Coverage for transformer_lens/model_bridge/sources/vllm/__init__.py: 100%

1"""vLLM source for TransformerBridge. 

2 

3Provides :func:`boot_vllm`, which constructs a vLLM ``LLM`` and wraps its 

4inner ``nn.Module`` in a :class:`TransformerBridge`. vLLM drives the forward 

5pass (PagedAttention, ``torch.compile``, CUDA graphs); the bridge surface is 

6populated from GPU buffers written by hooks the plugin installs pre-compile. 

7""" 

8from __future__ import annotations 

9 

10from .source import boot_vllm 

11 

12__all__ = ["boot_vllm"]