transformer_lens.model_bridge.supported_architectures.phi module

Phi architecture adapter.

class transformer_lens.model_bridge.supported_architectures.phi.PhiArchitectureAdapter(cfg: Any)

Bases: ArchitectureAdapter

Architecture adapter for Phi models.

__init__(cfg: Any) → None

Initialize the Phi architecture adapter.

Parameters:

cfg – The configuration object.

component_mapping: ComponentMapping | None

default_cfg: dict[str, Any] = {'use_fast': False}

uses_split_attention: bool

weight_processing_conversions: Dict[str, ParamProcessingConversion | str] | None