transformer_lens.model_bridge.supported_architectures.gemma3 module

Gemma3 architecture adapter.

class transformer_lens.model_bridge.supported_architectures.gemma3.Gemma3ArchitectureAdapter(cfg: Any)

Bases: ArchitectureAdapter

Architecture adapter for Gemma3 models.

__init__(cfg: Any) → None

Initialize the Gemma3 architecture adapter.

setup_component_testing(hf_model: Any, bridge_model: Any = None) → None

Wire local RoPE + eager attention; q/k norms delegate to HF autograd.

Gemma-3 uses dual RoPE (global + local); component tests share the local instance across all layers (layers on global RoPE accept the tradeoff).