transformer_lens.model_bridge.supported_architectures.ministral3 module¶
Ministral 3 (Ministral3ForCausalLM) adapter: Mistral module tree (subclasses
the Mistral adapter), plus a llama-4 positional query scale applied after RoPE.
- class transformer_lens.model_bridge.supported_architectures.ministral3.Ministral3ArchitectureAdapter(cfg: Any)¶
Bases:
MistralArchitectureAdapterArchitecture adapter for Ministral3ForCausalLM models.