transformer_lens.model_bridge.supported_architectures.ernie4_5 module¶
ERNIE 4.5 architecture adapter.
Baidu’s dense ERNIE 4.5 (Ernie4_5ForCausalLM) is a Llama-layout decoder —
RMSNorm + RoPE + GQA + gated MLP under identical module paths — with
config-gated biases (use_bias) and no BOS prepending.
- class transformer_lens.model_bridge.supported_architectures.ernie4_5.Ernie4_5ArchitectureAdapter(cfg: Any)¶
Bases:
LlamaArchitectureAdapterArchitecture adapter for Ernie4_5ForCausalLM models.