transformer_lens.pretrained package

Subpackages

• transformer_lens.pretrained.weight_conversions package
  • Submodules
    • transformer_lens.pretrained.weight_conversions.apertus module
      • convert_apertus_weights()
    • transformer_lens.pretrained.weight_conversions.bert module
    • transformer_lens.pretrained.weight_conversions.bloom module
      • convert_bloom_weights()
    • transformer_lens.pretrained.weight_conversions.coder module
      • convert_coder_weights()
    • transformer_lens.pretrained.weight_conversions.gemma module
    • transformer_lens.pretrained.weight_conversions.gpt2 module
    • transformer_lens.pretrained.weight_conversions.gptj module
    • transformer_lens.pretrained.weight_conversions.hubert module
      • convert_hubert_weights()
    • transformer_lens.pretrained.weight_conversions.llama module
    • transformer_lens.pretrained.weight_conversions.mingpt module
    • transformer_lens.pretrained.weight_conversions.mistral module
      • convert_mistral_weights()
    • transformer_lens.pretrained.weight_conversions.mixtral module
      • convert_mixtral_weights()
    • transformer_lens.pretrained.weight_conversions.nanogpt module
    • transformer_lens.pretrained.weight_conversions.neel_solu_old module
    • transformer_lens.pretrained.weight_conversions.neo module
    • transformer_lens.pretrained.weight_conversions.neox module
    • transformer_lens.pretrained.weight_conversions.olmo module
      • convert_olmo_weights()
    • transformer_lens.pretrained.weight_conversions.olmo2 module
      • convert_olmo2_weights()
    • transformer_lens.pretrained.weight_conversions.olmo3 module
      • convert_olmo3_weights()
    • transformer_lens.pretrained.weight_conversions.olmoe module
      • convert_olmoe_weights()
    • transformer_lens.pretrained.weight_conversions.openai module
      • convert_gpt_oss_weights()
    • transformer_lens.pretrained.weight_conversions.opt module
    • transformer_lens.pretrained.weight_conversions.phi module
      • convert_phi_weights()
    • transformer_lens.pretrained.weight_conversions.phi3 module
      • convert_phi3_weights()
    • transformer_lens.pretrained.weight_conversions.qwen module
      • convert_qwen_weights()
    • transformer_lens.pretrained.weight_conversions.qwen2 module
      • convert_qwen2_weights()
    • transformer_lens.pretrained.weight_conversions.qwen3 module
      • convert_qwen3_weights()
    • transformer_lens.pretrained.weight_conversions.t5 module
      • convert_t5_weights()
  • Module contents

Module contents

Pretrained model utilities and weight conversions.