transformer_lens.config package

Submodules

• transformer_lens.config.TransformerBridgeConfig module
  • TransformerBridgeConfig
    • TransformerBridgeConfig.__init__()
    • TransformerBridgeConfig.head_dim
• transformer_lens.config.TransformerLensConfig module
  • TransformerLensConfig
    • TransformerLensConfig.act_fn
    • TransformerLensConfig.attn_only
    • TransformerLensConfig.d_head
    • TransformerLensConfig.d_mlp
    • TransformerLensConfig.d_model
    • TransformerLensConfig.d_vocab
    • TransformerLensConfig.default_prepend_bos
    • TransformerLensConfig.device
    • TransformerLensConfig.dtype
    • TransformerLensConfig.eps
    • TransformerLensConfig.experts_per_token
    • TransformerLensConfig.final_rms
    • TransformerLensConfig.from_dict()
    • TransformerLensConfig.gated_mlp
    • TransformerLensConfig.layer_norm_folding
    • TransformerLensConfig.n_ctx
    • TransformerLensConfig.n_heads
    • TransformerLensConfig.n_key_value_heads
    • TransformerLensConfig.n_layers
    • TransformerLensConfig.normalization_type
    • TransformerLensConfig.num_experts
    • TransformerLensConfig.positional_embedding_type
    • TransformerLensConfig.to_dict()
    • TransformerLensConfig.unwrap()
    • TransformerLensConfig.use_attn_result
    • TransformerLensConfig.use_split_qkv_input
    • TransformerLensConfig.uses_rms_norm

Module contents

Configuration classes for TransformerLens.