Coverage for transformer_lens/model_bridge/supported_architectures/falcon_mamba.py: 100%

1"""FalconMamba architecture adapter. 

2 

3TII's FalconMamba (``FalconMambaForCausalLM``) is Mamba-1 with one numerical 

4delta: a parameter-free RMS normalization applied to the B, C, and dt 

5projections inside the mixer (``rms_forward`` in the HF source). Module paths 

6are identical to Mamba, so the mapping is inherited wholesale; the RMS is 

7honored inside SSMMixerBridge's eager scan and S6 reconstruction via the 

8wrapped mixer's ``rms_eps`` attribute. 

9""" 

10 

11from transformer_lens.model_bridge.supported_architectures.mamba import ( 

12 MambaArchitectureAdapter, 

13) 

14 

15 

16class FalconMambaArchitectureAdapter(MambaArchitectureAdapter): 

17 """Architecture adapter for FalconMambaForCausalLM models."""