Coverage for transformer_lens/model_bridge/supported_architectures/blenderbot.py: 100%

1"""Blenderbot (``BlenderbotForConditionalGeneration``) adapter: Pegasus-style 

2pre-norm encoder-decoder with learned pos-embeds and baked-in embedding scale (so 

3embed hooks see already-scaled output); asymmetric stacks, n_layers follows the decoder.""" 

4 

5from transformer_lens.model_bridge.supported_architectures.bart import ( 

6 BartFamilyArchitectureAdapter, 

7) 

8 

9 

10class BlenderbotArchitectureAdapter(BartFamilyArchitectureAdapter): 

11 """Architecture adapter for BlenderbotForConditionalGeneration models.""" 

12 

13 require_symmetric_layers = False 

14 n_layers_from = "decoder" 

15 has_final_stack_norm = True