transformer_lens.cache package

Submodules

• transformer_lens.cache.key_value_cache module
  • TransformerLensKeyValueCache
    • TransformerLensKeyValueCache.__getitem__()
    • TransformerLensKeyValueCache.append_attention_mask()
    • TransformerLensKeyValueCache.entries
    • TransformerLensKeyValueCache.freeze()
    • TransformerLensKeyValueCache.frozen
    • TransformerLensKeyValueCache.init_cache()
    • TransformerLensKeyValueCache.previous_attention_mask
    • TransformerLensKeyValueCache.unfreeze()
• transformer_lens.cache.key_value_cache_entry module
  • TransformerLensKeyValueCacheEntry
    • TransformerLensKeyValueCacheEntry.append()
    • TransformerLensKeyValueCacheEntry.frozen
    • TransformerLensKeyValueCacheEntry.init_cache_entry()
    • TransformerLensKeyValueCacheEntry.past_keys
    • TransformerLensKeyValueCacheEntry.past_values

Module contents

Cache package for TransformerLens key-value caching utilities.