transformer_lens.utilities.defaults_utils module¶

attribute_utils.

This module contains utility functions related to defaults

class transformer_lens.utilities.defaults_utils.LocallyOverridenDefaults(model, **overrides)¶

Bases: object

Context manager that allows temporary overriding of default values within a model. Once the context is exited, the default values are restored.

WARNING: This context manager must be used for any function/method that directly accesses default values which may be overridden by the user using the function/method’s arguments, e.g., model.cfg.default_prepend_bos and model.tokenizer.padding_side which can be overriden by prepend_bos and padding_side arguments, respectively, in the to_tokens.

__init__(model, **overrides)¶

Initializes the context manager.

Parameters:

model (HookedTransformer) – The model whose default values will be overridden.
overrides (dict) – Key-value pairs of properties to override and their new values.

transformer_lens.utilities.defaults_utils.override_or_use_default_value(default_flag: Any, override: Any | None = None) → Any¶: Determines which flag to return based on whether an overriding flag is provided. If a not-None overriding flag is provided, it is returned. Otherwise, the global flag is returned.