transformer_lens.utilities.matrix module

matrix.

This module contains utility functions related to the transformer lens implementation of factored matrices.

transformer_lens.utilities.matrix.composition_scores(left: FactoredMatrix, right: FactoredMatrix, broadcast_dims=True) → Float[Tensor, '*leading_dims'] | Float[Tensor, '*leading_dims_left_and_right']

See HookedTransformer.all_composition_scores for documentation.

transformer_lens.utilities.matrix.get_matrix_corner(matrix: FactoredMatrix, n=3)