transformer_lens.benchmarks.activation_cache module¶

Activation cache benchmarks for TransformerBridge.

transformer_lens.benchmarks.activation_cache.benchmark_activation_cache(bridge: TransformerBridge, test_text: str, reference_model: HookedTransformer | None = None, tolerance: float = 0.001) → BenchmarkResult¶

Benchmark activation cache values against reference model.

Parameters:

bridge – TransformerBridge model to test
test_text – Input text for testing
reference_model – Optional HookedTransformer reference model
tolerance – Tolerance for activation comparison

Returns:

BenchmarkResult with cache value comparison details

transformer_lens.benchmarks.activation_cache.benchmark_run_with_cache(bridge: TransformerBridge, test_text: str, reference_model: HookedTransformer | None = None) → BenchmarkResult¶

Benchmark run_with_cache functionality.

Parameters:

bridge – TransformerBridge model to test
test_text – Input text for testing
reference_model – Optional HookedTransformer reference model

Returns:

BenchmarkResult with cache functionality details