penzai.experimental.v2.toolshed#
Submodules
Basic training logic for training simple models. |
|
Utility for capturing and analyzing a small subcomputation in a larger model. |
|
Utilities for JIT compilation of Penzai models. |
|
Low-rank adaptation (LoRA, Hu et al. 2021). |
|
Helper classes for rewiring, ablating, and intervening on model activations. |
|
Utilities to capture and hold intermediate values as a model runs. |
|
Utilities for working with sharded arrays and parameters in Penzai. |
|
Recursively transforms |