transformer

Basic transformer backbone with variants.

Submodules

penzai.models.transformer.model_parts	Core components of a Transformer language model.
penzai.models.transformer.sampling_mode	Sampling-mode adapters for TransformerLM models.
penzai.models.transformer.simple_decoding_loop	A simple decoding loop for the transformer model.
penzai.models.transformer.variants	Concrete transformer variants.