variants

Concrete transformer variants.

Submodules

penzai.models.transformer.variants.gemma	The Gemma architecture transformer variant.
penzai.models.transformer.variants.gpt_neox	Transformer variant for GPT-NeoX models.
penzai.models.transformer.variants.llama	Llama architecture transformer variant.
penzai.models.transformer.variants.llamalike_common	A common transformer family used by Llama, Mistral, Gemma, and other models.
penzai.models.transformer.variants.mistral	Mistral architecture transformer variant.