Skip to main content

Ctrl+K

penzai

Guides

How to Think in Penzai
Pretty-Printing With Treescope
Visualizing NDArrays with Treescope
Selectors and Selections
Named Axes in Penzai
Data Effects - Scoped Side Effects and State in Penzai Models
Jitting and Sharding Penzai Models

Example Notebooks

LoRA From Scratch - Patching Pretrained Models in Penzai
Induction Heads in Gemma 7B
Gemma From Scratch: Inspecting and Re-implementing Gemma with Penzai

API Reference

pz: Penzai’s alias namespace
penzai.core
penzai.nn
penzai.data_effects
penzai.treescope

Extras

penzai.toolshed
penzai.example_models
- gemma
- simple_mlp
  - DropoutMLP
  - MLP

Repository
Open issue

.rst

simple_mlp

simple_mlp#

A simple multi-layer perceptron.

Classes

`DropoutMLP`	Sequence of Affine layers with dropout.
`MLP`	Sequence of Affine layers.

previous

temperature_sample_pyloop

next

DropoutMLP

By the Penzai Authors

© Copyright 2024, The Penzai Authors.