embeddings

embeddings#

Structs for handling tokens.

Classes

ApplyRoPE

Adjusts input embeddings using rotary position embeddings (RoPE).

EmbeddingDecode

Uses an embedding table to map embeddings back to token scores.

EmbeddingLookup

Looks up token IDs in an embedding table.

EmbeddingTable

A table of embedding vectors for a vocabulary of tokens.