embeddings

embeddings#

Structs for handling tokens.

Classes

ApplyRoPE

Adjusts input embeddings using rotary position embeddings (RoPE).

ApplyRoPEToSubset

Adjusts a subset of embeddings using rotary position embeddings (RoPE).

EmbeddingDecode

Uses an embedding table to map embeddings back to token scores.

EmbeddingLookup

Looks up token IDs in an embedding table.

EmbeddingTable

A table of embedding vectors for a vocabulary of tokens.