embeddings#
Structs for handling tokens.
Classes
Adjusts input embeddings using rotary position embeddings (RoPE). |
|
Uses an embedding table to map embeddings back to token scores. |
|
Looks up token IDs in an embedding table. |
|
A table of embedding vectors for a vocabulary of tokens. |