Type Alias Tokenization

What EdgeAi.tokenize returns: the tokens, plus the context window they have to fit in.

type Tokenization = {
maxContextLen: number;
tokens: number[];
}

Index

Properties

maxContextLen tokens

Properties

maxContextLen

maxContextLen: number

The model's context window in tokens. The input and the generated reply together must fit inside it.

tokens

tokens: number[]

The prompt's token ids.