Class EdgeAi

The edgeAi namespace on a BoxApplet. Talks directly to the box over HTTP. Obtained via applet.edgeAi.

Index

Methods

getImageEmbedding loadModel runPrompt streamPrompt new

Methods

getImageEmbedding

getImageEmbedding(
    model: Model,
    image: ImageBytes,
    options?: { abortSignal?: AbortSignal },
): Promise<ImageEmbeddingRef>
Encode an image on the box for model, returning an ImageEmbeddingRef to reuse across prompts. The ref is only valid for model.
Parameters
- model: Model
- image: ImageBytes
- Optionaloptions: { abortSignal?: AbortSignal }
Returns Promise<ImageEmbeddingRef>
- Defined in src/edge-ai.ts:90

loadModel

loadModel(model: Model): Promise<void>
Load a model onto the box (starts/keeps it resident). Rejects if it fails.
Parameters
- model: Model
Returns Promise<void>
- Defined in src/edge-ai.ts:80

runPrompt

runPrompt(
    model: Model,
    prompt: string,
    options?: PromptOptions,
): Promise<string>
Run a one-shot prompt against a loaded model and return the full response.
Parameters
- model: Model
- prompt: string
- Optionaloptions: PromptOptions
Returns Promise<string>
- Defined in src/edge-ai.ts:126

streamPrompt

streamPrompt(
    model: Model,
    prompt: string,
    options?: Omit<PromptOptions, "abortSignal">,
): PromptStream
Run a prompt and stream the generated tokens as they arrive (SSE).
Parameters
- model: Model
- prompt: string
- Optionaloptions: Omit<PromptOptions, "abortSignal">
Returns PromptStream
- Defined in src/edge-ai.ts:143

`Static`new

new(
    featureEnabled: boolean,
    info: UndefinedToOptional<{ token: string; url: string }> | undefined,
    logger: Logger,
): EdgeAi
Create a EdgeAi instance.

If the feature is not enabled or the info is undefined then a stub is returned that will error.

TODO IGNT-895: Make sure the returned stub properly returns an error state
Parameters
- featureEnabled: boolean
- info: UndefinedToOptional<{ token: string; url: string }> | undefined
- logger: Logger
Returns EdgeAi
- Defined in src/edge-ai.ts:69