0 Fork 0

mirror of https://github.com/webstudio-is/webstudio.git synced 2026-11-05 03:28:59 +09:00

Files

T

Bogdan Chadkin 6f3ac9d20a refactor: drop fetch polyfills (#3125 )

Remix Vite no longer polyfills streams and fetch.
Should be safe to drop them.

Stream polyfills broke ai, fetch broke trpc.

2024-04-10 10:56:56 +07:00

gpt.ts

refactor: drop fetch polyfills (#3125 )

2024-04-10 10:56:56 +07:00

index.ts

refactor: Replace request helper with ai request handler (#2433 )

2023-10-09 11:41:46 +02:00

README.md

refactor: Rename StreamingTextResponse to RemixStreamingTextResponse (#2434 )

2023-10-09 15:50:55 +02:00

README.md

Models

The Webstudio AI package contemplates a generic, vendor-agnostic messages format and LLM client.

Each vendor (eg. OpenAI) implementation follows the same API and is passed to chains which can use them to interact with a model. This allows to swap LLM without having to modify the chain(s).

export type Model<ModelMessageFormat> = {
  // Turns ModelMessages into a model-specific messages format.
  generateMessages: ModelGenerateMessages<ModelMessageFormat>;
  // JSON completion.
  completion: ModelCompletion<ModelMessageFormat>;
  // Streaming completion.
  completionStream: ModelCompletionStream<ModelMessageFormat>;
};

Currently the package offers an implementation that allows to use OpenAI's Chat Completion endpoint.

Please refer to the type definitions for the baseline vendor-agnostic format and the OpenAI implementation in this folder for an example.