A minimal abstraction for a generic, vendor-agnostic messages format and LLM client, allowing for building features without using model-specific APIs.

See details.

An implementation of the above that uses the OpenAI chat completion endpoint is available here.

Chains

A common interface for chains. Chains are regular async functions that can execute an arbitrary number of steps, including calling a LLM via a model client.

See details.

Usage

Install the package

pnpm i @webstudio-is/ai

For an example usage check out the base example and the copywriter chain that generates copy for Webstudio.

Prompt templates

This package comes with a small CLI that allows to turn prompt templates from markdown files to TypeScript modules, which is what you would use in your chain.

pnpm run build:prompts