Vercel AI SDK

Wire abliteration.ai into the Vercel AI SDK using the OpenAI-compatible provider.

The Vercel AI SDK works with abliteration.ai through the @ai-sdk/openai-compatible provider.

Install

npm install ai @ai-sdk/openai-compatible

Provider

import { createOpenAICompatible } from "@ai-sdk/openai-compatible";

const ablit = createOpenAICompatible({
  name: "abliteration",
  baseURL: "https://api.abliteration.ai/v1",
  apiKey: process.env.ABLIT_KEY,
});

Generate

import { generateText } from "ai";

const { text } = await generateText({
  model: ablit("abliterated-model"),
  prompt: "Hello",
});

Stream in a Next.js route

// app/api/chat/route.ts
import { streamText } from "ai";

export async function POST(req: Request) {
  const { messages } = await req.json();
  const result = streamText({
    model: ablit("abliterated-model"),
    messages,
  });
  return result.toDataStreamResponse();
}

Works in Node, Edge, and Bun runtimes.