LlamaIndex

Use abliteration.ai as the LLM in LlamaIndex pipelines via the OpenAILike adapter.

To use LlamaIndex with abliteration.ai, instantiate OpenAILike with api_base="https://api.abliteration.ai/v1" and your ak_... key.

Install

pip install llama-index llama-index-llms-openai-like

Usage

from llama_index.llms.openai_like import OpenAILike

llm = OpenAILike(
    model="abliterated-model",
    api_base="https://api.abliteration.ai/v1",
    api_key=os.environ["ABLIT_KEY"],
    is_chat_model=True,
)

print(llm.complete("Hello").text)

See the compatibility matrix for what’s supported.