Using in LangChain

Usage with LangChain (TypeScript)

import dotenv from "dotenv";
import { ChatOpenAI } from "@langchain/openai";

dotenv.config();

const API_TOKEN = process.env.IONOS_API_TOKEN;

const client = new ChatOpenAI({
  apiKey: API_TOKEN,
  model: "meta-llama/Meta-Llama-3.1-8B-Instruct",
  configuration: {
    baseURL: "https://openai.inference.de-txl.ionos.com/v1",
  },
});

const completion = await client.invoke(
  "How is the weather today in New York City?",
);
console.log(completion.content);

Using in AI SDK

Using in OpenCode

Using in n8n