Local LLM API OpenAI 兼容

Base URL https://huakuo-1.tailaa2acd.ts.net/v1 · 模型 qwen2.5:latest · 由本机 Ollama 提供算力

鉴权

所有 /v1/* 请求需带请求头:Authorization: Bearer <你的-api-key>

可用模型(5 个)

在请求体里用 model 字段指定;不传则用默认的 qwen2.5:latest。 程序里也可以调 GET /v1/models 拿到同款清单(含 capabilities 字段)。

模型参数大小上下文能力速度
qwen2.5:latest 默认7.6B4.7 GB32,768completion, tools快
qwen3.5:latest9.7B6.6 GB262,144completion, vision, tools, thinking中等
qwen3:4b4.0B2.5 GB262,144completion, tools, thinking快
qwen3-vl:30b ⚠️31.1B19 GB262,144completion, vision, tools, thinking🐢 很慢
qwen2.5:0.5b494M0.4 GB32,768completion, tools⚡ 极快

支持的接口

方法路径说明
POST/v1/chat/completions对话补全,支持 stream: true
POST/v1/completions传统文本补全
GET/v1/models模型列表
GET/health健康检查(无需鉴权)

curl

curl https://huakuo-1.tailaa2acd.ts.net/v1/chat/completions \
  -H "Authorization: Bearer $API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"qwen2.5:latest","messages":[{"role":"user","content":"你好,用一句话介绍你自己"}]}'

OpenAI Python SDK

pip install openai

from openai import OpenAI
client = OpenAI(base_url="https://huakuo-1.tailaa2acd.ts.net/v1", api_key="你的-api-key")

r = client.chat.completions.create(
    model="qwen2.5:latest",
    messages=[{"role": "user", "content": "你好"}],
)
print(r.choices[0].message.content)

OpenAI Node SDK

npm i openai

import OpenAI from "openai";
const client = new OpenAI({ baseURL: "https://huakuo-1.tailaa2acd.ts.net/v1", apiKey: "你的-api-key" });

const r = await client.chat.completions.create({
  model: "qwen2.5:latest",
  messages: [{ role: "user", content: "你好" }],
});
console.log(r.choices[0].message.content);

流式(SSE)

curl -N https://huakuo-1.tailaa2acd.ts.net/v1/chat/completions \
  -H "Authorization: Bearer $API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"qwen2.5:latest","stream":true,"messages":[{"role":"user","content":"数到五"}]}'

限流

每个 API Key 默认 60 请求/分钟,超限返回 429 并附 Retry-After。