Peter Steinberger 658b601ee5 feat(llama-cpp): in-process local GGUF text inference provider (#109444) ...

* feat(llama-cpp): add in-process text inference

* test(llama-cpp): narrow setup provider fixture

* fix(llama-cpp): trim public surface and refresh docs map

* fix(llama-cpp): import Context type in inference test

2026-07-16 18:53:55 -07:00

..

acpx.md

…

admin-http-rpc.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

alibaba.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

amazon-bedrock-mantle.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

amazon-bedrock.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

anthropic-vertex.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

anthropic.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

arcee.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

azure-speech.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

baseten.md

feat: add Baseten Model API provider (#108708)

2026-07-16 07:41:33 -07:00

bonjour.md

…

brave.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

browser.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

byteplus.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

canvas.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

cerebras.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

chutes.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

clawrouter.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

clickclack.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

cloudflare-ai-gateway.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

codex.md

fix(codex): remove duplicate provider setup choice (#107979)

2026-07-16 03:31:11 -07:00

cohere.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

comfy.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

copilot-proxy.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

copilot.md

…

crabbox.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

deepgram.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

deepinfra.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

deepseek.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

diagnostics-otel.md

…

diagnostics-prometheus.md

…

diffs-language-pack.md

…

diffs.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

discord.md

fix(codex): remove duplicate provider setup choice (#107979)

2026-07-16 03:31:11 -07:00

document-extract.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

duckduckgo.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

elevenlabs.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

exa.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

fal.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

featherless.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

feishu.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

file-transfer.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

firecrawl.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

fireworks.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

github-copilot.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

gmi.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

google-meet.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

google.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

googlechat.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

gradium.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

groq.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

huggingface.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

imessage.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

inworld.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

irc.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

kilocode.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

kimi.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

line.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

linux-canvas.md

feat(linux): canvas UI via CLI-node + Tauri app IPC bridge (#107633)

2026-07-14 16:05:14 -07:00

linux-node.md

…

litellm.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

llama-cpp.md

feat(llama-cpp): in-process local GGUF text inference provider (#109444)

2026-07-16 18:53:55 -07:00

llm-task.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

lmstudio.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

lobster.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

logbook.md

…

longcat.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

matrix.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

mattermost.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

memory-core.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

memory-lancedb.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

memory-wiki.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

meta.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

microsoft-foundry.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

microsoft.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

migrate-claude.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

migrate-hermes.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

minimax.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

mistral.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

moonshot.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

msteams.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

mxc.md

…

nextcloud-talk.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

nostr.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

novita.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

nvidia.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

oc-path.md

…

ollama.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

onepassword.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

open-prose.md

…

openai.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

opencode-go.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

opencode.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

openrouter.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

openshell.md

…

perplexity.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

pixverse.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

policy.md

…

qa-channel.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

qa-lab.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

qianfan.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

qqbot.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

qwen.md

fix(models): refresh bundled provider catalogs (#109410)

2026-07-16 16:47:25 -07:00

raft.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

reef.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

runway.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

searxng.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

senseaudio.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

sglang.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

signal.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

slack.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

sms.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

stepfun.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

synology-chat.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

synthetic.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

tavily.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

telegram.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

tencent.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

tlon.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

together.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

tokenjuice.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

tts-local-cli.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

twitch.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

vault.md

…

venice.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

vercel-ai-gateway.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

vllm.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

voice-call.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

volcengine.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

voyage.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

vydra.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

web-readability.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

webhooks.md

…

whatsapp.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

workboard.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

workspaces.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

xai.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

xiaomi.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

zai.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

zalo.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00

zalouser.md

fix(docs): preserve plugin surface identifiers

2026-07-14 23:41:24 -04:00