openclaw/docs/providers/deepinfra.md at d124fb235f427770e13a63e79414f7f102937cd0

mirror of https://github.com/openclaw/openclaw.git synced 2026-08-03 23:31:42 +00:00

Files

Georgi Atsev bb3f6c56cd fix(deepinfra): use OpenAI video end point and tag DeepSeek thinking format (#95824 )

* fix(deepinfra): tag DeepSeek thinking format and use OpenAI video endpoint

Route DeepInfra video generation through the OpenAI-compatible async
/v1/openai/videos endpoint (submit, then poll) with live video-gen tag
discovery, replacing the retired native /v1/inference path; doctor
migrates api.deepinfra.com URLs and the provider fails closed with an
actionable error on retired custom native endpoints without echoing
configured URLs (they may carry credentials).

Tag the deepseek-ai/* family with thinkingFormat "deepseek" so core
strips/recovers reasoning_content and DSML tool-call markup instead of
leaking it into replies, and mark reasoning-tagged models as
reasoning-capable.

Redaction tests assemble credential-shaped fixture URLs from string
pieces so TruffleHog's URI detector does not flag them. Docs describe
the per-surface static defaults with live discovery expanding the
selectable model lists.

* fix(deepinfra): preserve custom video output host

---------

Co-authored-by: Jacob Tomlinson <jacobtomlinson@users.noreply.github.com>

2026-07-22 15:31:06 +01:00

4.5 KiB

Raw Blame History

summary, read_when, title

summary

read_when

title

Use DeepInfra's unified API to access the most popular open source and frontier models in OpenClaw

You want a single API key for the top open source LLMs

You want to run models via DeepInfra's API in OpenClaw

DeepInfra

DeepInfra routes requests to popular open source and frontier models behind a single OpenAI-compatible endpoint and API key. Most OpenAI SDKs work against it by switching the base URL.

Install plugin

openclaw plugins install @openclaw/deepinfra-provider
openclaw gateway restart

Get an API key

Sign in at deepinfra.com
Go to Dashboard / Keys and generate a key, or use the auto-created one

CLI setup

openclaw onboard --deepinfra-api-key <key>

Or set the environment variable:

export DEEPINFRA_API_KEY="<your-deepinfra-api-key>" # pragma: allowlist secret

Config snippet

{
  env: { DEEPINFRA_API_KEY: "<your-deepinfra-api-key>" }, // pragma: allowlist secret
  agents: {
    defaults: {
      model: { primary: "deepinfra/deepseek-ai/DeepSeek-V4-Flash" },
    },
  },
}

Supported surfaces

Chat, image generation, and video generation refresh their model catalogs live from https://api.deepinfra.com/v1/openai/models?sort_by=openclaw&filter=with_meta once DEEPINFRA_API_KEY is configured. Live discovery expands the list of selectable models; the default model per surface stays the static value below. Other surfaces use static catalogs until they move onto the same live catalog.

Surface	Default model	OpenClaw config/tool
Chat / model provider	`deepseek-ai/DeepSeek-V4-Flash` (live catalog adds more chat models)	`agents.defaults.model`
Image generation/editing	`black-forest-labs/FLUX-1-schnell` (live catalog adds more `image-gen` models)	`image_generate`, `agents.defaults.mediaModels.image`
Media understanding	`moonshotai/Kimi-K2.5` for images	inbound image understanding
Speech-to-text	`openai/whisper-large-v3-turbo`	inbound audio transcription
Text-to-speech	`hexgrad/Kokoro-82M`	`tts.provider: "deepinfra"`
Video generation	`Pixverse/Pixverse-T2V` (live catalog adds more `video-gen` models)	`video_generate`, `agents.defaults.mediaModels.video`
Memory embeddings	`BAAI/bge-m3`	`memory.search.provider: "deepinfra"`

DeepInfra also exposes reranking, classification, object-detection, and other native model types. OpenClaw has no provider contract for those categories yet, so this plugin does not register them.

Available models

OpenClaw discovers DeepInfra models dynamically once a key is configured. Use /models deepinfra or openclaw models list --provider deepinfra to see the current list.

Any model on deepinfra.com works with the deepinfra/ prefix:

deepinfra/deepseek-ai/DeepSeek-V4-Flash
deepinfra/deepseek-ai/DeepSeek-V3.2
deepinfra/MiniMaxAI/MiniMax-M2.5
deepinfra/moonshotai/Kimi-K2.5
deepinfra/nvidia/NVIDIA-Nemotron-3-Super-120B-A12B
deepinfra/zai-org/GLM-5.1
...and many more

Notes

Model refs are deepinfra/<provider>/<model> (for example deepinfra/Qwen/Qwen3-Max).
Default chat model: deepinfra/deepseek-ai/DeepSeek-V4-Flash
Base URL: https://api.deepinfra.com/v1/openai
Video generation uses the OpenAI-compatible async endpoint https://api.deepinfra.com/v1/openai/videos (submit, then poll). A configured baseUrl is honored. openclaw doctor --fix migrates legacy nativeBaseUrl or /v1/inference values on api.deepinfra.com to baseUrl automatically; custom native endpoints are retired with a doctor notice and need a manually configured OpenAI-compatible baseUrl. Video generation fails with an actionable error (before sending any request) while baseUrl still targets the retired /v1/inference surface.

4.5 KiB Raw Blame History