mirror of
https://github.com/openclaw/openclaw.git
synced 2026-05-06 14:00:47 +00:00
GLM (docs/providers/glm.md): rewrote against extensions/zai/openclaw.plugin.json.
Removed the duplicate '# GLM models' H1 (Mintlify renders title from
frontmatter; an in-body H1 produces a brittle anchor). Replaced the
two-column model table with a single Notes column covering all 13
bundled refs, including which are reasoning, which accept image input,
and which is the default image model (zai/glm-4.6v from the auto-routing
defaults). Expanded the auth-choice step into a CodeGroup covering all
five onboarding choices (zai-api-key, zai-coding-global, zai-coding-cn,
zai-global, zai-cn) sourced from the plugin manifest's
providerAuthChoices.
Runway (docs/providers/runway.md): expanded the supported-modes table
to cover all seven Runway models from
extensions/runway/video-generation-provider.ts. Text-to-video now lists
veo3, veo3.1, veo3.1_fast alongside gen4.5; image-to-video adds
gen4_turbo, gen3a_turbo, veo3, veo3.1, and veo3.1_fast. Added an
aspect-ratio table covering the documented RUNWAY_TEXT_ASPECT_RATIOS
('16:9'/'9:16') and RUNWAY_EDIT_ASPECT_RATIOS ('1:1'/'16:9'/'9:16'/
'3:4'/'4:3'/'21:9'). Promoted the existing properties table with
plugin/onboarding/CLI flag rows from the manifest.
Vydra (docs/providers/vydra.md): added a properties table sourced from
extensions/vydra/openclaw.plugin.json, including the three
providerAuthContract memberships (image/video/speech) and the
vydra-api-key onboarding choice plus --vydra-api-key direct flag. Kept
the existing Warning about the apex-host redirect intact.
181 lines
5.4 KiB
Markdown
181 lines
5.4 KiB
Markdown
---
|
|
summary: "Use Vydra image, video, and speech in OpenClaw"
|
|
read_when:
|
|
- You want Vydra media generation in OpenClaw
|
|
- You need Vydra API key setup guidance
|
|
title: "Vydra"
|
|
---
|
|
|
|
The bundled Vydra plugin adds:
|
|
|
|
- Image generation via `vydra/grok-imagine`
|
|
- Video generation via `vydra/veo3` and `vydra/kling`
|
|
- Speech synthesis via Vydra's ElevenLabs-backed TTS route
|
|
|
|
OpenClaw uses the same `VYDRA_API_KEY` for all three capabilities.
|
|
|
|
| Property | Value |
|
|
| --------------- | ------------------------------------------------------------------------- |
|
|
| Provider id | `vydra` |
|
|
| Plugin | bundled, `enabledByDefault: true` |
|
|
| Auth env var | `VYDRA_API_KEY` |
|
|
| Onboarding flag | `--auth-choice vydra-api-key` |
|
|
| Direct CLI flag | `--vydra-api-key <key>` |
|
|
| Contracts | `imageGenerationProviders`, `videoGenerationProviders`, `speechProviders` |
|
|
| Base URL | `https://www.vydra.ai/api/v1` (use the `www` host) |
|
|
|
|
<Warning>
|
|
Use `https://www.vydra.ai/api/v1` as the base URL. Vydra's apex host (`https://vydra.ai/api/v1`) currently redirects to `www`. Some HTTP clients drop `Authorization` on that cross-host redirect, which turns a valid API key into a misleading auth failure. The bundled plugin uses the `www` base URL directly to avoid that.
|
|
</Warning>
|
|
|
|
## Setup
|
|
|
|
<Steps>
|
|
<Step title="Run interactive onboarding">
|
|
```bash
|
|
openclaw onboard --auth-choice vydra-api-key
|
|
```
|
|
|
|
Or set the env var directly:
|
|
|
|
```bash
|
|
export VYDRA_API_KEY="vydra_live_..."
|
|
```
|
|
|
|
</Step>
|
|
<Step title="Choose a default capability">
|
|
Pick one or more of the capabilities below (image, video, or speech) and apply the matching configuration.
|
|
</Step>
|
|
</Steps>
|
|
|
|
## Capabilities
|
|
|
|
<AccordionGroup>
|
|
<Accordion title="Image generation">
|
|
Default image model:
|
|
|
|
- `vydra/grok-imagine`
|
|
|
|
Set it as the default image provider:
|
|
|
|
```json5
|
|
{
|
|
agents: {
|
|
defaults: {
|
|
imageGenerationModel: {
|
|
primary: "vydra/grok-imagine",
|
|
},
|
|
},
|
|
},
|
|
}
|
|
```
|
|
|
|
Current bundled support is text-to-image only. Vydra's hosted edit routes expect remote image URLs, and OpenClaw does not add a Vydra-specific upload bridge in the bundled plugin yet.
|
|
|
|
<Note>
|
|
See [Image Generation](/tools/image-generation) for shared tool parameters, provider selection, and failover behavior.
|
|
</Note>
|
|
|
|
</Accordion>
|
|
|
|
<Accordion title="Video generation">
|
|
Registered video models:
|
|
|
|
- `vydra/veo3` for text-to-video
|
|
- `vydra/kling` for image-to-video
|
|
|
|
Set Vydra as the default video provider:
|
|
|
|
```json5
|
|
{
|
|
agents: {
|
|
defaults: {
|
|
videoGenerationModel: {
|
|
primary: "vydra/veo3",
|
|
},
|
|
},
|
|
},
|
|
}
|
|
```
|
|
|
|
Notes:
|
|
|
|
- `vydra/veo3` is bundled as text-to-video only.
|
|
- `vydra/kling` currently requires a remote image URL reference. Local file uploads are rejected up front.
|
|
- Vydra's current `kling` HTTP route has been inconsistent about whether it requires `image_url` or `video_url`; the bundled provider maps the same remote image URL into both fields.
|
|
- The bundled plugin stays conservative and does not forward undocumented style knobs such as aspect ratio, resolution, watermark, or generated audio.
|
|
|
|
<Note>
|
|
See [Video Generation](/tools/video-generation) for shared tool parameters, provider selection, and failover behavior.
|
|
</Note>
|
|
|
|
</Accordion>
|
|
|
|
<Accordion title="Video live tests">
|
|
Provider-specific live coverage:
|
|
|
|
```bash
|
|
OPENCLAW_LIVE_TEST=1 \
|
|
OPENCLAW_LIVE_VYDRA_VIDEO=1 \
|
|
pnpm test:live -- extensions/vydra/vydra.live.test.ts
|
|
```
|
|
|
|
The bundled Vydra live file now covers:
|
|
|
|
- `vydra/veo3` text-to-video
|
|
- `vydra/kling` image-to-video using a remote image URL
|
|
|
|
Override the remote image fixture when needed:
|
|
|
|
```bash
|
|
export OPENCLAW_LIVE_VYDRA_KLING_IMAGE_URL="https://example.com/reference.png"
|
|
```
|
|
|
|
</Accordion>
|
|
|
|
<Accordion title="Speech synthesis">
|
|
Set Vydra as the speech provider:
|
|
|
|
```json5
|
|
{
|
|
messages: {
|
|
tts: {
|
|
provider: "vydra",
|
|
providers: {
|
|
vydra: {
|
|
apiKey: "${VYDRA_API_KEY}",
|
|
voiceId: "21m00Tcm4TlvDq8ikWAM",
|
|
},
|
|
},
|
|
},
|
|
},
|
|
}
|
|
```
|
|
|
|
Defaults:
|
|
|
|
- Model: `elevenlabs/tts`
|
|
- Voice id: `21m00Tcm4TlvDq8ikWAM`
|
|
|
|
The bundled plugin currently exposes one known-good default voice and returns MP3 audio files.
|
|
|
|
</Accordion>
|
|
</AccordionGroup>
|
|
|
|
## Related
|
|
|
|
<CardGroup cols={2}>
|
|
<Card title="Provider directory" href="/providers/index" icon="list">
|
|
Browse all available providers.
|
|
</Card>
|
|
<Card title="Image generation" href="/tools/image-generation" icon="image">
|
|
Shared image tool parameters and provider selection.
|
|
</Card>
|
|
<Card title="Video generation" href="/tools/video-generation" icon="video">
|
|
Shared video tool parameters and provider selection.
|
|
</Card>
|
|
<Card title="Configuration reference" href="/gateway/config-agents#agent-defaults" icon="gear">
|
|
Agent defaults and model configuration.
|
|
</Card>
|
|
</CardGroup>
|