diff --git a/docs/providers/groq.md b/docs/providers/groq.md new file mode 100644 index 00000000000..cbbac8dbb59 --- /dev/null +++ b/docs/providers/groq.md @@ -0,0 +1,96 @@ +--- +title: "Groq" +summary: "Groq setup (auth + model selection)" +read_when: + - You want to use Groq with OpenClaw + - You need the API key env var or CLI auth choice +--- + +# Groq + +[Groq](https://groq.com) provides ultra-fast inference on open-source models +(Llama, Gemma, Mistral, and more) using custom LPU hardware. OpenClaw connects +to Groq through its OpenAI-compatible API. + +- Provider: `groq` +- Auth: `GROQ_API_KEY` +- API: OpenAI-compatible + +## Quick start + +1. Get an API key from [console.groq.com/keys](https://console.groq.com/keys). + +2. Set the API key: + +```bash +export GROQ_API_KEY="gsk_..." +``` + +3. Set a default model: + +```json5 +{ + agents: { + defaults: { + model: { primary: "groq/llama-3.3-70b-versatile" }, + }, + }, +} +``` + +## Config file example + +```json5 +{ + env: { GROQ_API_KEY: "gsk_..." }, + agents: { + defaults: { + model: { primary: "groq/llama-3.3-70b-versatile" }, + }, + }, +} +``` + +## Audio transcription + +Groq also provides fast Whisper-based audio transcription. When configured as a +media-understanding provider, OpenClaw uses Groq's `whisper-large-v3-turbo` +model to transcribe voice messages. + +```json5 +{ + media: { + understanding: { + audio: { + models: [{ provider: "groq" }], + }, + }, + }, +} +``` + +## Environment note + +If the Gateway runs as a daemon (launchd/systemd), make sure `GROQ_API_KEY` is +available to that process (for example, in `~/.openclaw/.env` or via +`env.shellEnv`). + +## Available models + +Groq's model catalog changes frequently. Run `openclaw models list | grep groq` +to see currently available models, or check +[console.groq.com/docs/models](https://console.groq.com/docs/models). + +Popular choices include: + +- **Llama 3.3 70B Versatile** - general-purpose, large context +- **Llama 3.1 8B Instant** - fast, lightweight +- **Gemma 2 9B** - compact, efficient +- **Mixtral 8x7B** - MoE architecture, strong reasoning + +## Links + +- [Groq Console](https://console.groq.com) +- [API Documentation](https://console.groq.com/docs) +- [Model List](https://console.groq.com/docs/models) +- [Pricing](https://groq.com/pricing) diff --git a/docs/providers/index.md b/docs/providers/index.md index be2b5154f61..93ccdf27635 100644 --- a/docs/providers/index.md +++ b/docs/providers/index.md @@ -31,6 +31,7 @@ Looking for chat channel docs (WhatsApp/Telegram/Discord/Slack/Mattermost (plugi - [Cloudflare AI Gateway](/providers/cloudflare-ai-gateway) - [GLM models](/providers/glm) - [Google (Gemini)](/providers/google) +- [Groq (LPU inference)](/providers/groq) - [Hugging Face (Inference)](/providers/huggingface) - [Kilocode](/providers/kilocode) - [LiteLLM (unified gateway)](/providers/litellm)