mirror of
https://github.com/openclaw/openclaw.git
synced 2026-07-23 02:51:13 +00:00
44 lines
1.5 KiB
Markdown
44 lines
1.5 KiB
Markdown
# @openclaw/llama-cpp-provider
|
|
|
|
Official llama.cpp text-inference and embedding provider for OpenClaw.
|
|
|
|
This plugin runs local GGUF chat and embedding models in-process through
|
|
`node-llama-cpp`.
|
|
|
|
## Install
|
|
|
|
```bash
|
|
openclaw plugins install @openclaw/llama-cpp-provider
|
|
```
|
|
|
|
Restart the Gateway after installing or updating the plugin. Use Node 24 for
|
|
native installs and updates.
|
|
|
|
## Configure text inference
|
|
|
|
Choose **Local model (llama.cpp)** during onboarding. After explicit consent,
|
|
OpenClaw downloads Gemma 4 E4B IT Q4_K_M (approximately 5.0 GB) as the default.
|
|
The bundled download is offered only on machines with at least 16 GiB of RAM.
|
|
Discovery never downloads a model.
|
|
|
|
On smaller machines, use Ollama or LM Studio with a smaller model, use a cloud
|
|
provider, or configure any custom GGUF through `params.modelPath`. The 16 GiB
|
|
gate applies only to OpenClaw's bundled default download; custom GGUF models
|
|
remain available on any machine.
|
|
|
|
See the [llama.cpp provider guide](https://docs.openclaw.ai/plugins/llama-cpp)
|
|
for custom GGUF model configuration and hardware guidance.
|
|
|
|
## Configure embeddings
|
|
|
|
Set `agents.defaults.memorySearch.provider` to `local`. By default, the plugin
|
|
downloads and uses the EmbeddingGemma GGUF model. Configure
|
|
`agents.defaults.memorySearch.local.modelPath` to use another local path, Hugging
|
|
Face model URI, or HTTPS model URL.
|
|
|
|
## Package
|
|
|
|
- Plugin id: `llama-cpp`
|
|
- Package: `@openclaw/llama-cpp-provider`
|
|
- Minimum OpenClaw host: `2026.6.2`
|