mirror of
https://github.com/openclaw/openclaw.git
synced 2026-07-22 19:11:15 +00:00
658b601ee5
* feat(llama-cpp): add in-process text inference * test(llama-cpp): narrow setup provider fixture * fix(llama-cpp): trim public surface and refresh docs map * fix(llama-cpp): import Context type in inference test
24 lines
488 B
Markdown
24 lines
488 B
Markdown
---
|
|
summary: "Local GGUF text inference and embeddings through node-llama-cpp."
|
|
read_when:
|
|
- You are installing, configuring, or auditing the llama-cpp plugin
|
|
title: "Llama Cpp plugin"
|
|
---
|
|
|
|
# Llama Cpp plugin
|
|
|
|
Local GGUF text inference and embeddings through node-llama-cpp.
|
|
|
|
## Distribution
|
|
|
|
- Package: `@openclaw/llama-cpp-provider`
|
|
- Install route: npm; ClawHub
|
|
|
|
## Surface
|
|
|
|
providers: `llama-cpp`; contracts: `embeddingProviders`
|
|
|
|
## Related docs
|
|
|
|
- [llama-cpp](/plugins/llama-cpp)
|