mirror of
https://github.com/openclaw/openclaw.git
synced 2026-03-16 04:20:44 +00:00
* feat(context-engine): add ContextEngine interface and registry
Introduce the pluggable ContextEngine abstraction that allows external
plugins to register custom context management strategies.
- ContextEngine interface with lifecycle methods: bootstrap, ingest,
ingestBatch, afterTurn, assemble, compact, prepareSubagentSpawn,
onSubagentEnded, dispose
- Module-level singleton registry with registerContextEngine() and
resolveContextEngine() (config-driven slot selection)
- LegacyContextEngine: pass-through implementation wrapping existing
compaction behavior for 100% backward compatibility
- ensureContextEnginesInitialized() guard for safe one-time registration
- 19 tests covering contract, registry, resolution, and legacy parity
* feat(plugins): add context-engine slot and registerContextEngine API
Wire the ContextEngine abstraction into the plugin system so external
plugins can register context engines via the standard plugin API.
- Add 'context-engine' to PluginKind union type
- Add 'contextEngine' slot to PluginSlotsConfig (default: 'legacy')
- Wire registerContextEngine() through OpenClawPluginApi
- Export ContextEngine types from plugin-sdk for external consumers
- Restore proper slot-based resolution in registry
* feat(context-engine): wire ContextEngine into agent run lifecycle
Integrate the ContextEngine abstraction into the core agent run path:
- Resolve context engine once per run (reused across retries)
- Bootstrap: hydrate canonical store from session file on first run
- Assemble: route context assembly through pluggable engine
- Auto-compaction guard: disable built-in auto-compaction when
the engine declares ownsCompaction (prevents double-compaction)
- AfterTurn: post-turn lifecycle hook for ingest + background
compaction decisions
- Overflow compaction: route through contextEngine.compact()
- Dispose: clean up engine resources in finally block
- Notify context engine on subagent lifecycle events
Legacy engine: all lifecycle methods are pass-through/no-op, preserving
100% backward compatibility for users without a context engine plugin.
* feat(plugins): add scoped subagent methods and gateway request scope
Expose runtime.subagent.{run, waitForRun, getSession, deleteSession}
so external plugins can spawn sub-agent sessions without raw gateway
dispatch access.
Uses AsyncLocalStorage request-scope bridge to dispatch internally via
handleGatewayRequest with a synthetic operator client. Methods are only
available during gateway request handling.
- Symbol.for-backed global singleton for cross-module-reload safety
- Fallback gateway context for non-WS dispatch paths (Telegram/WhatsApp)
- Set gateway request scope for all handlers, not just plugin handlers
- 3 staleness tests for fallback context hardening
* feat(context-engine): route /compact and sessions.get through context engine
Wire the /compact command and sessions.get handler through the pluggable
ContextEngine interface.
- Thread tokenBudget and force parameters to context engine compact
- Route /compact through contextEngine.compact() when registered
- Wire sessions.get as runtime alias for plugin subagent dispatch
- Add .pebbles/ to .gitignore
* style: format with oxfmt 0.33.0
Fix duplicate import (ControlUiRootState in server.impl.ts) and
import ordering across all changed files.
* fix: update extension test mocks for context-engine types
Add missing subagent property to bluebubbles PluginRuntime mock.
Add missing registerContextEngine to lobster OpenClawPluginApi mock.
* fix(subagents): keep deferred delete cleanup retryable
* style: format run attempt for CI
* fix(rebase): remove duplicate embedded-run imports
* test: add missing gateway context mock export
* fix: pass resolved auth profile into afterTurn compaction
Ensure the embedded runner forwards resolved auth profile context into
legacy context-engine compaction params on the normal afterTurn path,
matching overflow compaction behavior. This allows downstream LCM
summarization to use the intended provider auth/profile consistently.
Also fix strict TS typing in external-link token dedupe and align an
attempt unit test reasoningLevel value with the current ReasoningLevel
enum.
Regeneration-Prompt: |
We were debugging context-engine compaction where downstream summary
calls were missing the right auth/profile context in normal afterTurn
flow, while overflow compaction already propagated it. Preserve current
behavior and keep changes additive: thread the resolved authProfileId
through run -> attempt -> legacy compaction param builder without
broad refactors.
Add tests that prove the auth profile is included in afterTurn legacy
params and that overflow compaction still passes it through run
attempts. Keep existing APIs stable, and only adjust small type issues
needed for strict compilation.
* fix: remove duplicate imports from rebase
* feat: add context-engine system prompt additions
* fix(rebase): dedupe attempt import declarations
* test: fix fetch mock typing in ollama autodiscovery
* fix(test): add registerContextEngine to diffs extension mock APIs
* test(windows): use path.delimiter in ios-team-id fixture PATH
* test(cron): add model formatting and precedence edge case tests
Covers:
- Provider/model string splitting (whitespace, nested paths, empty segments)
- Provider normalization (casing, aliases like bedrock→amazon-bedrock)
- Anthropic model alias normalization (opus-4.5→claude-opus-4-5)
- Precedence: job payload > session override > config default
- Sequential runs with different providers (CI flake regression pattern)
- forceNew session preserving stored model overrides
- Whitespace/empty model string edge cases
- Config model as string vs object format
* test(cron): fix model formatting test config types
* test(phone-control): add registerContextEngine to mock API
* fix: re-export ChannelKind from config-reload-plan
* fix: add subagent mock to plugin-runtime-mock test util
* docs: add changelog fragment for context engine PR #22201
168 lines
5.0 KiB
TypeScript
168 lines
5.0 KiB
TypeScript
import type { AgentMessage } from "@mariozechner/pi-agent-core";
|
|
|
|
// Result types
|
|
|
|
export type AssembleResult = {
|
|
/** Ordered messages to use as model context */
|
|
messages: AgentMessage[];
|
|
/** Estimated total tokens in assembled context */
|
|
estimatedTokens: number;
|
|
/** Optional context-engine-provided instructions prepended to the runtime system prompt */
|
|
systemPromptAddition?: string;
|
|
};
|
|
|
|
export type CompactResult = {
|
|
ok: boolean;
|
|
compacted: boolean;
|
|
reason?: string;
|
|
result?: {
|
|
summary?: string;
|
|
firstKeptEntryId?: string;
|
|
tokensBefore: number;
|
|
tokensAfter?: number;
|
|
details?: unknown;
|
|
};
|
|
};
|
|
|
|
export type IngestResult = {
|
|
/** Whether the message was ingested (false if duplicate or no-op) */
|
|
ingested: boolean;
|
|
};
|
|
|
|
export type IngestBatchResult = {
|
|
/** Number of messages ingested from the supplied batch */
|
|
ingestedCount: number;
|
|
};
|
|
|
|
export type BootstrapResult = {
|
|
/** Whether bootstrap ran and initialized the engine's store */
|
|
bootstrapped: boolean;
|
|
/** Number of historical messages imported (if applicable) */
|
|
importedMessages?: number;
|
|
/** Optional reason when bootstrap was skipped */
|
|
reason?: string;
|
|
};
|
|
|
|
export type ContextEngineInfo = {
|
|
id: string;
|
|
name: string;
|
|
version?: string;
|
|
/** True when the engine manages its own compaction lifecycle. */
|
|
ownsCompaction?: boolean;
|
|
};
|
|
|
|
export type SubagentSpawnPreparation = {
|
|
/** Roll back pre-spawn setup when subagent launch fails. */
|
|
rollback: () => void | Promise<void>;
|
|
};
|
|
|
|
export type SubagentEndReason = "deleted" | "completed" | "swept" | "released";
|
|
|
|
/**
|
|
* ContextEngine defines the pluggable contract for context management.
|
|
*
|
|
* Required methods define a generic lifecycle; optional methods allow engines
|
|
* to provide additional capabilities (retrieval, lineage, etc.).
|
|
*/
|
|
export interface ContextEngine {
|
|
/** Engine identifier and metadata */
|
|
readonly info: ContextEngineInfo;
|
|
|
|
/**
|
|
* Initialize engine state for a session, optionally importing historical context.
|
|
*/
|
|
bootstrap?(params: { sessionId: string; sessionFile: string }): Promise<BootstrapResult>;
|
|
|
|
/**
|
|
* Ingest a single message into the engine's store.
|
|
*/
|
|
ingest(params: {
|
|
sessionId: string;
|
|
message: AgentMessage;
|
|
/** True when the message belongs to a heartbeat run. */
|
|
isHeartbeat?: boolean;
|
|
}): Promise<IngestResult>;
|
|
|
|
/**
|
|
* Ingest a completed turn batch as a single unit.
|
|
*/
|
|
ingestBatch?(params: {
|
|
sessionId: string;
|
|
messages: AgentMessage[];
|
|
/** True when the batch belongs to a heartbeat run. */
|
|
isHeartbeat?: boolean;
|
|
}): Promise<IngestBatchResult>;
|
|
|
|
/**
|
|
* Execute optional post-turn lifecycle work after a run attempt completes.
|
|
* Engines can use this to persist canonical context and trigger background
|
|
* compaction decisions.
|
|
*/
|
|
afterTurn?(params: {
|
|
sessionId: string;
|
|
sessionFile: string;
|
|
messages: AgentMessage[];
|
|
/** Number of messages that existed before the prompt was sent. */
|
|
prePromptMessageCount: number;
|
|
/** Optional auto-compaction summary emitted by the runtime. */
|
|
autoCompactionSummary?: string;
|
|
/** True when this turn belongs to a heartbeat run. */
|
|
isHeartbeat?: boolean;
|
|
/** Optional model context token budget for proactive compaction. */
|
|
tokenBudget?: number;
|
|
/** Backward-compat only: legacy compaction bridge runtime params. */
|
|
legacyCompactionParams?: Record<string, unknown>;
|
|
}): Promise<void>;
|
|
|
|
/**
|
|
* Assemble model context under a token budget.
|
|
* Returns an ordered set of messages ready for the model.
|
|
*/
|
|
assemble(params: {
|
|
sessionId: string;
|
|
messages: AgentMessage[];
|
|
tokenBudget?: number;
|
|
}): Promise<AssembleResult>;
|
|
|
|
/**
|
|
* Compact context to reduce token usage.
|
|
* May create summaries, prune old turns, etc.
|
|
*/
|
|
compact(params: {
|
|
sessionId: string;
|
|
sessionFile: string;
|
|
tokenBudget?: number;
|
|
/** Backward-compat only: force legacy compaction behavior even below threshold. */
|
|
force?: boolean;
|
|
/** Optional live token estimate from the caller's active context. */
|
|
currentTokenCount?: number;
|
|
/** Controls convergence target; defaults to budget for compatibility. */
|
|
compactionTarget?: "budget" | "threshold";
|
|
customInstructions?: string;
|
|
/** Backward-compat only: full params bag for legacy compaction bridge. */
|
|
legacyParams?: Record<string, unknown>;
|
|
}): Promise<CompactResult>;
|
|
|
|
/**
|
|
* Prepare context-engine-managed subagent state before the child run starts.
|
|
*
|
|
* Implementations can return a rollback handle that is invoked when spawn
|
|
* fails after preparation succeeds.
|
|
*/
|
|
prepareSubagentSpawn?(params: {
|
|
parentSessionKey: string;
|
|
childSessionKey: string;
|
|
ttlMs?: number;
|
|
}): Promise<SubagentSpawnPreparation | undefined>;
|
|
|
|
/**
|
|
* Notify the context engine that a subagent lifecycle ended.
|
|
*/
|
|
onSubagentEnded?(params: { childSessionKey: string; reason: SubagentEndReason }): Promise<void>;
|
|
|
|
/**
|
|
* Dispose of any resources held by the engine.
|
|
*/
|
|
dispose?(): Promise<void>;
|
|
}
|