mirror of https://github.com/openclaw/openclaw.git synced 2026-05-09 22:50:44 +00:00

Files

Peter Steinberger 44d7d6fd52 fix(qa-lab): refresh parity models and approval timeout

Summary:
- refresh QA parity workflow model refs to Opus 4.7 / GPT-5.5-alt
- raise approval-turn-tool-followthrough mock fallback timeouts to 60s
- credit the original contributor in the changelog

Verification:
- OPENCLAW_BUILD_PRIVATE_QA=1 OPENCLAW_ENABLE_PRIVATE_QA_CLI=1 pnpm build
- mock-openai approval-turn scenario passed 1/1 for openai/gpt-5.5 + openai/gpt-5.5-alt
- mock-openai approval-turn scenario passed 1/1 for anthropic/claude-opus-4-7 + anthropic/claude-sonnet-4-7
- pnpm test extensions/qa-lab/src/providers/mock-openai/server.test.ts extensions/qa-lab/src/qa-gateway-config.test.ts extensions/qa-lab/src/suite-planning.test.ts extensions/qa-lab/src/cli.runtime.test.ts
- pnpm check:workflows
- pnpm check:test-types
- pnpm exec oxfmt --check --threads=1 .github/workflows/openclaw-release-checks.yml .github/workflows/qa-live-transports-convex.yml CHANGELOG.md qa/scenarios/runtime/approval-turn-tool-followthrough.md
- git diff --check origin/main...HEAD

2026-05-09 03:22:55 -04:00

convex-credential-broker

docs: keep qa broker notes internal

2026-05-08 06:01:23 +01:00

scenarios

fix(qa-lab): refresh parity models and approval timeout

2026-05-09 03:22:55 -04:00

frontier-harness-plan.md

test(openai): cover GPT-5.5 defaults

2026-04-23 20:19:15 +01:00

new-scenarios-2026-04.md

feat(qa): execute ten new repo-backed scenarios

2026-04-06 04:28:33 +01:00

README.md

Add WhatsApp live QA lane (#77704 )

2026-05-05 12:09:28 -07:00

scenarios.md

QA: organize scenarios by theme

2026-04-17 11:03:47 -04:00

README.md

QA Scenarios

Seed QA assets for the private qa-lab extension.

Files:

scenarios/index.md - canonical QA scenario pack, kickoff mission, and operator identity.
scenarios/<theme>/*.md - one runnable scenario per markdown file.
frontier-harness-plan.md - big-model bakeoff and tuning loop for harness work.
convex-credential-broker/ - standalone Convex v1 lease broker for pooled live credentials.

Key workflow:

qa suite is the executable frontier subset / regression loop.
qa manual is the scoped personality and style probe after the executable subset is green.
qa coverage prints the scenario coverage inventory from scenario frontmatter.

Operator workflows:

Use the openclaw-qa-testing skill for QA Lab live lanes, Convex credential pool operations, and WhatsApp live credential setup/replacement.

Keep this folder in git. Add new scenarios here before wiring them into automation.