mirror of https://github.com/openclaw/openclaw.git synced 2026-08-02 04:21:34 +00:00

Files

Peter Steinberger 37cf0c6064 improve: reduce GPT-5.6 coding harness overhead (#114574 )

* improve: reduce GPT-5.6 coding harness overhead

* refactor: extract runtime parity timing helpers

* fix(qa): verify native apply-patch runtime parity

* fix(qa): use mock patch execution evidence

* fix(qa): preserve workspace templates in full syncs

* fix(qa): make rejected patch fixtures deterministic

* fix(qa): prove apply-patch workspace containment

* fix(qa): expose runtime prompt-cache usage

* fix(codex): confine forced private QA patch turns

* fix(qa): verify native patch execution and sandbox precedence

* fix(qa): execute native patches and prove disk mutation

* fix(codex): avoid duplicate native patch registration

* perf(agents): keep code mode catalog guidance compact

* fix(qa): make native Codex patch evidence deterministic

* fix(qa): recognize native sandbox denial errors

* fix(qa): advertise native Codex mock model capabilities

* fix(qa): seed native Codex mock model catalog at startup

* fix(qa): recognize native Codex patch denial results

* fix(ci): repair Codex harness parity checks

* fix(qa): distinguish unknown prompt-cache measurements

* fix(qa): accept native Codex project patch denials

* fix(ci): isolate runtime parity report contracts

* fix(codex): eliminate native runtime transport overhead

* fix(qa): consume runtime parity report contract

* fix(qa): compare matched runtime timing captures

* fix(qa): type native response delta context

* fix(qa): satisfy native codex websocket lint

2026-07-27 19:24:52 -04:00

convex-credential-broker

chore(deps): refresh repository dependencies (#112453 )

2026-07-23 16:17:13 +00:00

scenarios

improve: reduce GPT-5.6 coding harness overhead (#114574 )

2026-07-27 19:24:52 -04:00

frontier-harness-plan.md

chore: migrate active GPT-5.5 references to GPT-5.6 (#104452 )

2026-07-11 06:30:57 -07:00

maturity-scores.yaml

refactor(qa): make taxonomy coverage ids unique (#110280 )

2026-07-22 16:28:44 +09:00

README.md

Convert QA scenarios to YAML files (#92915 )

2026-06-14 17:31:18 -07:00

scenarios.md

Convert QA scenarios to YAML files (#92915 )

2026-06-14 17:31:18 -07:00

README.md

QA Scenarios

Seed QA assets for the private qa-lab extension.

Files:

scenarios/index.yaml - canonical QA scenario pack, kickoff mission, and operator identity.
scenarios/<theme>/*.yaml - one runnable scenario per YAML file.
frontier-harness-plan.md - big-model bakeoff and tuning loop for harness work.
convex-credential-broker/ - standalone Convex v1 lease broker for pooled live credentials.

Key workflow:

qa suite is the executable frontier subset / regression loop.
qa manual is the scoped personality and style probe after the executable subset is green.
qa coverage prints the scenario coverage inventory from scenario YAML.

Operator workflows:

Use the openclaw-qa-testing skill for QA Lab live lanes, Convex credential pool operations, and WhatsApp live credential setup/replacement.

Keep this folder in git. Add new scenarios here before wiring them into automation.