Dallin Romney 119dc4bd82 test: promote OpenAI HTTP QA coverage (#97369)

2026-06-27 22:28:31 -07:00

..

live-transports

fix(qa): record checked-out ref in evidence (#96434)

2026-06-24 22:37:41 +08:00

mantis

refactor(qa): share mantis option helpers

2026-06-20 07:04:11 +08:00

providers

fix(qa-lab): treat claude-cli as Anthropic-family for live turn timeouts (#96567)

2026-06-27 08:47:33 -07:00

agentic-parity-report.test.ts

test(release): stabilize qa runtime parity gate

2026-06-09 01:02:24 +02:00

agentic-parity-report.ts

fix(qa-lab): require tool evidence in parity metrics

2026-06-07 06:20:16 +02:00

agentic-parity.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

artifact-assertion.ts

refactor(qa): share artifact write assertion

2026-06-20 10:08:19 +08:00

artifact-run-id.ts

fix(qa): avoid default artifact directory collisions

2026-06-23 10:53:46 +02:00

auth-profile.fixture.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

browser-runtime.test.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

browser-runtime.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

bundled-plugin-staging.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

bus-queries.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

bus-server.test.ts

fix(qa): validate QA bus poll numbers

2026-06-21 12:41:22 +02:00

bus-server.ts

fix(qa): validate QA bus poll numbers

2026-06-21 12:41:22 +02:00

bus-state.test.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

bus-state.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

bus-waiters.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

character-eval.test.ts

fix(qa): avoid live artifact directory collisions

2026-06-23 11:11:47 +02:00

character-eval.ts

fix(qa): avoid live artifact directory collisions

2026-06-23 11:11:47 +02:00

child-output.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

cli-options.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

cli-paths.ts

Run Vitest and Playwright scenarios from qa suite (#92606)

2026-06-13 01:06:10 -07:00

cli.runtime.test.ts

fix: count maturity coverage ids (#96543)

2026-06-24 14:56:51 -07:00

cli.runtime.ts

fix(qa-lab): use scoped crabline package

2026-06-23 17:47:07 +08:00

cli.test.ts

test(qa): clean up smoke taxonomy profile (#96320)

2026-06-24 00:43:00 -07:00

cli.ts

fix(qa): reject out-of-range lab CLI ports

2026-06-23 10:16:45 +02:00

codex-plugin-lifecycle.test.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

codex-plugin.fixture.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

confidence-report.test.ts

fix(qa): reject impossible confidence counts

2026-06-21 14:38:42 +02:00

confidence-report.ts

fix(qa): reject impossible confidence counts

2026-06-21 14:38:42 +02:00

coverage-report.test.ts

fix: count maturity coverage ids (#96543)

2026-06-24 14:56:51 -07:00

coverage-report.ts

fix: count maturity coverage ids (#96543)

2026-06-24 14:56:51 -07:00

crabline-transport.test.ts

fix(qa): retain crabline delivery targets

2026-06-24 05:12:26 +08:00

crabline-transport.ts

fix(qa): retain crabline delivery targets

2026-06-24 05:12:26 +08:00

cron-run-wait.test.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

cron-run-wait.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

discovery-eval.test.ts

Convert QA scenarios to YAML files (#92915)

2026-06-14 17:31:18 -07:00

discovery-eval.ts

Convert QA scenarios to YAML files (#92915)

2026-06-14 17:31:18 -07:00

docker-harness.test.ts

fix(qa): quote generated compose paths

2026-06-20 17:08:40 +02:00

docker-harness.ts

fix(qa): quote generated compose paths

2026-06-20 17:08:40 +02:00

docker-runtime.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

docker-up.runtime.test.ts

fix(qa): reject QA Lab host port collisions

2026-06-21 12:23:52 +02:00

docker-up.runtime.ts

fix(qa): reject QA Lab host port collisions

2026-06-21 12:23:52 +02:00

errors.ts

refactor(qa): share thrown value normalization

2026-06-20 10:24:16 +08:00

evidence-gallery.test.ts

fix(qa): hide evidence producer href paths

2026-06-20 04:53:15 +02:00

evidence-gallery.ts

fix(qa): hide evidence producer href paths

2026-06-20 04:53:15 +02:00

evidence-summary.test.ts

fix(qa): record checked-out ref in evidence (#96434)

2026-06-24 22:37:41 +08:00

evidence-summary.ts

fix: count maturity coverage ids (#96543)

2026-06-24 14:56:51 -07:00

extract-tool-payload.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

gateway-child.test.ts

fix(qa): omit local temp roots from gateway artifacts

2026-06-23 09:18:41 +02:00

gateway-child.ts

fix(qa): omit local temp roots from gateway artifacts

2026-06-23 09:18:41 +02:00

gateway-log-redaction.ts

fix(qa): preserve cli flag redaction

2026-06-20 05:44:58 +02:00

gateway-log-sentinel.test.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

gateway-log-sentinel.ts

refactor(qa): share gateway message text extraction

2026-06-22 20:25:26 +08:00

gateway-rpc-client.test.ts

fix(qa): stop queued gateway rpc calls

2026-06-07 03:12:03 +02:00

gateway-rpc-client.ts

fix(qa): stop queued gateway rpc calls

2026-06-07 03:12:03 +02:00

harness-parity.test.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

harness-parity.ts

refactor(qa): share parity comparison helpers

2026-06-20 08:09:38 +08:00

harness-runtime.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

jsonl-replay.test.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

jsonl-replay.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

lab-server-capture.test.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

lab-server-capture.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

lab-server-ui.test.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

lab-server-ui.ts

fix(qa-lab): version UI assets from repo root

2026-06-21 23:43:48 +02:00

lab-server.test.ts

fix(qa): avoid self-check report clobbering

2026-06-23 10:46:25 +02:00

lab-server.ts

fix(qa-lab): version UI assets from repo root

2026-06-21 23:43:48 +02:00

lab-server.types.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

live-timeout.test.ts

fix(qa-lab): treat claude-cli as Anthropic-family for live turn timeouts (#96567)

2026-06-27 08:47:33 -07:00

live-timeout.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

mantis-options.runtime.ts

refactor(qa): share mantis option helpers

2026-06-20 07:04:11 +08:00

mantis-phase-timer.runtime.ts

refactor(qa): share mantis phase timer

2026-06-20 06:48:17 +08:00

manual-lane.runtime.test.ts

fix(qa-lab): harden live cleanup and readiness

2026-06-17 18:40:21 +02:00

manual-lane.runtime.ts

feat(qa): crabline channel driver (#91502)

2026-06-22 15:24:59 -07:00

model-catalog.runtime.test.ts

fix(qa-lab): preserve model catalog abort grace

2026-06-20 11:18:43 +02:00

model-catalog.runtime.ts

fix(qa-lab): resolve Windows taskkill path

2026-06-21 11:26:30 +02:00

model-selection.runtime.test.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

model-selection.runtime.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

model-selection.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

model-switch-eval.test.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

model-switch-eval.ts

Convert QA scenarios to YAML files (#92915)

2026-06-14 17:31:18 -07:00

multipass.runtime.test.ts

feat(qa): forward shared suite flags to multipass runner (#91506)

2026-06-22 15:48:05 -07:00

multipass.runtime.ts

fix(qa-lab): use scoped crabline package

2026-06-23 17:47:07 +08:00

node-exec.test.ts

fix(qa-lab): resolve Windows node lookup tool

2026-06-21 12:14:39 +02:00

node-exec.ts

fix(qa-lab): resolve Windows node lookup tool

2026-06-21 12:14:39 +02:00

parity-shared.ts

refactor(qa): share parity comparison helpers

2026-06-20 08:09:38 +08:00

process-tree-cpu.test.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

process-tree-cpu.ts

fix(qa-lab): resolve Windows PowerShell path

2026-06-21 12:40:57 +02:00

process-tree-cpu.windows.test.ts

fix(qa-lab): resolve Windows PowerShell path

2026-06-21 12:40:57 +02:00

progress-format.ts

refactor(qa): share progress formatting helpers

2026-06-20 08:26:00 +08:00

protocol.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

qa-agent-bootstrap.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

qa-agent-workspace.test.ts

fix(qa-lab): use junctions for Windows workspace repo links

2026-06-20 08:39:32 +02:00

qa-agent-workspace.ts

fix(qa-lab): use junctions for Windows workspace repo links

2026-06-20 08:39:32 +02:00

qa-channel-transport.test.ts

fix(qa): prove direct reply routing via qa channel

2026-06-24 00:41:28 +08:00

qa-channel-transport.ts

fix(qa): prove direct reply routing via qa channel

2026-06-24 00:41:28 +08:00

qa-credentials-admin.runtime.test.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

qa-credentials-admin.runtime.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

qa-credentials-common.runtime.test.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

qa-credentials-common.runtime.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

qa-credentials-fingerprint.runtime.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

qa-gateway-config.test.ts

fix(qa): prove direct reply routing via qa channel

2026-06-24 00:41:28 +08:00

qa-gateway-config.ts

fix(docker): bundle QA Lab runtime in the image (#92087)

2026-06-12 14:02:32 +10:00

qa-thinking.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

qa-transport-registry.test.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

qa-transport-registry.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

qa-transport.ts

feat(qa): crabline channel driver (#91502)

2026-06-22 15:24:59 -07:00

qa-web-search-provider.test.ts

test(qa): harden all-profile evidence scenarios (#96003)

2026-06-23 00:07:51 -07:00

qa-web-search-provider.ts

test(qa): harden all-profile evidence scenarios (#96003)

2026-06-23 00:07:51 -07:00

reply-failure.test.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

reply-failure.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

repo-path.ts

refactor(qa): share repo path resolution

2026-06-20 09:12:39 +08:00

run-config.test.ts

fix(qa): avoid lab artifact directory collisions

2026-06-23 09:39:04 +02:00

run-config.ts

fix(qa): avoid lab artifact directory collisions

2026-06-23 09:39:04 +02:00

runtime-api.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

runtime-parity.test.ts

fix(qa): align runtime parity evidence with Codex

2026-06-25 10:20:51 +08:00

runtime-parity.ts

fix(qa): align runtime parity evidence with Codex

2026-06-25 10:20:51 +08:00

runtime-tool-fixture.test.ts

fix(qa): allow async runtime fixture starts

2026-06-24 17:52:16 +08:00

runtime-tool-fixture.ts

fix(qa): allow async runtime fixture starts

2026-06-24 17:52:16 +08:00

runtime-tool-metadata.ts

refactor(qa-lab): drop unused report type aliases

2026-06-20 03:16:55 +08:00

scenario-catalog.test.ts

test: promote OpenAI HTTP QA coverage (#97369)

2026-06-27 22:28:31 -07:00

scenario-catalog.ts

perf(qa-lab): speed up unified QA suites (#95944)

2026-06-22 21:55:54 -07:00

scenario-flow-runner.test.ts

Convert QA scenarios to YAML files (#92915)

2026-06-14 17:31:18 -07:00

scenario-flow-runner.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

scenario-packs.test.ts

Convert QA scenarios to YAML files (#92915)

2026-06-14 17:31:18 -07:00

scenario-packs.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

scenario-runtime-api.test.ts

test(qa): wait for live history replies in flow scenarios

2026-06-23 04:01:11 +02:00

scenario-runtime-api.ts

test(qa): wait for live history replies in flow scenarios

2026-06-23 04:01:11 +02:00

scenario.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

scorecard-evidence.test.ts

fix: count maturity coverage ids (#96543)

2026-06-24 14:56:51 -07:00

scorecard-evidence.ts

fix: count maturity coverage ids (#96543)

2026-06-24 14:56:51 -07:00

scorecard-taxonomy.ts

fix: count maturity coverage ids (#96543)

2026-06-24 14:56:51 -07:00

self-check-runner.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

self-check-scenario.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

self-check.test.ts

fix(qa): avoid self-check report clobbering

2026-06-23 10:46:25 +02:00

self-check.ts

fix(qa): avoid default artifact directory collisions

2026-06-23 10:53:46 +02:00

shell-quote.ts

Run Vitest and Playwright scenarios from qa suite (#92606)

2026-06-13 01:06:10 -07:00

suite-launch.runtime.test.ts

test(qa): speed up smoke profile (#96340)

2026-06-24 09:30:59 -07:00

suite-launch.runtime.ts

test(qa): speed up smoke profile (#96340)

2026-06-24 09:30:59 -07:00

suite-merge-patch.test.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

suite-merge-patch.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

suite-planning.test.ts

fix(qa): avoid default artifact directory collisions

2026-06-23 10:53:46 +02:00

suite-planning.ts

fix(qa): avoid default artifact directory collisions

2026-06-23 10:53:46 +02:00

suite-runtime-agent-common.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

suite-runtime-agent-media.test.ts

fix(qa-lab): keep generated media fallback usable

2026-06-20 07:57:12 +02:00

suite-runtime-agent-media.ts

fix(qa-lab): keep generated media fallback usable

2026-06-20 07:57:12 +02:00

suite-runtime-agent-process.integration.test.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

suite-runtime-agent-process.test.ts

fix(qa): normalize completed wait envelopes

2026-06-23 05:13:35 +02:00

suite-runtime-agent-process.ts

fix(qa): normalize completed wait envelopes

2026-06-23 05:13:35 +02:00

suite-runtime-agent-session.test.ts

revert(sessions): defer session metadata sqlite

2026-06-10 16:34:06 +09:00

suite-runtime-agent-session.ts

refactor(qa): share gateway message text extraction

2026-06-22 20:25:26 +08:00

suite-runtime-agent-tools.test.ts

fix(qa-lab): keep workspace skills in sandbox

2026-06-19 04:33:18 +02:00

suite-runtime-agent-tools.ts

fix(qa-lab): keep workspace skills in sandbox

2026-06-19 04:33:18 +02:00

suite-runtime-agent.ts

test(qa): wait for live history replies in flow scenarios

2026-06-23 04:01:11 +02:00

suite-runtime-flow.test.ts

fix(qa): launch control ui flows with runnable chromium

2026-06-24 14:02:11 +08:00

suite-runtime-flow.ts

fix(qa): launch control ui flows with runnable chromium

2026-06-24 14:02:11 +08:00

suite-runtime-gateway.test.ts

Fix config.patch explicit array replacement (#91551)

2026-06-08 21:48:46 -05:00

suite-runtime-gateway.ts

refactor(qa): share thrown value normalization

2026-06-20 10:24:16 +08:00

suite-runtime-transport.test.ts

test(qa): show unexpected no-outbound messages

2026-06-24 08:29:37 +08:00

suite-runtime-transport.ts

test(qa): show unexpected no-outbound messages

2026-06-24 08:29:37 +08:00

suite-runtime-types.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

suite-summary.test.ts

Add QA evidence artifact output (#91484)

2026-06-12 16:12:58 -07:00

suite-summary.ts

feat(qa): crabline channel driver (#91502)

2026-06-22 15:24:59 -07:00

suite-test-helpers.ts

perf(qa-lab): speed up unified QA suites (#95944)

2026-06-22 21:55:54 -07:00

suite.summary-json.test.ts

feat(qa): crabline channel driver (#91502)

2026-06-22 15:24:59 -07:00

suite.test.ts

test(qa): log effective channel driver in progress (#96327)

2026-06-24 01:04:52 -07:00

suite.ts

fix(qa): record checked-out ref in evidence (#96434)

2026-06-24 22:37:41 +08:00

temp-dir.test-helper.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

test-file-scenario-runner.test.ts

fix(qa): recover Playwright Chromium on Ubuntu 26

2026-06-24 13:24:43 +08:00

test-file-scenario-runner.ts

fix(qa): record checked-out ref in evidence (#96434)

2026-06-24 22:37:41 +08:00

timer-timeouts.test.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

timer-timeouts.ts

docs: document channel extension sources

2026-06-04 21:59:00 -04:00

token-efficiency-report.test.ts

fix(qa): reject fractional live token usage

2026-06-21 14:49:29 +02:00

token-efficiency-report.ts

fix(qa): reject fractional live token usage

2026-06-21 14:49:29 +02:00

tool-coverage-report.test.ts

fix(qa): escape tool coverage markdown cells

2026-06-21 14:46:38 +02:00

tool-coverage-report.ts

fix(qa): escape tool coverage markdown cells

2026-06-21 14:46:38 +02:00

web-runtime.test.ts

fix #95495: [Bug]: 2026.6.9 silently relocates memory store with no migration, forcing a full re-embed (1499 files) with zero upgrade-time warning (#95631)

2026-06-24 17:47:44 +08:00

web-runtime.ts

fix #95495: [Bug]: 2026.6.9 silently relocates memory store with no migration, forcing a full re-embed (1499 files) with zero upgrade-time warning (#95631)

2026-06-24 17:47:44 +08:00

windows-system-tools.test.ts

fix(qa-lab): resolve Windows PowerShell path

2026-06-21 12:40:57 +02:00

windows-system-tools.ts

fix(qa-lab): resolve Windows PowerShell path

2026-06-21 12:40:57 +02:00