Dallin Romney
63b13ea837
feat(qa): crabline channel driver ( #91502 )
...
* feat(qa): add crabline channel driver seam
* feat: run crabline channel driver smoke
* chore: keep crabline qa dependency dev-only
* refactor(qa): keep crabline driver details opaque
* chore(qa): pin crabline to merged driver API
* feat(qa): drive channel driver from profiles
* fix(qa): declare crabline runtime peer
* feat(qa): resolve crabline channel from scenarios
* feat(qa): treat unsupported profile channels as coverage gaps
* Revert "feat(qa): treat unsupported profile channels as coverage gaps"
This reverts commit 65a9701655
2026-06-22 15:24:59 -07:00
Vincent Koc
db21588636
refactor(qa): share suite summary file loading
2026-06-22 20:24:20 +08:00
Dallin Romney
4809ac70fa
Add QA evidence artifact output ( #91484 )
...
* feat: add qa evidence summary normalization
* chore: rename qa evidence target environment
* chore: align qa evidence profile terminology
* chore: align qa evidence summary fields
* chore: add qa evidence taxonomy ref
* test: remove stale multipass evidence example
* test(qa): normalize vitest and playwright evidence
* test(qa): slim evidence summary metadata
* test(qa): clarify evidence summary inputs
* test(qa): rename scenario specs in evidence flow
* test(qa): treat evidence profiles as mapping strings
* test(qa): use neutral evidence test identity
* test(qa): nest evidence summary joins
* refactor(qa): normalize live evidence summaries
* fix(qa): accept normalized telegram rtt summaries
* fix(qa): normalize evidence lane summaries
* fix(qa): align evidence summaries with requirements
* refactor(qa): tighten evidence summary builders
* refactor(qa): restore standard evidence ids
* fix(qa): keep legacy summaries out of rtt evidence
* refactor(qa): make package evidence provenance explicit
* test(qa): keep script tests out of qa lab internals
* refactor(qa): rename scenario evidence definitions
* refactor(qa): clean evidence summary wording
* test(qa): fix evidence summary test inputs
* refactor(qa): simplify evidence identity fields
* refactor(qa): tighten evidence summary inputs
* refactor(qa): rename evidence artifact
2026-06-12 16:12:58 -07:00
Vincent Koc
3dc6ac3802
fix(qa): fail closed on skipped suite summaries
2026-06-07 11:20:25 +02:00
Vincent Koc
9b85b36d92
fix(qa): fail whatsapp skipped scenarios
2026-06-07 10:30:15 +02:00
Vincent Koc
e12141fa9f
fix(qa): gate live transport exits on summaries
2026-06-07 02:53:50 +02:00
Vincent Koc
6d2566682a
fix(qa): fail suite on summary scenario failures
2026-06-07 02:49:02 +02:00
Peter Steinberger
58912f8fd8
docs: document channel extension sources
2026-06-04 21:59:00 -04:00
Vincent Koc
532a6a7a89
test(qa): add gateway heap checkpoints
2026-05-18 13:41:35 +08:00
Vincent Koc
20ec5cdc42
test(qa): trace gateway rss in suite summaries
2026-05-18 13:41:35 +08:00
Vincent Koc
f345b54d04
test(qa-lab): add runtime parity axis
2026-05-17 03:32:50 +08:00
Peter Steinberger
fd4bee9c05
refactor: trim qa lab helper exports
2026-05-01 18:37:30 +01:00
Vincent Koc
abed3a056d
test(qa): add kitchen sink plugin gauntlet
2026-04-29 02:29:01 -07:00
Vincent Koc
4509420dd4
test(qa): add gateway CPU scenario pack
2026-04-28 13:26:43 -07:00
Josh Avant
d5b326523f
qa-lab: make live lanes CI-ready for v1 E2E automation ( #69122 )
...
* qa-lab: harden CI defaults and failure semantics for live lanes
* qa-lab: add unit tests for suite progress logging defaults
* qa-lab: cover malformed multipass summary edge cases
* qa-lab: share suite summary failure counting helper
* qa-lab: test allow-failures parse wiring and sanitize progress ids
* fix: note qa CI live-lane defaults in changelog (#69122 ) (thanks @joshavant)
2026-04-19 21:13:27 -05:00
