Commit Graph

46 Commits

Author SHA1 Message Date
Peter Steinberger
baab065f05 test(qa): isolate matrix stale sync replay 2026-04-23 16:49:53 +01:00
Peter Steinberger
855912b25c test(matrix): harden live QA waits 2026-04-23 09:36:48 +01:00
Peter Steinberger
6129dfe590 test(matrix): extend live QA waits 2026-04-23 08:25:32 +01:00
Peter Steinberger
a46d41156d fix(matrix): ignore stale no-reply events 2026-04-23 06:27:20 +01:00
Peter Steinberger
bf132d6fb9 test(qa-matrix): stabilize sync timeout cursor 2026-04-23 01:21:52 +01:00
Peter Steinberger
f72c97afca test(qa-matrix): stabilize sync timeout 2026-04-23 01:20:45 +01:00
Peter Steinberger
698f154c28 fix(qa): recheck Matrix sync events after poll 2026-04-22 23:11:27 +01:00
Peter Steinberger
90bc577a12 refactor: share matrix qa event matcher 2026-04-20 21:03:13 +01:00
Peter Steinberger
50b9526951 test: share matrix harness fixtures 2026-04-20 20:22:00 +01:00
Peter Steinberger
83bb7e8aab test: share matrix qa summary fixtures 2026-04-20 20:19:57 +01:00
Peter Steinberger
33254ca696 test: share matrix restart replay helpers 2026-04-20 20:18:21 +01:00
Peter Steinberger
1148f245c8 build(deps): declare extension runtime dependencies 2026-04-20 16:07:14 +01:00
Peter Steinberger
8116e638f3 chore: release 2026.4.20 2026-04-20 13:16:40 +01:00
Gustavo Madeira Santana
c700bfc35d perf(test): slim matrix media fixtures 2026-04-20 05:51:04 -04:00
Gustavo Madeira Santana
ea37a833dc test(matrix): add stale sync replay dedupe scenario 2026-04-20 05:51:04 -04:00
Josh Avant
d5b326523f qa-lab: make live lanes CI-ready for v1 E2E automation (#69122)
* qa-lab: harden CI defaults and failure semantics for live lanes

* qa-lab: add unit tests for suite progress logging defaults

* qa-lab: cover malformed multipass summary edge cases

* qa-lab: share suite summary failure counting helper

* qa-lab: test allow-failures parse wiring and sanitize progress ids

* fix: note qa CI live-lane defaults in changelog (#69122) (thanks @joshavant)
2026-04-19 21:13:27 -05:00
Gustavo Madeira Santana
f9a1875127 qa-matrix: cover Matrix allowlist hot reload
Add a Matrix QA scenario that removes an observer from the running account group allowlist and verifies the existing gateway stops replying without relying on a channel restart.

The scenario disables generic config reload and defers restart during the probe so it specifically covers the Matrix handler per-message live allowlist read.
2026-04-19 18:10:51 -04:00
Gustavo Madeira Santana
efc19f0ddb Add Matrix QA coverage for MXID-prefixed commands
Add a qa-matrix contract scenario that sends a Matrix self MXID-prefixed
control command from an observer and expects no SUT reply. This captures the
regression fixed by the Matrix command precheck change.
2026-04-19 16:46:49 -04:00
Peter Steinberger
ac8f0c9c0d chore: prepare 2026.4.19-beta.1 release 2026-04-19 02:09:43 +01:00
Peter Steinberger
df525b90f2 chore(lint): enable unnecessary type parameter rule 2026-04-18 18:31:13 +01:00
Peter Steinberger
3f2e73b723 chore(release): bump version to 2026.4.18 2026-04-18 15:46:33 +01:00
Gustavo Madeira Santana
5d8dceb37f QA Matrix: add catchup incremental scenario 2026-04-17 19:16:58 -04:00
Gustavo Madeira Santana
42805d26cf QA Matrix: exit cleanly on failure
Make the Matrix QA CLI single-shot exit contract symmetric: artifact-backed failures now print the preserved error, flush stdio, and exit with code 1 instead of waiting on Matrix native handles.

Keep an opt-out for direct test harnesses with OPENCLAW_QA_MATRIX_DISABLE_FORCE_EXIT.
2026-04-16 21:24:59 -04:00
Gustavo Madeira Santana
7e659e168b QA Matrix: isolate scenario coverage
Add the Matrix subagent-thread scenario and route it through the contract runner while preserving the current missing-hook failure as an explicit scenario result.

Give E2EE scenarios isolated rooms and storage keys so lifecycle tests do not reuse stale encrypted state across scenarios.
2026-04-16 21:24:59 -04:00
Peter Steinberger
0dc4c4076c chore: bump version to 2026.4.16 2026-04-17 00:45:04 +01:00
Vincent Koc
012b577e84 fix(ci): guard qa matrix fault proxy fetch 2026-04-16 13:59:07 -07:00
Gustavo Madeira Santana
56a9fd4b34 QA Matrix: capture full runner output 2026-04-16 16:18:54 -04:00
Gustavo Madeira Santana
988447ca24 QA Matrix: expand contract coverage 2026-04-16 16:18:54 -04:00
Gustavo Madeira Santana
4db162db7f QA: split lab runtime and extend Matrix coverage (#67430)
Merged via squash.

Prepared head SHA: 790418b93b
Co-authored-by: gumadeiras <5599352+gumadeiras@users.noreply.github.com>
Co-authored-by: gumadeiras <5599352+gumadeiras@users.noreply.github.com>
Reviewed-by: @gumadeiras
2026-04-16 03:08:39 -04:00
Peter Steinberger
943cb47274 fix(qa): use exported runner sdk seam 2026-04-15 20:26:12 +01:00
Peter Steinberger
b3fa5880dd build(extensions): bump bundled plugin versions to 2026.4.15-beta.1 2026-04-15 15:06:13 +01:00
Peter Steinberger
b9d0fc5630 fix(qa-matrix): remove unused scenario import 2026-04-15 13:08:36 +01:00
Gustavo Madeira Santana
963ad1df06 QA: extend Matrix live contract coverage 2026-04-15 07:36:35 -04:00
Peter Steinberger
7fc5a18d89 test(qa-matrix): isolate flaky beta scenarios 2026-04-15 06:10:37 +01:00
Gustavo Madeira Santana
7d7dc7510e QA: speed up Matrix live lane 2026-04-15 00:16:23 -04:00
Gustavo Madeira Santana
5042b8b8e3 QA: split Matrix contract runtime 2026-04-14 23:44:41 -04:00
Gustavo Madeira Santana
3c03d41f13 QA: split Matrix scenario leaf types 2026-04-14 21:16:48 -04:00
Gustavo Madeira Santana
9463f1c498 QA: expand Matrix config scenario coverage 2026-04-14 21:07:31 -04:00
Gustavo Madeira Santana
3aae0fb16d QA: tighten Matrix substrate coverage 2026-04-14 20:06:08 -04:00
Gustavo Madeira Santana
874eebe539 QA: extract Matrix event modules 2026-04-14 20:06:07 -04:00
Peter Steinberger
81b66e5bf3 test(qa-matrix): type provisioned topology fixture 2026-04-15 00:50:27 +01:00
Gustavo Madeira Santana
778ac4330a QA: finish Matrix P1 harness coverage 2026-04-14 19:42:17 -04:00
Gustavo Madeira Santana
5e77cbd9ec QA: add Matrix transport substrate 2026-04-14 19:42:17 -04:00
Gustavo Madeira Santana
95be2c1605 QA: replace qa-lab-runtime with qa-runtime
Introduce a tiny generic qa-runtime seam for shared live-lane helpers and
repoint qa-matrix to it. This keeps the qa-lab host split while removing
the host-owned runtime name from runner code.

Drop the old qa-lab-runtime shim/export now that nothing consumes it and
keep the plugin-sdk surface aligned with the new seam.
2026-04-14 18:53:25 -04:00
Gustavo Madeira Santana
85eac42d34 QA: remove runner install fallback catalog
Drop the generated qa-runner catalog and the missing/install placeholder
path for repo-private QA runners. The host should discover bundled QA
commands from manifest plus runtime surface only.

Also trim stale qa-matrix install docs and package metadata so the
source-only QA policy stays consistent.
2026-04-14 17:37:18 -04:00
Gustavo Madeira Santana
82a2db71e8 refactor(qa): split Matrix QA into optional plugin (#66723)
Merged via squash.

Prepared head SHA: 27241bd089
Co-authored-by: gumadeiras <5599352+gumadeiras@users.noreply.github.com>
Co-authored-by: gumadeiras <5599352+gumadeiras@users.noreply.github.com>
Reviewed-by: @gumadeiras
2026-04-14 16:28:57 -04:00