Commit Graph

1331 Commits

Author SHA1 Message Date
Peter Steinberger
a26df7153f test(qa): deduplicate mock provider fixtures (#117590) 2026-08-01 13:05:21 -07:00
Vincent Koc
263741b1f0 fix(ci): align release validation fixtures (#117494)
* fix(release): align beta 6 e2e fixtures

* fix(doctor): preserve missing state startup signal

* test(release): align beta e2e contracts

* test(agents): use canonical empty auth store

* test(agents): isolate prompt cooldown scheduling

* test(release): align main validation fixtures

* test(release): accept Code Mode plugin tool evidence

* fix(test): repair release validation checks

* test(cron): assert structured session targets
2026-08-02 00:39:36 +08:00
Peter Steinberger
568ea29d2e refactor(plugins): inherit shared package boundary settings (#117474) 2026-08-01 09:11:09 -07:00
Dallin Romney
fa8774cc61 fix(qa): Slack progress lane misses successful delivery (#117391)
* fix(qa): verify Slack live delivery observations

* test(qa): update Slack scenario fixture contract

* fix: guard Slack QA proxy network boundary

* refactor: use shared capture for Slack QA observations

* refactor(qa): split Slack fallback evidence

* fix(qa): verify Slack commentary from native capture

* fix(slack): preserve debug capture with proxies

* fix(qa): narrow Slack commentary fallback

* fix(qa): observe successful Slack progress writes
2026-08-02 00:07:01 +08:00
Dallin Romney
56ffa2bca4 fix(qa): preserve Slack fallback evidence (#117420) 2026-08-01 21:31:41 +08:00
Dallin Romney
39cc0a3199 fix(qa): Matrix replies disappear after final replacement (#117390)
* fix(qa): preserve Matrix relations through replacements

* fix: honor Matrix replacement relation semantics

* fix(qa): reconcile late Matrix replacement targets

* test(qa): exercise Matrix recorder through public behavior
2026-08-01 21:27:15 +08:00
Dallin Romney
fb9c8e74e6 fix(qa): keep Matrix SDK as QA Lab development dependency (#117392) 2026-08-01 20:59:04 +08:00
Peter Steinberger
aa2a5c96f6 feat(channels): record account lifecycle facts and retire inferred health vocabularies (#117300)
* fix(channels): record account lifecycle facts

* fix(channels): bound recorded lifecycle grace

* fix(channels): preserve authored health state

* test: dedupe health snapshot type literal and fix spread order
2026-08-01 02:51:47 -07:00
Peter Steinberger
b721cffa44 fix(inference): simplify lifecycle and preserve Codex tool identity (#117298) 2026-08-01 02:05:45 -07:00
Vincent Koc
f5a8cb02ea test(release): repair full validation regressions (#116931)
* test(discord): mock thread delete listener

* test(qa): expect blocked update evidence

* test(telegram): preserve recovered context body

* fix(test): configure kitchen-sink personality

* test(browser): expect canonical staged upload paths

* test(browser): canonicalize macOS download roots

* test(feishu): seed legacy session rows offline

* test(telegram): isolate message context session stores

* test(qqbot): expect canonical media paths

* test(anthropic): match canonical transcript paths

* test(qa): expect canonical session store keys

* test(gateway): isolate rewind media reads

* test(release): review plugin child spawns

* test(plugins): expect process-stable manifest metadata

* test(google): retire usage telemetry contracts
2026-08-01 15:42:50 +08:00
Ahmed Tarek
730cf56915 fix(msteams): prevent duplicate final replies (#116398)
* fix(msteams): preserve message-tool thread routing

Co-authored-by: Vincent Koc <vincentkoc@ieee.org>

* test(msteams): prove thread-aware final dedupe

* fix(agents): suppress duplicate source previews

* fix(agents): dedupe current-source reply previews

---------

Co-authored-by: Vincent Koc <vincentkoc@ieee.org>
2026-08-01 15:32:56 +08:00
Dallin Romney
947886e764 fix(qa): align release harness contracts (#116812) 2026-08-01 13:24:10 +08:00
Dallin Romney
2261a9c5b4 test(qa): align fanout catalog with public evidence (#117202) 2026-08-01 13:07:18 +08:00
Dallin Romney
40f0847fc3 fix(qa): isolate Slack MPIM dedupe proof (#116843) 2026-08-01 12:56:10 +08:00
Dallin Romney
f58570cb8c fix(qa): stabilize Slack progress and table proofs (#116847)
* fix(qa): stabilize Slack progress and table proofs

* fix(qa): type Slack invalid-blocks instrumentation
2026-08-01 12:55:39 +08:00
Dallin Romney
bf32414a4a fix(qa): keep memory context proof on the QA channel (#116849)
* fix(qa): correct memory and Codex watchdog contracts

* test(qa): keep channel assertion in channel catalog
2026-08-01 12:53:00 +08:00
Peter Steinberger
cb16d739cf fix(inference): harden Codex streaming, cancellation, and live QA (#116012)
* fix(inference): harden Codex turns, streams, and live QA

* fix(inference): dispatch open CR-delimited response frames

* fix(inference): finish live goal and split streaming regressions

* fix(codex): wait for interrupted turn completion

* fix(codex): narrow terminal collector notification ownership

* fix(inference): harden completion authority and lifecycle

* fix(inference): use canonical source delivery contract

* test(inference): align lifecycle probes with current main

* style(inference): format source delivery verification

* fix(goals): prevent premature completion across staged work

* fix(qa): settle streamed goal turns before continuation

* fix(goals): require visible replies after goal completion

* test(qa): keep goal flow regressions within lint limits
2026-07-31 21:29:33 -07:00
Peter Steinberger
7dd74db836 fix: preserve completion delivery and truthful agent session state (#117119) 2026-07-31 17:35:14 -07:00
Peter Steinberger
6d33976318 fix(qa): authenticate actual scenario execution evidence (#117004)
Co-authored-by: Peter Steinberger <steipete@macos.shared>
2026-07-31 13:03:12 -07:00
Peter Steinberger
80bbdeda1c fix(qa): verify requested scenarios and reject silent character runs (#116912)
* fix(qa): authenticate requested scenario test execution

* fix(qa): reject unanswered character evaluation runs

* refactor(qa): extract native vitest report validation

* fix(qa): require requested native test file to exist

---------

Co-authored-by: Peter Steinberger <steipete@macos.shared>
2026-07-31 09:18:05 -07:00
Peter Steinberger
2073371f80 fix(qa): preserve transport ownership and truthful reporting (#116911)
Co-authored-by: Peter Steinberger <steipete@macos.shared>
2026-07-31 09:00:44 -07:00
Harjoth Khara
102c2e1a64 fix(slack): recover MPIM thread context from outbound replies (#116660)
Co-authored-by: scoootscooob <167050519+scoootscooob@users.noreply.github.com>
2026-07-31 23:12:56 +08:00
Peter Steinberger
366a686cba fix(qa): authenticate producer and generated-media evidence (#116828)
Co-authored-by: Peter Steinberger <steipete@macos.shared>
2026-07-31 05:24:06 -07:00
Peter Steinberger
4d7d710c48 fix(qa-channel): enforce message and thread lifecycle ownership (#116801)
Co-authored-by: Peter Steinberger <steipete@macos.shared>
2026-07-31 04:56:07 -07:00
Peter Steinberger
4ec46e0ff1 fix(qa-lab): support groups and isolate thread timelines (#116803)
Co-authored-by: Peter Steinberger <steipete@macos.shared>
2026-07-31 04:54:03 -07:00
Peter Steinberger
82231b425b fix(qa-channel): isolate account evidence and exclude deleted messages (#116744)
* fix(qa): scope transport verdicts to visible account replies

* refactor(qa): remove obsolete outbound wait aliases

---------

Co-authored-by: Peter Steinberger <steipete@macos.shared>
2026-07-31 04:19:41 -07:00
Peter Steinberger
7ea4129227 fix(qa): authenticate summaries and bound native scenario commands (#116748)
Co-authored-by: Peter Steinberger <steipete@macos.shared>
2026-07-31 03:12:48 -07:00
Peter Steinberger
1f578f0e65 fix(telegram): validate native queue arguments before fallback (#116726)
Co-authored-by: Peter Steinberger <steipete@macos.shared>
2026-07-31 02:45:15 -07:00
Vincent Koc
37b1a71654 fix(release): unblock beta validation workflows (#116708)
* fix(release): repair beta validation workflow state

* fix(qa): dispatch yielded fanout runs without task tracking

* fix(test): honor GPT-Live shard opt-in
2026-07-31 15:47:11 +08:00
Dallin Romney
126933ba73 fix(qa): exceed Slack table aggregate limit in fallback probe (#116447) 2026-07-31 14:56:20 +08:00
Dallin Romney
fa5ee0798b fix(qa): use built plugin tools server (#116442) 2026-07-31 14:49:24 +08:00
Dallin Romney
397fe272a0 fix(qa): stop waiting on yielded fanout runs (#116440)
* fix(qa): observe resumed fanout completions

* test(qa): keep runtime watchdog assertions in runtime suite
2026-07-31 14:36:59 +08:00
Dallin Romney
b13b3d9a0f fix(qa): bound gateway log cleanup (#116431) 2026-07-31 14:23:36 +08:00
Dallin Romney
5c061507d3 fix(qa): align Slack progress scenarios with fresh finals (#116445)
* fix(qa): verify Slack progress drafts against fresh finals

* fix(qa): narrow Slack progress message identity
2026-07-31 14:22:24 +08:00
Dallin Romney
142e745372 fix(qa): avoid classifying fetched prose as tool failure (#116444)
* fix(qa): avoid classifying fetched prose as tool failure

* test(qa): keep tool result regression concise
2026-07-31 14:21:57 +08:00
Dallin Romney
2857eaa0f5 fix(qa): reset Matrix scenario streaming state (#116454) 2026-07-31 14:19:58 +08:00
Vincent Koc
bc63c66988 fix(qa): keep Anthropic parity scenarios working in Code Mode
Route hidden QA capabilities through Code Mode and wait for fanout workers to settle before synthesis.
2026-07-31 13:53:34 +08:00
Patrick Erichsen
61cf4b9246 test(buzz): add live QA Lab channel lane (#116298)
* feat(buzz): add live QA runner

* ci(qa): add gated Buzz live lane

* docs(qa): document Buzz live testing

* fix(buzz): keep QA relay type private

* test(buzz): type QA suite mock

* fix(buzz): preserve racing QA reply relations

* fix(qa): harden Buzz credential redaction

* fix(buzz): ignore retained QA relay events

* fix(buzz): clean up observer setup failures

* test(buzz): return complete racing messages

* fix(buzz): default QA credentials to file

* fix(qa): validate pooled Buzz secrets

* fix(qa): redact structured Buzz auth tags

* fix(buzz): preserve QA credential env override

* fix(qa): redact inspected Buzz auth tags

* test(buzz): limit live QA to supported scenarios

* ci(qa): run Buzz lane in release checks

* fix(qa): require secure remote Buzz relays

* fix(qa): satisfy Buzz QA validation gates

* fix(qa): inject credential leasing into transport adapters
2026-07-30 17:44:27 -07:00
joshavant
db4ad84d7f test(qa-lab): preserve Matrix fault proxy identity 2026-07-30 18:47:51 -05:00
joshavant
dd4728305f test(qa-lab): use upload-safe Tuwunel fixture 2026-07-30 14:57:44 -05:00
joshavant
fe654eaacd test(qa-lab): refresh Matrix Tuwunel fixture 2026-07-30 14:57:44 -05:00
Vincent Koc
0822e8d39e fix(qa): preserve missing Ollama cache telemetry (#116424) 2026-07-30 16:37:54 +00:00
Dallin Romney
424c36a2d5 fix(qa): prevent Slack cleanup from stalling profile runs (#116361)
* fix(qa): release Slack leases after gateway stop

* fix(qa): preserve async Slack cleanup contract

* fix(qa): expose post-gateway adapter cleanup
2026-07-30 19:05:49 +08:00
Dallin Romney
714a46d7f2 fix(qa): align live scenario selection (#115767) 2026-07-30 16:59:01 +08:00
Dallin Romney
184069f3df fix(qa): make Slack observer lazy and abortable (#116312) 2026-07-30 16:46:49 +08:00
joshavant
a56f7a2b98 test(qa): assert hook account rejection reasons 2026-07-30 02:59:06 -05:00
joshavant
54a6dba0d3 fix(gateway): validate hook delivery accounts 2026-07-30 02:59:06 -05:00
Dallin Romney
7df05d5fc0 refactor(qa): remove live-channel scenario registries and wrappers (#115752)
* refactor(qa): remove duplicate channel scenario registries

* refactor(qa): route live scenarios through shared runners

* fix(qa): isolate WhatsApp driver retries

* refactor(qa): add module export flow arguments

* test(qa): include scenario metadata in matrix fixture
2026-07-30 13:56:34 +08:00
Peter Steinberger
353c05d547 test(qa): recognize internal image completions (#116234) 2026-07-29 22:09:45 -07:00
Vincent Koc
9e041cd386 fix(hooks): preserve multi-account agent delivery (#116095)
* fix(hooks): preserve account routing for agent delivery

Refs #43866

Co-authored-by: Paul Desmond Parker <paul.parker@dcconnect.cn>

* test(gateway): prove hook account delivery handoff

---------

Co-authored-by: Paul Desmond Parker <paul.parker@dcconnect.cn>
2026-07-30 07:10:21 +08:00