Peter Steinberger da44d52ac6 feat: ask_user — structured questions from the agent with web card, channel buttons, and text answers (#109922) ...

* feat(gateway): add transient question runtime (question.* methods + broadcasts)

* feat(agents): add blocking ask_user question tool with chat prompt delivery and text-reply claim

* feat(ui): interactive in-thread question cards for ask_user

* feat(channels): native tap-to-answer buttons for ask_user on Telegram, Discord, and Slack

* feat(ui): unify codex and gateway question cards with interactive gateway answering

* refactor(agents): collapse ask_user pending state to one registry; docs for ask_user

* fix(agents): include ask_user in normal gateway runs; add question-flow control-ui e2e

* test(ui): avoid credential-shaped fixture in question card test

* refactor(ui): reorder stream-group context keys

* fix(gateway,ui): validate question answers at resolve; reject secret/duplicate-label questions; UI retry and reconnect hardening

* fix(gateway,agents): canonicalize accepted option answers; bound ask_user option labels to 64 chars

* chore(ci): prune unused question exports, allowlist mobile question events, fix discord lint

* chore(ci): regenerate protocol/i18n/docs/tool-display artifacts for question surface

* fix(protocol): flatten QuestionRecord for native codegen; drop TS-only alias from schema registry

* chore(android): regenerate ask-user localization resources

* docs: regenerate docs map after rebase

* fix(ci): avoid stale read-only dependency disks

* test: remove stale reef lint suppression ratchet

* fix(ci): keep source locale drift advisory in release gates

* fix(ci): scope locale advisory handling to parity check

2026-07-17 22:24:17 +01:00

..

Resources

feat: ask_user — structured questions from the agent with web card, channel buttons, and text answers (#109922)

2026-07-17 22:24:17 +01:00

AnyCodable.swift

…

AnyCodable+Helpers.swift

…

ArtifactBuildInfo.swift

feat: show build identity in About screens (#103595)

2026-07-10 10:42:36 +01:00

AsyncTimeout.swift

feat: add native inline widget support (#109212)

2026-07-16 19:24:41 -07:00

AudioStreamingProtocols.swift

feat(watchos): connect directly to Gateway as a node (#102893)

2026-07-09 15:53:02 +01:00

BonjourEscapes.swift

…

BonjourServiceResolverSupport.swift

feat(watchos): connect directly to Gateway as a node (#102893)

2026-07-09 15:53:02 +01:00

BonjourTypes.swift

chore(swift): restore compact conditional bodies (#103832)

2026-07-10 18:12:00 +01:00

BridgeFrames.swift

ci(swift): enforce shared OpenClawKit dead-code coverage (#105770)

2026-07-12 17:35:47 -07:00

BrowserCommands.swift

…

CalendarCommands.swift

…

CameraAuthorization.swift

fix(macos): silence Xcode 27 source warnings (#108081)

2026-07-15 01:49:23 -07:00

CameraCapturePipelineSupport.swift

ci(swift): enforce shared OpenClawKit dead-code coverage (#105770)

2026-07-12 17:35:47 -07:00

CameraCommands.swift

…

CameraSessionConfiguration.swift

ci(swift): enforce shared OpenClawKit dead-code coverage (#105770)

2026-07-12 17:35:47 -07:00

CanvasA2UIAction.swift

chore(swift): restore compact conditional bodies (#103832)

2026-07-10 18:12:00 +01:00

CanvasA2UICommands.swift

ci(swift): enforce shared OpenClawKit dead-code coverage (#105770)

2026-07-12 17:35:47 -07:00

CanvasA2UIJSONL.swift

chore(swift): restore compact conditional bodies (#103832)

2026-07-10 18:12:00 +01:00

CanvasCommandParams.swift

ci(swift): enforce shared OpenClawKit dead-code coverage (#105770)

2026-07-12 17:35:47 -07:00

CanvasCommands.swift

…

Capabilities.swift

feat(ios): add private HealthKit summaries (#105616)

2026-07-12 12:52:38 -07:00

CaptureRateLimits.swift

…

ChatCommands.swift

…

ChatImageProcessor.swift

…

ComputerCommands.swift

fix(computer): prevent stale, replayed, and post-cancel desktop actions (#103422)

2026-07-10 06:47:56 +01:00

ComputerInputGeometry.swift

fix(computer): prevent stale, replayed, and post-cancel desktop actions (#103422)

2026-07-10 06:47:56 +01:00

ContactsCommands.swift

…

DeepLinks.swift

fix(ios): defer QR pairing after scanner dismissal (#99572)

2026-07-05 12:31:53 -07:00

DeviceAuthPayload.swift

ci(swift): enforce shared OpenClawKit dead-code coverage (#105770)

2026-07-12 17:35:47 -07:00

DeviceAuthStore.swift

feat(apps): review durable approvals on mobile (#104913)

2026-07-11 19:59:07 -07:00

DeviceCommands.swift

…

DeviceIdentity.swift

fix(macos): silence Xcode 27 source warnings (#108081)

2026-07-15 01:49:23 -07:00

ElevenLabsKitShim.swift

ci(swift): enforce shared OpenClawKit dead-code coverage (#105770)

2026-07-12 17:35:47 -07:00

ExecApprovalPolicySnapshot.swift

fix(macos): reject revoked forwarded exec approvals (#103968)

2026-07-10 19:01:17 -07:00

GatewayChannel.swift

fix(swift): publish gateway snapshot after connect (#110127)

2026-07-17 20:38:35 +01:00

GatewayChannelSupport.swift

fix(onboarding): skip setup for configured gateways and require inference first (#102883)

2026-07-11 10:25:14 -07:00

GatewayConnectChallengeSupport.swift

chore(apps): remove dead code

2026-07-12 10:18:03 -07:00

GatewayConnectionProblem.swift

fix(ios): satisfy watch localization build gates

2026-07-12 18:33:47 +02:00

GatewayConnectOptions.swift

feat: add native inline widget support (#109212)

2026-07-16 19:24:41 -07:00

GatewayConnectPayload.swift

refactor(mac): make app node a CLI capability superset (#105642)

2026-07-12 13:16:07 -07:00

GatewayCustomHeaders.swift

feat(ios): per-gateway custom headers for gateways behind authenticating proxies (#100768)

2026-07-06 17:17:07 +01:00

GatewayDiscoveryBrowserSupport.swift

…

GatewayDiscoveryStatusText.swift

chore(swift): restore compact conditional bodies (#103832)

2026-07-10 18:12:00 +01:00

GatewayEndpointID.swift

…

GatewayErrors.swift

chore(swift): restore compact conditional bodies (#103832)

2026-07-10 18:12:00 +01:00

GatewayNodeSession.swift

feat: align native macOS chat with the web chat capability set (#109712)

2026-07-17 13:44:48 +01:00

GatewayNodeSession+InvokeTimeout.swift

feat: align native macOS chat with the web chat capability set (#109712)

2026-07-17 13:44:48 +01:00

GatewayPayloadDecoding.swift

ci(swift): enforce shared OpenClawKit dead-code coverage (#105770)

2026-07-12 17:35:47 -07:00

GatewayPluginSurfaceSupport.swift

feat: add native inline widget support (#109212)

2026-07-16 19:24:41 -07:00

GatewayPush.swift

feat(setup): rename Crestodian to OpenClaw system agent

2026-07-14 11:03:02 -07:00

GatewayTLSPinning.swift

feat: add native inline widget support (#109212)

2026-07-16 19:24:41 -07:00

GatewayWebSocketTransport.swift

fix(ios): make Talk audio lifecycle-safe (#103072)

2026-07-10 15:03:40 +01:00

GenericPasswordKeychainStore.swift

fix(ios): stop fresh setup from failing after pairing (#108779)

2026-07-16 03:50:54 -07:00

HealthCommands.swift

feat(ios): add private HealthKit summaries (#105616)

2026-07-12 12:52:38 -07:00

InstanceIdentity.swift

feat(watchos): connect directly to Gateway as a node (#102893)

2026-07-09 15:53:02 +01:00

JPEGTranscoder.swift

ci(swift): enforce shared OpenClawKit dead-code coverage (#105770)

2026-07-12 17:35:47 -07:00

LocationCommands.swift

…

LocationCurrentRequest.swift

…

LocationServiceSupport.swift

ci(swift): enforce shared OpenClawKit dead-code coverage (#105770)

2026-07-12 17:35:47 -07:00

LocationSettings.swift

…

LoopbackHost.swift

chore(swift): restore compact conditional bodies (#103832)

2026-07-10 18:12:00 +01:00

MotionCommands.swift

…

NetworkInterfaceIPv4.swift

chore(swift): restore compact conditional bodies (#103832)

2026-07-10 18:12:00 +01:00

NetworkInterfaces.swift

chore(swift): restore compact conditional bodies (#103832)

2026-07-10 18:12:00 +01:00

NodeError.swift

…

OpenClawAppGroup.swift

fix(ios): wire share extension app group signing

2026-06-19 12:53:45 +02:00

OpenClawDateRangeLimitParams.swift

…

OpenClawKitResources.swift

…

PhotoCapture.swift

…

PhotosCommands.swift

…

RemindersCommands.swift

…

ScreenCommands.swift

ci(swift): enforce shared OpenClawKit dead-code coverage (#105770)

2026-07-12 17:35:47 -07:00

SessionMutationResponses.swift

ci(swift): enforce shared OpenClawKit dead-code coverage (#105770)

2026-07-12 17:35:47 -07:00

ShareGatewayRelaySettings.swift

feat(apps): review durable approvals on mobile (#104913)

2026-07-11 19:59:07 -07:00

ShareImageProcessor.swift

fix(ios): resize oversized shared images (#103860)

2026-07-11 15:16:45 -07:00

ShareToAgentDeepLink.swift

feat(ios): refresh pro UI and gateway flows (#87367)

2026-05-28 17:23:26 +03:00

ShareToAgentSettings.swift

chore(swift): enforce current formatting and lint rules (#103313)

2026-07-10 11:54:08 +01:00

SkillManagement.swift

feat(apps): add native mobile Automations parity (#106355)

2026-07-13 15:35:32 -07:00

StoragePaths.swift

…

SystemCommands.swift

ci(swift): enforce shared OpenClawKit dead-code coverage (#105770)

2026-07-12 17:35:47 -07:00

TalkBufferedAudioPlayer.swift

fix(macos): silence Xcode 27 source warnings (#108081)

2026-07-15 01:49:23 -07:00

TalkCommands.swift

…

TalkConfigParsing.swift

…

TalkDirective.swift

chore(swift): restore compact conditional bodies (#103832)

2026-07-10 18:12:00 +01:00

TalkHistoryTimestamp.swift

…

TalkPlaybackLevelMeters.swift

ci(swift): enforce shared OpenClawKit dead-code coverage (#105770)

2026-07-12 17:35:47 -07:00

TalkPromptBuilder.swift

chore(swift): enforce current formatting and lint rules (#103313)

2026-07-10 11:54:08 +01:00

TalkSystemSpeechSynthesizer.swift

ci(swift): enforce shared OpenClawKit dead-code coverage (#105770)

2026-07-12 17:35:47 -07:00

ThrowingContinuationSupport.swift

…

ToolDisplay.swift

ci(swift): enforce shared OpenClawKit dead-code coverage (#105770)

2026-07-12 17:35:47 -07:00

WatchCommands.swift

fix(ios): satisfy watch localization build gates

2026-07-12 18:33:47 +02:00

WebViewJavaScriptSupport.swift

fix(canvas): hosted pages fail on macOS with scoped Gateway auth (#105336)

2026-07-12 13:02:27 +01:00