Skip to content

voice personal assistant layer#1

Open
JagjeevanAK wants to merge 20 commits intomainfrom
voice-personal-assistant-layer
Open

voice personal assistant layer#1
JagjeevanAK wants to merge 20 commits intomainfrom
voice-personal-assistant-layer

Conversation

@JagjeevanAK
Copy link
Copy Markdown
Owner

@JagjeevanAK JagjeevanAK commented Mar 6, 2026

No description provided.

Signed-off-by: Jagjeevan Kashid <jagjeevandev97@gmail.com>
Introduce core services for the voice assistant stack:\n- live auth adapter for Gemini/Vertex/Google auth modes\n- bidirectional live voice session management\n- audio playback support for streamed PCM output\n- audio engine updates for normalized PCM capture\n- local voice debug logger utilities\n- tests for live auth behavior

Signed-off-by: Jagjeevan Kashid <jagjeevandev97@gmail.com>
Add reusable utility modules that power personal-assistant behavior:\n- runtime and pending-action summarization for voice mode\n- tool confirmation resolution helpers for voice-driven approvals\n- tests for state and resolver behavior\n- user hint service update to support forced live steering hints

Signed-off-by: Jagjeevan Kashid <jagjeevandev97@gmail.com>
Refactor UI infrastructure needed by the voice assistant:\n- route ToolActionsProvider confirmations through resolveToolConfirmation\n- expose optional keypress context accessor\n- make useKeypress resilient when no provider is present

Signed-off-by: Jagjeevan Kashid <jagjeevandev97@gmail.com>
Add the core voice assistant runtime for conversational control:\n- voice assistant context and mode hook\n- live controller for transcript/audio/tool-call handling\n- ambiguity gating and direct yes/no approval mapping\n- local context query tool entrypoint for general read-only questions\n- mic status display integration for listening/transcript/model feedback

Signed-off-by: Jagjeevan Kashid <jagjeevandev97@gmail.com>
Wire the voice assistant into the main interactive app flow:\n- expose voice mode toggle/state via context provider\n- route runtime status, pending approvals, and steering hooks\n- handle spoken approval resolution across tool/auth/permission prompts\n- add start/finish and pending-attention voice announcements

Signed-off-by: Jagjeevan Kashid <jagjeevandev97@gmail.com>
Align integration and UI tests with new voice assistant behavior:\n- improve AppRig render/idle synchronization and output waits\n- update model steering integration to resolve pending tools by call id\n- adjust renderer setup for alternate-buffer settings snapshots\n- refresh approval/composer snapshots and related indicator assertions

Signed-off-by: Jagjeevan Kashid <jagjeevandev97@gmail.com>
Signed-off-by: Jagjeevan Kashid <jagjeevandev97@gmail.com>
Signed-off-by: Jagjeevan Kashid <jagjeevandev97@gmail.com>
Signed-off-by: Jagjeevan Kashid <jagjeevandev97@gmail.com>
Signed-off-by: Jagjeevan Kashid <jagjeevandev97@gmail.com>
Signed-off-by: Jagjeevan Kashid <jagjeevandev97@gmail.com>
Signed-off-by: Jagjeevan Kashid <jagjeevandev97@gmail.com>
Signed-off-by: Jagjeevan Kashid <jagjeevandev97@gmail.com>
@JagjeevanAK JagjeevanAK force-pushed the voice-personal-assistant-layer branch from e02217b to 040cd5d Compare March 6, 2026 04:41
Signed-off-by: Jagjeevan Kashid <jagjeevandev97@gmail.com>
Signed-off-by: Jagjeevan Kashid <jagjeevandev97@gmail.com>
…to voice-personal-assistant-layer

Signed-off-by: Jagjeevan Kashid <jagjeevandev97@gmail.com>

# Conflicts:
#	package-lock.json
#	packages/cli/src/ui/components/ApprovalModeIndicator.tsx
#	packages/cli/src/ui/components/MainContent.tsx
#	packages/cli/src/ui/components/__snapshots__/ApprovalModeIndicator.test.tsx.snap
Signed-off-by: Jagjeevan Kashid <jagjeevandev97@gmail.com>
Signed-off-by: Jagjeevan Kashid <jagjeevandev97@gmail.com>
Signed-off-by: Jagjeevan Kashid <jagjeevandev97@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant