Voice Commands

Voice commands is an AI UX pattern that maps spoken phrases to app actions via NLU, with listen indicators, recognized command echo, and success or failure feedback. It targets hands-free and accessibility cases where typing or tapping is awkward, and should always offer a text fallback path.

Share

Interactive demo

Voice Commands
Available commands
"Send email"Opens email composer
"Create task"Opens task form
"Search files"Opens file search
"Open calendar"Opens calendar view

Overview

The design problem

How might we design voice commands so people can trust and act on AI output?

Use this pattern

When this pattern fits

  • Perfect for mobile applications, accessibility tools, and hands-free interaction scenarios where voice commands provide natural, efficient control.

Avoid this pattern

When to skip or lighten it

  • Dense data entry faster on keyboard.
  • Open offices where speaking commands is disruptive.
  • Actions that need visual confirmation of complex forms.

States

State model coming soon

Key UX elements

Key UX elements coming soon

Anti-patterns to avoid

  • Rigid phrase list with no natural language fallback.

  • Executing destructive commands with no confirmation.

  • Listen state with no cancel or “stop listening”.

  • Failed recognition with no text fallback suggestion.

How products use it

ProductImplementation
SiriApp intents and shortcuts via spoken commands.
Google AssistantRoutine and app control from natural phrases.
AlexaSkill commands for smart home and media.
Voice access (OS)“Show numbers” and dictation for full UI control.

Implementation

Copy this prompt to generate a production-ready implementation in Cursor, Claude Code, Lovable, or any AI coding agent.

Generate a production-ready implementation of the "Voice Commands" AI interface design pattern.

Pattern Definition:

Frequently asked questions

Voice commands vs voice input?

Voice input fills text fields. Voice commands trigger actions like “open settings” or “start timer”.

How show available commands?

Cheatsheet, “what can I say?”, and contextual hints on first use of voice mode.

Confirmation for risky actions?

Use voice confirmation or on-screen confirm for pay, send, delete, and bulk operations.

Offline support?

Cache core commands on device when possible; label cloud-dependent actions.

Weekly AI UX in your inbox

Weekly AI interface UX notes and resources on Substack, no spam, unsubscribe anytime.

Subscribe on Substack