Build around the signal that costs the least
Hands-free does not need to mean voice-only. Ability, fatigue, pain, speech, privacy, noise, and concentration can change across a day. A resilient setup lets the user alternate between voice, text, keyboard, pointer, switch, head tracking, or gaze without losing the task state.
Fluent currently implements voice, typed fallback, and optional gaze context. Its design goal is one command surface where those inputs contribute to the same request instead of forcing the user into isolated modes.
- Intent layer: voice or text describes the outcome.
- Target layer: an explicit name, current focus, or optional gaze identifies the object.
- Correction layer: editable text and clarification repair recognition or target errors.
- Consent layer: a deliberate input approves or rejects consequential work.
- Recovery layer: stop, cancel, undo, or retry remains close to the active task.
A practical Fluent preview workflow
Start with a low-risk task in a familiar app. Arm the microphone with the wake phrase, microphone control, or push-to-talk shortcut. State one observable outcome. Watch the action trace and use cancel if the route diverges. Keep typed input available for private details or precise correction.
If gaze is enabled, use it only to disambiguate a visible target. Name the target aloud when practical. Avoid relying on gaze for activation or as the only route through the interface.
Evaluate the whole loop, not the demo moment
A successful spoken command is only one part of hands-free use. The real test includes installation, microphone and camera permissions, provider setup, wake and sleep behavior, correction, target ambiguity, cancellation, failure recovery, updates, and uninstall.
Measure effort as well as task completion. Count how often another person must help, how often the user must fall back to a costly input, and whether stop behavior is fast and understandable.
- Can the user reach the first useful task without developer tools?
- Can every active run be understood and stopped?
- Can a speech or target error be corrected without restarting everything?
- Does the baseline still work with the camera off?
- Can the user inspect and remove stored settings, memory, logs, and credentials?
When to involve an accessibility specialist
People with complex or changing access needs may benefit from an assistive technology professional who can compare voice access, switch access, head tracking, eye tracking, ergonomic hardware, and operating-system tools. Fluent is software documentation, not medical advice.
The best setup is the one that remains reliable on a difficult day, not the one that looks most hands-free in a short demo.