Powerful hands-free input - Talon / HN

see also

• Hands-Free Coding / HN

• Voice Control - talk to your computer (Dragon/Wav2Letter)
• Noise Control - click with a back-beat
• Eye Tracking - mouse where you look - r/EyeTracking
  • Tobii) / Tobii 5 Eye Tracker - v5 not officialy supported on linux but still work with talon
  • Pupil - open source / commercial hardware
  • EyeCommander - open source ?
• Python Scripts - customize everything

Demo

• using a Tobii eye tracker for mouse movement and Talon’s hiss+pop noise recognizers to click.
• overview of a software developer using Talon day to day (Emily Shea)

Install

• Configuration (knausj85/knausj_talon)
• Speech Recognition Engine / Wav2Letter
• Testing out the basics Comes with all dependencies, just launch ./run.sh and talk.
• Emily Shea / her Talon config

Slack

Application Integration

Browse Websites Without a Mouse

• Firefox Mouseless / Chrome Click by Voice
  • h - Show “blobs” with characters
  • Enter and Shift+Enter - Click blob or open in new tab
  • Ctrl+Enter - Save the URL of the selected link to the clipboard
  • k and l - Scroll up and down
  • _ and + - Scroll up and down fast
  • j and ; - Switch to the tab to the left/right of the current one
  • J and : - Move the tab left/right
  • Ctrl+j and Ctrl+; - Go back/forward in history
• Vimium

Command history

Implemented in python

• talon_configs/misc/history.py using webview
• knausj_talon/code/history.py

Programing Feature

Formatters

Try using formatters by saying e.g. “snake hello world,” which will insert hello_world

Mutliple formatters can be used togther, e.g. “dubstring snake hello world,” which will insert “hello_world”

Once you have the basics of text input down, try copying some code from one window to another.

After that, explore using ordinal repetition for easily repeating a command without pausing (e.g., saying “go up fifth” will go up five lines), window switching (“focus chrome”), and moving around in your text editor of choice.

Ref

• Writing and coding by voice with Talon