The Designers' Environment
Industrial designers currently write notes onto index cards, place them on a table, group them, label them, and relate them. We support this in a digital system in the Designers' Environment.
Speech Filtered Bubble Ray
Speech Filtered Bubble Ray is a new interaction technique that allows one to select items on a large display by pointing in a general direction and using speech to filter the selection.
Training Speech and Gesture Intefaces by Demonstration
This video describes a method of mapping speech and gesture commands to keyboard and mouse actions over any existing single user application. Also see Mapping Firefox
Motivating Multimodal Interaction Around Digital Tables Video
This video motivates multimodal interaction around multi user digital tables through several example applications: The Sims, Virtual Surgery, Warcraft III and Google Earth.
Multi User Multimodal Tabletop Interaction Video
This video shows a brief video of multi user speech and gesture over Google Earth and Warcraft III.
The Shape of Conversation Video
This video shows multiple people doing crazy things with speech on a table top.
The GroupLab Diamond Touch Toolkit Video
This video shows work by Rob Diaz-Marino using the MERL Diamond Touch Hardware.
The SDG Toolkit in Action Video
This video shows the result of an undergradute class using the multi mice and keyboard toolkit that I developed for my Masters thesis.