@nadinepietras

Multimodal local search in Speak4it

, and . Proceedings of the 16th international conference on Intelligent user interfaces, page 435--436. New York, NY, USA, ACM, (2011)
DOI: 10.1145/1943403.1943486

Abstract

Speak4it is a consumer-oriented mobile search application that leverages multimodal input and output to allow users to search for and act on local business information. It supports true multimodal integration where user inputs can be distributed over multiple input modes. In addition to specifying queries by voice e.g. bike repair shops near the golden gate bridge users can combine speech and gesture, for example, gas stations + <route drawn on display&#62; will return the gas stations along the specified route traced on the display. We describe the underlying multimodal architecture and some challenges of supporting multimodal interaction as a deployed mobile service.

Links and resources

Tags

community

  • @nadinepietras
  • @dblp
@nadinepietras's tags highlighted