@hci-uwb

A Communicative Mediator in a Virtual Environment: Processing of Multimodal Input and Output

, , and . Proceedings of the International Workshop on Information Presentation and Natural Multimodal Dialogue, page 71-74. (2001)

Abstract

This paper presents work on multimodal communication with an anthropomorphic agent. It focuses on processing of multimodal input and output employing natural language and gestures in virtual environments. On the input side, we describe our approach to recognize and interpret co-verbal gestures used for pointing, object manipulation, and object description. On the output side, we present the utterance generation module of the agent which is able to produce coordinated speech and gestures.

Links and resources

Tags

community

  • @hci-uwb
  • @marcerich
@hci-uwb's tags highlighted