|   | 
Author Siska Fitrianie; Leon J.M. Rothkrantz
Title Computed ontology-based situation awareness of multi-user observations Type Conference Article
Year 2009 Publication ISCRAM 2009 – 6th International Conference on Information Systems for Crisis Response and Management: Boundary Spanning Initiatives and New Perspectives Abbreviated Journal ISCRAM 2009
Volume Issue Pages
Keywords Character recognition; Face recognition; Gesture recognition; Information systems; Speech recognition; Communication device; Communication modalities; Information integration; Multi-modal; Multi-user; Multiuser communication; Rapid construction; Situation awareness; Visual languages
Abstract In recent years, we have developed a framework of human-computer interaction that offers recognition of various communication modalities including speech, lip movement, facial expression, handwriting/drawing, gesture, text and visual symbols. The framework allows the rapid construction of a multimodal, multi-device, and multi-user communication system within crisis management. This paper reports the approaches used in multi-user information integration (input fusion) and multimodal presentation (output fission) modules, which can be used in isolation, but also as part of the framework. The latter is able to specify and produce contextsensitive and user-tailored output combining language, speech, visual-language and graphics. These modules provide a communication channel between the system and users with different communication devices. By the employment of ontology, the system's view about the world is constructed from multi-user observations and appropriate multimodal responses are generated.
Address Man-Machine Interaction Group, Delft University of Technology, Netherlands; Netherlands Defence Academy, Delft University of Technology, Netherlands
Corporate Author Thesis
Publisher Information Systems for Crisis Response and Management, ISCRAM Place of Publication Gothenburg Editor J. Landgren, S. Jul
Language English Summary Language English Original Title
Series Editor Series Title Abbreviated Series Title
Series Volume Series Issue Edition
ISSN 2411-3387 ISBN 9789163347153 Medium
Track Open Track Expedition Conference 6th International ISCRAM Conference on Information Systems for Crisis Response and Management
Notes Approved no
Call Number Serial 498
Share this record to Facebook