|   | 
Details
   web
Records
Author Siska Fitrianie; Ronald Poppe; Trung H. Bui; Alin Gavril Chitu; Dragos Datcu; Ramón Dor; Denis Hofs; Pascal Wiggers; Don J.M. Willems; Mannes Poel; Leon J.M. Rothkrantz; Louis G. Vuurpijl; Job Zwiers
Title A multimodal human-computer interaction framework for research into crisis management Type Conference Article
Year 2007 Publication (up) Intelligent Human Computer Systems for Crisis Response and Management, ISCRAM 2007 Academic Proceedings Papers Abbreviated Journal ISCRAM 2007
Volume Issue Pages 149-158
Keywords Character recognition; Communication systems; Disasters; Human computer interaction; Speech recognition; Communication modalities; Evaluation methods; Facial Expressions; Multi-modal information; Multimodal human computer interaction; Multimodal system; Rescue simulation; Technological aspects; Face recognition
Abstract Unreliable communication networks, chaotic environments and stressful conditions can make communication during crisis events difficult. The current practice in crisis management can be improved by introducing ICT systems in the process. However, much experimentation is needed to determine where and how ICT can aid. Therefore, we propose a framework in which predefined modules can be connected in an ad hoc fashion. Such a framework allows for rapid development and evaluation of such ICT systems. The framework offers recognition of various communication modalities including speech, lip movement, facial expression, handwriting and drawing, body gesture, text and visual symbols. It provides mechanisms to fuse these modalities into a context dependent interpretation of the current situation and generate appropriate the multimodal information responses. The proposed toolbox can be used as part of a disaster and rescue simulation. We propose evaluation methods, and focus on the technological aspects of our framework.
Address Man-Machine Interaction Group, Delft University of Technology, Netherlands; Human Media Interaction Group, University of Twente, Netherlands; Nijmegen Institute for Cognition and Information, Radboud University Nijmegen, Netherlands
Corporate Author Thesis
Publisher Information Systems for Crisis Response and Management, ISCRAM Place of Publication Delft Editor B. Van de Walle, P. Burghardt, K. Nieuwenhuis
Language English Summary Language English Original Title
Series Editor Series Title Abbreviated Series Title
Series Volume Series Issue Edition
ISSN 2411-3387 ISBN 9789054874171; 9789090218717 Medium
Track HCIS Expedition Conference 4th International ISCRAM Conference on Information Systems for Crisis Response and Management
Notes Approved no
Call Number Serial 497
Share this record to Facebook
 

 
Author Siska Fitrianie; Leon J.M. Rothkrantz
Title Computed ontology-based situation awareness of multi-user observations Type Conference Article
Year 2009 Publication (up) ISCRAM 2009 – 6th International Conference on Information Systems for Crisis Response and Management: Boundary Spanning Initiatives and New Perspectives Abbreviated Journal ISCRAM 2009
Volume Issue Pages
Keywords Character recognition; Face recognition; Gesture recognition; Information systems; Speech recognition; Communication device; Communication modalities; Information integration; Multi-modal; Multi-user; Multiuser communication; Rapid construction; Situation awareness; Visual languages
Abstract In recent years, we have developed a framework of human-computer interaction that offers recognition of various communication modalities including speech, lip movement, facial expression, handwriting/drawing, gesture, text and visual symbols. The framework allows the rapid construction of a multimodal, multi-device, and multi-user communication system within crisis management. This paper reports the approaches used in multi-user information integration (input fusion) and multimodal presentation (output fission) modules, which can be used in isolation, but also as part of the framework. The latter is able to specify and produce contextsensitive and user-tailored output combining language, speech, visual-language and graphics. These modules provide a communication channel between the system and users with different communication devices. By the employment of ontology, the system's view about the world is constructed from multi-user observations and appropriate multimodal responses are generated.
Address Man-Machine Interaction Group, Delft University of Technology, Netherlands; Netherlands Defence Academy, Delft University of Technology, Netherlands
Corporate Author Thesis
Publisher Information Systems for Crisis Response and Management, ISCRAM Place of Publication Gothenburg Editor J. Landgren, S. Jul
Language English Summary Language English Original Title
Series Editor Series Title Abbreviated Series Title
Series Volume Series Issue Edition
ISSN 2411-3387 ISBN 9789163347153 Medium
Track Open Track Expedition Conference 6th International ISCRAM Conference on Information Systems for Crisis Response and Management
Notes Approved no
Call Number Serial 498
Share this record to Facebook
 

 
Author Daniel Stein; Barbara Krausz; Jobst Löffler; Robin Marterer; Rolf Bardeli; Jochen Schwenninger; Bela Usabaev
Title Enriching an intelligent resource management system with automatic event recognition Type Conference Article
Year 2012 Publication (up) ISCRAM 2012 Conference Proceedings – 9th International Conference on Information Systems for Crisis Response and Management Abbreviated Journal ISCRAM 2012
Volume Issue Pages
Keywords Data handling; Information services; Information systems; Natural resources management; Resource allocation; Service oriented architecture (SOA); Abnormal event detections; Automatic speech recognition; Event recognition; Irm; TETRA channel; Management information systems
Abstract Event recognition systems have high potential to support crisis management and emergency response. Given the vast amount of possible input channels, automatic processing of raw data is crucial. In this paper, we describe several components integrated in an overall intelligent resource management system, namely abnormal event detection in audio and video material, as well as automatic speech recognition within a public safety network. We elaborate on the challenges expected from real life data and the solutions that we applied. The overall system, based on Event-Driven Service-Oriented Architecture, has been implemented and partly integrated into the end users' infrastructures. The system is continuously running since almost two years, collecting data for research purposes. © 2012 ISCRAM.
Address Fraunhofer IAIS, Schloss Birlinghoven, St. Augustin, Germany; University of Paderborn, Germany
Corporate Author Thesis
Publisher Simon Fraser University Place of Publication Vancouver, BC Editor L. Rothkrantz, J. Ristvej, Z.Franco
Language English Summary Language English Original Title
Series Editor Series Title Abbreviated Series Title
Series Volume Series Issue Edition
ISSN 2411-3387 ISBN 9780864913326 Medium
Track Event-Driven Techniques and Methods for Crisis Management Expedition Conference 9th International ISCRAM Conference on Information Systems for Crisis Response and Management
Notes Approved no
Call Number Serial 209
Share this record to Facebook