1.1
1
xml
info:srw/schema/1/dc-v1.1
A multimodal human-computer interaction framework for research into crisis management
Siska Fitrianie
Ronald Poppe
Trung H. Bui
Alin Gavril Chitu
Dragos Datcu
Ramón Dor
Denis Hofs
Pascal Wiggers
Don J.M. Willems
Mannes Poel
Leon J.M. Rothkrantz
Louis G. Vuurpijl
Job Zwiers
B. Van de Walle, P.B., K. Nieuwenhuis
Unreliable communication networks, chaotic environments and stressful conditions can make communication during crisis events difficult. The current practice in crisis management can be improved by introducing ICT systems in the process. However, much experimentation is needed to determine where and how ICT can aid. Therefore, we propose a framework in which predefined modules can be connected in an ad hoc fashion. Such a framework allows for rapid development and evaluation of such ICT systems. The framework offers recognition of various communication modalities including speech, lip movement, facial expression, handwriting and drawing, body gesture, text and visual symbols. It provides mechanisms to fuse these modalities into a context dependent interpretation of the current situation and generate appropriate the multimodal information responses. The proposed toolbox can be used as part of a disaster and rescue simulation. We propose evaluation methods, and focus on the technological aspects of our framework.
urn:ISBN:9789054874171; 9789090218717
openurl:?ctx_ver=Z39.88-2004&rfr_id=info%3Asid%2Fidl.iscram.org%2F&genre=proceeding&title=A%20multimodal%20human-computer%20interaction%20framework%20for%20research%20into%20crisis%20management&stitle=ISCRAM%202007&issn=2411-3387&isbn=9789054874171%3B%209789090218717&date=2007&spage=149&epage=158&aulast=Siska%20Fitrianie&au=Ronald%20Poppe&au=Trung%20H.%20Bui&au=Alin%20Gavril%20Chitu&au=Dragos%20Datcu&au=Ram%F3n%20Dor&au=Denis%20Hofs&au=Pascal%20Wiggers&au=Don%20J.M.%20Willems&au=Mannes%20Poel&au=Leon%20J.M.%20Rothkrantz&au=Louis%20G.%20Vuurpijl&au=Job%20Zwiers&pub=Information%20Systems%20for%20Crisis%20Response%20and%20Management%2C%20ISCRAM&place=Delft&sid=refbase%3AISCRAM
url:http://idl.iscram.org/show.php?record=497
citekey:SiskaFitrianie_etal2007
citation:Siska Fitrianie, Ronald Poppe, Trung H. Bui, Alin Gavril Chitu, Dragos Datcu, Ramón Dor, et al. (2007). A multimodal human-computer interaction framework for research into crisis management. In K. Nieuwenhuis P. B. B. Van de Walle (Ed.), Intelligent Human Computer Systems for Crisis Response and Management, ISCRAM 2007 Academic Proceedings Papers (pp. 149-158). Delft: Information Systems for Crisis Response and Management, ISCRAM.
2007
ConferencePaper
text
Character recognition
Communication systems
Disasters
Human computer interaction
Speech recognition
Communication modalities
Evaluation methods
Facial Expressions
Multi-modal information
Multimodal human computer interaction
Multimodal system
Rescue simulation
Technological aspects
Face recognition
file:http://idl.iscram.org/files/fitrianie/2007/497_Fitrianie_etal2007.pdf
Information Systems for Crisis Response and Management, ISCRAM
English
2411-3387
Intelligent Human Computer Systems for Crisis Response and Management, ISCRAM 2007 Academic Proceedings Papers
2007
149
158
1