Siska Fitrianie, Ronald Poppe, Trung H. Bui, Alin Gavril Chitu, Dragos Datcu, Ramón Dor, et al. (2007). A multimodal human-computer interaction framework for research into crisis management. In K. Nieuwenhuis P. B. B. Van de Walle (Ed.), Intelligent Human Computer Systems for Crisis Response and Management, ISCRAM 2007 Academic Proceedings Papers (pp. 149–158). Delft: Information Systems for Crisis Response and Management, ISCRAM.
Abstract: Unreliable communication networks, chaotic environments and stressful conditions can make communication during crisis events difficult. The current practice in crisis management can be improved by introducing ICT systems in the process. However, much experimentation is needed to determine where and how ICT can aid. Therefore, we propose a framework in which predefined modules can be connected in an ad hoc fashion. Such a framework allows for rapid development and evaluation of such ICT systems. The framework offers recognition of various communication modalities including speech, lip movement, facial expression, handwriting and drawing, body gesture, text and visual symbols. It provides mechanisms to fuse these modalities into a context dependent interpretation of the current situation and generate appropriate the multimodal information responses. The proposed toolbox can be used as part of a disaster and rescue simulation. We propose evaluation methods, and focus on the technological aspects of our framework.
|
Don J.M. Willems, & Louis Vuurpijl. (2007). Designing interactive maps for crisis management. In K. Nieuwenhuis P. B. B. Van de Walle (Ed.), Intelligent Human Computer Systems for Crisis Response and Management, ISCRAM 2007 Academic Proceedings Papers (pp. 159–166). Delft: Information Systems for Crisis Response and Management, ISCRAM.
Abstract: This paper describes the design, implementation, and evaluation of pen input recognition systems that are suited for so-called interactive maps. Such systems provide the possibility to enter handwriting, drawings, sketches and other modes of pen input. Typically, interactive maps are used to annotate objects or mark situations that are depicted on the display of video walls, handhelds, PDAs, or tablet PCs. Our research explores the possibility of employing interactive maps for crisis management systems, which require robust and effective communication of, e.g., the location of objects, the kind of incidents, or the indication of route alternatives. The design process described here is a mix of “best practices” for building perceptive systems, combining research in pattern recognition, human factors, and human-computer interaction. Using this approach, comprising data collection and annotation, feature extraction, and the design of domain-specific recognition technology, a decrease in error rates is achieved from 9.3% to 4.0%.
|