Records |
Author |
Dragos Datcu; Leon J.M. Rothkrantz |
Title |
A Dialog Action Manager for automatic crisis management |
Type |
Conference Article |
Year |
2008 |
Publication |
Proceedings of ISCRAM 2008 – 5th International Conference on Information Systems for Crisis Response and Management |
Abbreviated Journal |
ISCRAM 2008 |
Volume |
|
Issue |
|
Pages |
384-393 |
Keywords |
Bayesian networks; Information systems; Management information systems; Mobile devices; Safe handling; Automatic systems; Crisis management; Crisis management systems; Crisis situations; Data-communication; Reasoning; System architectures; System knowledge; Managers |
Abstract |
This paper presents the results of our research on the development of a Dialog Action Manager-DAM as part of a complex crisis management system. Imagine the utility of such an automatic system to detect the crisis and to provide support to people in contexts similar to what happened recently at the underground in London and Madrid. Preventing and handling the scenarios of terrorism and other crisis are nowadays maybe the most important issues for a modern and safe society. In order to automate the crisis support, DAM simulates the behavior of an employee at the crisis centre handling telephone calls from human observers. Firstly, the system has to mimic the natural support for the paradigm 'do you hear me?' and next for the paradigm 'do you understand me?'. The people witnessing the crisis event as well as human experts provide reports and expertise according to their observations and knowledge on the crisis. The system knowledge and the data communication follow the XML format specifications. The system is centered on the results of our previous work on creating a user-centered multimodal reporting tool that works on mobile devices. In our paper we describe the mechanisms for creating an automatic DAM system that is able to analyze the user messages, to identify and track the crisis contexts, to support dialogs for crisis information disambiguation and to generate feedback in the form of advice to the users. The reasoning is done by using a data frame and rule based system architecture and an alternative Bayesian Network approach. In the paper we also present a series of experiments we have attempted in our endeavor to correctly identify natural solutions for the crisis situations. |
Address |
Man-Machine Interaction Group, Delft University of Technology, 2628 CD, Delft, Netherlands |
Corporate Author |
|
Thesis |
|
Publisher |
Information Systems for Crisis Response and Management, ISCRAM |
Place of Publication |
Washington, DC |
Editor |
F. Fiedrich, B. Van de Walle |
Language |
English |
Summary Language |
English |
Original Title |
|
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
Series Volume |
|
Series Issue |
|
Edition |
|
ISSN |
2411-3387 |
ISBN |
9780615206974 |
Medium |
|
Track |
Observation Systems in Crisis Situations |
Expedition |
|
Conference |
5th International ISCRAM Conference on Information Systems for Crisis Response and Management |
Notes |
|
Approved |
no |
Call Number |
|
Serial |
424 |
Share this record to Facebook |
|
|
|
Author |
Siska Fitrianie; Ronald Poppe; Trung H. Bui; Alin Gavril Chitu; Dragos Datcu; Ramón Dor; Denis Hofs; Pascal Wiggers; Don J.M. Willems; Mannes Poel; Leon J.M. Rothkrantz; Louis G. Vuurpijl; Job Zwiers |
Title |
A multimodal human-computer interaction framework for research into crisis management |
Type |
Conference Article |
Year |
2007 |
Publication |
Intelligent Human Computer Systems for Crisis Response and Management, ISCRAM 2007 Academic Proceedings Papers |
Abbreviated Journal |
ISCRAM 2007 |
Volume |
|
Issue |
|
Pages |
149-158 |
Keywords |
Character recognition; Communication systems; Disasters; Human computer interaction; Speech recognition; Communication modalities; Evaluation methods; Facial Expressions; Multi-modal information; Multimodal human computer interaction; Multimodal system; Rescue simulation; Technological aspects; Face recognition |
Abstract |
Unreliable communication networks, chaotic environments and stressful conditions can make communication during crisis events difficult. The current practice in crisis management can be improved by introducing ICT systems in the process. However, much experimentation is needed to determine where and how ICT can aid. Therefore, we propose a framework in which predefined modules can be connected in an ad hoc fashion. Such a framework allows for rapid development and evaluation of such ICT systems. The framework offers recognition of various communication modalities including speech, lip movement, facial expression, handwriting and drawing, body gesture, text and visual symbols. It provides mechanisms to fuse these modalities into a context dependent interpretation of the current situation and generate appropriate the multimodal information responses. The proposed toolbox can be used as part of a disaster and rescue simulation. We propose evaluation methods, and focus on the technological aspects of our framework. |
Address |
Man-Machine Interaction Group, Delft University of Technology, Netherlands; Human Media Interaction Group, University of Twente, Netherlands; Nijmegen Institute for Cognition and Information, Radboud University Nijmegen, Netherlands |
Corporate Author |
|
Thesis |
|
Publisher |
Information Systems for Crisis Response and Management, ISCRAM |
Place of Publication |
Delft |
Editor |
B. Van de Walle, P. Burghardt, K. Nieuwenhuis |
Language |
English |
Summary Language |
English |
Original Title |
|
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
Series Volume |
|
Series Issue |
|
Edition |
|
ISSN |
2411-3387 |
ISBN |
9789054874171; 9789090218717 |
Medium |
|
Track |
HCIS |
Expedition |
|
Conference |
4th International ISCRAM Conference on Information Systems for Crisis Response and Management |
Notes |
|
Approved |
no |
Call Number |
|
Serial |
497 |
Share this record to Facebook |
|
|
|
Author |
Dragos Datcu; Leon J.M. Rothkrantz |
Title |
The use of active appearance model for facial expression recognition in crisis environments |
Type |
Conference Article |
Year |
2007 |
Publication |
Intelligent Human Computer Systems for Crisis Response and Management, ISCRAM 2007 Academic Proceedings Papers |
Abbreviated Journal |
ISCRAM 2007 |
Volume |
|
Issue |
|
Pages |
515-524 |
Keywords |
Face recognition; Gesture recognition; Active appearance models; Automatic evaluation; Automatic facial expression recognition; Computer vision techniques; Context-aware systems; Crisis management systems; Facial expression recognition; Human computer interfaces; Human computer interaction |
Abstract |
In the past a crisis event was notified by local witnesses that use to make phone calls to the special services. They reported by speech according to their observation on the crisis site. The recent improvements in the area of human computer interfaces make possible the development of context-aware systems for crisis management that support people in escaping a crisis even before external help is available at site. Apart from collecting the people's reports on the crisis, these systems are assumed to automatically extract useful clues during typical human computer interaction sessions. The novelty of the current research resides in the attempt to involve computer vision techniques for performing an automatic evaluation of facial expressions during human-computer interaction sessions with a crisis management system. The current paper details an approach for an automatic facial expression recognition module that may be included in crisis-oriented applications. The algorithm uses Active Appearance Model for facial shape extraction and SVM classifier for Action Units detection and facial expression recognition. |
Address |
Man-Machine Interaction Group, Delft University of Technology, 2628 CD, Delft, Netherlands |
Corporate Author |
|
Thesis |
|
Publisher |
Information Systems for Crisis Response and Management, ISCRAM |
Place of Publication |
Delft |
Editor |
B. Van de Walle, P. Burghardt, K. Nieuwenhuis |
Language |
English |
Summary Language |
English |
Original Title |
|
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
Series Volume |
|
Series Issue |
|
Edition |
|
ISSN |
2411-3387 |
ISBN |
9789054874171; 9789090218717 |
Medium |
|
Track |
EMOT |
Expedition |
|
Conference |
4th International ISCRAM Conference on Information Systems for Crisis Response and Management |
Notes |
|
Approved |
no |
Call Number |
|
Serial |
425 |
Share this record to Facebook |