Rahul Pandey, Brenda Bannan, & Hemant Purohit. (2020). CitizenHelper-training: AI-infused System for Multimodal Analytics to assist Training Exercise Debriefs at Emergency Services. In Amanda Hughes, Fiona McNeill, & Christopher W. Zobel (Eds.), ISCRAM 2020 Conference Proceedings – 17th International Conference on Information Systems for Crisis Response and Management (pp. 42–53). Blacksburg, VA (USA): Virginia Tech.
Abstract: The adoption of Artificial Intelligence (AI) technologies across various real-world applications for human performance augmentation demonstrates an unprecedented opportunity for emergency management. However, the current exploration of AI technologies such as computer vision and natural language processing is highly focused on emergency response and less investigated for the preparedness and mitigation phases. The training exercises for emergency services are critical to preparing responders to perform effectively in the real-world, providing a venue to leverage AI technologies. In this paper, we demonstrate an application of AI to address the challenges in augmenting the performance of instructors or trainers in such training exercises in real-time, with the explicit aim of reducing cognitive overload in extracting relevant knowledge from the voluminous multimodal data including video recordings and IoT sensor streams. We present an AI-infused system design for multimodal stream analytics and lessons from its use during a regional training exercise for active violence events.
|