Abstract: Achieving interoperable communication across governmental agencies and jurisdictions remains a challenge and is simply taking time to implement. Initiatives to support agency interoperability continue. However, community responders remain in need of two-way device quick response tactics. SMS text-messaging is one viable interoperable communication technology that provides a bottom-up approach while offering benefits for everyday use. This research in progress studies the use of a web-based SMS text-message training application, designed to simulate two-way SMS text-message exchange. Speech Act Theory and the Theory of Planned Behavior are leveraged to carefully measure SMS text-message exchange. The overarching crisis scenario takes the role of the local community responder. Initial qualitative pilot results are presented and discussed, including next steps for this ongoing research.

Abstract: This study explored automated training for emergency managers and the effects of feedback on performance. A prototype emergency management training application was built to allow the usage of either immediate feedback or delayed, “hotwash” feedback. Users were split into two groups and asked to carry out two emergency management scenarios using one of the feedback mechanisms, and the difference in scores between each feedback type were analyzed There was a general increase in performance across sessions. Further, the improvements in scores between each feedback type showed that users performed significantly better when using the hotwash feedback mechanism compared with the immediate feedback mechanism. In contrast to the performance data, preference data showed no overall differences between the two procedures, although each user had a strong preference for one or the other feedback mechanism. The implications for the design of training systems offering both procedures are discussed.

Abstract: This review addresses current educational and research efforts in disaster medical education (DME) in the United States. Since the events of 9/11, DME has received greater attention. However substantial problems remain in terms of ensuring that large numbers of medical students and residents are exposed to high quality DME – not only Emergency Medicine residents. Barriers to widespread adoption of DME include lack of performance metrics, disagreement task areas, and lack of emphasis on physician leadership. Further, such efforts must ensure retention of key information over periods that are disaster free; utilize objective training metrics that will allow for an evidence base to form; and develop low cost, scalable training approaches that offer greater fidelity to the disaster environment than classroom based instruction. To improve the state of the art, we argue that DME research must move toward a translational science model that integrates important advances in basic information science into application that improve the clinical performance of frontline medical staff who are called on to respond to individual and community needs in the aftermath of disaster. Mid-fidelity, team-in-the-loop simulations developed for disaster manager training may provide an avenue toward improved DME by exposing medical students to scenarios that fundamentally challenge their assumptions in real-time game play. This can be accomplished with lower costs and greater scalability than live exercise or mock-up training approaches. © 2012 ISCRAM.

Abstract: Planning processes, including simulations and games, can help emergency workers to prepare for the unexpected. Rehearsal using software based gaming techniques not only helps planning, but is also cost effective. Computer-based groupware systems can make experts available regardless of location. A new approach, Virtual Simulation (VS), uses networking to create a flexible learning and planning environment. To date two prototype trials of this approach have been implemented at NJIT with major revamps between each one. This paper gives the results of the latest prototype trial, a simulation of attacks on university computer centers. The insights from this second prototype trial of virtual simulation will help us to improve the design and approach for future offerings.

Abstract: What are effective ways to train students for designing Emergency Management Information Systems and for working with distant partners on EMIS projects? This paper describes the results of a project whose goal is to assess the effectiveness of Partially Distributed Teams (PDTs) as a pedagogical strategy. A PDT is one type of distributed team, in which two or more co-located subgroups use information and communication technology to collaborate on a task. Much of emergency management involves cross-organizational and often cross-national collaboration in this form. Students need, but lack, learning experiences focused on how to work effectively in such situations. This field study involved more than 700 students from universities in eight countries, working in 80 teams on an EMIS software requirements task. Results indicate that students report positive learning experiences, with international students in international teams reporting the most positive experiences. There are also significant differences among universities.

Abstract: Artesis Virtual and VSTEP BV developed a virtual scenario training for leading firefighters. We evaluated the usability of the training application and measured the satisfaction of 53 trainees. The trainees were positive about the training application, the training itself, and the interaction with the interface. We observed that trainees experienced navigation difficulties and sometimes misjudged visual information. Evaluations of new versions of this application, should address the influence of interface problems on performance.

Abstract: Simulation and serious games (SSG) are advocated as promising technologies supporting training in emergency management (EM). Based on an investigation of SSG use for fire fighter training in nine countries, this paper is examining key elements and success factors that can counteract potential obstacles and challenges of SSG implementation. Data comes from interviews and observations with users and responsible managers from user organizations. By contrasting the different incentives and views regarding the SSG use, this paper contributes to a better understanding of SSG integration into organizational practices. Only by connecting the local, organizational strategies and user requirements with technical values and concrete examples can the SSG usage be experienced as successful. This connection requirement is by far not obvious since values are formulated differently by the main stakeholders and the benefits at one organization are not necessarily the same as at another. In this context, the added values of SSG solutions need to be more explicitly connected to the goals of traditional classroom and live training.

Abstract: Responders and decision makers can be trained through simulation tools where participants learn how to deal with an ongoing crisis and make decisions through a realistic, simulated environment using a game or gamification approach. Training through a simulated, virtual crisis tool would be a more affordable way of conducting a drill, as a supplement to field drills. In this paper, we describe the requirements' elicitation process for co-design of a virtual training tool for emergency management. The cooperative design process included researchers and end-users together to generate potential solutions for a defined problem. The elicitation process involved brain-storming, interviews and a workshop together with representatives from emergency stakeholders. A systematic qualitative data analysis was conducted. The paper reports our analysis results which serve as a basis for further development of an emergency management virtual training tool using an extreme weather scenario.

Abstract: Several researchers and contingency agencies have suggested good practices for crisis management exercises. Resource-constrained practitioners in the field report difficulties finding cost-efficient ways to maintain exercise cycles. This paper draws on experiences from working with professional crisis response coordinators who adapted material for table-top exercises to learning management systems, executed the exercises and evaluated team performance. This paper discusses the elimination of bottlenecks and unexpected benefits arising from more flexible exercise designs in terms of synchrony, continuity, and location. While these concepts capture the essence of the various opportunities for flexibility, they need some supporting features in the design of digital exercises. This paper argues for putting emphasis on the writing/speech dichotomy when analysing exercise designs from the perspective of the entire exercise life cycle, including evaluations and preparations for further exercises. Additionally, how requests for individual answers are planned appears to be an effective instrument for efficient exercise design and evaluation during the conducting of an exercise.

Abstract: We describe a socio-technical system designed to train different organisations in emergency management during the preparedness phase. In this system, both humans and the system work together in building organisational context awareness. The system uses a normative multi-agent system and a tangible table for user interaction. Real time virtual feedbacks are used to draw users? attention to the validity of their actions with respect to the emergency plan. Feedback allows the actors to be aware of the other factors that impact the validity of their action (actions of other actors, environment etc.) and to identify the behaviour that is expected of them by the other organisations. The system is still in its prototype phase. Its behaviour is illustrated by example scenarios, showing that it is possible to support collaboration amongst distant actors, in a way that only relevant information is shown.

Abstract: Understanding the COVID-19 pandemic impacts on low-income households can inform social services about the needs of vulnerable communities. Some recent works have studied such impacts through social media content analysis, and supervised machine learning models have been proposed to automatically classify COVID-19 tweets into different categories, such as income and economy impacts, social inequality and justice issues, etc. In this paper, we propose semi-supervised learning models based on BERT with Self-Training and Knowledge Distillation for identifying COVID-19 tweets relevant to low-income households by leveraging readily available unlabeled data in addition to limited amounts of labeled data. Furthermore, we explore ChatGPT’s potential for annotating COVID-19 data and the performance of fine-tuned GPT-3 models. Our semi-supervised BERT model with Knowledge Distillation showed improvements compared to a supervised baseline model, while zero-shot ChatGPT showed good potential as a tool for annotating crisis data. However, our study suggests that the cost of fine-tuning large and expensive GPT-3 models may not be worth for some tasks.

Abstract: Serious games are an effective tool for giving players a hands-on, immersive experience of crisis situations. To simplify the design of such games while ensuring their relevance, we propose a design method that is based on reference tasks. The feasibility of this approach is demonstrated by the improved design of the serious game “Disaster in my Backyard” that has been played during ISCRAM Summer school 2013. The design incorporates humanitarian logistics, search-and-rescue and coordination tasks. We also present the lessons learned from this instantiation of the game and give an outlook towards future research, such as the evaluation of tools for crisis response and management through the use of serious games and reference tasks.

Abstract: Current crisis management training, at the strategic level, is predominantly focused on two approaches, table-top exercises and large-scale physical simulations. Unfortunately, neither of these approaches provides the necessary realism to accurately prepare trainees for the stress, volume and speed of decision-making required in an actual crisis situation. The development of virtual environments, rich multimedia, and games technologies has resulted in considerable work in developing new training support tools. Some of this work has introduced more realistic stress into the training environment, but to date there has been no systematic approach to the creation and management of stress in crisis management training. The Pandora project has built from existing models taken from crisis management Gold Commander training, timeline-based event network modelling, augmented and virtual reality serious games environments, affective computing research, and emotional ambience models from film and TV, to develop a rich multimedia training environment offering just such an approach. © 2012 ISCRAM.