Bas Lijnse. (2022). Modeling Real World Crisis Management Plans with C2Sketch. In Rob Grace, & Hossein Baharmand (Eds.), ISCRAM 2022 Conference Proceedings – 19th International Conference on Information Systems for Crisis Response and Management (pp. 404–413). Tarbes, France.
Abstract: When crisis management plans are described in natural language documents, they may contain logical inconsistencies or ambiguities that are not immediately apparent. To allow automated early detection of such errors, they need to be described in a well defined formalism. C2Sketch is a tool for modeling command and control systems that provides such a structure for formalizing (crisis management) plans. However, C2Sketch is in active development and to what extent real-world crisis management plans can be expressed in it is unknown. In this exploratory study the unstructured text of a small sample of publicly available regional-level crisis management plans was translated systematically into structured C2Sketch mission-plans to uncover limitations and opportunities for further development of the tool. The plans contained enough information to largely capture the networks of actors and their tasks therein, but did contain enough operational information to develop complete C2Sketch models from.
|
Pauline Tobergte, Alena Knispel, Lennart Landsberg, & Ompe Aimé Mudimu. (2022). Evaluation of Tabletop Exercises in Emergency Response Research and Application in the Research Project SORTIE. In Rob Grace, & Hossein Baharmand (Eds.), ISCRAM 2022 Conference Proceedings – 19th International Conference on Information Systems for Crisis Response and Management (pp. 415–427). Tarbes, France.
Abstract: This paper presents the fields of application of the tabletop exercise in emergency response by explaining the method in emergency response research. The authors illustrate the tabletop exercise of the Institute for Rescue Engineering and Civil Protection (IRG) of the TH Köln in a research project on Sensor Systems for Localization of Trapped Victims in Collapsed Infrastructure (acronym: SORTIE) as an application example. Subsequently, the quantitative and qualitative evaluation methods used generally and specifically for the tabletop exercise of the research project SORTIE are considered, and the technical implementation is explained. The evaluation method used in the tabletop exercise consists of three sub-areas (participant survey; exercise observation; photo, video and audio recordings). Further, the analysis of the evaluation using statistical tools is explained. Finally, this paper refers to possible sources of error in the evaluation of tabletop exercises, such as exercise artificiality and subjectivity of the exercise observers.
|
Stella Polikarpus, Tobias Ley, Hans Hazebroek, Graham Edgar, Geoffrey Sallis, Steven Baker, et al. (2022). Authoring Virtual Simulations to Measure Situation Awareness and Understanding. In Rob Grace, & Hossein Baharmand (Eds.), ISCRAM 2022 Conference Proceedings – 19th International Conference on Information Systems for Crisis Response and Management (pp. 428–433). Tarbes, France.
Abstract: Measuring situation awareness (SA) and situation understanding (SU) is an important topic for Command & Control research. Virtual simulations (VS) have been proposed as a suitable method for measuring SA/U, but, there is little research into how to build scenarios for VS so that SA/U can be measured reliably. In this study, we used two different VS scenarios and the Quantitative Analysis of Situation Awareness (QASA) method to measure, and provide feedback on, actual and perceived SA/U. Two VS scenarios were tested in Estonia with 36 trainees. The results of the different scenarios were compared to establish whether the scenario storylines and authoring process resulted in differences in SA or SU. We conclude that reliable assessment results were produced with both authoring processes, and further suggest that the Collaborative Authoring Process Model for Virtual Simulations (CAPM) be used for VS creation.
|
Rustenberg, K., Radianti, J., & Gjøsæter, T. (2023). Exploring Demons for the Establishment of Team Situational Awareness. In Jaziar Radianti, Ioannis Dokas, Nicolas Lalone, & Deepak Khazanchi (Eds.), Proceedings of the 20th International ISCRAM Conference (pp. 636–648). Omaha, USA: University of Nebraska at Omaha.
Abstract: Individual situational awareness (SA) is crucial for building team SA, which is necessary for achieving a shared understanding of a situation, making informed decisions, and taking appropriate actions. This article examines the communication barriers that emerge when transitioning from individual to team SA in emergency management scenarios. We observed two emergency exercises on “ongoing life-threatening violence” and dam failure causing hospital congestion. The study was complemented with interviews with participants of these exercises, aiming at identifying barriers called SA-demons in the team setting. We discovered barriers that hinder the establishment of team SA, including a vicious cycle of mistrust, a fragmented information trap, a false feeling of mastery trap, and a decaying memory trap. These barriers can stem from individual, organizational, or technological factors. To complement existing SA theories, we applied the Cynefin framework and found that standard operating procedures can be potential barriers when transitioning into chaotic or complex domains.
|
Grace, R., Montarnal, A., Petitdemange, E., Rutter, J., Rodriguez, G. R., & Potts, M. (2023). Collaborative Information Seeking during a 911 Call Surge: A Case Study. In Jaziar Radianti, Ioannis Dokas, Nicolas Lalone, & Deepak Khazanchi (Eds.), Proceedings of the 20th International ISCRAM Conference (pp. 649–662). Omaha, USA: University of Nebraska at Omaha.
Abstract: This case study examines collaborative information seeking in a public-safety answering point during a 911 call surge that occurred when a man fired an assault rifle at police officers and evaded capture for nearly an hour in March 2020. Overwhelmed by questionable and imprecise reports from 911 callers, telecommunicators and on scene responders began working together to conduct broad and deep searches for the shooter. Whereas broad searches improved the scope of information gathering by identifying multiple, albeit questionable and imprecise, reports of the suspect’s location, deep searches improved the quality of information gathering by investigating 911 callers’ reports using drone, helicopter, and patrol units. These findings suggest requirements for collaborative information seeking in public-safety answering points, including capabilities to conduct broad and deep searches using next-generation 911 technologies, and command and control requirements for triaging these search tasks within inter-organizational emergency response systems.
|
Radianti, J., Pilemalm, S., Steen-Tveit, K., & Rustenberg, K. (2023). Enhancing Learning from Incidents by Reconstruction of Events: Using the SQUARE Tool for Evaluation. In Jaziar Radianti, Ioannis Dokas, Nicolas Lalone, & Deepak Khazanchi (Eds.), Proceedings of the 20th International ISCRAM Conference (pp. 663–675). Omaha, USA: University of Nebraska at Omaha.
Abstract: Evaluation after exercise and incidents—often called After Action Review or AAR—are important to enhance the emergency management (EM) response capability. However, evaluation supporttools for event reconstruction after incidents and exercises are not yet fully available. We engaged EM stakeholders in a tabletop exercise based on snow chaos and car accidents scenarios to evaluate a fully functional prototype. The tool assists information sharing in real-time and enhances debriefing process of any EM response and exercise. Analysis of reflective discussions and an open question survey shows that the EM participants consider the features of the prototype to facilitate better learning from incidents. However, they have different attitudes concerning the adoption, management, and application of the tool in organizations. For instance, more security features are required to comply with regulations. We argue that the tool is an important first step to fill the gap on the need for “event reconstruction-based evaluation.”
|
Stensrud, R., & Valaker, S. (2023). Methods to meet changes in the security environment a proposal of qualitative and quantitative assessment attributes for coordination performance. In Jaziar Radianti, Ioannis Dokas, Nicolas Lalone, & Deepak Khazanchi (Eds.), Proceedings of the 20th International ISCRAM Conference (pp. 676–691). Omaha, USA: University of Nebraska at Omaha.
Abstract: The use of methods to inform changes of command and control has long been important, in particular through empirical surveys and computational simulation. In this article, we focus on a particular type of control: “bump less” time-shift of authority during emergency response where it is not desirable to interrupt task resolution (Dess et al.,1984). As an example we address a particular type of control in a sociotechnical use case, i.e. ensuring coordinated action among human and non-human entities, and specifically use as a case shift of who ensures coordinated action when what entities are participating fluctuate over time, yet there is a need to sustain coordination (e.g. due to criticality of sustained performance). We do some work to detail a sociotechnical control mechanism and we present methods for examining the influence such control may have on performing both planned, prescribed, organizational task work as well as dynamic, non-prescribed tasks (Stanton et al., 2018). We argue that measures of high fidelity, with high specificity, defined before task resolution (feedforward) may be particularly important in prescribed change due to the possibility to define clear goals for coordinating and detailing who holds coordination authority. For dynamic change, on the other hand supporting technology that enable a sensing and processing of feedback the number of agents/entities undergoing change is not predetermined and the change of who is best suited to coordinate authority is less clear. Our theorizing is illustrated by using traditional linear control theory emulating shift of control nuanced by an emergency use case. In conclusion, we suggest future directions for research as well as practical implications.
|
Landsberg, L., Gleibs, T., & Mudimu, O. A. (2023). Design of a Systems Theory Approach for the Evaluation of C2-Systems. In Jaziar Radianti, Ioannis Dokas, Nicolas Lalone, & Deepak Khazanchi (Eds.), Proceedings of the 20th International ISCRAM Conference (pp. 692–700). Omaha, USA: University of Nebraska at Omaha.
Abstract: The course of large-scale incidents as well as disasters can reveal weaknesses in command and control (C2) systems, which make adjustments necessary. Also, new technologies may require C2-systems to be adapted to achieve their full potential for improving incident command. This paper deals with an approach to enable the comparison and evaluation of different C2-systems or their adaptations in order to find the best possible customizations for C2-systems. To this purpose, systems theory is used to unify the approaches of different research disciplines. Within the C2-system boundaries, distinctions were made to represent three different levels of evaluation: “Physical Characteristics”, “Structures and Processes” as well as “C2-system-effectiveness”. During the implementation of the evaluation methods from the different research disciplines into the systems theory approach, it became apparent that the comprehensive approach is desirable, but that broad knowledge and expertise is necessary, especially at the highest evaluation level “C2-system-effectiveness”.
|
Berggren, P., Ryrberg, T., Lindhagen, A., & Johansson, B. (2023). Building capacity – conceptualizing Training of Trainers. In Jaziar Radianti, Ioannis Dokas, Nicolas Lalone, & Deepak Khazanchi (Eds.), Proceedings of the 20th International ISCRAM Conference (pp. 701–710). Omaha, USA: University of Nebraska at Omaha.
Abstract: Many organizations train and educate their staff to prepare for crisis. One approach is train-the-trainer (ToT; Training of trainers) concept. It is based on the idea that someone can be trained as a trainer, who in turn train their colleagues. The philosophy resembles a pyramid scheme that allows for a fast and efficient spread of knowledge and skills. This study focused on perceptions of the ToT concept through interviews with ToT trainers. Two learning theories, organizational learning (4I) and experiential learning theory (ELT) were used to conceptualize the ToT-concept. It was found that the ToT-concept can be used as the method to conduct ELT to achieve organizational learning and knowledge (4I). Furthermore, the study also presents how participants perceives ToT using thematic analysis. This resulted in four themes: Common understanding of ToT, Learn-by doing, No grounding in ToT, and Difficult to ensure quality.
|
Björnqvist, A., Brodin, W., Friberg, M., & Berggren, P. (2023). Identifying Teamwork Processes in a Medical Command and Control Team During the COVID-19 Pandemic. In Jaziar Radianti, Ioannis Dokas, Nicolas Lalone, & Deepak Khazanchi (Eds.), Proceedings of the 20th International ISCRAM Conference (pp. 711–720). Omaha, USA: University of Nebraska at Omaha.
Abstract: This paper presents an ethnographic study consisting of non-participatory observations of a Swedish regional medical command and control team during their crisis response to the COVID-19 pandemic. The field-notes from the observations were analyzed using a deductive content analysis with categories representing teamwork processes. The content analysis showed that the studied regional medical command and control team was engaged in all but one of the predefined teamwork processes. Furthermore, the content analysis also added to the understanding of the regional medical command and control team’s work procedures by emphasizing how the team was engaged in the different processes. Lastly, the content analysis also made it possible to identify potential developmental needs of the studied regional medical command and control team.
|
Borglund, E., A.M., & Granholm, M. (2023). Challenges in work procedures in distributed crisis management. In Jaziar Radianti, Ioannis Dokas, Nicolas Lalone, & Deepak Khazanchi (Eds.), Proceedings of the 20th International ISCRAM Conference (pp. 732–737). Omaha, USA: University of Nebraska at Omaha.
Abstract: This is a work in progress paper on work and IT usage in distributed crisis management. The data presented in this paper has been collected at a one-day tabletop exercise with four Swedish municipalities. Four members of the four municipalities’ crisis organizations were invited to the exercise, which was designed as one scenario divided into two cases. At the start of each case of the exercise, each municipality was split into two separate rooms, to simulate a distributed crisis management. During the first case they could communicate using phone, TETRA radio, and the Internet. During case two in the scenario, there was no Internet connection. The study indicates that all the municipalities managed to organize and solve the given tasks using primarily voice communication, in case one using phone or, e.g., Teams, and in case two using TETRA radio. Information sharing using IT was non-existing.
|
Sebastian Schmitz, Konrad Barth, Tim Brüstle, Tobias Gleibs, & Ompe Aimé Mudimu. (2019). Testing the implementation of a flying localization system into emergency response using a tabletop exercise. In Z. Franco, J. J. González, & J. H. Canós (Eds.), Proceedings of the 16th International Conference on Information Systems for Crisis Response And Management. Valencia, Spain: Iscram.
Abstract: To optimize the search for trapped victims after building collapses, the authors participated in the development ofI a localization system based on an unmanned aerial vehicle. The objective of this study is to evaluate an approach to implement this system into the command and control structures during the emergency response after a building collapse. For this purpose, a tabletop exercise, based on a gas explosion scenario in an apartment building, was carried out with emergency response managers of the fire department and the German federal agency of technical relief. Observers have documented the exercise. Additionally, audio and video recordings were used. Thus, statements could be made about the implementation approach and the tabletop exercise method. Based on the results, the implementation approach can be considered appropriate. In addition, knowledge was gained about the appropriateness of tabletop exercises for the purpose of scientific evaluation.
|
Kristine Steen-Tveit, & Jaziar Radianti. (2019). Analysis of Common Operational Picture and Situational Awareness during Multiple Emergency Response Scenarios. In Z. Franco, J. J. González, & J. H. Canós (Eds.), Proceedings of the 16th International Conference on Information Systems for Crisis Response And Management. Valencia, Spain: Iscram.
Abstract: Disaster response operations require communication and coordination between agencies that seldom occurs in everyday workday situations. Furthermore, in such hybrid environments it is necessary to establish a common operational picture for the responders involved to support collaborative decision-making. The emergency responders must gain situational awareness, and this can further affect the quality of how they deal with the situation. Training in emergency situations is shown to be efficient for learning. In order to understand the complexity of working in unpredictable environments, an analysis of an audio-log from a large-scale drill was carried out. Moreover, this paper provides a definition of several categories for identifying the processes to establish situational awareness and a common operational picture among emergency responders. The analysis process revealed how the actors communicate and revealed an overall communication pattern.
|
Kristoffer Karl Darin-Mattsson, & Niklas Hallberg. (2019). Do's and Don'ts in Inter-Organizational Crisis Management Exercises. In Z. Franco, J. J. González, & J. H. Canós (Eds.), Proceedings of the 16th International Conference on Information Systems for Crisis Response And Management. Valencia, Spain: Iscram.
Abstract: It is commonly assumed that conducting exercises will contribute to better crisis management. However, the exact mechanisms of cause and effect are hard to isolate empirically. The objective of this paper is to compile and analyze the recommendations in the literature on inter-organizational exercises and learning. While not claiming to meet the strict scientific demand of empirical validation and general applicability, the compilation may nevertheless provide some guidance from research to practitioners. Forty-four papers about learning in interorganizational exercises were analyzed. Out of the analyzed papers, 28 discussed obstacles or success factors.
However, the recommendations applicable in one setting are not automatically valid in others, and some are even contradictory. The recommendations have therefore been categorized according to two criteria; when in the exercise cycle and for whom they apply. Several recommendations concern individual learning, but maximizing individual learning can sometimes hamper learning on the organizational level.
|
Pär Hans Tuve Eriksson, & Niklas Hallberg. (2019). Design to Fit – Morphological Analysis as a Tool for Exercise Design. In Z. Franco, J. J. González, & J. H. Canós (Eds.), Proceedings of the 16th International Conference on Information Systems for Crisis Response And Management. Valencia, Spain: Iscram.
Abstract: Exercises are considered as vital to develop and sustain crisis management capabilities. An exercise may have a role both as a provider of knowledge about the crisis management system, and its performance, and as a driver of change through training of individuals, groups and organizations. However, the relationship between the design and characteristics of a specific exercise, and the usability of its results in the development of the crisis management system is not well-understood. The objective of this paper is to explore if a morphological field can be used to investigate this relationship. Such a field was designed and evaluated. Even though this field was relatively simple, it was concluded that it provides results that deepen the understanding of how different types of exercises can contribute to the development of the crisis management system.
|
Mari Olsén, Niklas Hallberg, & Kristoffer Darin Mattsson. (2019). Who Learns from Crisis Management Exercises: An Explorative Study. In Z. Franco, J. J. González, & J. H. Canós (Eds.), Proceedings of the 16th International Conference on Information Systems for Crisis Response And Management. Valencia, Spain: Iscram.
Abstract: Exercises are stated to be an important means to learn how to handle crises. However, it has been discussed who should participate and what can be learnt from them. Several roles are involved in the planning, execution and evaluation of exercises, such as participants, observers, facilitators and evaluators. This paper presents an empirical study of the differences in learning experiences between participants and observers. The study was based on interviews with participants and observers involved in a series of exercises at municipality level. The result shows that the participants? learning relates to individual experiences and how well they felt they performed the task. Meanwhile, the observers? learning experiences concerned organisational issues. The findings suggest that to achieve variation in learning experiences, which is important for inventing new solutions, crisis management organisations need to allow their personnel to try different roles in the exercises to increase the learning outcome.
|
Amanda Jaber, Björn Johan Erik Johansson, Linnea Bergsten, Joeri Laere van, & Peter Berggren. (2019). Evaluating the observation protocol of the Team Resilience Assessment Method for Simulation (TRAMS). In Z. Franco, J. J. González, & J. H. Canós (Eds.), Proceedings of the 16th International Conference on Information Systems for Crisis Response And Management. Valencia, Spain: Iscram.
Abstract: This work in progress paper presents an initial evaluation of the observation protocol of the Team Resilience Assessment Method for Simulation (TRAMS) conducted in a crisis response simulation project. TRAMS is designed to assess the resilience of crisis response teams. The TRAMS observation protocol uses six core resilience functions from the Systemic Resilience Model as its theoretical foundation. Three independent observers used the protocol during a pilot study and six actual simulation games. Strategies relating to three out of six core resilience functions could be identified. The observations made were distributed similarly among the observers, indicating that the components of the TRAMS protocol are stable enough to continue developing the protocol. This study describes changes made to the protocol since the original design, and describes how the strategies relating to the six core resilience functions can be identified in the simulation games.
|
Abbas Ganji, Tom Wilson, Sonia Saveli, Dharma Dailey, & Mark Haselkorn. (2019). Cause and Effect: A Qualitative Analysis of Obstacles to Information Sharing During a Regional Disaster Exercise. In Z. Franco, J. J. González, & J. H. Canós (Eds.), Proceedings of the 16th International Conference on Information Systems for Crisis Response And Management. Valencia, Spain: Iscram.
Abstract: After large-scale disasters, diverse partner agencies rely heavily on an information-sharing environment that supports collaborative work. In the U.S., this occurs under the Incident Command System (ICS), a structured organizational framework for coordinated action. We explore obstacles to information sharing and coordinationobserved at a county-level Emergency Operations Center (EOC) operating under ICS during the response phase of a large-scale regional disaster exercise. Textual observations collected in situ are analyzed for both the effect/manifestation and cause/source of barriers to information sharing. Two-thirds of barriers that manifest as computational issues are not caused by technology breakdowns, and a third caused by unclear processes manifest as computational issues. Overall, obstacles to collaborative work that appear to be related to computational issues are generally attributable to non-technical causes. This indicates that resources directed at improving collaborative management of disasters by enhancing technological capabilities are likely to be misdirected.
|
Johan Nordström, & Björn Johan Erik Johansson. (2019). Supporting Inter-Organizational Learning – A Review of Post-Excercise Knowledge Sharing. In Z. Franco, J. J. González, & J. H. Canós (Eds.), Proceedings of the 16th International Conference on Information Systems for Crisis Response And Management. Valencia, Spain: Iscram.
Abstract: Inter-organisational learning from exercises and response operations is crucial for improving overall response capacity for coping with cross-domain crisis events. In order to compile and disseminate experiences and acquired knowledge in the form of lessons learned, post-exercise reports are written. This paper presents a review of 17 Swedish post-exercise reports. The review was conducted with the aim to investigate whether such reports contained enough information to support inter-organisational learning, i.e. if learning goals were stated, how the event was described, method for evaluation, conclusions, and whether recommendations for change were sufficient for supporting inter-organisational learning. It was found that most reports did not support organisational development and lacked recommendations that were useful outside the own organisation or the
context of the specific exercise scrutinised. The results indicate the need for an exercise evaluation framework for inter-organisational exercises.
|
Daniel Auferbauer, Roman Ganhör, & Hilda Tellioglu. (2019). Opportunistic Affiliation in Spontaneous Volunteer Management. In Z. Franco, J. J. González, & J. H. Canós (Eds.), Proceedings of the 16th International Conference on Information Systems for Crisis Response And Management. Valencia, Spain: Iscram.
Abstract: Spontaneous volunteers influence crisis and disaster relief efforts as both an effective aid and a stressing factor for emergency organisations. Managing the negative impacts of spontaneous volunteering has thus become part of command and control deliberations. In this paper, we take a closer look at integrating spontaneous volunteers into the formal response system to mitigate negative impacts.
Working with participants from formal response organisations, we gathered qualitative data regarding the management of spontaneous volunteers during the European migration crisis in 2015.
Through thematic analysis, we extracted topics to systematically describe the interaction between emergency organisations and spontaneous volunteers. As implication thereof, we propose how computer supported systems can be applied to better manage spontaneous volunteers. In our discussion, we focus on the registration process and ad hoc verification of spontaneous volunteers to better integrate them in the formal response process.
|
