Christine Adler, Lisa Jakob, Mirjam Haus, Lena Erfurt, & Marion Krüsmann. (2012). GABEK WinRelan® – A qualitative method for crisis research engaging crisis management personnel. In Z.Franco J. R. L. Rothkrantz (Ed.), ISCRAM 2012 Conference Proceedings – 9th International Conference on Information Systems for Crisis Response and Management. Vancouver, BC: Simon Fraser University.
Abstract: Qualitative research methods like GABEK WinRelan are advantageous tools to analyze and thereby improve crisis management planning and communication systems by interrogating crisis management personnel. Contrary to quantitative methods they help to identify, explore, and structure new important aspects in this field and to formulate more specific research questions. This paper describes the usage and advantages of the qualitative method GABEK WinRelan within crisis management research, particularly within the e-Triage project which aims at the development of an electronic registration system of affected persons in mass casualty incidents. Furthermore it addresses different corresponding research fields like stress within emergency missions and the role GABEK WinRelan could play in examining these research fields. © 2012 ISCRAM.
|
Ahmed Abdeltawab Abdelgawad, & Tina Comes. (2019). Evaluation Framework for the iTRACK Integrated System. In Z. Franco, J. J. González, & J. H. Canós (Eds.), Proceedings of the 16th International Conference on Information Systems for Crisis Response And Management. Valencia, Spain: Iscram.
Abstract: Evaluation and testing are major steps in the development of any information system, particularly if it is to be used in high-risk contexts such as conflicts. While thus far there are various approaches for testing against technology requirements; usability or usefulness, there is a lack of a comprehensive evaluation framework that combines the three elements. The lack of such a framework and commonly agreed standards constitutes a barrier for innovation, and at the same time imposes risks to responders if the technology is introduced without proper testing. This paper aims to close this gap. Based on a reviewing of evaluation methods and measurement metrics, we design a comprehensive evaluation framework including common code quality testing metrics, usability testing methods, subjective usefulness questionnaires, and performance indicators. We demonstrate our approach by using the example of an integrated system for the safety and security of humanitarian missions, and we highlight how our approach allows measuring the system?s quality and usefulness.
|
Hina Aman, Pourang Irani, & Hai-Ning Liang. (2012). A review of information communication technology applied on common tasks during times of emergency. In Z.Franco J. R. L. Rothkrantz (Ed.), ISCRAM 2012 Conference Proceedings – 9th International Conference on Information Systems for Crisis Response and Management. Vancouver, BC: Simon Fraser University.
Abstract: Research in emergency response systems has produced significant literature in a very short span of time. We review a corpus of published works on how Information Communication Technology (ICT) is being utilized and the type of tasks ICT attempts to support in the event of a crisis due to disasters, whether natural or man-made. In our research, we have been able to distinguish eight types of tasks supported by technology during a disaster. We list some of these technologies used by the public, practitioners and researchers to illustrate the current trends of technology usage. We also identify gaps and technology needs that require our attention. Given the increasing frequency and severity of disasters, this research is timely as it (1) contributes to our understanding of the trends of development and technology use during times of crises and (2) identifies potential areas for future work to improve ICT's role during times of emergency. © 2012 ISCRAM.
|
Cecilia Hammar Wijkmark, & Ilona Heldal. (2020). Virtual and Live Simulation-Based Training for Incident Commanders. In Amanda Hughes, Fiona McNeill, & Christopher W. Zobel (Eds.), ISCRAM 2020 Conference Proceedings – 17th International Conference on Information Systems for Crisis Response and Management (pp. 1154–1162). Blacksburg, VA (USA): Virginia Tech.
Abstract: Computer and virtual simulation-based training (CST) offer several benefits for emergency response and management preparedness. However, organizations responsible for training are often hesitant to use CST, based on cost and perceived lack of benefit when compared to live simulation training (LST). This paper investigates how CST can complement LST, and how it contributes to achieving the necessary learning objectives for level one fire and rescue service incident commanders (ICs). Data and examples come from an experimental study with students from different fire and rescue services trained in the role of the IC in LST and CST, in a similar scenario. Results show the cost and benefits of the CST implementation based on evaluations from learners, instructors and responsible managers. Participants had a positive attitude towards using virtual simulations, but the results also point to barriers regarding the suitable design of learning scenarios and implementation.
|
Madhavi M. Chakrabarty, & David Mendonça. (2005). Design considerations for information systems to support critical infrastructure management. In B. C. B. Van de Walle (Ed.), Proceedings of ISCRAM 2005 – 2nd International Conference on Information Systems for Crisis Response and Management (pp. 13–18). Brussels: Royal Flemish Academy of Belgium.
Abstract: This paper develops a set of design considerations for information systems to support the management of interdependent critical infrastructure systems. Constraints on how these systems are managed are oriented along technical, political and organizational dimensions, though objectives along these dimensions may conflict and thus be difficult to satisfy. This paper harnesses methodologies from software engineering and cognitive science in order to specify opportunities for using information systems to support human-centered management of critical infrastructure systems. The particular focus of this work is on developing information systems to support visualization and visual problem solving. Progress to date is discussed in terms of an ongoing research project which uses as a test-bed data associated with lower Manhattan (New York, USA).
|
Aygul Gabdulkhakova, Birgitta König-Ries, & Dmitry Rizvanov. (2012). Rational resource allocation in mass casualty incidents – Adaptivity and efficiency. In Z.Franco J. R. L. Rothkrantz (Ed.), ISCRAM 2012 Conference Proceedings – 9th International Conference on Information Systems for Crisis Response and Management. Vancouver, BC: Simon Fraser University.
Abstract: Mass casualty incidents (MCI) are highly dynamic situations in which limited available resources need to be quickly and efficiently allocated. In this paper, we suggest considerable extensions to an allocation method that we presented in earlier work. The extensions address two major challenges: First, the need to balance real-world resource usage and second, the need to adapt to changing situations. Additionally, a theoretical evaluation of the efficiency of the suggested approach is described. © 2012 ISCRAM.
|
Corine H.G. Horsch, Nanja J. J. M. Smets, Mark A. Neerincx, & Raymond H. Cuijpers. (2013). Revealing unexpected effects of rescue robots' team-membership in a virtual environment. In J. Geldermann and T. Müller S. Fortier F. F. T. Comes (Ed.), ISCRAM 2013 Conference Proceedings – 10th International Conference on Information Systems for Crisis Response and Management (pp. 627–631). KIT; Baden-Baden: Karlsruher Institut fur Technologie.
Abstract: In urban search and rescue (USAR) situations resources are limited and workload is high. Robots that act as team players instead of tools could help in these situations. A Virtual Reality (VR) experiment was set up to test if team performance of a human-robot team increases when the robot act as such a team player. Three robot settings were tested ranging from the robot as a tool to the robot as a team player. Unexpectedly, team performance seemed to be the best for the tool condition. Two side-effects of increasing robot's teammembership could explain this result: Mental workload increased for the humans who had to work with the team-playing robot, whereas the tendency to share information was reduced between these humans. Future research should, thus, focus on team-memberships that improve communication and reduce cognitive workload.
|
Joske M. Houtkamp, & Frank A. Bos. (2007). Evaluation of a virtual scenario training for leading firefighters. In K. Nieuwenhuis P. B. B. Van de Walle (Ed.), Intelligent Human Computer Systems for Crisis Response and Management, ISCRAM 2007 Academic Proceedings Papers (pp. 565–570). Delft: Information Systems for Crisis Response and Management, ISCRAM.
Abstract: Artesis Virtual and VSTEP BV developed a virtual scenario training for leading firefighters. We evaluated the usability of the training application and measured the satisfaction of 53 trainees. The trainees were positive about the training application, the training itself, and the interaction with the interface. We observed that trainees experienced navigation difficulties and sometimes misjudged visual information. Evaluations of new versions of this application, should address the influence of interface problems on performance.
|
Jeff Maunder. (2018). The Geospatial Intelligence Continuum during Sudden Onset Disaster Response. In Kristin Stock, & Deborah Bunker (Eds.), Proceedings of ISCRAM Asia Pacific 2018: Innovating for Resilience – 1st International Conference on Information Systems for Crisis Response and Management Asia Pacific. (pp. 246–253). Albany, Auckland, New Zealand: Massey Univeristy.
Abstract: This document will discuss the current methodologies used by New Zealand DART and USAR teams to collect manage, analyse and report on information gathered during the initial and subsequent phases of deployments to a sudden onset disaster (SOD). This will include some of the experiences that have formed the current methodology and the outcomes of disaster events with new methodologies applied. It will further identify and discuss the current systems and processes in place and how they have come about, and then identify a range of opportunities and issues that exist within the Geospatial Intelligence environment to be more effective, both in systems and the development of partnerships to enhance the usability and intuitive nature of these systems and methods. Finally, the discussion will look to identify a future state for responders to SOD's and the ability and outcomes of proposed and imagined future systems, leveraging off the current Esri packages to provide a starting platform and a desired end state.
|
Kerrianne Morrison, Yee-Yin Choong, Shanee Dawkins, & Sandra Spickard Prettyman. (2021). Communication Technology Problems and Needs of Rural First Responders. In Anouck Adrot, Rob Grace, Kathleen Moore, & Christopher W. Zobel (Eds.), ISCRAM 2021 Conference Proceedings – 18th International Conference on Information Systems for Crisis Response and Management (pp. 817–834). Blacksburg, VA (USA): Virginia Tech.
Abstract: Although new technology may benefit rural first responders to help them serve their communities, to date little is known about what communication technology problems rural first responders most need addressed and what future technology they desire. To explore the context of use and communication technology problems and needs of rural first responders, semi-structured interviews were conducted with 63 rural first responders across four disciplines: Communications (Comm) Center & 9-1-1 Services, Emergency Medical Services, Fire Service, and Law Enforcement. Using qualitative data analysis, interview data were sorted into problems and needs categories. Rural first responders' greatest problems were with reliable coverage/connectivity, interoperability, implementation/information technology (IT) infrastructure, and physical ergonomics. Rural first responders' greatest need for new technology was to address their current problems, but they were interested in new technology that leverages real-time technology and location tracking. Implications for researchers and developers of public safety communication technology are discussed.
|
Stas Simon Krupenia, & Cécilia Aguero. (2012). Asset distribution with a multitouch table. In Z.Franco J. R. L. Rothkrantz (Ed.), ISCRAM 2012 Conference Proceedings – 9th International Conference on Information Systems for Crisis Response and Management. Vancouver, BC: Simon Fraser University.
Abstract: We examined to what extent a MultiTouch Table (MTT) can support a collaborative Operational Planning Asset Distribution task as compared to traditional Spreadsheet methods. Participants were given different and complementary specialist roles and were then asked to distribute different sets of assets over an area of Operations with multiple known and unknown 'needs'. Additionally, participants had to satisfy a series of real time intelligence recommendations regarding potential needs. Of interest were subjective usability ratings and objective performance measures in terms of need fulfillment and satisfying intelligence recommendations. We found that on all but one usability measure participants rated the MTT more positively than the Spreadsheets. There was also a non-significant trend for greater needs fulfillment and resolving intelligence recommendations using the MTT than the spreadsheets. On the basis of the results we suggest that MTT technology offers a viable tool for supporting collaborative Asset Distribution tasks in general. © 2012 ISCRAM.
|
Lamsal, R., Read, M. R., & Karunasekera, S. (2023). A Twitter narrative of the COVID-19 pandemic in Australia. In Jaziar Radianti, Ioannis Dokas, Nicolas Lalone, & Deepak Khazanchi (Eds.), Proceedings of the 20th International ISCRAM Conference (pp. 353–370). Omaha, USA: University of Nebraska at Omaha.
Abstract: Social media platforms contain abundant data that can provide comprehensive knowledge of historical and real-time events. During crisis events, the use of social media peaks, as people discuss what they have seen, heard, or felt. Previous studies confirm the usefulness of such socially generated discussions for the public, first responders, and decision-makers to gain a better understanding of events as they unfold at the ground level. This study performs an extensive analysis of COVID-19-related Twitter discussions generated in Australia between January 2020, and October 2022. We explore the Australian Twitterverse by employing state-of-the-art approaches from both supervised and unsupervised domains to perform network analysis, topic modeling, sentiment analysis, and causality analysis. As the presented results provide a comprehensive understanding of the Australian Twitterverse during the COVID-19 pandemic, this study aims to explore the discussion dynamics to aid the development of future automated information systems for epidemic/pandemic management.
|
Vitaveska Lanfranchi, Suvodeep Mazumdar, & Fabio Ciravegna. (2013). Evaluating the real usability of a C2 system – Short and controlled vs long and real. In J. Geldermann and T. Müller S. Fortier F. F. T. Comes (Ed.), ISCRAM 2013 Conference Proceedings – 10th International Conference on Information Systems for Crisis Response and Management (pp. 62–66). KIT; Baden-Baden: Karlsruher Institut fur Technologie.
Abstract: Command and Control systems (C2) need to be highly usable to efficiently support communication during crisis situations. Short-term usability evaluations are typically carried out because of the cost and time advantage. However, even the most realistic evaluations (simulations) do not reflect the real issues encountered “in the wild”, such as the operators' stress or the multiple foci of attention. In this paper we carry out an experiment to measure the changes in usability of a C2 system between a short-term simulation and a long-term “in the wild” evaluation. We demonstrate that short-term usability measurements can differ significantly from long-term “in the wild” ones. Our results indicate that a different approach to usability assessment is needed when dealing with critical systems, that takes into account the temporal horizon and assesses the system in real-life conditions.
|
Marion Lara Tan, Raj Prasanna, Kristin Stock, Emma Hudson-Doyle, Graham Leonard, & David Johnston. (2018). Usability Factors Affecting the Continuance Intention of Disaster Apps. In Kristin Stock, & Deborah Bunker (Eds.), Proceedings of ISCRAM Asia Pacific 2018: Innovating for Resilience – 1st International Conference on Information Systems for Crisis Response and Management Asia Pacific. (pp. 326–338). Albany, Auckland, New Zealand: Massey Univeristy.
Abstract: Multiple disaster mobile applications (apps) already exist for public use; however, availability does not automatically translate to continued usage. Limited research has explored whether disaster apps are usable and whether the apps' usability affects users' intent for continued use. The paper presents a work-in-progress study that aims to test a usability-continuance intention model for the specific context of disaster apps. The study theorises seven usability factors that influence continued intention to use. An online usability survey was used to gather user experience data on disaster apps. Initial findings, through structural equational modelling, showed that five of the seven usability factors have a significant relationship to continuance intention. Although the relationships have different weights and directions, key influencers to users' intent to continue usage are app utility, app dependability, interface output, interface input, and interface graphics. The next step of the study will investigate the mediating effects of the factors and the moderating effects of users' experience and technological comfort.
|
Marion Lara Tan, Raj Prasanna, Kristin Stock, Emma Hudson-Doyle, Graham Leonard, & David Johnston. (2019). Enhancing the usability of a disaster app: exploring the perspective of the public as users. In Z. Franco, J. J. González, & J. H. Canós (Eds.), Proceedings of the 16th International Conference on Information Systems for Crisis Response And Management. Valencia, Spain: Iscram.
Abstract: Limited research has studied how citizens? perspectives as end-users can contribute to improving the usability of disaster apps. This study addresses this gap by exploring end-user insights with the use of a conceptual disaster app in the New Zealand (NZ) context. NZ has multiple public alerting authorities that have various technological options in delivering information to the population?s mobile devices; including social media platforms, apps, as well as the Emergency Mobile Alert system. However, during critical events, the multiplicity of information may become overwhelming. A disaster app, conceptualised in the NZ context, aims to aggregate, organise, and deliver information from official sources to the public. After the initial conceptual design, a usability inquiry was administered by interviewing members of the public. Partial results of the inquiry show that the public?s perspective has value; in the process of understanding the new user?s viewpoint, usability highlights and issues are identified.
|
Tilo Mentler, & Michael Herczeg. (2013). Applying ISO 9241-110 dialogue principles to tablet applications in emergency medical services. In J. Geldermann and T. Müller S. Fortier F. F. T. Comes (Ed.), ISCRAM 2013 Conference Proceedings – 10th International Conference on Information Systems for Crisis Response and Management (pp. 502–506). KIT; Baden-Baden: Karlsruher Institut fur Technologie.
Abstract: In the safety- And time-critical context of pre-hospital medical care, usability is a major challenge that needs to be addressed, because interaction problems or errors may have serious consequences for patients as well as employees of Emergency Medical Services (EMS). In this regard, a user-centered human-computer interface is a crucial factor for efficient usage as well as user acceptance. Well-established design principles can serve as directives throughout the analysis, design, implementation, and evaluation of applications. For standard PCbased applications the ISO standard 9241-110 serves as a practical guide since many years. However, new types of devices, especially mobile systems impose new challenges and ways of interpreting usability standards and guidelines. In this paper, we apply the ISO-Standard 9241-110 dialogue principles to mobile applications in EMS, considering the challenges of designing a system suitable for supporting users in both regular day-to-day services as well as rare Mass Casualty Incidents (MCIs).
|
Jason R.C. Nurse, Sadie Creese, Michael Goldsmith, Rachel Craddock, & Glyn Jones. (2012). An initial usability evaluation of the secure situation awareness system. In Z.Franco J. R. L. Rothkrantz (Ed.), ISCRAM 2012 Conference Proceedings – 9th International Conference on Information Systems for Crisis Response and Management. Vancouver, BC: Simon Fraser University.
Abstract: The importance of situation awareness systems in crisis-management scenarios cannot be emphasised enough. These systems enable entire disaster situations to be mapped out in a real-time fashion thereby aiding significantly in human decision-making and the necessary positioning, management and deployment of resources. As a result of the core role these systems play in responding to crises, it is vital that they are highly usable and optimized for human cognition and experience. In this paper we consider this reality in the context of an initial evaluation of the visualisation interface of a situation-awareness tool called Secure Situation Awareness (SSA). Our evaluation seeks to gather useful feedback from potential end-users on the usability of the tool's interface to feed into the design and development of interfaces for similar systems. © 2012 ISCRAM.
|
Felix Riedel, & Fernando Chaves. (2012). Workflows and decision tables for flexible early warning systems. In Z.Franco J. R. L. Rothkrantz (Ed.), ISCRAM 2012 Conference Proceedings – 9th International Conference on Information Systems for Crisis Response and Management. Vancouver, BC: Simon Fraser University.
Abstract: Today's decision support systems for crisis management are mostly designed to support a fixed process that integrates a given set of information sources. This means policies that govern the crisis management process are tightly integrated with the implementation, which makes it hard to adapt the system to changing requirements. Modern systems are expected to be adaptable and need to evolve along with the availability of new information sources and changing business processes. Previous work suggested using workflow systems to manage crisis management processes. Current approaches that use workflow systems are not end-user friendly or not flexible enough. In this paper we present our approach that combines workflows and decision tables for creating more flexible decision support systems. While workflows are used to orchestrate services and implement information logistics in the decision support processes, embedded rule sets are used to provide flexibility and adaptability of workflows. The rule sets are authored using decision tables which are an easy-to-use representation that allows end-users to express rules in an intuitive way. © 2012 ISCRAM.
|
Samuel Auclair, Pierre Gehl, Mickael Delatre, Christophe Debray, & Philippe Méresse. (2022). In-depth Analysis of Practitioners' Perceptions about Seismic Early Warning Prior to Aftershocks: The Point of View of the USAR Community. In Rob Grace, & Hossein Baharmand (Eds.), ISCRAM 2022 Conference Proceedings – 19th International Conference on Information Systems for Crisis Response and Management (pp. 740–754). Tarbes, France.
Abstract: Urban Search and Rescue (USAR) teams are particularly exposed to the risk of collapse of buildings due to aftershocks, making concept of earthquake early warning (EEW) particularly interesting. In addition to scientific advances in EEW, it is crucial to understand what are the real expectations and needs of USAR teams, and to what extent EEW solutions could meet them. In this study, we conduct a survey to collect insights from USAR rescuers: it highlights that aftershocks are a major concern for them. In this context, we find that the concept of EEW is very favorably received by the respondents, who consider different types of possible actions upon receipt of an early warning. This study provides a basis for the functional specifications of future solutions of EEW useful to all USAR teams, as well as for the definition of their modalities of engagement on the field.
|
Schmidt-Colberg, A., & Löffler-Dauth, L. (2023). A Human-Centric Evaluation Dataset for Automated Early Wildfire Detection from a Causal Perspective. In Jaziar Radianti, Ioannis Dokas, Nicolas Lalone, & Deepak Khazanchi (Eds.), Proceedings of the 20th International ISCRAM Conference (pp. 933–943). Omaha, USA: University of Nebraska at Omaha.
Abstract: Insight into performance ability is crucial for successfully implementing AI solutions in real-world applications. Unanticipated input can lead to false positives (FP) and false negatives (FN), potentially resulting in false alarms in fire detection scenarios. Literature on fire detection models shows varying levels of complexity and explicability in evaluation practices; little supplementary information on performance ability outside of accuracy scores is provided. We advocate for a standardized evaluation dataset that prioritizes the end-user perspective in assessing performance capabilities. This leads us to ask what an evaluation dataset needs to constitute to enable a non-expert to determine the adequacy of a model's performance capabilities for their specific use case. We propose using data augmentation techniques that simulate interventions to remove the connection to the original target label, providing interpretable counterfactual explanations into a model's predictions.
|
Huizhang Shen, Jingwen Hu, Jidi Zhao, & Jing Dong. (2012). Ontology-based modeling of emergency incidents and crisis management. In Z.Franco J. R. L. Rothkrantz (Ed.), ISCRAM 2012 Conference Proceedings – 9th International Conference on Information Systems for Crisis Response and Management. Vancouver, BC: Simon Fraser University.
Abstract: With the frequent occurrence of emergency incidents in recent years, developing intelligent and effective decision support systems for emergency response and management is getting crucial to the government and public administration. Prior research has made many efforts in constructing crisis databases over the decades. However, existing emergency management systems built on top of these databases provide limited decision support capabilities and are short of information processing and reasoning. Furthermore, ontology based on logic description and rules has more semantics description capability compared to traditional relational database. Aiming to extend existing studies and considering ontology's reusability, this paper presents an approach to build ontology-based DSSs for crisis response and management. © 2012 ISCRAM.
|
Tilo Mentler. (2017). Applying Usability Engineering to Interactive Systems for Crisis and Disaster Management. In eds Aurélie Montarnal Matthieu Lauras Chihab Hanachi F. B. Tina Comes (Ed.), Proceedings of the 14th International Conference on Information Systems for Crisis Response And Management (pp. 929–938). Albi, France: Iscram.
Abstract: Crisis and disaster management are increasingly characterized by interactive systems intended to be valuable support for professionals and volunteers in preventing, preparing for, responding to and recovering from major incidents and accidents. Therefore, usability in terms of safe and efficient usage of computer-based solutions becomes a crucial factor for successful crisis and disaster management. In order to ensure usability, it has to be addressed systematically throughout any development process. In this paper, established engineering approaches to crisis and disaster management systems are summarized. Subsequently, resemblances (e.g. diversity of users and devices) and differences (e.g. scalability) between safety-critical contexts of medical device design and crisis management are outlined. Following this, recommendations for applying usability engineering processes to disaster management are derived from standards and guidelines according to medical device design (IEC 62366-1:2015, ISO 14971:2007). Particularly, relationships and interactions between usability engineering and risk managements measures (e.g. hazard-related use scenarios) are described.
|