Christine Adler, Lisa Jakob, Mirjam Haus, Lena Erfurt, & Marion Krüsmann. (2012). GABEK WinRelan® – A qualitative method for crisis research engaging crisis management personnel. In Z.Franco J. R. L. Rothkrantz (Ed.), ISCRAM 2012 Conference Proceedings – 9th International Conference on Information Systems for Crisis Response and Management. Vancouver, BC: Simon Fraser University.
Abstract: Qualitative research methods like GABEK WinRelan are advantageous tools to analyze and thereby improve crisis management planning and communication systems by interrogating crisis management personnel. Contrary to quantitative methods they help to identify, explore, and structure new important aspects in this field and to formulate more specific research questions. This paper describes the usage and advantages of the qualitative method GABEK WinRelan within crisis management research, particularly within the e-Triage project which aims at the development of an electronic registration system of affected persons in mass casualty incidents. Furthermore it addresses different corresponding research fields like stress within emergency missions and the role GABEK WinRelan could play in examining these research fields. © 2012 ISCRAM.
|
Ahmed Abdeltawab Abdelgawad, & Tina Comes. (2019). Evaluation Framework for the iTRACK Integrated System. In Z. Franco, J. J. González, & J. H. Canós (Eds.), Proceedings of the 16th International Conference on Information Systems for Crisis Response And Management. Valencia, Spain: Iscram.
Abstract: Evaluation and testing are major steps in the development of any information system, particularly if it is to be used in high-risk contexts such as conflicts. While thus far there are various approaches for testing against technology requirements; usability or usefulness, there is a lack of a comprehensive evaluation framework that combines the three elements. The lack of such a framework and commonly agreed standards constitutes a barrier for innovation, and at the same time imposes risks to responders if the technology is introduced without proper testing. This paper aims to close this gap. Based on a reviewing of evaluation methods and measurement metrics, we design a comprehensive evaluation framework including common code quality testing metrics, usability testing methods, subjective usefulness questionnaires, and performance indicators. We demonstrate our approach by using the example of an integrated system for the safety and security of humanitarian missions, and we highlight how our approach allows measuring the system?s quality and usefulness.
|
Cecilia Hammar Wijkmark, & Ilona Heldal. (2020). Virtual and Live Simulation-Based Training for Incident Commanders. In Amanda Hughes, Fiona McNeill, & Christopher W. Zobel (Eds.), ISCRAM 2020 Conference Proceedings – 17th International Conference on Information Systems for Crisis Response and Management (pp. 1154–1162). Blacksburg, VA (USA): Virginia Tech.
Abstract: Computer and virtual simulation-based training (CST) offer several benefits for emergency response and management preparedness. However, organizations responsible for training are often hesitant to use CST, based on cost and perceived lack of benefit when compared to live simulation training (LST). This paper investigates how CST can complement LST, and how it contributes to achieving the necessary learning objectives for level one fire and rescue service incident commanders (ICs). Data and examples come from an experimental study with students from different fire and rescue services trained in the role of the IC in LST and CST, in a similar scenario. Results show the cost and benefits of the CST implementation based on evaluations from learners, instructors and responsible managers. Participants had a positive attitude towards using virtual simulations, but the results also point to barriers regarding the suitable design of learning scenarios and implementation.
|
Joske M. Houtkamp, & Frank A. Bos. (2007). Evaluation of a virtual scenario training for leading firefighters. In K. Nieuwenhuis P. B. B. Van de Walle (Ed.), Intelligent Human Computer Systems for Crisis Response and Management, ISCRAM 2007 Academic Proceedings Papers (pp. 565–570). Delft: Information Systems for Crisis Response and Management, ISCRAM.
Abstract: Artesis Virtual and VSTEP BV developed a virtual scenario training for leading firefighters. We evaluated the usability of the training application and measured the satisfaction of 53 trainees. The trainees were positive about the training application, the training itself, and the interaction with the interface. We observed that trainees experienced navigation difficulties and sometimes misjudged visual information. Evaluations of new versions of this application, should address the influence of interface problems on performance.
|
Kerrianne Morrison, Yee-Yin Choong, Shanee Dawkins, & Sandra Spickard Prettyman. (2021). Communication Technology Problems and Needs of Rural First Responders. In Anouck Adrot, Rob Grace, Kathleen Moore, & Christopher W. Zobel (Eds.), ISCRAM 2021 Conference Proceedings – 18th International Conference on Information Systems for Crisis Response and Management (pp. 817–834). Blacksburg, VA (USA): Virginia Tech.
Abstract: Although new technology may benefit rural first responders to help them serve their communities, to date little is known about what communication technology problems rural first responders most need addressed and what future technology they desire. To explore the context of use and communication technology problems and needs of rural first responders, semi-structured interviews were conducted with 63 rural first responders across four disciplines: Communications (Comm) Center & 9-1-1 Services, Emergency Medical Services, Fire Service, and Law Enforcement. Using qualitative data analysis, interview data were sorted into problems and needs categories. Rural first responders' greatest problems were with reliable coverage/connectivity, interoperability, implementation/information technology (IT) infrastructure, and physical ergonomics. Rural first responders' greatest need for new technology was to address their current problems, but they were interested in new technology that leverages real-time technology and location tracking. Implications for researchers and developers of public safety communication technology are discussed.
|
Stas Simon Krupenia, & Cécilia Aguero. (2012). Asset distribution with a multitouch table. In Z.Franco J. R. L. Rothkrantz (Ed.), ISCRAM 2012 Conference Proceedings – 9th International Conference on Information Systems for Crisis Response and Management. Vancouver, BC: Simon Fraser University.
Abstract: We examined to what extent a MultiTouch Table (MTT) can support a collaborative Operational Planning Asset Distribution task as compared to traditional Spreadsheet methods. Participants were given different and complementary specialist roles and were then asked to distribute different sets of assets over an area of Operations with multiple known and unknown 'needs'. Additionally, participants had to satisfy a series of real time intelligence recommendations regarding potential needs. Of interest were subjective usability ratings and objective performance measures in terms of need fulfillment and satisfying intelligence recommendations. We found that on all but one usability measure participants rated the MTT more positively than the Spreadsheets. There was also a non-significant trend for greater needs fulfillment and resolving intelligence recommendations using the MTT than the spreadsheets. On the basis of the results we suggest that MTT technology offers a viable tool for supporting collaborative Asset Distribution tasks in general. © 2012 ISCRAM.
|
Vitaveska Lanfranchi, Suvodeep Mazumdar, & Fabio Ciravegna. (2013). Evaluating the real usability of a C2 system – Short and controlled vs long and real. In J. Geldermann and T. Müller S. Fortier F. F. T. Comes (Ed.), ISCRAM 2013 Conference Proceedings – 10th International Conference on Information Systems for Crisis Response and Management (pp. 62–66). KIT; Baden-Baden: Karlsruher Institut fur Technologie.
Abstract: Command and Control systems (C2) need to be highly usable to efficiently support communication during crisis situations. Short-term usability evaluations are typically carried out because of the cost and time advantage. However, even the most realistic evaluations (simulations) do not reflect the real issues encountered “in the wild”, such as the operators' stress or the multiple foci of attention. In this paper we carry out an experiment to measure the changes in usability of a C2 system between a short-term simulation and a long-term “in the wild” evaluation. We demonstrate that short-term usability measurements can differ significantly from long-term “in the wild” ones. Our results indicate that a different approach to usability assessment is needed when dealing with critical systems, that takes into account the temporal horizon and assesses the system in real-life conditions.
|
Marion Lara Tan, Raj Prasanna, Kristin Stock, Emma Hudson-Doyle, Graham Leonard, & David Johnston. (2018). Usability Factors Affecting the Continuance Intention of Disaster Apps. In Kristin Stock, & Deborah Bunker (Eds.), Proceedings of ISCRAM Asia Pacific 2018: Innovating for Resilience – 1st International Conference on Information Systems for Crisis Response and Management Asia Pacific. (pp. 326–338). Albany, Auckland, New Zealand: Massey Univeristy.
Abstract: Multiple disaster mobile applications (apps) already exist for public use; however, availability does not automatically translate to continued usage. Limited research has explored whether disaster apps are usable and whether the apps' usability affects users' intent for continued use. The paper presents a work-in-progress study that aims to test a usability-continuance intention model for the specific context of disaster apps. The study theorises seven usability factors that influence continued intention to use. An online usability survey was used to gather user experience data on disaster apps. Initial findings, through structural equational modelling, showed that five of the seven usability factors have a significant relationship to continuance intention. Although the relationships have different weights and directions, key influencers to users' intent to continue usage are app utility, app dependability, interface output, interface input, and interface graphics. The next step of the study will investigate the mediating effects of the factors and the moderating effects of users' experience and technological comfort.
|
Marion Lara Tan, Raj Prasanna, Kristin Stock, Emma Hudson-Doyle, Graham Leonard, & David Johnston. (2019). Enhancing the usability of a disaster app: exploring the perspective of the public as users. In Z. Franco, J. J. González, & J. H. Canós (Eds.), Proceedings of the 16th International Conference on Information Systems for Crisis Response And Management. Valencia, Spain: Iscram.
Abstract: Limited research has studied how citizens? perspectives as end-users can contribute to improving the usability of disaster apps. This study addresses this gap by exploring end-user insights with the use of a conceptual disaster app in the New Zealand (NZ) context. NZ has multiple public alerting authorities that have various technological options in delivering information to the population?s mobile devices; including social media platforms, apps, as well as the Emergency Mobile Alert system. However, during critical events, the multiplicity of information may become overwhelming. A disaster app, conceptualised in the NZ context, aims to aggregate, organise, and deliver information from official sources to the public. After the initial conceptual design, a usability inquiry was administered by interviewing members of the public. Partial results of the inquiry show that the public?s perspective has value; in the process of understanding the new user?s viewpoint, usability highlights and issues are identified.
|
Tilo Mentler, & Michael Herczeg. (2013). Applying ISO 9241-110 dialogue principles to tablet applications in emergency medical services. In J. Geldermann and T. Müller S. Fortier F. F. T. Comes (Ed.), ISCRAM 2013 Conference Proceedings – 10th International Conference on Information Systems for Crisis Response and Management (pp. 502–506). KIT; Baden-Baden: Karlsruher Institut fur Technologie.
Abstract: In the safety- And time-critical context of pre-hospital medical care, usability is a major challenge that needs to be addressed, because interaction problems or errors may have serious consequences for patients as well as employees of Emergency Medical Services (EMS). In this regard, a user-centered human-computer interface is a crucial factor for efficient usage as well as user acceptance. Well-established design principles can serve as directives throughout the analysis, design, implementation, and evaluation of applications. For standard PCbased applications the ISO standard 9241-110 serves as a practical guide since many years. However, new types of devices, especially mobile systems impose new challenges and ways of interpreting usability standards and guidelines. In this paper, we apply the ISO-Standard 9241-110 dialogue principles to mobile applications in EMS, considering the challenges of designing a system suitable for supporting users in both regular day-to-day services as well as rare Mass Casualty Incidents (MCIs).
|
Jason R.C. Nurse, Sadie Creese, Michael Goldsmith, Rachel Craddock, & Glyn Jones. (2012). An initial usability evaluation of the secure situation awareness system. In Z.Franco J. R. L. Rothkrantz (Ed.), ISCRAM 2012 Conference Proceedings – 9th International Conference on Information Systems for Crisis Response and Management. Vancouver, BC: Simon Fraser University.
Abstract: The importance of situation awareness systems in crisis-management scenarios cannot be emphasised enough. These systems enable entire disaster situations to be mapped out in a real-time fashion thereby aiding significantly in human decision-making and the necessary positioning, management and deployment of resources. As a result of the core role these systems play in responding to crises, it is vital that they are highly usable and optimized for human cognition and experience. In this paper we consider this reality in the context of an initial evaluation of the visualisation interface of a situation-awareness tool called Secure Situation Awareness (SSA). Our evaluation seeks to gather useful feedback from potential end-users on the usability of the tool's interface to feed into the design and development of interfaces for similar systems. © 2012 ISCRAM.
|
Felix Riedel, & Fernando Chaves. (2012). Workflows and decision tables for flexible early warning systems. In Z.Franco J. R. L. Rothkrantz (Ed.), ISCRAM 2012 Conference Proceedings – 9th International Conference on Information Systems for Crisis Response and Management. Vancouver, BC: Simon Fraser University.
Abstract: Today's decision support systems for crisis management are mostly designed to support a fixed process that integrates a given set of information sources. This means policies that govern the crisis management process are tightly integrated with the implementation, which makes it hard to adapt the system to changing requirements. Modern systems are expected to be adaptable and need to evolve along with the availability of new information sources and changing business processes. Previous work suggested using workflow systems to manage crisis management processes. Current approaches that use workflow systems are not end-user friendly or not flexible enough. In this paper we present our approach that combines workflows and decision tables for creating more flexible decision support systems. While workflows are used to orchestrate services and implement information logistics in the decision support processes, embedded rule sets are used to provide flexibility and adaptability of workflows. The rule sets are authored using decision tables which are an easy-to-use representation that allows end-users to express rules in an intuitive way. © 2012 ISCRAM.
|
Huizhang Shen, Jingwen Hu, Jidi Zhao, & Jing Dong. (2012). Ontology-based modeling of emergency incidents and crisis management. In Z.Franco J. R. L. Rothkrantz (Ed.), ISCRAM 2012 Conference Proceedings – 9th International Conference on Information Systems for Crisis Response and Management. Vancouver, BC: Simon Fraser University.
Abstract: With the frequent occurrence of emergency incidents in recent years, developing intelligent and effective decision support systems for emergency response and management is getting crucial to the government and public administration. Prior research has made many efforts in constructing crisis databases over the decades. However, existing emergency management systems built on top of these databases provide limited decision support capabilities and are short of information processing and reasoning. Furthermore, ontology based on logic description and rules has more semantics description capability compared to traditional relational database. Aiming to extend existing studies and considering ontology's reusability, this paper presents an approach to build ontology-based DSSs for crisis response and management. © 2012 ISCRAM.
|
Tilo Mentler. (2017). Applying Usability Engineering to Interactive Systems for Crisis and Disaster Management. In eds Aurélie Montarnal Matthieu Lauras Chihab Hanachi F. B. Tina Comes (Ed.), Proceedings of the 14th International Conference on Information Systems for Crisis Response And Management (pp. 929–938). Albi, France: Iscram.
Abstract: Crisis and disaster management are increasingly characterized by interactive systems intended to be valuable support for professionals and volunteers in preventing, preparing for, responding to and recovering from major incidents and accidents. Therefore, usability in terms of safe and efficient usage of computer-based solutions becomes a crucial factor for successful crisis and disaster management. In order to ensure usability, it has to be addressed systematically throughout any development process. In this paper, established engineering approaches to crisis and disaster management systems are summarized. Subsequently, resemblances (e.g. diversity of users and devices) and differences (e.g. scalability) between safety-critical contexts of medical device design and crisis management are outlined. Following this, recommendations for applying usability engineering processes to disaster management are derived from standards and guidelines according to medical device design (IEC 62366-1:2015, ISO 14971:2007). Particularly, relationships and interactions between usability engineering and risk managements measures (e.g. hazard-related use scenarios) are described.
|
