|
|
Ahmed Abdeltawab Abdelgawad, & Tina Comes. (2019). Evaluation Framework for the iTRACK Integrated System. In Z. Franco, J. J. González, & J. H. Canós (Eds.), Proceedings of the 16th International Conference on Information Systems for Crisis Response And Management. Valencia, Spain: Iscram.
Abstract: Evaluation and testing are major steps in the development of any information system, particularly if it is to be used in high-risk contexts such as conflicts. While thus far there are various approaches for testing against technology requirements; usability or usefulness, there is a lack of a comprehensive evaluation framework that combines the three elements. The lack of such a framework and commonly agreed standards constitutes a barrier for innovation, and at the same time imposes risks to responders if the technology is introduced without proper testing. This paper aims to close this gap. Based on a reviewing of evaluation methods and measurement metrics, we design a comprehensive evaluation framework including common code quality testing metrics, usability testing methods, subjective usefulness questionnaires, and performance indicators. We demonstrate our approach by using the example of an integrated system for the safety and security of humanitarian missions, and we highlight how our approach allows measuring the system?s quality and usefulness.
|
|
|
|
Dirk Bradler, Benjamin Schiller, Erwin Aitenbichler, & Nicolas Liebau. (2009). Towards a distributed crisis response communication system. In S. J. J. Landgren (Ed.), ISCRAM 2009 – 6th International Conference on Information Systems for Crisis Response and Management: Boundary Spanning Initiatives and New Perspectives. Gothenburg: Information Systems for Crisis Response and Management, ISCRAM.
Abstract: Reliable communication systems are one of the key success factors for a successful first response mission. Current crisis response communication systems suffer from damaged or destroyed infrastructure or are just overstressed in the case of a large scale disaster. We provide an outline for a distributed communication approach, which fulfills the requirements of first responders. It is based on a layered network topology and current technology used in research projects or already established products. In addition, we propose a testing framework for the evaluation of a crisis response communication system.
|
|
|
|
Bruna Diirr, & Marcos R. S. Borges. (2013). Applying software engineering testing techniques to evaluate emergency plans. In J. Geldermann and T. Müller S. Fortier F. F. T. Comes (Ed.), ISCRAM 2013 Conference Proceedings – 10th International Conference on Information Systems for Crisis Response and Management (pp. 758–763). KIT; Baden-Baden: Karlsruher Institut fur Technologie.
Abstract: An emergency plan is an important artifact used throughout emergencies. Therefore, it is crucial that this plan covers the different scenarios faced by emergency team and that the prescribed procedures generate the desired results. To achieve these goals, emergency plans need to be exhaustively tested prior to its adoption. Emergency teams usually use simulation to test plans, but it is an expensive approach, demanding the building of complex environments and tools to get realistic situations. To be ready to go through a simulation exercise, a plan should not have many or critical mistakes, otherwise the simulation exercise would be wasted. We present a paired approach to evaluate emergency plans before simulation exercises, by applying software engineering testing techniques: Formal technical review (FTR) and mutation testing. The expected result is a plan more ready to go through simulation, as many of the mistakes are eliminated prior to simulation.
|
|
|
|
Rahele B. Dilmaghani, & Ramesh R. Rao. (2008). A wireless mesh infrastructure deployment with application for emergency scenarios. In B. V. de W. F. Fiedrich (Ed.), Proceedings of ISCRAM 2008 – 5th International Conference on Information Systems for Crisis Response and Management (pp. 484–494). Washington, DC: Information Systems for Crisis Response and Management, ISCRAM.
Abstract: When a disaster or emergency occurs, one of the most pressing needs is to establish a communication network for the first responders at the scene. Establishing and accessing a reliable communication infrastructure at a crisis site is crucial in order to have accurate and real-time exchange of information. Failure in the exchange of timely and crucial information or delay in allocating resources impedes early response efforts, potentially resulting in loss of life and additional economic impact. At a disaster site, the existing communication infrastructure may be damaged and therefore partially or totally unavailable; or, there may not have been previously existing infrastructure (as in the case of remote areas). A communication infrastructure within the context of emergency applications should be reliable, easily configurable, robust, interoperable in a heterogeneous environment with minimum interdependencies, and quickly deployable at low cost. A disaster scene is a chaotic environment which requires a systematic approach to abstract the system, study the flow of information and collaboration among different disciplines and jurisdictions to facilitate response and recovery efforts. We have deployed the wireless mesh infrastructure in several drills at the university campus and in the city as part of the California Institute for Telecommunications and Information Technology (Calit2) NSF-funded RESCUE project (Responding to Crises and Unexpected Events). To evaluate network performance and identify the source(s) of bottleneck, we have captured the network traffic. The lessons learned from test bed evaluations of the network based on real-world scenarios can be applied to future applications to enhance the network design and performance.
|
|
|
|
Rafael A. Gonzalez. (2009). Crisis response simulation combining discrete-event and agent-based modeling. In S. J. J. Landgren (Ed.), ISCRAM 2009 – 6th International Conference on Information Systems for Crisis Response and Management: Boundary Spanning Initiatives and New Perspectives. Gothenburg: Information Systems for Crisis Response and Management, ISCRAM.
Abstract: This paper presents a crisis response simulation model architecture combining a discrete-event simulation (DES) environment for a crisis scenario with an agent-based model of the response organization. In multi-agent systems (MAS) as a computational organization, agents are modeled and implemented separately from the environmental model. We follow this perspective and submit an architecture in which the environment is modeled as a discreteevent simulation, and the crisis response agents are modeled as a multi-agent system. The simultaneous integration and separation of both models allows for independent modifications of the response organization and the scenario, resulting in a testbed that allows testing different organizations to respond to the same scenario or different emergencies for the same organization. It also provides a high-level architecture suggesting the way in which DES and MAS can be combined into a single simulation in a simple way.
|
|
|
|
Gordon Gow, Peter Anderson, & Nuwan Waidyanatha. (2007). Hazard warnings in Sri Lanka: Challenges of internetworking with Common Alerting Protocol. In K. Nieuwenhuis P. B. B. Van de Walle (Ed.), Intelligent Human Computer Systems for Crisis Response and Management, ISCRAM 2007 Academic Proceedings Papers (pp. 281–293). Delft: Information Systems for Crisis Response and Management, ISCRAM.
Abstract: There is a growing call for the use of open source content standards for all-hazards, all-media alert and notification systems. This paper presents findings on the implementation of Common Alerting Protocol (CAP) as a content standard for a community-based hazard information network in Sri Lanka. CAP is being deployed as part of the HazInfo project, which has established last-mile networking capability for 32 tsunami-affected villages in Sri Lanka in order to study the suitability of various Information Communication Technologies (ICTs) for a standards-based community hazard information system. Results to date suggest that the basic internetworking arrangement at lower technical layers has proven to be reasonably robust and reliable but that a key challenge remains in the upper layers of application software and content provision. This is evident in the apparent difficulties faced when implementing CAP messaging over multiple last-mile systems that include commercial satellite and terrestrial network technologies (C/L/X-Band, GSM, and CDMA in modes of voice and text). Lessons learned from silent tests and live exercises point to several key bottlenecks in the system where the integrity of CAP messages is compromised due to problems associated with software interoperability or direct human intervention. The wider implication of this finding is that content standards by themselves are not sufficient to support appropriate and timely emergency response activities. Those working with content standards for hazard information systems must consider closely the interoperability issues at various layers of interconnectivity.
|
|
|
|
Ida Maria Haugstveit, Eivind Lars Rake, & Aslak Wegner Eide. (2015). Practitioner-Centered, Long-Term Testing of an ICT-based Triage System for Emergency Management. In L. Palen, M. Buscher, T. Comes, & A. Hughes (Eds.), ISCRAM 2015 Conference Proceedings ? 12th International Conference on Information Systems for Crisis Response and Management. Kristiansand, Norway: University of Agder (UiA).
Abstract: Triage in emergency response refers to determining the priority of victims based on their need for treatment and medical intervention. Today, triage is performed by the use of paper-based triage tags. Communication about patients? status is mainly carried out over radio or through handwritten notes. This practice makes it challenging for emergency personnel to keep an overview of the number, location, and medical status of victims, and to distribute information between personnel. Although technological solutions to ease the triage process exist, the methods used to test these solutions are somewhat limited. This paper reports our plans and preparations for a practitioner-centered, long-term testing of an ICT-based triage system. The system uses electronic devices to tag patients and communicate their status to relevant incident operators, providing a common operational picture for both on- and off-site personnel. The technologies (eTriage and Master) that are to be used during the testing are presented.
|
|
|
|
Aamir Mahmood, Konstantinos Koufos, & Krisztina Cziner. (2008). Multicast voice performance within a public safety cell. In B. V. de W. F. Fiedrich (Ed.), Proceedings of ISCRAM 2008 – 5th International Conference on Information Systems for Crisis Response and Management (pp. 18–24). Washington, DC: Information Systems for Crisis Response and Management, ISCRAM.
Abstract: In public safety communications the first responders are getting directions about the tactical action plan with multicast voice whereas they can report back to the dispatcher with unicast voice. In this paper, the aim is to find the maximum number of voice calls for situation reporting in the presence of multicast voice for tactical coordination. In order to increase the reliability of our analysis we verify our simulator against a test bed prototype consisting of three 802.11 terminals. The simulation study is applied within a mobile cell. The proposed mobility model applies for initial deployment in emergency scenarios. We investigate the statistical properties of the model by simulations.
|
|
|
|
Christine M. Newlon, Mark Pfaff, Himalaya Patel, Gert-Jan De Vreede, & Karl MacDorman. (2009). Mega-collaboration: The Inspiration and development of an interface for large-scale disaster response. In S. J. J. Landgren (Ed.), ISCRAM 2009 – 6th International Conference on Information Systems for Crisis Response and Management: Boundary Spanning Initiatives and New Perspectives. Gothenburg: Information Systems for Crisis Response and Management, ISCRAM.
Abstract: The need to gather and use decentralized information and resources in responding to disasters demands an integrated interface that can support large-scale collaboration. This paper describes the development of a collaboration tool interface. The tool will surpass existing groupware and social networking applications, providing easy entry, categorization, and visualization of masses of critical data; the ability to form ad-hoc teams with collaboration protocols for negotiated action; and agent-augmented mixed-initiative tracking and coordination of these activities. The paper reports user testing results concerning the data entry interface, emergent leadership, and the directed negotiation process. The paper also discusses planned enhancements, including formalized collaboration engineering and the use of a disaster simulation test bed.
|
|
|
|
Jason R.C. Nurse, Sadie Creese, Michael Goldsmith, Rachel Craddock, & Glyn Jones. (2012). An initial usability evaluation of the secure situation awareness system. In Z.Franco J. R. L. Rothkrantz (Ed.), ISCRAM 2012 Conference Proceedings – 9th International Conference on Information Systems for Crisis Response and Management. Vancouver, BC: Simon Fraser University.
Abstract: The importance of situation awareness systems in crisis-management scenarios cannot be emphasised enough. These systems enable entire disaster situations to be mapped out in a real-time fashion thereby aiding significantly in human decision-making and the necessary positioning, management and deployment of resources. As a result of the core role these systems play in responding to crises, it is vital that they are highly usable and optimized for human cognition and experience. In this paper we consider this reality in the context of an initial evaluation of the visualisation interface of a situation-awareness tool called Secure Situation Awareness (SSA). Our evaluation seeks to gather useful feedback from potential end-users on the usability of the tool's interface to feed into the design and development of interfaces for similar systems. © 2012 ISCRAM.
|
|
