Stella Polikarpus, Tobias Ley, Hans Hazebroek, Graham Edgar, Geoffrey Sallis, Steven Baker, et al. (2022). Authoring Virtual Simulations to Measure Situation Awareness and Understanding. In Rob Grace, & Hossein Baharmand (Eds.), ISCRAM 2022 Conference Proceedings – 19th International Conference on Information Systems for Crisis Response and Management (pp. 428–433). Tarbes, France.
Abstract: Measuring situation awareness (SA) and situation understanding (SU) is an important topic for Command & Control research. Virtual simulations (VS) have been proposed as a suitable method for measuring SA/U, but, there is little research into how to build scenarios for VS so that SA/U can be measured reliably. In this study, we used two different VS scenarios and the Quantitative Analysis of Situation Awareness (QASA) method to measure, and provide feedback on, actual and perceived SA/U. Two VS scenarios were tested in Estonia with 36 trainees. The results of the different scenarios were compared to establish whether the scenario storylines and authoring process resulted in differences in SA or SU. We conclude that reliable assessment results were produced with both authoring processes, and further suggest that the Collaborative Authoring Process Model for Virtual Simulations (CAPM) be used for VS creation.
|
Stella Polikarpus, Tobias Ley, & Katrin Poom-Valickis. (2021). Collaborative Authoring of Virtual Simulation Scenarios for Assessing Situational Awareness. In Anouck Adrot, Rob Grace, Kathleen Moore, & Christopher W. Zobel (Eds.), ISCRAM 2021 Conference Proceedings – 18th International Conference on Information Systems for Crisis Response and Management (pp. 229–237). Blacksburg, VA (USA): Virginia Tech.
Abstract: Situational awareness (SA), the ability to perceive, comprehend and predict situation around you and it is a key in attending any incident as critical foundation for successful decision-making. Because incidents are solitary events, development and assessment of SA presents a significant challenge. In this article we analyze the authoring process of twenty-two scenarios implemented in the XVR on-scene virtual simulation software used to assess rescue incident commanders' (ICs) SA. To allow the scenarios to be used by different assessors, the Collaborative Authoring Process Model for Virtual Simulation Scenarios (CAPM) was developed. In Estonia, 473 assessments were recorded in Effective Command database and analysed by all three levels of SA as recommended by Endsley (2000). Introduction of CAPM resulted in scenarios being re-used by different assessors for authentic SA measuring. In the last sections of this article, we introduce our suggestions to improve virtual scenario design and SA research.
|
