by Santiago Maraggi, Joan Baixauli and Roderick McCall (LIST)
Training for radiological events is time consuming and risky. In contrast to real sources, a prototype augmented reality system lets trainees and trainers safely learn about the necessary detection, identification and decontamination steps.
The European Union funded H2020 TARGET project uses mixed reality technologies alongside serious gaming approaches to train security critical agents such as the police, fire brigades and Chemical, Biological, Radiological and Nuclear (CBRN) teams. CBRN response team training is the focus of this article, with the particular system described here using augmented reality to train radiological incident teams. The main advantages of using augmented reality for CBRN training are that the trainees continue to interact with the real world but can see invisible risks e.g. radiation. As there are no real radiation sources it is safer and cheaper. The systems developed within the project were a direct result of an extensive requirements capture process [1].
The training case comprises a two person CBRN team entering a scene where they have to detect, find, classify and isolate simulated radiation sources. They also need avoid over exposure to the radiation sources and have to complete their tasks before their simulated oxygen level is depleted. Once they have completed this task they must enter the decontamination phase, which entails simulating the cleaning of their protective suits.
The system uses a range of technologies, for example the Microsoft Hololens augmented reality headset makes it possible to see augmented virtual holographic objects (holograms) in the environment integrated with the real objects perceived by the user, providing a mixed reality perception. The Pozyx indoor localisation system allows us to track movable objects in the scene. Any object can have a chosen simulated radiation isotope attached with an intensity Bq (Becquerels). A customised 3D printed simulated dosimeter (a replica of an “Identifinder” device) has been developed, it contains a Raspberry pi with a screen and a Pozyx tag to identify isotopes and measure the simulated radiation values.
Radiation contamination is modelled using a discrete particle system in Unity 3D. Particles are attached to contaminated objects; this allows the system to check for collisions between, for example, the Pozyx tag attached to the trainee and the contaminated object. Virtual colliders are set with all scene elements in order to detect collisions with contamination particles (see Figure 1). It is also possible for objects to become contaminated in specific areas and for contamination to spread between objects (see Figure 2).
Figure 1: Colliders Superimposed Over Real Objects.
Figure 2: Contaminated Laboratory Instruments.
Visualisation of the radiation field is provided on two levels (see Figure 3), firstly the red particles show the critical zone, while the yellow particles show the external dangerous zone. The extent of the visualisation elements depends on the dose level of the source. For the visualisation of the contamination particles a transparent green spherical model is used. Also, each time a contamination particle comes into contact with a contaminable object a sound is emitted. These visual and aural clues can be activated or deactivated depending on the preferences of the instructor.
Figure 3: Radiation Fields.
All radiation contamination particles have a specific radiation dose value and also a minimum level. This allows for radiation dose levels to fall over time and also for certain levels of radiation to remain even if cleaning (decontamination) is undertaken.
The decontamination or cleaning process involves the application of a physical simulated cleaning brush to contaminated objects. This is similar to using a real brush to undertake the same task. A liquid jet is also simulated and it can be used to clean contaminated particles from a chosen object. Decontamination of the CBRN team members is also an important task. For this, the first trainee has to stand away from the main scene with their arms horizontal. A second trainee uses a simulated cleaning jet to clean the first trainees protective suit, the contamination level is indicated via several augmentations. Decontamination is complete when all the contamination zones have turned green.
To enhance the learning and training experience, some visualisation elements were added. During the exercise, an oxygen level bar with a certain amount of time appears at the left side of the augmented reality display and an accumulative radiation exposure bar is shown on the right and becomes red when the cumulative dose reaches a dangerous level. Several gamification parameters are displayed by the system and these include: Accumulated Radiation Avoidance, Contamination Spread Avoidance and Time of Exposure (Figure 5).
Figure 4: CBRN Team Member Wearing a Protective Suit.
Figure 5: Gamification Display.
In order to validate the work, different versions of the system have been tested during two trials in Bratislava, Slovakia. The trials identified that the approach is useful for CBRN teams and also pointed to several areas of improvement.
This work has been carried out within the framework of the EU H2020 TARGET project. The project has received funding from the European Union’s Horizon research and innovation programme under grant agreement No 653350. We also acknowledge the other partners in the project for their assistance.
Reference:
[1] J.L.Huynen et al. “Towards Design Recommendations for Training of Security Critical Agents in Mixed Reality Environments” in BCS HCI 2018.
Links:
http://www.target-h2020.eu/
https://www.pozyx.io/
https://www.microsoft.com/en-us/hololens
https://unity3d.com/
https://www.flir.com/products/identifinder-r400/
Please contact:
Rod McCall, Environmental Research and Innovation Department (ERIN), Luxembourg Institute of Science and Technology (LIST)
