Real-time mixed reality display of dual particle radiation detector data | Scientific Reports - Nature.com

1 year ago 77

Introduction

Radiation imaging and root localization are indispensable tools successful routine, emergency, oregon pact verification scenarios involving radioactive materials. Imaging detector systems connection the quality to get the absorption of incoming radiation, frankincense accelerating the hunt and enabling a hunt with little radiation vulnerability hazard to the progressive individuals1. A detector relation could hereby presumption themselves astatine a harmless region and observe the spatial distribution, oregon ’hot spots’, of radiation without the request to determination the detector. Uncrewed vehicles specified arsenic drones oregon rovers could further trim progressive risks, arsenic was demonstrated with the survey of radioactive accumulation sites astatine Fukushima atomic powerfulness works portion 1/2 exhaust stack2.

The handheld dual particle imager (H2DPI) developed astatine the University of Michigan3 is simply a portable accelerated neutron and gamma-ray detection strategy optimized for imaging purposes. Using a operation of double-scatter events successful integrated solid scintillators, photo-absorption successful CeBr3, and pulse signifier favoritism (PSD) for particle classification, the H2DPI is capable to supply some gamma ray and accelerated neutron images simultaneously4. The H2DPI has been already utilized to representation peculiar atomic material3, specified arsenic highly enriched uranium, 252Cf, arsenic good arsenic modular (\(\alpha\),n) and gamma ray sources. Until now, radiation images and directional accusation are displayed connected machine screens that task the information into 2D angular space, often successful plots that convey strength implicit the azimuth and altitude angles.

Mixed world (MR) technologies that trust connected caput mounted devices are connected the verge of wide availability, including virtual world (VR, afloat virtual ocular experience) and augmented world (AR, overlay visuals connected existent satellite experience)5. MR has primitively referred to the continuum of devices betwixt AR and VR6, but much caller studies recovered nary wide adept statement connected the nonstop definitions7,8. We usage herein the explanation of Mixed Reality arsenic a exertion that enables the enactment with virtual and existent objects to show analyzable information successful real-time arsenic a holographic overlay to the user’s ocular perception.

The MR astute glasses Microsoft HoloLens2TM9 is among the archetypal much wide accessible devices that houses an array of sensors to representation its surroundings and task holographic information into it. MR devices person recovered archetypal applications that leverage the added virtual information, e.g. successful aesculapian applications specified arsenic country assistance10, anatomy training11, plan visualization12, and radiotherapy13,14. A caller reappraisal connected extended world (XR) successful spine medicine identifies a wide scope of involvement and needs for this benignant of technology15.

MR has besides been explored successful in the domain of enactment information successful construction16, radiation extortion training17,18,19, arsenic good arsenic collaborative attraction and installation management20 and metropolis planning21. VR reconstructions of rooms with radiation sources person been utilized for distant inspections and root searches22. In a akin fashion, the usage of AR and VR successful airy cognition studies person shown committedness successful widening our knowing of quality cognition and optimize architecture23. Nonetheless, a caller survey quantified the show erstwhile utilizing a VR instrumentality compared to machine monitors for a spatial knowing task24, and recovered nary important show summation utilizing VR. The envisioned benefits of utilizing XR technologies are truthful not guaranteed.

MR has nevertheless the imaginable to beryllium successfully applied successful fields wherever a idiosyncratic whitethorn payment from a nonstop ocular practice of analyzable information (e.g. surgery, visualizing tumor locations), wherever timeliness of a awesome whitethorn beryllium important (e.g. successful enactment safety, highlighting radiation zones oregon different information hazards), oregon wherever effectual acquisition and grooming tin payment from a caller mode of representing the underlying concepts (e.g. radiation fields different invisible to the quality eye).

Radiation representation mentation requires the conversion of 2D angular accusation into 3D ocular space. MR has the chiseled vantage of eliminating this intelligence step, starring to a nonstop 3D content of the radiation information onto the carnal surroundings. In caller lit this circumstantial exertion is, truthful far, unexplored - yet, arsenic mentioned above, akin cases person been demonstrated successful medicine and enactment safety. MR technologies could truthful alteration non-rad-professionals (e.g., exigency responders, non-specialized equipped forces, researchers successful training) to execute regular radiation monitoring and respond to mishap scenarios.

The nonsubjective of this enactment is to show a real-time MR show of some gamma ray and accelerated neutron images created from H2DPI information successful HoloLens2, arsenic illustrated successful Fig. 1. Hereby we integrate respective cutting borderline technologies, from silicon photomultiplier (SiPM) readout of caller integrated solid scintillator, implicit an optimized information processing and web implementation, to 3D MR show of the data. Our unfastened root implementation (see the Code availability connection below) is based connected Unity, python, and Rust - each readily disposable codification packages. Using Unity specifically implies that our solution is readily translatable to different platforms, specified arsenic smartphones. We showcase the MR presumption for antithetic measurements utilizing 252Cf spontaneous fission and 137Cs gamma ray sources, and qualitatively sermon the advantages and limitations of MR radiation visuals utilizing the H2DPI.

Figure 1
figure 1

(a) Picture of a idiosyncratic wearing the Microsoft HoloLens2. The surface successful the inheritance depicts what the MR instrumentality shows the idiosyncratic - successful this illustration an representation of a blistery spot implicit a barrel. (b) Picture of the (open) handheld dual particle imager (H2DPI), showing the apical of the system.

Results

Radiation representation calculation

An overview of the information pipeline from detector interactions to MR show is shown successful Fig. 2. The H2DPI strategy was acceptable up connected an optical committee to guarantee repeatable positioning, a much elaborate statement of the detector geometry tin beryllium recovered successful the Methods section.

Figure 2
figure 2

Overview of the information processing from particle interactions to MR display. (a) Radiation interactions successful the H2DPI detector strategy are observed via SiPM arrays that are connected to a digitizer. (b) Acquired waveforms are sent to the acquisition PC successful regular intervals implicit an optical wire, wherever they are filtered and sent implicit WiFi to the HoloLens2. (c) The HoloLens2 projects the information into the users tract of view. Single events (d) tin beryllium utilized to estimation full number rates successful each detector (i.e., some neutrons and gamma rays), which amusement a circumstantial signifier depending connected the source’s azimuthal determination (e). The mean number rates per detector are fixed arsenic inputs to a pre-trained neural web (f) that predicts the azimuth of the source, showing an arrow to the user. Double-scatter events successful 2 antithetic detector volumes (g) let for the reconstruction of the detected particle’s incidence cone with opening space \(\alpha\). Subsequent particle classification of the idiosyncratic events successful the integrated solid scintillator (OGS) via pulse signifier favoritism (h) enables the differentiation betwixt neutron-neutron and gamma-gamma incidence cones. A favoritism enactment betwixt the pulse signifier clusters (white) is recovered via fitting a treble Gaussian into each vigor equivalent portion and taking the vale arsenic the determination threshold. Using a backmost projection algorithm the cones are overlaid to make the radiation representation (i) successful angular abstraction (Azimuth \(\Theta\), Altitude \(\Phi\)) for either gamma rays oregon accelerated neutrons. The idiosyncratic is past shown a 3D projection of the representation successful MR.

The H2DPI consists of an array of detectors optimized for imaging, notably done the statement of the lattice of 12 integrated solid scintillator bars for accelerated neutron and gamma-ray detection and 8 CeBr3 inorganic scintillators for photoelectric gamma ray detection. The radiation images are calculated via double-scatter events successful the H2DPI (Fig. 2g), i.e., each waveforms are filtered into lawsuit pairs that fulfill the conditions of having occurred wrong 30 ns of each different successful 2 antithetic detector volumes. These doubles events are past classified via the idiosyncratic lawsuit waveforms into gamma ray oregon accelerated neutron events4 (Fig. 2h), and filtered to lone see neutron-neutron and gamma-gamma doubles. Each double-scatter lawsuit has an associated estimated incidence cone, which are superimposed to conception the alleged elemental backmost projection image3. By utilizing neutron-neutron oregon gamma-gamma events, cumulatively implicit clip a neutron and/or gamma ray representation tin beryllium calculated successful angular abstraction (Fig. 2i).

The digitized waveforms from the detector strategy (Fig. 2a) are sent successful arbitrary batch sizes (typically acceptable to constitute a batch astir each 2 seconds) to the acquisition PC (Fig. 2b). The filtering of the events to double-scatter incidence cones is performed here. Individual cones are past disposable connected a locally hosted server that the HoloLens2 accesses via the wireless web (Fig. 2c). Sending idiosyncratic cones alternatively of images was recovered to trim the wide web strain, allowing for a changeless information watercourse from detector to HoloLens.

Real-time radiation information show successful MR

The MR show successful the HoloLens2 is achieved via respective steps utilizing an exertion written successful the Unity crippled engine25 that runs connected the HoloLens. First the HoloLens is provided the determination of the detector. 3D spatial mapping is simply a basal diagnostic of the HoloLens, and an exertion programming interface (API) provides the spatial representation of the surroundings to the back-end programmer. We further usage the HoloLens API that allows the scanning of QR codes successful abstraction to localize a definite 3D coordinate successful the fixed spatial map. A QR codification is acceptable connected the aboveground of the H2DPI astatine a known presumption comparative to the halfway of the detector strategy (see Fig. 3a,d), enabling the calculation of a notation location.

Simultaneously, the HoloLens uses the section WiFi web to query a server hosted connected the acquisition PC to retrieve the detector data. After receiving the cones, the visualizer performs elemental backmost projection to make the radiation representation texture successful H2DPI space. A pixel shader is past utilized to render the representation onto the spatial mesh. For each pixel connected the spatial mesh, the pixel surface presumption is transformed into the notation coordinates, which are past transformed into H2DPI spherical coordinates, which are utilized to illustration from the radiation image. A colour representation is applied to convey the intensity, creating a colored content of the spatial mesh (that is transparent otherwise). A much aggravated coloring of the mesh would hereby beryllium indicative of a much aggravated radiation representation successful that spatial direction.

On apical of the spatial mesh coloring, we iterate done each pixel successful the backmost projected texture and task a ray from the H2DPI to exemplify the angular quality of the accusation successful the image. If the ray intersects with the spatial mesh, and exceeds a definite threshold, past it draws a enactment betwixt the H2DPI and the spatial mesh. All of the mentioned processing steps typically necessitate little than 1 second, frankincense providing a visually creaseless experience. The show of either rays oregon spatial mesh coloring is disposable to the idiosyncratic done a virtual paper that is located connected their wrist (i.e., erstwhile the user’s wrist is successful the tract of presumption of the HoloLens, a paper appears that has virtual buttons for settings).

As an illustration of the resulting ocular experience, we show pictures taken with the HoloLens depicting 2 experiments successful Fig. 3. In the archetypal example, we hid a 137Cs root nether 1 of 3 caps (Fig. 3a). After astir 30 seconds of acquisition time, the HoloLens displays the colored spatial mesh (Fig. 3b) oregon rays (Fig. 3c) according to the backmost projection image. At immoderate point, the idiosyncratic whitethorn toggle betwixt the show of the gamma ray oregon neutron image. Examples of neutron and gamma ray images are shown successful Fig. 3e,f, successful which we show the MR presumption of an experimental setup utilizing a 252Cf root acceptable successful beforehand of the detection system.

An important facet of the colored shading of the blistery spot is the prime of colormap. We hereby followed the regularisation to usage perceptually azygous sequential colormaps26. We implemented the modular perceptually azygous sequential colormaps utilized successful Matplotlib (viridis, inferno, magma, plasma, cividis)27 arsenic options, that the idiosyncratic tin take successful the virtual menu. The idiosyncratic tin truthful take the due colormap to maximize opposition for a fixed background, oregon to set for a user’s quality to separate colors. For instance, a colormap containing reddish (inferno) connected a greenish inheritance (e.g. grass) whitethorn not beryllium informative to a idiosyncratic with deuteranomaly, and they whitethorn take to power to a yellow/blue based representation (cividis).

Figure 3
figure 3

Examples of the mixed world visuals arsenic seen by the idiosyncratic wearing the HoloLens2. (a) A 100 \(\mu\)Ci 137Cs root is acceptable nether 1 of 3 caps successful beforehand of the detector system. (b) In MR, the idiosyncratic is shown a coloring of the spatial mesh aft astir 30 seconds of acquisition. (c) The idiosyncratic whitethorn optionally take to besides show rays that constituent to the blistery spot. (d) A 1 mCi 252Cf root successful beforehand of the system. (e) The gamma ray representation forms wrong astir 20 seconds. (f) The idiosyncratic tin power to the (simultaneously acquired) neutron representation via a wrist menu. A converged neutron representation that intersects with the expected root determination is seen aft astir 1 minute.

Fast root hunt via neural network

Double-scatter events are uncommon compared to azygous events, and successful galore scenarios a sufficiently converged representation whitethorn not signifier wrong a fixed measurement time. In bid to optimally usher the detector relation successful moving the detector strategy to a person location, we suggest to usage the azygous enactment number rates to foretell the source’s determination rapidly (Fig. 2d), arsenic number rates tin beryllium estimated astatine immoderate constituent successful the measurement. Due to the statement of the detector lattice, we expect a gradient successful the number rates (Fig. 2e, i.e., the detectors that are person to the root person a higher number complaint than the detectors further away, frankincense enabling a statistical learning method to foretell the space of incidence of the radiation).

The number rates per detector are estimated via a rolling mean implicit the waveforms implicit a 1-2 2nd agelong measurement and fixed arsenic input into a trained neural web that outputs an estimated azimuthal determination of the source. We picture the neural web (training information and hyper-parameters) successful the Methods section. In MR, the idiosyncratic is presented with an arrow pointing successful the azimuthal absorption of the prediction.

Figure 4 shows an illustration of the MR visuals for the root absorption estimation for some 137Cs and 252Cf sources. The prediction, owed to the tiny size of the neural net, takes little than 1 2nd and provides the expected result. Uncertainty quantification of the neural network’s predictions are beyond the scope of this study, and we truthful contiguous this effect qualitatively arsenic a impervious of concept. Note that the neural web was trained connected 252Cf simulations, but the predictions were close for some 252Cf and 137Cs experiments. This shows committedness for aboriginal investigations to elucidate the neural web performance, successful peculiar with regards to grooming it connected aggregate sources, aggregate distances, arsenic good arsenic the altitude angle.

Figure 4
figure 4

Examples of the mixed world visuals arsenic seen by the idiosyncratic wearing the HoloLens2 for the accelerated root absorption estimation utilizing a neural net. (a) A 100 \(\mu\)Ci 137Cs root is held successful 3 antithetic locations astir the detector, the MR show shows a yellowish arrow to correspond the neural nets’ guess. (b) A 1 mCi 252Cf root is held astatine antithetic locations astir the detector. The prediction and show of the source’s estimated determination took little than 1 2nd successful each case.

Detection limitations for the existent H2DPI system

Double-scatter events are comparatively uncommon and their occurrence airs the main regulation to achieving a radiation representation that is, by immoderate empirically determined threshold, converged. In Fig. 5 we show the double-scatter lawsuit rates for 252Cf and 137Cs sources for expanding distances to the strategy to exemplify this. With expanding distance, arsenic is evident from the alteration successful azygous lawsuit complaint pursuing astir an inverse quadrate law, we observe a alteration successful double-scatter rates. We further bespeak approximate lawsuit rates that would output a converged representation (arbitrarily defined arsenic 1000 cones, based connected the authors’ experience), showing that the utilized sources tin lone beryllium imaged successful little than 1 hr to convergence wrong a radius of 1 m astir the system. The H2DPI strategy volition successful the aboriginal beryllium upgraded to incorporate up to 64 integrated solid scintillator bars, enhancing the ratio of detection by astir tenfold for neutrons and twenty-fold for gamma rays, alleviating the convergence clip concern4.

The sources we used, however, are comparatively weak. An extrapolation of treble lawsuit rates with enactment is expected to standard linearly, frankincense allowing for predictions for circumstantial scenarios. For example, astir radiation accidents caused by mislaid oregon stolen sources successful the precocious 20th period progressive sources with activities >100 GBq28, frankincense being much than 3 orders of magnitude stronger than the sources we utilized successful this work. A converged representation would hereby, assuming the exemplary acceptable we utilized for the gamma events from 252Cf, beryllium formed wrong 1 infinitesimal astatine much than 10 meters distance, enabling a harmless appraisal of the source’s determination adjacent with the existent system.

Figure 5
figure 5

Double-scatter enactment rates (per minute) with region of the root to the detector strategy for 100 \(\mu\)Ci 137Cs and 1 mCi 252Cf sources. Inverse quadrate instrumentality exemplary fits are shown for illustration, alongside 2 lines that bespeak the clip needed to execute a converged representation (1000 double-scatter events). The mistake bars are often smaller than the marker.

Discussion

Mixed reality: a amended visualization tool?

The herein presented enactment is simply a impervious of conception for the usage of MR successful radiation detection and imaging. We demonstrated the feasibility of utilizing a hand-held detector to make on-the-fly gamma ray and neutron images and root absorption estimates successful MR wrong seconds of their acquisition. This attack is achieved by utilizing respective cutting borderline technologies successful ensemble: a caller integrated solid scintillator coupled to a silicon photomultiplier (SiPM) array for dual particle detection, a detector layout optimized for radiation imaging utilizing double-scatter events, a neural web trained with Monte Carlo information to assistance successful the root localization, and yet MR visualization of the information utilizing the Microsoft HoloLens2. We further explored 2 antithetic visualization styles: a colored spatial mesh and optionally rays pointing towards the estimated root location.

We hereby improved connected respective aspects of caller literature: A erstwhile survey of utilizing an array of NaI detectors for root absorption estimation utilizing a neural web showed precocious accuracy29, yet relied purely connected gamma ray interactions and prediction was performed aft the experiment. Our web was trained for some photons and neutrons and is capable to supply a determination estimation for either benignant of root successful real-time. Other studies showed the MR visualization of radiation blistery spots connected a tablet instrumentality oregon AR utilizing information from Geiger Mueller counters connected a robot30 oregon a UAV31. We physique upon these by demonstrating MR visualization successful real-time, connected a caput mounted device, for some gamma ray and neutron detection. Recent developments for MR applications for wide radiation extortion education32 and operating country radiation awareness17,33 trust connected transport calculations that are past translated to MR visuals - utilizing real-time detector information whitethorn payment from our projected method and supply a much realistic practice of the radiation field. Our implementation is unfastened root (see Code availability connection below) and based connected a wide 3D motor (Unity). This means that our implementation could beryllium translated to different platforms that person basal MR/AR capabilities, specified arsenic smartphones oregon different smart-glass devices.

The main vantage of utilizing MR visualization is the simplified mentation of angular radiation images, i.e., not requiring the idiosyncratic to mentally task the 2D angular blistery spots into 3D directions and plausible root locations. Radiation images tin truthful present beryllium interpreted by untrained individuals, impacting grooming requirements for wide radiation measurements and allowing for flexibility successful task delegation successful clip delicate scenarios.

The MR visualization besides conveys a much realistic size and uncertainty of the radiation images. In interpreting 2D radiation images, the authors themselves consistently underestimated the angular uncertainty erstwhile translating the images into a existent abstraction root location. We recovered that images that we antecedently perceived arsenic converged turned retired to beryllium not capable to find a source’s determination erstwhile viewed successful MR.

MR is, nonetheless, a subjective experience. Qualitatively speaking, we study an wide affirmative effect to the usage of the HoloLens2 successful radiation laboratory demonstrations, pointing astatine worst to enjoyment from axenic novelty, and astatine champion to a genuinely much intuitive instrumentality to visualize radiation. Future enactment truthful requires a much rigorous quantification of the improvements specified arsenic informativeness of the visualization, measured radiation exposure, and perceived betterment successful workflow successful the mentioned exertion scenarios. For instance, the subjective prime of cognition could beryllium evaluated utilizing the Maryland Visual Comfort Scale34. The usefulness of VR/MR technologies should besides beryllium contrasted with intelligence probe connected the conception of beingness MR35 to elucidate wherefore they are useful, thereby perchance aiding successful the guided ideation for aboriginal applications of MR technologies.

Methods

The authors affirm that the depicted individuals provided written consent for the work of the figures and video utilized successful this work.

Handheld dual particle imager (H2DPI)

The H2DPI is simply a detector strategy developed astatine the University of Michigan that consists of an array of 12 integrated solid scintillator bars, (50x6x6) mm3 each, and 8 CeBr3 scintillator cylinders, 6x6 mm3 each, arsenic shown successful Fig. 6. The detector statement is optimized for radiation imaging, utilizing 2 silicon photomultiplier (SiPM) arrays (ArrayJ-60035-64P-PCB SensL) with (6x6x0.5 mm3) EJ-560 optical interfaces3,36 for airy collection. The strategy notably uses dual ended readout and the comparative airy yields per pulse apical versus bottommost to estimation the z-position of a fixed interaction37. The H2DPI was connected via modular BNC and LEMO cables to 2 CAEN V1730S digitzer boards mounted to a CAEN VME8004 powered crate.

Figure 6
figure 6

(a) Picture of the H2DPI with the HoloLens2 connected top. (b) The detector measurement of the H2DPI viewed from the side. (c) X-Y transverse conception schematic of the detectors of the H2DPI. The integrated solid scintillator (OGS) bars are (50x6x6) mm3 successful size. The CeBr3 detectors successful the corners are cylindrical successful signifier (6x6 mm2) successful height, acceptable connected some the apical and bottommost SiPM arrays. Each country has truthful 2 CeBr3 detectors.

Neural web for root absorption estimation

The neural web was constructed utilizing the TensorFlow 2.5 room successful Python 3.8.8. Recently, the palmy exertion of neural nets for this task was shown utilizing arrays of NaI detectors29,38, oregon a azygous measurement HPGe39. The neural web input nodes correspond to the number rates successful each of the 20 detector volumes of the H2DPI. The output furniture is the probability estimation for an azimuthal angle, present discretized by 1\(^{\circ }\) increments into a vector of magnitude 360. The input furniture activation relation was acceptable to relu, whilst the output furniture relied connected softmax.

Training information was produced with the Monte Carlo particle transport codification MCNPX-PoliMi40 that allows for some neutron and photon transport. An explicit exemplary of the detector and casing was created, spot Fig. 7. We simulated 360 root locations, each displaced by 1\(^{\circ }\) increments astatine 30 cm region to the detector, to screen the full azimuthal range. We simulated each angular presumption with 109 spontaneous fissions from a 252Cf constituent source. The 20 detector volumes were tallied for neutron and photon interactions and processed into number rates per detector measurement utilizing the post-processing codification MPPost41.

The 360x20 information sets were past augmented by 100 by sampling Gaussian sound with zero mean and 10% of the counted particles arsenic modular deviation to adhd noisy information to the training, frankincense yielding a information acceptable of 36000x20. Note that the validation accuracy did not converge without the summation of the noisy data.

Training was conducted utilizing randomly shuffled grooming data, a 10% validation bid split, and a categorical cross-entropy nonaccomplishment function. We show an illustration of the detector information with azimuth, arsenic good arsenic accuracy and nonaccomplishment of the exemplary for some grooming information and validation information with grooming iterations (’epochs’) successful Fig. 8. The exemplary was trained astatine archetypal for 1000 epochs, yet a imaginable overfit is seen successful the validation nonaccomplishment summation supra 400 epochs. The last exemplary was frankincense trained for 300 epochs. The grooming and validation information accuracies summation with grooming iterations Fig. 8b) and overfitting is not observed. The last estimated validation accuracy was stated by the programme arsenic 98.8%. Note that adding hidden layers led to overfitting (i.e. a oscillating validation accuracy and validation nonaccomplishment summation with epochs42), which whitethorn necessitate regularization if used.

The MR show uses the best estimation of the neural web (i.e., the output node with the highest value). For example, if node 90 has the highest worth (typically >0.9), past the HoloLens volition show a yellowish arrow into the azimuthal absorption 90\(^{\circ }\).

Figure 7
figure 7

Overview of the grooming information procreation for the root absorption prediction utilizing a neural net. 360 cases of a root astir the detector were simulated utilizing MCNP PoliMi, covering the azimuthal abstraction successful 1\(^{\circ }\) increments. The number rates successful each detector measurement were past extracted alongside the known angular presumption of the root to make a grooming information set. The input nodes of the neural web correspond to the detector volumes, 12 integrated solid scintillators and 8 CeBr3, i.e., a vector of magnitude 20 with relu activation. The output furniture of magnitude 360 is afloat connected (fc) to the input with a softmax activation, denoting the estimated probability for a root being astatine the scale successful degrees.

Figure 8
figure 8

(a) Example of grooming information for neutron and photon interactions per spontaneous fission per root incidence space successful integrated solid oregon CeBr3 detectors. (b) Training and validation accuracy with grooming iterations (’epochs’). (c) Training and validation nonaccomplishment with epochs.

Data availability

Data are disposable done tenable petition to the corresponding writer (O. Pakari, pakari@umich.edu).

References

  1. Marques, L., Vale, A. & Vaz, P. State-of-the-art mobile radiation detection systems for antithetic scenarios. Sensors 21, 1051. https://doi.org/10.3390/s21041051 (2021).

    Article  ADS  Google Scholar 

  2. Sato, Y. & Terasaka, Y. Radiation imaging utilizing an integrated radiation imaging strategy based connected a compact compton camera nether portion 1/2 exhaust stack of fukushima daiichi atomic powerfulness station. J. Nucl. Sci. Technol.https://doi.org/10.1080/00223131.2021.2001391 (2021).

    Article  Google Scholar 

  3. Steinberger, W. M. et al. Imaging peculiar atomic worldly utilizing a handheld dual particle imager. Sci. Rep.https://doi.org/10.1038/s41598-020-58857-z (2020).

    Article  Google Scholar 

  4. Lopez, R. et al. Neutron and gamma imaging utilizing an integrated solid scintillator handheld dual particle imager. Nucl. Instrum. Methods Phys. Res. Sect. A 1042, 167407. https://doi.org/10.1016/j.nima.2022.167407 (2022).

    Article  CAS  Google Scholar 

  5. Tepper, O. M. et al. Mixed world with hololens. Plast. Reconstr. Surg. 140, 1066–1070. https://doi.org/10.1097/prs.0000000000003802 (2017).

    Article  CAS  Google Scholar 

  6. Milgram, P., Takemura, H., Utsumi, A. & Kishino, F. Augmented reality: A people of displays connected the reality-virtuality continuum. In Das, H. (ed.) SPIE Proceedings, https://doi.org/10.1117/12.197321 (SPIE, 1995).

  7. Speicher, M., Hall, B. D. & Nebeling, M. What is mixed reality? In Proceedings of the 2019 CHI Conference connected Human Factors successful Computing Systems, https://doi.org/10.1145/3290605.3300767 (ACM, 2019).

  8. Skarbez, R., Smith, M. & Whitton, M. C. Revisiting milgram and kishino’s reality-virtuality continuum. Front. Virtual Real.https://doi.org/10.3389/frvir.2021.647997 (2021).

    Article  Google Scholar 

  9. Microsoft HoloLens2. https://www.microsoft.com/en-us/hololens/hardware, Accessed Aug 2022.

  10. Navab, N., Blum, T., Wang, L., Okur, A. & Wendler, T. First deployments of augmented world successful operating rooms. Computer 45, 48–55. https://doi.org/10.1109/mc.2012.75 (2012).

    Article  Google Scholar 

  11. Vergel, R. S., Tena, P. M., Yrurzum, S. C. & Cruz-Neira, C. A comparative valuation of a virtual world array and a holoLens-based augmented world strategy for anatomy training. IEEE Trans. Hum. Mach. Syst. 50, 337–348. https://doi.org/10.1109/thms.2020.2984746 (2020).

    Article  Google Scholar 

  12. Dunston, P., Wang, X., Billinghurst, M. & Hampson, B. Mixed world benefits for plan perception. In Proceedings of the 19th International Symposium connected Automation and Robotics successful Construction (ISARC), https://doi.org/10.22260/isarc2002/0030 (International Association for Automation and Robotics successful Construction (IAARC), 2002).

  13. Park, B. J., Hunt, S. J., Nadolski, G. J. & Gade, T. P. Augmented world improves procedural ratio and reduces radiation dose for CT-guided lesion targeting: A phantom survey utilizing holoLens 2. Sci. Rep.https://doi.org/10.1038/s41598-020-75676-4 (2020).

    Article  Google Scholar 

  14. Porpiglia, F. et al. Percutaneous kidney puncture with three-dimensional mixed-reality hologram guidance: From preoperative readying to intraoperative navigation. Eur. Urol. 81, 588–597. https://doi.org/10.1016/j.eururo.2021.10.023 (2022).

    Article  Google Scholar 

  15. Morimoto, T. et al. XR (extended reality: Virtual reality, augmented reality, mixed reality) exertion successful spine medicine: Status quo and quo vadis. J. Clin. Med. 11, 470. https://doi.org/10.3390/jcm11020470 (2022).

    Article  CAS  Google Scholar 

  16. Wu, S., Hou, L., Zhang, G. K. & Chen, H. Real-time mixed reality-based ocular informing for operation workforce safety. Autom. Constr. 139, 104252. https://doi.org/10.1016/j.autcon.2022.104252 (2022).

    Article  Google Scholar 

  17. Loy Rodas, N., Barrera, F. & Padoy, N. See it with your ain eyes: Markerless mobile augmented world for radiation consciousness successful the hybrid room. I.E.E.E. Trans. Biomed. Eng. 64, 429–440. https://doi.org/10.1109/TBME.2016.2560761 (2017).

    Article  Google Scholar 

  18. Süncksen, M., Bott, O. J., Dresing, K. & Teistler, M. Simulation of scattered radiation during intraoperative imaging successful a virtual world learning environment. Int. J. Comput. Assist. Radiol. Surg. 15, 691–702. https://doi.org/10.1007/s11548-020-02126-x (2020).

    Article  Google Scholar 

  19. Lee, D., Lee, B. I., Park, Y. & Kim, D. Application program for radiological vulnerability exemplary utilizing virtual reality–based radiological workout system. Nucl. Eng. Technol. 50, 745–750. https://doi.org/10.1016/j.net.2018.03.009 (2018).

    Article  CAS  Google Scholar 

  20. Ammari, K. E. & Hammad, A. Collaborative BIM-based markerless mixed world model for facilities maintenance. In Computing successful Civil and Building Engineering (2014), https://doi.org/10.1061/9780784413616.082 (American Society of Civil Engineers, 2014).

  21. Zhang, L., Chen, S., Dong, H. & Saddik, A. E. Visualizing toronto metropolis information with HoloLens: Using augmented world for a metropolis model. IEEE Consum. Electron. Mag. 7, 73–80. https://doi.org/10.1109/mce.2018.2797658 (2018).

    Article  Google Scholar 

  22. Sato, Y., Minemoto, K., Nemoto, M. & Torii, T. Construction of virtual world strategy for radiation moving situation reproduced by gamma-ray imagers combined with SLAM technologies. Nucl. Instrum. Methods Phys. Res. Sect. A 976, 164286. https://doi.org/10.1016/j.nima.2020.164286 (2020).

    Article  CAS  Google Scholar 

  23. Chamilothori, K. et al. Subjective and physiological responses to façade and sunlight signifier geometry successful virtual reality. Build. Environ. 150, 144–155. https://doi.org/10.1016/j.buildenv.2019.01.009 (2019).

    Article  Google Scholar 

  24. Hattab, G. et al. Investigating the inferior of VR for spatial knowing successful surgical planning: Evaluation of head-mounted to desktop display. Sci. Rep.https://doi.org/10.1038/s41598-021-92536-x (2021).

    Article  Google Scholar 

  25. Haas, J. K. A past of the unity crippled engine. Diss. Worcest. Polytech. Inst. 483, 484 (2014).

    Google Scholar 

  26. Hattab, G., Rhyne, T.-M. & Heider, D. Ten. elemental rules to colorize biologic information visualization. PLoS Comput. Biol. 16, e1008259. https://doi.org/10.1371/journal.pcbi.1008259 (2020).

    Article  CAS  Google Scholar 

  27. Hunter, J. D. Matplotlib: A 2d graphics environment. Comput. Sci. Eng. 9, 90–95. https://doi.org/10.1109/mcse.2007.55 (2007).

    Article  Google Scholar 

  28. Nénot, J.-C. Radiation accidents implicit the past 60 years. J. Radiol. Prot. 29, 301–320. https://doi.org/10.1088/0952-4746/29/3/r01 (2009).

    Article  Google Scholar 

  29. Durbin, M., Balbier, C. & Lintereur, A. Development of a afloat connected residual neural web for directional gamma ray detection. Int. J. Mod. Phys.: Conf. Ser. 50, 2060010. https://doi.org/10.1142/s2010194520600101 (2020).

    Article  CAS  Google Scholar 

  30. Sato, Y., Minemoto, K. & Nemoto, M. Three-dimensional visualization of a beta-emitting nuclide by combining a directional geiger-mueller antagonistic and operation from motion. J. Instrum. 16, C10008. https://doi.org/10.1088/1748-0221/16/10/c10008 (2021).

    Article  CAS  Google Scholar 

  31. Aleotti, J. et al. Detection of atomic sources by UAV teleoperation utilizing a visuo-haptic augmented world interface. Sensors 17, 2234. https://doi.org/10.3390/s17102234 (2017).

    Article  ADS  Google Scholar 

  32. Caputo, E. et al. Exploiting augmented world and net of things for gamma ray experiments successful acquisition field. In 2021 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), https://doi.org/10.1109/i2mtc50364.2021.9459881 (IEEE, 2021).

  33. Nishi, K., Fujibuchi, T. & Yoshinaga, T. Development of an exertion to visualise the dispersed of scattered radiation successful radiography utilizing augmented reality. J. Radiol. Prot. 40, 1299–1310. https://doi.org/10.1088/1361-6498/abc14b (2020).

    Article  Google Scholar 

  34. Seagull, F. J. et al. A validated subjective standing of show quality: The maryland ocular comfortableness scale. Surg. Endosc. 25, 567–571. https://doi.org/10.1007/s00464-010-1220-x (2010).

    Article  Google Scholar 

  35. Wagner, I. et al. On the relation of beingness successful mixed reality. Presence Teleop. Virt. 18, 249–276. https://doi.org/10.1162/pres.18.4.249 (2009).

    Article  Google Scholar 

  36. Fulvio, A. D. et al. SiPM readout of stilbene crystals for safeguards applications. In 2017 IEEE Nuclear Science Symposium and Medical Imaging Conference (NSS/MIC), https://doi.org/10.1109/nssmic.2017.8532859 (IEEE, 2017).

  37. Giha, N. P. et al. Organic solid scintillator bars with dual-ended readout. Nucl. Instrum. Methods Phys. Res. Sect. A 1014, 165676. https://doi.org/10.1016/j.nima.2021.165676 (2021).

    Article  CAS  Google Scholar 

  38. Fobar, D., Vanderlip, W. J., Koch, W. & Chapman, P. A instrumentality learning attack to a multidetector array effect relation for atomic search. IEEE Trans. Nucl. Sci. 69, 1939–1944. https://doi.org/10.1109/tns.2022.3186831 (2022).

    Article  ADS  CAS  Google Scholar 

  39. Gladen, R. et al. Implementation of a instrumentality learning method for estimating gamma absorption utilizing a coaxial precocious purity germanium detector. Nucl. Instrum. Methods Phys. Res. A: Accel. Spectrom., Detect. Assoc. Equip.https://doi.org/10.1016/j.nima.2022.167067 (2022).

    Article  Google Scholar 

  40. Pozzi, S. A., Padovani, E. & Marseguerra, M. MCNP-PoliMi: A monte-carlo codification for correlation measurements. Nucl. Instrum. Methods Phys. Res. Sect. A 513, 550–558. https://doi.org/10.1016/j.nima.2003.06.012 (2003).

    Article  ADS  CAS  Google Scholar 

  41. Miller, E., Clarke, S., Flaska, M., Pozzi, S. & Padovani, E. Mcnpx-polimi post-processing algorithm for detector effect simulations. JNMM, J. Inst. Nucl. Mater. Manag. 40, 34–41 (2012).

    CAS  Google Scholar 

  42. Goodfellow, I., Bengio, Y. & Courville, A. Deep learning (MIT press, 2016).

    MATH  Google Scholar 

Download references

Acknowledgements

This enactment was supported in-part by the Consortium for Monitoring, Technology, and Verification nether Department of Energy National Nuclear Security Administration grant fig DE-NA0003920. The authors would similar to specifically widen their gratitude to the editor, who provided comments that pb to a greatly improved manuscript.

Author information

Authors and Affiliations

  1. Department of Nuclear Engineering and Radiological Sciences, University of Michigan, Ann Arbor, MI, 48109, USA

    Oskari Pakari, Ricardo Lopez, Ivan Druckman, Emilee Meng, Erik Zhou, Ziang Wang, Shaun D. Clarke & Sara A. Pozzi

  2. Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI, 48109, USA

    Ivan Druckman, Emilee Meng, Erik Zhou & Ziang Wang

Contributions

O.P. wrote the main manuscript, conducted the ceremonial analysis, aided successful the conceptualization, and provided supervision. R.L. provided resources and developed software. O.P., R.L, I.D., E.M., E.Z., and Z.W. conducted the laboratory work. I.D., E.M., E.Z., and Z.W. developed the bundle for the MR visualization. S.P. and S.C. conceived the archetypal idea, acquired funding, aided successful the conceptualization, and edited the manuscript.

Corresponding author

Correspondence to Oskari Pakari.

Ethics declarations

Competing interests

The authors state nary competing interests.

Additional information

Publisher's note

Springer Nature remains neutral with respect to jurisdictional claims successful published maps and organization affiliations.

Supplementary Information

Supplementary Information.

About this article

Verify currency and authenticity via CrossMark

Cite this article

Pakari, O., Lopez, R., Druckman, I. et al. Real-time mixed world show of dual particle radiation detector data. Sci Rep 13, 362 (2023). https://doi.org/10.1038/s41598-023-27632-1

Download citation

  • Received: 12 August 2022

  • Accepted: 02 January 2023

  • Published: 07 January 2023

  • DOI: https://doi.org/10.1038/s41598-023-27632-1

Read Entire Article