AR-Safe: Improving safety in the construction environment with the use of Augmented Reality

Construction sites are inherently complex and dangerous environments where traditional safety measures often fall short in providing real-time, context-aware information. This project introduces AR-Safe, an innovative Augmented Reality (AR) system prototype developed for the Microsoft HoloLens 2, designed to transform worker safety. By delivering dynamic hazard detection and intuitive visual cues directly within the user's field of view, AR-Safe aims to mitigate risks, enhance awareness, and proactively guide personnel in high-risk zones, making construction safer and more efficient.

Initial situation

The construction industry faces continuous pressure to enhance safety, efficiency, and operational processes on site. The emergence of "digital twins"—real-time digital replicas of physical environments—offers a promising avenue not only for optimizing construction workflows but also for significantly improving safety. Specifically, Augmented Reality (AR) presents a unique opportunity to guide and protect workers by identifying hazards and ensuring compliance with safety regulations. Given that accidents remain a significant concern, especially on complex and large-scale construction sites, AR-enabled digital twins have the potential to revolutionize safety management by providing dynamic, visual cues to workers in real time, guiding them into safe zones and warning them of dangers. The hyperloop test track infrastructure being built by EuroTube provided a crucial real-world environment to explore and test these innovative approaches.

Problem statement / Project goal

Construction sites are inherently dangerous, with safety management often reactive rather than proactive. The primary goal of this project was to transform this approach by integrating Augmented Reality into the digital twin concept for construction sites. This integration aimed to deliver proactive safety measures and context-aware information directly to workers.

In pursuit of this goal, the project specifically addressed two key research questions:

• What non-intrusive AR experiences can we design to effectively communicate safety on a construction site?
• How could the feedback mechanism from a digital twin be implemented in AR within the context of a construction site?

By exploring these questions, the project sought to develop a system that could improve real-time safety, visualize specific safety features, and identify challenges in integrating AR technology into existing construction workflows for safety purposes.

Solution developed and its benefits

The core of this project is the AR-Safe prototype, an Augmented Reality safety system developed for the Microsoft HoloLens 2. This solution transforms traditional construction safety by providing real-time, context-aware information directly within a worker's field of view. It leverages a modular architecture that integrates both physical markers and environmental data to deliver dynamic visual alerts. This system is designed to proactively guide workers away from hazards and provide critical information, significantly enhancing on-site awareness and decision-making.

• The system detects and displays active hazards directly in the worker's environment using AR overlays, such as color-coded zones (red for danger, yellow for caution), hazard icons, and virtual signs.
• Safety information is dynamically presented based on the worker's current location and the proximity to identified risks, ensuring relevance and immediacy.
• Utilizes QR codes for flexible, dynamic hazard identification (e.g., temporary equipment, moving machinery paths) and Wi-Fi-based geolocation for static hazard zones (e.g., restricted areas, excavations), offering robust coverage.
• By simulating hazardous environments and providing immediate visual feedback, the application serves as an invaluable tool for both ongoing safety awareness and immersive training in a "forgiving environment."
• AR overlays are designed to be clear and informative without obstructing the worker's view of the physical environment, ensuring safety communication is effective yet non-distracting.
• Shifts safety protocols from a reactive approach to a proactive one, allowing for immediate mitigation of new or changing dangers on dynamic construction sites.

This AR system bridges the gap between theoretical safety knowledge and practical application, providing accessible and intuitive safety intelligence that directly supports workers in high-risk environments. Its ability to deliver precise, context-specific warnings helps to prevent accidents, improve communication, and streamline coordination across the construction site.

Key terms

• Augmented Reality (AR)A technology that overlays digital information and virtual objects onto the real-world environment.
• Construction SafetyPractices and measures implemented to minimize risks, prevent accidents, and ensure the well-being of workers on construction sites.
• HoloLensMicrosoft's mixed reality headset, utilized as the primary hardware platform for the AR-Safe application.
• Hazard DetectionThe process of identifying potential dangers, unsafe conditions, or risks within an environment.
• Real-time VisualizationThe immediate display of data, information, or virtual elements as events unfold or data is collected.
• Workplace SafetyA broader discipline focused on protecting the health and safety of employees in any work environment, including construction.
• QR CodesTwo-dimensional barcodes used as visual markers that, when scanned, trigger specific actions or retrieve data, employed here for hazard identification.
• Digital TwinA virtual replica of a physical object, system, or environment, designed to reflect its real-time state for monitoring, analysis, and simulation.
• Safety ManagementThe systematic process of planning, organizing, leading, and controlling activities to minimize risks and prevent accidents.

Customer

EuroTube AG
Lorenzo Benedetti
Neugutstrasse 66
8600 Dübendorf
link to the company

Team