AR, VR and MR glasses for surgeons – how augmented reality supports modern medicine

Augmented reality technologies are increasingly entering operating rooms, diagnostic facilities and training centers. AR, MR, VR and XR glasses and headsets can help surgeons analyze medical images, plan operations, navigate instruments, observe patient anatomy and practice complex procedures.

Not all devices work in the same way, however. Some systems support the physician directly during a procedure, while others are used primarily for preoperative preparation, staff training or remote consultation.

AR, VR, MR and XR – how do these technologies differ?
AR – Augmented Reality

AR, or augmented reality, overlays digital information onto a real-world view.
Surgeons can still see the patient, instruments and operating room while simultaneously viewing additional data, such as:

anatomical models,
computed tomography cross-sections,
planned instrument trajectories,
implant positions,
procedure parameters,
information from a navigation system.

AR can reduce the need to constantly turn one's head toward an external monitor.

MR – Mixed Reality
MR, or mixed reality, combines real-world views with digital objects that can be spatially aligned with the patient or operating room equipment.

A model of an organ, bone or lesion can be placed over the patient, next to the operating table or in another convenient location. Users can view it from various angles, reposition it and analyze selected layers.

VR – Virtual Reality
VR, or virtual reality, replaces the real-world view with a digital environment.

In surgery, VR is mainly used for:

training physicians,
simulating procedures,
planning operations,
learning to operate medical devices,
practicing rare or complex procedures.

During an actual operation, completely blocking the physician's view of the real surroundings would usually be dangerous, so conventional VR headsets are more often used outside the operating room.

XR – Extended Reality
XR, or extended reality in the broader sense, is an umbrella term encompassing AR, MR and VR.

In manufacturer materials, XR can refer to both training systems and advanced intraoperative visualization platforms.

How can surgeons use AR and MR glasses?

Head-mounted systems can support surgeons at several stages of treatment.

Preoperative planning

A three-dimensional model of an individual patient's anatomy is created from imaging examinations such as computed tomography or magnetic resonance imaging.

The physician can analyze in advance:

tumor location,
the course of blood vessels,
the relationship of a lesion to healthy tissues,
the best surgical access route,
planned implant placement,
potential risk areas.
Navigation during a procedure

In surgical navigation systems, glasses can display the direction, depth and position of an instrument in relation to patient anatomy.

This does not mean that the headset performs navigation on its own. Glasses are usually only one component of a larger system consisting of:

tracking cameras,
reference markers,
medical software,
a workstation,
surgical instruments,
patient imaging data.
Anatomical visualization

A digital model can show structures that are not directly visible from outside the body.

Depending on the system, physicians can view:

bones,
vessels,
organs,
nerves,
tumors,
planned implant trajectories,
instrument positions.

It should nevertheless be remembered that the image shown in the glasses is not an “X-ray view of the patient in real time.” It is a processed visualization prepared from imaging examinations and a positioning registration system.

Remote consultations and training

Glasses can also transmit the operator's point of view to a specialist outside the operating room.

This can be used for:

remote consultation,
technical support,
observation of procedures by physicians in training,
procedure documentation,
live instruction.
Examples of AR, MR and XR systems for surgeons

 
Augmedics xvision

Augmedics xvision is an augmented reality system intended primarily for navigation in spine surgery.

The surgeon wears a see-through headset and can still see the patient and operative field. At the same time, navigation information about anatomy, instruments and the planned trajectory is displayed before the surgeon's eyes.

The system can support, among other tasks:

screw placement,
controlling instrument direction,
assessing depth,
spatial orientation during open and minimally invasive procedures.

Its main benefit is the ability to view navigation data without constantly shifting one's gaze to an external monitor.

However, xvision is not a standalone pair of glasses. It is a complete medical system including a headset, software, tracking arrangement and navigation equipment.

Medivis SurgicalAR

Medivis SurgicalAR uses augmented and mixed reality to present three-dimensional medical data.

The system can transform information from computed tomography, magnetic resonance imaging and other examinations into interactive models of patient anatomy.

Physicians can view:

bones,
vessels,
organs,
lesions,
medical imaging cross-sections,
images from an endoscope or other devices.

Models can be positioned above the patient, beside the operating table or elsewhere in the room. The platform is being developed, among other areas, for neurosurgery and spine surgery.

Brainlab Spine Mixed Reality Navigation

Brainlab Spine Mixed Reality Navigation combines conventional surgical navigation with the Magic Leap 2 MedTech headset.

The system can display:

3D spine models,
screw entry points,
planned trajectories,
instrument positions,
standard navigation views.

The solution is intended primarily to support pedicle screw placement.

It is important, however, that information presented in the glasses should not be the sole source of navigation data. The surgeon must still use the standard information provided by the certified navigation system.

SentiAR CommandEP

SentiAR CommandEP is a mixed reality platform for cardiac electrophysiology.

During procedures related to heart rhythm disorders, physicians can view a spatial model of the heart and the current position of catheters within its structures.

The data come from electroanatomical mapping systems and are presented as an interactive hologram.

This allows physicians to:

view the heart from different angles,
observe catheter position,
analyze spatial relationships,
manipulate the model without touching nonsterile screens.
Beyeonics One

Beyeonics One is a visualization system intended for ophthalmic surgery.

Instead of looking through a conventional surgical microscope, physicians can use a headset presenting a stereoscopic image of the operative field.

The system can display:

a magnified image of the eye,
a stereoscopic 3D image,
preoperative data,
intraoperative information,
additional parameters and digital overlays.

The solution may improve ergonomics because the surgeon does not need to keep their head in one position at the microscope eyepieces throughout the procedure.

Surgical Theater

Surgical Theater develops XR platforms primarily for neurosurgery and spine surgery.

A 3D model is created from an individual patient's examinations and can be used for:

planning an operation,
analyzing tumor location,
assessing the course of vessels,
virtually rehearsing the procedure,
collaboration among several specialists,
explaining the surgical plan to the patient.

The prepared model can also be used during the operation as an additional spatial visualization.

VR in surgical training

VR technology is particularly useful in education because it allows a procedure to be repeated many times without risk to a patient.

PrecisionOS

PrecisionOS focuses, among other things, on training in orthopedic surgery and the operation of robotic systems.

Users can practice:

successive steps of a procedure,
instrument selection,
implant preparation,
spatial orientation,
decision-making.
Fundamental Surgery

Fundamental Surgery offers VR simulations and solutions working with haptic devices.

Haptics means that the simulated resistance of an instrument, bone or tissue can be felt. Training can therefore involve not only viewing images but also partially reproducing tactile sensations.

Osso VR

Osso VR is a training platform intended for surgeons, operating teams, medical institutions and equipment manufacturers.

It can be used to learn procedures and how to use new implants and medical instruments.

Can ordinary AR glasses be used during surgery?

It is technically possible to use devices such as Vuzix, RealWear, Microsoft HoloLens or Magic Leap for video transmission, communication and displaying instructions.

However, this does not mean that all AR glasses can be used as surgical navigation systems.

In the operating room, important considerations include:

medical device status,
image registration accuracy,
display latency,
digital model stability,
disinfection capability,
compliance with hospital procedures,
patient data security,
integration with imaging systems,
regulatory compliance.

Ordinary industrial glasses may be used for video transmission or consultation but should not automatically be treated as certified medical systems.

Key limitations of the technology

Despite their considerable potential, AR and MR systems still have limitations.

Image accuracy

A digital model must be correctly aligned with the patient's position. Even a small displacement may matter in procedures requiring high precision.

Latency

The image should be updated virtually in real time. Latency may cause discrepancies between actual instrument movement and its displayed position.

Field of view

A field of view that is too small can limit the amount of information shown. Too much information, on the other hand, can distract the surgeon.

Ergonomics

A headset should be light and comfortable enough to be used during procedures lasting many hours.

Hygiene and sterility

The device must be suitable for use in a medical environment. Replaceable covers, protective sleeves or disinfection procedures are often used.

Dependence on the complete system

The glasses are usually only an interface. Without tracking, imaging and suitable software, they do not provide surgical navigation.

Benefits of AR, MR and XR

Properly deployed systems can offer several significant benefits:

easier access to data during a procedure,
less need to look at external monitors,
better spatial orientation,
more accurate planning,
collaboration among multiple specialists,
more effective training,
repeated practice of a procedure,
easier explanation of a surgical plan to a patient.

However, it should not be assumed that using glasses automatically improves the outcome of every operation. Effectiveness depends on the procedure, system quality, operator experience and proper implementation.

Will AR glasses replace monitors and conventional navigation?

At present, most often not.

In many systems, glasses provide an additional way to present information. Conventional monitors, medical imaging and standard navigation remain essential equipment.

AR and MR may reduce the need to turn one's head and improve access to data, but should not replace other verification methods unless the system manufacturer explicitly permits it.

Summary

AR, MR, VR and XR glasses and headsets are already used in surgery, diagnostics, procedure planning and medical training.

The most developed applications currently include:

spine surgery,
neurosurgery,
cardiac electrophysiology,
ophthalmic surgery,
preoperative planning,
VR training and simulations,
remote consultations.

Well-known solutions include Augmedics xvision, Medivis SurgicalAR, Brainlab Spine Mixed Reality Navigation, SentiAR CommandEP, Beyeonics One and Surgical Theater.

Before purchasing or deploying a particular system, verify its intended purpose, medical device status, availability in the relevant market and compliance with applicable hospital and national requirements.


Augmedics xvision

Technology: AR – Augmented Reality
Main application: surgical navigation
Specialty: spine surgery
Use: directly during an operation
Device type: see-through headset
Displayed information: patient anatomy, instrument position, instrument insertion direction and depth
Data source: patient medical imaging and an instrument tracking system
Main benefit: the surgeon can view navigation data without constantly looking away toward a monitor
System components: headset, workstation, tracking system, reference markers, instruments and software
Intended use: open, minimally invasive and percutaneous spinal procedures
Limitation: this is not a standalone pair of glasses, but part of a complete navigation system
Regulatory status: the system has clearances for specified uses in the US market; availability and status in Europe should be confirmed with the manufacturer

Medivis SurgicalAR

Technology: AR and MR – Augmented and Mixed Reality
Main application: visualization, planning and surgical navigation
Specialty: neurosurgery, cranial surgery and spine surgery
Use: before and during an operation
Device type: headset working with a medical platform
Displayed information: models of bones, vessels, organs and tumors, CT and MRI cross-sections and images from medical devices
Data source: computed tomography, magnetic resonance imaging and other patient imaging data
Main benefit: ability to view a three-dimensional model of anatomy in the operating room
Display method: the model can be positioned above the patient, beside the table or elsewhere
Additional applications: virtual monitors, team collaboration and surgical plan analysis
Limitation: accuracy depends on correctly aligning the model with the patient's position
Regulatory status: the manufacturer reports clearances for selected applications; status must be checked separately for each module and market

Brainlab Spine Mixed Reality Navigation

Technology: MR – Mixed Reality
Main application: navigation during spine surgery
Specialty: spine surgery
Use: directly during a procedure
Device type: headset integrated with the Brainlab navigation system
Headset used: Magic Leap 2 in a configuration intended for medical applications
Displayed information: 3D spine models, screw entry points, instrument trajectories and navigation views
Main procedures: planning and placement of pedicle screws
Main benefit: navigation data can be presented directly in the surgeon's field of view
Data source: patient imaging, tracking system and conventional Brainlab navigation
Limitation: the image in the glasses should not be the only source of instrument position information
Safety requirement: standard navigation system views and checks must also be used
Regulatory status: the solution received FDA clearance for specified uses; availability may be limited in individual countries

SentiAR CommandEP

Technology: MR and AR – Mixed and Augmented Reality
Main application: visualization of the heart and catheter position
Specialty: cardiac electrophysiology
Use: during electrophysiology and ablation procedures
Device type: headset displaying an interactive 3D model
Displayed information: three-dimensional model of the heart and the positions of catheters within its structures
Data source: electroanatomical mapping system
Main benefit: the physician can observe spatial relationships inside the heart without obstructing the view of the patient
Controls: ability to rotate, move and analyze the hologram
Practical application: planning and conducting procedures related to heart rhythm disorders
Limitation: the system must be integrated with a compatible mapping system
Regulatory status: the manufacturer describes CommandEP as an FDA-cleared system for specified electrophysiology applications

Beyeonics One

Technology: digital visualization with AR elements
Main application: replacing or supplementing a conventional surgical microscope
Specialty: ophthalmic surgery
Use: directly during eye surgery
Device type: immersive headset connected to a camera system
Displayed information: stereoscopic operative field image, magnification, preoperative data and intraoperative parameters
Image: digital 3D image recorded by the system's cameras
Application: anterior- and posterior-segment eye surgery
Main benefit: the surgeon does not need to look through a conventional microscope's eyepieces throughout the procedure
Ergonomic benefit: ability to maintain a more natural head and torso position
Additional functions: integration of visible-light and infrared images and presentation of additional data
Limitation: the surgeon views a digital image from cameras, so image quality and system latency are crucial
Regulatory status: device status and scope of clearance must be checked for the specific market; FDA listing does not equal full FDA approval of effectiveness

Surgical Theater

Technology: XR, VR and AR
Main application: surgical planning, simulation and visualization
Specialty: neurosurgery and spine surgery
Use: before surgery and for additional visualization during a procedure
Device type: software platform working with headsets and imaging systems
Displayed information: three-dimensional models of the brain, spine, tumors, vessels and other anatomical structures
Data source: imaging examinations of an individual patient
Main benefit: ability to rehearse the planned surgical approach in advance
Preoperative applications: anatomy analysis, selecting an approach, risk assessment and team collaboration
Intraoperative applications: displaying a previously prepared model as an additional source of information
Patient application: easier explanation of the surgical plan and lesion location
Limitation: the model is a reconstruction prepared from earlier examinations, not a direct real-time view inside the body
Regulatory status: the scope of clearances depends on the specific module and application

PrecisionOS

Technology: VR – Virtual Reality
Main application: training and simulation of surgical procedures
Specialty: primarily orthopedic surgery and use of robotic systems
Use: outside the operating room
Device type: training platform using a VR headset and controllers
Training scope: stages of a procedure, instrument selection, working with implants and decision-making
Main benefit: ability to repeat a procedure many times without risk to a patient
Application: training surgeons, operating teams and medical device users
Functions: simulating surgical scenarios and assessing procedure performance
Limitation: the system does not fully reproduce the behavior of real tissues and operating room conditions
Intraoperative use: no
Product nature: a training tool, not a surgical navigation system

Fundamental Surgery

Technology: VR and haptic simulation
Main application: learning and practicing surgical procedures
Specialty: various surgical fields, depending on the available training module
Use: outside the operating room
Device type: VR platform working with headsets and optional haptic devices
Haptics: technology that simulates resistance from instruments, bone or tissue
Training scope: sequence of actions, instrument use, spatial orientation and surgical technique
Main benefit: combining VR images with partially reproduced tactile sensations
Application: surgeon education, team training and demonstration of new procedures
Limitation: haptic sensations are simulated and do not fully reproduce working on real tissue
Intraoperative use: no
Product nature: educational and simulation platform

Osso VR

Technology: VR – Virtual Reality
Main application: surgical training and learning to use medical devices
Specialty: surgery, orthopedics and procedures involving implants or specialist instruments
Use: outside the operating room
Device type: training platform using a VR headset
Training scope: procedure stages, instrument use, implant preparation and team collaboration
Main benefit: ability to standardize and scale training for many users
Audience: surgeons, medical staff, hospitals and medical device manufacturers
Functions: practicing procedures, assessing progress and repeating scenarios
Limitation: the system does not replace practical clinical training or supervision by an experienced operator
Intraoperative use: no
Product nature: a training platform, not a medical navigation system

Vuzix

Technology: AR – Augmented Reality
Main medical application: video transmission, remote consultation and displaying instructions
Specialty: general healthcare and operating room applications
Use: depending on deployed software
Device type: industrial smart glasses
Possible features: camera, video streaming, voice communication, instructions and checklist display
Main benefit: hands-free operation
Application: remote consultations, procedure documentation, training and technical support
Limitation: the glasses alone are not automatically a surgical navigation system
Requirement: medical use depends on software, integration and compliance with facility procedures
Regulatory status: should be assessed for the complete solution, not only the glasses

RealWear

Technology: assisted reality and head-mounted display
Main medical application: remote assistance, communication and access to documentation
Specialty: general applications in medical facilities
Use: during hands-free activities
Device type: rugged head-mounted computer with a small display
Possible features: video transmission, video calls, instruction display and voice control
Main benefit: ability to control the device without touching a screen
Application: consultation, service support, training and communication with an external specialist
Limitation: the device does not precisely overlay an anatomical model on the patient
Navigation use: no, unless it forms part of a separately certified system
Regulatory status: depends on the specific application, software and deployment configuration


15.07.2026
Sources
Augmedics – xvision Spine System
Medivis – SurgicalAR
Brainlab – Spine Mixed Reality Navigation
SentiAR – CommandEP
Beyeonics Vision – Beyeonics One
Surgical Theater – XR platforms
PrecisionOS
Fundamental Surgery
Osso VR
US Food and Drug Administration (FDA) documentation concerning selected systems

glasses for surgeons, AR glasses for surgeons, VR glasses for surgeons, MR glasses for surgeons, XR glasses for surgeons, augmented reality in surgery, mixed reality in medicine, virtual reality in surgery, AR surgical navigation, AR systems in operating rooms, XR technology in medicine, 3D anatomy visualization, VR surgical planning, VR surgical training, surgical simulations, medical holograms, digital surgical navigation, 3D medical imaging, AR computed tomography, AR magnetic resonance imaging, computer-assisted surgery, Augmedics xvision, Medivis SurgicalAR, Brainlab Mixed Reality, SentiAR CommandEP, Beyeonics One, Surgical Theater, PrecisionOS, Fundamental Surgery, Osso VR, Magic Leap 2 MedTech, Microsoft HoloLens in medicine, Vuzix glasses in medicine, RealWear for doctors, AR spine surgery, AR neurosurgery, MR cardiac electrophysiology, AR ophthalmic surgery, remote medical consultation, VR physician training, immersive technologies in medicine, medical headsets, surgical headset, future of surgery, modern medical technologies