The Data Glasses Control the Robot in Surgery

Robotics and Imaging The Data Glasses Control the Robot in Surgery

2026-07-01 From Dipl.-Ing. (FH) Hendrik Härter | Translated by AI 2 min Reading Time

Related Vendors

FAULHABER Drive Systems

tmts2026-ticec-banner-en-2000px (https://www.tmts.tw/en)

Taiwan Machine Tool & Accessory Builders' Association (TMBA)

SIMTOS (Seoul International Machine Tool Show)

In minimally invasive surgery, robotics and imaging merge into a single unit. By combining highly precise robotic systems with data glasses, researchers at the Fraunhofer IWU create a navigation aid that brings patient data in real time directly into the surgeon's field of vision.

Robotic systems that execute the surgeon's motion commands with high precision, in real time, and with millimeter accuracy while filtering out even the finest tremors are already successfully in use in clinics. Now, the combination of this technology with data glasses promises another innovation boost.(Image: University Hospital Leipzig I Lilly Schmidt) — Robotic systems that execute the surgeon's motion commands with high precision, in real time, and with millimeter accuracy while filtering out even the finest tremors are already successfully in use in clinics. Now, the combination of this technology with data glasses promises another innovation boost.
(Image: University Hospital Leipzig I Lilly Schmidt)

Robot-assisted surgery, using systems like Da Vinci, is already standard in modern hospitals. These systems filter the natural tremor of the human hand and enable millimeter-precise movements in the tightest spaces. However, a crucial piece of the puzzle has so far been missing for perfect navigation: the seamless integration of additional information from the body directly into the physician's field of view.

The App as Middleware is the Bridge Between MRI and Data Glasses

The core of the development by the Fraunhofer Institute for Machine Tools and Forming Technology (IWU) and the University Hospital Leipzig (UKL) (Germany) is a specialized app. It serves as the link between high-resolution imaging data, such as from magnetic resonance imaging, and standard virtual reality (VR) hardware.

For developers in medical electronics, the economic aspect is particularly interesting: using consumer hardware significantly reduces system costs. The technological challenge lies in the software architecture, which must precisely overlay patient data onto the real anatomy ("registration") while tracking instruments in real time within the anatomical environment.

Sensor Fusion and Real-Time Tracking

For the overlays to provide real added value to the surgeon, latencies must be minimal. The system visualizes critical structures such as:

The course of nerve pathways (e.g., mandibular nerve),
the exact location of tumor boundaries and vessels,
the drilling directions for implants in real time.

Especially in tumor orthopedics or urology, this enhanced perspective enables the principle of "destroy as much as necessary, but as little as possible." The additional imaging information serves as a guide even when blood or tissue dominates the real view in the surgical field.

New Degrees of Freedom Through Micro-Robotics

In combination with tiny, fully movable joints at the instrument tips, the dexterity of the robots far surpasses that of the human hand. The electronics behind them must translate the surgeon's complex movement commands with high precision and without delay. The goal is intuitive operation using a trained control logic that simplifies complex 3D orientation instead of overloading it with excessive data.

Subscribe to the newsletter now

Don't Miss out on Our Best Content

Business E-mail

Please enter a valid mailadress.

By clicking on „Subscribe to Newsletter“ I agree to the processing and use of my data according to the consent form (please expand for details) and accept the Terms of Use. For more information, please see our Privacy Policy. The consent declaration relates, among other things, to the sending of editorial newsletters by email and to data matching for marketing purposes with selected advertising partners (e.g., LinkedIn, Google, Meta)

Date: 08.12.2025

Naturally, we always handle your personal data responsibly. Any personal data we receive from you is processed in accordance with applicable data protection legislation. For detailed information please see our privacy policy.

Consent to the use of data for promotional purposes

I hereby consent to Vogel Communications Group GmbH & Co. KG, Max-Planck-Str. 7-9, 97082 Würzburg including any affiliated companies according to §§ 15 et seq. AktG (hereafter: Vogel Communications Group) using my e-mail address to send editorial newsletters. A list of all affiliated companies can be found here

Newsletter content may include all products and services of any companies mentioned above, including for example specialist journals and books, events and fairs as well as event-related products and services, print and digital media offers and services such as additional (editorial) newsletters, raffles, lead campaigns, market research both online and offline, specialist webportals and e-learning offers. In case my personal telephone number has also been collected, it may be used for offers of aforementioned products, for services of the companies mentioned above, and market research purposes.

Additionally, my consent also includes the processing of my email address and telephone number for data matching for marketing purposes with select advertising partners such as LinkedIn, Google, and Meta. For this, Vogel Communications Group may transmit said data in hashed form to the advertising partners who then use said data to determine whether I am also a member of the mentioned advertising partner portals. Vogel Communications Group uses this feature for the purposes of re-targeting (up-selling, cross-selling, and customer loyalty), generating so-called look-alike audiences for acquisition of new customers, and as basis for exclusion for on-going advertising campaigns. Further information can be found in section “data matching for marketing purposes”.

In case I access protected data on Internet portals of Vogel Communications Group including any affiliated companies according to §§ 15 et seq. AktG, I need to provide further data in order to register for the access to such content. In return for this free access to editorial content, my data may be used in accordance with this consent for the purposes stated here. This does not apply to data matching for marketing purposes.

Right of revocation

I understand that I can revoke my consent at will. My revocation does not change the lawfulness of data processing that was conducted based on my consent leading up to my revocation. One option to declare my revocation is to use the contact form found at https://contact.vogel.de. In case I no longer wish to receive certain newsletters, I have subscribed to, I can also click on the unsubscribe link included at the end of a newsletter. Further information regarding my right of revocation and the implementation of it as well as the consequences of my revocation can be found in the data protection declaration, section editorial newsletter.