Robots recognize transparent and reflective objects: progress through 'goROBOT3D' system

There is more to see Robots can now Detect Previously "Invisible" Objects

2025-06-18 Source: Fraunhofer-IOF | Translated by AI 2 min Reading Time

tmts2026-ticec-banner-en-2000px (https://www.tmts.tw/en)

Taiwan Machine Tool & Accessory Builders' Association (TMBA)

Robots have found it difficult to detect transparent, reflective, or deep black objects as they are so-called uncooperative surfaces. Researchers have now improved the vision of robots.

For the optics of robotic systems, the surfaces of some objects are hardly detectable, and therefore, the objects themselves are not either. However, with AI and special projections, researchers have managed to make the "ghost objects" identifiable...(Image: Fraunhofer-IOF) — For the optics of robotic systems, the surfaces of some objects are hardly detectable, and therefore, the objects themselves are not either. However, with AI and special projections, researchers have managed to make the "ghost objects" identifiable...
(Image: Fraunhofer-IOF)

So-called uncooperative surfaces are difficult for conventional sensor systems to capture. However, researchers at the Fraunhofer Institute for Optics and Precision Engineering (IOF) have overcome this challenge with the "goROBOT3D" system, which recognizes such surfaces through "intelligent" thermal imaging, as it is now reported. They have further developed existing systems for this purpose. The measurement and evaluation time for transparent or deep black objects with the new system could be reduced from the previous 15 to just under 1.5 seconds. For this purpose, IOF also developed a new projection method for thermal 3D sensing.

Diffractive Optical Elements Create Anchor Points

The developed procedure transfers a "Single Shot" technology to thermal 3D measurement technology. In the process, the surface of the measurement scenery is structurally heated. A thermally statistical dot pattern arising on the surface of the objects is emitted and recognized using two thermal imaging cameras. Through spatial cross-correlation, a 3D result can be obtained from the captured image pair, as the researchers from Jena explain. Because instead of previously using stripe projections to generate the pattern, two diffractive optical elements (DOE) now create an irregular dot pattern. Such DOEs use the principle of light diffraction to multiply the incoming laser beam and divide it into a pattern. Through the clever combination of the DOEs, the required dot pattern could be projected onto the transparent object efficiently and for the first time in the shortest possible time.

Dot Pattern Allows Robots to Grip in Milliseconds

The captured 3D data is then analyzed using artificial intelligence (AI). Suitable gripping points and directions are derived and transmitted to a robotic arm with a suction gripper. For this purpose, the researchers employ a so-called "bin-picking" procedure. It can be said that it is essentially a grab into the box, i.e., the targeted picking of chaotically arranged objects. And the drastically shortened recording and evaluation time creates new possibilities for automated industrial processes, for example, in manufacturing plants or product design. Robots can not only safely identify and pick transparent or dark objects but also continue working almost without interruption. And while one object is being handled, the next measurement can already take place.

For those interested: The IOF will showcase this new possibility at the Automatica in Munich from June 24th to 27th in Hall 4.

Subscribe to the newsletter now

Don't Miss out on Our Best Content

Business E-mail

Please enter a valid mailadress.

By clicking on „Subscribe to Newsletter“ I agree to the processing and use of my data according to the consent form (please expand for details) and accept the Terms of Use. For more information, please see our Privacy Policy. The consent declaration relates, among other things, to the sending of editorial newsletters by email and to data matching for marketing purposes with selected advertising partners (e.g., LinkedIn, Google, Meta)

Date: 08.12.2025

Naturally, we always handle your personal data responsibly. Any personal data we receive from you is processed in accordance with applicable data protection legislation. For detailed information please see our privacy policy.

Consent to the use of data for promotional purposes

I hereby consent to Vogel Communications Group GmbH & Co. KG, Max-Planck-Str. 7-9, 97082 Würzburg including any affiliated companies according to §§ 15 et seq. AktG (hereafter: Vogel Communications Group) using my e-mail address to send editorial newsletters. A list of all affiliated companies can be found here

Newsletter content may include all products and services of any companies mentioned above, including for example specialist journals and books, events and fairs as well as event-related products and services, print and digital media offers and services such as additional (editorial) newsletters, raffles, lead campaigns, market research both online and offline, specialist webportals and e-learning offers. In case my personal telephone number has also been collected, it may be used for offers of aforementioned products, for services of the companies mentioned above, and market research purposes.

Additionally, my consent also includes the processing of my email address and telephone number for data matching for marketing purposes with select advertising partners such as LinkedIn, Google, and Meta. For this, Vogel Communications Group may transmit said data in hashed form to the advertising partners who then use said data to determine whether I am also a member of the mentioned advertising partner portals. Vogel Communications Group uses this feature for the purposes of re-targeting (up-selling, cross-selling, and customer loyalty), generating so-called look-alike audiences for acquisition of new customers, and as basis for exclusion for on-going advertising campaigns. Further information can be found in section “data matching for marketing purposes”.

In case I access protected data on Internet portals of Vogel Communications Group including any affiliated companies according to §§ 15 et seq. AktG, I need to provide further data in order to register for the access to such content. In return for this free access to editorial content, my data may be used in accordance with this consent for the purposes stated here. This does not apply to data matching for marketing purposes.

Right of revocation

I understand that I can revoke my consent at will. My revocation does not change the lawfulness of data processing that was conducted based on my consent leading up to my revocation. One option to declare my revocation is to use the contact form found at https://contact.vogel.de. In case I no longer wish to receive certain newsletters, I have subscribed to, I can also click on the unsubscribe link included at the end of a newsletter. Further information regarding my right of revocation and the implementation of it as well as the consequences of my revocation can be found in the data protection declaration, section editorial newsletter.