Humanoids Put to the Test

Robotics Humanoids Put to the Test

2026-05-29 Source: Pressemitteilung | Translated by AI 3 min Reading Time

Related Vendors

dataTec AG

tmts2026-ticec-banner-en-2000px (https://www.tmts.tw/en)

Taiwan Machine Tool & Accessory Builders' Association (TMBA)

SIMTOS (Seoul International Machine Tool Show)

To use humanoid robots in industrial applications, they must meet application-relevant criteria. The Fraunhofer IPA has developed a benchmark that allows manufacturers and end-users to analyze humanoids in terms of energy efficiency, cleanroom suitability, and data security.

As part of the benchmark, the ability of humanoids to self-stabilize is examined through movements with various walking paths on a ramp.(Image: Image: Fraunhofer IPA/Rainer Bez) — As part of the benchmark, the ability of humanoids to self-stabilize is examined through movements with various walking paths on a ramp.
(Image: Image: Fraunhofer IPA/Rainer Bez)

Humanoid robots fascinate with their human-like appearance. However, there is a significant gap between spectacular staging and actual capabilities. "For end users as well as manufacturers, a look behind the facade sometimes built by marketing agencies is essential," explains Simon Schmidt, Head of Automated Systems at Fraunhofer IPA. "The market is too volatile and non-transparent to reliably assess and evaluate humanoids for individual applications."

The Fraunhofer Institute for Manufacturing Engineering and Automation IPA has therefore developed a comprehensive benchmark for the standardized analysis of humanoid robots. The modular benchmark covers six application-relevant criteria and is based on internationally recognized industry standards.

Aligned with Industry Standards

The modular structure of the benchmark allows manufacturers, end-users, and software providers to specifically test the areas relevant to their application. Where possible, the benchmarking aligns with established and internationally recognized industry standards that have been in place for decades – for example, ISO 14644 for cleanroom suitability or ISO 10218 and ISO TS 15066 for functional safety.

The benchmark is divided into six key areas:

1. Technologies and Basic Capabilities: Examination of installed sensors, AI models, gripper types, as well as tests on walking speed, gripping forces, and manageable loads. Objective measurements are recorded using a 3D tracking system and force sensors.

2. Complex Capabilities: Evaluation of practical generic tasks such as climbing stairs, overcoming obstacles, movement and force precision, as well as reaction speed. The tests are intentionally designed to be challenging to allow comparability with future model generations.

3. Cleanroom Suitability: Evaluation of particle emission according to ISO 14644-14, outgassing behavior, and cleanability—crucial for use in the semiconductor, pharmaceutical, or food industries.

4. Functional Safety: Central to human-robot collaboration. Stability on various surfaces, force limitation during collisions, obstacle detection, and system behavior in case of failures are tested. Collision tests are conducted using the same force sensors as for collaborative industrial robots.

5. Cybersecurity: Four modules examine vulnerability management, secure lifecycle, network security, and penetration resistance—a critical factor given the increasing legal requirements.

6. Energy Efficiency: Measurement of battery life and power consumption in various scenarios (standing, walking, walking with incline and load). The results enable realistic deployment planning and optimization of charging cycles.

Benchmark Already successfully Applied

Using the Unitree G1 as an example, Fraunhofer IPA applied the benchmark comprehensively for the first time. The technical basis was a Unitree G1 EDU-4 with Dex3-1 3-finger hands and firmware version 1.04, delivered in May 2025. While the robot demonstrated good self-stabilization and potential suitability for ISO Class 5 cleanrooms, significant limitations were also revealed. During collisions, forces exceeding 500 Newtons can occur—far above the pain thresholds permitted by standards. Additionally, researchers identified a critical Bluetooth security vulnerability in the software version available at the time of testing, which allowed complete remote control by attackers. This vulnerability has since been resolved. In terms of energy efficiency, maximum operating times were shown to be 2 hours and 49 minutes on a single charge while standing, and 1 hour and 49 minutes in a typical scenario involving both standing and walking.

"Users can directly interpret the results and thus find the right humanoid for the right application," emphasizes Werner Kraus, head of research at the Fraunhofer IPA. The benchmark makes humanoids comparable not only with each other but also with proven automation components. This is particularly important because:

Subscribe to the newsletter now

Don't Miss out on Our Best Content

Business E-mail

Please enter a valid mailadress.

By clicking on „Subscribe to Newsletter“ I agree to the processing and use of my data according to the consent form (please expand for details) and accept the Terms of Use. For more information, please see our Privacy Policy. The consent declaration relates, among other things, to the sending of editorial newsletters by email and to data matching for marketing purposes with selected advertising partners (e.g., LinkedIn, Google, Meta)

Date: 08.12.2025

Naturally, we always handle your personal data responsibly. Any personal data we receive from you is processed in accordance with applicable data protection legislation. For detailed information please see our privacy policy.

Consent to the use of data for promotional purposes

I hereby consent to Vogel Communications Group GmbH & Co. KG, Max-Planck-Str. 7-9, 97082 Würzburg including any affiliated companies according to §§ 15 et seq. AktG (hereafter: Vogel Communications Group) using my e-mail address to send editorial newsletters. A list of all affiliated companies can be found here

Newsletter content may include all products and services of any companies mentioned above, including for example specialist journals and books, events and fairs as well as event-related products and services, print and digital media offers and services such as additional (editorial) newsletters, raffles, lead campaigns, market research both online and offline, specialist webportals and e-learning offers. In case my personal telephone number has also been collected, it may be used for offers of aforementioned products, for services of the companies mentioned above, and market research purposes.

Additionally, my consent also includes the processing of my email address and telephone number for data matching for marketing purposes with select advertising partners such as LinkedIn, Google, and Meta. For this, Vogel Communications Group may transmit said data in hashed form to the advertising partners who then use said data to determine whether I am also a member of the mentioned advertising partner portals. Vogel Communications Group uses this feature for the purposes of re-targeting (up-selling, cross-selling, and customer loyalty), generating so-called look-alike audiences for acquisition of new customers, and as basis for exclusion for on-going advertising campaigns. Further information can be found in section “data matching for marketing purposes”.

In case I access protected data on Internet portals of Vogel Communications Group including any affiliated companies according to §§ 15 et seq. AktG, I need to provide further data in order to register for the access to such content. In return for this free access to editorial content, my data may be used in accordance with this consent for the purposes stated here. This does not apply to data matching for marketing purposes.

Right of revocation

I understand that I can revoke my consent at will. My revocation does not change the lawfulness of data processing that was conducted based on my consent leading up to my revocation. One option to declare my revocation is to use the contact form found at https://contact.vogel.de. In case I no longer wish to receive certain newsletters, I have subscribed to, I can also click on the unsubscribe link included at the end of a newsletter. Further information regarding my right of revocation and the implementation of it as well as the consequences of my revocation can be found in the data protection declaration, section editorial newsletter.

- demographic change necessitates the use of automation in previously manual areas;

- significant investment decisions require solid, objective evaluation criteria;

- safety standards for humanoids are not expected until 2028 (ISO 25785-1);

- regulatory requirements for cybersecurity are increasing;

- sensitive production environments require reliable data for contamination prevention.

The Fraunhofer IPA plans to test more humanoids and build a comparison database. Manufacturers and users can now commission individual benchmark modules up to comprehensive examinations and benefit from the existing infrastructure and expertise.