Sensor simulation Scalable platform simulates and tests sensors

From | Translated by AI 2 min Reading Time

Nvidia offers the Omniverse Cloud Sensor RTX, a platform for realistic and physically precise sensor simulations in virtual environments. This could not only reduce development costs.

A scalable sensor platform simulates physically precise virtual environments. Roretellix and MathWorks are already using it to develop autonomous vehicles.(Image: Nvidia)
A scalable sensor platform simulates physically precise virtual environments. Roretellix and MathWorks are already using it to develop autonomous vehicles.
(Image: Nvidia)

Sensors collect data from the real world and algorithms transform this data into information. It does not matter where the data comes from. Sensors are a billion-dollar growth market and play a crucial role in autonomous vehicles, humanoid robots, industry, or mobile robots. But before physical sensors are used, developers rely on simulation. Here, Nvidia supports with a suite of microservices: Ominiverse Cloud Sensor RTX.

With this approach, Nvidia aims to significantly accelerate the development of fully autonomous machines by providing realistic and scalable virtual test environments. Omniverse Cloud Sensor RTX enables developers to test sensor perception and associated AI software in physically accurate, realistic virtual environments. The underlying technology is based on the OpenUSD framework and uses Nvidia's RTX ray tracing and neural rendering techniques. By combining real video, camera, radar, and lidar data with synthetic data, developers can conduct comprehensive and realistic tests.

A digital image of the real world

"The development of safe and reliable autonomous machines powered by generative physical AI requires training and testing in virtual worlds based on physics," says Rev Lebaredian, vice president of Omniverse and simulation technology at Nvidia. According to Lebaredian, developers can create digital twins of factories, cities and even the Earth.

The Omniverse Cloud Sensor RTX can be used in a variety of scenarios. For example, it can simulate the operation of a robot arm, the movement of a luggage carousel at the airport, or the presence of an obstacle on a roadway. Even with limited access to real data, the microservices help to accurately simulate a variety of activities.

Collaboration and availability

Foretellix and MathWorks have already gained access to Nvidia's Omniverse Cloud Sensor RTX. They are developing autonomous vehicles with it. The collaboration is intended to enable sensor manufacturers to validate and integrate digital twins of their sensors in virtual environments. This reduces the time and cost of physical prototyping.

(heh)

Subscribe to the newsletter now

Don't Miss out on Our Best Content

By clicking on „Subscribe to Newsletter“ I agree to the processing and use of my data according to the consent form (please expand for details) and accept the Terms of Use. For more information, please see our Privacy Policy. The consent declaration relates, among other things, to the sending of editorial newsletters by email and to data matching for marketing purposes with selected advertising partners (e.g., LinkedIn, Google, Meta)

Unfold for details of your consent