More driving comfort and safety How special cameras and sensors support in the vehicle

A guest post by Dr. Matthias Neundorf* | Translated by AI 6 min Reading Time

Related Vendors

In order for modern vehicles to precisely recognize their surroundings, sensors and cameras play a crucial role. The combination of camera, sensors, and software enhances driving comfort and safety.

Modern Vehicles: They are equipped with cameras and sensors that assist the driver. Software complements the cameras and sensors to analyze, for example, the driver's line of sight.(Image: Kyocera)
Modern Vehicles: They are equipped with cameras and sensors that assist the driver. Software complements the cameras and sensors to analyze, for example, the driver's line of sight.
(Image: Kyocera)

Dr. Matthias Neundorf is the Head of Design Center & BIC at Kyocera Automotive & Industrial Solutions.

Cameras play a central role in modern vehicles. While there are assistance functions like ACC (Adaptive Cruise Control) for which ideally other sensor types such as radar or lidar are used, the use cases for specialized cameras are steadily increasing. They include safety aspects such as detecting pedestrians and cyclists and marking them on the driver's display or head-up display, as well as functions for increased driving comfort. Examples of the latter include rear-view cameras or 360-degree all-around views in parking assistants.

Kyocera offers specialized cameras as well as other semiconductor and electronic components for applications in vehicles. Among the improved hardware features offered is an optimized evaluation cycle in close coordination between Kyocera and the respective OEM. This allows customer feedback to be incorporated from a very early stage of product development, reducing the time from conception to market launch to up to one-third of the previously usual duration.

Specialized camera modules for the automotive industry

Compact camera modules are the eyes of a modern vehicle. For route monitoring, the cameras can identify pedestrians, cyclists, and other road users and objects.
(Image:Kyocera)

The camera modules developed for use in vehicles meet the requirements of the automotive industry. Additionally, their optics and image sensors offer very high resolutions depending on the area of application. As with any type of camera, the achievable overall quality crucially depends on the interplay of the optical components (lens system), electronics hardware (image sensor), and software (for example, image processing or recognition). To deliver the best possible image quality even in difficult lighting conditions such as backlight or twilight, the camera modules work with a very high dynamic range (HDR). Where motion display plays a role, high refresh rates ensure smooth displays.

In addition to hardware, cameras rely on software. This includes spatial and temporal processes as well as analysis software.
(Image:Kyocera)

Kyocera develops and manufactures all relevant technologies in-house. This applies to both the control electronics and the mechanical elements such as camera housings and sensor systems, where the company also leverages its expertise in fine ceramics. On this basis, all necessary hardware and software functions can be provided and customized. This starts with exposure control or color matching and extends to application support in the software. Examples include the display of guide lines in parking assistance systems or object recognition in safety systems.

Specialized camera modules depending on the application

Depending on the application, the range offers specially tailored applications: Camera modules used for route monitoring are optimized for overseeing the area in front of the vehicle. They can identify pedestrians, bicycles, and other road users and objects, enabling the vehicle software to display warnings in the driver's or head-up display in hazardous situations. Exposure control and high dynamic range ensure that recognition accuracy and image quality remain high even in backlight, low sun, or other unfavorable lighting conditions.

Cameras optimized for digital video recorder (DVR) functions are used, for example, to record the traffic situation for potential accident analysis (dashcam function) or for general surveillance of the vehicle's surroundings, such as when cars are parked. These functions are typically networked with other sensors, such as collision detection or proximity and vibration sensors in stationary vehicles. It is important to comply with the respective legal requirements in different target markets—this is typically fulfilled by the vehicle software developed by the OEM themselves.

Monitoring the driver is also playing an increasingly important role in modern cars—for instance, if the driver is inattentive or shows clear signs of fatigue, an appropriate warning should be issued. To implement these functions with high recognition accuracy, eye tracking is integrated into the analysis software, which analyzes the driver's direction of gaze. Driver monitoring systems now significantly contribute to avoiding risky traffic situations and, in the worst case, accidents.

Driver comfort and safety through cameras

E-Mirror camera modules are designed to replace conventional rear and side mirrors, reducing or completely eliminating blind spots.
(Image:Kyocera)

A 360-degree surround view enables advanced parking assistants to provide a clear representation of the entire vicinity of the vehicle on the driver's or central display. The surround view also covers blind spots, thus aiding in confusing parking situations to prevent rear-end collisions or worse. The image geometry is designed so that the software can compose a coherent and recognizable overall display from the individual images of the cameras, enhancing the driver’s perception and ability to navigate and maneuver safely.

Subscribe to the newsletter now

Don't Miss out on Our Best Content

By clicking on „Subscribe to Newsletter“ I agree to the processing and use of my data according to the consent form (please expand for details) and accept the Terms of Use. For more information, please see our Privacy Policy. The consent declaration relates, among other things, to the sending of editorial newsletters by email and to data matching for marketing purposes with selected advertising partners (e.g., LinkedIn, Google, Meta)

Unfold for details of your consent
Even the external mirrors can be replaced by cameras.
(Image:Kyocera)

Kyocera's E-Mirror camera modules are optimized to replace conventional rear-view and side mirrors. In modern, aerodynamically optimized car bodies, this can reduce or eliminate blind spots and improve visibility, for example, when rear passengers or luggage obstruct the driver’s field of view. Additionally, the aerodynamically shaped housings of electronic side mirrors significantly reduce air resistance compared to traditional external mirrors. The automatic adjustment of the camera image to current light conditions, such as during tunnel driving, can also enhance the driver's visibility and prevent glare from other road users.

Traditional backup cameras control exposure and image processing and are capable of recognizing surroundings and objects regardless of available light.
(Image:Kyocera)

The classic backup cameras are also optimized. Exposure control and image processing provide high contrast and recognize the surroundings and objects regardless of the available light. Image geometry and field of view are enhanced for integration with software, which displays guiding and boundary lines and other graphical hints in the camera image in parking assistants. The software functions are provided at the OEM's request and can include additional features such as AI-based object detection and classification. In this case, the camera not only identifies vehicles but also people or pets within its field of view, allowing the software to provide clear warnings to the driver accordingly.

Far-infrared sensors and stereo camera in development

Kyocera is also working on future products and technologies, including Far Infrared (FIR) sensors, which are planned to be introduced to the market in 2025. These types of camera sensors use infrared radiation to detect pedestrians, obstacles, or vehicles at a distance—even in darkness or poor weather conditions. The camera is compact and can be flexibly installed in the vehicle. Potential positions include the grille, in a roof module, or at any other suitable location on the body. In this case, the hardware module includes recognition software that ensures reliable detection of vehicles, people, and objects even in darkness or fog.

Kyocera is also developing a high-resolution stereo camera, which is expected to be introduced to the market in 2025. The stereo principle allows for the detection and differentiation of objects at greater distances as well as smaller objects in close proximity. Thus, this camera is not only suitable for use in cars but can also be integrated into more compact mobility devices such as electric scooters or scooters and used in autonomous robotic systems. (heh)

Cameras in the vehicle

Cameras provide high-resolution images with many details, helping to identify objects, traffic signs, or road markings. Compared to a Lidar system, cameras are more cost-effective. However, despite their advantages, cameras have limited effectiveness in poor light and weather conditions. Therefore, modern vehicles often combine different types of sensors including cameras, radar, and Lidar to enhance detection capabilities and provide reliable performance under various environmental conditions.