The vehicles of the future will not only monitor other road users. Sensors in the car interior will work with AI algorithms to make travel significantly safer and more comfortable for the driver and passengers: “Intelligent image and signal processing, paired with AI-based algorithms, can extract minute changes in intensity or micromovements on the skin and in the entire human body. The signals recorded can be used to determine vital signs such as heart and respiratory rate,” explains Dr. Christian Wiede, head of Embedded AI at Fraunhofer IMS. A person’s respiratory rate is visible, for example, through slight chest movements and can thus be measured, whereas the little-known optical technique of photoplethysmography allows heart rate to be monitored. This technique relies on the heart’s contractions, recording subtle changes to the intensity of light on the skin. These changes, invisible to the eye, can be detected by standard cameras.
Benefits for the transport of tomorrow
In terms of comfort and safety, this development offers many advantages to the transport of tomorrow: By monitoring the vital signs of car, industrial vehicle and train drivers, emergencies can be anticipated and, in best-case scenarios, avoided. Comfort functionalities such as temperature, sound and light controls can also be better tailored to the driver, improving the driving experience.
This kind of camera-based monitoring is contact-free and does not require any active input from the driver. This not only increases comfort, but also acceptance of this type of system. Fraunhofer IMS has developed a modular software library, which facilitates integration into existing vehicle applications and assistance systems. This ensures that integration is possible without relying on car manufacturers or suppliers.
In the future, it will be possible to add further parameters, such as blood pressure, stress symptoms, alcohol intoxication and more to the system.
At IAA MOBILITY, which will take place from September 5–8, 2023, Fraunhofer IMS researchers will be offering an insight into the latest developments. At the joint Fraunhofer booth in Hall B1, Booth D11, a console will show how AI algorithms work with optical sensors to record vital signs such as heart and respiratory rates.
Fraunhofer-Gesellschaft
