Real-Time ADAS Evaluation with MXeval
Objectifying ADAS with MXeval: Real-Time Evaluation in the Vehicle
Advanced Driver Assistance Systems (ADAS) play a crucial role in modern vehicle safety and comfort. But how can their performance be assessed objectively? In collaboration with auto motor und sport, MdynamiX and the IFM at Kempten University of Applied Sciences rely on the powerful MXeval analysis and targeting software. In the last video on our MdynamiX Innovation Portal, we introduced the method of subjective and objective evaluation—now, we take it a step further and demonstrate how real-time evaluation works directly in the vehicle.
Applying the Method and Live Results
A specially prepared test scenario featuring a modern lane-keeping assistant illustrates how the MXeval methodology is applied. Three driver assistance functions were tested:
- Lane-Keeping Assistant
- Adaptive Cruise Control
- Automated Parking System
Real-time data analysis allows for instant evaluation and optimization. The system actively intervenes by applying counter-steering torque—this is objectively measured and characterized using the IFM methodology.
Measurement and Real-Time Evaluation
A practical example is the in-lane Weave Test: The vehicle is deliberately steered toward the lane boundary and then corrected back into the lane. The measurement is started and stopped by the driver so that the engineers can view the results immediately after the maneuver.
The evaluation is based on specific Key Performance Indicators (KPIs), ensuring a transparent assessment of ADAS performance. In a live data analysis in the vehicle, the following signals, among others, are recorded and values calculated:
- Steering Torque
- Steering Angle
- Characteristic Steering Torque Points
These data points are clearly visualized—including bar charts—providing immediate feedback for further optimization.
Subjective Perception Meets Objective Data
One of MXeval’s key advantages is the ability to correlate test drivers’ subjective impressions with objective measurement data. Using the MXevalApp, test drivers can complete questionnaires directly in the vehicle, allowing for an instant comparison with live data. This creates a holistic evaluation, incorporating both engineering insights and real-world driving experiences.
In our next video, we’ll dive deeper into how this correlation works in practice. Stay tuned!