Real-Time ADAS Evaluation with MXeval
Objectifying ADAS with MXeval: Real-Time Evaluation in the Vehicle
Advanced Driver Assistance Systems (ADAS) play a crucial role in modern vehicle safety and comfort. But how can their performance be objectively assessed? In collaboration with auto motor und sport, MdynamiX and the IFM at Kempten University of Applied Sciences rely on the powerful MXeval analysis and targeting software. In the last video on our MdynamiX Innovation Portal, we introduced the method of subjective and objective evaluation—now, we take it a step further and demonstrate how real-time evaluation works directly in the vehicle.
Applying the Method and Live Results
A specially prepared test scenario featuring a modern lane-keeping assistant illustrates how the MXeval methodology is applied. Three driver assistance functions were tested:
- Lane-Keeping Assistant
- Active Adaptive Cruise Control
- Automated Parking System
Real-time data analysis allows for instant evaluation and optimization. The system actively intervenes by applying counter-steering torque—this is objectively measured and characterized using the IFM methodology.
Measurement and Real-Time Evaluation
A practical example is the Weave Test: The vehicle is deliberately steered toward the lane boundary and then corrected back into the lane. The measurement starts and stops automatically, enabling engineers to analyze the results in real time while driving.
The evaluation is based on specific Key Performance Indicators (KPIs), ensuring a transparent assessment of ADAS performance. The live data analysis in the vehicle records key parameters such as:
- Steering Torque
- Steering Angle
- Characteristic Steering Force Points
These data points are clearly visualized—including bar charts—providing immediate feedback for further optimization.
Subjective Perception Meets Objective Data
One of MXeval’s key advantages is the ability to correlate test drivers’ subjective impressions with objective measurement data. Using the MXeval app, test drivers can complete questionnaires directly in the vehicle, allowing for an instant comparison with live data. This creates a holistic evaluation, incorporating both engineering insights and real-world driving experiences.
In our next video, we’ll dive deeper into how this correlation works in practice. Stay tuned!