Eclipse MOSAIC News 2021
Fraunhofer FOKUS

Testing Remote-Operated Driving virtually with Eclipse MOSAIC

News from Feb. 26, 2021

The business unit Smart Mobility demonstrates how the open-source simulation environment Eclipse MOSAIC can be used to test and further develop Remote-Operated Driving (ROD).

Remote-Operated Driving is the bridge technology from human towards fully automated driving. In situations outside of the driving capabilities of a highly-automated vehicle, e.g. if data is missing or the autonomous function is unsure to make a certain decision, remote-operation is the key. Also, in other use-cases, remote-operated driving is a helpful technique, e.g. for driving electric car-sharing vehicles to their charging stations, or maneuvering vehicles remotely through a parking garage.

In those use-cases, the vehicle can request a human operator to help solve the local situations remotely. Thereby, sensor information is sent over the low-latency 5G network to the operator who can then decide on the action or trajectory the vehicle should follow. The information the operator receives could be any sensor data from the vehicle, such as camera data, LiDAR data, or already compiled information like detected objects and free space. With Mobile Edge Computing and sensor fusion, the information could be enriched by other vehicles or stationary sensors.

Virtual tests with the open source simulation environment Eclipse MOSAIC allow to further developing ROD. The MOSAIC team in the Smart Mobility business unit uses LiDAR data to represent the driver's view in Eclipse MOSAIC to test ROD. It allows selecting different viewing angles as well as sensor fusion of different perspectives from other vehicles for a holistic environment model. The final result can be seen in this video.

Eclipse MOSAIC has been used to couple the vehicle simulator PHABMACS with the MOSAIC Application simulator, in which a custom application has been deployed providing the operator view. The vehicle simulator PHABMACS is responsible for vehicle dynamics and sensor data, in this case LiDAR data. The message exchange of LiDAR as well as vehicle control data has been simulated by integrating the MOSAIC Cell simulator. In this way, we could analyze the influence of communication properties, e.g. latencies and different connection qualities such as low capacities or packet losses, on the application. For the hybrid test setup with virtual world and real application for the human operators, the whole simulation has to run in real time, which is possible with Eclipse MOSAIC.