Neurosymbolic planning using natural language communication for cooperative autonomous vehicles

What if that neighboring vehicle could simply tell your car, “Vehicle merging from the right, about 15 meters away, moving quickly.”

This simple idea of cars helping each other by describing what they see in natural language motivates UNCAP, our new framework for cooperative autonomous driving.

UNCAP teaches autonomous vehicles both who to talk to as well as how much to trust what they hear.

In reality, with the rise of autonomous driving, the roads are instead observing a mixture of manufacturers, sensor configurations, and heterogenous software stacks.

Read the paper in full UNCAP: Uncertainty-Guided Neurosymbolic Planning Using Natural Language Communication for Cooperative Autonomous Vehicles, Neel P. Bhatt, Po-han Li, Kushagra Gupta, Rohan Siva, Daniel Milan, Alexander T. Hogue, Sandeep P. Chinchali, David Fridovich-Keil, Zhangyang Wang, Ufuk Topcu.