Login

Project

#12 Prediction and Behaviors for Driver Assistance and Socially Cooperative Autonomous Driving


Principal Investigator
John Dolan
Status
Completed
Start Date
Jan. 1, 2017
End Date
Aug. 31, 2018
Project Type
Technology Transfer - Commercialization
Grant Program
MAP-21 TSET National (2013 - 2018)
Grant Cycle
2017 TSET UTC
Visibility
Public

Abstract

This project will develop social behaviors for autonomous freeway driving. Human drivers signal their intentions to one another in various ways, including adjustments in speed and acceleration. We will refine previously developed intention prediction models and couple them with host-vehicle strategy generation methods to improve the performance and realism of autonomous vehicles interacting with other freeway traffic in a wide range of scenarios, with a primary emphasis on entrance/exit ramp handling and secondary emphasis on lane changing. The developed algorithms will be tested on CMU’s autonomous Cadillac SRX and, if possible, on relevant vehicles in GM’s continuing vehicle autonomy projects. Relevance to safety is twofold: use of such algorithms 1) in driver assistance systems to convey to drivers the intentions of surrounding cars; 2) in autonomous cars to provide less “robotic” and more natural, predictable, and socially comfortable driving.    
Description
Introduction
This project will develop social behaviors for autonomous freeway driving. Human drivers signal their intentions to one another in various ways, including adjustments in speed and acceleration. We will refine our intention prediction models and couple them with host-vehicle strategy generation methods to improve the performance and realism of autonomous vehicles interacting with other freeway traffic in a wide range of scenarios, with a primary emphasis on entrance/exit ramp handling and secondary emphasis on lane changing. The developed algorithms will be tested on CMU’s autonomous Cadillac SRX and, if possible, on relevant vehicles in GM’s continuing vehicle autonomy projects.

Problem statement
Relatively little work has been done in creating autonomous driving behaviors that are socially acceptable. Drivers typically communicate or negotiate with one another through a variety of sometimes subtle clues. In earlier work, we have extended the rule-based behaviors approach used in the DARPA Urban Challenge race to a prediction-and-cost-function-based (PCB) approach that covers a wider range of scenarios. We have also performed initial work on prediction intention of other drivers (intention or iPCB), but this work is in its initial stages and has significant scope for improvement. 

Approach
The proposed work will use Probabilistic Graphical Models (PGM) to probabilistically model and predict the intentions of other drivers. PGM is a powerful tool which allows coherent expression and straightforward simplification of the dependencies among random variables in complex systems. Initial results have enabled improvements over the iPCB method mentioned above. Further work will focus on extensions of the current PGM representation, followed by validation in simulation and on real vehicles.

Tasks
a.	Refine current algorithms with better intention estimation using Probabilistic Graphical Models (PGM). 
b.	Refine the PGM algorithm to handle multiple vehicles on an entrance ramp.
c.	Improve and analyze the PGM algorithm’s robustness to perception inputs and map errors. Define appropriate perception requirements. 
d.	Collect human driving data in order to evaluate the realism of the PGM algorithm in relevant environments and tune its parameters.
e.	Test the PGM algorithm in the freeway driving domain with a focus on entrance ramp behaviors, but including also freeway distance keeping and lane changing. Improve and analyze the algorithm’s robustness to perception inputs.
Timeline
Duration: 20 months (Jan. 1, 2017 – Aug. 31, 2018)
High-level schedule:
	Aug. 31, 2017: Refined algorithm with better intention estimation via PGM 
        Jan. 31, 2018: Human driving data collection
	July 31, 2018: Implementation and validation on CMU’s Cadillac SRX
	Aug. 31, 2018: Final report, documentation of hardware/software
Strategic Description / RD&T

    
Deployment Plan
1.	Validate a basic capability to perform socially cooperative driving during the course of the proposed project.
2.	Begin to transition this capability to GM R&D through the technology transfer mechanism already in place via the GM-CMU Autonomous Driving Collaborative Research Lab (AD-CRL).
3.	The technology can then be matured through GM’s proven processes to the point that it may become suitable for deployment on passenger vehicles.
Expected Outcomes/Impacts
Accomplishments
•	Creation of a socially cooperative behaviors system with significant safety benefits via driver assistance and inclusion in autonomous driving algorithms
•	Validation of the system in simulation and on-road driving
•	Documentation of the results in a form appropriate for hand-off to a partner capable of full-scale deployment

Metrics
•	Achieve 90% accurate prediction of neighboring drivers’ entrance ramp, distance keeping, and lane changing maneuvers
•	Achieve smooth and comfortable autonomous driving response to such maneuvers
Expected Outputs

    
TRID


    

Individuals Involved

Email Name Affiliation Role Position
jmd@cs.cmu.edu Dolan, John Robotics Institute PI Faculty - Research/Systems
chiyud@andrew.cmu.edu Dong, Chiyu Robotics Institute Other Student - PhD

Budget

Amount of UTC Funds Awarded
$127500.00
Total Project Budget (from all funding sources)
$127500.00

Documents

Type Name Uploaded
Publication Intention Estimation for Ramp Merging Control in Autonomous Driving March 30, 2018, 1:12 p.m.
Publication Lane-Change Social Behavior Generator for Autonomous Driving Car by Non-Parametric Regression in Reproducing Kernel Hilbert Space March 30, 2018, 1:12 p.m.
Publication Interactive Ramp Merging Planning in Autonomous Driving: Multi-Merging Leading PGM (MML-PGM) March 30, 2018, 1:12 p.m.
Progress Report 12_Progress_Report_2018-03-30 March 30, 2018, 1:19 p.m.
Publication Smooth Behavioral Estimation For Ramp Merging Control In Autonomous Driving Sept. 28, 2018, 8:23 a.m.
Progress Report 12_Progress_Report_2018-09-30 Sept. 28, 2018, 8:25 a.m.
Final Report 12_Dolan_-_UTC_Final_Report.pdf Oct. 31, 2018, 5:54 a.m.
Publication A data-driven behavior generation algorithm in car-following scenarios April 19, 2021, 6:19 a.m.
Publication Lane-change intention estimation for car-following control in autonomous driving April 19, 2021, 6:21 a.m.
Publication Learning Vehicle Surrounding-aware Lane-changing Behavior from Observed Trajectories April 19, 2021, 6:22 a.m.
Publication Smooth behavioral estimation for ramp merging control in autonomous driving April 19, 2021, 6:23 a.m.
Publication Attention-based hierarchical deep reinforcement learning for lane change behaviors in autonomous driving April 19, 2021, 6:25 a.m.
Publication Learning on-road visual control for self-driving vehicles with auxiliary tasks April 19, 2021, 6:26 a.m.
Publication Interactive trajectory prediction for autonomous driving via recurrent meta induction neural network April 19, 2021, 6:28 a.m.
Publication Hierarchical reinforcement learning method for autonomous vehicle behavior planning April 19, 2021, 6:29 a.m.
Publication FG-GMM-based Interactive Behavior Estimation for Autonomous Driving Vehicles in Ramp Merging Control  April 19, 2021, 6:30 a.m.
Publication Human Driver Behavior Prediction based on UrbanFlow* April 19, 2021, 6:31 a.m.
Publication Measuring Similarity of Interactive Driving Behaviors Using Matrix Profile April 19, 2021, 6:32 a.m.
Publication Safe Trajectory Planning Using Reinforcement Learning for Self Driving April 19, 2021, 6:33 a.m.
Publication Trajectory Planning for Autonomous Vehicles Using Hierarchical Reinforcement Learning April 19, 2021, 6:34 a.m.
Publication Behavior Planning at Urban Intersections through Hierarchical Reinforcement Learning April 19, 2021, 6:35 a.m.
Publication Learning to Robustly Negotiate Bi-Directional Lane Usage in High-Conflict Driving Scenarios April 19, 2021, 6:42 a.m.

Match Sources

No match sources!

Partners

No partners!