Project: #342 Training Drivers to Automated Vehicles Progress Report - Reporting Period Ending: March 31, 2021 Principal Investigator: Helen Loeb Status: Active Start Date: July 1, 2020 End Date: June 30, 2021 Research Type: Applied Grant Type: Research Grant Program: FAST Act - Mobility National (2016 - 2022) Grant Cycle: Mobility21 - University of Pennsylvania Progress Report (Last Updated: April 13, 2021, 4:07 a.m.) % Project Completed to Date: 75 % Grant Award Expended: 75 % Match Expended & Document: 0 USDOT Requirements Accomplishments This project aims at developing methods and tools to help drivers of all ages and abilities comprehend and trust Automated Vehicle Technology. According to a survey developed by the PAVE campaign in March 2020 (https://pavecampaign.org/pave-poll-americans-wary-of-avs-but-say-education-and-experience-with-technology-can-build-trust/), 48% of Americans say they would "never get into a taxi or ride-share vehicle that was being driven autonomously". Specifically, this project's goal is to develop an Immersive Mixed Reality driving simulator that can provide a safe stationary platform where drivers of all ages and skills can have a first hand experience and learn what to expect before they go on road. Under these goals and through a collaboration between the University of Pennsylvania and Jitsik LLC, two prototypes were developed: a chair simulator which has a small footprint, and a car simulator where an actual car is retrofitted with equipment to provide a realistic immersive environment. The project is articulated in two years. In this first year, progress has been made on the hardware and software of the driving simulator. On the hardware side, prototypes were assembled, and sensors were acquired to retrofit a Toyota Prius into a driving simulator. On the software side, Unity3D was used to develop scenarios. This project has provided strong opportunities for professional development. Eight students (4 from the University of Pennsylvania and 4 from Drexel University) have worked on this project through hands on opportunities in mechanical engineering, instrumentation, control, perception, Virtual Reality scenario design. Results are being disseminated through a combination of scientific papers (one submitted to TRB, 3 other papers in progress) and outreach material (4 blogs were written by students about their work and posted online). Before the next reporting period, we intend to calibrate current software and test to ensure it can provide solid ground for a pilot with participants. In addition, we intend to work with the IRB of the University of Pennsylvania to prepare for that pilot. Impacts Our work is especially suited for technology transfer as it is a collaboration between the University of Pennsylvania and a start-up company Jitsik LLC. The company rents a garage a mile away from Penn and provides lab space for experimentation on a real car (Toyota Prius). While academic research is conducted by UPenn researchers and students, outreach is conducted as a day to day operation of the startup (e.g. contacts with potential customers such as driving schools or dealerships), dissemination through social media etc, field stake holders (PAVEcampaign...), business contacts and investors. Of note, a meeting with leaders of Autoware is in the works for its potential in acedemic but also business opportunities. Finally, a pre-existing patent, property of Jitsik LLC will ensure Intellectual Property stays within this project. Our work in cutting edge technology such as Virtual Reality and Mixed Reality might be a vector for further patents. Our goal is to make driving simulation ubiquitous by lowering its cost and increasing its teacvhinh power through complete immersion. In addition, our academic work contributes to the body of scientific knowledge through the development of scientific papers and participation to conferences. A paper was submitted to TRB, 3 additional papers are in the work and will provide an opportunity for first author to two graduate students from the University of Pennsylvania. Other Results of the partnership between the University of Pennsylvania and the JITSIK LLC startup are published in scientific media but also social media for outreach. - The website www.jitsik.com leverages a facebook group, an instagram, a twitter account, a linkedin account that are used to disseminate information about the project. Videos can also be posted on a youtube account. https://www.youtube.com/watch?v=S_ylWJXGNkE - Four blogs were written by student from Drexel University and the University of Pennsylvania: https://www.linkedin.com/company/33202653/admin/ Using Unity 3D for solid engineering applications by Allen Wu Using Augmented Reality Technology for driving simulation by Amine Mrad The DriveRight project: HMI for self-driving by Zhijie Qiao Transitioning to a world of autonomous vehicles by Venkata Gurrala Of note, a pre-existing non-provisional patent, property of Jitsik LLC is currently under review. We are planning to develop educational aid through a pilot in Year 2. Outcomes New Partners A background activity of this research project is the presentation to stake holders of all sorts, especially as it relates to the business development of the startup: - contacts for STTR, SBIR development (Clemson University) - contacts for new academic partnerships (Villanova University) - contacts for business (Autoware) - contacts for marketing (SafeDrivingCoach.com, Mike Peretz marketing...) We hope to develop in Year 2 a solid video of prototype that can help further our deployment goals. Issues The COVID pandemic has resulted in a slower development as the Jitsik lab could not be used for development at the height of the pandemic. While progress could be made by students who borrowed hardware and worked from home, other development was slowed down such as the development of the car simulator (required the lab). In addition, it became clear as the pandemic extended over a long period of time that clinical trials could not take place in Year 1. We have focused on the engineering development and are currently developing the IRB protocol that will be needed in Year 2 for a pilot of participants. As far as budget is concerned, we are on target.