Project: #308 Smart Glasses for Improving Mobility of Low Vision People (Phase Two) Progress Report - Reporting Period Ending: March 31, 2021 Principal Investigator: Yang Cai Status: Completed Start Date: July 1, 2020 End Date: June 30, 2021 Research Type: Applied Grant Type: Research Grant Program: FAST Act - Mobility National (2016 - 2022) Grant Cycle: 2020 Mobility21 UTC Progress Report (Last Updated: Sept. 28, 2021, 2:29 p.m.) % Project Completed to Date: 65 % Grant Award Expended: 25 % Match Expended & Document: 25 USDOT Requirements Accomplishments The goals of this project period include improved heads-up display design and bioptic vision algorithms and prototypes. We have worked with a vendor to have the extended data line for the camera so far it can be placed upfront of the glasses. We have designed a smaller head-up display with a beamsplitter in two prototypes. We have prototyped the edge detection algorithm for the embedded computer. We also worked with a local optics lab to manufacture the beamsplitter lens with a metal wireframe. To date, we have mainly worked in digital zooming to simulate the telescope effect. This is not the ultimate solution. So during the next task period, we will research miniature telescope lenses and different designs in order to improve the clarity. We will optimize the size and weight for better usability. In addition to our current tasks, we responded to the call from our collaborator Dr. Paul Freeman, the head of Low-Vision Lab in AGH, to find a solution to help the low-vision patients to do the visual training with bioptic glasses. We prototyped a 3-camera system that can stream live videos from a moving vehicle to the computer at the doctor's office wirelessly. This is timely needed during the pandemic when we follow the social distancing policy and avoid the be in the packed vehcilces. In the next period, we will improve the video clarity, frame rate, and synchronization of multiple video channgels. Impacts The technology for live video streaming from a moving vehicle can be applied to autonomous vehicle development, testing, and traffic management. It also can be used to improve mobility, telework, and telemedicine. It is also a good application of 5G network and wearable video stream devices for public safety. Other The first video streaming test https://youtu.be/QNRDM54bEVU On September 28, 2021, the PI submitted the Invention Disclosure to CMU CTTEC office titled "Holographic AR Glasses for Improving Mobility of Low-Vision Users" Outcomes New Partners Three River Optics Lab, Pittsburgh, PA Issues We are seeking a miniature telescope lens, similar to the telescopic lens on iPhone 12 Pro. We would like to find the OEM for that but we haven't found it yet.