Abstract
We propose a Digital Twin system that integrates cyber-physical simulation models (e.g. flood dynamic model in Pittsburgh Downtown area) with the live or historical IoT data. The system can be used for real-time operation and off-line training for emergency traffic management. It is portable and can run on a laptop, AR/VR device, or a stereo projector. We will test our prototype with our partners in UPMC EMS and the Fire Academy.
Description
The need for emergency traffic management has grown rapidly due to extreme weather caused by climate change, fire, flood, traffic accidents, special events, and mass shootings. Traffic Management Center (TMC) plays essential roles in daily mobility and Emergency Support Functions (ESF). They are centralized with a massive amount of live data. Here we propose a Digital Twin system that integrates cyber-physical simulation models (e.g. flood dynamic model in Pittsburgh Downtown area) with the live or historical IoT data. The system can be used for real-time operation and off-line training for emergency traffic management. It is portable and can run on a laptop, AR/VR device, or a stereo projector. We will test our prototype with our partners in UPMC EMS and the Fire Academy.
Timeline
1. Digital Twin City Models - Summer 2022
2. Real-Time Traffic Overlay - Fall 2022
3. Mobility Scenarios in Extreme Conditions - Spring 2022
Strategic Description / RD&T
Deployment Plan
We will deploy our prototype to our partners in UPMC MedEvac EMT, City of Pittsburgh Fire Bureau, and Allegheny Fire Academy. The Digital Twin system is portable and it can run on a laptop or a heads-up-display (HUD) device for AR or VR such as HoloLens 2 and Magic Leap ML1. It can also be projected to a holographic screen for stereo vision from a pair of affordable polarized lens glasses. We will study the mobility scenarios in normal and extreme conditions including normal city view from a traffic management center, MedEvac Dispatch Center, and flood in downtown Pittsburgh.
Our field test partners include Dr. Lenny Weiss of UPMC EM Center, MedEvac team, and SWAT. He will test the Emergency Medical Center traffic management scenarios for 18 helicopters. Ronald V. Romano (Subject Matter Expert in Emergency Medical Services). Mr. Romano is Chief of the City EMS. He will facilitate the collaborative relationship between the Department of Emergency Medicine and the research team of Carnegie Mellon University and provide input during project working sessions and formal demonstrations. The Chief’s support letter is included in this proposal.
Brian Kikkola, EFO, CTO (Subject Matter Expert in Fire and Public Safety). Chief Kikkola is Assistant Chief of the Bureau of Fire, the City of Pittsburgh, Department of Public Safety. He will provide emergency response training scenarios development support and AR prototype testing and evaluation, collaborating on Task 1-6 and potentially adopt the AR technology for training courses at Allegheny County Fire and Police Academy.
Daniel E. Stack (Subject Matter Expert in Public Safety). Mr. Stack is Fire Marshal of McCandless Township, PA. He will provide knowledge about fire inspection and emergency response training scenarios and help to test the AR interfaces at Allegheny County Fire and Police Academy.
Expected Outcomes/Impacts
Expected Accomplishments:
We will develop the Digital Twin authoring tool that can extract engineering accurate 3D terrain and building models registered with the live traffic data from open sources such as highway CCTV, Google Map, USGS, DHS, and NOAA. The Digital Twin system is portable and it can run on a laptop or a heads-up-display (HUD) device for AR or VR such as HoloLens 2 and Magic Leap ML1. It can also be projected to a holographic screen for stereo vision from a pair of affordable polarized lens glasses. We will study the mobility scenarios in extreme conditions including normal city view from a traffic management center, MedEvac Dispatch Center, and flood in downtown Pittsburgh.
Evaluation Metrics
The Digital Twin city models include the downtown Pittsburgh area. The Digital Twin authoring tool will extract the 3D city model with point clouds and texture maps and interface with 3D scanned data. The live traffic video data is at least 1 fps and the sensor data is at least 1 dataset per minute. The AR/VR frame rate will be at least 60 fps. The test scenarios are: the mobility scenarios in extreme conditions including views from a traffic management center, MedEvac Dispatch Center, and flood, fire, or major accidents in downtown Pittsburgh.
Expected Outputs
TRID
Individuals Involved
| Email |
Name |
Affiliation |
Role |
Position |
| ycai@cmu.edu |
Cai, Yang |
Carnegie Mellon School of Engineering |
Co-PI |
Faculty - Research/Systems |
| tonif@andrew.cmu.edu |
Fox, Toni |
CMU |
Other |
Staff - Business Manager |
| mws@cmu.edu |
Siegel, Mel |
Carnegie Mellon University |
PI |
Faculty - Research/Systems |
Budget
Amount of UTC Funds Awarded
$100000.00
Total Project Budget (from all funding sources)
$100000.00
Documents
| Type |
Name |
Uploaded |
| Data Management Plan |
Data_Management_Plan-Updated-V5.pdf |
Nov. 18, 2021, 11:07 p.m. |
| Publication |
Extreme Reality (EXR) Telemetry Interfaces |
Sept. 16, 2022, 2:40 p.m. |
| Publication |
Sensory Fusion for Remote Multi-Body Temperature Monitoring |
Sept. 16, 2022, 2:40 p.m. |
| Progress Report |
401_Progress_Report_2022-09-30 |
Sept. 16, 2022, 2:40 p.m. |
| Publication |
Tangible Extended Reality with Sensor Fusion a |
March 30, 2023, 3:58 a.m. |
| Progress Report |
401_Progress_Report_2023-03-30 |
March 30, 2023, 3:58 a.m. |
| Publication |
IMS Technical Committee TC-22: Intelligent Measurement Systems |
April 10, 2023, 9:07 p.m. |
| Publication |
Heads-up lidar imaging with sensor fusion |
April 10, 2023, 9:08 p.m. |
| Publication |
Haptic Helmet for Emergency Responses in Virtual and Live Environments |
April 10, 2023, 9:09 p.m. |
| Publication |
IoT-based architectures for sensing and local data processing in ambient intelligence: research and industrial trends |
April 10, 2023, 9:09 p.m. |
| Final Report |
Final_Report_-_Siegel_401.pdf |
July 31, 2023, 5:16 a.m. |
Match Sources
No match sources!
Partners
| Name |
Type |
| UPMC EMC |
Deployment Partner Deployment Partner |
