Project: #386 Deterioration Digital Twins of Commercial Trucks and Trailers for Targeted Inspection and Maintenance Progress Report - Reporting Period Ending: Sept. 30, 2022 Principal Investigator: Pingbo Tang Status: Active Start Date: July 1, 2022 End Date: June 30, 2023 Research Type: Applied Grant Type: Research Grant Program: FAST Act - Mobility National (2016 - 2022) Grant Cycle: 2022 Mobility21 UTC Progress Report (Last Updated: Sept. 30, 2022, 2:42 p.m.) % Project Completed to Date: 30 % Grant Award Expended: 10 % Match Expended & Document: 10 USDOT Requirements Accomplishments The proposed project aims to enable targeted inspection and maintenance of commercial tractors and trailer fleets by a vehicle deterioration digital twin that integrates historical inspection records and real-time sensor data for predicting high-risk vehicles and components. Such a vehicle deterioration digital twin should support the prioritization of vehicles and vehicle components for inspection and maintenance to balance fleets’ safety, mobility, and maintenance costs. Specific objectives include: • Generating Process Digital Twins from Inspection Data and Sensor Logs of Telematics System. • Generating Inspection and Maintenance Plans for Truck and Trailer Fleets. • Discussions with State and Federal Stakeholders about the Use of Inspection Reports and Telematics Data for Guiding the Safety Inspection Policy What was accomplished under these goals? Since April 2022, the project team has focused on developing data-driven deterioration models of vehicles and has developed a vehicle data analytics and visualization dashboard for visualizing current and predicted deterioration information of vehicles. The fleet managers and inspectors can use this dashboard to analyze deterioration rates of vehicles based on historical inspection data, identifying the high-risk vehicles of a given commercial vehicle fleet based on historical deterioration rates of various vehicles and components. The dashboard also is a user interface for fleet managers and inspectors to get inspection suggestions that enable the cost-safety balance for a given fleet. Specific research and development achievements include: • Identified deterioration patterns of heavy-duty trucks and trailers and developed a general Markov deterioration model based on the whole population of heavy-duty vehicles for predicting a certain vehicle’s state in the future. The prediction of vehicles’ future states can contribute to fleet management. • Clustered the heavy-duty trucks and trailers according to the deterioration patterns and identified four groups of heavy-duty vehicles corresponding to four deterioration patterns. • Developed specific Markov deterioration models for distinct groups of vehicles with different deterioration patterns, which allow customized deterioration prediction of a certain vehicle based on the vehicle group it belongs to. • Developed an inspection strategy that identifies risky vehicles periodically using the Markov deterioration model, which can balance the operation safety and costs. • Examined different inspection strategies’ (e.g., annual inspection for all vehicles, monthly inspection for all vehicles, monthly inspection for high-risk vehicles) performances in balancing operation safety, losses of uptime, and inspection costs. • Developed a data augmentation method to augment the limited historical inspection data and refine the Markov model. The general Markov model with data augmentation and the specific models with data augmentation both have been validated to have good performances in vehicle condition prediction. • Developed a transfer-learning-based state prediction method to predict the vehicle component’s state in the future according to the vehicle’s specific deterioration pattern. The researchers developed a transfer learning algorithm to transfer the information in the general Markov deterioration model to several specific models for different deterioration patterns. Heavy-duty trucks and trailers have different deterioration patterns. For example, some vehicles’ brakes deteriorate faster due to different driving behaviors and vehicle properties. The general deterioration model can hardly accurately reflect the deterioration patterns of all heavy-duty vehicles. In contrast, the specific deterioration models can fit different deterioration patterns and achieve more accurate predictions. Such an accurate prediction can help to generate more safety-cost-balanced inspection decisions that can detect all unsafe vehicles and not waste inspections on safe vehicles. • Quantified the impacts of the critical vehicle attributes (e.g., vehicle characteristics, driving behaviors, driving environments) on the deterioration patterns of various vehicle components and present the clustering results to CompuSpections and Truck-Lite professionals for developing explainable deterioration models. • Start reorganizing the user interfaces for inspectors and fleet managers with full use of the clustering algorithms and new deterioration models. The interface for inspectors allows inspectors to input the inspection data, checks the data anomalies based on the historical data, provides correction suggestions, and allows inspectors to check the suggestions. The interface for fleet managers allows managers to upload the vehicle information for the fleet, suggests inspection and maintenance plans, provides explanations for the suggested plans, and allows the managers to understand the suggested plans and make final decisions. What opportunities for training and professional development has the project provided? • Three Ph.D. students (Chenyu Yuan, Ruoxin Xiong, Ying Shi) in the Department of Civil and Environmental Engineering have been able to learn the practice of commercial vehicle fleet inspection and maintenance planning, accumulating data analysis results for future presentations and research publications. • The three Ph.D. students (Chenyu Yuan, Ruoxin Xiong, and Ying Shi) have weekly meetings with industry collaborators to develop their skills in presenting the work to industry professionals and identifying scientific problems from practical problems. They also get feedback from the industry professionals about various data quality issues in the inspection data and have started developing new scientific methods for data imputation and new data analysis methods that enable vehicle data analytics and predictive fleet management based on partial and faulty data • One Ph.D. student (Ying Shi) presented the research work on “Deterioration Digital Twins of Bridges and Commercial Trucks and Trailers for Targeted Inspection and Maintenance” at a Digital Twin Research Collaboration Meeting with ANSYS in Pittsburgh, PA, on July 15, 2022 How have the results been disseminated? If so, in what way/s? • The most frequent distribution of the results is through bi-weekly meetings with industry professionals to show them the results of data collection and analysis for supporting predictive commercial vehicle fleet management. • One M.S. student (Jiayi Li) presented at the Summer Research Symposium of the Civil and Environmental Engineering Department. The short presentation is on the truck fleet management dashboard for visualizing truck fleet deterioration rates based on historical inspection reports. • The project team presented use cases of a user interface design to CompuSpections and Truck-Lite (Clarience Technologies) for simplifying the uses of the developed algorithms in guiding the inspectors in selecting critical vehicles and components and prioritizing the maintenance plans of a given fleet. What do you plan to do during the next reporting period to accomplish the goals and objectives? - Plan to reach out to industry and government and dig more into the policy perspective. - Develop and test the new dashboard that allows inspectors and fleet managers to view clusters of vehicles for an interactive explanation of the inspection and maintenance plans generated by the algorithms - Communicate with Turnpike for potential collaborations on using the developed data-driven models and dashboard in helping policemen at the entrance of highway 76 in identifying critical trucks or trailers for preventing high-risk vehicles from entering the highway. - Submit the inspection and maintenance strategy generation journal manuscript - Present the work on 2022 Traffic21/Mobility21 Deployment Partner Consortium Symposium - November 3 - Submit an abstract to the 14th National Conference on Transportation Asset Management (due October 15th) - Collaborate with Amazon collaborators (AWS Professional Services) in developing a proposal in response to Amazon AI Call for proposals (https://www.amazon.science/research-awards/call-for-proposals/aws-ai-call-for-proposals-fall-2022) Impacts During this reporting period, the project team continued the following activities that have some impacts: • The two industry collaborators (Compuspections and Clarience Technologies) provided more truck/tractor inspection data and helped the project team clean and organize their data for supporting integrated analysis of historical inspection reports and real-time data. • The two industry collaborators (Compuspections and Clarience Technologies) have their engineers and professionals participate in the development of data analytics techniques and started improving their software and hardware platform based on the findings of the project (e.g., critical components that deserve automatic inspection). • The project team has a new user interface design approved by professionals from CompuSpections and Clarience Technologies) because of its simplified design. This new user interface design integrates clustering and machine learning algorithms with interactive data visualization features for an interactive explanation of inspection and maintenance plans generated by the algorithms. • The new data augmentation and transfer learning algorithms for deterioration prediction of vehicles have scientific impacts. These new deterioration models and algorithms contribute scientific knowledge about vehicle deterioration models for supporting proactive fleet management and the interfaces for queries and suggestions of inspection and maintenance plans of certain components of certain vehicles with specific properties. Other - Website: TrSafety - Towards Data-Driven and Continuous Safety Inspection of Commercial Trucks and Trailers: https://sites.google.com/andrew.cmu.edu/trsafety/home - Algorithms Algorithms for 1) predicting vehicle conditions and identifying risky vehicles periodically to ensure the operation safety with the minimizing number of inspections; 2) clustering similar vehicles with similar brake deterioration patterns; 3) augmenting limited historical data for obtaining more reliable deterioration models; 4) explaining the clustering results by quantifying the influences of vehicle characteristics, driving behaviors, and driving environments on deterioration patterns given a certain component. - Models Deterioration models of commercial trucks and tractors for supporting the simulation of different inspection and maintenance policies for managing commercial vehicle fleets - Educational aids or curricula Education and outreach materials for training industrial professionals in the effective use of historical inspection records of commercial vehicles for preventive commercial vehicle fleet inspection and maintenance planning - Software or NetWare Two interfaces for inspectors and fleet managers, respectively, are in development. Outcomes New Partners None Issues None