WO2024139287A1 - Road disease prediction method and apparatus, electronic device and storage medium - Google Patents

Road disease prediction method and apparatus, electronic device and storage medium Download PDF

Info

Publication number
WO2024139287A1
WO2024139287A1 PCT/CN2023/114730 CN2023114730W WO2024139287A1 WO 2024139287 A1 WO2024139287 A1 WO 2024139287A1 CN 2023114730 W CN2023114730 W CN 2023114730W WO 2024139287 A1 WO2024139287 A1 WO 2024139287A1
Authority
WO
WIPO (PCT)
Prior art keywords
road
data
target
matrix
feature map
Prior art date
Application number
PCT/CN2023/114730
Other languages
French (fr)
Chinese (zh)
Inventor
程冰
韩华胜
邹博
Original Assignee
深圳云天励飞技术股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳云天励飞技术股份有限公司 filed Critical 深圳云天励飞技术股份有限公司
Publication of WO2024139287A1 publication Critical patent/WO2024139287A1/en

Links

Abstract

A road disease prediction method, comprising: acquiring historical driving vehicle data and historical road environment data of each road section; determining a road disease influence factor according to the historical driving vehicle data and the historical road environment data; and predicting a road disease of a target road section according to the road disease influence factor to obtain a road disease prediction result of the target road section. The road disease influence factor is determined by means of the historical driving vehicle data and the historical road environment data of each road section, and the road disease of the target road section is predicted by means of the road disease influence factor, so that the road disease of the target road section can be predicted in advance, and relevant management departments can carry out targeted maintenance work on the target road section, thereby prolonging the service life of the target road section.

Description

道路病害预测方法、装置、电子设备及存储介质Road damage prediction method, device, electronic device and storage medium 技术领域Technical Field
本发明涉及智慧城市领域,尤其涉及一种道路病害预测方法、装置、电子设备及存储介质。The present invention relates to the field of smart cities, and in particular to a road damage prediction method, device, electronic equipment and storage medium.
本申请要求于2022年12月31日提交中国专利局,申请号为202211739057.4、发明名称为“道路病害预测方法、装置、电子设备及存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application filed with the China Patent Office on December 31, 2022, with application number 202211739057.4 and invention name “Road Defect Prediction Method, Device, Electronic Device and Storage Medium”, all contents of which are incorporated by reference in this application.
背景技术Background technique
道路CT是对道路进行扫描,通过扫描图像进行道路病害识别,从而得到道路内部病害情况的一种方式,然而,道路CT是针对道路中已有病害进行扫描,对于以后会发生的道路病害无法进行预测,也就无法提前对道路进行针对性养护来延长道路寿命。Road CT is a method of scanning roads and identifying road defects through scanned images to obtain the internal road defect conditions. However, road CT scans existing defects in the road and cannot predict road defects that will occur in the future. It is also impossible to perform targeted maintenance on the road in advance to extend the road life.
技术解决方案Technical Solutions
本发明实施例提供一种道路病害预测方法,旨在解决现有技术中只能针对道路中已有病害进行扫描,对于以后会发生的道路病害无法进行预测的问题。通过各个路段的历史行驶车辆数据以及历史道路环境数据来确定道路病害影响因子,通过道路病害影响因子来对目标路段的道路病害进行预测,可以提前预测目标路段会出现什么样的道路病害,从而能够使相关管理部门对目标路段进行有针对性的养护工作,进而可以提高目标路段的使用寿命。The embodiment of the present invention provides a road disease prediction method, which aims to solve the problem that the existing technology can only scan existing diseases in the road, but cannot predict road diseases that will occur in the future. The road disease influencing factors are determined by the historical driving vehicle data and historical road environment data of each road section, and the road diseases of the target road section are predicted by the road disease influencing factors. It can be predicted in advance what kind of road diseases will occur in the target road section, so that the relevant management department can carry out targeted maintenance work on the target road section, thereby increasing the service life of the target road section.
第一方面,本发明实施例提供一种道路病害预测方法,所述方法包括:In a first aspect, an embodiment of the present invention provides a road damage prediction method, the method comprising:
获取各个路段的历史行驶车辆数据以及历史道路环境数据;Obtain historical vehicle driving data and historical road environment data for each road section;
根据所述历史行驶车辆数据以及历史道路环境数据,确定道路病害影响因子;Determining road disease influencing factors based on the historical vehicle driving data and historical road environment data;
根据所述道路病害影响因子,对所述目标路段的道路病害进行预测,得到所述目标路段的道路病害预测结果。The road damage of the target road section is predicted according to the road damage influencing factor to obtain a road damage prediction result of the target road section.
可选的,所述根据所述历史行驶车辆数据以及历史道路环境数据,确定道路病害影响因子,包括:Optionally, determining the road disease influencing factor according to the historical vehicle driving data and the historical road environment data includes:
根据所述历史行驶车辆数据以及历史道路环境数据,确定道路病害的影响数据,所述影响数据包括第一数量个数据维度;Determine, according to the historical vehicle driving data and the historical road environment data, the impact data of road diseases, wherein the impact data includes a first number of data dimensions;
对所述影响数据进行降维处理,得到样本降维数据,所述样本降维数据包括第二数量个数据维度,所述第二数量小于所述第一数量;Performing dimensionality reduction processing on the influencing data to obtain sample dimensionality reduction data, wherein the sample dimensionality reduction data includes a second number of data dimensions, and the second number is smaller than the first number;
基于所述样本降维数据,确定道路病害影响因子。Based on the sample dimension reduction data, the road disease influencing factors are determined.
可选的,所述对所述影响数据进行降维处理,得到样本降维数据,所述样本降维数据包括第二数量个数据维度,包括:Optionally, the influencing data is subjected to dimensionality reduction processing to obtain sample dimensionality reduction data, wherein the sample dimensionality reduction data includes a second number of data dimensions, including:
根据所述影响数据,确定第一影响矩阵,所述第一影响矩阵包括第一数量个数据维度;Determine a first influence matrix according to the influence data, wherein the first influence matrix includes a first number of data dimensions;
对所述第一影响矩阵进行降维处理,得到第二影响矩阵;Performing dimensionality reduction processing on the first influence matrix to obtain a second influence matrix;
基于所述第一影响矩阵与所述第二影响矩阵,确定所述样本降维数据。The sample dimension reduction data is determined based on the first influence matrix and the second influence matrix.
可选的,所述对所述第一影响矩阵进行降维处理,得到第二影响矩阵,包括:Optionally, performing dimensionality reduction processing on the first influence matrix to obtain a second influence matrix includes:
确定所述第一影响矩阵的协方差矩阵;determining a covariance matrix of the first influence matrix;
基于所述第一影响矩阵的协方差矩阵,对所述第一影响矩阵进行降维处理,得到第二影响矩阵。Based on the covariance matrix of the first influence matrix, dimension reduction processing is performed on the first influence matrix to obtain a second influence matrix.
可选的,所述基于所述第一影响矩阵的协方差矩阵,对所述第一影响矩阵进行降维处理,得到第二影响矩阵,包括:Optionally, the performing dimensionality reduction processing on the first influence matrix based on the covariance matrix of the first influence matrix to obtain a second influence matrix includes:
计算所述第一影响矩阵的协方差矩阵;Calculating a covariance matrix of the first influence matrix;
计算所述协方差矩阵的特征值以及所述特征值对应的特征向量;Calculate the eigenvalues of the covariance matrix and the eigenvectors corresponding to the eigenvalues;
根据所述特征值最大的第二数量个所述特征向量得到所述中间矩阵,根据所述第一影响矩阵与所述中间矩阵确定第二影响矩阵。The intermediate matrix is obtained according to a second number of the eigenvectors with the largest eigenvalues, and a second influence matrix is determined according to the first influence matrix and the intermediate matrix.
可选的,所述根据所述特征值最大的第二数量个所述特征向量得到所述中间矩阵,根据所述第一影响矩阵与所述中间矩阵确定第二影响矩阵,包括:Optionally, obtaining the intermediate matrix according to a second number of the eigenvectors with the largest eigenvalues, and determining the second influence matrix according to the first influence matrix and the intermediate matrix include:
将所述第一影响矩阵与所述中间矩阵进行相乘,得到第二影响矩阵。The first influence matrix is multiplied by the intermediate matrix to obtain a second influence matrix.
可选的,所述根据所述道路病害影响因子,对所述目标路段的道路病害进行预测,得到所述目标路段的道路病害预测结果,包括:Optionally, predicting the road damage of the target road section according to the road damage influencing factor to obtain the road damage prediction result of the target road section includes:
获取所述目标路段的行驶车辆数据以及道路环境数据;Acquiring driving vehicle data and road environment data of the target road section;
根据所述道路病害影响因子,确定所述目标路段的目标影响矩阵;Determining a target impact matrix of the target road section according to the road disease impact factor;
基于所述目标影响矩阵,对所述目标路段的道路病害进行预测,得到所述目标路段的道路病害预测结果。Based on the target impact matrix, the road damage of the target road section is predicted to obtain the road damage prediction result of the target road section.
第二方面,本发明实施例提供一种道路病害预测装置,所述装置包括:In a second aspect, an embodiment of the present invention provides a road damage prediction device, the device comprising:
获取模块,用于获取各个路段的历史行驶车辆数据以及历史道路环境数据;An acquisition module is used to acquire historical vehicle driving data and historical road environment data of each road section;
确定模块,用于根据所述历史行驶车辆数据以及历史道路环境数据,确定道路病害影响因子;A determination module, used to determine the road disease impact factor based on the historical vehicle driving data and the historical road environment data;
预测模块,用于根据所述道路病害影响因子,对所述目标路段的道路病害进行预测,得到所述目标路段的道路病害预测结果。The prediction module is used to predict the road damage of the target road section according to the road damage influencing factor to obtain the road damage prediction result of the target road section.
第三方面,本发明实施例提供一种电子设备,包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现本发明实施例提供的道路病害预测方法中的步骤。In a third aspect, an embodiment of the present invention provides an electronic device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the road damage prediction method provided in the embodiment of the present invention when executing the computer program.
第四方面,本发明实施例提供一种计算机可读存储介质,所述计算机可读存储介质上存储有计算机程序,所述计算机程序被处理器执行时实现发明实施例提供的道路病害预测方法中的步骤。In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps in the road damage prediction method provided in the embodiment of the invention are implemented.
本发明实施例中,获取各个路段的历史行驶车辆数据以及历史道路环境数据;根据所述历史行驶车辆数据以及历史道路环境数据,确定道路病害影响因子;根据所述道路病害影响因子,对所述目标路段的道路病害进行预测,得到所述目标路段的道路病害预测结果。通过各个路段的历史行驶车辆数据以及历史道路环境数据来确定道路病害影响因子,通过道路病害影响因子来对目标路段的道路病害进行预测,可以提前预测目标路段会出现什么样的道路病害,从而能够使相关管理部门对目标路段进行有针对性的养护工作,进而可以提高目标路段的使用寿命。。In the embodiment of the present invention, the historical driving vehicle data and the historical road environment data of each road section are obtained; the road disease influencing factor is determined according to the historical driving vehicle data and the historical road environment data; the road disease of the target road section is predicted according to the road disease influencing factor, and the road disease prediction result of the target road section is obtained. The road disease influencing factor is determined by the historical driving vehicle data and the historical road environment data of each road section, and the road disease of the target road section is predicted by the road disease influencing factor. It is possible to predict in advance what kind of road disease will occur in the target road section, so that the relevant management department can carry out targeted maintenance work on the target road section, thereby increasing the service life of the target road section. .
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1是本发明实施例提供的一种道路病害预测方法的流程图;FIG1 is a flow chart of a road damage prediction method provided by an embodiment of the present invention;
图2是本发明实施例提供的一种道路病害预测装置的结构示意图;FIG2 is a schematic diagram of the structure of a road damage prediction device provided by an embodiment of the present invention;
图3是本发明实施例提供的一种电子设备的结构示意图。。FIG3 is a schematic diagram of the structure of an electronic device provided by an embodiment of the present invention.
本发明的实施方式Embodiments of the present invention
请参见图1,图1是本发明实施例提供的一种道路病害预测方法的流程图,如图1所示,该道路病害预测方法包括以下步骤:Please refer to FIG. 1 , which is a flow chart of a road damage prediction method provided by an embodiment of the present invention. As shown in FIG. 1 , the road damage prediction method includes the following steps:
101、获取各个路段的历史行驶车辆数据以及历史道路环境数据。101. Obtain historical vehicle driving data and historical road environment data for each road section.
在本发明实施例中,上述各个路段指的是多个样本路段,上述样本路段包括已经出现道路病害的路段和还未出现道路病害的路段。In the embodiment of the present invention, the above-mentioned road sections refer to a plurality of sample road sections, and the above-mentioned sample road sections include road sections where road damage has occurred and road sections where road damage has not occurred.
上述历史行驶车辆数据可以是行驶车辆的类型、行驶车辆的大小、行驶车辆的速度、行驶车辆的数量等与行驶车辆相关的数据。上述历史行驶车辆数据可以通过设置在各个路段的交通摄像头采集到的图像数据进行确定,具体的,在各个路段中均设置有交通摄像头,通过交通摄像头采集对应路段的交通图像,对交通图像进行车辆识别,得到对应路段的行驶车辆数据,将行驶车辆数据存储到服务器中进行复用。The above historical driving vehicle data may be data related to the driving vehicle, such as the type of driving vehicle, the size of the driving vehicle, the speed of the driving vehicle, the number of driving vehicles, etc. The above historical driving vehicle data may be determined by image data collected by traffic cameras installed at each road section. Specifically, traffic cameras are installed at each road section, and the traffic images of the corresponding road section are collected by the traffic cameras. Vehicles are identified on the traffic images to obtain driving vehicle data of the corresponding road section, and the driving vehicle data is stored in the server for reuse.
上述历史道路环境数据可以是天气数据、道路湿度数据、道路温度数据、道路扫描数据、道路病害数据等。上述天气数据可以根据道路所在天气部门进行获取,上述道路扫描数据可以根据道路扫描车扫描到的数据进行获取,上述道路病害数据可以根据道路扫描数据进行获取,也可以通过道路巡查人员的记录进行获取。The above historical road environment data may be weather data, road humidity data, road temperature data, road scanning data, road disease data, etc. The above weather data may be obtained from the weather department where the road is located, the above road scanning data may be obtained from the data scanned by the road scanning vehicle, and the above road disease data may be obtained from the road scanning data or from the records of road inspectors.
102、根据历史行驶车辆数据以及历史道路环境数据,确定道路病害影响因子。102. Determine the factors affecting road hazards based on historical vehicle driving data and historical road environment data.
在本发明实施例中,可以对历史行驶车辆数据以及历史道路环境数据来确定道路病害的影响数据,根据道路病害的影响数据,确定道路病害影响因子。具体的,可以对道路病害的影响数据进行降维处理,得到道路病害影响因子,上述降维处理可以是在全部的影响因子中对于道路病害影响最大的多个影响因子。通过对上述影响数据进行降维处理,可以得到数据维度较低的降维数据。比如,道路病害的影响数据为行驶车辆的类型、行驶车辆的大小、行驶车辆的速度、行驶车辆的数量、天气数据、道路湿度数据、道路温度数据等,道路病害影响因子可以是行驶车辆的大小、行驶车辆的速度、道路温度数据。In an embodiment of the present invention, the impact data of road diseases can be determined based on historical vehicle data and historical road environment data, and the road disease impact factor can be determined based on the impact data of road diseases. Specifically, the impact data of road diseases can be subjected to dimensionality reduction processing to obtain the road disease impact factor, and the above-mentioned dimensionality reduction processing can be a plurality of impact factors that have the greatest impact on road diseases among all the impact factors. By performing dimensionality reduction processing on the above-mentioned impact data, dimensionality reduction data with a lower data dimension can be obtained. For example, the impact data of road diseases are the type of traveling vehicles, the size of traveling vehicles, the speed of traveling vehicles, the number of traveling vehicles, weather data, road humidity data, road temperature data, etc., and the road disease impact factor can be the size of traveling vehicles, the speed of traveling vehicles, and the road temperature data.
103、根据道路病害影响因子,对目标路段的道路病害进行预测,得到目标路段的道路病害预测结果。103. The road damage of the target section is predicted based on the road damage influencing factors to obtain the road damage prediction result of the target section.
在本发明实施例中在得到道路病害影响因子后,可以通过道路病害影响因子,在目标路段的数据中筛选与道路病害影响因子对应的数据,根据筛选出来的数据对目标路段的道路病害进行预测,得到目标路段的道路病害预测结果。比如,道路影响因子为行驶车辆的大小、行驶车辆的速度、道路温度数据,则可以在目标路段的数据中筛选出行驶车辆的大小、行驶车辆的速度、道路温度数据,根据行驶车辆的大小、行驶车辆的速度、道路温度数据来预测目标路段的会发生什么类型的道路病害。In the embodiment of the present invention, after obtaining the road disease influencing factor, the data corresponding to the road disease influencing factor can be screened in the data of the target road section by the road disease influencing factor, and the road disease of the target road section is predicted based on the screened data to obtain the road disease prediction result of the target road section. For example, if the road influencing factor is the size of the traveling vehicle, the speed of the traveling vehicle, and the road temperature data, the size of the traveling vehicle, the speed of the traveling vehicle, and the road temperature data can be screened in the data of the target road section, and the type of road disease that will occur in the target road section can be predicted based on the size of the traveling vehicle, the speed of the traveling vehicle, and the road temperature data.
具体的,在筛选出与道路病害影响因子对应的数据后,可以将与道路病害影响因子对应的数据输入到训练好的时序模型中进行预测处理,时序模型输出得到目标路段的道路病害预测结果。Specifically, after the data corresponding to the road disease influencing factors are screened out, the data corresponding to the road disease influencing factors can be input into a trained time series model for prediction processing, and the time series model outputs the road disease prediction result of the target road section.
本发明实施例中,获取各个路段的历史行驶车辆数据以及历史道路环境数据;根据所述历史行驶车辆数据以及历史道路环境数据,确定道路病害影响因子;根据所述道路病害影响因子,对所述目标路段的道路病害进行预测,得到所述目标路段的道路病害预测结果。通过各个路段的历史行驶车辆数据以及历史道路环境数据来确定道路病害影响因子,通过道路病害影响因子来对目标路段的道路病害进行预测,可以提前预测目标路段会出现什么样的道路病害,从而能够使相关管理部门对目标路段进行有针对性的养护工作,进而可以提高目标路段的使用寿命。In the embodiment of the present invention, historical vehicle driving data and historical road environment data of each road section are obtained; road disease impact factors are determined based on the historical vehicle driving data and historical road environment data; road diseases of the target road section are predicted based on the road disease impact factors to obtain road disease prediction results of the target road section. By determining the road disease impact factors based on the historical vehicle driving data and historical road environment data of each road section, and predicting the road diseases of the target road section based on the road disease impact factors, it is possible to predict in advance what kind of road diseases will occur in the target road section, thereby enabling the relevant management department to carry out targeted maintenance work on the target road section, thereby increasing the service life of the target road section.
可选的,在根据历史行驶车辆数据以及历史道路环境数据,确定道路病害影响因子的步骤中,可以根据历史行驶车辆数据以及历史道路环境数据,确定道路病害的影响数据,影响数据包括第一数量个数据维度;对影响数据进行降维处理,得到样本降维数据,样本降维数据包括第二数量个数据维度,第二数量小于第一数量;基于样本降维数据,确定道路病害影响因子。Optionally, in the step of determining the influencing factors of road hazards based on historical vehicle driving data and historical road environment data, the influencing data of road hazards can be determined based on the historical vehicle driving data and historical road environment data, the influencing data including a first number of data dimensions; the influencing data is subjected to dimensionality reduction processing to obtain sample reduced dimensionality data, the sample reduced dimensionality data including a second number of data dimensions, the second number being smaller than the first number; and the influencing factors of road hazards are determined based on the sample reduced dimensionality data.
在本发明实施例中,上述各个路段中包括已发生道路病害的路段和未发生道路病害的路段,在得到各个路段的历史行驶车辆数据以及历史道路环境数据后,对各个路段贩历史行驶车辆数据和历史道路环境数据进行整理,得到道路病害的影响数据。上述道路病害的影响数据用于说明数据与道路病害的产生或多或少存在影响关系。上述道路病害的影响数据可以是为行驶车辆的类型、行驶车辆的大小、行驶车辆的速度、行驶车辆的数量、天气数据、道路湿度数据、道路温度数据等,道路病害影响因子可以是行驶车辆的大小、行驶车辆的速度、道路温度数据。上述道路病害主要包括沥青路面对应的道路病害、水泥路面对应的道路病害以及沿线设施对应的道路病害,其中,沥青路面对应的道路病害的类型可以包括坑槽、龟裂、块裂、裂缝(横向裂缝、纵向裂缝、不规则斜线裂缝)、沉陷、车辙、路框差、杂物、积水等;水泥路面对应的道路病害的类型可以包括面板破碎、坑洞、板角断裂、线裂等;沿线设施对应的道路病害的类型可以包括护栏损坏、路框差、井盖破损等。In the embodiment of the present invention, the above-mentioned road sections include road sections where road damage has occurred and road sections where road damage has not occurred. After obtaining the historical driving vehicle data and historical road environment data of each road section, the historical driving vehicle data and historical road environment data of each road section are sorted to obtain the impact data of road damage. The impact data of the above-mentioned road damage is used to illustrate that the data has more or less an impact relationship with the occurrence of road damage. The impact data of the above-mentioned road damage can be the type of driving vehicle, the size of the driving vehicle, the speed of the driving vehicle, the number of driving vehicles, weather data, road humidity data, road temperature data, etc., and the road damage influencing factors can be the size of the driving vehicle, the speed of the driving vehicle, and the road temperature data. The above-mentioned road diseases mainly include road diseases corresponding to asphalt pavements, road diseases corresponding to cement pavements and road diseases corresponding to facilities along the line. Among them, the types of road diseases corresponding to asphalt pavements may include potholes, cracks, block cracks, cracks (transverse cracks, longitudinal cracks, irregular diagonal cracks), subsidence, rutting, poor road frame, debris, water accumulation, etc.; the types of road diseases corresponding to cement pavements may include panel breakage, potholes, broken plate corners, linear cracks, etc.; the types of road diseases corresponding to facilities along the line may include damaged guardrails, poor road frames, damaged manhole covers, etc.
上述道路病害的影响数据具有第一数量个数据维度,上述第一数量个数据维度可以理解为具有第一数量个道路病害候选影响因子。在得到道路病害的影响数据数据后,可以将道路病害的影响数据进行降维处理,得到样本标题降维数据,样本降维数据具有第二数量个数据维度,上述第二数量个数据维度可以理解为具有第二数量个道路病害影响因子。The above-mentioned road disease impact data has a first number of data dimensions, and the above-mentioned first number of data dimensions can be understood as having a first number of candidate road disease impact factors. After obtaining the road disease impact data, the road disease impact data can be subjected to dimensionality reduction processing to obtain sample title dimensionality reduction data, and the sample dimensionality reduction data has a second number of data dimensions, and the above-mentioned second number of data dimensions can be understood as having a second number of road disease impact factors.
上述的降维处理可以是通过主成分分析算法(Principal Component Analysis,PCA)、线性判别分析算法(Discriminant Analysis,LDA)等降维方法来进行。在得到样本降维数据后,可以根据样本降维数据中的数据维度来确定道路病害影响因子,每个数据维度对应一个道路病害影响因子。The above-mentioned dimensionality reduction processing can be performed by dimensionality reduction methods such as principal component analysis (PCA) and linear discriminant analysis (LDA). After obtaining the sample dimensionality reduction data, the road disease influencing factors can be determined according to the data dimensions in the sample dimensionality reduction data, and each data dimension corresponds to a road disease influencing factor.
可选的,在对影响数据进行降维处理,得到样本降维数据,样本降维数据包括第二数量个数据维度的步骤中,可以根据影响数据,确定第一影响矩阵,第一影响矩阵包括第一数量个数据维度;对第一影响矩阵进行降维处理,得到第二影响矩阵;基于第一影响矩阵与第二影响矩阵,确定样本降维数据。Optionally, in the step of performing dimensionality reduction processing on the influence data to obtain sample dimensionality reduction data, wherein the sample dimensionality reduction data includes a second number of data dimensions, a first influence matrix can be determined based on the influence data, wherein the first influence matrix includes a first number of data dimensions; performing dimensionality reduction processing on the first influence matrix to obtain a second influence matrix; and determining the sample dimensionality reduction data based on the first influence matrix and the second influence matrix.
在本发明实施例中,高所有路段的数量为n,第一数量为m,则可以将n个路段对应的m个数据维度的影响数据构建成n×m的第一影响矩阵,在第一影响矩阵中,每一列对应一个道路病害候选影响因子,每一行对应一个路段的影响数据。In an embodiment of the present invention, the number of all road sections is n, and the first number is m, then the impact data of m data dimensions corresponding to the n road sections can be constructed into a first impact matrix of n×m. In the first impact matrix, each column corresponds to a candidate impact factor of road hazards, and each row corresponds to the impact data of a road section.
可以通过主成分分析算法或线性判别分析算法,对第一影响矩阵进行降维处理,得到第二影响矩阵,其中,上述第二影响矩阵为n×k,k为第二数量,即表示样本降维数据的数据维度为k。上述k可以是预先设定的。在第二影响矩阵中,第一列对应一个道路病害影响因子,第一行对应一个路段的影响数据。The first influence matrix can be reduced in dimension by a principal component analysis algorithm or a linear discriminant analysis algorithm to obtain a second influence matrix, wherein the second influence matrix is n×k, k is a second number, that is, the data dimension of the sample reduced dimension data is k. The k can be preset. In the second influence matrix, the first column corresponds to a road disease influencing factor, and the first row corresponds to the influencing data of a road section.
可选的,在对第一影响矩阵进行降维处理,得到第二影响矩阵的步骤中,可以确定第一影响矩阵的协方差矩阵;基于第一影响矩阵的协方差矩阵,对所述第一影响矩阵进行降维处理,得到第二影响矩阵。Optionally, in the step of performing dimensionality reduction processing on the first influence matrix to obtain the second influence matrix, the covariance matrix of the first influence matrix can be determined; based on the covariance matrix of the first influence matrix, the first influence matrix is subjected to dimensionality reduction processing to obtain the second influence matrix.
在本发明实施例中,对于第一影响矩阵,计算每一列性能指标数据的平均值,用每一列性能指标数据减去该平均值,得到每个性能指标数据对应的标准差,通过标准差的平方得到每个性能指标数据对应的协方差,根据协方差得到n×m的协方差矩阵。In an embodiment of the present invention, for the first influence matrix, the average value of each column of performance indicator data is calculated, and the average value is subtracted from each column of performance indicator data to obtain the standard deviation corresponding to each performance indicator data, and the covariance corresponding to each performance indicator data is obtained by the square of the standard deviation, and an n×m covariance matrix is obtained based on the covariance.
通过对协方差矩阵提取出性能指标数据的异变信息,从而通过异变信息,再对协方差矩阵进行降维处理,可以提取异变程度较高的样本降维数据,保证样本降维数据对于道路病害的高影响力。By extracting the variation information of the performance index data from the covariance matrix, and then reducing the dimension of the covariance matrix through the variation information, it is possible to extract sample reduced dimension data with a high degree of variation, thereby ensuring the high influence of the sample reduced dimension data on road diseases.
可选的,在基于第一影响矩阵的协方差矩阵,对第一影响矩阵进行降维处理,得到第二影响矩阵的步骤中,可以计算第一影响矩阵的协方差矩阵;计算协方差矩阵的特征值以及特征值对应的特征向量;根据特征值最大的第二数量个特征向量得到中间矩阵,根据第一影响矩阵与中间矩阵确定第二影响矩阵。Optionally, in the step of performing dimensionality reduction processing on the first influence matrix based on the covariance matrix of the first influence matrix to obtain the second influence matrix, the covariance matrix of the first influence matrix can be calculated; the eigenvalues of the covariance matrix and the eigenvectors corresponding to the eigenvalues are calculated; the intermediate matrix is obtained based on the second number of eigenvectors with the largest eigenvalues, and the second influence matrix is determined based on the first influence matrix and the intermediate matrix.
在本发明实施例中,在得到第一影响矩阵的协方差矩阵后,再求出协方差矩阵的特征值和对应的特征向量;按特征值的大小进行特征向量的排序;保留前k个特征值最大的特征向量,得到m×k的中间矩阵。根据第一影响矩阵与中间矩阵,确定第二影响矩阵。通过特征值来确定性能指标数据的异变程度,从而可以选取到异变程度较高的样本降维数据,保证样本降维数据对于道路病害的高影响力。In an embodiment of the present invention, after obtaining the covariance matrix of the first influence matrix, the eigenvalues and corresponding eigenvectors of the covariance matrix are calculated; the eigenvectors are sorted according to the size of the eigenvalues; the eigenvectors with the largest eigenvalues of the first k are retained to obtain an m×k intermediate matrix. The second influence matrix is determined based on the first influence matrix and the intermediate matrix. The degree of variation of the performance index data is determined by the eigenvalues, so that sample dimensionality reduction data with a high degree of variation can be selected to ensure the high influence of the sample dimensionality reduction data on road diseases.
上述中间矩阵中每一列对应一个道路病害影响因子,每一行对应一个特征向量。Each column in the above intermediate matrix corresponds to a road disease influencing factor, and each row corresponds to a eigenvector.
可选的,在根据道路病害影响因子,对目标路段的道路病害进行预测,得到目标路段的道路病害预测结果的步骤中,可以将第一影响矩阵与中间矩阵进行相乘,得到第二影响矩阵。Optionally, in the step of predicting the road damage of the target road section according to the road damage influencing factors to obtain the road damage prediction result of the target road section, the first influence matrix and the intermediate matrix can be multiplied to obtain the second influence matrix.
在本发明实施例中,在得到第一影响矩阵与中间矩阵后,对第一影响矩阵和中间矩阵进行矩阵计算,得到第二影响矩阵。具体的,设第一影响矩阵为H=n×m,中间影响矩阵D=m×k,则第二影响矩阵G=HD=n×k。这样,就可以将第一影响矩阵由m维降到k维,去掉了对于道路病害影响小的数据维度。In the embodiment of the present invention, after obtaining the first impact matrix and the intermediate matrix, matrix calculation is performed on the first impact matrix and the intermediate matrix to obtain the second impact matrix. Specifically, assuming that the first impact matrix is H=n×m and the intermediate impact matrix is D=m×k, then the second impact matrix is G=HD=n×k. In this way, the first impact matrix can be reduced from m-dimension to k-dimension, removing the data dimension that has little impact on road diseases.
通过矩阵乘法进行降维处理,得到异变程度较高的样本降维数据,保证样本降维数据对于道路病害的高影响力。Through matrix multiplication, dimensionality reduction processing is performed to obtain sample dimensionality reduction data with a high degree of variation, ensuring the high influence of sample dimensionality reduction data on road diseases.
在得到第二影响矩阵后,可以将第二影响矩阵中的各列对应的数据维度确定为对应的道路病害影响因子。After the second impact matrix is obtained, the data dimensions corresponding to each column in the second impact matrix may be determined as corresponding road hazard impact factors.
可选的,在根据所述道路病害影响因子,对目标路段的道路病害进行预测,得到所述目标路段的道路病害预测结果的步骤中,可以获取目标路段的行驶车辆数据以及道路环境数据;根据道路病害影响因子,确定目标路段的目标影响矩阵;基于目标影响矩阵,对目标路段的道路病害进行预测,得到目标路段的道路病害预测结果。Optionally, in the step of predicting road damages of a target section according to the road damage influencing factors and obtaining a road damage prediction result for the target section, driving vehicle data and road environment data of the target section can be obtained; a target influence matrix of the target section can be determined according to the road damage influencing factors; and road damages of the target section can be predicted based on the target influence matrix to obtain a road damage prediction result for the target section.
在本发明实施例中,上述目标路段的行驶车辆数据,行驶车辆的类型、行驶车辆的大小、行驶车辆的速度、行驶车辆的数量等与行驶车辆相关的数据。上述目标路段的行驶车辆数据可以通过设置在目标路段的交通摄像头采集到的图像数据进行确定。具体的,在目标路段中设置有交通摄像头,通过交通摄像头采集目标路段的交通图像,对交通图像进行车辆识别,得到目标路段的行驶车辆数据,将行驶车辆数据存储到服务器中进行复用。In an embodiment of the present invention, the driving vehicle data of the target road section includes the type of driving vehicle, the size of driving vehicle, the speed of driving vehicle, the number of driving vehicles and other data related to driving vehicles. The driving vehicle data of the target road section can be determined by the image data collected by the traffic camera set on the target road section. Specifically, a traffic camera is set on the target road section, and the traffic image of the target road section is collected by the traffic camera, and the vehicle recognition is performed on the traffic image to obtain the driving vehicle data of the target road section, and the driving vehicle data is stored in the server for reuse.
上述道路环境数据可以是目标路段的天气数据、道路湿度数据、道路温度数据、道路扫描数据、道路病害数据等。上述天气数据可以根据目标道路所在天气部门进行获取,上述道路扫描数据可以根据道路扫描车扫描目标道路时得到的数据进行获取,上述道路病害数据可以根据目标路段的道路扫描数据进行获取,也可以通过目标路段的道路巡查人员的记录进行获取。The road environment data may be weather data of the target road section, road humidity data, road temperature data, road scanning data, road disease data, etc. The weather data may be obtained from the weather department of the target road, the road scanning data may be obtained from the data obtained when a road scanning vehicle scans the target road, and the road disease data may be obtained from the road scanning data of the target road section or from the records of road inspectors of the target road section.
在得到目标路段的行驶车辆数据和道路环境数据后,筛选出与道路病害因子相关的数据,构建得到一个G=1×k×T的目标影响矩阵,上述目标影响矩阵中,k表示有k个道路病害影响因子,T表示时间维度。在得到目标影响矩阵,将目标影响矩阵输入到时序模型中进行预测,得到目标路段的道路病害预测结果。After obtaining the driving vehicle data and road environment data of the target road section, the data related to the road disease factor is screened out to construct a target impact matrix G = 1 × k × T. In the above target impact matrix, k represents k road disease impact factors, and T represents the time dimension. After obtaining the target impact matrix, the target impact matrix is input into the time series model for prediction to obtain the road disease prediction result of the target road section.
上述时序模型可以是基于循环神经网络RNN或长短时记忆网络LSTM的时序模型。在训练时序模型时,可以获取数据集和初始时序模型,上述数据集包括样本影响矩阵以及真实病害标签,上述样本影响矩阵与目标影响矩阵通过相同的处理方法来得到,将样本影响矩阵输入到初始时序模型,得到样本病害预测结果,计算样本病害预测结果与真实病害标签之间的误差损失,以最小误差损失为优化目标,对初始时序模型进行参数调整,迭代上述参数调整过程,直到迭代次数达到预设次数,或初始时序模型在最小化误差损失处收敛,停止训练,得到训练好的时序模型。The above-mentioned time series model can be a time series model based on a recurrent neural network RNN or a long short-term memory network LSTM. When training a time series model, a data set and an initial time series model can be obtained. The above-mentioned data set includes a sample influence matrix and a true disease label. The above-mentioned sample influence matrix and the target influence matrix are obtained by the same processing method. The sample influence matrix is input into the initial time series model to obtain the sample disease prediction result, and the error loss between the sample disease prediction result and the true disease label is calculated. With the minimum error loss as the optimization goal, the parameters of the initial time series model are adjusted, and the above-mentioned parameter adjustment process is iterated until the number of iterations reaches the preset number, or the initial time series model converges at the minimum error loss, the training is stopped, and the trained time series model is obtained.
在得到训练好的时序模型后,将目标影响矩阵输入到训练好的时序模型中,通过训练好的时序模型输出目标路段的道路病害预测结果。上审判员道路病害预测结果包括道路病害类型以及道路病害发生时间。After obtaining the trained time series model, the target impact matrix is input into the trained time series model, and the road damage prediction result of the target road section is output through the trained time series model. The road damage prediction result of the judge includes the road damage type and the time when the road damage occurs.
需要说明的是,本发明实施例提供的道路病害预测方法可以应用于可以进行道路病害预测方法的智能摄像头、智能手机、电脑、服务器等设备。It should be noted that the road damage prediction method provided in the embodiment of the present invention can be applied to smart cameras, smart phones, computers, servers and other devices that can perform the road damage prediction method.
可选的,请参见图2,图2是本发明实施例提供的一种道路病害预测装置的结构示意图,如图2所示,所述装置包括:Optionally, please refer to FIG. 2 , which is a schematic diagram of the structure of a road disease prediction device provided by an embodiment of the present invention. As shown in FIG. 2 , the device includes:
获取模块201,用于获取各个路段的历史行驶车辆数据以及历史道路环境数据;An acquisition module 201 is used to acquire historical vehicle driving data and historical road environment data of each road section;
确定模块202,用于根据所述历史行驶车辆数据以及历史道路环境数据,确定道路病害影响因子;A determination module 202, for determining a road disease impact factor based on the historical vehicle driving data and the historical road environment data;
预测模块203,用于根据所述道路病害影响因子,对所述目标路段的道路病害进行预测,得到所述目标路段的道路病害预测结果。The prediction module 203 is used to predict the road damage of the target road section according to the road damage influencing factor to obtain the road damage prediction result of the target road section.
可选的,所述确定模块202,包括:Optionally, the determining module 202 includes:
第一确定子模块,用于根据所述历史行驶车辆数据以及历史道路环境数据,确定道路病害的影响数据,所述影响数据包括第一数量个数据维度;A first determination submodule is used to determine the impact data of road diseases according to the historical vehicle driving data and the historical road environment data, wherein the impact data includes a first number of data dimensions;
处理子模块,用于对所述影响数据进行降维处理,得到样本降维数据,所述样本降维数据包括第二数量个数据维度,所述第二数量小于所述第一数量;a processing submodule, configured to perform dimensionality reduction processing on the influencing data to obtain sample dimensionality reduction data, wherein the sample dimensionality reduction data includes a second number of data dimensions, and the second number is smaller than the first number;
第二确定子模块,用于基于所述样本降维数据,确定道路病害影响因子。The second determination submodule is used to determine the road disease influencing factors based on the sample dimension reduction data.
可选的,所述处理子模块,包括:Optionally, the processing submodule includes:
第一确定单元,用于根据所述影响数据,确定第一影响矩阵,所述第一影响矩阵包括第一数量个数据维度;A first determining unit, configured to determine a first influence matrix according to the influence data, wherein the first influence matrix includes a first number of data dimensions;
处理单元,用于对所述第一影响矩阵进行降维处理,得到第二影响矩阵;A processing unit, configured to perform dimensionality reduction processing on the first influence matrix to obtain a second influence matrix;
第二确定单元,用于基于所述第一影响矩阵与所述第二影响矩阵,确定所述样本降维数据。The second determining unit is used to determine the sample dimension reduction data based on the first influence matrix and the second influence matrix.
可选的,所述处理单元,包括:Optionally, the processing unit includes:
确定子单元,用于确定所述第一影响矩阵的协方差矩阵;A determination subunit, configured to determine a covariance matrix of the first influence matrix;
处理子单元,用于基于所述第一影响矩阵的协方差矩阵,对所述第一影响矩阵进行降维处理,得到第二影响矩阵。A processing subunit is used to perform dimensionality reduction processing on the first influence matrix based on the covariance matrix of the first influence matrix to obtain a second influence matrix.
可选的,所述处理子单元还用于计算所述第一影响矩阵的协方差矩阵;计算所述协方差矩阵的特征值以及所述特征值对应的特征向量;根据所述特征值最大的第二数量个所述特征向量得到所述中间矩阵,根据所述第一影响矩阵与所述中间矩阵确定第二影响矩阵。Optionally, the processing sub-unit is also used to calculate the covariance matrix of the first influence matrix; calculate the eigenvalues of the covariance matrix and the eigenvectors corresponding to the eigenvalues; obtain the intermediate matrix based on the second number of eigenvectors with the largest eigenvalues, and determine the second influence matrix based on the first influence matrix and the intermediate matrix.
可选的,所述处理子单元还用于将所述第一影响矩阵与所述中间矩阵进行相乘,得到第二影响矩阵。Optionally, the processing subunit is further used to multiply the first influence matrix and the intermediate matrix to obtain a second influence matrix.
可选的,所述预测模块203,包括:Optionally, the prediction module 203 includes:
获取子模块,用于获取所述目标路段的行驶车辆数据以及道路环境数据;An acquisition submodule, used to acquire the driving vehicle data and road environment data of the target road section;
第三确定子模块,用于根据所述道路病害影响因子,确定所述目标路段的目标影响矩阵;A third determination submodule is used to determine the target impact matrix of the target road section according to the road disease impact factor;
预测子模块,用于基于所述目标影响矩阵,对所述目标路段的道路病害进行预测,得到所述目标路段的道路病害预测结果。The prediction submodule is used to predict the road damage of the target road section based on the target impact matrix to obtain the road damage prediction result of the target road section.
需要说明的是,本发明实施例提供的道路病害预测装置可以应用于可以进行道路病害预测方法的智能摄像头、智能手机、电脑、服务器等设备。It should be noted that the road damage prediction device provided in the embodiment of the present invention can be applied to smart cameras, smart phones, computers, servers and other devices that can perform road damage prediction methods.
本发明实施例提供的道路病害预测装置能够实现上述方法实施例中道路病害预测方法实现的各个过程,且可以达到相同的有益效果。为避免重复,这里不再赘述。The road damage prediction device provided in the embodiment of the present invention can implement each process implemented by the road damage prediction method in the above method embodiment and can achieve the same beneficial effects. To avoid repetition, it will not be described here.
参见图3,图3是本发明实施例提供的一种电子设备的结构示意图,如图3所示,包括:存储器302、处理器301及存储在所述存储器302上并可在所述处理器301上运行的道路病害预测方法的计算机程序,其中:Referring to FIG. 3 , FIG. 3 is a schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. As shown in FIG. 3 , the electronic device includes: a memory 302, a processor 301, and a computer program of a road damage prediction method stored in the memory 302 and executable on the processor 301, wherein:
处理器301用于调用存储器302存储的计算机程序,执行如下步骤:The processor 301 is used to call the computer program stored in the memory 302 and execute the following steps:
获取各个路段的历史行驶车辆数据以及历史道路环境数据;Obtain historical vehicle driving data and historical road environment data for each road section;
根据所述历史行驶车辆数据以及历史道路环境数据,确定道路病害影响因子;Determining road disease influencing factors based on the historical vehicle driving data and historical road environment data;
根据所述道路病害影响因子,对所述目标路段的道路病害进行预测,得到所述目标路段的道路病害预测结果。The road damage of the target road section is predicted according to the road damage influencing factor to obtain a road damage prediction result of the target road section.
可选的,处理器301执行的所述根据所述历史行驶车辆数据以及历史道路环境数据,确定道路病害影响因子,包括:Optionally, the determining of the road disease impact factor according to the historical vehicle driving data and the historical road environment data performed by the processor 301 includes:
根据所述历史行驶车辆数据以及历史道路环境数据,确定道路病害的影响数据,所述影响数据包括第一数量个数据维度;Determine, according to the historical vehicle driving data and the historical road environment data, the impact data of road diseases, wherein the impact data includes a first number of data dimensions;
对所述影响数据进行降维处理,得到样本降维数据,所述样本降维数据包括第二数量个数据维度,所述第二数量小于所述第一数量;Performing dimensionality reduction processing on the influencing data to obtain sample dimensionality reduction data, wherein the sample dimensionality reduction data includes a second number of data dimensions, and the second number is smaller than the first number;
基于所述样本降维数据,确定道路病害影响因子。Based on the sample dimension reduction data, the road disease influencing factors are determined.
可选的,处理器301执行的所述对所述影响数据进行降维处理,得到样本降维数据,所述样本降维数据包括第二数量个数据维度,包括:Optionally, the processor 301 performs dimensionality reduction processing on the impact data to obtain sample dimensionality reduction data, where the sample dimensionality reduction data includes a second number of data dimensions, including:
根据所述影响数据,确定第一影响矩阵,所述第一影响矩阵包括第一数量个数据维度;Determine a first influence matrix according to the influence data, wherein the first influence matrix includes a first number of data dimensions;
对所述第一影响矩阵进行降维处理,得到第二影响矩阵;Performing dimensionality reduction processing on the first influence matrix to obtain a second influence matrix;
基于所述第一影响矩阵与所述第二影响矩阵,确定所述样本降维数据。The sample dimension reduction data is determined based on the first influence matrix and the second influence matrix.
可选的,处理器301执行的所述对所述第一影响矩阵进行降维处理,得到第二影响矩阵,包括:Optionally, the processor 301 performs dimensionality reduction processing on the first influence matrix to obtain a second influence matrix, including:
确定所述第一影响矩阵的协方差矩阵;determining a covariance matrix of the first influence matrix;
基于所述第一影响矩阵的协方差矩阵,对所述第一影响矩阵进行降维处理,得到第二影响矩阵。Based on the covariance matrix of the first influence matrix, dimension reduction processing is performed on the first influence matrix to obtain a second influence matrix.
可选的,处理器301执行的所述基于所述第一影响矩阵的协方差矩阵,对所述第一影响矩阵进行降维处理,得到第二影响矩阵,包括:Optionally, the processor 301 performs dimensionality reduction processing on the first influence matrix based on the covariance matrix of the first influence matrix to obtain a second influence matrix, including:
计算所述第一影响矩阵的协方差矩阵;Calculating a covariance matrix of the first influence matrix;
计算所述协方差矩阵的特征值以及所述特征值对应的特征向量;Calculate the eigenvalues of the covariance matrix and the eigenvectors corresponding to the eigenvalues;
根据所述特征值最大的第二数量个所述特征向量得到所述中间矩阵,根据所述第一影响矩阵与所述中间矩阵确定第二影响矩阵。The intermediate matrix is obtained according to a second number of the eigenvectors with the largest eigenvalues, and a second influence matrix is determined according to the first influence matrix and the intermediate matrix.
可选的,处理器301执行的所述根据所述特征值最大的第二数量个所述特征向量得到所述中间矩阵,根据所述第一影响矩阵与所述中间矩阵确定第二影响矩阵,包括:Optionally, the processor 301 executes the step of obtaining the intermediate matrix according to the second number of eigenvectors with the largest eigenvalues, and determining the second influence matrix according to the first influence matrix and the intermediate matrix, including:
将所述第一影响矩阵与所述中间矩阵进行相乘,得到第二影响矩阵。The first influence matrix is multiplied by the intermediate matrix to obtain a second influence matrix.
可选的,处理器301执行的所述根据所述道路病害影响因子,对所述目标路段的道路病害进行预测,得到所述目标路段的道路病害预测结果,包括:Optionally, the processor 301 predicts the road damage of the target road section according to the road damage influencing factor to obtain the road damage prediction result of the target road section, including:
获取所述目标路段的行驶车辆数据以及道路环境数据;Acquiring driving vehicle data and road environment data of the target road section;
根据所述道路病害影响因子,确定所述目标路段的目标影响矩阵;Determining a target impact matrix of the target road section according to the road disease impact factor;
基于所述目标影响矩阵,对所述目标路段的道路病害进行预测,得到所述目标路段的道路病害预测结果。Based on the target impact matrix, the road damage of the target road section is predicted to obtain the road damage prediction result of the target road section.
本发明实施例提供的电子设备能够实现上述方法实施例中道路病害预测方法实现的各个过程,且可以达到相同的有益效果。为避免重复,这里不再赘述。The electronic device provided in the embodiment of the present invention can implement each process implemented by the road damage prediction method in the above method embodiment and can achieve the same beneficial effect. To avoid repetition, it will not be described here.
本发明实施例还提供一种计算机可读存储介质,计算机可读存储介质上存储有计算机程序,该计算机程序被处理器执行时实现本发明实施例提供的道路病害预测方法的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the various processes of the road damage prediction method provided by the embodiment of the present invention are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的程序可存储于一计算机可读取存储介质中,该程序在执行时,可包括如上述各方法的实施例的流程。其中,所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Nenory,RON)或随机存取存储器(Randon Access Nenory,简称RAN)等。Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. The storage medium can be a disk, an optical disk, a read-only storage memory (RON) or a random access memory (RAN).

Claims (20)

  1. [援引加入(细则20.6)12.12.2023]
    一种道路病害预测方法,其特征在于,包括以下步骤:
    [Incorporated by reference (Rule 20.6) 12.12.2023]
    A road damage prediction method, characterized in that it comprises the following steps:
    获取各个路段的历史行驶车辆数据以及历史道路环境数据;Obtain historical vehicle driving data and historical road environment data for each road section;
    根据所述历史行驶车辆数据以及历史道路环境数据,确定道路病害影响因子;Determining road disease influencing factors based on the historical vehicle driving data and historical road environment data;
    根据所述道路病害影响因子,对所述目标路段的道路病害进行预测,得到所述目标路段的道路病害预测结果。The road damage of the target road section is predicted according to the road damage influencing factor to obtain a road damage prediction result of the target road section.
  2. [援引加入(细则20.6)12.12.2023]
    如权利要求1所述的道路病害预测方法,其特征在于,所述根据所述历史行驶车辆数据以及历史道路环境数据,确定道路病害影响因子,包括:
    [Incorporated by reference (Rule 20.6) 12.12.2023]
    The road damage prediction method according to claim 1, characterized in that the road damage influencing factor is determined based on the historical vehicle driving data and the historical road environment data, comprising:
    根据所述历史行驶车辆数据以及历史道路环境数据,确定道路病害的影响数据,所述影响数据包括第一数量个数据维度;Determine, according to the historical vehicle driving data and the historical road environment data, the impact data of road diseases, wherein the impact data includes a first number of data dimensions;
    对所述影响数据进行降维处理,得到样本降维数据,所述样本降维数据包括第二数量个数据维度,所述第二数量小于所述第一数量;Performing dimensionality reduction processing on the influencing data to obtain sample dimensionality reduction data, wherein the sample dimensionality reduction data includes a second number of data dimensions, and the second number is smaller than the first number;
    基于所述样本降维数据,确定道路病害影响因子。Based on the sample dimension reduction data, the road disease influencing factors are determined.
  3. [援引加入(细则20.6)12.12.2023]
    如权利要求2所述的道路病害预测方法,其特征在于,所述对所述影响数据进行降维处理,得到样本降维数据,所述样本降维数据包括第二数量个数据维度,包括:
    [Incorporated by reference (Rule 20.6) 12.12.2023]
    The road damage prediction method according to claim 2, characterized in that the dimension reduction processing is performed on the impact data to obtain sample dimension reduction data, and the sample dimension reduction data includes a second number of data dimensions, including:
    根据所述影响数据,确定第一影响矩阵,所述第一影响矩阵包括第一数量个数据维度;Determine a first influence matrix according to the influence data, wherein the first influence matrix includes a first number of data dimensions;
    对所述第一影响矩阵进行降维处理,得到第二影响矩阵;Performing dimensionality reduction processing on the first influence matrix to obtain a second influence matrix;
    基于所述第一影响矩阵与所述第二影响矩阵,确定所述样本降维数据。The sample dimension reduction data is determined based on the first influence matrix and the second influence matrix.
  4. [援引加入(细则20.6)12.12.2023]
    如权利要求3所述的道路病害预测方法,其特征在于,所述对所述第一影响矩阵进行降维处理,得到第二影响矩阵,包括:
    [Incorporated by reference (Rule 20.6) 12.12.2023]
    The road damage prediction method according to claim 3, characterized in that the step of performing dimensionality reduction processing on the first influence matrix to obtain the second influence matrix comprises:
    确定所述第一影响矩阵的协方差矩阵;determining a covariance matrix of the first influence matrix;
    基于所述第一影响矩阵的协方差矩阵,对所述第一影响矩阵进行降维处理,得到第二影响矩阵。Based on the covariance matrix of the first influence matrix, dimension reduction processing is performed on the first influence matrix to obtain a second influence matrix.
  5. [援引加入(细则20.6)12.12.2023]
    如权利要求4所述的道路病害预测方法,其特征在于,所述基于所述第一影响矩阵的协方差矩阵,对所述第一影响矩阵进行降维处理,得到第二影响矩阵,包括:
    [Incorporated by reference (Rule 20.6) 12.12.2023]
    The road damage prediction method according to claim 4, characterized in that the covariance matrix based on the first influence matrix performs dimensionality reduction processing on the first influence matrix to obtain the second influence matrix, comprising:
    计算所述第一影响矩阵的协方差矩阵;Calculating a covariance matrix of the first influence matrix;
    计算所述协方差矩阵的特征值以及所述特征值对应的特征向量;Calculate the eigenvalues of the covariance matrix and the eigenvectors corresponding to the eigenvalues;
    根据所述特征值最大的第二数量个所述特征向量得到所述中间矩阵,根据所述第一影响矩阵与所述中间矩阵确定第二影响矩阵。The intermediate matrix is obtained according to a second number of the eigenvectors with the largest eigenvalues, and a second influence matrix is determined according to the first influence matrix and the intermediate matrix.
  6. [援引加入(细则20.6)12.12.2023]
    如权利要求5所述的道路病害预测方法,其特征在于,所述根据所述特征值最大的第二数量个所述特征向量得到所述中间矩阵,根据所述第一影响矩阵与所述中间矩阵确定第二影响矩阵,包括:
    [Incorporated by reference (Rule 20.6) 12.12.2023]
    The road damage prediction method according to claim 5 is characterized in that the step of obtaining the intermediate matrix according to the second number of eigenvectors with the largest eigenvalues, and determining the second influence matrix according to the first influence matrix and the intermediate matrix comprises:
    将所述第一影响矩阵与所述中间矩阵进行相乘,得到第二影响矩阵。The first influence matrix is multiplied by the intermediate matrix to obtain a second influence matrix.
  7. [援引加入(细则20.6)12.12.2023]
    如权利要求6所述的道路病害预测方法,其特征在于,所述根据所述道路病害影响因子,对所述目标路段的道路病害进行预测,得到所述目标路段的道路病害预测结果,包括:
    [Incorporated by reference (Rule 20.6) 12.12.2023]
    The road damage prediction method according to claim 6 is characterized in that the road damage of the target road section is predicted according to the road damage influencing factor to obtain the road damage prediction result of the target road section, comprising:
    获取所述目标路段的行驶车辆数据以及道路环境数据;Acquiring driving vehicle data and road environment data of the target road section;
    根据所述道路病害影响因子,确定所述目标路段的目标影响矩阵;Determining a target impact matrix of the target road section according to the road disease impact factor;
    基于所述目标影响矩阵,对所述目标路段的道路病害进行预测,得到所述目标路段的道路病害预测结果。Based on the target impact matrix, the road damage of the target road section is predicted to obtain the road damage prediction result of the target road section.
  8. [援引加入(细则20.6)12.12.2023]
    一种道路病害预测装置,其特征在于,所述装置包括:
    [Incorporated by reference (Rule 20.6) 12.12.2023]
    A road damage prediction device, characterized in that the device comprises:
    获取模块,用于获取各个路段的历史行驶车辆数据以及历史道路环境数据;An acquisition module is used to acquire historical vehicle driving data and historical road environment data of each road section;
    确定模块,用于根据所述历史行驶车辆数据以及历史道路环境数据,确定道路病害影响因子;A determination module, used to determine the road disease impact factor based on the historical vehicle driving data and the historical road environment data;
    预测模块,用于根据所述道路病害影响因子,对所述目标路段的道路病害进行预测,得到所述目标路段的道路病害预测结果。The prediction module is used to predict the road damage of the target road section according to the road damage influencing factor to obtain the road damage prediction result of the target road section.
  9. [援引加入(细则20.6)12.12.2023]
    一种电子设备,其特征在于,包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现如权利要求1至7中任一项所述的道路病害预测方法中的步骤。
    [Incorporated by reference (Rule 20.6) 12.12.2023]
    An electronic device, characterized in that it comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the steps in the road damage prediction method as described in any one of claims 1 to 7 are implemented.
  10. [援引加入(细则20.6)12.12.2023]
    一种计算机可读存储介质,其特征在于,所述计算机可读存储介质上存储有计算机程序,所述计算机程序被处理器执行时实现如权利要求1至7中任一项所述的道路病害预测方法中的步骤。
    [Incorporated by reference (Rule 20.6) 12.12.2023]
    A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps in the road damage prediction method as described in any one of claims 1 to 7 are implemented.
  11. [错误提交(细则20.5之二)]
    一种道路病害的识别方法,适用于设备端,其特征在于,包括以下步骤:
    [Incorrect filing (Rule 20.5bis)]
    A method for identifying road damage, applicable to a device, is characterized by comprising the following steps:
    提取道路病害图像的特征图,所述道路病害图像包括目标物;Extracting a feature map of a road damage image, wherein the road damage image includes a target object;
    将所述特征图输入至预设的目标神经网络预测模型中进行区域分割,并根据分割得到的区域的区域像素值计算权重值;Inputting the feature map into a preset target neural network prediction model for region segmentation, and calculating weight values according to the region pixel values of the segmented region;
    基于分割得到的区域的所述权重值以及所述区域像素值,获取下采样特征图,所述下采样特征图中包括所述目标物;Based on the weight value of the segmented region and the pixel value of the region, a downsampled feature map is obtained, wherein the downsampled feature map includes the target object;
    对所述下采样特征图中的所述目标物进行特征信息增强,得到目标特征图,所述目标特征图包括所述目标物的病害类别的置信度;Performing feature information enhancement on the target object in the downsampled feature map to obtain a target feature map, wherein the target feature map includes a confidence level of a disease category of the target object;
    基于所述置信度判断所述目标物所属的病害类别。The disease category to which the target object belongs is determined based on the confidence level.
  12. [错误提交(细则20.5之二)]
    如权利要求1所述的方法,其特征在于,所述将所述特征图输入至预设的目标神经网络预测模型中进行区域分割,并根据分割得到的区域的区域像素值计算权重值,包括:
    [Incorrect filing (Rule 20.5bis)]
    The method according to claim 1, characterized in that the step of inputting the feature map into a preset target neural network prediction model for region segmentation, and calculating weight values according to regional pixel values of the segmented regions, comprises:
    将所述特征图预处理后,输入至所述预设的目标神经网络预测模型中进行训练,所述预设的目标神经网络预测模型包括骨干网络模型;After preprocessing, the feature graph is input into the preset target neural network prediction model for training, wherein the preset target neural network prediction model includes a backbone network model;
    基于所述骨干网络模型,按照预设大小对所述道路病害图像进行区域分割,分割得到的每个区域对应一个所述区域像素值;Based on the backbone network model, the road damage image is segmented into regions according to a preset size, and each region obtained by segmentation corresponds to a pixel value of the region;
    通过归一化指数函数对分割得到的区域进行归一化处理,将每个区域的所述区域像素值转换为所述权重值。The segmented regions are normalized by a normalized exponential function, and the region pixel value of each region is converted into the weight value.
  13. [错误提交(细则20.5之二)]
    如权利要求1所述的方法,其特征在于,所述基于分割得到的区域的所述权重值以及所述区域像素值,获取下采样特征图,包括:
    [Incorrect filing (Rule 20.5bis)]
    The method according to claim 1, characterized in that the step of obtaining a downsampled feature map based on the weight value of the segmented region and the pixel value of the region comprises:
    针对分割得到的每个区域,基于所述区域的所述权重值与所述区域像素值计算所述区域的区域像素权值;For each region obtained by segmentation, a region pixel weight of the region is calculated based on the weight value of the region and the region pixel value;
    基于计算的得到所有区域的区域像素权值,获取所述下采样特征图。Based on the calculated regional pixel weights of all regions, the downsampled feature map is obtained.
  14. [错误提交(细则20.5之二)]
    如权利要求2所述的方法,其特征在于,所述对所述下采样特征图中的所述目标物特征进行特征信息增强,得到目标特征图,包括:
    [Incorrect filing (Rule 20.5bis)]
    The method according to claim 2, characterized in that the step of enhancing feature information of the target object features in the downsampled feature map to obtain a target feature map comprises:
    对所述下采样特征图进行卷积操作,获取到第一卷积子特征图、第二卷积子特征图以及第三卷积子特征图;Performing a convolution operation on the downsampled feature map to obtain a first convolution sub-feature map, a second convolution sub-feature map, and a third convolution sub-feature map;
    将所述第二卷积子特征图转置,并与所述第一卷积子特征图点积计算得到特征卷积矩阵;Transpose the second convolution sub-feature map, and calculate the dot product with the first convolution sub-feature map to obtain a feature convolution matrix;
    基于所述归一化指数函数对所述特征卷积矩阵进行归一化,得到所述下采样特征图中每个像素对应的像素权重值;Normalizing the feature convolution matrix based on the normalized exponential function to obtain a pixel weight value corresponding to each pixel in the downsampled feature map;
    基于所述下采样特征图中每个像素对应的像素权重值与所述第三卷积子特征图点积计算得到待分解特征图;The feature map to be decomposed is obtained based on the dot product calculation of the pixel weight value corresponding to each pixel in the downsampled feature map and the third convolution sub-feature map;
    对所述待分解特征图进行分解及归一化处理,得到所述目标特征图。The feature map to be decomposed is decomposed and normalized to obtain the target feature map.
  15. [错误提交(细则20.5之二)]
    如权利要求4所述的方法,其特征在于,所述对所述待分解特征图进行分解及归一化处理,得到所述目标特征图,包括:
    [Incorrect filing (Rule 20.5bis)]
    The method according to claim 4, characterized in that the decomposing and normalizing the feature map to be decomposed to obtain the target feature map comprises:
    将所述待分解特征图分解为第一分解特征图、第二分解特征图以及第三分解特征图;Decomposing the to-be-decomposed characteristic graph into a first decomposition characteristic graph, a second decomposition characteristic graph, and a third decomposition characteristic graph;
    分别对所述第一分解特征图、所述第二分解特征图以及所述第三分解特征图依次进行编码与解码处理,得到解码后的第一分解特征图、解码后的第二分解特征图以及解码后的第三分解特征图;The first decomposition feature graph, the second decomposition feature graph and the third decomposition feature graph are respectively encoded and decoded in sequence to obtain a decoded first decomposition feature graph, a decoded second decomposition feature graph and a decoded third decomposition feature graph;
    将所述解码后的第一分解特征图、所述解码后的第二分解特征图以及所述解码后的第三分解特征图进行连接,并进行标准归一化处理,得到所述目标特征图。The decoded first decomposition feature graph, the decoded second decomposition feature graph and the decoded third decomposition feature graph are connected and subjected to standard normalization processing to obtain the target feature graph.
  16. [错误提交(细则20.5之二)]
    如权利要求2所述的方法,其特征在于,所述将所述特征图预处理,包括:
    [Incorrect filing (Rule 20.5bis)]
    The method according to claim 2, characterized in that the preprocessing of the feature map comprises:
    将所述道路病害图像的所述特征图根据预设缩放比例进行缩放,得到所述预设的目标神经网络预测模型的标准输入尺寸。The feature map of the road damage image is scaled according to a preset scaling ratio to obtain a preset standard input size of the target neural network prediction model.
  17. [错误提交(细则20.5之二)]
    一种道路病害的重识别方法,适用于平台端,其特征在于,包括以下步骤:
    [Incorrect filing (Rule 20.5bis)]
    A road disease re-identification method, applicable to a platform end, is characterized by comprising the following steps:
    平台端获取设备端上传的存在道路病害的道路病害图像,基于所述道路病害图像的位置坐标,在不同时间及空间条件下采集多个同类别的重识别图像;The platform end obtains a road disease image with road diseases uploaded by the device end, and based on the position coordinates of the road disease image, collects a plurality of re-identified images of the same category under different time and space conditions;
    将多张所述重识别图像通过特征损失函数进行重识别,对输出的多维特征进行特征距离计算;Re-identify the plurality of re-identified images using a feature loss function, and calculate feature distances on the output multi-dimensional features;
    若所述特征距离满足预设距离阈值,则判断所述道路病害图像与所述重识别图像为同一病害类别。If the characteristic distance meets the preset distance threshold, it is determined that the road damage image and the re-identified image are of the same damage category.
  18. [错误提交(细则20.5之二)]
    一种道路病害的识别装置,适用于设备端,其特征在于,包括:
    [Incorrect filing (Rule 20.5bis)]
    A road disease identification device, applicable to a device end, characterized by comprising:
    第一获取模块,用于提取道路病害图像的特征图,所述道路病害图像包括目标物;A first acquisition module is used to extract a feature map of a road damage image, wherein the road damage image includes a target object;
    分割模块,用于将所述特征图输入至预设的目标神经网络预测模型中进行区域分割,并根据分割得到的区域的区域像素值计算权重值;A segmentation module, used for inputting the feature map into a preset target neural network prediction model for region segmentation, and calculating weight values according to the region pixel values of the segmented region;
    第二获取模块,用于基于分割得到的区域的所述权重值以及所述区域像素值,获取下采样特征图,所述下采样特征图中包括所述目标物;A second acquisition module is used to acquire a down-sampled feature map based on the weight value of the segmented region and the pixel value of the region, wherein the down-sampled feature map includes the target object;
    特征增强模块,用于对所述下采样特征图中的所述目标物进行特征信息增强,得到目标特征图,所述目标特征图包括所述目标物的病害类别的置信度;A feature enhancement module, used for enhancing feature information of the target object in the downsampled feature map to obtain a target feature map, wherein the target feature map includes a confidence level of a disease category of the target object;
    第一判断模块,用于基于所述置信度判断所述目标物所属的病害类别。The first judgment module is used to judge the disease category of the target object based on the confidence level.
  19. [错误提交(细则20.5之二)]
    一种电子设备,其特征在于,包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现如权利要求1-6中任一项所述的一种道路病害的识别方法以及如权利要求7中所述的一种道路病害的识别方法中的步骤。
    [Incorrect filing (Rule 20.5bis)]
    An electronic device, characterized in that it comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, it implements a method for identifying road damage as described in any one of claims 1 to 6 and the steps in a method for identifying road damage as described in claim 7.
  20. [错误提交(细则20.5之二)]
    一种计算机可读存储介质,其特征在于,所述计算机可读存储介质上存储有计算机程序,所述计算机程序被处理器执行时实现如权利要求1-6中任一项所述的一种道路病害的识别方法以及如权利要求7中所述的一种道路病害的识别方法中的步骤。
    [Incorrect filing (Rule 20.5bis)]
    A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, it implements the method for identifying road damage as described in any one of claims 1 to 6 and the steps in the method for identifying road damage as described in claim 7.
PCT/CN2023/114730 2022-12-31 2023-08-24 Road disease prediction method and apparatus, electronic device and storage medium WO2024139287A1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211739057.4 2022-12-31

Publications (1)

Publication Number Publication Date
WO2024139287A1 true WO2024139287A1 (en) 2024-07-04

Family

ID=

Similar Documents

Publication Publication Date Title
Wang et al. Asphalt pavement pothole detection and segmentation based on wavelet energy field
Chen et al. Pavement crack detection and classification based on fusion feature of LBP and PCA with SVM
Cao et al. Survey on performance of deep learning models for detecting road damages using multiple dashcam image resources
Cheng et al. Real-time image thresholding based on sample space reduction and interpolation approach
CN106683073B (en) License plate detection method, camera and server
CN107239778B (en) Efficient and accurate license plate recognition method
Deb et al. An efficient method of vehicle license plate recognition based on sliding concentric windows and artificial neural network
CN111681240A (en) Bridge surface crack detection method based on YOLO v3 and attention mechanism
EP3004850A1 (en) Mobile pothole detection system and method
Antar et al. Automatic number plate recognition of Saudi license car plates
CN112307989B (en) Road surface object identification method, device, computer equipment and storage medium
CN115995056A (en) Automatic bridge disease identification method based on deep learning
CN113240623A (en) Pavement disease detection method and device
CN113269042A (en) Intelligent traffic management method and system based on running vehicle violation identification
Katsamenis et al. A few-shot attention recurrent residual U-Net for crack segmentation
CN114283383A (en) Smart city highway maintenance method, computer equipment and medium
CN1259663A (en) Automatic evaluation method of casting ingot cross section quality
CN116432095A (en) Road disease prediction method, device, electronic equipment and storage medium
WO2024139287A1 (en) Road disease prediction method and apparatus, electronic device and storage medium
CN116523871A (en) Method and device for detecting defects of machined part, electronic equipment and storage medium
CN110751623A (en) Joint feature-based defect detection method, device, equipment and storage medium
CN116152758A (en) Intelligent real-time accident detection and vehicle tracking method
Adak et al. Automatic number plate recognition (ANPR) with YOLOv3-CNN
CN115512315A (en) Non-motor vehicle child riding detection method, electronic device and storage medium
CN112861701B (en) Illegal parking identification method, device, electronic equipment and computer readable medium