CN111898502A - Dangerous goods vehicle identification method, device, computer storage medium, and electronic equipment - Google Patents
Dangerous goods vehicle identification method, device, computer storage medium, and electronic equipment Download PDFInfo
- Publication number
- CN111898502A CN111898502A CN202010698582.0A CN202010698582A CN111898502A CN 111898502 A CN111898502 A CN 111898502A CN 202010698582 A CN202010698582 A CN 202010698582A CN 111898502 A CN111898502 A CN 111898502A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- dangerous goods
- neural network
- convolutional neural
- level
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
- G06F18/2415—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on parametric or probabilistic models, e.g. based on likelihood ratio or false acceptance rate versus a false rejection rate
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/084—Backpropagation, e.g. using gradient descent
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
- G06V20/42—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items of sport video content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/08—Detecting or categorising vehicles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/09—Recognition of logos
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Life Sciences & Earth Sciences (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Computational Linguistics (AREA)
- Computing Systems (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Health & Medical Sciences (AREA)
- Biophysics (AREA)
- Mathematical Physics (AREA)
- Biomedical Technology (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Molecular Biology (AREA)
- Evolutionary Biology (AREA)
- Probability & Statistics with Applications (AREA)
- Image Analysis (AREA)
Abstract
危险品车辆识别方法、装置及计算机存储介质、电子设备,包括:获取道路图像;利用预先训练得到的多级串联卷积神经网络识别所述道路图像中的危险品车辆;多级串联卷积神经网络包括第一级卷积神经网络、第二级卷积神经网络和第三级卷积神经网络,第一级卷积神经网络识别道路图像中危险品车辆及其车辆区域;第二级卷积神经网络根据车辆区域的截图识别车辆区域的危险品标志;第三级卷积神经网络根据车辆区域的截图识别车辆类型并判断危险品标志的置信度,根据车辆类型和危险品标志的置信度得到危险品车辆概率。采用本申请中的方案,能够准确识别危险品车身上的各类危险品标志,实现全自动、准确、高效的智能识别危险品车辆。
A method, device, computer storage medium, and electronic equipment for identifying dangerous goods vehicles, including: acquiring road images; identifying dangerous goods vehicles in the road images by using a multi-level series convolutional neural network obtained by pre-training; The network includes the first-level convolutional neural network, the second-level convolutional neural network and the third-level convolutional neural network. The first-level convolutional neural network identifies dangerous goods vehicles and their vehicle areas in road images; the second-level convolutional neural network The neural network recognizes the dangerous goods signs in the vehicle area according to the screenshots of the vehicle area; the third-level convolutional neural network identifies the vehicle type according to the screenshots of the vehicle area and judges the confidence level of the dangerous goods signs, which is obtained according to the vehicle type and the confidence level of the dangerous goods signs. Dangerous Goods Vehicle Probability. By adopting the solution in the present application, various types of dangerous goods signs on the body of dangerous goods can be accurately identified, and automatic, accurate and efficient intelligent identification of dangerous goods vehicles can be realized.
Description
技术领域technical field
本申请涉及智能交通技术,具体地,涉及一种危险品车辆识别方法、装置及计算机存储介质、电子设备。The present application relates to intelligent transportation technology, and in particular, to a method and device for identifying vehicles with dangerous goods, a computer storage medium, and an electronic device.
背景技术Background technique
危险品运输车是运送石油化工品、炸药、鞭炮等危险品的专用车辆。因其安全条件要求高、事故危害性大,故对其管控非常严格。Dangerous goods transport vehicle is a special vehicle for transporting petrochemicals, explosives, firecrackers and other dangerous goods. Because of its high safety requirements and high accident hazards, its control is very strict.
现有技术中存在的问题:Problems existing in the prior art:
目前的管控方式主要依靠人力,成本高、效率低。无法做到大范围、及时的监管。The current management and control methods mainly rely on manpower, which is costly and inefficient. Large-scale and timely supervision cannot be achieved.
发明内容SUMMARY OF THE INVENTION
本申请实施例中提供了一种危险品车辆识别方法、装置及计算机存储介质、电子设备,以解决上述技术问题。Embodiments of the present application provide a method and device for identifying dangerous goods vehicles, a computer storage medium, and an electronic device to solve the above-mentioned technical problems.
根据本申请实施例的第一个方面,提供了一种危险品车辆识别方法,包括如下步骤:According to a first aspect of the embodiments of the present application, a method for identifying a dangerous goods vehicle is provided, including the following steps:
获取道路图像;Get road images;
利用预先训练得到的多级串联卷积神经网络识别所述道路图像中的危险品车辆;Identifying the dangerous goods vehicle in the road image by using the multi-stage series convolutional neural network obtained by pre-training;
其中,所述多级串联卷积神经网络包括第一级卷积神经网络、第二级卷积神经网络和第三级卷积神经网络,所述第一级卷积神经网络识别所述道路图像中危险品车辆及其车辆区域;所述第二级卷积神经网络根据所述第一级卷积神经网络返回的车辆区域的截图识别所述车辆区域的危险品标志;所述第三级卷积神经网络根据所述第一级卷积神经网络返回的车辆区域的截图识别车辆类型并判断所述危险品标志的置信度,根据车辆类型和危险品标志的置信度得到危险品车辆概率。Wherein, the multi-level series convolutional neural network includes a first-level convolutional neural network, a second-level convolutional neural network and a third-level convolutional neural network, and the first-level convolutional neural network identifies the road image Medium-dangerous goods vehicles and their vehicle areas; the second-level convolutional neural network identifies the dangerous goods signs in the vehicle area according to the screenshot of the vehicle area returned by the first-level convolutional neural network; the third-level volume The convolutional neural network identifies the vehicle type according to the screenshot of the vehicle area returned by the first-level convolutional neural network and judges the confidence level of the dangerous goods sign, and obtains the dangerous goods vehicle probability according to the vehicle type and the confidence level of the dangerous goods sign.
根据本申请实施例的第二个方面,提供了一种危险品车辆识别装置,包括:According to a second aspect of the embodiments of the present application, there is provided a vehicle identification device for dangerous goods, including:
获取模块,用于获取道路图像;an acquisition module for acquiring road images;
识别模块,用于利用预先训练得到的多级串联卷积神经网络识别所述道路图像中的危险品车辆;an identification module for identifying dangerous goods vehicles in the road image by using the multi-stage series convolutional neural network obtained by pre-training;
其中,所述两级串联卷积神经网络包括第一级卷积神经网络、第二级卷积神经网络和第三级卷积神经网络,所述第一级卷积神经网络识别所述道路图像中危险品车辆及其车辆区域;所述第二级卷积神经网络根据所述第一级卷积神经网络返回的车辆区域的截图识别所述车辆区域的危险品标志;所述第三级卷积神经网络根据所述第一级卷积神经网络返回的车辆区域的截图识别车辆类型并判断所述危险品标志的置信度,根据车辆类型和危险品标志的置信度得到危险品车辆概率。The two-stage convolutional neural network in series includes a first-stage convolutional neural network, a second-stage convolutional neural network and a third-stage convolutional neural network, and the first-stage convolutional neural network identifies the road image Medium-dangerous goods vehicles and their vehicle areas; the second-level convolutional neural network identifies the dangerous goods signs in the vehicle area according to the screenshot of the vehicle area returned by the first-level convolutional neural network; the third-level volume The convolutional neural network identifies the vehicle type according to the screenshot of the vehicle area returned by the first-level convolutional neural network and judges the confidence level of the dangerous goods sign, and obtains the dangerous goods vehicle probability according to the vehicle type and the confidence level of the dangerous goods sign.
根据本申请实施例的第三个方面,提供了一种计算机存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现如上所述危险品车辆识别方法的步骤。According to a third aspect of the embodiments of the present application, a computer storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, implements the steps of the above method for identifying a vehicle with dangerous goods.
根据本申请实施例的第四个方面,提供了一种电子设备,包括存储器、以及一个或多个处理器,所述存储器用于存储一个或多个程序;所述一个或多个程序被所述一个或多个处理器执行时,实现如上所述的危险品车辆识别方法。According to a fourth aspect of the embodiments of the present application, an electronic device is provided, including a memory and one or more processors, where the memory is used to store one or more programs; the one or more programs are When executed by the one or more processors, the above-mentioned method for identifying vehicles with dangerous goods is implemented.
采用本申请实施例中提供的危险品车辆识别方法、装置及计算机存储介质、电子设备,基于卷积神经网络实现,能够准确识别危险品车身上的各类危险品标志,实现全自动、准确、高效的智能识别危险品车辆。Using the method, device, computer storage medium, and electronic equipment for identifying dangerous goods vehicles provided in the embodiments of the present application, based on convolutional neural network implementation, it is possible to accurately identify various types of dangerous goods signs on the body of dangerous goods, and realize fully automatic, accurate, Efficient and intelligent identification of dangerous goods vehicles.
附图说明Description of drawings
此处所说明的附图用来提供对本申请的进一步理解,构成本申请的一部分,本申请的示意性实施例及其说明用于解释本申请,并不构成对本申请的不当限定。在附图中:The drawings described herein are used to provide further understanding of the present application and constitute a part of the present application. The schematic embodiments and descriptions of the present application are used to explain the present application and do not constitute an improper limitation of the present application. In the attached image:
图1示出了本申请实施例一中危险品车辆识别方法实施的流程示意图;FIG. 1 shows a schematic flowchart of the implementation of the method for identifying dangerous goods vehicles in Embodiment 1 of the present application;
图2示出了本申请实施例一中危险品车概率判断过程示意图;FIG. 2 shows a schematic diagram of a process of judging the probability of dangerous goods vehicles in Embodiment 1 of the present application;
图3示出了本申请实施例一中车辆类型识别过程;FIG. 3 shows the vehicle type identification process in the first embodiment of the present application;
图4示出了本申请实施例一中车辆危险品类型分数计算过程;Fig. 4 shows the calculation process of the vehicle dangerous goods type score in the first embodiment of the present application;
图5示出了本申请实施例一中自学习过程示意图;FIG. 5 shows a schematic diagram of the self-learning process in Embodiment 1 of the present application;
图6示出了本申请实施例二中危险品车辆识别装置的结构示意图;FIG. 6 shows a schematic structural diagram of a vehicle identification device for dangerous goods in the second embodiment of the present application;
图7示出了本申请实施例四中电子设备的结构示意图。FIG. 7 shows a schematic structural diagram of an electronic device in Embodiment 4 of the present application.
具体实施方式Detailed ways
本申请实施例中的方案可以采用各种计算机语言实现,例如,面向对象的程序设计语言Java和直译式脚本语言JavaScript等。The solutions in the embodiments of the present application may be implemented in various computer languages, for example, the object-oriented programming language Java and the literal translation scripting language JavaScript, and the like.
为了使本申请实施例中的技术方案及优点更加清楚明白,以下结合附图对本申请的示例性实施例进行进一步详细的说明,显然,所描述的实施例仅是本申请的一部分实施例,而不是所有实施例的穷举。需要说明的是,在不冲突的情况下,本申请中的实施例及实施例中的特征可以相互组合。In order to make the technical solutions and advantages of the embodiments of the present application more clear, the exemplary embodiments of the present application will be described in further detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, and Not all embodiments are exhaustive. It should be noted that the embodiments in the present application and the features of the embodiments may be combined with each other in the case of no conflict.
实施例一Example 1
图1示出了本申请实施例一中危险品车辆识别方法实施的流程示意图。FIG. 1 shows a schematic flowchart of the implementation of the method for identifying a dangerous goods vehicle in Embodiment 1 of the present application.
如图所示,所述危险品车辆识别方法包括:As shown in the figure, the method for identifying vehicles with dangerous goods includes:
步骤101、获取道路图像;
步骤102、利用预先训练得到的多级串联卷积神经网络识别所述道路图像中的危险品车辆;
其中,所述多级串联卷积神经网络包括第一级卷积神经网络、第二级卷积神经网络和第三级卷积神经网络,所述第一级卷积神经网络识别所述道路图像中危险品车辆及其车辆区域;所述第二级卷积神经网络根据所述第一级卷积神经网络返回的车辆区域的截图识别所述车辆区域的危险品标志;所述第三级卷积神经网络根据所述第一级卷积神经网络返回的车辆区域的截图识别车辆类型并判断所述危险品标志的置信度,根据车辆类型和危险品标志的置信度得到危险品车辆概率。Wherein, the multi-level series convolutional neural network includes a first-level convolutional neural network, a second-level convolutional neural network and a third-level convolutional neural network, and the first-level convolutional neural network identifies the road image Medium-dangerous goods vehicles and their vehicle areas; the second-level convolutional neural network identifies the dangerous goods signs in the vehicle area according to the screenshot of the vehicle area returned by the first-level convolutional neural network; the third-level volume The convolutional neural network identifies the vehicle type according to the screenshot of the vehicle area returned by the first-level convolutional neural network and judges the confidence level of the dangerous goods sign, and obtains the dangerous goods vehicle probability according to the vehicle type and the confidence level of the dangerous goods sign.
具体实施时,本申请实施例可以将道路图像中的车辆区域识别并截取出来,然后对截取的车辆区域预测是否有危险品的相关标志,从而判断该车辆是否为危险品车辆。During specific implementation, the embodiment of the present application can identify and intercept the vehicle area in the road image, and then predict whether there is a relevant sign of dangerous goods in the intercepted vehicle area, so as to determine whether the vehicle is a dangerous goods vehicle.
图2示出了本申请实施例一中危险品车概率判断过程示意图。FIG. 2 shows a schematic diagram of a process of judging the probability of a dangerous goods vehicle in Embodiment 1 of the present application.
如图所示,本申请实施例设计了串联、组合网络:As shown in the figure, the embodiment of the present application designs a series and combined network:
1)第一级网络识别摄像头返回整体图像中的车辆及位置;1) The first-level network identification camera returns the vehicle and position in the overall image;
2)对返回的车辆位置做车辆区域截图;2) Take a screenshot of the vehicle area for the returned vehicle position;
3)第二级网络对车辆截图做危险品疑似标志位置预测;3) The second-level network predicts the location of suspected signs of dangerous goods on the screenshot of the vehicle;
4)将车辆截图、危险品疑似标志截图同时送入第三级网络;4) Send the screenshots of vehicles and suspected signs of dangerous goods into the third-level network at the same time;
5)第三级网络是包括几个分类模型的组合网络,其一对车辆截图进行车辆类型分类(大罐车、重型货车、小轿车、非机动车等),得到不同车辆类型的危险品类型概率;其二对疑似危险标志进行置信度判断;5) The third-level network is a combined network including several classification models. It classifies vehicle types (tank trucks, heavy-duty trucks, cars, non-motor vehicles, etc.) with a pair of vehicle screenshots, and obtains the probability of dangerous goods types for different vehicle types. ; Second, make confidence judgment on suspected danger signs;
6)最后综合车辆类型与危险品标志置信度判断危险品车概率,例如:危险品车概率=0.6×危险品标志概率+0.4×危险品车辆类型概率。6) Finally, the probability of dangerous goods vehicles is judged by comprehensive vehicle type and the confidence level of dangerous goods signs, for example: dangerous goods vehicle probability=0.6×dangerous goods sign probability+0.4×dangerous goods vehicle type probability.
采用本申请实施例中提供的危险品车辆识别方法,基于卷积神经网络实现,能够准确识别危险品车身上的各类危险品标志,实现全自动、准确、高效的智能识别危险品车辆。Using the method for identifying dangerous goods vehicles provided in the embodiments of the present application, which is implemented based on a convolutional neural network, can accurately identify various types of dangerous goods signs on the body of dangerous goods, and realize fully automatic, accurate, and efficient intelligent identification of dangerous goods vehicles.
在一种实施方式中,所述获取道路图像,包括:In one embodiment, the obtaining of road images includes:
提取摄像头拍摄的监控视频;Extract the surveillance video captured by the camera;
根据所述监控视频获取每帧道路图像。Each frame of road image is acquired according to the surveillance video.
在一种实施方式中,所述危险品标志包括以下一种或多种:In one embodiment, the dangerous goods signs include one or more of the following:
危险品牌、三角形危险品标志、危险品菱形标志、“燃”/“爆”/“腐”危险品细分标志。Dangerous brands, triangular dangerous goods signs, dangerous goods diamond signs, "burning"/"explosive"/"rotten" dangerous goods subdivision signs.
在一种实施方式中,所述第一级卷积神经网络的训练过程包括:In one embodiment, the training process of the first-level convolutional neural network includes:
标注训练图像中各车辆所在位置信息,得到包括车辆位置信息的训练数据;Label the location information of each vehicle in the training image to obtain training data including vehicle location information;
根据所述包括车辆位置信息的训练数据,依靠梯度反传进行训练,得到第一级卷积神经网络;所述第一级卷积神经网络的输入为道路图像,输出为道路图像中车辆对应位置信息。According to the training data including the vehicle position information, the first-level convolutional neural network is obtained by relying on gradient backpropagation for training; the input of the first-level convolutional neural network is a road image, and the output is the corresponding position of the vehicle in the road image information.
具体实施时,训练第一级卷积神经网络的步骤可以如下:During specific implementation, the steps of training the first-level convolutional neural network may be as follows:
1、训练数据标注。标注训练图片中各车辆所在位置信息(xmin、ymin、xmax、ymax)。以此得到一批得知位置信息的训练数据。1. Annotation of training data. Label the location information (xmin, ymin, xmax, ymax) of each vehicle in the training image. In this way, a batch of training data for knowing the location information is obtained.
2、卷积神经网络训练。使用标注好的训练数据,对卷积神经网络的检测模型(不限定具体种类)依靠梯度反传进行训练。使得模型具备得知图像中车辆位置(xmin、ymin、xmax、ymax)的能力。2. Convolutional neural network training. Using the labeled training data, the detection model of the convolutional neural network (not limited to the specific type) is trained by gradient backpropagation. The model has the ability to know the vehicle position (xmin, ymin, xmax, ymax) in the image.
3、对训练完成的模型进行部署。提供道路的输入图片,模型执行后就可以获取输入图中车辆对应位置(xmin、ymin、xmax、ymax)。3. Deploy the trained model. Provide the input picture of the road. After the model is executed, the corresponding position (xmin, ymin, xmax, ymax) of the vehicle in the input picture can be obtained.
在一种实施方式中,所述第二级卷积神经网络的训练过程包括:In one embodiment, the training process of the second-level convolutional neural network includes:
标注训练车辆图像中各危险品标志所在位置信息及种类信息,得到包括危险品标志所在位置信息及种类信息的训练数据;Mark the location information and type information of each dangerous goods sign in the training vehicle image, and obtain the training data including the location information and type information of the dangerous goods sign;
根据所述包括危险品标志所在位置信息及种类信息的训练数据,依靠梯度反传进行训练,得到第二级卷积神经网络;所述第二级卷积神经网络输入为车辆图像,输出为车辆图像中各危险品标志的位置信息及种类信息。According to the training data including the location information and type information of the dangerous goods signs, rely on gradient back propagation for training to obtain a second-level convolutional neural network; the input of the second-level convolutional neural network is a vehicle image, and the output is a vehicle The location information and type information of each dangerous goods symbol in the image.
具体实施时,训练第二级卷积神经网络的步骤可以如下:During specific implementation, the steps of training the second-level convolutional neural network may be as follows:
1、训练数据标注。标注训练车辆图片中各危险品标志所在位置信息(xmin、ymin、xmax、ymax)及种类信息(燃、爆、腐等)。以此得到一批得知位置、种类信息的训练数据。1. Annotation of training data. Mark the location information (xmin, ymin, xmax, ymax) and type information (burning, explosion, rot, etc.) of the dangerous goods signs in the training vehicle picture. In this way, a batch of training data for knowing the location and type information is obtained.
2、卷积神经网络训练。使用标注好的训练数据,对卷积神经网络的检测模型(不限定具体种类)依靠梯度反传进行训练。使得模型具备得知图像中各危险品标志位置(xmin、ymin、xmax、ymax)及种类(燃、爆、腐等)的能力。2. Convolutional neural network training. Using the labeled training data, the detection model of the convolutional neural network (not limited to the specific type) is trained by gradient backpropagation. The model has the ability to know the position (xmin, ymin, xmax, ymax) and type (burning, explosion, rot, etc.) of the dangerous goods in the image.
3、对训练完成的模型进行部署。提供车辆图片输入,模型执行后就可以获取输入图中各危险品标志位置(xmin、ymin、xmax、ymax)及种类(燃、爆、腐等)。3. Deploy the trained model. Provide vehicle image input. After the model is executed, the position (xmin, ymin, xmax, ymax) and type (burning, explosion, rot, etc.) of each dangerous goods sign in the input image can be obtained.
在一种实施方式中,所述利用预先训练得到的多级串联卷积神经网络识别所述道路图像中的危险品车辆,包括:In one embodiment, the use of a pre-trained multi-stage series convolutional neural network to identify dangerous goods vehicles in the road image includes:
利用第一级卷积神经网络识别所述道路图像中的车辆所在区域的位置信息;Identify the location information of the area where the vehicle is located in the road image by using the first-level convolutional neural network;
根据所述车辆所在区域的位置信息,截取所述道路图像的矩阵中车辆区域作为车辆图像;According to the position information of the area where the vehicle is located, intercept the vehicle area in the matrix of the road image as the vehicle image;
将所述车辆图像输入至第二级卷积神经网络,利用第二级卷积神经网络识别出危险品标志的位置信息及种类信息;Inputting the vehicle image into the second-level convolutional neural network, and using the second-level convolutional neural network to identify the location information and type information of the dangerous goods signs;
利用第三级卷积神经网络根据所述第一级卷积神经网络返回的车辆区域的截图识别车辆类型并判断所述危险品标志的置信度;Utilize the third-level convolutional neural network to identify the vehicle type according to the screenshot of the vehicle area returned by the first-level convolutional neural network and judge the confidence level of the dangerous goods sign;
根据车辆类型和危险品标志的置信度得到危险品车辆概率。The probability of dangerous goods vehicles is obtained according to the vehicle type and the confidence level of the dangerous goods signs.
具体实施时,多级串联卷积神经网络的工作过程可以如下:In specific implementation, the working process of the multi-stage series convolutional neural network can be as follows:
1、监控设施获取的道路图片,经过第一级卷积神经网络后获得车辆位置信息。1. The road pictures obtained by the monitoring facilities are passed through the first-level convolutional neural network to obtain vehicle location information.
2、通过编程实现,根据所给图片及车辆位置信息,截取出图片矩阵中车辆区域作为新的图片,提供给第二级卷积神经网络使用。2. Implemented by programming, according to the given picture and vehicle position information, the vehicle area in the picture matrix is cut out as a new picture, which is provided to the second-level convolutional neural network for use.
3、第二级卷积神经网络输入截图的车辆图片,推断出危险品标志及种类信息;3. The second-level convolutional neural network inputs the screenshot of the vehicle picture, and infers the dangerous goods signs and type information;
4、所述第三级卷积神经网络根据所述第一级卷积神经网络返回的车辆区域的截图识别车辆类型并判断所述危险品标志的置信度;4. The third-level convolutional neural network identifies the vehicle type according to the screenshot of the vehicle area returned by the first-level convolutional neural network and judges the confidence level of the dangerous goods sign;
5、根据车辆类型和危险品标志的置信度得到危险品车辆概率。5. Obtain the probability of dangerous goods vehicles according to the vehicle type and the confidence of the dangerous goods signs.
在一种实施方式中,所述方法进一步包括:In one embodiment, the method further comprises:
在识别到危险品车辆时,发送危险预警。When a dangerous goods vehicle is identified, a hazard warning is sent.
具体实施时,可以在识别到危险品车辆时,定位该危险品车辆所在道路或所在位置,并根据该危险品车辆所在道路或所在位置在地图上进行标识、跟踪,以提示周围或经过该路段的其他车辆注意安全。In specific implementation, when a dangerous goods vehicle is identified, the road or location of the dangerous goods vehicle can be located, and the road or location of the dangerous goods vehicle can be marked and tracked on the map to prompt the surroundings or pass through the road section other vehicles, pay attention to safety.
在一种实施方式中,所述第三级卷积神经网络的训练过程,包括:In one embodiment, the training process of the third-level convolutional neural network includes:
对若干训练车辆样本数据进行训练得到车辆类型识别模型;A vehicle type recognition model is obtained by training several training vehicle sample data;
根据所有采样的有危险品标志的车辆确定每种类型车辆的危险品标志的置信度。Determine the confidence level of the hazmat markings for each type of vehicle based on all sampled hazmat marked vehicles.
图3示出了本申请实施例一中车辆类型识别过程。FIG. 3 shows the vehicle type identification process in the first embodiment of the present application.
如图所示,本申请实施例构建了车辆类型识别模型,具体构建过程可以如下:As shown in the figure, the embodiment of the present application constructs a vehicle type identification model, and the specific construction process may be as follows:
以人工标注方式对一批训练车辆数据做车辆类型区分,其类型种类可以分为大罐车、重型货车、轻型货车、小轿车等。然后以多分类深度神经网络训练,得到可以智能识别车辆属于训练种类中哪一类的深度学习模型。A batch of training vehicle data is classified into vehicle types by manual annotation, and its types can be divided into large tank trucks, heavy trucks, light trucks, cars, etc. Then, it is trained with a multi-class deep neural network to obtain a deep learning model that can intelligently identify which class the vehicle belongs to.
图4示出了本申请实施例一中车辆危险品类型分数计算过程。FIG. 4 shows the calculation process of the vehicle dangerous goods type score in the first embodiment of the present application.
如图所示,本申请实施例采用归一化概率计算方式,假设所有采样的有危险品标志的车辆总数是N,示例的4中车辆类型(大罐车、重型货车、轻型货车、小轿车)有危险品标志的车辆总数分别是n1、n2、n3、n4。那么四种车辆危险品类型分数分别为:n1/N、n2/N、n3/N、n4/N。其中N=n1+n2+n3+n4。As shown in the figure, the embodiment of the present application adopts a normalized probability calculation method, assuming that the total number of all sampled vehicles with signs of dangerous goods is N, and the four types of vehicles in the example (large tank truck, heavy goods vehicle, light truck, and car) The total number of vehicles with dangerous goods signs are n1, n2, n3, and n4 respectively. Then the scores of the four types of dangerous goods in vehicles are: n1/N, n2/N, n3/N, and n4/N. where N=n1+n2+n3+n4.
在一种实施方式中,所述方法进一步包括:In one embodiment, the method further comprises:
在所述危险品车辆为第一类型的危险品车辆时,获取所述危险品车辆的数据,将所述危险品车辆的数据作为训练样本重新训练所述多级卷积神经网络;When the dangerous goods vehicle is a first type of dangerous goods vehicle, obtain data of the dangerous goods vehicle, and retrain the multi-level convolutional neural network using the data of the dangerous goods vehicle as a training sample;
所述第一类型的危险品车辆为在训练所述多级卷积神经网络时占比少于第二类型的危险品车辆的车辆类型。The dangerous goods vehicle of the first type is a vehicle type that accounts for less than the dangerous goods vehicle of the second type when training the multi-level convolutional neural network.
考虑到不同车辆类型属于危险品车的概率不同,本申请实施例采用实时自学习调整的方式确定每类车型属于危险品车的概率;Considering that different vehicle types have different probabilities of belonging to dangerous goods vehicles, the embodiment of the present application adopts a real-time self-learning adjustment method to determine the probability that each type of vehicle belongs to dangerous goods vehicles;
其具体实现方法是:对监控场景中的车辆各类型统计检测到危险品标志的概率,实时更新各类车型中带危险品标志车辆的比率,以此比率确定各类车型属于危险品车辆的概率。本申请实施例所提供的这种方式对各地区不同类型的危险品车具有自学习能力,泛化性能较好。The specific implementation method is: statistics the probability of detecting dangerous goods signs for various types of vehicles in the monitoring scene, update the ratio of vehicles with dangerous goods signs in various models in real time, and use this ratio to determine the probability of various types of vehicles belonging to dangerous goods vehicles. . The method provided by the embodiment of the present application has the self-learning ability for different types of dangerous goods vehicles in various regions, and has good generalization performance.
图5示出了本申请实施例一中自学习过程示意图。FIG. 5 shows a schematic diagram of the self-learning process in Embodiment 1 of the present application.
如图所示,得益于车辆类型自学习模块的加入,车辆类型自学习分支与危险品标志识别分支之间形成正反馈自提升的作用。对于危险品标志识别模型来说,其危险品标志的识别效果在各类车型上的表现并不相同,主要受影响于训练数据中各类车型的比例分布,对于危险品车来说,最多的是大罐车,可能占比80%以上,具有充足的训练数据,因此其模型表现较好。但是对于轻型货车,其占比可能低于5%,因此模型的训练偏向于数据更多的车辆类型,在轻型货车上的表现可能非常差。而自学习模型引入后,可以在各个车辆数据库中利用车辆类型自学习模块和危险品标志识别模块有针对性地获得轻型货车等类型的危险品车辆数据,从而快速补充训练数据中比例较少的车辆类型危险品车,平衡数据种类以后使得危险品标志识别模块在各类车辆类型上都可以达到较好的效果。反过来,危险品标志识别模块提高后又可以提高车辆类型识别模块中各类车辆占比的准确率。形成正反馈,使得整体框架效果获得提升。As shown in the figure, thanks to the addition of the vehicle type self-learning module, a positive feedback self-improvement effect is formed between the vehicle type self-learning branch and the dangerous goods sign recognition branch. For the hazmat sign recognition model, the performance of its hazmat sign recognition effect on various models is not the same, which is mainly affected by the proportional distribution of various models in the training data. For hazmat vehicles, the most It is a large tanker, which may account for more than 80%, and has sufficient training data, so its model performs better. But for light trucks, the proportion may be less than 5%, so the model training is biased towards vehicle types with more data, and the performance on light trucks may be very poor. After the introduction of the self-learning model, the vehicle type self-learning module and the dangerous goods sign identification module can be used in each vehicle database to obtain the data of light trucks and other types of dangerous goods vehicles in a targeted manner, so as to quickly supplement the training data with a small proportion. Vehicle type Dangerous goods vehicle, after balancing the data types, the dangerous goods sign recognition module can achieve better results on various vehicle types. In turn, the improvement of the dangerous goods sign identification module can improve the accuracy of the proportion of various types of vehicles in the vehicle type identification module. Positive feedback is formed to improve the overall frame effect.
综上,本申请实施例具备如下优点:To sum up, the embodiments of the present application have the following advantages:
1)全自动,无需人力。只需要各路口已经架设好的摄像头,捕捉路面图像,本申请实施例可以自动识别图像中各个车辆,以及车辆是否是危险品车。1) Fully automatic, no manpower required. It is only necessary for cameras that have been set up at each intersection to capture road images, and the embodiment of the present application can automatically identify each vehicle in the image and whether the vehicle is a dangerous goods vehicle.
2)准确。依靠本申请实施例对危险品车辆识别准确率高达近100%,实现通过摄像头路面的所有危险品车辆都能准确识别、报告。2) Accurate. Relying on the embodiment of the present application, the identification accuracy rate of dangerous goods vehicles is as high as nearly 100%, so that all dangerous goods vehicles passing through the camera on the road can be accurately identified and reported.
3)高效。本申请实施例可以做成软件包部署在各种服务器上,实现数十万帧/每小时的图像处理速度,满足大范围内的监控需要。3) Efficient. The embodiments of the present application can be made into software packages and deployed on various servers to achieve an image processing speed of hundreds of thousands of frames per hour, and to meet monitoring needs in a wide range.
4)及时。本申请实施例能够在前端摄像头返回图像的第一时间及时识别出现的危险品车辆。做到及时发现危险隐患,防患于未然,避免后知后觉,事故后才发现的问题。4) Timely. In the embodiment of the present application, the dangerous goods vehicle that appears can be identified in time at the first time when the front-end camera returns an image. To discover hidden dangers in a timely manner, prevent problems before they occur, and avoid problems that are only discovered after an accident.
实施例二Embodiment 2
基于同一发明构思,本申请实施例提供了一种危险品车辆识别装置,该装置解决技术问题的原理与一种危险品车辆识别方法相似,重复之处不再赘述。Based on the same inventive concept, an embodiment of the present application provides a vehicle identification device for dangerous goods. The principle of the device for solving technical problems is similar to that of a method for identifying vehicles for dangerous goods, and repeated details will not be repeated.
图6示出了本申请实施例二中危险品车辆识别装置的结构示意图。FIG. 6 shows a schematic structural diagram of a vehicle identification device for dangerous goods in Embodiment 2 of the present application.
如图所示,所述危险品车辆识别装置包括:As shown in the figure, the dangerous goods vehicle identification device includes:
获取模块601,用于获取道路图像;an
识别模块602,用于利用预先训练得到的多级串联卷积神经网络识别所述道路图像中的危险品车辆;An
其中,所述多级串联卷积神经网络包括第一级卷积神经网络、第二级卷积神经网络和第三级卷积神经网络,所述第一级卷积神经网络识别所述道路图像中危险品车辆及其车辆区域;所述第二级卷积神经网络根据所述第一级卷积神经网络返回的车辆区域的截图识别所述车辆区域的危险品标志;所述第三级卷积神经网络根据所述第一级卷积神经网络返回的车辆区域的截图识别车辆类型并判断所述危险品标志的置信度,根据车辆类型和危险品标志的置信度得到危险品车辆概率。Wherein, the multi-level series convolutional neural network includes a first-level convolutional neural network, a second-level convolutional neural network and a third-level convolutional neural network, and the first-level convolutional neural network identifies the road image Medium-dangerous goods vehicles and their vehicle areas; the second-level convolutional neural network identifies the dangerous goods signs in the vehicle area according to the screenshot of the vehicle area returned by the first-level convolutional neural network; the third-level volume The convolutional neural network identifies the vehicle type according to the screenshot of the vehicle area returned by the first-level convolutional neural network and judges the confidence level of the dangerous goods sign, and obtains the dangerous goods vehicle probability according to the vehicle type and the confidence level of the dangerous goods sign.
采用本申请实施例中提供的危险品车辆识别装置,基于卷积神经网络实现,能够准确识别危险品车身上的各类危险品标志,实现全自动、准确、高效的智能识别危险品车辆。Using the dangerous goods vehicle identification device provided in the embodiment of the present application, implemented based on a convolutional neural network, can accurately identify various types of dangerous goods signs on the dangerous goods body, and realize fully automatic, accurate and efficient intelligent identification of dangerous goods vehicles.
在一种实施方式中,所述获取模块,包括:In one embodiment, the acquisition module includes:
视频提取单元,用于提取摄像头拍摄的监控视频;A video extraction unit for extracting surveillance video captured by a camera;
图像获取单元,用于根据所述监控视频获取每帧道路图像。An image acquisition unit, configured to acquire each frame of road image according to the surveillance video.
在一种实施方式中,所述危险品标志包括以下一种或多种:In one embodiment, the dangerous goods signs include one or more of the following:
危险品牌、三角形危险品标志、危险品菱形标志、“燃”/“爆”/“腐”危险品细分标志。Dangerous brands, triangular dangerous goods signs, dangerous goods diamond signs, "burning"/"explosive"/"rotten" dangerous goods subdivision signs.
在一种实施方式中,所述第一级卷积神经网络的训练过程包括:In one embodiment, the training process of the first-level convolutional neural network includes:
标注训练图像中各车辆所在位置信息,得到包括车辆位置信息的训练数据;Label the location information of each vehicle in the training image to obtain training data including vehicle location information;
根据所述包括车辆位置信息的训练数据,依靠梯度反传进行训练,得到第一级卷积神经网络;所述第一级卷积神经网络的输入为道路图像,输出为道路图像中车辆对应位置信息。According to the training data including the vehicle position information, the first-level convolutional neural network is obtained by relying on gradient backpropagation for training; the input of the first-level convolutional neural network is a road image, and the output is the corresponding position of the vehicle in the road image information.
在一种实施方式中,所述第二级卷积神经网络的训练过程包括:In one embodiment, the training process of the second-level convolutional neural network includes:
标注训练车辆图像中各危险品标志所在位置信息及种类信息,得到包括危险品标志所在位置信息及种类信息的训练数据;Mark the location information and type information of each dangerous goods sign in the training vehicle image, and obtain the training data including the location information and type information of the dangerous goods sign;
根据所述包括危险品标志所在位置信息及种类信息的训练数据,依靠梯度反传进行训练,得到第二级卷积神经网络;所述第二级卷积神经网络输入为车辆图像,输出为车辆图像中各危险品标志的位置信息及种类信息。According to the training data including the location information and type information of the dangerous goods signs, rely on gradient back propagation for training to obtain a second-level convolutional neural network; the input of the second-level convolutional neural network is a vehicle image, and the output is a vehicle The location information and type information of each dangerous goods symbol in the image.
在一种实施方式中,所述利用预先训练得到的两级串联卷积神经网络识别所述道路图像中的危险品车辆,包括:In one embodiment, the use of a pre-trained two-stage series convolutional neural network to identify dangerous goods vehicles in the road image includes:
利用第一级卷积神经网络识别所述道路图像中的车辆所在区域的位置信息;Identify the location information of the area where the vehicle is located in the road image by using the first-level convolutional neural network;
根据所述车辆所在区域的位置信息,截取所述道路图像的矩阵中车辆区域作为车辆图像;According to the position information of the area where the vehicle is located, intercept the vehicle area in the matrix of the road image as the vehicle image;
将所述车辆图像输入至第二级卷积神经网络,利用第二级卷积神经网络识别出危险品标志的位置信息及种类信息;Inputting the vehicle image into the second-level convolutional neural network, and using the second-level convolutional neural network to identify the location information and type information of the dangerous goods signs;
根据所述第一级卷积神经网络返回的车辆区域的截图识别车辆类型并判断所述危险品标志的置信度;Identify the vehicle type according to the screenshot of the vehicle area returned by the first-level convolutional neural network and determine the confidence level of the dangerous goods sign;
根据车辆类型和危险品标志的置信度得到危险品车辆概率。The probability of dangerous goods vehicles is obtained according to the vehicle type and the confidence level of the dangerous goods signs.
在一种实施方式中,所述第三级卷积神经网络的训练过程,包括:In one embodiment, the training process of the third-level convolutional neural network includes:
对若干训练车辆样本数据进行训练得到车辆类型识别模型;A vehicle type recognition model is obtained by training several training vehicle sample data;
根据所有采样的有危险品标志的车辆确定每种类型车辆的危险品标志的置信度。Determine the confidence level of the hazmat markings for each type of vehicle based on all sampled hazmat marked vehicles.
在一种实施方式中,所述装置进一步包括:In one embodiment, the apparatus further comprises:
预警模块,用于在识别到危险品车辆时,发送危险预警。The early warning module is used to send a danger warning when a dangerous vehicle is identified.
在一种实施方式中,所述装置进一步包括:In one embodiment, the apparatus further comprises:
自学习模块,用于在所述危险品车辆为第一类型的危险品车辆时,获取所述危险品车辆的数据,将所述危险品车辆的数据作为训练样本重新训练所述多级卷积神经网络;The self-learning module is configured to acquire the data of the dangerous goods vehicle when the dangerous goods vehicle is the first type of dangerous goods vehicle, and use the data of the dangerous goods vehicle as a training sample to retrain the multi-level convolution Neural Networks;
所述第一类型的危险品车辆为在训练所述多级卷积神经网络时占比少于第二类型的危险品车辆的车辆类型。The dangerous goods vehicle of the first type is a vehicle type that accounts for less than the dangerous goods vehicle of the second type when training the multi-level convolutional neural network.
实施例三Embodiment 3
基于同一发明构思,本申请实施例还提供一种计算机存储介质,下面进行说明。Based on the same inventive concept, an embodiment of the present application further provides a computer storage medium, which will be described below.
所述计算机存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现如实施例一所述危险品车辆识别方法的步骤。The computer storage medium stores a computer program thereon, and when the computer program is executed by the processor, implements the steps of the method for identifying a dangerous goods vehicle according to the first embodiment.
采用本申请实施例中提供的计算机存储介质,基于卷积神经网络实现,能够准确识别危险品车身上的各类危险品标志,实现全自动、准确、高效的智能识别危险品车辆。Using the computer storage medium provided in the embodiments of the present application, based on the convolutional neural network implementation, it is possible to accurately identify various types of dangerous goods signs on the dangerous goods body, and realize fully automatic, accurate and efficient intelligent identification of dangerous goods vehicles.
实施例四Embodiment 4
基于同一发明构思,本申请实施例还提供一种电子设备,下面进行说明。Based on the same inventive concept, an embodiment of the present application further provides an electronic device, which will be described below.
图7示出了本申请实施例四中电子设备的结构示意图。FIG. 7 shows a schematic structural diagram of an electronic device in Embodiment 4 of the present application.
如图所示,所述电子设备包括存储器701、以及一个或多个处理器702,所述存储器用于存储一个或多个程序;所述一个或多个程序被所述一个或多个处理器执行时,实现如实施例一所述的危险品车辆识别方法。As shown, the electronic device includes a
采用本申请实施例中提供的电子设备,基于卷积神经网络实现,能够准确识别危险品车身上的各类危险品标志,实现全自动、准确、高效的智能识别危险品车辆。Using the electronic equipment provided in the embodiments of the present application, implemented based on a convolutional neural network, can accurately identify various types of dangerous goods signs on the dangerous goods body, and realize fully automatic, accurate and efficient intelligent identification of dangerous goods vehicles.
本领域内的技术人员应明白,本申请的实施例可提供为方法、系统、或计算机程序产品。因此,本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。As will be appreciated by those skilled in the art, the embodiments of the present application may be provided as a method, a system, or a computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
本申请是参照根据本申请实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present application. It will be understood that each flow and/or block in the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to the processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing device to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing device produce Means for implementing the functions specified in a flow or flow of a flowchart and/or a block or blocks of a block diagram.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory result in an article of manufacture comprising instruction means, the instructions The apparatus implements the functions specified in the flow or flow of the flowcharts and/or the block or blocks of the block diagrams.
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded on a computer or other programmable data processing device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process such that The instructions provide steps for implementing the functions specified in the flow or blocks of the flowcharts and/or the block or blocks of the block diagrams.
尽管已描述了本申请的优选实施例,但本领域内的技术人员一旦得知了基本创造性概念,则可对这些实施例作出另外的变更和修改。所以,所附权利要求意欲解释为包括优选实施例以及落入本申请范围的所有变更和修改。While the preferred embodiments of the present application have been described, additional changes and modifications to these embodiments may occur to those skilled in the art once the basic inventive concepts are known. Therefore, the appended claims are intended to be construed to include the preferred embodiment and all changes and modifications that fall within the scope of this application.
显然,本领域的技术人员可以对本申请进行各种改动和变型而不脱离本申请的精神和范围。这样,倘若本申请的这些修改和变型属于本申请权利要求及其等同技术的范围之内,则本申请也意图包含这些改动和变型在内。Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010698582.0A CN111898502A (en) | 2020-07-20 | 2020-07-20 | Dangerous goods vehicle identification method, device, computer storage medium, and electronic equipment |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010698582.0A CN111898502A (en) | 2020-07-20 | 2020-07-20 | Dangerous goods vehicle identification method, device, computer storage medium, and electronic equipment |
Publications (1)
Publication Number | Publication Date |
---|---|
CN111898502A true CN111898502A (en) | 2020-11-06 |
Family
ID=73189255
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010698582.0A Pending CN111898502A (en) | 2020-07-20 | 2020-07-20 | Dangerous goods vehicle identification method, device, computer storage medium, and electronic equipment |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111898502A (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112863190A (en) * | 2020-12-30 | 2021-05-28 | 北京北大千方科技有限公司 | Dangerous goods transport vehicle information acquisition equipment and acquisition method |
CN113313098A (en) * | 2021-07-30 | 2021-08-27 | 阿里云计算有限公司 | Video processing method, device, system and storage medium |
CN113313400A (en) * | 2021-06-08 | 2021-08-27 | 中国石油大学(北京) | Accident warning method, accident warning device and storage medium |
CN113469158A (en) * | 2021-09-06 | 2021-10-01 | 智广海联(天津)大数据技术有限公司 | Method and system for identifying illegal hazardous chemical substance transport vehicle based on convolutional neural network |
CN113553913A (en) * | 2021-06-29 | 2021-10-26 | 浙江大华技术股份有限公司 | Early warning method, early warning device, electronic device and storage medium |
CN114429619A (en) * | 2022-01-26 | 2022-05-03 | 浙江商汤科技开发有限公司 | Target vehicle detection method and device |
CN116386341A (en) * | 2022-12-05 | 2023-07-04 | 北京万集科技股份有限公司 | Management method, device and equipment for two-passenger and one-danger vehicle in tunnel |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105373782A (en) * | 2015-11-16 | 2016-03-02 | 深圳市哈工大交通电子技术有限公司 | Method of automatically recognizing hazardous chemical vehicle from image or video |
CN108038540A (en) * | 2017-11-08 | 2018-05-15 | 北京卓视智通科技有限责任公司 | A kind of multiple dimensioned neutral net and the image characteristic extracting method based on the network |
CN208141607U (en) * | 2018-03-26 | 2018-11-23 | 河北交投智能交通技术有限责任公司 | A kind of wisdom card sending system for supporting HAZMAT vehicle control based on video identification technology |
-
2020
- 2020-07-20 CN CN202010698582.0A patent/CN111898502A/en active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105373782A (en) * | 2015-11-16 | 2016-03-02 | 深圳市哈工大交通电子技术有限公司 | Method of automatically recognizing hazardous chemical vehicle from image or video |
CN108038540A (en) * | 2017-11-08 | 2018-05-15 | 北京卓视智通科技有限责任公司 | A kind of multiple dimensioned neutral net and the image characteristic extracting method based on the network |
CN208141607U (en) * | 2018-03-26 | 2018-11-23 | 河北交投智能交通技术有限责任公司 | A kind of wisdom card sending system for supporting HAZMAT vehicle control based on video identification technology |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112863190A (en) * | 2020-12-30 | 2021-05-28 | 北京北大千方科技有限公司 | Dangerous goods transport vehicle information acquisition equipment and acquisition method |
CN113313400A (en) * | 2021-06-08 | 2021-08-27 | 中国石油大学(北京) | Accident warning method, accident warning device and storage medium |
CN113313400B (en) * | 2021-06-08 | 2023-12-15 | 中国石油大学(北京) | Accident alarm method, device and storage medium |
CN113553913A (en) * | 2021-06-29 | 2021-10-26 | 浙江大华技术股份有限公司 | Early warning method, early warning device, electronic device and storage medium |
CN113313098A (en) * | 2021-07-30 | 2021-08-27 | 阿里云计算有限公司 | Video processing method, device, system and storage medium |
CN113313098B (en) * | 2021-07-30 | 2022-01-04 | 阿里云计算有限公司 | Video processing method, device, system and storage medium |
CN113469158A (en) * | 2021-09-06 | 2021-10-01 | 智广海联(天津)大数据技术有限公司 | Method and system for identifying illegal hazardous chemical substance transport vehicle based on convolutional neural network |
CN114429619A (en) * | 2022-01-26 | 2022-05-03 | 浙江商汤科技开发有限公司 | Target vehicle detection method and device |
CN116386341A (en) * | 2022-12-05 | 2023-07-04 | 北京万集科技股份有限公司 | Management method, device and equipment for two-passenger and one-danger vehicle in tunnel |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111898502A (en) | Dangerous goods vehicle identification method, device, computer storage medium, and electronic equipment | |
Tian et al. | An automatic car accident detection method based on cooperative vehicle infrastructure systems | |
CN104156734B (en) | A kind of complete autonomous on-line study method based on random fern grader | |
US20160171328A1 (en) | Methods and systems for vehicle tag number recognition | |
CN114418895A (en) | Driving assistance method and device, vehicle-mounted device and storage medium | |
CN109993138A (en) | A kind of car plate detection and recognition methods and device | |
CN112949578B (en) | Vehicle lamp state identification method, device, equipment and storage medium | |
CN113515968A (en) | Method, device, equipment and medium for detecting street abnormal event | |
CN113191273A (en) | Oil field well site video target detection and identification method and system based on neural network | |
CN117648929B (en) | Target false recognition correction method based on similar humanized generalized perception mechanism | |
CN118429899A (en) | Zero-order learning intelligent early warning method based on multi-mode deep learning drive | |
Arief et al. | Traffic signs detection and recognition system using the YOLOv4 algorithm | |
CN112949510A (en) | Human detection method based on fast R-CNN thermal infrared image | |
Wu et al. | Research on asphalt pavement disease detection based on improved YOLOv5s | |
Kirubakaran et al. | Driving into the Future: Artificial Intelligence based Traffic Sign Recognition using Learning Assisted OCR Principle | |
US11443531B1 (en) | Methods and apparatus for automatic collection of under-represented data for improving a training of a machine learning model | |
Pravallika et al. | Efficient Vehicle Detection System Using YOLOv8 on Jetson Nano Board | |
Pan et al. | Traffic light detection for self-driving vehicles based on deep learning | |
Oublal et al. | An advanced combination of semi-supervised Normalizing Flow & Yolo (YoloNF) to detect and recognize vehicle license plates | |
Baviskar et al. | Auto Number Plate Recognition | |
Khan | Vehicle and pedestrian detection using YOLOv3 and YOLOv4 for self-driving cars | |
CN116186282A (en) | Power construction behavior safety detection method and device and nonvolatile storage medium | |
CN116311157A (en) | Obstacle recognition method and obstacle recognition model training method | |
Zuo et al. | A SECI method based on improved YOLOv4 for traffic sign detection and recognition | |
Sisias et al. | Preliminary results of a proposed CNN framework for use in motorway applicable detection systems |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201106 |
|
RJ01 | Rejection of invention patent application after publication |