WO2019051941A1 - Procédé, appareil et dispositif d'identification de type de véhicule, et support de stockage lisible par ordinateur - Google Patents

Procédé, appareil et dispositif d'identification de type de véhicule, et support de stockage lisible par ordinateur Download PDF

Info

Publication number
WO2019051941A1
WO2019051941A1 PCT/CN2017/108232 CN2017108232W WO2019051941A1 WO 2019051941 A1 WO2019051941 A1 WO 2019051941A1 CN 2017108232 W CN2017108232 W CN 2017108232W WO 2019051941 A1 WO2019051941 A1 WO 2019051941A1
Authority
WO
WIPO (PCT)
Prior art keywords
picture
preset
model
error
tested
Prior art date
Application number
PCT/CN2017/108232
Other languages
English (en)
Chinese (zh)
Inventor
王健宗
刘新卉
黄章成
肖京
Original Assignee
平安科技（深圳）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 平安科技（深圳）有限公司 filed Critical 平安科技（深圳）有限公司
Publication of WO2019051941A1 publication Critical patent/WO2019051941A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2415—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on parametric or probabilistic models, e.g. based on likelihood ratio or false acceptance rate versus a false rejection rate
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/08—Detecting or categorising vehicles

Definitions

  • the present application relates to the field of computer technology, and in particular, to a vehicle identification method, apparatus, device, and computer readable storage medium based on a convolutional neural network.
  • Automobile model identification plays a key role in vehicle management, vehicle violation and escape, vehicle inspection and control, and accidental vehicle loss compensation.
  • the vehicle type has the advantage of being difficult to change, and becomes a very important feature in vehicle identification.
  • the model In the case of cars and deck cars, it is impossible to obtain effective vehicle information through license plate recognition and image sharpening processing technology, especially in the case of car damage claims, the model has a great influence on the amount of compensation, and the vehicle type identification is similar to other traffic monitoring and control. Traffic accident liability determination and other scenarios also play a very important role.
  • the embodiment of the present application provides a vehicle identification method, device, device and computer readable storage medium based on a convolutional neural network, which can realize high-precision vehicle type recognition and make the identification process efficient and stable.
  • an embodiment of the present application provides a vehicle identification method based on a convolutional neural network, the method comprising:
  • Pre-processing the acquired picture to be tested inputting the pre-processed picture to the first preset detection model to determine whether the picture to be tested contains vehicle feature information; if the picture to be tested contains vehicle feature information,
  • the pre-processed picture to be tested is input to a second preset detection model; the second preset detection model is used to calculate a probability value of the picture to be tested corresponding to each type of vehicle type; determining a maximum probability among all probability values a value, and the vehicle corresponding to the maximum probability value is used as the model of the picture to be tested; wherein the first preset detection model and the second preset detection model respectively use a preset picture data to convolutional neural network Get it by training accordingly.
  • the embodiment of the present application further provides a vehicle identification device based on a convolutional neural network, the device comprising:
  • a processing unit configured to: perform pre-processing on the acquired image to be tested; and the determining unit is configured to input the pre-processed image to be tested into the first preset detection model to determine whether the image to be tested includes vehicle feature information; And if the picture to be tested contains the vehicle feature information, the pre-processed picture to be tested is input to the second preset detection model; and the calculating unit is configured to calculate the to-be-waited by the second preset detection model
  • the measured picture corresponds to a probability value of each type of vehicle type; the determining unit is configured to determine a maximum probability value of all the probability values, and the vehicle type corresponding to the maximum probability value is used as the model of the picture to be tested; wherein
  • the first preset detection model and the second preset detection model are respectively acquired by performing corresponding training on the convolutional neural network by using preset image data.
  • the embodiment of the present application further provides a vehicle identification device based on a convolutional neural network, the device comprising:
  • a memory for storing a program for realizing vehicle type recognition; and a processor for running a program for realizing vehicle type identification stored in the memory to perform the following operations:
  • Pre-processing the acquired picture to be tested inputting the pre-processed picture to the first preset detection model to determine whether the picture to be tested contains vehicle feature information; if the picture to be tested contains vehicle feature information,
  • the pre-processed picture to be tested is input to a second preset detection model; the second preset detection model is used to calculate a probability value of the picture to be tested corresponding to each type of vehicle type; determining a maximum probability among all probability values a value, and the vehicle corresponding to the maximum probability value is used as the model of the picture to be tested; wherein the first preset detection model and the second preset detection model respectively use a preset picture data to convolutional neural network Get it by training accordingly.
  • an embodiment of the present application further provides a computer readable storage medium storing one or more programs, the one or more programs being executable by one or more processors Execute to implement the following steps:
  • Pre-processing the acquired picture to be tested inputting the pre-processed picture to the first preset detection model to determine whether the picture to be tested contains vehicle feature information; if the picture to be tested contains vehicle feature information,
  • the pre-processed picture to be tested is input to a second preset detection model; the second preset detection model is used to calculate a probability value of the picture to be tested corresponding to each type of vehicle type; determining a maximum probability among all probability values a value, and the vehicle corresponding to the maximum probability value is used as the model of the picture to be tested; wherein the first preset detection model and the second preset detection model respectively use a preset picture data to convolutional neural network Get it by training accordingly.
  • the embodiment of the present application determines whether the picture to be tested contains vehicle feature information by inputting the pre-processed picture to be tested into a first preset detection model; if the picture to be tested contains vehicle feature information, the pre-processed to-be-processed Inputting a second preset detection model; calculating, by the second preset detection model, a probability value of the picture to be tested corresponding to each type of vehicle; determining a maximum probability value among all probability values, and The vehicle model corresponding to the maximum probability value is used as the model of the picture to be tested; specifically, the vehicle is first classified according to the picture to be measured, and then the picture containing the vehicle characteristic information is found according to the second classification result of the vehicle, and the classification and recognition of the vehicle type are performed again.
  • the application embodiment can realize the classification and recognition of the fine vehicle type of the vehicle, for example, achieving high-precision vehicle type recognition of up to 92.48%, and at the same time making the recognition process more efficient and stable.
  • FIG. 1 is a schematic flow chart of a vehicle identification method based on a convolutional neural network according to an embodiment of the present application
  • FIG. 2 is another schematic flowchart of a method provided by an embodiment of the present application.
  • FIG. 3 is another schematic flowchart of a method provided by an embodiment of the present application.
  • FIG. 4 is another schematic diagram of a method provided by an embodiment of the present application.
  • FIG. 5 is a schematic block diagram of a vehicle identification device based on a convolutional neural network according to an embodiment of the present application
  • FIG. 6 is another schematic block diagram of an apparatus provided by an embodiment of the present application.
  • FIG. 7 is another schematic block diagram of an apparatus provided by an embodiment of the present application.
  • FIG. 8 is a schematic structural diagram of a vehicle identification device based on a convolutional neural network according to an embodiment of the present application.
  • FIG. 1 is a schematic flow chart of a vehicle identification method based on a convolutional neural network according to an embodiment of the present application.
  • the method can be run on devices such as smart phones (such as Android phones, IOS phones, etc.), tablets, laptops, and smart devices.
  • the method of the present application can automatically analyze the input picture to be tested, thereby realizing the classification and recognition of the fine vehicle type of the vehicle, for example, achieving high-precision vehicle identification up to 92.48%, and also making the identification process more efficient and stable.
  • the method includes steps S101 to S105.
  • the picture to be tested may be a regular picture, or may be a picture obtained by extracting a video key frame from the video data.
  • the pre-processed picture to be tested needs to be input into the first preset detection model to perform two classifications, thereby determining whether the picture to be tested contains vehicle feature information.
  • the first preset detection model may be a vehicle binary classification model trained based on a deep convolutional neural network and a large number of vehicle related picture data sets.
  • step S102 includes steps S201 to S202.
  • S201 Input the pre-processed picture to be tested into the first preset detection model to obtain a confidence.
  • a corresponding confidence level may be obtained, because the first preset detection model is based on a deep convolutional neural network.
  • the training is obtained, so the confidence can be outputted by the connection layer for the two classifications in the deep convolutional neural network.
  • the pre-set reliability may be correspondingly set according to actual conditions. For example, when the pre-set reliability is 0.6, if the confidence is less than or equal to 0.6, the picture to be tested is a picture containing vehicle characteristic information. That is, if the confidence level is greater than a preset threshold, the picture to be tested contains vehicle feature information.
  • the pre-processed image to be tested is input into the second preset detection model, and the second preset detection model may be based on A model classification model trained by deep convolutional neural networks and a large number of vehicle-related image data sets.
  • the probability value of each type of vehicle corresponding to the picture to be tested may be calculated.
  • the model in the embodiment of the present application may include information such as a brand name, a manufacturer name, and a model of the vehicle, and is of course not limited to the above information.
  • each probability value of the output can be calculated by the second preset detection model. Corresponding to a model.
  • the model may include a model as shown in Table 1 below.
  • each of the serial numbers 1 to 12 has a probability. If the probability of the model indicated by the serial number 9 is the largest, then the model of the vehicle in the picture to be tested is the brand name Land Rover. The manufacturer is called Land Rover (import), and the model number of the car is the model found in the first generation.
  • S105 Determine a maximum probability value among all the probability values, and use a vehicle type corresponding to the maximum probability value as a model of the picture to be tested.
  • all the probability values are compared and analyzed to obtain the maximum probability value.
  • the model corresponding to the probability value is the model of the picture to be tested.
  • the preset picture data includes preset first picture data, and the steps in the vehicle identification method based on the convolutional neural network provided by the embodiment of the present application are provided. Step S301 to S305 are also included before S101:
  • the preset first picture data is divided into a first training set and a first verification set.
  • the preset first picture data may include a preset image including a picture of the vehicle and a picture not including the vehicle, which may be manually classified and filtered, and the two types of data are used as two scenes, and Input data is provided to the convolutional neural network for learning classification, so that it can be judged Whether the picture is a vehicle two-category model containing a picture of the vehicle.
  • the given classification of the picture without the vehicle may be marked as 0, the given classification of the picture containing the vehicle is marked as 1, and the preset picture data marked with the label is assigned as the first ratio of 4:1.
  • the training set and the first verification set may include a picture containing the vehicle and a picture not containing the vehicle, and the first verification set may include a picture containing the vehicle and a picture not containing the vehicle.
  • the first training set is used for regular training of the convolutional neural network
  • the first verification set is used for performing corresponding classification detection on the model obtained by the trained convolutional neural network.
  • the The first training set and the first verification set are first subjected to corresponding preprocessing, such as feature enhancement, etc., before the convolutional neural network can be input for training.
  • the Convolutional Neural Network is a feedforward neural network, and the artificial neurons can respond to surrounding units in a part of the coverage, and have excellent performance for large image processing.
  • Different convolutional neural networks include different hierarchical structures.
  • the embodiment of the present application can train the first intermediate model by using the first training set to select the deep convolutional neural network.
  • the first convolutional neural network may comprise an eight-layer structure, wherein the first convolutional neural network comprises five convolutional layers, two fully connected layers, and one probability for two classifications Statistical layer.
  • the first five layers are convolutional layers for feature extraction and dimensionality reduction, the latter two layers are fully connected layers, and finally the probability and statistics layer for binary classification.
  • Each convolutional layer in the first convolutional neural network can filter the input image data into a two-dimensional vector through the convolution kernel, and calculate its parameters separately during the training phase, while the fully connected layer will input and weight the vector.
  • the dot multiplication is performed, so that the neurons of the latter layer are all connected with the neurons of the previous layer, all neurons are accelerated by the activation function, and the probability statistical layer is used for judging whether the picture includes vehicle characteristic information.
  • the picture in the first verification set is input into the first intermediate model for classification detection to obtain a classification detection result, and when the classification detection result is inconsistent with the preset classification of the picture, the picture is identified as a first A wrong sample.
  • the image in which all the classification detection results are inconsistent with the pre-classification of the picture can be classified into the first error set.
  • each first error set can be included to One less first error sample.
  • the first intermediate model is trained by using the first error set to obtain a new first intermediate model.
  • the first intermediate model is trained to obtain a corresponding new first intermediate model, thereby further improving the accuracy of the classification detection of the first intermediate model.
  • the first verification set after obtaining the new first intermediate model, the first verification set needs to be used again to perform verification to obtain a new classification detection result, and at the same time, it is determined whether the number of error samples in the first error set at this time is less than The preset threshold, when the number of error samples in the first error set is less than the preset threshold, then it may be determined that the new first intermediate model at this time is the corresponding first preset detection model. And if the number of error samples in the first error set is greater than or equal to the preset threshold, then step S304 may be returned.
  • the first layer of the convolution layer is taken as an example, and the image is unified to a size of 227*227, and the convolution kernel size is 11 *11, the step size is 4, the number of convolution kernels is 96, and the size of the feature map after convolution is 55 after the edge is subtracted.
  • the feature map is normalized by the ReLu activation function and Norm normalized by the pooling operation.
  • the feature map with the size of 27*27*96 is output, and then input into the subsequent convolution layer and the fully connected layer for binary classification.
  • the preset picture data further includes preset second picture data, and step S101 in the vehicle identification method based on the convolutional neural network provided by the embodiment of the present application is provided. It may also include steps S401 to S405 before:
  • the preset second picture data is divided into a second training set and a second verification set.
  • the preset second picture data may include a preset classified picture of the vehicle having various vehicle types, which may be manually classified to filter the corresponding vehicle type, and each picture is used as a scene and used as input data. It is provided to a convolutional neural network for learning classification, so as to obtain a vehicle classification model that can determine the vehicle model in the picture.
  • the second training set is used for regular training on the convolutional neural network
  • the second verification set is used for the second training set.
  • the model obtained by the trained convolutional neural network is classified and detected.
  • the second training set and the second verification set may be pre-processed, such as feature enhancement, before inputting. Convolutional neural networks are trained.
  • the Convolutional Neural Network is a feedforward neural network, and the artificial neurons can respond to surrounding units in a part of the coverage, and have excellent performance for large image processing.
  • Different convolutional neural networks include different hierarchical structures.
  • the embodiment of the present application can train the second deep model by using the second deep training convolution neural network.
  • the picture in the second verification set is input into the second intermediate model for classification detection to obtain the classification detection result, and when the classification detection result is inconsistent with the preset classification of the picture, the picture is identified as a first Two wrong samples.
  • the image in which all the classification detection results are inconsistent with the pre-classification of the picture can be classified as the second error set.
  • each second error set can include at least one second error sample.
  • the second intermediate model is trained by using the second error set to obtain a new second intermediate model.
  • the second intermediate model is trained to obtain a corresponding new second intermediate model, thereby further improving the accuracy of the classification detection of the second intermediate model.
  • the intermediate model is a corresponding second preset detection model.
  • the second verification set needs to be used again to perform verification to obtain a new classification detection result, and at the same time, it is determined whether the number of error samples in the second error set at this time is smaller than The preset threshold, when the number of error samples in the second error set is less than the preset threshold, then it may be determined that the new second intermediate model at this time is the corresponding second preset detection model. And if If the number of error samples in the second error set is greater than or equal to the preset threshold, then step S404 may be returned.
  • the second convolutional neural network may comprise a twenty-layer structure, as shown in Table 2.
  • the second convolutional neural network uses a large number of 1*1 convolution kernels to enhance the fitting of nonlinearities for dimensionality reduction, while adding the initial module (Inception), using different scale filters to solve the scale. problem.
  • the other layers are similar, except that the number of filters is changed.
  • the second convolutional neural network may include three output layers, wherein the structure of the last output layer is optimal, and the story uses the result of the output layer of the last layer as an output. Therefore, by training the hundreds of thousands of vehicle images of the determined vehicle in the second convolutional neural network, it is possible to generate a vehicle classification model that retains the vehicle characteristic parameters.
  • the pre-processed picture to be tested is input into the first preset detection model to determine whether the picture to be tested contains vehicle feature information; And collecting the pre-processed picture to be input into the second preset detection model; calculating, by using the second preset detection model, the probability value of the picture to be tested corresponding to each type of vehicle type; determining all probability values The maximum probability value in the middle, and the vehicle corresponding to the maximum probability value is used as the model of the picture to be tested; specifically, the vehicle is first classified according to the picture to be measured, and then the picture containing the vehicle characteristic information is found according to the vehicle classification result.
  • the application embodiment can realize the classification and recognition of the fine vehicle type of the vehicle, that is, realize the vehicle identification with high precision of up to 92.48%, and at the same time, make the identification process more efficient and stable.
  • the embodiment of the present application further provides a vehicle identification device based on a convolutional neural network, where the device 100 includes: a processing unit 101, a determining unit 102, The input unit 103, the calculation unit 104, and the determination unit 105.
  • the processing unit 101 is configured to perform pre-processing on the acquired picture to be tested.
  • the determining unit 102 is configured to input the pre-processed picture to be tested into a first preset detection model to determine whether the picture to be tested contains vehicle feature information.
  • the input unit 103 is configured to input the pre-processed picture to be tested into the second preset detection model if the picture to be tested contains vehicle feature information.
  • the calculating unit 104 is configured to calculate, by using the second preset detection model, a probability value of the picture to be tested corresponding to each type of vehicle type.
  • the determining unit 105 is configured to determine a maximum probability value among all the probability values, and use the vehicle type corresponding to the maximum probability value as the vehicle type of the picture to be tested.
  • the preset picture data includes preset first picture data
  • the apparatus 100 further includes a classification unit 201, a training unit 202, a verification unit 203, an adjustment unit 204, Decision unit 205.
  • the classification unit 201 is configured to divide the preset first picture data into a first training set and a first verification set;
  • the training unit 202 is configured to train the first convolutional neural network by using the first training set to obtain a corresponding first intermediate model
  • the verification unit 203 is configured to verify the first intermediate model by using the first verification set to obtain a corresponding first error set, where the first error set includes at least one first error sample;
  • the adjusting unit 204 is configured to: if the number of the first error samples in the first error set is greater than or equal to the first preset threshold, use the first error set to train the first intermediate model to obtain a new first Intermediate model
  • the determining unit 205 is configured to verify the new first intermediate model again by using the first verification set until the number of the first error samples in the first error set is less than a preset threshold, and determine that the new time is
  • the first intermediate model is a corresponding first preset detection model.
  • the preset picture data further includes preset second picture data, wherein the classification unit 201 is further configured to divide the preset second picture data into the second training set and the second verification set.
  • the training unit 202 is further configured to train the second convolutional neural network by using the second training set to obtain a corresponding second intermediate model.
  • the verification unit 203 is further configured to verify the second intermediate model by using the second verification set to obtain a corresponding second error set, wherein the second error set includes at least one second error sample.
  • the adjusting unit 204 is further configured to: if the number of the second error samples in the second error set is greater than or equal to the second preset threshold, use the second error set to train the second intermediate model to obtain a new second Intermediate model.
  • the determining unit 205 is further configured to use the second verification set to verify the new second intermediate model again, until the number of the second error samples in the second error set is less than a preset threshold, and determine the current time
  • the new second intermediate model is a corresponding second preset detection model.
  • the determining unit 102 includes a confidence acquiring unit 301 and a confidence determining unit 302.
  • the confidence acquiring unit 301 is configured to input the pre-processed picture to be tested into the first preset detection model to obtain a confidence.
  • the confidence determination unit 302 is configured to determine whether the confidence level is greater than a preset threshold.
  • the picture to be tested contains vehicle feature information.
  • the above-described convolutional neural network based vehicle identification device can be implemented in the form of a computer program that can be run on a device as shown in FIG.
  • FIG. 8 is a schematic structural diagram of a vehicle type identification device based on a convolutional neural network according to the present application.
  • the device 800 can include an input device 801, an output device 802, a transceiver device 803, a memory 804, and a processor 805, where:
  • the input device 801 is configured to receive input data of an external access control device.
  • the input device 801 in the embodiment of the present application may include a keyboard, a mouse, a photoelectric input device, a sound input device, a touch input device, a scanner, and the like.
  • the output device 802 is configured to output output data of the access control device to the outside.
  • the output device 802 described in this embodiment of the present application may include a display, a speaker, a printer, and the like.
  • the transceiver device 803 is configured to send data to or receive data from other devices through a communication link.
  • the transceiver 803 of the embodiment of the present application may include a transceiver device such as a radio frequency antenna.
  • the memory 804 is used to store program data with various functions.
  • the memory 804 of the embodiment of the present application includes a non-volatile storage medium and an internal memory.
  • the non-volatile storage medium can store an operating system and program data.
  • the processor 805 can be caused to perform a vehicle type identification method.
  • the internal memory provides an environment for the operation of program data in a non-volatile storage medium that, when executed by the processor 805, causes the processor 805 to perform a vehicle type identification method.
  • the processor 805 is configured to run a program for realizing vehicle type identification stored in the memory 804, to perform the following operations: pre-processing the acquired image to be tested; and inputting the pre-processed image to be tested into the first preset Detecting a model to determine whether the image to be tested contains vehicle feature information; if the image to be tested contains vehicle feature information, inputting the pre-processed image to be input into a second preset detection model;
  • the model calculates that the picture to be tested corresponds to a probability value of each type of vehicle type; determines a maximum probability value among all the probability values, and uses the vehicle type corresponding to the maximum probability value as the model of the picture to be tested.
  • the preset picture data includes preset first picture data
  • the pre-processing of the obtained picture to be tested includes:
  • the preset picture data further includes preset second picture data
  • the method further includes: dividing the preset second picture data into a second training set and a second verification set; Two The training set trains the second convolutional neural network to obtain a corresponding second intermediate model; and the second intermediate model is verified by the second verification set to obtain a corresponding second error set, wherein the The second error set includes at least one second error sample; if the number of the second error samples in the second error set is greater than or equal to the second preset threshold, the second intermediate model is trained by using the second error set Obtaining a new second intermediate model; verifying, by the second verification set, the new second intermediate model again, until the number of second error samples in the second error set is less than a preset threshold, and determining The new second intermediate model at this time is the corresponding second preset detection model.
  • the first convolutional neural network comprises an eight-layer structure
  • the second convolutional neural network comprises a twenty-layer structure, wherein the first convolutional neural network comprises five convolutional layers, two full The connection layer and a probabilistic layer for the two classifications.
  • the inputting the pre-processed picture to the first preset detection model to determine whether the picture to be tested contains the vehicle feature information comprises: inputting the pre-processed picture to be input into the first preset detection model Obtaining a confidence level; determining whether the confidence level is greater than a preset threshold; wherein, if the confidence level is greater than a preset threshold, the picture to be tested includes vehicle feature information.
  • the embodiment of the convolutional neural network based vehicle type identification device shown in FIG. 8 does not constitute a limitation on the specific configuration of the convolutional neural network based vehicle type identification device.
  • the vehicle type identification device of the convolutional neural network may include more or fewer components than those illustrated, or some components may be combined, or different component arrangements.
  • the convolutional neural network based vehicle identification device may only include a memory and a processor. In such an embodiment, the structure and function of the memory and processor are consistent with the embodiment shown in FIG. This will not be repeated here.
  • the application provides a computer readable storage medium storing one or more programs, the one or more programs being executable by one or more processors to implement the following steps:
  • the image to be tested is preprocessed; the preprocessed picture to be tested is input into the first preset detection model to determine whether the picture to be tested contains vehicle feature information; if the picture to be tested contains vehicle feature information, the preprocessing is performed
  • the second picture to be tested is input to the second preset detection model; the probability value of the picture to be tested corresponding to each type of vehicle type is calculated by the second preset detection model; and the maximum probability value among all the probability values is determined, And the model corresponding to the maximum probability value is used as the model of the picture to be tested.
  • the preset picture data includes preset first picture data
  • the pre-processing of the acquired picture to be tested includes: dividing the preset first picture data into the first training set and a first verification set; training the first convolutional neural network with the first training set to obtain a corresponding first intermediate model; and verifying the first intermediate model by using the first verification set to obtain Corresponding first error set, wherein the first error set includes at least one first error sample; if the number of the first error samples in the first error set is greater than or equal to a first preset threshold, using the first The error set trains the first intermediate model to obtain a new first intermediate model; the new first intermediate model is again verified using the first verification set until the first error sample in the first error set The number is less than the preset threshold, and it is determined that the new first intermediate model at this time is the corresponding first preset detection model.
  • the preset picture data further includes preset second picture data
  • the method further includes: dividing the preset second picture data into a second training set and a second verification set;
  • the second training set trains the second convolutional neural network to obtain a corresponding second intermediate model; and uses the second verification set to verify the second intermediate model to obtain a corresponding second error set, where
  • the second error set includes at least one second error sample; if the number of the second error samples in the second error set is greater than or equal to a second preset threshold, training the second intermediate model with the second error set Obtaining a new second intermediate model; verifying the new second intermediate model again by using the second verification set until the number of second error samples in the second error set is less than a preset threshold, and It is determined that the new second intermediate model at this time is the corresponding second preset detection model.
  • the first convolutional neural network comprises an eight-layer structure
  • the second convolutional neural network comprises a twenty-layer structure, wherein the first convolutional neural network comprises five convolutional layers, two full The connection layer and a probabilistic layer for the two classifications.
  • the inputting the pre-processed picture to the first preset detection model to determine whether the picture to be tested contains vehicle feature information includes: pre-processing the obtained picture to be tested; Entering a first preset detection model to obtain a confidence level; determining whether the confidence level is greater than a preset threshold; wherein, if the confidence level is greater than a preset threshold, the image to be tested includes vehicle feature information .
  • the foregoing storage medium of the present application includes: a magnetic disk, an optical disk, a read-only memory (ROM), and the like, which can store various program codes.
  • the units in all the embodiments of the present application may be implemented by a general-purpose integrated circuit, such as a CPU (Central Processing Unit), or by an ASIC (Application Specific Integrated Circuit).
  • the steps in the method of the embodiment of the present application may be sequentially adjusted, merged, and deleted according to actual needs.
  • the units in the apparatus of the embodiment of the present application may be combined, divided, and deleted according to actual needs.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Probability & Statistics with Applications (AREA)
  • Image Analysis (AREA)

Abstract

L'invention concerne un procédé, un appareil et un dispositif d'identification d'un type de véhicule basés sur un réseau neuronal à convolution, et un support de stockage lisible par ordinateur. Le procédé comporte les étapes consistant à: prétraiter une image acquise à détecter (S101); introduire l'image prétraitée à détecter dans un premier modèle de détection préétabli pour déterminer si l'image à détecter contient des informations de caractéristiques de véhicule (S102); si l'image à détecter contient des informations de caractéristiques de véhicule, introduire l'image prétraitée à détecter dans un second modèle de détection préétabli (S103); réaliser un calcul au moyen du second modèle de détection préétabli pour obtenir une valeur de probabilité que l'image à détecter corresponde à chaque catégorie de types de véhicules (S104); et déterminer la valeur de probabilité maximale parmi toutes les valeurs de probabilité, et prendre un type de véhicule correspondant à la valeur de probabilité maximale en tant que type de véhicule de l'image à détecter (S105), le premier modèle de détection préétabli et le second modèle de détection préétabli étant respectivement acquis par un apprentissage correspondant effectué sur un réseau neuronal à convolution au moyen de données d'image prédéfinies. Le procédé peut réaliser une identification de haute précision d'un type de véhicule, et permet également à un processus d'identification d'être stable et à haut rendement.
PCT/CN2017/108232 2017-09-15 2017-10-30 Procédé, appareil et dispositif d'identification de type de véhicule, et support de stockage lisible par ordinateur WO2019051941A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710833636.8 2017-09-15
CN201710833636.8A CN107665353A (zh) 2017-09-15 2017-09-15 基于卷积神经网络的车型识别方法、装置、设备及计算机可读存储介质

Publications (1)

Publication Number Publication Date
WO2019051941A1 true WO2019051941A1 (fr) 2019-03-21

Family

ID=61097903

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/108232 WO2019051941A1 (fr) 2017-09-15 2017-10-30 Procédé, appareil et dispositif d'identification de type de véhicule, et support de stockage lisible par ordinateur

Country Status (2)

Country Link
CN (1) CN107665353A (fr)
WO (1) WO2019051941A1 (fr)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110245577A (zh) * 2019-05-23 2019-09-17 复钧智能科技(苏州)有限公司 目标车辆识别方法、装置及车辆实时监控系统
CN111461093A (zh) * 2020-06-22 2020-07-28 北京慧智数据科技有限公司 一种基于深度学习技术的改装货车识别方法
CN111461195A (zh) * 2020-03-27 2020-07-28 国网电子商务有限公司 一种图片校验方法、装置及电子设备
CN111814582A (zh) * 2020-06-15 2020-10-23 开易（北京）科技有限公司 一种用于驾驶员行为监测图像的处理方法及装置
CN111816311A (zh) * 2020-07-22 2020-10-23 北京捷通华声科技股份有限公司 状态识别的方法、系统、装置
CN111881944A (zh) * 2020-07-08 2020-11-03 贵州无忧天空科技有限公司 图像鉴别的方法、电子设备和计算机可读介质
CN111882519A (zh) * 2020-06-15 2020-11-03 上海眼控科技股份有限公司 一种车灯识别的方法及装置
CN112257869A (zh) * 2020-09-29 2021-01-22 北京北大千方科技有限公司 基于随机森林的套牌车分析方法、系统及计算机介质
CN114330596A (zh) * 2022-01-12 2022-04-12 中翔科技（杭州）有限公司 一种基于神经网络图像分类算法的设备状态反馈方法及系统
CN114323583A (zh) * 2021-12-21 2022-04-12 广汽本田汽车有限公司 一种车辆灯光检测方法、装置、设备及系统
CN115083169A (zh) * 2022-06-14 2022-09-20 公安部交通管理科学研究所 一种假冒救护车的嫌疑车辆的发现方法

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108491866B (zh) * 2018-03-06 2022-09-13 平安科技（深圳）有限公司 色情图片鉴定方法、电子装置及可读存储介质
CN108875600A (zh) * 2018-05-31 2018-11-23 银江股份有限公司 一种基于yolo的车辆信息检测和跟踪方法、装置及计算机存储介质
CN109308565B (zh) * 2018-08-01 2024-03-19 平安科技（深圳）有限公司 人群绩效等级识别方法、装置、存储介质及计算机设备
CN109214426A (zh) * 2018-08-08 2019-01-15 王新维 一种物体外观检测的方法及深度神经网络模型
CN109242835A (zh) * 2018-08-24 2019-01-18 深圳市兆泰云智能科技有限公司 基于人工智能的车底缺陷检测方法、装置、设备及系统
CN110569700B (zh) * 2018-09-26 2020-11-03 创新先进技术有限公司 优化损伤识别结果的方法及装置
CN109145107B (zh) * 2018-09-27 2023-07-25 平安科技（深圳）有限公司 基于卷积神经网络的主题提取方法、装置、介质和设备
CN110147707B (zh) * 2018-10-25 2021-07-20 初速度（苏州）科技有限公司 一种高精度车辆识别方法及系统
CN109815997B (zh) * 2019-01-04 2024-07-19 平安科技（深圳）有限公司 基于深度学习的识别车辆损伤的方法和相关装置
CN109872145B (zh) * 2019-01-29 2020-12-08 中智沃达(北京)电力科技有限公司 基于cnn卷积神经网络的充电场智能管理系统
CN111507483A (zh) * 2019-01-30 2020-08-07 鸿富锦精密电子(天津)有限公司 返修板检测装置、方法及计算机可读存储介质
CN109977766A (zh) * 2019-02-18 2019-07-05 南京航空航天大学 一种基于局部特征的车型精细识别方法
CN110414929A (zh) * 2019-07-10 2019-11-05 广州市巴图鲁信息科技有限公司 一种汽车配件图片智能审核方法
CN110503051B (zh) * 2019-08-27 2023-04-07 西南林业大学 一种基于图像识别技术的珍贵木材识别系统及方法
CN111881956B (zh) * 2020-07-15 2023-05-12 北京市商汤科技开发有限公司 网络训练方法及装置、目标检测方法及装置和电子设备
CN112435463B (zh) * 2020-10-20 2022-04-01 北京科技大学 一种基于道路物联网监测的车型与车重分类方法
CN112329886A (zh) * 2020-11-26 2021-02-05 珠海大横琴科技发展有限公司 双车牌识别方法、模型训练方法、装置、设备及存储介质
CN115761659B (zh) * 2023-01-09 2023-04-11 南京隼眼电子科技有限公司 识别模型构建方法、车型识别方法、电子设备及存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104463241A (zh) * 2014-10-31 2015-03-25 北京理工大学 一种智能交通监控系统中的车辆类型识别方法
CN104680149A (zh) * 2015-03-10 2015-06-03 苏州科达科技股份有限公司 一种物体类型识别方法及系统
US20160140424A1 (en) * 2014-11-13 2016-05-19 Nec Laboratories America, Inc. Object-centric Fine-grained Image Classification
US20160148079A1 (en) * 2014-11-21 2016-05-26 Adobe Systems Incorporated Object detection using cascaded convolutional neural networks
CN105938560A (zh) * 2016-03-23 2016-09-14 吉林大学 一种基于卷积神经网络的车型精细分类系统

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104182735A (zh) * 2014-08-18 2014-12-03 厦门美图之家科技有限公司 训练优化的基于卷积神经网络的色情图像或视频检测方法
CN104978586A (zh) * 2015-06-29 2015-10-14 百度在线网络技术（北京）有限公司 商标识别方法和装置
CN106022285A (zh) * 2016-05-30 2016-10-12 北京智芯原动科技有限公司 一种基于卷积神经网络的车款识别方法及装置
CN106529446A (zh) * 2016-10-27 2017-03-22 桂林电子科技大学 基于多分块深层卷积神经网络的车型识别方法和系统

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104463241A (zh) * 2014-10-31 2015-03-25 北京理工大学 一种智能交通监控系统中的车辆类型识别方法
US20160140424A1 (en) * 2014-11-13 2016-05-19 Nec Laboratories America, Inc. Object-centric Fine-grained Image Classification
US20160148079A1 (en) * 2014-11-21 2016-05-26 Adobe Systems Incorporated Object detection using cascaded convolutional neural networks
CN104680149A (zh) * 2015-03-10 2015-06-03 苏州科达科技股份有限公司 一种物体类型识别方法及系统
CN105938560A (zh) * 2016-03-23 2016-09-14 吉林大学 一种基于卷积神经网络的车型精细分类系统

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110245577A (zh) * 2019-05-23 2019-09-17 复钧智能科技(苏州)有限公司 目标车辆识别方法、装置及车辆实时监控系统
CN111461195A (zh) * 2020-03-27 2020-07-28 国网电子商务有限公司 一种图片校验方法、装置及电子设备
CN111461195B (zh) * 2020-03-27 2023-06-09 国网数字科技控股有限公司 一种图片校验方法、装置及电子设备
CN111814582B (zh) * 2020-06-15 2022-06-28 开易（北京）科技有限公司 一种用于驾驶员行为监测图像的处理方法及装置
CN111814582A (zh) * 2020-06-15 2020-10-23 开易（北京）科技有限公司 一种用于驾驶员行为监测图像的处理方法及装置
CN111882519A (zh) * 2020-06-15 2020-11-03 上海眼控科技股份有限公司 一种车灯识别的方法及装置
CN111461093A (zh) * 2020-06-22 2020-07-28 北京慧智数据科技有限公司 一种基于深度学习技术的改装货车识别方法
CN111461093B (zh) * 2020-06-22 2020-09-29 北京慧智数据科技有限公司 一种基于深度学习技术的改装货车识别方法
CN111881944A (zh) * 2020-07-08 2020-11-03 贵州无忧天空科技有限公司 图像鉴别的方法、电子设备和计算机可读介质
CN111816311A (zh) * 2020-07-22 2020-10-23 北京捷通华声科技股份有限公司 状态识别的方法、系统、装置
CN112257869A (zh) * 2020-09-29 2021-01-22 北京北大千方科技有限公司 基于随机森林的套牌车分析方法、系统及计算机介质
CN114323583A (zh) * 2021-12-21 2022-04-12 广汽本田汽车有限公司 一种车辆灯光检测方法、装置、设备及系统
CN114323583B (zh) * 2021-12-21 2024-06-04 广汽本田汽车有限公司 一种车辆灯光检测方法、装置、设备及系统
CN114330596A (zh) * 2022-01-12 2022-04-12 中翔科技（杭州）有限公司 一种基于神经网络图像分类算法的设备状态反馈方法及系统
CN115083169A (zh) * 2022-06-14 2022-09-20 公安部交通管理科学研究所 一种假冒救护车的嫌疑车辆的发现方法
CN115083169B (zh) * 2022-06-14 2023-07-18 公安部交通管理科学研究所 一种假冒救护车的嫌疑车辆的发现方法

Also Published As

Publication number Publication date
CN107665353A (zh) 2018-02-06

Similar Documents

Publication Publication Date Title
WO2019051941A1 (fr) Procédé, appareil et dispositif d'identification de type de véhicule, et support de stockage lisible par ordinateur
CN110020592B (zh) 物体检测模型训练方法、装置、计算机设备及存储介质
WO2020215571A1 (fr) Procédé et dispositif d'identification de données sensibles, support de stockage et appareil informatique
JP5588395B2 (ja) 画像をオブジェクト及びそのパーツに関して効率的に解釈するためのシステムと方法
KR20170140214A (ko) 신경망을 위한 훈련 기준으로서의 필터 특이성
KR20180036709A (ko) 미디어 분류
CN110807491A (zh) 车牌图像清晰度模型训练方法、清晰度检测方法及装置
CN106897746A (zh) 数据分类模型训练方法和装置
CN111417960B (zh) 信息处理装置、信息处理方法及程序
CN110956255A (zh) 难样本挖掘方法、装置、电子设备及计算机可读存储介质
US11605210B2 (en) Method for optical character recognition in document subject to shadows, and device employing method
CN114419313A (zh) 影像辨识方法及影像辨识系统
KR101545809B1 (ko) 차량 번호판 이중 검출 방법 및 장치
CN111292377A (zh) 目标检测方法、装置、计算机设备和存储介质
CN112288012A (zh) 图像识别方法、装置及存储介质
CN110135428B (zh) 图像分割处理方法和装置
CN112949785B (zh) 对象检测方法、装置、设备及计算机存储介质
CN115620083B (zh) 模型训练方法、人脸图像质量评价方法、设备及介质
CN113408564A (zh) 图处理方法、网络训练方法、装置、设备以及存储介质
WO2016149937A1 (fr) Classification de réseau neuronal par décomposition
CN112950652B (zh) 机器人及其手部图像分割方法和装置
CN112686129B (zh) 一种人脸识别系统及方法
CN112801045B (zh) 一种文本区域检测方法、电子设备及计算机存储介质
CN111931767B (zh) 一种基于图片信息度的多模型目标检测方法、装置、系统及存储介质
TWI775038B (zh) 字元識別方法、裝置及電腦可讀取存儲介質

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17925264

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 25/09/2020)

122 Ep: pct application non-entry in european phase

Ref document number: 17925264

Country of ref document: EP

Kind code of ref document: A1