CN109508636A - Vehicle attribute recognition methods, device, storage medium and electronic equipment - Google Patents
Vehicle attribute recognition methods, device, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN109508636A CN109508636A CN201811169429.8A CN201811169429A CN109508636A CN 109508636 A CN109508636 A CN 109508636A CN 201811169429 A CN201811169429 A CN 201811169429A CN 109508636 A CN109508636 A CN 109508636A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- image
- monitored
- information
- layer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000001514 detection method Methods 0.000 claims abstract description 89
- 238000000605 extraction Methods 0.000 claims abstract description 18
- 238000013528 artificial neural network Methods 0.000 claims description 10
- 238000012545 processing Methods 0.000 claims description 10
- 230000000306 recurrent effect Effects 0.000 claims description 10
- 210000004709 eyebrow Anatomy 0.000 claims description 5
- 238000004590 computer program Methods 0.000 claims description 3
- 238000012216 screening Methods 0.000 abstract description 4
- 238000013461 design Methods 0.000 description 27
- 238000010586 diagram Methods 0.000 description 8
- 238000012544 monitoring process Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 4
- 238000007781 pre-processing Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 210000004209 hair Anatomy 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06V20/584—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of vehicle lights or traffic lights
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- General Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- Biophysics (AREA)
- General Engineering & Computer Science (AREA)
- Artificial Intelligence (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Life Sciences & Earth Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Health & Medical Sciences (AREA)
- Image Analysis (AREA)
Abstract
The present invention provides a kind of vehicle attribute recognition methods, device, storage medium and electronic equipment.Vehicle attribute recognition methods provided by the invention, it include: first to obtain image to be monitored, and the outline data information of vehicle to be identified is obtained from image to be monitored by preset vehicle detection model, vehicle detection frame is determined further according to outline data information, and the corresponding images to be recognized of vehicle to be identified is intercepted from image to be monitored using vehicle detection frame, then feature extraction is carried out to images to be recognized by preset vehicle attribute identification model, to obtain the attributive character information of the vehicle to be identified in images to be recognized.Vehicle attribute recognition methods provided by the invention may be implemented the function that in security protection application scenarios suspected vehicles are carried out with identification screening, greatly accelerate recognition speed and accuracy, and reduce the investment of human cost.
Description
Technical field
The present invention relates to technical field of computer vision more particularly to a kind of vehicle attribute recognition methods, device, storage Jie
Matter and electronic equipment.
Background technique
With the continuous development of internet and artificial intelligence technology, more and more fields start to be related to computer vision certainly
Dynamicization calculates and analysis, wherein monitoring safety-security area is then wherein mostly important one of application scenarios.
In order to be identified using the monitoring video in security protection scene to the attribute of suspected vehicles, thus realization pair
The identification and tracking of suspected vehicles are all in the prior art to know first to record from monitoring otherwise using eye-observation mostly
Target vehicle is found out as in, then vehicle is tracked according still further to time sequencing.
But vehicle attribute identification is carried out using traditional human eye observation, error is larger, and needs to expend a large amount of people
Power and material resources, it is difficult to adapt to the suspected vehicles identification in practical security protection application scenarios.
Summary of the invention
The present invention provides a kind of vehicle attribute recognition methods, device, storage medium and electronic equipment, to be directed to figure to be monitored
As exporting the vehicle detection frame of vehicle to be identified and the corresponding attributive character information of the vehicle to be identified, to realize in reality
In border security protection application scenarios suspected vehicles are carried out with the function of identification screening.
In a first aspect, the present invention provides a kind of vehicle attribute recognition methods, comprising:
Image to be monitored is obtained, and vehicle to be identified is obtained from the image to be monitored by preset vehicle detection model
Outline data information；
Vehicle detection frame is determined according to the outline data information, and utilizes the vehicle detection frame from the figure to be monitored
The corresponding images to be recognized of the vehicle to be identified is intercepted as in；
Feature extraction is carried out to the images to be recognized by preset vehicle attribute identification model, it is described wait know to obtain
The attributive character information of the vehicle to be identified in other image.
In a kind of possible design, it is described by preset vehicle attribute identification model to the images to be recognized into
Row feature extraction, after the attributive character information to obtain the vehicle to be identified in the images to be recognized, further includes:
Vehicle detection frame described in Overlapping display and the attributive character information on the image to be monitored, wherein institute
Vehicle detection frame is stated for accommodating the vehicle to be identified in the image to be monitored.
In a kind of possible design, it is described obtained from the image to be monitored by preset vehicle detection model to
Identify the outline data information of vehicle, comprising:
The processing of multiple convolution layer and the processing of pond layer are carried out by the image to be monitored, to form full articulamentum；
Classification and Identification is carried out to the full articulamentum using target detection network, to obtain the profile of the vehicle to be identified
Data information.
It is described that vehicle detection frame is determined according to the outline data information in a kind of possible design, comprising:
Determine the top left corner apex of the vehicle detection frame first in preset coordinate system according to the outline data information
Coordinate value, the first frame long value and the first frame height value, wherein the abscissa value in first coordinate value is less than or equal to described
Minimum abscissa value in outline data information, the ordinate value in first coordinate value be greater than or equal to the number of contours it is believed that
Maximum ordinate value in breath, the first frame long value be greater than or equal in the outline data information maximum abscissa value with it is described
The difference of minimum abscissa value, the first frame height value be greater than or equal to the outline data information in maximum ordinate value with it is described
The difference of minimum ordinate value.
In a kind of possible design, the preset vehicle attribute identification model is tensor recurrent neural networks model.
In a kind of possible design, the tensor recurrent neural networks model includes input layer, the first convolutional layer, first
Correcting layer, the first pond layer, the second convolutional layer, the second correcting layer, the second pond layer, third convolutional layer, tensor recurrence layer and defeated
Layer out；
Wherein, the input layer, first convolutional layer, first correcting layer, first pond layer, described second
Convolutional layer, second correcting layer, second pond layer and the third convolutional layer are sequentially connected, the tensor recurrence layer
It is connected to the third convolutional layer entirely, the output layer is connected to the tensor recurrence layer entirely.
In a kind of possible design, obtained from the image to be monitored described by preset vehicle detection model
Before the outline data information of vehicle to be identified, further includes:
First pretreatment is carried out to the image to be monitored, so that the image to be monitored meets preset dimension requirement.
In a kind of possible design, after carrying out the first pretreatment to the image to be monitored, further includes:
Second pretreatment is carried out to the image to be monitored, so that the image to be monitored meets preset RGB color value
It is required that.
In a kind of possible design, the attributive character information includes at least at least one in following attributive character:
Outside vehicle characteristic information, vehicle interior characteristic information and vehicle heading information.
In a kind of possible design, the outside vehicle characteristic information includes at least at least one in following attributive character
:
Vehicle model information, vehicle window rain eyebrow information, top holder information and skylight information；
The vehicle interior characteristic information includes at least at least one in following attributive character:
Interior pose status information, rearview mirror hanger status information, operator seat status information and co-driver shape
State information.
Second aspect, the present invention also provides a kind of vehicle attribute identification devices, comprising:
Module is obtained, for obtaining image to be monitored, and by preset vehicle detection model from the image to be monitored
The middle outline data information for obtaining vehicle to be identified；
Determining module for determining vehicle detection frame according to the outline data information, and utilizes the vehicle detection frame
The corresponding images to be recognized of the vehicle to be identified is intercepted from the image to be monitored；
Extraction module, for carrying out feature extraction to the images to be recognized by preset vehicle attribute identification model,
To obtain the attributive character information of the vehicle to be identified in the images to be recognized.
In a kind of possible design, the vehicle attribute identification device, further includes:
Display module, for vehicle detection frame and the attributive character described in the Overlapping display on the image to be monitored
Information, wherein the vehicle detection frame is used to accommodate the vehicle to be identified in the image to be monitored.
In a kind of possible design, the acquisition module is specifically used for:
The processing of multiple convolution layer and the processing of pond layer are carried out by the image to be monitored, to form full articulamentum；
Classification and Identification is carried out to the full articulamentum using target detection network, to obtain the profile of the vehicle to be identified
Data information.
It is described that vehicle detection frame is determined according to the outline data information in a kind of possible design, comprising:
Determine the top left corner apex of the vehicle detection frame first in preset coordinate system according to the outline data information
Coordinate value, the first frame long value and the first frame height value, wherein the abscissa value in first coordinate value is less than or equal to described
Minimum abscissa value in outline data information, the ordinate value in first coordinate value be greater than or equal to the number of contours it is believed that
Maximum ordinate value in breath, the first frame long value be greater than or equal in the outline data information maximum abscissa value with it is described
The difference of minimum abscissa value, the first frame height value be greater than or equal to the outline data information in maximum ordinate value with it is described
The difference of minimum ordinate value.
In a kind of possible design, the preset vehicle attribute identification model is tensor recurrent neural networks model.
In a kind of possible design, the tensor recurrent neural networks model includes input layer, the first convolutional layer, first
Correcting layer, the first pond layer, the second convolutional layer, the second correcting layer, the second pond layer, third convolutional layer, tensor recurrence layer and defeated
Layer out；
Wherein, the input layer, first convolutional layer, first correcting layer, first pond layer, described second
Convolutional layer, second correcting layer, second pond layer and the third convolutional layer are sequentially connected, the tensor recurrence layer
It is connected to the third convolutional layer entirely, the output layer is connected to the tensor recurrence layer entirely.
In a kind of possible design, the vehicle attribute identification device, further includes:
Preprocessing module, for carrying out the first pretreatment to the image to be monitored, so that the image to be monitored meets
Preset dimension requirement.
In a kind of possible design, the preprocessing module is also used to:
Second pretreatment is carried out to the image to be monitored, so that the image to be monitored meets preset RGB color value
It is required that.
In a kind of possible design, the attributive character information includes at least at least one in following attributive character:
Outside vehicle characteristic information, vehicle interior characteristic information and vehicle heading information.
In a kind of possible design, the outside vehicle characteristic information includes at least at least one in following attributive character
:
Vehicle model information, vehicle window rain eyebrow information, top holder information and skylight information；
The vehicle interior characteristic information includes at least at least one in following attributive character:
Interior pose status information, rearview mirror hanger status information, operator seat status information and co-driver shape
State information.
The third aspect, the present invention also provides a kind of computer readable storage mediums, are stored thereon with computer program, the journey
Any one possible vehicle attribute recognition methods in first aspect is realized when sequence is executed by processor.
Fourth aspect, the present invention also provides a kind of electronic equipment, comprising:
Processor；And
Memory, for storing the executable instruction of the processor；
Wherein, be configured to execute any one in first aspect via the executable instruction is executed can for the processor
The vehicle attribute recognition methods of energy.
A kind of vehicle attribute recognition methods, device, storage medium and electronic equipment provided by the invention are first passed through using pre-
If vehicle detection model the outline data information of vehicle to be identified is obtained from image to be monitored, further according to outline data information
It determines vehicle detection frame, and intercepts the corresponding images to be recognized of vehicle to be identified from image to be monitored using vehicle detection frame,
Then by preset vehicle attribute identification model to images to be recognized carry out feature extraction, with obtain in images to be recognized to
Identify the attributive character information of vehicle, thus realize the function that in security protection application scenarios suspected vehicles are carried out with identification screening,
Recognition speed and accuracy are greatly accelerated, and reduces the investment of human cost.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is this hair
Bright some embodiments for those of ordinary skill in the art without any creative labor, can be with
It obtains other drawings based on these drawings.
Fig. 1 is the application scenario diagram of vehicle attribute recognition methods shown according to an exemplary embodiment；
Fig. 2 is the flow chart of vehicle attribute recognition methods shown according to an exemplary embodiment；
Fig. 3 is a kind of possible application scene figure of embodiment illustrated in fig. 2；
Fig. 4 is the flow chart of the vehicle attribute recognition methods shown according to another exemplary embodiment；
Fig. 5 is the structural schematic diagram of vehicle attribute identification device shown according to an exemplary embodiment；
Fig. 6 is the structural schematic diagram of the vehicle attribute identification device shown according to another exemplary embodiment；
Fig. 7 is the structural schematic diagram of present invention electronic equipment shown according to an exemplary embodiment.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art
Every other embodiment obtained without creative efforts, shall fall within the protection scope of the present invention.
Fig. 1 is the application scenario diagram of vehicle attribute recognition methods shown according to an exemplary embodiment.As shown in Figure 1,
Vehicle attribute recognition methods provided in this embodiment is in use, can be by input image data either video data
Single-frame images carries out Attribute Recognition, wherein the single-frame images in input image data either video data, which can be, passes through peace
The terminal devices such as anti-camera, smart phone, tablet computer, personal computer obtain.And when being inputted is video data,
Frame decoding processing first can be carried out to video data, first every frame image is individually identified, is finally realized to all picture frames
Identification.
Wherein, vehicle attribute recognition methods provided by the present embodiment is applied and is in police's suspected vehicles investigation field
Example is illustrated.If the police know that the type for the vehicle that suspect drives is car from the information that reporter provides at this time,
Without skylight and rearview mirror is without hanger, at this point, can may be haunted the security protection video in section by obtaining the suspected vehicles, and
It is identified, meets the vehicle of clue to help the police that can quickly filter out in a large amount of vehicle data, to improve
Suspected vehicles recognition efficiency is conducive to practical popularization and application.
Fig. 2 is the flow chart of vehicle attribute recognition methods shown according to an exemplary embodiment.As shown in Fig. 2, this reality
The vehicle attribute recognition methods of example offer is provided, comprising:
Step 101 obtains image to be monitored, and is obtained from image to be monitored wait know by preset vehicle detection model
The outline data information of other vehicle.
Specifically, image to be detected can pass through the single-frame images in input image data either video data, wherein
Single-frame images of the input image data either in video data can be by security protection camera, smart phone, tablet computer,
The terminal devices such as personal computer obtain.And when being inputted is video data, first video data can be carried out at frame decoding
Reason, is first individually identified every frame image, finally realizes the identification to all picture frames, and real after every frame completes identification
When by vehicle detection frame and vehicle attribute characteristic information superposition in this frame image.
After getting image to be monitored, can be obtained from image to be monitored by preset vehicle detection model to
The outline data information for identifying vehicle, and for target detection therein, can be based on SSD target detection frame or
RefineDet target detection frame, in the present embodiment, not to the specific calculation of the outline data acquisition of information of vehicle to be identified
Method is defined, and need to only guarantee the outline data information that vehicle to be identified is obtained from image to be monitored.
In a kind of possible design, the processing of multiple convolution layer can be carried out by image to be monitored and pond layer is handled,
To form full articulamentum, then target detection network is recycled to carry out Classification and Identification to full articulamentum, to obtain vehicle to be identified
Outline data information, wherein the target detection network can be based on SSD target detection frame or RefineDet target inspection
Survey frame.
Step 102 determines vehicle detection frame according to outline data information, and using vehicle detection frame from image to be monitored
Intercept the corresponding images to be recognized of vehicle to be identified.
Specifically, it is based on SSD target detection frame or RefineDet target detection frame, can be exported as several vehicles
Detection block, wherein the position of each frame and the first coordinate value is used with size, wherein the first coordinate value includes 4 coordinates
(xmin, ymin, w, h), xmin indicate that x coordinate of the vehicle detection frame upper left corner in preset coordinate system, ymin indicate vehicle
Y-coordinate of the detection block upper left corner in preset coordinate system, w indicate that the first frame long value of vehicle detection frame, h indicate vehicle detection
First frame height value of frame, wherein above-mentioned value respectively corresponds a vehicle region as unit of pixel.
In order to distinguish each car separately through vehicle detection frame, vehicle can be determined according to outline data information
The top left corner apex of detection block the first coordinate value, the first frame long value and first frame height value in preset coordinate system, wherein
Abscissa value in one coordinate value is less than or equal to minimum abscissa value in outline data information, the ordinate in the first coordinate value
Value is greater than or equal to maximum ordinate value in outline data information, and the first frame long value is greater than or equal to maximum in outline data information
The difference of abscissa value and minimum abscissa value, the first frame height value is more than or equal to maximum ordinate value in outline data information and most
The difference of small ordinate value.
After determining vehicle detection frame, it can use vehicle detection frame and intercept vehicle pair to be identified from image to be monitored
The images to be recognized answered.In addition, corresponding to be identified intercepting vehicle to be identified from image to be monitored using vehicle detection frame
After image, unification can also be carried out to its size again, such as can scale it again to fixed dimension, such as 224*224
Pixel, the images to be recognized input vehicle attribute identification model after it will scale carries out feature extraction later.
Step 103 carries out feature extraction to images to be recognized by preset vehicle attribute identification model, to obtain wait know
The attributive character information of vehicle to be identified in other image.
It, can be by being based on moving-vision network (MobileNet), to images to be recognized after inputting images to be recognized
Feature extraction is carried out, to obtain the attributive character information of the vehicle to be identified in images to be recognized.And for getting wait know
The attributive character information of other vehicle, can be directly displayed on image to be monitored, be also possible to input corresponding statistical forecast mould
Type is screened, not special to the attribute of accessed vehicle to be identified to determine suspected vehicles, and in the present embodiment
The concrete application scene of reference breath is specifically limited.
In a kind of possible design, above-mentioned vehicle attribute identification model can also be tensor recurrent neural network mould
Type.Specifically, tensor recurrent neural networks model includes input layer, the first convolutional layer, the first correcting layer, the first pond layer,
Two convolutional layers, the second correcting layer, the second pond layer, third convolutional layer, tensor recurrence layer and output layer；Wherein, input layer, first
Convolutional layer, the first correcting layer, the first pond layer, the second convolutional layer, the second correcting layer, the second pond layer and third convolutional layer according to
Secondary connection, tensor recurrence layer are connected to third convolutional layer entirely, and output layer is connected to tensor recurrence layer entirely.
And at least one in following attributive character is included at least for attributive character information:
Outside vehicle characteristic information, vehicle interior characteristic information and vehicle heading information.
Specifically, above-mentioned outside vehicle characteristic information includes at least at least one in following attributive character:
Vehicle model information, vehicle window rain eyebrow information, top holder information and skylight information；
In addition, vehicle interior characteristic information includes at least at least one in following attributive character:
Interior pose status information, rearview mirror hanger status information, operator seat status information and co-driver shape
State information.
In one specifically application scenarios, when carrying out feature identification using MobileNet, it can be believed with defined attribute feature
Breath, specifically as described in table one:
In the present embodiment, it first passes through and obtains vehicle to be identified from image to be monitored using preset vehicle detection model
Outline data information, determine vehicle detection frame further according to outline data information, and using vehicle detection frame from image to be monitored
The corresponding images to be recognized of middle interception vehicle to be identified, then by preset vehicle attribute identification model to images to be recognized into
Row feature extraction, to obtain the attributive character information of the vehicle to be identified in images to be recognized, to realize in security protection applied field
The function that in scape suspected vehicles are carried out with identification screening, greatly accelerates recognition speed and accuracy, and reduce human cost
Investment.
On the basis of embodiment shown in Fig. 2, images to be recognized is being carried out by preset vehicle attribute identification model
Feature extraction can also be in image to be monitored after the attributive character information to obtain the vehicle to be identified in images to be recognized
Upper Overlapping display vehicle detection frame and attributive character information.
Fig. 3 is a kind of possible application scene figure of embodiment illustrated in fig. 2.As shown in figure 3, get vehicle detection frame with
And after attributive character information, can on image to be monitored Overlapping display vehicle detection frame and attributive character information, wherein
Vehicle detection frame is used to accommodate the vehicle to be identified in image to be monitored.
In the present embodiment, it first passes through and obtains vehicle to be identified from image to be monitored using preset vehicle detection model
Outline data information, determine vehicle detection frame further according to outline data information, and using vehicle detection frame from image to be monitored
The corresponding images to be recognized of middle interception vehicle to be identified, then by preset vehicle attribute identification model to images to be recognized into
Row feature extraction is finally folded on image to be monitored with obtaining the attributive character information of the vehicle to be identified in images to be recognized
Add display vehicle detection frame and attributive character information, identification sieve is carried out to suspected vehicles in security protection application scenarios to realize
The function of choosing greatly accelerates recognition speed and accuracy, and reduces the investment of human cost.
Fig. 4 is the flow chart of the vehicle attribute recognition methods shown according to another exemplary embodiment.As shown in figure 4, this
The vehicle attribute recognition methods that embodiment provides, comprising:
Step 201 treats the first pretreatment of monitoring image progress, so that image to be monitored meets preset dimension requirement.
In order to enable preset vehicle detection model to get various sizes of figure to be monitored to different modes
As being identified, monitoring image can also be treated and carry out the first pretreatment, so that image to be monitored meets preset dimension requirement.Example
It such as, can be by the image scaling to be monitored of input at fixed dimension, such as 512*512 pixel.
Step 202 treats the second pretreatment of monitoring image progress, so that image to be monitored meets preset RGB color value
It is required that.
In order to enable preset vehicle detection model to get different color, brightness and right to different modes
Image to be monitored than degree is identified, can also be treated monitoring image and be carried out the second pretreatment, so that image to be monitored meets
Preset RGB color value requirement.For example, image to be monitored can be subtracted to unified RGB mean value, such as [104,117,123].
Step 203 obtains image to be monitored, and is obtained from image to be monitored wait know by preset vehicle detection model
The outline data information of other vehicle.
Step 204 determines vehicle detection frame according to outline data information, and using vehicle detection frame from image to be monitored
Intercept the corresponding images to be recognized of vehicle to be identified.
Step 205 carries out feature extraction to images to be recognized by preset vehicle attribute identification model, to obtain wait know
The attributive character information of vehicle to be identified in other image.
It is worth explanatorily, the specific implementation of step 203-205 is referring to step 101-103 in embodiment illustrated in fig. 2
Description, which is not described herein again.
Step 206, Overlapping display vehicle detection frame and attributive character information on image to be monitored.
After getting vehicle detection frame and attributive character information, can on image to be monitored Overlapping display vehicle
Detection block and attributive character information, wherein vehicle detection frame is used to accommodate the vehicle to be identified in image to be monitored.
Fig. 5 is the structural schematic diagram of vehicle attribute identification device shown according to an exemplary embodiment.As shown in figure 5,
Vehicle attribute identification device provided in this embodiment, comprising:
Module 301 is obtained, for obtaining image to be monitored, and by preset vehicle detection model from the figure to be monitored
The outline data information of vehicle to be identified is obtained as in；
Determining module 302 for determining vehicle detection frame according to the outline data information, and utilizes the vehicle detection
Frame intercepts the corresponding images to be recognized of the vehicle to be identified from the image to be monitored；
Extraction module 303 is mentioned for carrying out feature to the images to be recognized by preset vehicle attribute identification model
It takes, to obtain the attributive character information of the vehicle to be identified in the images to be recognized.
On the basis of embodiment shown in Fig. 5, Fig. 6 is the vehicle attribute identification dress shown according to another exemplary embodiment
The structural schematic diagram set.As shown in fig. 6, vehicle attribute identification device provided by the embodiment, further includes:
Display module 304, for vehicle detection frame and the attribute described in the Overlapping display on the image to be monitored
Characteristic information, wherein the vehicle detection frame is used to accommodate the vehicle to be identified in the image to be monitored.
In a kind of possible design, the acquisition module 301 is specifically used for:
The processing of multiple convolution layer and the processing of pond layer are carried out by the image to be monitored, to form full articulamentum；
Classification and Identification is carried out to the full articulamentum using target detection network, to obtain the profile of the vehicle to be identified
Data information.
It is described that vehicle detection frame is determined according to the outline data information in a kind of possible design, comprising:
Determine the top left corner apex of the vehicle detection frame first in preset coordinate system according to the outline data information
Coordinate value, the first frame long value and the first frame height value, wherein the abscissa value in first coordinate value is less than or equal to described
Minimum abscissa value in outline data information, the ordinate value in first coordinate value be greater than or equal to the number of contours it is believed that
Maximum ordinate value in breath, the first frame long value be greater than or equal in the outline data information maximum abscissa value with it is described
The difference of minimum abscissa value, the first frame height value be greater than or equal to the outline data information in maximum ordinate value with it is described
The difference of minimum ordinate value.
In a kind of possible design, the preset vehicle attribute identification model is tensor recurrent neural networks model.
In a kind of possible design, the tensor recurrent neural networks model includes input layer, the first convolutional layer, first
Correcting layer, the first pond layer, the second convolutional layer, the second correcting layer, the second pond layer, third convolutional layer, tensor recurrence layer and defeated
Layer out；
Wherein, the input layer, first convolutional layer, first correcting layer, first pond layer, described second
Convolutional layer, second correcting layer, second pond layer and the third convolutional layer are sequentially connected, the tensor recurrence layer
It is connected to the third convolutional layer entirely, the output layer is connected to the tensor recurrence layer entirely.
Please continue to refer to Fig. 6, vehicle attribute identification device provided by the embodiment, further includes:
Preprocessing module 305, for carrying out the first pretreatment to the image to be monitored, so that the image to be monitored is full
Sufficient preset dimension requirement.
In a kind of possible design, the preprocessing module 305 is also used to:
Second pretreatment is carried out to the image to be monitored, so that the image to be monitored meets preset RGB color value
It is required that.
In a kind of possible design, the attributive character information includes at least at least one in following attributive character:
Outside vehicle characteristic information, vehicle interior characteristic information and vehicle heading information.
In a kind of possible design, the outside vehicle characteristic information includes at least at least one in following attributive character
:
Vehicle model information, vehicle window rain eyebrow information, top holder information and skylight information；
The vehicle interior characteristic information includes at least at least one in following attributive character:
Interior pose status information, rearview mirror hanger status information, operator seat status information and co-driver shape
State information.
It is worth explanatorily, the terminal device in Fig. 5 and embodiment illustrated in fig. 6 can be used for executing shown in above-mentioned Fig. 2 and Fig. 4
Method in embodiment, specific implementation is similar with technical effect, and which is not described herein again.
The present invention also provides a kind of computer readable storage mediums, are stored thereon with computer program, and the program is processed
Device realizes the technical solution of any one of aforementioned embodiment of the method when executing, it is similar that the realization principle and technical effect are similar, herein no longer
It repeats.
Fig. 7 is the structural schematic diagram of present invention electronic equipment shown according to an exemplary embodiment.As shown in fig. 7, this
The electronic equipment that embodiment provides, comprising:
Processor 401；And
Memory 402, for storing the executable instruction of the processor；
Wherein, the processor is configured to execute any one of aforementioned embodiment of the method via the executable instruction is executed
The technical solution, it is similar that the realization principle and technical effect are similar, and details are not described herein again.
Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention., rather than its limitations；To the greatest extent
Pipe present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: its according to
So be possible to modify the technical solutions described in the foregoing embodiments, or part of or all technical features are carried out etc.
With replacement；And these modifications or substitutions, technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution
Range.
Claims (13)
1. a kind of vehicle attribute recognition methods characterized by comprising
Image to be monitored is obtained, and vehicle to be identified is obtained from the image to be monitored by preset vehicle detection model
Outline data information；
Vehicle detection frame is determined according to the outline data information, and using the vehicle detection frame from the image to be monitored
Intercept the corresponding images to be recognized of the vehicle to be identified；
Feature extraction is carried out to the images to be recognized by preset vehicle attribute identification model, to obtain the figure to be identified
The attributive character information of the vehicle to be identified as in.
2. vehicle attribute recognition methods according to claim 1, which is characterized in that pass through preset vehicle attribute described
Identification model carries out feature extraction to the images to be recognized, to obtain the vehicle to be identified in the images to be recognized
After attributive character information, further includes:
Vehicle detection frame described in Overlapping display and the attributive character information on the image to be monitored, wherein the vehicle
Detection block is used to accommodate the vehicle to be identified in the image to be monitored.
3. vehicle attribute recognition methods according to claim 1, which is characterized in that described to pass through preset vehicle detection mould
Type obtains the outline data information of vehicle to be identified from the image to be monitored, comprising:
The processing of multiple convolution layer and the processing of pond layer are carried out by the image to be monitored, to form full articulamentum；
Classification and Identification is carried out to the full articulamentum using target detection network, to obtain the outline data of the vehicle to be identified
Information.
4. vehicle attribute recognition methods according to claim 3, which is characterized in that described according to the outline data information
Determine vehicle detection frame, comprising:
The top left corner apex of the vehicle detection frame the first coordinate in preset coordinate system is determined according to the outline data information
Value, the first frame long value and the first frame height value, wherein the abscissa value in first coordinate value is less than or equal to the profile
Minimum abscissa value in data information, the ordinate value in first coordinate value are greater than or equal in the outline data information
Maximum ordinate value, the first frame long value are greater than or equal to maximum abscissa value and the minimum in the outline data information
The difference of abscissa value, the first frame height value are greater than or equal to maximum ordinate value and the minimum in the outline data information
The difference of ordinate value.
5. vehicle attribute recognition methods according to claim 4, which is characterized in that the preset vehicle attribute identifies mould
Type is tensor recurrent neural networks model.
6. vehicle attribute recognition methods according to claim 5, which is characterized in that the tensor recurrent neural networks model
Including input layer, the first convolutional layer, the first correcting layer, the first pond layer, the second convolutional layer, the second correcting layer, the second pond layer,
Third convolutional layer, tensor recurrence layer and output layer；
Wherein, the input layer, first convolutional layer, first correcting layer, first pond layer, second convolution
Layer, second correcting layer, second pond layer and the third convolutional layer are sequentially connected, and the tensor recurrence layer connects entirely
It is connected to the third convolutional layer, the output layer is connected to the tensor recurrence layer entirely.
7. vehicle attribute recognition methods according to claim 1, which is characterized in that pass through preset vehicle detection described
Model is before the outline data information for obtaining vehicle to be identified in the image to be monitored, further includes:
First pretreatment is carried out to the image to be monitored, so that the image to be monitored meets preset dimension requirement.
8. vehicle attribute recognition methods according to claim 7, which is characterized in that carrying out the to the image to be monitored
After one pretreatment, further includes:
Second pretreatment is carried out to the image to be monitored, so that the image to be monitored meets preset RGB color value requirement.
9. vehicle attribute recognition methods described in any one of -8 according to claim 1, which is characterized in that the attributive character
Information includes at least at least one in following attributive character:
Outside vehicle characteristic information, vehicle interior characteristic information and vehicle heading information.
10. vehicle attribute recognition methods according to claim 9, which is characterized in that the outside vehicle characteristic information is extremely
Less include at least one in following attributive character:
Vehicle model information, vehicle window rain eyebrow information, top holder information and skylight information；
The vehicle interior characteristic information includes at least at least one in following attributive character:
Interior pose status information, rearview mirror hanger status information, operator seat status information and co-driver state letter
Breath.
11. a kind of vehicle attribute identification device characterized by comprising
Module is obtained, is obtained from the image to be monitored for obtaining image to be monitored, and by preset vehicle detection model
Take the outline data information of vehicle to be identified；
Determining module for determining vehicle detection frame according to the outline data information, and utilizes the vehicle detection frame from institute
It states and intercepts the corresponding images to be recognized of the vehicle to be identified in image to be monitored；
Extraction module, for carrying out feature extraction to the images to be recognized by preset vehicle attribute identification model, to obtain
Obtain the attributive character information of the vehicle to be identified in the images to be recognized.
12. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor
Claim 1-9 described in any item vehicle attribute recognition methods are realized when execution.
13. a kind of electronic equipment characterized by comprising
Processor；And
Memory, for storing the executable instruction of the processor；
Wherein, the processor is configured to require 1-9 described in any item via executing the executable instruction and carry out perform claim
Vehicle attribute recognition methods.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811169429.8A CN109508636A (en) | 2018-10-08 | 2018-10-08 | Vehicle attribute recognition methods, device, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811169429.8A CN109508636A (en) | 2018-10-08 | 2018-10-08 | Vehicle attribute recognition methods, device, storage medium and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109508636A true CN109508636A (en) | 2019-03-22 |
Family
ID=65746422
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811169429.8A Pending CN109508636A (en) | 2018-10-08 | 2018-10-08 | Vehicle attribute recognition methods, device, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109508636A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110674873A (en) * | 2019-09-24 | 2020-01-10 | Oppo广东移动通信有限公司 | Image classification method and device, mobile terminal and storage medium |
| CN110765861A (en) * | 2019-09-17 | 2020-02-07 | 中控智慧科技股份有限公司 | Unlicensed vehicle type identification method and device and terminal equipment |
| CN110765862A (en) * | 2019-09-17 | 2020-02-07 | 中控智慧科技股份有限公司 | Car logo identification method and terminal equipment |
| CN111079543A (en) * | 2019-11-20 | 2020-04-28 | 浙江工业大学 | Efficient vehicle color identification method based on deep learning |
| CN113449554A (en) * | 2020-03-25 | 2021-09-28 | 北京灵汐科技有限公司 | Target detection and identification method and system |
| CN113569912A (en) * | 2021-06-28 | 2021-10-29 | 北京百度网讯科技有限公司 | Vehicle identification method and device, electronic equipment and storage medium |
| CN115359436A (en) * | 2022-08-18 | 2022-11-18 | 中国人民公安大学 | Remote sensing image-based checking method, device, equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105574550A (en) * | 2016-02-02 | 2016-05-11 | 北京格灵深瞳信息技术有限公司 | Vehicle identification method and device |
| CN106599869A (en) * | 2016-12-22 | 2017-04-26 | 安徽大学 | Vehicle attribute identification method based on multi-task convolutional neural network |
| CN106897747A (en) * | 2017-02-28 | 2017-06-27 | 深圳市捷顺科技实业股份有限公司 | A kind of method and device for differentiating vehicle color based on convolutional neural networks model |
| CN107153812A (en) * | 2017-03-31 | 2017-09-12 | 深圳先进技术研究院 | A kind of exercising support method and system based on machine vision |
| CN108256567A (en) * | 2018-01-12 | 2018-07-06 | 环球大数据科技有限公司 | A kind of target identification method and system based on deep learning |
-
2018
- 2018-10-08 CN CN201811169429.8A patent/CN109508636A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105574550A (en) * | 2016-02-02 | 2016-05-11 | 北京格灵深瞳信息技术有限公司 | Vehicle identification method and device |
| CN106599869A (en) * | 2016-12-22 | 2017-04-26 | 安徽大学 | Vehicle attribute identification method based on multi-task convolutional neural network |
| CN106897747A (en) * | 2017-02-28 | 2017-06-27 | 深圳市捷顺科技实业股份有限公司 | A kind of method and device for differentiating vehicle color based on convolutional neural networks model |
| CN107153812A (en) * | 2017-03-31 | 2017-09-12 | 深圳先进技术研究院 | A kind of exercising support method and system based on machine vision |
| CN108256567A (en) * | 2018-01-12 | 2018-07-06 | 环球大数据科技有限公司 | A kind of target identification method and system based on deep learning |
Non-Patent Citations (1)
| Title |
|---|
| 徐博: ""基于卷积神经网络的车辆属性识别"", 《中国优秀硕士学位论文全文数据库－信息科技辑》 * |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110765861A (en) * | 2019-09-17 | 2020-02-07 | 中控智慧科技股份有限公司 | Unlicensed vehicle type identification method and device and terminal equipment |
| CN110765862A (en) * | 2019-09-17 | 2020-02-07 | 中控智慧科技股份有限公司 | Car logo identification method and terminal equipment |
| CN110674873A (en) * | 2019-09-24 | 2020-01-10 | Oppo广东移动通信有限公司 | Image classification method and device, mobile terminal and storage medium |
| CN110674873B (en) * | 2019-09-24 | 2022-05-27 | Oppo广东移动通信有限公司 | Image classification method and device, mobile terminal and storage medium |
| CN111079543A (en) * | 2019-11-20 | 2020-04-28 | 浙江工业大学 | Efficient vehicle color identification method based on deep learning |
| CN111079543B (en) * | 2019-11-20 | 2022-02-15 | 浙江工业大学 | Efficient vehicle color identification method based on deep learning |
| CN113449554A (en) * | 2020-03-25 | 2021-09-28 | 北京灵汐科技有限公司 | Target detection and identification method and system |
| CN113449554B (en) * | 2020-03-25 | 2024-03-08 | 北京灵汐科技有限公司 | Target detection and identification method and system |
| CN113569912A (en) * | 2021-06-28 | 2021-10-29 | 北京百度网讯科技有限公司 | Vehicle identification method and device, electronic equipment and storage medium |
| CN115359436A (en) * | 2022-08-18 | 2022-11-18 | 中国人民公安大学 | Remote sensing image-based checking method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109522790A (en) | Human body attribute recognition approach, device, storage medium and electronic equipment | |
| CN109508636A (en) | Vehicle attribute recognition methods, device, storage medium and electronic equipment | |
| US10943145B2 (en) | Image processing methods and apparatus, and electronic devices | |
| CN111178183B (en) | Face detection method and related device | |
| CN109284738B (en) | Irregular face correction method and system | |
| JP7165742B2 (en) | LIFE DETECTION METHOD AND DEVICE, ELECTRONIC DEVICE, AND STORAGE MEDIUM | |
| US20190213392A1 (en) | Face spatial positioning method, face spatial positioning system, and non-transitory computer-readable recording medium | |
| CN109492638A (en) | Method for text detection, device and electronic equipment | |
| CN112381104B (en) | Image recognition method, device, computer equipment and storage medium | |
| CN106446862A (en) | Face detection method and system | |
| CN111160202A (en) | AR equipment-based identity verification method, AR equipment-based identity verification device, AR equipment-based identity verification equipment and storage medium | |
| JP7419080B2 (en) | computer systems and programs | |
| CN110910445B (en) | Object size detection method, device, detection equipment and storage medium | |
| CN107993256A (en) | Dynamic target tracking method, apparatus and storage medium | |
| WO2023165616A1 (en) | Method and system for detecting concealed backdoor of image model, storage medium, and terminal | |
| CN109816694A (en) | Method for tracking target, device and electronic equipment | |
| CN111832561B (en) | Character sequence recognition method, device, equipment and medium based on computer vision | |
| CN112435223A (en) | Target detection method, device and storage medium | |
| CN108875500A (en) | Pedestrian recognition methods, device, system and storage medium again | |
| CN114005149A (en) | Training method and device for target angle detection model | |
| CN113255549A (en) | Intelligent recognition method and system for pennisseum hunting behavior state | |
| CN117037244A (en) | Face security detection method, device, computer equipment and storage medium | |
| CN114170642A (en) | Image detection processing method, device, equipment and storage medium | |
| CN108875467B (en) | Living body detection method, living body detection device and computer storage medium | |
| CN114463685B (en) | Behavior recognition method, behavior recognition device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190322 |
|
| RJ01 | Rejection of invention patent application after publication |