CN101196996A - Image detection method and device - Google Patents

Image detection method and device Download PDF

Info

Publication number
CN101196996A
CN101196996A CNA200710308416XA CN200710308416A CN101196996A CN 101196996 A CN101196996 A CN 101196996A CN A200710308416X A CNA200710308416X A CN A200710308416XA CN 200710308416 A CN200710308416 A CN 200710308416A CN 101196996 A CN101196996 A CN 101196996A
Authority
CN
China
Prior art keywords
automobile
input picture
candidate
edge
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA200710308416XA
Other languages
Chinese (zh)
Other versions
CN100578527C (en
Inventor
邓亚峰
黄英
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanxi Vimicro Technology Co Ltd
Original Assignee
Vimicro Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vimicro Corp filed Critical Vimicro Corp
Priority to CN200710308416A priority Critical patent/CN100578527C/en
Publication of CN101196996A publication Critical patent/CN101196996A/en
Application granted granted Critical
Publication of CN100578527C publication Critical patent/CN100578527C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The present invention discloses an image detection method and a device thereof, which is used to solve the problems that the prior art is slow in automobile detection speed and poor in effect. The image detection method provided by the present invention comprises that: a weak feature library is obtained in advance through an edge direction histogram in a set rectangular region in an image, and a rapid automobile classifier based on a hierarchical self-adaptive enhanced classifier and the edge direction histogram is arranged by utilizing the weak feature library; through the edge direction and edge intensity of an input image, the edge direction histogram in the set rectangular region on the input image is calculated; according to the edge direction histogram in the set rectangular region on the input image, an automobile position in the input image is determined by adopting the rapid automobile classifier. The present invention also discloses an image tracking method and a device thereof. The present invention is used to determine automobile positions in images rapidly and accurately.

Description

A kind of image detecting method and device
Technical field
The present invention relates to technical field of image processing, relate in particular to a kind of image detecting method and device.
Background technology
Automobile Detection is meant automatically the number that obtains automobile from image that collects or video, and the technology of the position of each automobile and size.
In the prior art, as classifier design method important in the area of pattern recognition, self-adaptation strengthens (Adaboost) algorithm and obtained good application in comprising a lot of application that people's face detects.Voila etc. have proposed a kind of human face detection tech based on microstructure features (Haar-like Features) and level type (Cascade-based) self-adaptation enhancing (Adaboost) sorter, this technology on performance with suitable based on the method for support vector machine (SVM) and neural network (Neural Network), but, on speed, be higher than far away based on support vector machine and neural network method, can reach the level of real time execution substantially.But, because distance distance in the class of mode motor in the class of people's face pattern makes the separation vehicle problem be difficult to people's face pattern far away.So though this method can be applied directly on the Automobile Detection, and detection speed is very fast, detects effect and but can't reach practical requirement.
Support vector machine (SVM) has also obtained a lot of important use as the sorter that a kind of relative Adaboost has better generalization ability.But, adopt the detection speed of this sorter but extremely slow, can't be applied in the system of real time execution, thereby limit its application.In addition, because the process of training svm classifier device is loaded down with trivial details, so, adopt this method design vehicle sorter complexity than higher.
In sum, slow, the weak effect of Automobile Detection speed of the prior art.
Summary of the invention
The embodiment of the invention provides a kind of image detecting method and device that is used for the automobile position of definite image, and the Automobile Detection speed that exists in the prior art is slow in order to solve, the problem of weak effect.
The image detecting method that the embodiment of the invention provides comprises:
Obtain weak feature database by the edge orientation histogram of setting in the rectangular area in the image in advance, and utilize this weak feature database setting to strengthen the quick separation vehicle device of sorter and edge orientation histogram based on level type self-adaptation;
By the edge direction and the edge strength of input picture, calculate the edge orientation histogram of setting on the described input picture in the rectangular area;
Adopt described quick separation vehicle device, the above sets the edge orientation histogram in the rectangular area according to described input picture, determines the automobile position in the described input picture.
The image tracking method that the embodiment of the invention provides comprises:
Obtain weak feature database by the edge orientation histogram of setting in the rectangular area in the image in advance, and utilize this weak feature database setting to strengthen the quick separation vehicle device of sorter and edge orientation histogram based on level type self-adaptation;
Input picture is compared with reference picture, obtain the moving region of described input picture;
By described quick separation vehicle device described moving region is judged, obtained the automobile position in the described input picture.
The image detection device that the embodiment of the invention provides comprises:
The unit is set, is used for obtaining weak feature database, and utilize this weak feature database setting to strengthen the quick separation vehicle device of sorter and edge orientation histogram based on level type self-adaptation by the edge orientation histogram that image is set in the rectangular area;
The edge orientation histogram unit is used for edge direction and edge strength by input picture, calculates the edge orientation histogram of setting on the described input picture in the rectangular area;
Detecting unit is used to adopt described quick separation vehicle device, and the above sets the edge orientation histogram in the rectangular area according to described input picture, determines the automobile position in the described input picture.
The image tracking means that the embodiment of the invention provides comprises:
The unit is set, is used for obtaining weak feature database, and utilize this weak feature database setting to strengthen the quick separation vehicle device of sorter and edge orientation histogram based on level type self-adaptation by the edge orientation histogram that image is set in the rectangular area;
Determine the unit, moving region, be used for input picture is compared with reference picture, obtain the moving region of described input picture;
Identifying unit is used for by described quick separation vehicle device described moving region being judged, obtains the automobile position in the described input picture.
The embodiment of the invention obtains weak feature database by the edge orientation histogram of setting in the rectangular area in the image in advance, and utilizes this weak feature database setting to strengthen the quick separation vehicle device of sorter and edge orientation histogram based on level type self-adaptation; By the edge direction and the edge strength of input picture, calculate the edge orientation histogram of setting on the described input picture in the rectangular area; Adopt described quick separation vehicle device, the above sets the edge orientation histogram in the rectangular area according to described input picture, determines the automobile position in the described input picture, thereby realizes determining quickly and accurately automobile position.
Description of drawings
The image detecting method schematic flow sheet that is used for determining automobile position that Fig. 1 provides for the embodiment of the invention;
The structural representation of the level type Adaboost detecting device that Fig. 2 provides for the embodiment of the invention;
The no symbol edge direction discretize synoptic diagram that Fig. 3 provides for the embodiment of the invention;
The integral image synoptic diagram that Fig. 4 provides for the embodiment of the invention;
The synoptic diagram of asking for edge orientation histogram fast that Fig. 5 provides for the embodiment of the invention;
The employing that Fig. 6 provides for the embodiment of the invention is determined the concrete grammar schematic flow sheet of the automobile position in the input picture based on the quick separation vehicle device of level type Adaboost and HOG;
The border movement area schematic that Fig. 7 provides for the embodiment of the invention;
The Adaboost level type separation vehicle device synoptic diagram that Fig. 8 provides for the embodiment of the invention in conjunction with kinergety;
The image tracking method schematic flow sheet that is used for the tracking motor position that Fig. 9 provides for the embodiment of the invention.
Embodiment
Because distance is very big in the class of automobile, difference such as color, shape is very big between the different vehicle, thereby the embodiment of the invention adopts edge orientation histogram (HOG) feature of the edge contour information between automobile and background that can embody, and adopt level type self-adaptation quick and that be easy to realize to strengthen (AdaBoost) sorter, fast and accurately realize Automobile Detection and tracking.In order further to improve Automobile Detection speed, the embodiment of the invention is attached to movable information in the Automobile Detection.Simultaneously, utilize the positional information of automobile and colouring information etc. to carry out the automobile coupling, obtain the automobile trace information, and adopt the automobile trace information that traveling automobile on the highway is counted, with the statistics magnitude of traffic flow.
Below in conjunction with accompanying drawing, the technical scheme that the embodiment of the invention is provided describes in detail.
Referring to Fig. 1, for speed and the effect that improves Automobile Detection, the method that the mode that the employing that the embodiment of the invention provides combines level type Adaboost and HOG feature detects automobile comprises:
S101, determine the horizontal direction of the image that collects and the edge of vertical direction respectively.
The direction at the edge of S102, calculating discretize, and, edge calculation intensity.
S103, employing histogram mode edge calculation histogram HOG.
S104, employing auto graph are positive sample, and other non-auto graph is anti-sample, and training is based on the quick separation vehicle device of level type Adaboost and HOG.
S105, adopt quick separation vehicle device, determine the automobile position in the input picture based on level type Adaboost and HOG.
Referring to Fig. 2, level type Adaboost structure for all candidate window, adopts the ground floor sorter to judge earlier as shown in Figure 1, if can pass through the ground floor sorter, then adopts second layer sorter to proceed to judge, otherwise, directly refuse.In like manner, carry out follow-up each layer processing, can pass through the rectangular area of all layers sorter as candidate's automobile zone (abbreviation candidate frame).
Above-mentioned each layer sorter (being called strong classifier) all is made up of a plurality of Weak Classifiers, and the weighted sum of the Weak Classifier output in every layer of strong classifier and the threshold value of this layer strong classifier compare resulting result, are the output of this layer strong classifier.AdaBoost strong classifier building method has a variety of, and is commonly used as Discrete-AdaBoost, Real-AdaBoost and Gentle-AdaBoost etc., can be used for constructing above-mentioned each layer strong classifier.The corresponding weak feature of each Weak Classifier, the make of Weak Classifier also has a variety of, can select the above-mentioned Weak Classifier of structure for use.Simple as Weak Classifier building method based on threshold value:
Figure S200710308416XD00051
Wherein, x is the input picture of fixed size, g j(X) represent the weak eigenwert of j of this image correspondence, θ jBe the decision threshold of j weak feature correspondence, polarity sign p jValue be 1 or-1, work as p jBe 1 o'clock, the judgement symbol of decision device is a greater-than sign, works as p jBe at-1 o'clock, the symbol of decision device is an is less than, h j(x) the judgement output of j Weak Classifier of expression.Like this, each Weak Classifier threshold ratio that only need carry out once just can be finished judgement.
Preferably, on the make of Weak Classifier, in order to improve the classification capacity of Weak Classifier, the embodiment of the invention adopts the manner of comparison of dual threshold to construct Weak Classifier, each Weak Classifier is set by two threshold value (q j 1And q j 2, and q j 1<q j 2) and a polarity sign (p j, p jValue be 1 or-1) form.
Work as p jBe 1 o'clock, Weak Classifier is defined as:
Figure S200710308416XD00052
Work as p jBe at-1 o'clock, Weak Classifier is defined as:
Figure S200710308416XD00053
Wherein, x is the image of fixed size, g j(X) corresponding j the weak eigenwert of presentation video, h j(x) the judgement output of j Weak Classifier of expression.
The make of the Weak Classifier that the embodiment of the invention proposes, more pervasive than the mode that prior art proposes.Work as p jBe 1, and q j 2During for positive infinity, Be converted to Middle p j=1 situation; Work as p jBe 1, and q j 1During for negative infinitesimal, Be converted to
Figure S200710308416XD00063
Middle p j=-1 situation.That is to say that the dual threshold mode of embodiment of the invention proposition has included the situation of single threshold.
In the Weak Classifier training step, to current feature g j(X), select p j, q j 1And q j 2, make Weak Classifier that this weak feature forms weighting error rate minimum to all samples.Therefore, the embodiment of the invention has increased the possible form of candidate's Weak Classifier, thereby makes it possible to select the stronger Weak Classifier of classification capacity, thereby improves the performance of strong classifier and even final level type AdaBoost sorter.
In addition, the embodiment of the invention also can adopt the look-up table Weak Classifier building method structure Weak Classifier that proposes in the prior art.
It should be explicitly made clear at this point that the weak feature in the embodiment of the invention refers to certain accumulated value of the edge orientation histogram correspondence in certain rectangular area.Wherein, the edge orientation histogram in certain zone is defined as the accumulative histogram of each pixel on each discretize edge direction (total DN the direction of supposition) in this rectangular area.Introduce the concrete acquiring method of edge orientation histogram (HOG) below.
Among the step S101, ask for the horizontal edge and the vertical edge of each pixel on the image respectively, the acquiring method of image border has a lot, and commonly used is Sobel and Prewitt operator.The Sobel operator is distributed as in the detection template of level and vertical direction:
- 1 0 1 - 2 0 . 2 - 1 0 1
With
- 1 - 2 - 1 0 0 . 0 1 2 1
The Prewitt operator is respectively in the detection template of level and vertical direction:
- 1 0 1 - 1 0 . 1 - 1 0 1
With
- 1 - 1 - 1 0 0 . 0 1 1 1
Above-mentioned template is that template is asked at the edge of gray level image.The embodiment of the invention has provided a kind of directly method at computed image edge in the hyperchannel coloured image.Suppose the current pixel point coordinate for (x, y), and the corresponding vectorial CV of all colours channel value of this pixel (x, y), then (x, y) and (x ', y ') two pixel color differences be the norm of the difference of two pixel corresponding color vectors, be NORM (CV (x, y)-CV (x ', y ')).Norm can be (but being not limited to) 1 norm, 2 norms or infinite norm.
The Sobel horizontal edge computing method of coloured image are as follows:
NORM(CV(x+1,y-1)-CV(x-1,y-1))+NORM(CV(x+1,y+1)-CV(x-1,y+1))+2*NORM(CV(x+1,y)-CV(x-1,y))。
The Sobel vertical edge computing method of coloured image are as follows:
NORM(CV(x-1,y+1)-CV(x-1,y-1))+NORM(CV(x+1,y+1)-CV(x+1,y-1))+2*NORM(CV(x,y+1)-CV(x,y-1))。
The Prewitt horizontal edge computing method of coloured image are as follows:
NORM(CV(x+1,y-1)-CV(x-1,y-1))+NORM(CV(x+1,y+1)-CV(x-1,y+1))+NORM(CV(x+1,y)-CV(x-1,y))。
The Prewitt vertical edge computing method of coloured image are as follows:
NORM(CV(x-1,y+1)-CV(x-1,y-1))+NORM(CV(x+1,y+1)-CV(x+1,y-1))+NORM(CV(x,y+1)-CV(x,y-1))。
Among the step S102, edge direction is carried out discretize, the edge direction and the edge strength of trying to achieve discretize are specific as follows:
The horizontal edge of supposing the current pixel point of trying to achieve is EH, and vertical edge is EV, further needs to calculate the direction and the intensity at this pixel edge, supposes that direction is ED, and intensity is EI.Wherein, edge direction has two kinds of definition modes, and a kind of is signless edge direction, and promptly the scope of edge direction is 0 to 180 degree, thinks that the edge direction that differs 180 degree is same direction.Another is the edge direction that symbol is arranged, and edge direction is 0 to 360, thinks that the direction that differs 180 degree is a different directions.Only provide the discretization method of no symbol edge direction in the embodiment of the invention.Suppose to turn to N interval with signless edge direction is discrete, the situation when N=6 as shown in Figure 3.A kind of computing formula of edge strength is
Figure S200710308416XD00081
, also can for | EH|+|EV|, the no symbol edge direction among Fig. 3 is ED = arccot ( EV EH ) , Wherein arccot represents to ask for the inverse function of cotangent function, and then the edge direction of discretize is:
But, adopt above-mentioned definition to calculate ED earlier, the speed of calculating NED then is slow.Preferably, the method for a kind of quick calculating NED of embodiment of the invention proposition comprises:
The first step judges whether EH is 0, if EH is 0, then setting NED is 0; Otherwise, carried out for second step and handle.
In second step, initialization i=0 calculates
Figure S200710308416XD00084
Value.
In the 3rd step, judge
Figure S200710308416XD00085
Whether less than
Figure S200710308416XD00086
, if then execution in step the 6th goes on foot; Otherwise, forwarded for the 4th step to.
In the 4th step, i increases by 1.
In the 5th step, whether judge i less than N-1, if then forwarded for the 3rd step to; Otherwise, the 6th step of execution in step.
In the 6th step, setting NED is i, withdraws from flow process.
Then the edge orientation histogram HOG in certain image-region R is defined as the edge strength of all pixels on all directions in this zone accumulation and, that is:
Figure S200710308416XD00091
Wherein, (x y) represents certain pixel coordinate to P, and (P (x, y)) represents the edge strength of this pixel to EI, and (P (x, y)) represents the edge direction of this pixel to ED.
When step S104 trains quick separation vehicle device, at first need to gather and extract automobile sample and other non-automobile samples of standard, and be normalized to fixed size (width such as image is W, highly is H), this size is the size of the Automobile Detection device of training.
For the AdaBoost training algorithm, need construct feature set a little less than the candidate for it.A kind of feasible embodiment is to adopt the value of edge orientation histogram on certain discretize edge direction of the setting rectangular area (being called sub-rectangle) in the image-region of subscribing yardstick as weak feature.The edge orientation histogram correspondence of the sub-rectangle of all existence feature a little less than the value on all discretize directions is the candidate then.For width is W, highly is the image-region of H, and sub-rectangular set is:
{R(left,top,right,bottom)|0≤left<right<W,0≤top<bottom<H}
Wherein, left, top, right, bottom represent left frame, upper side frame, the left frame of sub-rectangle, the position coordinates of lower frame respectively, promptly wide be W, high for any rectangle in the image range of H all in sub-rectangular set, can overlap mutually between this a little rectangle.In order to reduce operand, improve training speed, can limit the width and the altitude range of sub-rectangle, and the spacing between each sub-rectangle left frame and the upper side frame.The width minimum value of setting sub-rectangle is WMin, and the width maximal value is WMax, and the height minimum value is HMin, the height maximal value is HMax, minimum horizontal distance and minimum perpendicular distance are 1 between sub-rectangle, and the sub-rectangle that then sub-rectangular set comprises is: R (left, top, right, bottom), wherein left gets W-wr from 0, and top gets H-hr from 0, wherein wr gets WMax from WMin, and hr gets HMax from HMin.WMin can be taken as 1, and WMax is taken as W, and HMin can be taken as 1, and HMax is taken as H.
For each the sub-rectangle in the above-mentioned sub-rectangular set, all there is a direction gradient histogram Hist, this Hist is a vector, contains N element altogether.The sub-rectangle number of supposing above-mentioned setting is NR, then total NR*N the direction histogram element of all sub-rectangles.Regard each direction histogram element as a weak feature, then the AdaBoost algorithm obtains common NR*N weak feature.
For the AdaBoost algorithm, weak feature database need be set, comprise much being used for selecteed weak feature.Adopt above-mentioned NR*N direction histogram unit that weak feature database usually is set in the embodiment of the invention.
But, directly according to formula The histogrammic operand of calculated direction can be very big, therefore, the embodiment of the invention adopts the quick edge calculation direction histogram of integral image HOG, promptly the edge strength by each edge direction of all pixels after discretize in the candidate rectangle zone on the edge direction integral image calculating input image with, specific as follows:
Suppose that the edge gradient direction is turned to N direction by discrete, then calculate the edge direction integral image of N direction respectively, the edge direction integral image of supposing n direction is at point (x, y) value be II (x, y, n), as shown in Figure 4, the edge direction integral image of n direction point (x, the value defined of y) locating for all the edge discretize directions in the grey rectangle zone in its upper left corner be n pixel edge strength with, that is:
Figure S200710308416XD00102
The mode that adopts following iteration obtains the edge direction integral image of all directions for one time to edge direction and edge strength image from the grey rectangle sector scanning in the upper left corner:
Handle all N direction successively.Suppose when pre-treatment be n direction, adopt rs (x, y, n) expression y capable arrive current pixel (x, y) till all edge directions of (comprising current pixel) be the edge strength sum of the pixel of n, that is:
Figure S200710308416XD00103
Then adopt following formula iterative computation edge direction integral image:
If NED (x y) is n, then rs (x, y, n)=rs (x-1, y, n)+EI (x, y); Otherwise, rs (x, y, n)=rs (x-1, y, n); And then have: II (x, y, n)=II (x, y-1, n)+rs (x, y, n).
Concrete implementation is as follows:
To any n=0,1,2...N-1, carry out following processing:
To any y=0,1,2...H-1 and x=0,1,2...W-1, setting II (1, y, n)=0, II (x ,-1, n)=0;
To all row of image, according to y=0,1, the order of 2...H-1 is carried out following processing:
Set rs=0 represent the current line edge direction be n all pixel edge intensity and initial value be 0;
All pixels to image y in capable are docile and obedient preface x=0, and 1,2...W-1 carries out following processing:
If NED (x y) is n, then make rs=rs+EI (x, y);
Otherwise, keep rs constant;
And then calculate:
II(x,y,n)=II(x,y-1,n)+rs;
Then calculate the capable edge direction integral image of y+1 after having calculated the capable edge direction integral image of y.
After all capable disposing to image, finish the calculating of edge direction integral image.
Viola propose a kind of quick calculating rectangular area interior pixel brightness and method, this method can be expanded and be used for edge calculation direction integral image, for each edge direction, need W*H s (x, y, n) write down every row pixel edge direction till the current pixel be n pixel edge strength and.And the embodiment of the invention to adopt every row all edge directions of (comprising current pixel) till the current pixel be the edge strength of n and (be that rs (x, y, n)) comes recursion calculated product partial image.The embodiment of the invention is when the calculated product partial image, according to from top to bottom, from left to right order recursion calculates, therefore embodiment of the invention method only need be preserved the rs (x of current pixel, y) be rs, can save internal memory widely, for the higher application of some request memories, such as chip design, the method that adopts the embodiment of the invention to provide has more advantage.
Adopt above-mentioned edge direction integral image can ask for the edge orientation histogram HOG that rectangular area inward flange direction is n fast.Suppose rectangle D (left, top, right, bottom) in, edge direction is that the edge orientation histogram of n is Hist (n, D), as shown in Figure 5, wherein shadow region A, B, C, D represent a rectangular area respectively, and point 1,2,3,4 is the summit, the lower right corner of corresponding region A, B, C, D respectively, according to the definition of edge direction integral image, can calculate according to following formula:
Hist(n,D)=II(4,n)-II(2,n)-II(3,n)+II(1,n)
Wherein, II (1, n), II (2, n), II (3, n) and II (4, n) represent that respectively edge direction is that the edge direction integral image of n is at point 1, point 2, point 3 with put the value at 4 places.
The Automobile Detection device that above-mentioned training obtains can only detect the automobile of a yardstick (W*H), in order to detect the automobile of different sizes, can detect according to the mode of asking for the pyramid picture structure.Suppose original input picture width and highly be respectively IW and IH, calculate the pyramid image of a series of a plurality of yardsticks (being assumed to M) according to scaling yardstick RS, size is (ROUND (IW*RSm), ROUND (IH*RSm)), wherein ROUND is the computing that rounds up, and the span of m is to M-1 from 0.
Referring to Fig. 6, step S105 specifically comprises:
S601, according to input picture, obtain the pyramid picture structure.
S602, for the pyramid image of each yardstick, calculate the discretize edge direction and the edge strength of this scalogram picture, and the edge calculation direction histogram.
S603, with a fixed step size, obtain rectangle frame position possible on this scalogram picture with vertical direction traversal in the horizontal direction.
The Automobile Detection device model of S604, the fixed size (W*H) that obtains according to above-mentioned training calculates the required edge orientation histogram of detection model, and further calculates current rectangle and whether can pass through the Automobile Detection device, if, execution in step S605 then, otherwise, execution in step S606.
S605, candidate's automobile frame is added the automobile formation, and return execution in step S603, obtain and handle next possible rectangle frame, all possible rectangle frame position all disposes on this scalogram picture.
S606, refuse not the rectangle frame by checking, and return execution in step S603, obtain and handle next possible rectangle frame, all possible rectangle frame position all disposes on this scalogram picture.
S607, behind the pyramid image of handling all yardsticks, according to the candidate's automobile frame in the automobile formation, determine the automobile position in the input picture.
Preferably, step S605 comprises the step that candidate's automobile frame adds the automobile formation: according to the size and the position of candidate's automobile frame to be added, and the size and the position that have been added to the candidate's automobile frame in the automobile formation, judge whether described candidate's automobile frame to be added is close with the described candidate's automobile frame that has added, if, then close candidate's automobile frame is merged, and with the number of the merged candidate's automobile frame degree of confidence as the candidate's automobile frame after merging; Otherwise, described candidate's automobile frame to be added is added in the described automobile formation.
Preferably, step S607 determines that according to the candidate's automobile frame in the automobile formation step of the automobile position in the input picture comprises: when the candidate's automobile frame in the automobile formation is contained in another candidate's automobile frame, and candidate's automobile frame deletion that degree of confidence is less; When degree of confidence is identical, the less candidate's automobile frame of deletion area; To be defined as the automobile position on the input picture through the position of remaining candidate's automobile frame in the automobile formation after described merging and the deletion processing.
Though above-mentioned Automobile Detection device can satisfy the requirement of real time execution, but, in video image, the movable information of the automobile in the combining image can further be accelerated the speed of Automobile Detection, simultaneously, the interference that exists in can also the rejection image background, thus flase drop reduced, improve the Automobile Detection effect.
For the static situation of camera, it is poor that current input image and the background image that sets in advance are done, and obtains motion pixel sign mask; And, be the candidate frame setting threshold in advance, only motion is carried out Automobile Detection greater than to a certain degree candidate frame.In the embodiment of the invention, the number of pixels that changes in the definition rectangle frame is the kinergety of rectangle frame, weighs the degree that the pixel in the rectangle frame changes by this kinergety.
The sign mask images of supposing the pixel that changes in the present image is MI, be in point (x, the sign mask images of y) locating be MI (x, y), if pixel changes, then (x is a non-zero number y) to MI, is assumed to MF, if this pixel does not change, then (x is zero y) to MI.
Further, the number of pixels that adopts rectangular area normalization to change, i.e. normalization kinergety is the number of pixels that changes in the rectangular area and the ratio of rectangular area area.Further, can adopt the mode of integral image to calculate normalization kinergety and kinergety fast.At first calculate the motion sign integral image of full figure, concrete steps are as follows:
To any y=0,1,2...H-1 and x=0,1,2...W-1, setting II (1, y)=0, IMI (x ,-1)=0;
To all row of image, according to y=0,1, the order of 2...H-1 is carried out following processing:
Set rs and represent all number of pixels that change of current line, initialization rs is 0;
All pixels to image y in capable are according to x=0, and 1, the order of 2...W-1 is carried out following processing:
If current pixel changes, then make rs=rs+1; If current pixel does not change, keep rs constant; And then current pixel (x, and motion sign integral image IMI y) (x, y)=IMI (x, y-1)+rs;
Then calculate the capable motion sign integral image of y+1 after having calculated the capable motion sign integral image of y.
After all capable disposing to image, finishing the calculating of motion sign integral image.
As shown in Figure 5, according to the definition of motion sign integral image, kinergety can be calculated according to following formula:
ME(D)=IMI(4)-IMI(2)-IMI(3)+IMI(1)
Wherein IMI (1), IMI (2), IMI (3) and IMI (4) represent that respectively motion sign integral image is at point 1, point 2, point 3 with put the value at 4 places.
The normalization kinergety is:
ME ( D ) ( right - left ) * ( bottom - top )
For the situation of cam movement, adopt the mode of FN frame difference to obtain movable information, FN can equal 2, also can be greater than 2, obtain movement edge pixel sign mask, be the candidate region setting threshold, only motion is carried out Automobile Detection greater than candidate region to a certain degree.Further, determine whether variation has taken place in the rectangle frame, only adopt apart from outer rectangular frame edge longitudinal distance smaller or equal to DH, lateral separation is added up normalization smaller or equal to the pixel of DW and is changed number of pixels, and and threshold ratio determine whether rectangle frame variation has taken place, whether need to adopt the separation vehicle device whether to judge automobile.In embodiments of the present invention, being used for adding up the pixel that whether moves is apart from the pixel of rectangular edges less than threshold value, as shown in Figure 7, employing apart from edge longitudinal less than DH, laterally less than the area part between two rectangle frames of DW as judging the zone that whether moves, this zone is called the border movement zone.
In conjunction with the level type Adaboost separation vehicle device of kinergety as shown in Figure 8, whether the kinergety of judging candidate frame, is then thought not to be automobile if be not more than greater than certain threshold value earlier, directly refuses; If greater than, then adopt the level type Adaboost separation vehicle device that trains to judge based on feature a little less than the HOG.
Further, the embodiment of the invention also provides a kind of automobile tracking based on background subtraction, the automobile tracking then is position, the CF information according to each automobile in the image of different frame, determine the corresponding relation of each automobile, determine that promptly which or which automobile is the automobile of same automobile in the image of different frame in the image, as shown in Figure 9, specifically comprise:
S901, initialization background image.
The method of initialization background image can simply select a pair not have the image of prospect, also can adopt the background image initial method of more complicated.
S902, input picture is compared with background image (being reference picture), obtain the moving region of input picture.
Comparison herein, can adopt the mode that compares with the threshold value that sets in advance after input picture and the background image work difference, also can adopt mixed Gauss model (GMM, Gaussian Mixture Model) and Density Estimator (KDE, Kernel Density Estimation) etc. complicated model relatively obtains the moving region.Consider the processing speed of system, a kind of mode is better before adopting.
The integral image of S903, calculating moving region, and, adopt integral image to obtain the number of pixels that its inside changes to each candidate frame.
S904, the number of pixels that changes and the threshold value that sets in advance are compared, judge that when remarkable motion has taken place, employing is decided the zone based on the quick Automobile Detection device of level type Adaboost algorithm to described fortune and detected, and obtains candidate's automobile frame.
S905, the candidate's automobile frame that obtains is added in candidate's automobile formation of current input image.
S906, the candidate's automobile position that overlaps mutually in the formation of described candidate's automobile is merged processing.
The mode that S907, employing are mated based on histogram, the maximum match degree of the reference automobile frame in each candidate's automobile frame in candidate's automobile formation of calculating current input image and the tracking queue that sets in advance.
Employing is based on the mode of histogram coupling, and calculating comprises with reference to the concrete steps of the maximum match degree of automobile frame and candidate's automobile frame:
Calculating is with reference to the histogram matching degree and the dimension location matching degree of automobile frame and candidate's automobile frame;
Described histogram matching degree be multiply by described dimension location matching degree as described maximum match degree with reference to automobile frame and described candidate's automobile frame.
S908, judge that whether the maximum match degree of candidate's automobile frame is greater than threshold value TP, if, think that then the match is successful, determine candidate's automobile frame and be same automobile frame, and adopt corresponding positional information in the updating location information tracking queue of candidate's automobile frame that the match is successful in the automobile formation with reference to the automobile frame with reference to the automobile frame; Otherwise, add candidate's automobile frame positional information that it fails to match to tracking queue, as new reference items; If tracking queue is empty, promptly do not have in the tracking queue then directly the candidate's automobile frame that merges after handling to be added in the tracking queue with reference to the automobile frame.
S909, according to the reference automobile position in the tracking queue after the described renewal, determine the automobile position on the described input picture.
Further, the present embodiment method also comprises: the occurrence number of the reference automobile frame in the record tracking queue, be assumed to n, and preestablish threshold value TN, if n 3TN thinks that then this is the real car frame with reference to the automobile frame, otherwise thinks candidate's automobile frame.And, write down each with reference to the automobile frame do not have tracked to frame number be nm, for the real car frame, if satisfy nm 3TMN thinks that this real car disappears in the image acquisition scope, then delete the positional information of this real car frame from tracking queue, and wherein, TMN is a pre-set threshold; For candidate's automobile frame, if satisfy nm 3TMPN thinks that then this candidate's automobile disappears, the positional information of this candidate's automobile frame of deletion from tracking queue, and wherein, TMPN is a pre-set threshold.The final real car frame that only will occur carries out keeping records as effective automobile frame, is used for analyzing and inquiry.
Preferably, the present embodiment method also comprises: distribute a unique numbering (ID) for the real car in the tracking queue, the numbering of each emerging real car correspondence increases progressively, and is final, the number of master serial number is the number of the real car of appearance, thereby realizes the counting to automobile.
Further, when mating among the step S907, adopt candidate's automobile frame and assist histogram to mate with reference to the positional information and the size information of automobile frame in video; Suppose that these two automobile frames are respectively R 1(cx1, cy1, w1, h1) and R 2(cx2, cy2, w2, h2), and cx1 wherein, cx2 is respectively the center horizontal ordinate of two rectangle automobile frames, and cy1, cy2 are respectively the central longitudinal coordinate of two automobile frames, and w1, w2 are respectively the width of two automobile frames, and h1, h2 are respectively the height of two automobile frames; The centre distance of two automobile frames is dis=sqrt ((cx1-cx2) * (cx1-cx2)+(cy1-cy2) * (cy1-cy2)), and the dimension location matching degree that then defines two automobile frames is exp ( - dis 2 ( w 1 + w 2 ) 2 * DR ) * exp ( - ( min ( w 1 , w 2 ) max ( w 1 , w 2 ) - 1 ) 2 * SR ) , Sqrt is an extracting operation, and min is for going little value computing, and max is for getting big value computing, and DR and SR are constant.In the embodiment of the invention, the matching degree of two automobile frames multiply by the dimension location matching degree of rectangle automobile frame for the histogram matching degree.
Further, the histogram coupling can adopt the mode of weighted histogram, promptly to setting different weights on the automobile frame during zones of different statistic histogram, such as, the distance of setting weights and each pixel distance automobile frame center is inversely proportional to, and distance center is near more, and weights are big more, distance center is far away more, and weights are more little; The histogram that finally obtains is to the histogram after each pixel weighting.
Preferably, after step S905 finishes Automobile Detection, candidate's automobile frame is not merged the post-processing operation that overlaps mutually rectangle frame, but all candidate's automobile frames is carried out following processing:
Step 1: the number of plies and every layer of weights and this layer threshold value that strong classifier is tried to achieve of the Automobile Detection device that passes through according to candidate's automobile frame, for each candidate's automobile frame is determined a degree of confidence.
Step 2:, then current candidate's automobile frame is merged the post-processing operation that overlaps mutually rectangle frame, and the position of all the candidate's automobile frames after the aftertreatment is added in the tracking queue if tracking queue is empty.
Step 3: if tracking queue is not empty, then in the tracking queue each with reference to the automobile frame, for example with reference to automobile frame A, all candidate's automobile frames that it is corresponding with current input image mate, all matching degrees are all preserved greater than candidate's automobile frame of certain threshold value, as aftertreatment automobile frame, and carry out aftertreatment, last handling process herein is:
All aftertreatment automobile frames are classified according to the position, and the aftertreatment automobile frame that same position is overlapped on together is divided into a class, then, and to the matching degree addition of each aftertreatment automobile frame of belonging to a class total matching degree as such; The class of getting total matching degree maximum is as final matching result, and according to the degree of confidence of such each aftertreatment automobile frame, the weighted sum of position coordinates of trying to achieve each aftertreatment automobile frame is as the position coordinates of coupling automobile frame (A is complementary with reference automobile frame), and upgrades in the tracking queue accordingly position coordinates with reference to automobile frame A with position coordinates of this coupling automobile frame.And, all candidate's automobile frames that position in candidate's automobile formation of current input image correspondence and described coupling automobile frame takes place to overlap are deleted from the formation of described candidate's automobile.
Then, carry out same treatment to next in the tracking queue with reference to the automobile frame, reference automobile frames all in tracking queue all dispose, the candidate's automobile frame that exists in candidate's automobile formation to current input image merges the aftertreatment of overlapping frame again, and all the candidate's automobile frames after this aftertreatment are added in the tracking queue.
In addition, can also adopt the moving region that obtains input picture based on the mode of frame difference, and automobile is followed the tracks of.The method of obtaining the moving region is as follows:
The first step adds context queue with preceding N two field picture as initialization background (reference picture).
Second goes on foot, and input picture is compared with the N frame background image in the context queue obtains the moving region.
Particularly, can adopt input picture and every frame background image poor, and with threshold ratio, the most at last N comparative result respective pixel ask or mode obtain the moving region; And, add the present frame input picture to context queue, with context queue two field picture deletion the earliest.Wherein, N can be 1, also can be greater than 1.
In addition, can also adopt after the background image weighted sum in the context queue, the mode with the current input image comparison obtains the moving region again.
The 3rd step, ask the integral image of moving region, and to each candidate rectangle position, adopt integral image to obtain the number of pixels that its inside changes, and with threshold ratio, see whether it remarkable motion has taken place, if, then adopt Automobile Detection device based on level type Adaboost algorithm, judge whether the candidate rectangle frame is candidate's automobile frame, if then this candidate's automobile frame is added in the automobile formation of present frame input picture.
Introduce the device that the embodiment of the invention provides below.
A kind of image detection device that the embodiment of the invention provides comprises:
The unit is set, is used for obtaining weak feature database, and utilize this weak feature database setting to strengthen the quick separation vehicle device of sorter and edge orientation histogram based on level type self-adaptation by the edge of image direction histogram.
The edge orientation histogram unit is used for edge direction and edge strength by input picture, calculates the edge orientation histogram of described input picture.
Detecting unit is used to adopt described quick separation vehicle device, according to the edge orientation histogram of described input picture, determines the automobile position in the described input picture.
A kind of image tracking means that the embodiment of the invention provides comprises:
The unit is set, is used for obtaining weak feature database, and utilize this weak feature database setting to strengthen the quick separation vehicle device of sorter and edge orientation histogram based on level type self-adaptation by the edge of image direction histogram.
Determine the unit, moving region, be used for input picture is compared with reference picture, obtain the moving region of described input picture.
Identifying unit is used for by described quick separation vehicle device described moving region being judged, obtains the automobile position in the described input picture.
In sum, the Automobile Detection that the embodiment of the invention is realized by level type AdaBoost sorter and HOG feature are combined and the technical scheme of tracking, can determine automobile position quickly and accurately, has very important application value, for example, can be applied in intelligent video monitoring, intelligent transportation, video analysis and fields such as retrieval and picture retrieval.
Obviously, those skilled in the art can carry out various changes and modification to the present invention and not break away from the spirit and scope of the present invention.Like this, if of the present invention these are revised and modification belongs within the scope of claim of the present invention and equivalent technologies thereof, then the present invention also is intended to comprise these changes and modification interior.

Claims (20)

1. an image detecting method is characterized in that, this method comprises:
Obtain weak feature database by the edge orientation histogram of setting in the rectangular area in the image in advance, and utilize this weak feature database setting to strengthen the quick separation vehicle device of sorter and edge orientation histogram based on level type self-adaptation;
By the edge direction and the edge strength of input picture, calculate the edge orientation histogram of setting on the described input picture in the rectangular area;
Adopt described quick separation vehicle device, the above sets the edge orientation histogram in the rectangular area according to described input picture, determines the automobile position in the described input picture.
2. method according to claim 1 is characterized in that, by the edge direction and the edge strength of input picture, the step of calculating the edge orientation histogram in the above setting rectangular area of described input picture comprises:
Edge direction to input picture is carried out discretize, determines each edge direction after the discretize of described input picture;
By described input picture the above set each edge direction of all pixels after described discretize in rectangular area edge strength and, calculate the edge orientation histogram of setting described in the described input picture in the rectangular area.
3. method according to claim 2 is characterized in that, determines that the step of the edge direction after the discretize of pixel of described input picture comprises:
Turn to some intervals with the edge direction of described input picture is discrete in advance;
When the horizontal edge of the pixel of described input picture is 0, determine that the edge direction after the discretize of this pixel is 0;
Cotangent function by the angle that the ratio of the vertical edge of the pixel of described input picture and horizontal edge is corresponding with described some intervals compares, and determines the edge direction after the discretize of pixel of described input picture.
4. method according to claim 2 is characterized in that, by the edge direction integral image calculate each edge direction of all pixels after described discretize in the described setting rectangular area on the described input picture edge strength and.
5. method according to claim 1 is characterized in that, when described input picture is coloured image, according to the norm of the difference of the color vector of per two the pixel correspondences on the described input picture, calculates the edge of this colour input picture.
6. method according to claim 1 is characterized in that, further according to the movable information of the automobile in the described input picture, determines the position of the automobile on the described input picture.
7. method according to claim 6 is characterized in that, according to the movable information of the automobile in the described input picture, determines that the step of the position of the automobile on the described input picture comprises:
Input picture and the background image that sets in advance are compared, determine the moving region in the described input picture;
Calculate kinergety in the described moving region by the number of pixels that changes in the described moving region;
When the kinergety in the described moving region during, detect the automobile position in this moving region greater than certain threshold value.
8. method according to claim 6 is characterized in that, according to the movable information of the automobile in the described input picture, determines that the step of the position of the automobile on the described input picture comprises:
By comparison, determine the moving region in the described current input image with the prior image frame of current input image and this current input picture;
Calculate kinergety in the described moving region by the number of pixels that changes in the described moving region;
When the kinergety in the described moving region during, detect the automobile position in this moving region greater than certain threshold value.
9. according to claim 7 or 8 described methods, it is characterized in that, calculate kinergety in the described moving region by integral image.
10. according to claim 7 or 8 described methods, it is characterized in that the kinergety in the described moving region is the ratio of the area of the number of pixels that changes in the described moving region and described moving region.
11., it is characterized in that the kinergety in the described moving region is that the number by the pixel that changes in the described moving region frame certain limit of adjusting the distance calculates according to claim 7 or 8 described methods.
12. an image tracking method is characterized in that, this method comprises:
Obtain weak feature database by the edge orientation histogram of setting in the rectangular area in the image in advance, and utilize this weak feature database setting to strengthen the quick separation vehicle device of sorter and edge orientation histogram based on level type self-adaptation;
Input picture is compared with reference picture, obtain the moving region of described input picture;
By described quick separation vehicle device described moving region is judged, obtained the automobile position in the described input picture.
13. method according to claim 12 is characterized in that, by described quick separation vehicle device the position, candidate region in the described moving region is judged that the step that obtains the automobile position in the described input picture comprises:
By described quick separation vehicle device described moving region is judged, obtained candidate's automobile frame of described input picture, and, this candidate's automobile frame is added in candidate's automobile formation of current input image;
Candidate's automobile frame in the formation of described candidate's automobile and reference automobile frame in the tracking queue that sets in advance are mated, and, described tracking queue upgraded according to described matching result;
According to the reference automobile frame position in the tracking queue after the described renewal, determine the automobile position on the described input picture.
14. method according to claim 13, it is characterized in that, candidate's automobile frame in the formation of described candidate's automobile and reference automobile frame in the tracking queue that sets in advance are mated, and the step of upgrading described tracking queue according to described matching result comprises:
The matching degree of the reference automobile frame in the tracking queue that calculates the candidate's automobile frame in the formation of described candidate's automobile and set in advance;
In described tracking queue, select the coupling group for each with reference to the automobile frame, this coupling group is to belong to one group of candidate's automobile frame with reference to the matching degree sum maximum of automobile frame;
In described tracking queue, each is merged into this coupling automobile frame with reference to the automobile frame with reference to the candidate's automobile frame in the coupling group of automobile frame, and utilize this coupling automobile frame to upgrade corresponding in the described tracking queue with reference to the automobile frame.
15. method according to claim 13 is characterized in that, this method also comprises step: the candidate's automobile frame that overlaps mutually in the formation of described candidate's automobile is merged processing.
16. method according to claim 15, it is characterized in that, candidate's automobile frame in the formation of described candidate's automobile and reference automobile frame in the tracking queue that sets in advance are mated, and the step of upgrading described tracking queue according to described matching result comprises:
The matching degree of the reference automobile frame in the tracking queue that calculates the candidate's automobile frame in the formation of described candidate's automobile and set in advance;
Whether the matching degree of judging the candidate's automobile frame in the formation of described candidate's automobile is greater than pre-set threshold, if then utilize this candidate's automobile frame to upgrade in the described tracking queue accordingly with reference to the automobile frame; Otherwise, this candidate's automobile frame is added in the described tracking queue.
17. method according to claim 13, it is characterized in that, when not comprising in the described tracking queue with reference to the automobile frame, the candidate's automobile frame that overlaps mutually in the formation of described candidate's automobile is merged processing, and all the candidate's automobile frames after merge handling are added in the described tracking queue, as the reference automobile frame in the described tracking queue.
18. method according to claim 13 is characterized in that, this method also comprises:
Add up the quantity of the real car of the appearance in the described tracking queue, realize the automobile counting.
19. an image detection device is characterized in that, this device comprises:
The unit is set, is used for obtaining weak feature database, and utilize this weak feature database setting to strengthen the quick separation vehicle device of sorter and edge orientation histogram based on level type self-adaptation by the edge orientation histogram that image is set in the rectangular area;
The edge orientation histogram unit is used for edge direction and edge strength by input picture, calculates the edge orientation histogram of setting on the described input picture in the rectangular area;
Detecting unit is used to adopt described quick separation vehicle device, and the above sets the edge orientation histogram in the rectangular area according to described input picture, determines the automobile position in the described input picture.
20. an image tracking means is characterized in that, this device comprises:
The unit is set, is used for obtaining weak feature database, and utilize this weak feature database setting to strengthen the quick separation vehicle device of sorter and edge orientation histogram based on level type self-adaptation by the edge orientation histogram that image is set in the rectangular area;
Determine the unit, moving region, be used for input picture is compared with reference picture, obtain the moving region of described input picture;
Identifying unit is used for by described quick separation vehicle device described moving region being judged, obtains the automobile position in the described input picture.
CN200710308416A 2007-12-29 2007-12-29 Image detection method and device Active CN100578527C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN200710308416A CN100578527C (en) 2007-12-29 2007-12-29 Image detection method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN200710308416A CN100578527C (en) 2007-12-29 2007-12-29 Image detection method and device

Publications (2)

Publication Number Publication Date
CN101196996A true CN101196996A (en) 2008-06-11
CN100578527C CN100578527C (en) 2010-01-06

Family

ID=39547388

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200710308416A Active CN100578527C (en) 2007-12-29 2007-12-29 Image detection method and device

Country Status (1)

Country Link
CN (1) CN100578527C (en)

Cited By (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101599175A (en) * 2009-06-11 2009-12-09 北京中星微电子有限公司 Determine the detection method and the image processing equipment of alteration of shooting background
CN102005044A (en) * 2010-11-10 2011-04-06 新太科技股份有限公司 Method for detecting single-frequency interference based on edge direction histogram principle
CN102147867A (en) * 2011-05-20 2011-08-10 北京联合大学 Method for identifying traditional Chinese painting images and calligraphy images based on subject
CN101320520B (en) * 2008-07-21 2012-07-04 北京中星微电子有限公司 Vehicle detection method and equipment thereof
CN102663357A (en) * 2012-03-28 2012-09-12 北京工业大学 Color characteristic-based detection algorithm for stall at parking lot
CN102768804A (en) * 2012-07-30 2012-11-07 江苏物联网研究发展中心 Video-based traffic information acquisition method
CN102855500A (en) * 2011-06-27 2013-01-02 东南大学 Haar and HoG characteristic based preceding car detection method
CN102867411A (en) * 2012-09-21 2013-01-09 博康智能网络科技股份有限公司 Taxi dispatching method and taxi dispatching system on basis of video monitoring system
CN102902983A (en) * 2012-09-21 2013-01-30 博康智能网络科技股份有限公司 Taxi recognition method based on support vector machine
CN103034843A (en) * 2012-12-07 2013-04-10 电子科技大学 Method for detecting vehicle at night based on monocular vision
CN103106400A (en) * 2013-02-06 2013-05-15 浙江宇视科技有限公司 Face detecting method and device
CN103150547A (en) * 2013-01-21 2013-06-12 信帧电子技术(北京)有限公司 Vehicle tracking method and device
CN103198705A (en) * 2013-03-21 2013-07-10 电子科技大学 Parking place state automatic detection method
CN103903434A (en) * 2012-12-28 2014-07-02 重庆凯泽科技有限公司 Intelligent traffic system based on image processing
CN103971117A (en) * 2013-01-25 2014-08-06 北京明日时尚信息技术有限公司 Detection method of digital cameras in static pictures
CN103971118A (en) * 2013-01-25 2014-08-06 北京明日时尚信息技术有限公司 Detection method of wine bottles in static pictures
CN103970262A (en) * 2013-02-06 2014-08-06 原相科技股份有限公司 Optical pointing system
CN104021679A (en) * 2014-05-30 2014-09-03 宁波海视智能系统有限公司 Traffic flow statistic method based on video
CN104090658A (en) * 2014-07-04 2014-10-08 四川长虹电器股份有限公司 Human body image detection method based on HOG features
CN104168451A (en) * 2014-07-25 2014-11-26 重庆科技学院 Fighting detection method in intelligent video monitoring
CN104268589A (en) * 2014-09-16 2015-01-07 奇瑞汽车股份有限公司 Front vehicle detection method
CN104282157A (en) * 2014-10-16 2015-01-14 银江股份有限公司 Main line video traffic detecting method for traffic signal control
CN105930803A (en) * 2016-04-22 2016-09-07 北京智芯原动科技有限公司 Preceding vehicle detection method based on Edge Boxes and preceding vehicle detection device thereof
CN106056575A (en) * 2016-05-05 2016-10-26 南京大学 Image matching method based on object similarity recommended algorithm
CN106203383A (en) * 2016-07-21 2016-12-07 成都之达科技有限公司 Vehicle safety method for early warning based on image
US9766717B2 (en) 2013-01-29 2017-09-19 Pixart Imaging Inc. Optical pointing system
CN107346537A (en) * 2016-05-05 2017-11-14 福耀集团(上海)汽车玻璃有限公司 glass intelligent counting method, device and mobile phone
CN108564814A (en) * 2018-06-06 2018-09-21 清华大学苏州汽车研究院(吴江) A kind of parking position detection method and device based on image
CN108875482A (en) * 2017-09-14 2018-11-23 北京旷视科技有限公司 Object detecting method and device, neural network training method and device
CN109101889A (en) * 2018-07-12 2018-12-28 苏海英 Finger scan mechanism based on dust analysis
CN109614898A (en) * 2018-11-29 2019-04-12 通号通信信息集团有限公司 It is a kind of for This train is bound for XXX detection intelligent determination method
CN110610118A (en) * 2018-06-15 2019-12-24 杭州海康威视数字技术股份有限公司 Traffic parameter acquisition method and device
CN113661523A (en) * 2019-04-08 2021-11-16 沃尔沃卡车集团 System for analyzing data in a vehicle

Cited By (54)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101320520B (en) * 2008-07-21 2012-07-04 北京中星微电子有限公司 Vehicle detection method and equipment thereof
CN101599175A (en) * 2009-06-11 2009-12-09 北京中星微电子有限公司 Determine the detection method and the image processing equipment of alteration of shooting background
CN101599175B (en) * 2009-06-11 2014-04-23 北京中星微电子有限公司 Detection method for determining alteration of shooting background and image processing device
CN102005044A (en) * 2010-11-10 2011-04-06 新太科技股份有限公司 Method for detecting single-frequency interference based on edge direction histogram principle
CN102147867A (en) * 2011-05-20 2011-08-10 北京联合大学 Method for identifying traditional Chinese painting images and calligraphy images based on subject
CN102147867B (en) * 2011-05-20 2012-12-12 北京联合大学 Method for identifying traditional Chinese painting images and calligraphy images based on subject
CN102855500A (en) * 2011-06-27 2013-01-02 东南大学 Haar and HoG characteristic based preceding car detection method
CN102663357A (en) * 2012-03-28 2012-09-12 北京工业大学 Color characteristic-based detection algorithm for stall at parking lot
CN102768804A (en) * 2012-07-30 2012-11-07 江苏物联网研究发展中心 Video-based traffic information acquisition method
CN102768804B (en) * 2012-07-30 2014-03-26 江苏物联网研究发展中心 Video-based traffic information acquisition method
CN102867411A (en) * 2012-09-21 2013-01-09 博康智能网络科技股份有限公司 Taxi dispatching method and taxi dispatching system on basis of video monitoring system
CN102902983A (en) * 2012-09-21 2013-01-30 博康智能网络科技股份有限公司 Taxi recognition method based on support vector machine
CN102902983B (en) * 2012-09-21 2016-01-20 博康智能网络科技股份有限公司 A kind of taxi identification method based on support vector machine
CN102867411B (en) * 2012-09-21 2014-07-09 博康智能网络科技股份有限公司 Taxi dispatching method and taxi dispatching system on basis of video monitoring system
CN103034843B (en) * 2012-12-07 2015-06-17 电子科技大学 Method for detecting vehicle at night based on monocular vision
CN103034843A (en) * 2012-12-07 2013-04-10 电子科技大学 Method for detecting vehicle at night based on monocular vision
CN103903434B (en) * 2012-12-28 2015-11-04 重庆凯泽科技有限公司 Based on the intelligent transportation system of image procossing
CN103903434A (en) * 2012-12-28 2014-07-02 重庆凯泽科技有限公司 Intelligent traffic system based on image processing
CN103150547A (en) * 2013-01-21 2013-06-12 信帧电子技术(北京)有限公司 Vehicle tracking method and device
CN103971118A (en) * 2013-01-25 2014-08-06 北京明日时尚信息技术有限公司 Detection method of wine bottles in static pictures
CN103971117A (en) * 2013-01-25 2014-08-06 北京明日时尚信息技术有限公司 Detection method of digital cameras in static pictures
US9958961B2 (en) 2013-01-29 2018-05-01 Pixart Imaging Inc. Optical pointing system
US9766717B2 (en) 2013-01-29 2017-09-19 Pixart Imaging Inc. Optical pointing system
US10228772B2 (en) 2013-01-29 2019-03-12 Pixart Imaging Inc. Remote controller
CN107992198A (en) * 2013-02-06 2018-05-04 原相科技股份有限公司 Optical profile type pointing system
CN103106400A (en) * 2013-02-06 2013-05-15 浙江宇视科技有限公司 Face detecting method and device
CN103106400B (en) * 2013-02-06 2016-03-23 浙江宇视科技有限公司 A kind of method for detecting human face and device
CN103970262A (en) * 2013-02-06 2014-08-06 原相科技股份有限公司 Optical pointing system
CN103970262B (en) * 2013-02-06 2018-01-16 原相科技股份有限公司 Optical profile type pointing system
CN107992198B (en) * 2013-02-06 2021-01-05 原相科技股份有限公司 Optical pointing system
CN103198705B (en) * 2013-03-21 2015-05-27 电子科技大学 Parking place state automatic detection method
CN103198705A (en) * 2013-03-21 2013-07-10 电子科技大学 Parking place state automatic detection method
CN104021679A (en) * 2014-05-30 2014-09-03 宁波海视智能系统有限公司 Traffic flow statistic method based on video
CN104090658A (en) * 2014-07-04 2014-10-08 四川长虹电器股份有限公司 Human body image detection method based on HOG features
CN104168451A (en) * 2014-07-25 2014-11-26 重庆科技学院 Fighting detection method in intelligent video monitoring
CN104168451B (en) * 2014-07-25 2018-07-31 重庆科技学院 Detection method of fighting in intelligent video monitoring
CN104268589B (en) * 2014-09-16 2017-09-12 奇瑞汽车股份有限公司 A kind of front vehicles detection method
CN104268589A (en) * 2014-09-16 2015-01-07 奇瑞汽车股份有限公司 Front vehicle detection method
CN104282157A (en) * 2014-10-16 2015-01-14 银江股份有限公司 Main line video traffic detecting method for traffic signal control
CN105930803A (en) * 2016-04-22 2016-09-07 北京智芯原动科技有限公司 Preceding vehicle detection method based on Edge Boxes and preceding vehicle detection device thereof
CN106056575A (en) * 2016-05-05 2016-10-26 南京大学 Image matching method based on object similarity recommended algorithm
CN107346537A (en) * 2016-05-05 2017-11-14 福耀集团(上海)汽车玻璃有限公司 glass intelligent counting method, device and mobile phone
CN106056575B (en) * 2016-05-05 2019-03-29 南京大学 A kind of image matching method based on like physical property proposed algorithm
CN106203383B (en) * 2016-07-21 2019-06-11 成都之达科技有限公司 Vehicle safety method for early warning based on image
CN106203383A (en) * 2016-07-21 2016-12-07 成都之达科技有限公司 Vehicle safety method for early warning based on image
CN108875482A (en) * 2017-09-14 2018-11-23 北京旷视科技有限公司 Object detecting method and device, neural network training method and device
CN108875482B (en) * 2017-09-14 2022-01-21 北京旷视科技有限公司 Object detection method and device and neural network training method and device
CN108564814A (en) * 2018-06-06 2018-09-21 清华大学苏州汽车研究院(吴江) A kind of parking position detection method and device based on image
CN108564814B (en) * 2018-06-06 2020-11-17 清华大学苏州汽车研究院(吴江) Image-based parking lot parking space detection method and device
CN110610118A (en) * 2018-06-15 2019-12-24 杭州海康威视数字技术股份有限公司 Traffic parameter acquisition method and device
CN109101889A (en) * 2018-07-12 2018-12-28 苏海英 Finger scan mechanism based on dust analysis
CN109614898A (en) * 2018-11-29 2019-04-12 通号通信信息集团有限公司 It is a kind of for This train is bound for XXX detection intelligent determination method
CN109614898B (en) * 2018-11-29 2023-08-08 通号通信信息集团有限公司 Intelligent judging method for train running direction detection
CN113661523A (en) * 2019-04-08 2021-11-16 沃尔沃卡车集团 System for analyzing data in a vehicle

Also Published As

Publication number Publication date
CN100578527C (en) 2010-01-06

Similar Documents

Publication Publication Date Title
CN100578527C (en) Image detection method and device
CN102609686B (en) Pedestrian detection method
Sivaraman et al. Vehicle detection by independent parts for urban driver assistance
Niknejad et al. On-road multivehicle tracking using deformable object model and particle filter with improved likelihood estimation
Bahlmann et al. A system for traffic sign detection, tracking, and recognition using color, shape, and motion information
Fernandez-Sanjurjo et al. Real-time visual detection and tracking system for traffic monitoring
Zhou et al. DAVE: A unified framework for fast vehicle detection and annotation
Fukui et al. Pedestrian detection based on deep convolutional neural network with ensemble inference network
CN104063712B (en) A kind of information of vehicles extracting method and system
Han et al. Small-scale pedestrian detection based on deep neural network
Bugeau et al. Detection and segmentation of moving objects in complex scenes
CN110119726B (en) Vehicle brand multi-angle identification method based on YOLOv3 model
Negri et al. An oriented-contour point based voting algorithm for vehicle type classification
KR20120032897A (en) Method and system for detecting object in input image
CN106778633B (en) Pedestrian identification method based on region segmentation
CN101211411A (en) Human body detection process and device
CN111915583B (en) Vehicle and pedestrian detection method based on vehicle-mounted thermal infrared imager in complex scene
CN110852269A (en) Cross-lens portrait correlation analysis method and device based on feature clustering
CN109284705A (en) A kind of method for detecting abnormality of Traffic Surveillance Video
Wang et al. Simultaneous detection and tracking using deep learning and integrated channel feature for ambint traffic light recognition
CN103761747A (en) Target tracking method based on weighted distribution field
CN114049572A (en) Detection method for identifying small target
Gad et al. Real-time lane instance segmentation using segnet and image processing
Dalka et al. Vehicle classification based on soft computing algorithms
Alefs Embedded vehicle detection by boosting

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
ASS Succession or assignment of patent right

Owner name: SHANXI ZHONGTIANXIN TECHNOLOGY CO., LTD.

Free format text: FORMER OWNER: BEIJING VIMICRO ELECTRONICS CO., LTD.

Effective date: 20121211

C41 Transfer of patent application or patent right or utility model
COR Change of bibliographic data

Free format text: CORRECT: ADDRESS; FROM: 100083 HAIDIAN, BEIJING TO: 030032 TAIYUAN, SHAANXI PROVINCE

TR01 Transfer of patent right

Effective date of registration: 20121211

Address after: 105, room 3, building 6, Kaiyuan street, Taiyuan economic and Technological Development Zone, Shanxi 030032, China

Patentee after: SHANXI VIMICRO TECHNOLOGY CO., LTD.

Address before: 100083, Haidian District, Xueyuan Road, Beijing No. 35, Nanjing Ning building, 15 Floor

Patentee before: Beijing Vimicro Corporation