CN106203385A - A kind of driver's hand-held phone behavioral value method and device - Google Patents

A kind of driver's hand-held phone behavioral value method and device Download PDF

Info

Publication number
CN106203385A
CN106203385A CN201610578623.6A CN201610578623A CN106203385A CN 106203385 A CN106203385 A CN 106203385A CN 201610578623 A CN201610578623 A CN 201610578623A CN 106203385 A CN106203385 A CN 106203385A
Authority
CN
China
Prior art keywords
driver
hand
windscreen
image
area image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610578623.6A
Other languages
Chinese (zh)
Other versions
CN106203385B (en
Inventor
田波
许健
路洪运
万定锐
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Netposa Technologies Ltd
Original Assignee
Netposa Technologies Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Netposa Technologies Ltd filed Critical Netposa Technologies Ltd
Priority to CN201610578623.6A priority Critical patent/CN106203385B/en
Publication of CN106203385A publication Critical patent/CN106203385A/en
Application granted granted Critical
Publication of CN106203385B publication Critical patent/CN106203385B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/59Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/107Static hand or arm
    • G06V40/11Hand-related biometrics; Hand pose recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Multimedia (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)

Abstract

The invention provides a kind of driver's hand-held phone behavioral value method and device, the method includes: gather driver place to be detected vehicle image;The circumscribed rectangular region image of vehicle is obtained from the vehicle image gathered;From above-mentioned circumscribed rectangular region image, position the driver area of described driver to be detected, obtain driver area image;Behavior of raising one's hand disaggregated model according to driver area image, raise one's hand behavioral value model and the training in advance of training in advance carries out hand-held phone behavioral value to driver to be detected.In the present invention, judge whether driver to be detected has hand-held phone behavior by the driver area of driver to be detected, do not rely on the face location detecting driver to be detected, can detect whether driver has hand-held phone behavior accurately, avoid owing to by illumination, resolution is affected cannot detect face location, and then cannot detect whether driver has the situation of hand-held phone behavior.

Description

A kind of driver's hand-held phone behavioral value method and device
Technical field
The present invention relates to image procossing and intelligent traffic monitoring technical field, hand-held in particular to a kind of driver Phone behavioral value method and device.
Background technology
Driver, in driving procedure, needs both hands to hold steering wheel, and focuses on observing road conditions and surrounding ring Border, if driver has hand-held phone behavior in driving procedure, at this moment driver will hold steering wheel by one hand, and this can be to driving Member's driving vehicle forms bigger obstacle;Further, driver takes phone when driving vehicle and easily takes sb's mind off sth, and hinders and drives Member to road conditions and the observation of surrounding, reduces the perception to peripheral vision, the traffic safety of harm driver, therefore, Hand-held phone behavior during driver drives vehicle is detected and alarm is just particularly important.
Driver's hand-held phone behavioral value method in correlation technique, be mostly set up Face datection on the basis of, i.e. The face location of detection driver, determines the hand-held phone position in left and right face according to the face location of driver, passes through Whether the method detection driver of feature detection has hand-held phone behavior.
But the method in correlation technique, owing to being affected by illumination, resolution, may be from the driver gathered Image in the face of driver detected, thus cause detecting whether driver has hand-held phone behavior.
Summary of the invention
In view of this, the purpose of the embodiment of the present invention is to provide a kind of driver's hand-held phone behavioral value method and dress Put, during to solve the face location depending on driver in prior art to detect driver and whether have hand-held phone behavior, when When being affected by illumination, resolution, the face location of driver may be detected from the image of the driver gathered, Thus cause the problem whether driver has hand-held phone behavior being detected.
First aspect, embodiments provides a kind of driver's hand-held phone behavioral value method, wherein, described side Method includes:
Gather driver place to be detected vehicle image;
The circumscribed rectangular region image of vehicle is obtained from the vehicle image gathered;
From described circumscribed rectangular region image, position the driver area of described driver to be detected, obtain driver area figure Picture;
The behavior of raising one's hand according to described driver area image, raise one's hand behavioral value model and the training in advance of training in advance divides Class model carries out hand-held phone behavioral value to described driver to be detected.
In conjunction with first aspect, embodiments provide the first possible implementation of above-mentioned first aspect, its In, the described driver area positioning described driver to be detected from described circumscribed rectangular region image, obtain driver area figure Picture, including:
According to described circumscribed rectangular region image, the windscreen of described vehicle is carried out coarse positioning, obtains the car of coarse positioning Front window area image;
From the windscreen area image of described coarse positioning, position the lower edges of described windscreen, obtain determining up and down The windscreen area image at edge;
From the described windscreen area image determining lower edges, position the left and right edges of described windscreen, obtain car Front window area image;
Described windscreen area image is divided into left area and right half area, described right half area is defined as described The driver area of driver to be detected, obtains described driver area image.
In conjunction with the first possible implementation of first aspect, embodiments provide the of above-mentioned first aspect Two kinds of possible implementations, wherein, described from the windscreen area image of described coarse positioning, position the upper of described windscreen Lower limb, including:
Obtain the binary picture of the edge strength of the windscreen area image of described coarse positioning;
The binary picture of described edge strength is carried out floor projection, obtains Horizontal edge projection figure;
Subpoint in described Horizontal edge projection figure is ranked up according to skirt response intensity;
From the subpoint after sequence, according to skirt response intensity from choosing two subpoints successively to weak order by force, Distance between said two subpoint is compared with predeterminable range scope, two of described predeterminable range scope will be met The edge that subpoint is corresponding is defined as the lower edges of described windscreen.
In conjunction with the first possible implementation of first aspect, embodiments provide the of above-mentioned first aspect Three kinds of possible implementations, wherein, described from the described windscreen area image determining lower edges, position described Herba Plantaginis The left and right edges of window, including:
According to preset ratio, the described windscreen area image determining lower edges is divided into left region image and the right side Portion's area image;
Calculate the gradient direction angle of each pixel in the image of described left region, obtain institute according to described gradient direction angle State the binary image of left region image;
Pixel in described binary image is carried out upright projection, obtains vertical projection diagram;
Determine the projection peak point in described vertical projection diagram, determine described windscreen according to described projection peak point Left hand edge;
The right hand edge of described windscreen is determined according to described right areas image.
In conjunction with the first possible implementation of first aspect, embodiments provide the of above-mentioned first aspect Four kinds of possible implementations, wherein, described according to described circumscribed rectangular region image, the windscreen of described vehicle is carried out slightly Location, obtains the windscreen area image of coarse positioning, including:
The position of the first predeterminable range below the coboundary of described circumscribed rectangular region image is defined as coarse positioning The lower limb of windscreen;
The position of the second predeterminable range above the coboundary of described circumscribed rectangular region image is defined as coarse positioning The top edge of windscreen;
By true for the region between the lower limb of the top edge of the windscreen of described coarse positioning and the windscreen of described coarse positioning It is set to the windscreen region of coarse positioning, obtains the most fixed windscreen area image.
In conjunction with first aspect, embodiments provide the 5th kind of possible implementation of above-mentioned first aspect, its In, the described behavior of raising one's hand according to described driver area image, raise one's hand behavioral value model and the training in advance of training in advance divides Class model carries out hand-held phone behavioral value to described driver to be detected, including:
According to described driver area image and described in behavioral value model of raising one's hand described driver to be detected is raised one's hand Behavioral value;
When behavior is raised one's hand in behavioral value result instruction described driver to be detected existence of raising one's hand, according to described driver area Image and described in behavior disaggregated model of raising one's hand described driver to be detected is carried out hand-held phone behavioral value.
In conjunction with the 5th kind of possible implementation of first aspect, embodiments provide the of above-mentioned first aspect Six kinds of possible implementations, wherein, described according to described driver area image and described in raise one's hand behavioral value model to described Driver to be detected is carried out raising one's hand behavioral value, including:
Described driver area image is normalized, obtains the driver area image of the first pre-set dimension;
The first polymerization of described driver's arm to be detected is extracted from the driver area image of described first pre-set dimension Channel characteristics, described first converging channels feature includes gray feature, gradient magnitude and six gradient direction features;
By described driver's hands to be detected described in behavioral value model and described first converging channels feature calculation of raising one's hand According to described score, the score of arm diverse location, judges whether described driver to be detected raises one's hand behavior.
In conjunction with the 6th kind of possible implementation of first aspect, embodiments provide the of above-mentioned first aspect Seven kinds of possible implementations, wherein, described behavioral value result of raising one's hand of working as indicates described driver to be detected to there is row of raising one's hand For time, according to described driver area image and described in behavior disaggregated model of raising one's hand described driver to be detected is carried out hand-held phone Behavioral value, including:
According to behavioral value result of raising one's hand, the arm position of highest scoring is defined as the position of hand-held phone behavioral value Put;
The second polymerization of the arm position of described driver's highest scoring to be detected is extracted from the image of described driver area Channel characteristics, described second converging channels feature includes gray feature, gradient magnitude and 12 gradient direction features;
Respectively by raise one's hand behavior model and the described second each behavior of raising one's hand of converging channels feature calculation of training in advance According to the score of described each behavior model of raising one's hand, the score of model, judges whether described driver to be detected has hand-held phone row For.
Second aspect, embodiments provides a kind of driver's hand-held phone behavioral value device, wherein, described dress Put and include:
Acquisition module, is used for gathering driver place to be detected vehicle image;
Acquisition module, for obtaining the circumscribed rectangular region image of vehicle from the vehicle image gathered;
Locating module, for positioning the driver area of described driver to be detected from described circumscribed rectangular region image, Obtain driver area image;
Hand-held phone behavioral value module, for according to described driver area image, the behavioral value of raising one's hand of training in advance Behavior of the raising one's hand disaggregated model of model and training in advance carries out hand-held phone behavioral value to described driver to be detected.
In conjunction with second aspect, embodiments provide the first possible implementation of above-mentioned second aspect, its In, described locating module includes:
First positioning unit, for according to described circumscribed rectangular region image, carrying out slightly determining to the windscreen of described vehicle Position, obtains the windscreen area image of coarse positioning;
Second positioning unit, for from the windscreen area image of described coarse positioning, positions the upper and lower of described windscreen Edge, obtains determining the windscreen area image of lower edges;
3rd positioning unit, for from the described windscreen area image determining lower edges, positions described windscreen Left and right edges, obtain windscreen area image;
Determine unit, for described windscreen area image is divided into left area and right half area, by the described right side half Region is defined as the driver area of described driver to be detected, obtains described driver area image.
In conjunction with the first possible implementation of second aspect, embodiments provide the of above-mentioned second aspect Two kinds of possible implementations, wherein, described second positioning unit, for obtaining the windscreen area image of described coarse positioning The binary picture of edge strength;The binary picture of described edge strength is carried out floor projection, obtains Horizontal edge projection figure;Will Subpoint in described Horizontal edge projection figure is ranked up according to skirt response intensity;From the subpoint after sequence, according to Skirt response intensity is from choosing two subpoints successively to weak order by force, by the distance between said two subpoint with default Distance range is compared, and edge corresponding for two subpoints meeting described predeterminable range scope is defined as described windscreen Lower edges.
In conjunction with the first possible implementation of second aspect, embodiments provide the of above-mentioned second aspect Three kinds of possible implementations, wherein, described 3rd positioning unit, for determining lower edges according to preset ratio by described Windscreen area image is divided into left region image and right areas image;Calculate each pixel in the image of described left region The gradient direction angle of point, obtains the binary image of described left region image according to described gradient direction angle;To described two-value The pixel changed in image carries out upright projection, obtains vertical projection diagram;Determine the projection peak value in described vertical projection diagram Point, determines the left hand edge of described windscreen according to described projection peak point;Described Herba Plantaginis is determined according to described right areas image The right hand edge of window.
In conjunction with the first possible implementation of second aspect, embodiments provide the of above-mentioned second aspect Four kinds of possible implementations, wherein, described first positioning unit, for by the top apart from described circumscribed rectangular region image Below boundary, the position of the first predeterminable range is defined as the lower limb of the windscreen of coarse positioning;Will be apart from described circumscribed rectangular region figure Above the coboundary of picture, the position of the second predeterminable range is defined as the top edge of the windscreen of coarse positioning;Car by described coarse positioning Region between the lower limb of the top edge of front window and the windscreen of described coarse positioning is defined as the windscreen region of coarse positioning, To the most fixed windscreen area image.
In conjunction with second aspect, embodiments provide the 5th kind of possible implementation of above-mentioned second aspect, its In, described hand-held phone behavioral value module includes:
Raise one's hand behavioral value unit, for according to described driver area image and described in raise one's hand behavioral value model to described Driver to be detected is carried out raising one's hand behavioral value;
Hand-held phone behavioral value unit, for indicating described driver to be detected to there is act when behavioral value result of raising one's hand During hands behavior, according to described driver area image and described in behavior disaggregated model of raising one's hand described driver to be detected is carried out hand-held Phone behavioral value.
In conjunction with the 5th kind of possible implementation of second aspect, embodiments provide the of above-mentioned second aspect Six kinds of possible implementations, wherein, described in raise one's hand behavioral value unit, for described driver area image is normalized Process, obtain the driver area image of the first pre-set dimension;Institute is extracted from the driver area image of described first pre-set dimension Stating the first converging channels feature of driver's arm to be detected, described first converging channels feature includes gray feature, gradient width Value and six gradient direction features;Treated described in behavioral value model and described first converging channels feature calculation by described raising one's hand According to described score, the score of detection driver's arm diverse location, judges whether described driver to be detected raises one's hand behavior.
In conjunction with the 6th kind of possible implementation of second aspect, embodiments provide the of above-mentioned second aspect Seven kinds of possible implementations, wherein, described hand-held phone behavioral value unit, it is used for according to raising one's hand behavioral value result, will The arm position of highest scoring is defined as the position of hand-held phone behavioral value;Treat described in extracting from the image of described driver area Second converging channels feature of the arm position of detection driver's highest scoring, described second converging channels feature includes that gray scale is special Levy, gradient magnitude and 12 gradient direction features;It is polymerized logical by the behavior model and described second of raising one's hand of training in advance respectively The score of each behavior model of raising one's hand of road feature calculation, judges described to be detected according to the score of described each behavior model of raising one's hand Whether driver has hand-held phone behavior.
Driver's hand-held phone behavioral value method and device that the embodiment of the present invention provides, does not relies on detection to be detected The face location of driver, it is possible to detect whether driver has hand-held phone behavior accurately, it is to avoid due to by illumination, The impact of resolution cannot detect face location, and then cannot detect whether driver has the situation of hand-held phone behavior.
For making the above-mentioned purpose of the present invention, feature and advantage to become apparent, preferred embodiment cited below particularly, and coordinate Appended accompanying drawing, is described in detail below.
Accompanying drawing explanation
In order to be illustrated more clearly that the technical scheme of the embodiment of the present invention, below by embodiment required use attached Figure is briefly described, it will be appreciated that the following drawings illustrate only certain embodiments of the present invention, and it is right to be therefore not construed as The restriction of scope, for those of ordinary skill in the art, on the premise of not paying creative work, it is also possible to according to this A little accompanying drawings obtain other relevant accompanying drawings.
Fig. 1 shows the flow chart of a kind of driver hand-held phone behavioral value method that the embodiment of the present invention 1 provided;
Fig. 2 shows that the structure of a kind of driver hand-held phone behavioral value device that the embodiment of the present invention 2 provided is shown It is intended to.
Detailed description of the invention
For making the purpose of the embodiment of the present invention, technical scheme and advantage clearer, below in conjunction with the embodiment of the present invention Middle accompanying drawing, is clearly and completely described the technical scheme in the embodiment of the present invention, it is clear that described embodiment is only It is a part of embodiment of the present invention rather than whole embodiments.Generally real with the present invention illustrated described in accompanying drawing herein The assembly executing example can be arranged with various different configurations and design.Therefore, below to the present invention's provided in the accompanying drawings The detailed description of embodiment is not intended to limit the scope of claimed invention, but is merely representative of the selected reality of the present invention Execute example.Based on embodiments of the invention, the institute that those skilled in the art are obtained on the premise of not making creative work There are other embodiments, broadly fall into the scope of protection of the invention.
In view of the hand-held phone behavioral value method of the driver in correlation technique, mostly it is built upon Face datection On the basis of, the most first detect the face location of driver, determine that hand-held phone is at left and right face according to the face location of driver By the method for feature detection, position, detects whether driver has hand-held phone behavior.But, the detection side in correlation technique Method, is easily subject to the impact of illumination, resolution, the people of driver cannot be detected calmly from the image of the driver gathered Face, thus cause detecting whether driver has hand-held phone behavior.Based on this, embodiments provide one and drive The person's of sailing hand-held phone behavioral value method and device, is described below by embodiment.
Embodiment 1
Embodiments providing a kind of driver's hand-held phone behavioral value method, the method is by from driver institute In vehicle image, detect the driver area of driver, obtain driver area image, and according to driver area image to be detected Driver carries out raise one's hand behavioral value and behavior classification of raising one's hand, thus identifies whether driver to be detected has hand-held phone behavior, This method does not relies on whether driver just can be had hand-held phone behavior to detect by the face location of driver.
Before whether the method detection driver using the embodiment of the present invention to provide has hand-held phone behavior, need to use Adaboost (producing strong classifier by iteration Weak Classifier) learning method, behavior characteristics that driver is raised one's hand Practising, training is raised one's hand behavioral value model and is raised one's hand behavior disaggregated model.
Wherein, the behavioral value model of raising one's hand of above-mentioned training is one group of behavioral value model of raising one's hand varied in size, above-mentioned Behavior of the raising one's hand disaggregated model of training is the behavior model that three classes, respectively driver are phoned with mobile telephone, driver's face action behavior Model and driver head's action behavior model, phone with mobile telephone in behavior model driver, and the hands of driver is placed on the side of head Face, in driver's face action behavior model, the hands of driver is placed on front face portion, at driver head's action behavior model In, the hands of driver is placed on head.
Whether the method detection driver using the embodiment of the present invention to provide has hand-held phone behavior, as it is shown in figure 1, include Step S110-S140.
S110, gathers driver place to be detected vehicle image.
Traffic block port camera acquisition driver to be detected place vehicle image can be passed through, when vehicle on the way travels Time, when entering into the pickup area of traffic block port video camera, the video camera of traffic block port can be with certain frame per second continuous acquisition The vehicle image of process.
S120, obtains the circumscribed rectangular region image of vehicle from the vehicle image gathered.
When the camera acquisition of traffic block port is to after the vehicle image of driving vehicle, use Adaboost algorithm from gathering Detecting the position coordinates of vehicle in this image in every frame vehicle image, the position coordinates of vehicle refers to vehicle boundary rectangle Four extreme coordinates, can determine that four end points of vehicle boundary rectangle according to four extreme coordinates of vehicle boundary rectangle, Four end points are coupled together and can obtain the circumscribed rectangular region image of vehicle.
S130, positions the driver area of driver to be detected from above-mentioned circumscribed rectangular region image, obtains driver area Image.
In embodiments of the present invention, from circumscribed rectangular region image, orient the driver area of driver to be detected, can First to orient windscreen region from circumscribed rectangular region image, the right half area in windscreen region is defined as driver's compartment Territory, detailed process includes: according to circumscribed rectangular region image, the windscreen of vehicle is carried out coarse positioning, obtains the car of coarse positioning Front window area image;From the windscreen area image of coarse positioning, the lower edges of positioning car front window, obtain determining lower edges Windscreen area image;From the windscreen area image determining lower edges, the left and right edges of positioning car front window, obtain car Front window area image;Windscreen area image is divided into left area and right half area, right half area is defined as to be detected The driver area of driver, obtains driver area image.
In said process, it is necessary first to windscreen is carried out coarse positioning, specifically includes: will be apart from circumscribed rectangular region image Coboundary below the position of the first predeterminable range be defined as the lower limb of windscreen of coarse positioning;Will be apart from circumscribed rectangular region Above the coboundary of image, the position of the second predeterminable range is defined as the top edge of the windscreen of coarse positioning;By the Herba Plantaginis of coarse positioning Region before the lower limb of the top edge of window and the windscreen of coarse positioning is defined as the windscreen region of coarse positioning.
Above-mentioned first predeterminable range can be the 3/5 of the boundary rectangle picture altitude of vehicle, and above-mentioned second predeterminable range is 0 To vehicle boundary rectangle picture altitude 1/4 between any number, certainly, above-mentioned first predeterminable range and second preset away from From can also is that other numerical value, the embodiment of the present invention does not limit the concrete of above-mentioned first predeterminable range and the second predeterminable range Numerical value, as long as the value of the first predeterminable range and the second predeterminable range ensure that windscreen in the regional extent of coarse positioning be Can.
The windscreen region of above-mentioned coarse positioning is bigger than actual windscreen region, it is therefore an objective to ensure that windscreen can wrap completely It is contained in the windscreen region of coarse positioning, owing to the windscreen region of coarse positioning is bigger than actual windscreen, therefore, obtains thick Behind the windscreen region of location, in addition it is also necessary to according to the windscreen region of coarse positioning, windscreen is accurately positioned, i.e. obtains reality The lower edges of the windscreen on border and left and right edges.
First according to the windscreen region of coarse positioning, orient the lower edges of windscreen, specifically include: obtain coarse positioning The binary picture of edge strength in windscreen region;The binary picture of edge strength is carried out floor projection, obtains horizontal sides Edge projection;Subpoint in Horizontal edge projection figure is ranked up according to skirt response intensity;Subpoint after sequence In, according to skirt response intensity from choosing two subpoints successively to weak order by force, by between above-mentioned two subpoint away from Compare from predeterminable range scope, edge corresponding for two subpoints meeting predeterminable range scope is defined as windscreen Lower edges.
In embodiments of the present invention, when the windscreen region after the windscreen area image obtaining coarse positioning, to coarse positioning Image carries out histogram equalization process, i.e. uses rectangular histogram that the windscreen area image of coarse positioning is carried out pretreatment, to adjust The foreground layer of the windscreen area image of whole coarse positioning and the contrast of background layer, strengthen the windscreen area image of coarse positioning Contrast between foreground layer and background layer, after the windscreen area image of coarse positioning is carried out histogram equalization process, The windscreen area image of the coarse positioning after processing is carried out rim detection, obtains the edge of the windscreen area image of coarse positioning Intensity map, when carrying out rim detection to the windscreen area image of coarse positioning, it is possible to use the edge inspections such as Sobel (Sobel) Measuring and calculating, it is possible to use [-10 1]TTemplate etc., the present invention do not limit above-mentioned carry out during rim detection specifically used Edge detection operator.
After the edge strength figure of the windscreen area image obtaining coarse positioning, above-mentioned edge strength figure is carried out at binaryzation Reason, sets threshold value T of pixel value, and the pixel value of the pixel less than T of the pixel value in edge strength figure is set to zero, by limit In edge intensity map, the pixel value of the pixel value pixel more than or equal to T is set to 1, so, and pixel in above-mentioned edge strength figure The pixel value of point only has 0 and 1 two numerical value, obtains the binary picture of edge strength figure, wherein, and the span of above-mentioned threshold value T For [20,50], the concrete value of above-mentioned threshold value can be configured according to reality application.
After obtaining the binary picture of edge strength, the binary picture of edge strength is carried out floor projection, will edge strong Pixel in the binary picture of degree all projects on vertical direction, obtains the Horizontal edge projection of the binary picture of edge strength Figure, in order to reduce the noise in above-mentioned Horizontal edge projection figure, can pass through [1 2 1]TTemplate is to above-mentioned Horizontal edge projection Figure is smoothed, and after smoothing processing, obtains the local edge phase in each neighborhood by the method for non-maxima suppression Answer the subpoint of maximum intensity, and the subpoint of the skirt response maximum intensity obtained is arranged according to skirt response intensity Sequence, can be according to skirt response intensity from by force to weak order sequence, it is also possible to according to skirt response intensity from weak to strong suitable Sequence is ranked up, the subpoint sequence after being sorted, and the concrete sequence that the embodiment of the present invention does not limit above-mentioned subpoint is suitable Sequence.
When obtaining in above-mentioned Horizontal edge projection figure after subpoint sequence, from above-mentioned subpoint sequence, strong according to response Degree by choosing two subpoints to weak order by force, such as, above-mentioned subpoint according to response intensity to weak order being by force K1, K2, K3, K4…KN, wherein, K1、K2、K3…KNAll represent is subpoint, first chooses throwing from above-mentioned subpoint sequence Shadow point K1And K2Mate, during mating, obtain subpoint K1And K2Between distance D12, it is judged that D12Whether Fall in the range of predeterminable range, if D12Fall in the range of predeterminable range, then explanation subpoint K1And K2The match is successful, by K1、K2 Corresponding edge line is defined as the lower edges of windscreen, if D12In the range of not falling within predeterminable range, then subpoint is described K1And K2Mate unsuccessful, choose subpoint K the most again1And K3Mate, obtain marginal point K1And K3Between distance D13, it is judged that D13Whether in the range of predeterminable range, if it is, be judged as subpoint K1And K3The match is successful, will subpoint K1And K3Right The edge line answered is defined as the lower edges of windscreen, if subpoint K1And K3Mate unsuccessful, then full continuation is from above-mentioned projection Point sequence is chosen marginal point mate, till determining the lower edges of windscreen, wherein, above-mentioned predeterminable range model Enclose for (Dmin, Dmax), i.e. work as D12Meet Dmin<D12<DmaxTime, it is judged that for projection line K1And K2The match is successful, above-mentioned DminRefer to Minimum range between windscreen lower edges, DmaxRefer to the ultimate range between windscreen lower edges, for different Vehicle, DminAnd DmaxValue may differ.
Determined the lower edges of windscreen by said process, obtain determining the windscreen area image of lower edges, Afterwards according in the windscreen area image determining lower edges, orient the left and right edges of windscreen, specifically include: according in advance If the windscreen area image determining lower edges is divided into left region image and right areas image by ratio;Calculate left part The gradient direction angle of each pixel in area image, obtains the binary image of left region image according to gradient direction angle; Pixel in above-mentioned binary image is carried out upright projection, obtains vertical projection diagram;Determine the throwing in vertical projection diagram Shadow peak point, determines the left hand edge of windscreen according to above-mentioned projection peak point;The right side of windscreen is determined according to right areas image Edge.
In embodiments of the present invention, the arbitrary proportion value that may range from the range of 1/2 to 1 of above-mentioned preset ratio, i.e. The size of above-mentioned left region image can be appointing between the 1/3-1/2 of the whole windscreen area image determining lower edges Meaning numerical value, the embodiment of the present invention does not limit the concrete numerical value of above-mentioned preset ratio.
According to preset ratio, the above-mentioned windscreen area image determining lower edges is divided into left region image and the right side After portion's area image, determine the left hand edge of windscreen according to left region image, determine windscreen according to right areas image Right hand edge, the left hand edge of windscreen is identical with the determination method of right hand edge, therefore, next will be with true according to left region image As a example by determining the left hand edge of windscreen, the detailed process of the left hand edge that determine windscreen it is discussed in detail:
Owing to above-mentioned left region image is two dimensional image, therefore in image, the coordinate of each pixel is also that two dimension is sat Mark, the coordinate of each pixel can be expressed as that (x y), therefore, it can pass through formulaCalculate every The gradient of individual pixel, wherein, in above-mentioned formula,Being the gradient of ith pixel point, the gradient of each pixel is one Individual two-dimensional vector, therefore can be decomposed into the component on the component of horizontal direction and vertical direction, gradientHorizontal component be gx, vertical component is gy
The gradient direction angle of each pixel is the vertical component horizontal component with this gradient of the gradient of each pixel Between angle, i.e.Wherein, θiIt is the gradient direction angle of ith pixel point, gyIt it is ith pixel point ladder The vertical component of degree, gxIt is the horizontal component of ith pixel point gradient, above-mentioned formula is deformed, can obtainThe gradient direction angle of each pixel can be calculated according to this formula.
When calculating in the image of left region after the gradient direction angle of each pixel, above-mentioned gradient direction angle is returned One change processes, and is all normalized to by each gradient direction angle in the regional extent of [0 °, 90 °], direction initialization threshold value O1And O2, root According to direction threshold value O1And O2, left region image is carried out binary conversion treatment, detailed process includes: when in the image of left region The gradient direction angle of pixel meets O1i<O2Time, pixel value corresponding for this pixel is set to 1, when left region image In pixel be unsatisfactory for O1i<O2Time, pixel value corresponding for this pixel is set to 0, so, in the image of left region The pixel value of pixel only has 0 and 1 two numerical value, obtains the binary image of left region image, wherein, above-mentioned threshold value O1's Span isAbove-mentioned threshold value O2Span beCertainly, above-mentioned threshold value O1 and the value of threshold value O2 Scope can be configured according to concrete application scenarios, and the embodiment of the present invention does not limit above-mentioned threshold value O1And O2Concrete value Scope.
When, after the bianry image obtaining left region image, the pixel that the pixel value in this bianry image is not zero being clicked on Row upright projection, the pixel being not zero by pixel value projects in horizontal direction, in embodiments of the present invention, can be by pixel The pixel that value is not zero projects to, on windscreen lower limb, pass through formulaCalculate pixel in above-mentioned bianry image Put each pixel being not zero side-play amount in the horizontal direction, i.e. this spot projection correspondence position to horizontal direction, its In, in above-mentioned formula, x is the side-play amount that pixel projects in horizontal direction, and θ is the gradient direction angle of pixel, phIt is Pixel is to the distance of vehicle window lower limb.
When, on the spot projection being not zero by pixel value in above-mentioned bianry image to horizontal direction, obtaining hanging down of this bianry image Straight projection, in order to reduce the noise in vertical projection diagram, is smoothed this vertical projection diagram, is being smoothed Time, [1 2 1] template can be used to go out to be smoothed to above-mentioned upright projection, after being smoothed, from smoothing processing After vertical projection diagram in find the projection peak point of pixel, cross this projection peak point and do vertical with windscreen lower limb straight Line, is defined as the left hand edge of windscreen by this straight line.
Use and the above-mentioned method determining that windscreen left hand edge is identical, determine the right of windscreen according to right areas Edge, when, after the right hand edge determining windscreen, the region of the lower edges of windscreen, left and right edges besieged city being defined as windscreen Region, obtains windscreen area image, and the windscreen region that the embodiment of the present invention is determined is rectangular area.
The above-mentioned area image defining windscreen, is divided into left area and right half-court by the area image of windscreen Territory, is defined as driver area by right half area, this results in the driver area image of driver.
S140, according to driver area image, the behavior of raising one's hand of raise one's hand behavioral value model and the training in advance of training in advance Disaggregated model carries out hand-held phone behavioral value to driver to be detected.
When driver to be detected is carried out hand-held phone behavioral value, first detect whether driver to be detected raises one's hand Behavior, if it is judged that driver to be detected raises one's hand during behavior, at the classification of the behavior of raising one's hand judging driver to be detected, tool Body process includes: raise one's hand driver to be detected behavioral value according to driver area image and behavioral value model of raising one's hand; When behavior is raised one's hand in behavioral value result instruction driver to be detected existence of raising one's hand, divide according to driver area image and the behavior of raising one's hand Class model carries out hand-held phone behavioral value to described driver to be detected.
Driver to be detected raised one's hand behavioral value according to driver area image and behavioral value model of raising one's hand, specifically Including: driver area image is normalized, obtains the driver area image of the first pre-set dimension;Chi is preset from first Extracting the first converging channels feature of driver's arm to be detected in very little driver area image, the first converging channels feature includes Gray feature, gradient magnitude and six gradient direction features;By behavioral value model and the first converging channels feature meter of raising one's hand Calculate the score of driver's arm diverse location to be detected, judge whether driver to be detected raises one's hand behavior according to score.
Owing to traffic block port video camera is when shooting driver place vehicle image to be detected, may be at vehicle distances bayonet socket The when of video camera certain distance, bayonet camera begins to collection vehicle image, so the vehicle image gathered differs in size, The driver area image i.e. determined differs in size, so above-mentioned raising one's hand one group that behavioral value model is training in advance varies in size Driver raise one's hand behavioral value model.
In order to prevent driver area image excessive, first driver area image is normalized, by driver area Image normalization, to fixing size, obtains the driver area image of the first pre-set dimension, and above-mentioned first pre-set dimension can be The dimensional values pre-set, the size of this size can be configured according to practical situation, and the embodiment of the present invention is not Limit the specific size of above-mentioned first pre-set dimension.
After driver area image is normalized, extracts from the driver area image of the first pre-set dimension and treat First converging channels feature of detection driver's arm, the first aggregation features of driver's arm includes the gray scale of driver's arm Feature, i.e. uses black tone to represent the arm of driver, and with black as reference colours, the black of different saturations shows to be driven The arm of the person of sailing, above-mentioned first converging channels feature also includes the arm position picture treating driver to be detected in the image of driver area The gradient magnitude of vegetarian refreshments, and six gradient direction features.
Above-mentioned six gradient direction features refer to averagely be divided into 180 ° six intervals.
When after the first converging channels feature being extracted driver's arm to be detected, by the good one group of size of training in advance not Same behavioral value model of raising one's hand carries out traversal inspection respectively on the first converging channels characteristic pattern of the driver to be detected extracted Surveying, testing result is the score of driver's arm diverse location, and this score is to gather by the first of driver's arm diverse location Close the weight gained of each feature in the behavioral value model of raising one's hand of channel characteristics and training in advance and value, above-mentioned driver's arm What the score of position represented is this position and the matching degree of correspondence position on behavioral value model of raising one's hand, and score is the highest, explanation Position corresponding to this score is the highest with the matching degree of correspondence position on behavioral value model of raising one's hand, and can sentence according to above-mentioned score Break and driver and whether raise one's hand behavior.
Meanwhile, during behavioral value that driver is raised one's hand, it may be determined that go out the size of driver area image, Therefore, when driver to be detected being raised one's hand behavior classification and Detection, directly by driver area image normalization to raise one's hand Behavior disaggregated model size of the same size.
When behavioral value process of raising one's hand detect driver to be detected raise one's hand behavior time, next according to driver area figure Picture and behavior disaggregated model of raising one's hand, whether detection driver has hand-held phone behavior, specifically includes: according to behavioral value knot of raising one's hand Really, the arm position of highest scoring is defined as the position of hand-held phone behavioral value;Extract to be checked from the image of driver area Surveying the second converging channels feature of the arm position of driver's highest scoring, the second converging channels feature includes gray feature, ladder Degree amplitude and 12 gradient direction features;Respectively by raise one's hand behavior model and the second converging channels feature calculation of training in advance According to the score of each behavior model of raising one's hand, the score of each behavior model of raising one's hand, judges whether described driver to be detected has hands Hold phone behavior.
Wherein, behavior of the raising one's hand disaggregated model of above-mentioned training in advance includes that three classes, respectively driver are phoned with mobile telephone behavior mould Type, driver's face action behavior model and driver head's action behavior model, phone with mobile telephone in behavior model driver, drive The hands of the person of sailing is placed on the side of head, and in driver's face action behavior model, the hands of driver is placed on front face portion, is driving In the person's of sailing headwork behavior model, the hands of driver is placed on head, and, above-mentioned behavior disaggregated model of raising one's hand is fixed dimension Model.
When behavior classification of raising one's hand driver to be detected judges, driver to be detected is raised one's hand in behavioral value, The position that on driver's arm to be detected, scoring position is the highest is as the position of behavior classification and Detection of raising one's hand, and this position is a square Shape region, in order to prevent, this rectangular area is too small can accurately not treat the detection driver behavior classification that carries out raising one's hand and judge, because of This, driver to be detected is raised one's hand behavior classification judge time, first this band of position is extended out, will this band of position to Surrounding expands certain ratio, and the width extended out can be the 1/2 of origin-location peak width, and the height extended out can be original The 1/2 of band of position height, and the driver area image after being extended out is normalized, and normalizes to and raises one's hand The consistent size of behavior disaggregated model.
Driver area image after above-mentioned extending out extracts driver to be detected the above-mentioned band of position extended out Dimerization channel characteristics, the second converging channels feature of extraction includes the gray feature of this position of driver to be detected, gradient width Value and 12 gradient direction features.
Above-mentioned 12 gradient direction features refer to averagely be divided into 180 ° 12 intervals.
When, after the second converging channels feature being extracted driver to be detected, three group the raise one's hand behaviors good by training in advance divide Class model carries out traversal detection respectively on the second converging channels characteristic pattern of the driver to be detected extracted, and testing result is three The score of individual behavior disaggregated model of raising one's hand, using the top score of each behavior disaggregated model of raising one's hand as this behavior classification mould of raising one's hand The final score of type, this score is the second converging channels feature by the above-mentioned position of driver and the behavior of raising one's hand of training in advance In disaggregated model the weight gained of each feature and value, what above-mentioned each score raising one's hand behavior disaggregated model represented is to be detected Behavior of raising one's hand and this of driver is raised one's hand the matching degree of behavior disaggregated model, the behavior of raising one's hand of the model of highest scoring is determined For the behavior of raising one's hand of driver to be detected, if above-mentioned highest scoring is that driver phones with mobile telephone behavior model, then it is judged as treating Detection driver has hand-held phone behavior.
When detecting that driver to be detected has hand-held phone behavior, then perform operation of reporting to the police, and performing the behaviour that reports to the police The image that this moment traffic block port gathers is preserved while work.
Driver's hand-held phone behavioral value method that the embodiment of the present invention provides, does not relies on detection driver to be detected Face location, it is possible to detect whether driver has hand-held phone behavior accurately, it is to avoid due to by illumination, resolution Impact cannot detect face location, and then cannot detect whether driver has the situation of hand-held phone behavior.
Embodiment 2
Embodiments providing a kind of driver's hand-held phone behavioral value device, this device is used for performing above-mentioned reality Execute driver's hand-held phone behavioral value method that example 1 provides.
As in figure 2 it is shown, driver's hand-held phone behavioral value device that the embodiment of the present invention provides includes: acquisition module 210, acquisition module 220, locating module 230 and hand-held phone behavioral value module 240;
Above-mentioned acquisition module 210, is used for gathering driver place to be detected vehicle image;
Above-mentioned acquisition module 220, for obtaining the circumscribed rectangular region image of vehicle from the vehicle image gathered;
Above-mentioned locating module 230, for positioning the driver's compartment of driver to be detected from above-mentioned circumscribed rectangular region image Territory, obtains driver area image;
Above-mentioned hand-held phone behavioral value module 240, for according to above-mentioned driver area image, the row of raising one's hand of training in advance For behavior of the raising one's hand disaggregated model of detection model and training in advance, driver to be detected carried out hand-held phone behavioral value.
Traffic block port camera acquisition driver to be detected place vehicle image can be passed through, when vehicle on the way travels Time, when entering into the pickup area of traffic block port video camera, the video camera of traffic block port can be with certain frame per second continuous acquisition The vehicle image of process.
When the camera acquisition of traffic block port is to after the vehicle image of driving vehicle, use Adaboost (weak by iteration Grader produce strong classifier) algorithm from gather every frame vehicle image detect the position coordinates of vehicle, car in this image Position coordinates refer to four extreme coordinates of vehicle boundary rectangle, four extreme coordinates according to vehicle boundary rectangle can To determine four end points of vehicle boundary rectangle, four end points are coupled together and can obtain the circumscribed rectangular region figure of vehicle Picture.
Above-mentioned locating module 230 positions the driver area of driver to be detected from circumscribed rectangular region image, is to pass through First positioning unit, the second positioning unit, the 3rd positioning unit and determine what unit realized, specifically include:
Above-mentioned first positioning unit, for according to circumscribed rectangular region image, carries out coarse positioning to the windscreen of vehicle, Windscreen area image to coarse positioning;Above-mentioned second positioning unit, for from the windscreen area image of coarse positioning, positions The lower edges of windscreen, obtains determining the windscreen area image of lower edges;Above-mentioned 3rd positioning unit, for from determining In the windscreen area image of lower edges, the left and right edges of positioning car front window, obtain windscreen area image;Above-mentioned determine list Unit, for windscreen area image is divided into left area and right half area, is defined as driver to be detected by right half area Driver area, obtain driver area image.
Above-mentioned second positioning unit from the windscreen area image of coarse positioning, the lower edges of positioning car front window, specifically Including: obtain the binary picture of the edge strength of the windscreen area image of coarse positioning;The binary picture of edge strength is carried out Floor projection, obtains Horizontal edge projection figure;Subpoint in Horizontal edge projection figure is arranged according to skirt response intensity Sequence;From the subpoint after sequence, according to skirt response intensity from choosing two subpoints successively to weak order, by two by force Distance between subpoint is compared with predeterminable range scope, by limit corresponding for two subpoints meeting predeterminable range scope Edge is defined as the lower edges of windscreen.
Above-mentioned 3rd positioning unit from the windscreen area image determining lower edges, the limit, left and right of positioning car front window Edge, specifically includes: according to preset ratio, the windscreen area image determining lower edges is divided into left region image and the right side Portion's area image;Calculate the gradient direction angle of each pixel in the image of left region, obtain a left side according to above-mentioned gradient direction angle The binary image of portion's area image;Pixel in above-mentioned binary image is carried out upright projection, obtains vertical projection diagram; Determine the projection peak point in vertical projection diagram, determine the left hand edge of windscreen according to projection peak point;According to right areas Image determines the right hand edge of windscreen.
In embodiments of the present invention, the arbitrary proportion value that may range from the range of 1/2 to 1 of above-mentioned preset ratio, i.e. The size of above-mentioned left region image can be appointing between the 1/3-1/2 of the whole windscreen area image determining lower edges Meaning numerical value, the embodiment of the present invention does not limit the concrete numerical value of above-mentioned preset ratio.
Above-mentioned first positioning unit, according to circumscribed rectangular region image, carries out coarse positioning to the front window of vehicle, specifically wraps Include: the position of the first predeterminable range below the coboundary of distance circumscribed rectangular region image is defined as the windscreen of coarse positioning Lower limb;The position of the second predeterminable range above the coboundary of distance circumscribed rectangular region image is defined as the Herba Plantaginis of coarse positioning The top edge of window;Region between the lower limb of the top edge of the windscreen of coarse positioning and the windscreen of coarse positioning is defined as slightly The windscreen region of location, obtains the most fixed windscreen area image.
Above-mentioned first predeterminable range can be the 3/5 of the boundary rectangle picture altitude of vehicle, and above-mentioned second predeterminable range is 0 To vehicle boundary rectangle picture altitude 1/4 between any number, certainly, above-mentioned first predeterminable range and second preset away from From can also is that other numerical value, the embodiment of the present invention does not limit the concrete of above-mentioned first predeterminable range and the second predeterminable range Numerical value, as long as the value of the first predeterminable range and the second predeterminable range ensure that windscreen in the regional extent of coarse positioning be Can.
Wherein, above-mentioned hand-held phone behavioral value module 240 carries out hand-held phone behavioral value to driver to be detected, is By raising one's hand what behavioral value unit and hand-held phone behavioral value unit realized, specifically include:
Above-mentioned behavioral value unit of raising one's hand, for driving to be detected according to driver area image and behavioral value model of raising one's hand The person of sailing is carried out raising one's hand behavioral value;Above-mentioned hand-held phone behavioral value unit, for indicating to be checked when behavioral value result of raising one's hand Survey driver exist raise one's hand behavior time, according to driver area image and behavior disaggregated model of raising one's hand, driver to be detected is carried out hands Hold phone behavioral value.
The above-mentioned one group of driver varied in size that behavioral value model is training in advance that raises one's hand raises one's hand behavioral value model.
Wherein, behavior of the raising one's hand disaggregated model of above-mentioned training in advance includes that three classes, respectively driver are phoned with mobile telephone behavior mould Type, driver's face action behavior model and driver head's action behavior model, phone with mobile telephone in behavior model driver, drive The hands of the person of sailing is placed on the side of head, and in driver's face action behavior model, the hands of driver is placed on front face portion, is driving In the person's of sailing headwork behavior model, the hands of driver is placed on head, and, above-mentioned behavior disaggregated model of raising one's hand is fixed dimension Model.
Wherein, when above-mentioned behavioral value unit of raising one's hand when raising one's hand behavioral value to driver to be detected, specifically wrap Include and driver area image is normalized, obtain the driver area image of the first pre-set dimension;From the first pre-set dimension Driver area image in extract the first converging channels feature of driver's arm to be detected, the first converging channels feature includes ash Degree feature, gradient magnitude and six gradient direction features;By behavioral value model and the first converging channels feature calculation of raising one's hand According to above-mentioned score, the score of driver's arm diverse location to be detected, judges whether driver to be detected raises one's hand behavior.
Above-mentioned hand-held phone behavioral value unit carries out hand-held phone behavioral value and specifically includes driver to be detected: root According to behavioral value result of raising one's hand, the arm position of highest scoring is defined as the position of hand-held phone behavioral value;From driver's compartment Area image extracts the second converging channels feature of the arm position of driver's highest scoring to be detected, the second converging channels feature Including gray feature, gradient magnitude and 12 gradient direction features;Respectively by the behavior model and second of raising one's hand of training in advance The score of each behavior model of raising one's hand of converging channels feature calculation, judges to be detected driving according to the score of each behavior model of raising one's hand Whether the person of sailing has hand-held phone behavior.
Driver's hand-held phone behavioral value device that the embodiment of the present invention provides, does not relies on detection driver to be detected Face location, it is possible to detect whether driver has hand-held phone behavior accurately, it is to avoid due to by illumination, resolution Impact cannot detect face location, and then cannot detect whether driver has the situation of hand-held phone behavior.
Driver's hand-held phone behavioral value device that the embodiment of the present invention is provided can be the specific hardware on equipment Or the software being installed on equipment or firmware etc..The device that the embodiment of the present invention is provided, it realizes the skill of principle and generation Art effect is identical with preceding method embodiment, for briefly describing, and the not mentioned part of device embodiment part, refer to preceding method Corresponding contents in embodiment.Those skilled in the art is it can be understood that arrive, and for convenience and simplicity of description, aforementioned retouches The specific works process of system, device and the unit stated, is all referred to the corresponding process in said method embodiment, at this not Repeat again.
In embodiment provided by the present invention, it should be understood that disclosed apparatus and method, can be by other side Formula realizes.Device embodiment described above is only that schematically such as, the division of described unit, the most only one are patrolled Volume function divides, and actual can have other dividing mode when realizing, the most such as, multiple unit or assembly can in conjunction with or can To be integrated into another system, or some features can be ignored, or does not performs.Another point, shown or discussed each other Coupling direct-coupling or communication connection can be the INDIRECT COUPLING by some communication interfaces, device or unit or communication link Connect, can be electrical, machinery or other form.
The described unit illustrated as separating component can be or may not be physically separate, shows as unit The parts shown can be or may not be physical location, i.e. may be located at a place, or can also be distributed to multiple On NE.Some or all of unit therein can be selected according to the actual needs to realize the mesh of the present embodiment scheme 's.
It addition, each functional unit in the embodiment that the present invention provides can be integrated in a processing unit, it is possible to Being that unit is individually physically present, it is also possible to two or more unit are integrated in a unit.
If described function is using the form realization of SFU software functional unit and as independent production marketing or use, permissible It is stored in a computer read/write memory medium.Based on such understanding, technical scheme is the most in other words The part contributing prior art or the part of this technical scheme can embody with the form of software product, this meter Calculation machine software product is stored in a storage medium, including some instructions with so that a computer equipment (can be individual People's computer, server, or the network equipment etc.) perform all or part of step of method described in each embodiment of the present invention. And aforesaid storage medium includes: USB flash disk, portable hard drive, read only memory (ROM, Read-Only Memory), random access memory are deposited The various media that can store program code such as reservoir (RAM, Random Access Memory), magnetic disc or CD.
It should also be noted that similar label and letter represent similar terms, therefore, the most a certain Xiang Yi in following accompanying drawing Individual accompanying drawing is defined, then need not it be defined further and explains in accompanying drawing subsequently, additionally, term " the One ", " second ", " the 3rd " etc. are only used for distinguishing and describe, and it is not intended that instruction or hint relative importance.
It is last it is noted that the detailed description of the invention of embodiment described above, the only present invention, in order to the present invention to be described Technical scheme, be not intended to limit, protection scope of the present invention is not limited thereto, although with reference to previous embodiment to this Bright it is described in detail, it will be understood by those within the art that: any those familiar with the art In the technical scope that the invention discloses, the technical scheme described in previous embodiment still can be modified or can be light by it It is readily conceivable that change, or wherein portion of techniques feature is carried out equivalent;And these are revised, change or replace, do not make The essence of appropriate technical solution departs from the spirit and scope of embodiment of the present invention technical scheme.All should contain the protection in the present invention Within the scope of.Therefore, protection scope of the present invention should be as the criterion with described scope of the claims.

Claims (16)

1. driver's hand-held phone behavioral value method, it is characterised in that described method includes:
Gather driver place to be detected vehicle image;
The circumscribed rectangular region image of vehicle is obtained from the vehicle image gathered;
From described circumscribed rectangular region image, position the driver area of described driver to be detected, obtain driver area image;
Behavior of raising one's hand classification mould according to described driver area image, raise one's hand behavioral value model and the training in advance of training in advance Type carries out hand-held phone behavioral value to described driver to be detected.
Method the most according to claim 1, it is characterised in that described from described circumscribed rectangular region image location described The driver area of driver to be detected, obtains driver area image, including:
According to described circumscribed rectangular region image, the windscreen of described vehicle is carried out coarse positioning, obtains the windscreen of coarse positioning Area image;
From the windscreen area image of described coarse positioning, position the lower edges of described windscreen, obtain determining lower edges Windscreen area image;
From the described windscreen area image determining lower edges, position the left and right edges of described windscreen, obtain windscreen Area image;
Described windscreen area image is divided into left area and right half area, described right half area is defined as described to be checked Survey the driver area of driver, obtain described driver area image.
Method the most according to claim 2, it is characterised in that described from the windscreen area image of described coarse positioning, Position the lower edges of described windscreen, including:
Obtain the binary picture of the edge strength of the windscreen area image of described coarse positioning;
The binary picture of described edge strength is carried out floor projection, obtains Horizontal edge projection figure;
Subpoint in described Horizontal edge projection figure is ranked up according to skirt response intensity;
From the subpoint after sequence, according to skirt response intensity from choosing two subpoints successively to weak order, by institute by force The distance stated between two subpoints is compared with predeterminable range scope, will meet two projections of described predeterminable range scope The edge that point is corresponding is defined as the lower edges of described windscreen.
Method the most according to claim 2, it is characterised in that described from the described windscreen administrative division map determining lower edges In Xiang, position the left and right edges of described windscreen, including:
According to preset ratio, the described windscreen area image determining lower edges is divided into left region image and right part district Area image;
Calculate the gradient direction angle of each pixel in the image of described left region, obtain a described left side according to described gradient direction angle The binary image of portion's area image;
Pixel in described binary image is carried out upright projection, obtains vertical projection diagram;
Determine the projection peak point in described vertical projection diagram, determine the left side of described windscreen according to described projection peak point Edge;
The right hand edge of described windscreen is determined according to described right areas image.
Method the most according to claim 2, it is characterised in that described according to described circumscribed rectangular region image, to described The windscreen of vehicle carries out coarse positioning, obtains the windscreen area image of coarse positioning, including:
The position of the first predeterminable range below the coboundary of described circumscribed rectangular region image is defined as the car of coarse positioning The lower limb of front window;
The position of the second predeterminable range above the coboundary of described circumscribed rectangular region image is defined as the car of coarse positioning The top edge of front window;
Region between the lower limb of the top edge of the windscreen of described coarse positioning and the windscreen of described coarse positioning is defined as The windscreen region of coarse positioning, obtains the most fixed windscreen area image.
Method the most according to claim 1, it is characterised in that described according to described driver area image, training in advance Behavior of the raising one's hand disaggregated model of behavioral value model and the training in advance of raising one's hand carries out hand-held phone row to described driver to be detected For detecting, including:
According to described driver area image and described in behavioral value model of raising one's hand described driver to be detected is raised one's hand behavior Detection;
When behavior is raised one's hand in behavioral value result instruction described driver to be detected existence of raising one's hand, according to described driver area image Behavior disaggregated model of raising one's hand described in and carries out hand-held phone behavioral value to described driver to be detected.
Method the most according to claim 6, it is characterised in that described according to described driver area image and described in raise one's hand row Described driver to be detected raised one's hand behavioral value for detection model, including:
Described driver area image is normalized, obtains the driver area image of the first pre-set dimension;
The first converging channels of described driver's arm to be detected is extracted from the driver area image of described first pre-set dimension Feature, described first converging channels feature includes gray feature, gradient magnitude and six gradient direction features;
Raise one's hand driver's arm to be detected described in behavioral value model and described first converging channels feature calculation not by described According to described score, the score of co-located, judges whether described driver to be detected raises one's hand behavior.
Method the most according to claim 7, it is characterised in that described behavioral value result of raising one's hand of working as indicates described to be detected Driver exists when raising one's hand behavior, according to described driver area image and described in behavior disaggregated model of raising one's hand to be detected drive described The person of sailing carries out hand-held phone behavioral value, including:
According to behavioral value result of raising one's hand, the arm position of highest scoring is defined as the position of hand-held phone behavioral value;
The second converging channels of the arm position of described driver's highest scoring to be detected is extracted from the image of described driver area Feature, described second converging channels feature includes gray feature, gradient magnitude and 12 gradient direction features;
Respectively by raise one's hand behavior model and the described second each behavior model of raising one's hand of converging channels feature calculation of training in advance Score, judge whether described driver to be detected has hand-held phone behavior according to the score of described each behavior model of raising one's hand.
9. driver's hand-held phone behavioral value device, it is characterised in that this device includes:
Acquisition module, is used for gathering driver place to be detected vehicle image;
Acquisition module, for obtaining the circumscribed rectangular region image of vehicle from the vehicle image gathered;
Locating module, for positioning the driver area of described driver to be detected from described circumscribed rectangular region image, obtains Driver area image;
Hand-held phone behavioral value module, for according to described driver area image, the behavioral value model of raising one's hand of training in advance And behavior of the raising one's hand disaggregated model of training in advance carries out hand-held phone behavioral value to described driver to be detected.
Device the most according to claim 9, it is characterised in that described locating module includes:
First positioning unit, for according to described circumscribed rectangular region image, carries out coarse positioning to the windscreen of described vehicle, Windscreen area image to coarse positioning;
Second positioning unit, for from the windscreen area image of described coarse positioning, positions the lower edges of described windscreen, Obtain determining the windscreen area image of lower edges;
3rd positioning unit, for from the described windscreen area image determining lower edges, positions a left side for described windscreen Right hand edge, obtains windscreen area image;
Determine unit, for described windscreen area image being divided into left area and right half area, by described right half area It is defined as the driver area of described driver to be detected, obtains described driver area image.
11. devices according to claim 10, it is characterised in that described second positioning unit, it is described thick fixed to be used for obtaining The binary picture of the edge strength of the windscreen area image of position;The binary picture of described edge strength is carried out floor projection, Obtain Horizontal edge projection figure;Subpoint in described Horizontal edge projection figure is ranked up according to skirt response intensity;From In subpoint after sequence, according to skirt response intensity from choosing two subpoints successively to weak order, by said two by force Distance between subpoint is compared with predeterminable range scope, will meet two subpoint correspondences of described predeterminable range scope Edge be defined as the lower edges of described windscreen.
12. devices according to claim 10, it is characterised in that described 3rd positioning unit, for according to preset ratio The described windscreen area image determining lower edges is divided into left region image and right areas image;Calculate a described left side The gradient direction angle of each pixel in portion's area image, obtains the two of described left region image according to described gradient direction angle Value image;Pixel in described binary image is carried out upright projection, obtains vertical projection diagram;Determine described vertically Projection peak point in projection, determines the left hand edge of described windscreen according to described projection peak point;According to described right part district Area image determines the right hand edge of described windscreen.
13. devices according to claim 10, it is characterised in that described first positioning unit, being used for will be outside described Connect the position of the first predeterminable range below the coboundary of rectangular region image and be defined as the lower limb of the windscreen of coarse positioning;Will be away from Above the coboundary of described circumscribed rectangular region image, the position of the second predeterminable range is defined as the upper of the windscreen of coarse positioning Edge;Region between the lower limb of the top edge of the windscreen of described coarse positioning and the windscreen of described coarse positioning is defined as The windscreen region of coarse positioning, obtains the most fixed windscreen area image.
14. devices according to claim 9, it is characterised in that described hand-held phone behavioral value module includes:
Raise one's hand behavioral value unit, for according to described driver area image and described in raise one's hand behavioral value model to described to be checked Survey driver to carry out raising one's hand behavioral value;
Hand-held phone behavioral value unit, for indicating described driver to be detected to there is row of raising one's hand when behavioral value result of raising one's hand For time, according to described driver area image and described in behavior disaggregated model of raising one's hand described driver to be detected is carried out hand-held phone Behavioral value.
15. devices according to claim 14, it is characterised in that described in raise one's hand behavioral value unit, for driving described Sail area image to be normalized, obtain the driver area image of the first pre-set dimension;From described first pre-set dimension Driver area image extracts the first converging channels feature of described driver's arm to be detected, described first converging channels feature Including gray feature, gradient magnitude and six gradient direction features;Gathered by described behavioral value model and described first of raising one's hand Close channel characteristics and calculate the score of described driver's arm diverse location to be detected, judge described to be detected drive according to described score Whether the person of sailing raises one's hand behavior.
16. devices according to claim 15, it is characterised in that described hand-held phone behavioral value unit, for basis Raise one's hand behavioral value result, the arm position of highest scoring is defined as the position of hand-held phone behavioral value;From described driving Extracting the second converging channels feature of the arm position of described driver's highest scoring to be detected in area image, described second gathers Close channel characteristics and include gray feature, gradient magnitude and 12 gradient direction features;Respectively by the behavior of raising one's hand of training in advance Model and the score of the described second each behavior model of raising one's hand of converging channels feature calculation, according to described each behavior model of raising one's hand Score judge whether described driver to be detected has hand-held phone behavior.
CN201610578623.6A 2016-07-20 2016-07-20 A kind of hand-held phone behavioral value method and device of driver Active CN106203385B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610578623.6A CN106203385B (en) 2016-07-20 2016-07-20 A kind of hand-held phone behavioral value method and device of driver

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610578623.6A CN106203385B (en) 2016-07-20 2016-07-20 A kind of hand-held phone behavioral value method and device of driver

Publications (2)

Publication Number Publication Date
CN106203385A true CN106203385A (en) 2016-12-07
CN106203385B CN106203385B (en) 2019-07-09

Family

ID=57491317

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610578623.6A Active CN106203385B (en) 2016-07-20 2016-07-20 A kind of hand-held phone behavioral value method and device of driver

Country Status (1)

Country Link
CN (1) CN106203385B (en)

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107958200A (en) * 2017-10-13 2018-04-24 上海眼控科技股份有限公司 A kind of intelligent checking system and method for car repacking exhaust fan
CN107967446A (en) * 2017-10-13 2018-04-27 上海眼控科技股份有限公司 A kind of intelligent checking system and method for installing engine protection device additional
CN107967445A (en) * 2017-10-13 2018-04-27 上海眼控科技股份有限公司 A kind of car installs the intelligent checking system and method for skylight additional
CN107976319A (en) * 2017-10-13 2018-05-01 上海眼控科技股份有限公司 A kind of car installs the intelligent checking system and method for foot pedal additional
CN107977604A (en) * 2017-11-06 2018-05-01 浙江工业大学 A kind of hand detection method based on improvement converging channels feature
CN108062552A (en) * 2017-10-13 2018-05-22 上海眼控科技股份有限公司 A kind of vehicle body air brushing intelligent checking system and method for vehicle annual test
CN109165607A (en) * 2018-08-29 2019-01-08 浙江工业大学 A kind of hand-held phone detection method of the driver based on deep learning
CN109285327A (en) * 2018-07-05 2019-01-29 惠州市德赛西威汽车电子股份有限公司 A kind of processing method using mobile phone for driver in driving conditions
CN109508661A (en) * 2018-10-31 2019-03-22 上海交通大学 A kind of person's of raising one's hand detection method based on object detection and Attitude estimation
CN109685026A (en) * 2018-12-28 2019-04-26 南通大学 A kind of driver holds the method for real-time of mobile phone communication
CN110059541A (en) * 2019-02-28 2019-07-26 长江大学 A kind of mobile phone usage behavior detection method and device in driving
CN110309764A (en) * 2019-06-27 2019-10-08 浙江工业大学 A kind of multistage driver based on deep learning makes a phone call behavioral value method
CN110383290A (en) * 2017-03-03 2019-10-25 法雷奥舒适驾驶助手公司 For determining the device of vehicle driver's attention, the onboard system and associated method including this device
CN111738235A (en) * 2020-08-14 2020-10-02 广州汽车集团股份有限公司 Action detection method and device for automatically opening vehicle door
CN113191244A (en) * 2021-04-25 2021-07-30 上海夏数网络科技有限公司 Method for detecting driver irregular behaviors

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102592143A (en) * 2012-01-09 2012-07-18 清华大学 Method for detecting phone holding violation of driver in driving
CN103366506A (en) * 2013-06-27 2013-10-23 北京理工大学 Device and method for automatically monitoring telephone call behavior of driver when driving
CN104573724A (en) * 2015-01-09 2015-04-29 安徽清新互联信息科技有限公司 Method for monitoring call making and receiving behaviors of driver
US20150286884A1 (en) * 2014-04-04 2015-10-08 Xerox Corporation Machine learning approach for detecting mobile phone usage by a driver
US20150286885A1 (en) * 2014-04-04 2015-10-08 Xerox Corporation Method for detecting driver cell phone usage from side-view images
CN105718864A (en) * 2016-01-18 2016-06-29 安徽天盛智能科技有限公司 A method for detecting whether drivers and passengers of motor vehicles fasten seat belts on the way

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102592143A (en) * 2012-01-09 2012-07-18 清华大学 Method for detecting phone holding violation of driver in driving
CN103366506A (en) * 2013-06-27 2013-10-23 北京理工大学 Device and method for automatically monitoring telephone call behavior of driver when driving
US20150286884A1 (en) * 2014-04-04 2015-10-08 Xerox Corporation Machine learning approach for detecting mobile phone usage by a driver
US20150286885A1 (en) * 2014-04-04 2015-10-08 Xerox Corporation Method for detecting driver cell phone usage from side-view images
CN104573724A (en) * 2015-01-09 2015-04-29 安徽清新互联信息科技有限公司 Method for monitoring call making and receiving behaviors of driver
CN105718864A (en) * 2016-01-18 2016-06-29 安徽天盛智能科技有限公司 A method for detecting whether drivers and passengers of motor vehicles fasten seat belts on the way

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
徐兵 等: "基于图像分析的安全带识别算法研究", 《电子技术与软件工程》 *
王丹: "基于机器视觉的驾驶员打电话行为检测", 《中国优秀硕士学位论文全文数据库 工程科技Ⅱ辑》 *

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110383290A (en) * 2017-03-03 2019-10-25 法雷奥舒适驾驶助手公司 For determining the device of vehicle driver's attention, the onboard system and associated method including this device
CN110383290B (en) * 2017-03-03 2023-09-01 法雷奥舒适驾驶助手公司 Device for determining the attention of a vehicle driver, in-vehicle system comprising such a device and associated method
CN107967446A (en) * 2017-10-13 2018-04-27 上海眼控科技股份有限公司 A kind of intelligent checking system and method for installing engine protection device additional
CN107967445A (en) * 2017-10-13 2018-04-27 上海眼控科技股份有限公司 A kind of car installs the intelligent checking system and method for skylight additional
CN107976319A (en) * 2017-10-13 2018-05-01 上海眼控科技股份有限公司 A kind of car installs the intelligent checking system and method for foot pedal additional
CN108062552A (en) * 2017-10-13 2018-05-22 上海眼控科技股份有限公司 A kind of vehicle body air brushing intelligent checking system and method for vehicle annual test
CN107958200A (en) * 2017-10-13 2018-04-24 上海眼控科技股份有限公司 A kind of intelligent checking system and method for car repacking exhaust fan
CN107976319B (en) * 2017-10-13 2020-06-16 上海眼控科技股份有限公司 Intelligent detection system and method for car additionally provided with pedal
CN107977604A (en) * 2017-11-06 2018-05-01 浙江工业大学 A kind of hand detection method based on improvement converging channels feature
CN109285327A (en) * 2018-07-05 2019-01-29 惠州市德赛西威汽车电子股份有限公司 A kind of processing method using mobile phone for driver in driving conditions
CN109165607A (en) * 2018-08-29 2019-01-08 浙江工业大学 A kind of hand-held phone detection method of the driver based on deep learning
CN109165607B (en) * 2018-08-29 2021-12-14 浙江工业大学 Driver handheld phone detection method based on deep learning
CN109508661B (en) * 2018-10-31 2021-07-09 上海交通大学 Method for detecting hand lifter based on object detection and posture estimation
CN109508661A (en) * 2018-10-31 2019-03-22 上海交通大学 A kind of person's of raising one's hand detection method based on object detection and Attitude estimation
CN109685026A (en) * 2018-12-28 2019-04-26 南通大学 A kind of driver holds the method for real-time of mobile phone communication
CN109685026B (en) * 2018-12-28 2023-04-18 南通大学 Real-time monitoring method for mobile phone call held by driver
CN110059541A (en) * 2019-02-28 2019-07-26 长江大学 A kind of mobile phone usage behavior detection method and device in driving
CN110309764A (en) * 2019-06-27 2019-10-08 浙江工业大学 A kind of multistage driver based on deep learning makes a phone call behavioral value method
CN111738235A (en) * 2020-08-14 2020-10-02 广州汽车集团股份有限公司 Action detection method and device for automatically opening vehicle door
CN113191244A (en) * 2021-04-25 2021-07-30 上海夏数网络科技有限公司 Method for detecting driver irregular behaviors

Also Published As

Publication number Publication date
CN106203385B (en) 2019-07-09

Similar Documents

Publication Publication Date Title
CN106203385A (en) A kind of driver&#39;s hand-held phone behavioral value method and device
CN107330378A (en) A kind of driving behavior detecting system based on embedded image processing
CN109635656A (en) Vehicle attribute recognition methods, device, equipment and medium neural network based
CN106682641A (en) Pedestrian identification method based on image with FHOG- LBPH feature
CN100463000C (en) Human eye state detection method based on cascade classification and hough circle transform
CN106652465A (en) Method and system for identifying abnormal driving behavior on road
CN109118479A (en) Defects of insulator identification positioning device and method based on capsule network
CN103218605B (en) A kind of fast human-eye positioning method based on integral projection and rim detection
CN104809433B (en) A kind of zebra line detecting method based on maximum stable region and stochastical sampling
CN105046250A (en) Glasses elimination method for face recognition
CN106326860A (en) Gesture recognition method based on vision
CN103186904A (en) Method and device for extracting picture contours
CN105551046B (en) Vehicle face-positioning method and device
CN112381870B (en) Binocular vision-based ship identification and navigational speed measurement system and method
CN105426894B (en) Railway plug pin image detecting method and device
CN104915642B (en) Front vehicles distance measuring method and device
CN106203375A (en) A kind of based on face in facial image with the pupil positioning method of human eye detection
TWI611961B (en) Device, method, and computer-readable medium for analyzing lane line image
CN107180228A (en) A kind of grad enhancement conversion method and system for lane detection
CN106096512A (en) Utilize the detection device and method that vehicles or pedestrians are identified by depth camera
CN105426863A (en) Method and device for detecting lane line
CN104346621A (en) Method and device for creating eye template as well as method and device for detecting eye state
CN108108703A (en) Deceleration strip missing detection method, device and electronic equipment
CN108509900A (en) Road traffic sign detection and recognition methods, system and storage medium
CN109784265A (en) A kind of rail level semantic segmentation method and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
PP01 Preservation of patent right

Effective date of registration: 20220726

Granted publication date: 20190709

PP01 Preservation of patent right