CN109858403A - A kind of method and photographic device that monitoring driver drives using mobile phone - Google Patents
A kind of method and photographic device that monitoring driver drives using mobile phone Download PDFInfo
- Publication number
- CN109858403A CN109858403A CN201910039743.2A CN201910039743A CN109858403A CN 109858403 A CN109858403 A CN 109858403A CN 201910039743 A CN201910039743 A CN 201910039743A CN 109858403 A CN109858403 A CN 109858403A
- Authority
- CN
- China
- Prior art keywords
- gaze
- driver
- pupil
- facial image
- eye socket
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Image Processing (AREA)
- Traffic Control Systems (AREA)
Abstract
The present invention is suitable for field of communication technology, provides a kind of method and photographic device that monitoring driver drives using mobile phone, comprising: when monitoring that the automobile is in driving status, drive the camera lens of the photographic device to first position；The facial image comprising driver's face is obtained by the camera lens, and the facial image is identified, identifies the eye socket and pupil in the facial image；According in the facial image identified eye socket and pupil determine the current direction of gaze of driver, and judge whether the time that driver watches attentively along the direction of gaze reaches the first preset time；If driver reaches the first preset time along the time that the direction of gaze is watched attentively, the camera lens is driven to scan for along the direction of gaze；If searching the image of mobile phone along the direction of gaze, determine that driver checks mobile phone, and issue preset alert.By the above method, prompting can be effectively performed when driver drives using mobile phone.
Description
Technical field
The present invention relates to fields of communication technology more particularly to a kind of monitoring driver to drive to fill using the method and camera shooting of mobile phone
It sets.
Background technique
With popularizing for smart phone, people are more and more stronger to the dependence of mobile phone.It either works, learn, or is raw
It is living, all it be unable to do without mobile phone.Many drivers use mobile phone in driving process, and the case where ignore road ahead, and then cause
Traffic accident.If can remind driver in the case where driver drives using mobile phone, then can substantially reduce such
Traffic accident frequency, and ensure that the personal safety of driver and passenger.
Summary of the invention
In view of this, the embodiment of the invention provides a kind of method and photographic device that monitoring driver drives using mobile phone,
To solve the problems, such as not reminding when driver drives using mobile phone in the prior art.
The embodiment of the present invention in a first aspect, provide it is a kind of monitoring driver drive use mobile phone method, may include:
When monitoring that the automobile is in driving status, drive the camera lens of the photographic device to first position, it is described
First position is the position that the camera lens can take driver；
The facial image comprising driver's face is obtained by the camera lens, and the facial image is identified, is identified
Eye socket and pupil in the facial image out；
According in the facial image identified eye socket and pupil determine the current direction of gaze of driver, and judge driver edge
Time for watching attentively of the direction of gaze whether reach the first preset time；
If driver reaches the first preset time along the time that the direction of gaze is watched attentively, drive the camera lens along institute
Direction of gaze is stated to scan for；
If searching the image of mobile phone along the direction of gaze, determine that driver checks mobile phone, and issue default police
It accuses.
The second aspect of the embodiment of the present invention provides a kind of photographic device, comprising:
Driving unit, for driving the camera lens of the photographic device extremely when monitoring that the automobile is in driving status
First position, the first position are the position that the camera lens can take driver；
Recognition unit, for obtaining the facial image comprising driver's face by the camera lens, and to the facial image
It is identified, identifies the eye socket and pupil in the facial image；
Judging unit, for according in the facial image that identifies eye socket and pupil determine the current side of watching attentively of driver
To, and judge whether the time that driver watches attentively along the direction of gaze reaches the first preset time；
Search unit drives if reaching the first preset time along the time that the direction of gaze is watched attentively for driver
The camera lens is scanned for along the direction of gaze；
Warning unit determines that driver checks mobile phone if the image for searching mobile phone along the direction of gaze,
And issue preset alert.
The third aspect of the embodiment of the present invention, provides a kind of computer readable storage medium, described computer-readable to deposit
Storage media is stored with computer program, and the computer program realizes following steps when being executed by processor:
When monitoring that the automobile is in driving status, drive the camera lens of the photographic device to first position, it is described
First position is the position that the camera lens can take driver；
The facial image comprising driver's face is obtained by the camera lens, and the facial image is identified, is identified
Eye socket and pupil in the facial image out；
According in the facial image identified eye socket and pupil determine the current direction of gaze of driver, and judge driver edge
Time for watching attentively of the direction of gaze whether reach the first preset time；
If driver reaches the first preset time along the time that the direction of gaze is watched attentively, drive the camera lens along institute
Direction of gaze is stated to scan for；
If searching the image of mobile phone along the direction of gaze, determine that driver checks mobile phone, and issue default police
It accuses.
The fourth aspect of the embodiment of the present invention, provides a kind of photographic device, including memory, processor and is stored in
In the memory and the computer program that can run on the processor, when the processor executes the computer program
Realize following steps:
When monitoring that the automobile is in driving status, drive the camera lens of the photographic device to first position, it is described
First position is the position that the camera lens can take driver；
The facial image comprising driver's face is obtained by the camera lens, and the facial image is identified, is identified
Eye socket and pupil in the facial image out；
According in the facial image identified eye socket and pupil determine the current direction of gaze of driver, and judge driver edge
Time for watching attentively of the direction of gaze whether reach the first preset time；
If driver reaches the first preset time along the time that the direction of gaze is watched attentively, drive the camera lens along institute
Direction of gaze is stated to scan for；
If searching the image of mobile phone along the direction of gaze, determine that driver checks mobile phone, and issue default police
It accuses.
Existing beneficial effect is the embodiment of the present invention compared with prior art:
The embodiment of the present invention passes through the camera of driving photographic device, so that camera can be obtained comprising level Four face
Facial image, by being identified to facial image, to judge whether driver uses mobile phone when driving, if it is, hair
Preset alert out can be reminded by the above method when driver drives and plays mobile phone, effectively prevent playing mobile phone because of driver
The traffic accident of generation.In addition, being the eye socket and pupil first identified in facial image to facial image identification, according to eye socket
The direction of gaze of driver is determined with pupil, and can be relatively accurate by the above method along the image of direction of gaze searching handset
Ground identifies whether driver uses mobile phone when driving.
Detailed description of the invention
It to describe the technical solutions in the embodiments of the present invention more clearly, below will be to embodiment or description of the prior art
Needed in attached drawing be briefly described, it should be apparent that, the accompanying drawings in the following description is only of the invention some
Embodiment for those of ordinary skill in the art without any creative labor, can also be according to these
Attached drawing obtains other attached drawings.
Fig. 1 is the implementation process schematic diagram that monitoring driver provided in an embodiment of the present invention drives using the method for mobile phone；
Fig. 2 is the schematic diagram of photographic device provided in an embodiment of the present invention；
Fig. 3 is the schematic diagram for the photographic device that further embodiment of this invention provides.
Specific embodiment
In being described below, for illustration and not for limitation, the tool of such as particular system structure, technology etc is proposed
Body details, to understand thoroughly the embodiment of the present invention.However, it will be clear to one skilled in the art that there is no these specific
The present invention also may be implemented in the other embodiments of details.In other situations, it omits to well-known system, device, electricity
The detailed description of road and method, in case unnecessary details interferes description of the invention.
It should be appreciated that ought use in this specification and in the appended claims, term " includes " instruction is described special
Sign, entirety, step, operation, the presence of element and/or component, but be not precluded one or more of the other feature, entirety, step,
Operation, the presence or addition of element, component and/or its set.
It is also understood that mesh of the term used in this description of the invention merely for the sake of description specific embodiment
And be not intended to limit the present invention.As description of the invention and it is used in the attached claims, unless on
Other situations are hereafter clearly indicated, otherwise " one " of singular, "one" and "the" are intended to include plural form.
It will be further appreciated that the term "and/or" used in description of the invention and the appended claims is
Refer to any combination and all possible combinations of one or more of associated item listed, and including these combinations.
As used in this specification and in the appended claims, term " if " can be according to context quilt
Be construed to " when ... " or " once " or " in response to determination " or " in response to detecting ".Similarly, phrase " if it is determined that " or
" if detecting [described condition or event] " can be interpreted to mean according to context " once it is determined that " or " in response to true
It is fixed " or " once detecting [described condition or event] " or " in response to detecting [described condition or event] ".
In order to illustrate technical solutions according to the invention, the following is a description of specific embodiments.
Fig. 1 is the implementation process schematic diagram that monitoring driver provided in an embodiment of the present invention drives using the method for mobile phone, such as
Shown in figure, the method may include following steps:
Step S101 drives the camera lens of the photographic device to first when monitoring that the automobile is in driving status
Position, the first position are the position that the camera lens can take driver.
In practical applications, photographic device can be communicated to connect with the controller of automobile, in this way, photographic device can obtain
The speed of automobile is got, for example, photographic device can obtain the automobile shown in automobile instrument panel by the controller of automobile
Present speed.
In practical applications, photographic device can be searched in real time using face as target, for example, when getting on the bus from driver,
Photographic device starts to scan for, and the rotational angle with the variation of face location, to guarantee to capture complete
, clearly facial image.Correspondingly, the first position in the present invention be photographic device can take it is complete, clear
Facial image when corresponding position.
Step S102 obtains the facial image comprising driver's face by the camera lens, and carries out to the facial image
Identification, identifies the eye socket and pupil in the facial image.
Step S103, according in the facial image identified eye socket and pupil determine the current direction of gaze of driver, and
Judge whether the time that driver watches attentively along the direction of gaze reaches the first preset time.
First preset time can be it is preset, which determine in the present invention monitor driver drive when check mobile phone
The accuracy rate of method.First preset time can be obtained according to the statistics of traffic accident, for example, not watching front attentively due to driver
Caused by a large amount of traffic accidents, statistics driver does not watch the average time in front attentively.It here is only to determine the first preset time
Example, the setting method of the first preset time is not specifically limited, as long as can ensure in the present invention monitor driver open
The accuracy rate of the method for mobile phone is checked when vehicle.
In one embodiment, described in step S103 according in the facial image that identifies eye socket and pupil determine department
The current direction of gaze of machine, comprising:
S1031 determines the first direction of gaze according to the area of eye socket in the facial image.
First direction of gaze be longitudinal direction, i.e., upwards, head-up or downwards.
In one embodiment, the area according to eye socket in the facial image determines the first direction of gaze, comprising:
The area for calculating face in the facial image obtains the first area, and calculates the face of eye socket in the facial image
Product obtains second area.
Judge the ratio of the second area and first area whether less than the first preset threshold.
If the ratio of the second area and first area less than the first preset threshold, determines the first direction of gaze
It is downward.
If the ratio of the second area and first area is equal to or more than the first preset threshold, the people is judged
Whether pupil is to ratio of the distance at a distance from pupil to inferior orbit of superior orbit less than the second preset threshold in face image.
If pupil is to ratio of the distance at a distance from pupil to inferior orbit of superior orbit less than second in the facial image
Preset threshold then determines that the first direction of gaze is upward.
If ratio of the distance at a distance from pupil to inferior orbit of pupil to superior orbit is equal to second in the facial image
Preset threshold then determines the first direction of gaze for head-up.
In practical applications, the facial image of multiple drivers can be captured within a period of time after driver starts automobile,
In general this period, driver can face road ahead situation, according to the facial image captured in this period, calculate separately the
The ratio of two areas and the first area determines the first preset threshold according to calculated each ratio.For example, these can be taken
80% of maximum value in ratio is used as the first preset threshold, and the average value of these ratios can also be taken as the first default threshold
Value.
S1032 determines the second direction of gaze according to the relative position of pupil and eye socket in the facial image.
Second direction of gaze be transverse direction, such as to the left, head-up or to the right.
In one embodiment, described to determine that second watches attentively according to the relative position of pupil and eye socket in the facial image
Direction, comprising:
Judge pupil in the facial image to eye socket left edge ratio of the distance at a distance from pupil to eye socket right hand edge
Whether value is less than third predetermined threshold value.
If distance ratio with pupil to eye socket right hand edge at a distance from of the pupil to eye socket left edge in the facial image
Less than third predetermined threshold value, then determine that the second direction of gaze is to the left.
If distance ratio with pupil to eye socket right hand edge at a distance from of the pupil to eye socket left edge in the facial image
Greater than third predetermined threshold value and less than the 4th preset threshold, then determine the second direction of gaze for head-up.
If distance ratio with pupil to eye socket right hand edge at a distance from of the pupil to eye socket left edge in the facial image
Greater than the 4th preset threshold, then determine that the second direction of gaze is to the right.
S1033 determines the current direction of gaze of driver according to first direction of gaze and second direction of gaze.
The longitudinal direction that first direction of gaze determines, the second direction of gaze is it is confirmed that transverse direction, the first direction of gaze
It is the direction of gaze that can determine driver in conjunction with the second direction of gaze.Illustratively, if the first direction of gaze be it is upward, second watches attentively
Direction is that the left, then direction of gaze is upper left side；If the first direction of gaze be it is upward, the second direction of gaze be head-up, then watch attentively
Direction is surface；If the first direction of gaze is head-up, the second direction of gaze is head-up, then direction of gaze is head-up.Successively class
It pushes away, so that it may the direction of gaze of driver is determined according to the first direction of gaze and the second direction of gaze.
Step S104, if driver reaches the first preset time along the time that the direction of gaze is watched attentively, described in driving
Camera lens is scanned for along the direction of gaze.
Since photographic device is the direction of gaze for determining driver according to the facial image of shooting, so what is determined watches attentively
Direction is in fact with the true direction of gaze of driver or so on the contrary, for example, the actual direction of gaze of driver is lower right, from face figure
The direction of gaze of the driver determined as in is lower left.In other words, photographic device determines direction of gaze and photographic device
Camera lens direction it is consistent, then need to only be scanned for according to determining direction of gaze when scanning for.
Illustratively, it is assumed that determining direction of gaze is lower left, then camera lens is driven to rotate along the direction of lower left；It is false
If the direction of gaze determined is upper right side, then camera lens is driven to rotate along the direction in upper right side；Assuming that the direction of gaze determined is
Head-up, then drive camera lens to turn 180 degree.
The process of search can be camera lens and shoot in rotation, each image then shot in rotary course respectively
It is identified, is judged in image with the presence or absence of mobile phone.
Step S105 determines that driver checks mobile phone, concurrently if searching the image of mobile phone along the direction of gaze
Preset alert out.
In practical applications, after the direction of gaze for getting driver, it is also necessary to which whether the direction of gaze for judging driver is flat
Depending on if not head-up, illustrates that driver does not face road ahead, at this time along the image of direction of gaze searching handset.
If driver stares at a direction of gaze (non-flat apparent direction) for a long time, and searches mobile phone along the direction of gaze
Image, then illustrate that driver checks always mobile phone, at this moment issue preset alert.
But if the direction of gaze of driver is head-up, or if do not searched for along direction of gaze (non-head-up) in one's hands
Machine illustrates that driver does not check mobile phone, it is possible that driver is conversing, call also will affect driver to strain responses,
There can be the risk that traffic accident occurs, so needing to be determined the case where driver is driven and conversed.Embodiment specific as follows.
In one embodiment, after driving the camera lens to scan for along the direction of gaze, further includes:
If not searching the image of mobile phone along the direction of gaze, shoot a driver's every the second preset time
Face-image, and identify in the face-image mouth to folding condition.
When the quantity of the face-image of shooting reaches preset quantity, the folding condition of mouth in all face-images is counted
Number of transitions.
If the number of transitions is greater than or equal to preset times, determine that driver is conversing, and opens road auxiliary prison
Brake.
In practical applications, a face-image is shot every the second preset time, when the quantity of shooting reaches present count
When amount, illustrate also to have reached certain monitoring time；If in this section of monitoring time, the change of the folding condition of driver's mouth
Number is changed greater than preset times, then determines that driver is conversing.
Wherein, the transformation of folding condition refers to, illustratively, it is assumed that driver's mouth is to open shape in first face-image
State, driver's mouth is closed state in second face-image, then folding condition transformation is primary；Assuming that in third face-image
Driver's mouth is closed state, then folding condition does not convert；Assuming that driver's mouth is to open shape in the 4th face-image
State, then folding condition transformation is primary.
If driver is in state of speaking, the frequency of mouth folding transformation can be higher, it is possible to by the second preset time
It is set as the shorter time, can accurately determines the conversion frequency of driver's mouth folding in this way.
In one embodiment, the unlatching road auxiliary monitoring function, comprising:
Drive the camera lens of the photographic device to reaching the second position, and to being monitored in front of the automobile, described
Two positions are that the camera lens can be to the position shot in front of the automobile.
If monitoring occur barrier in front of the automobile, default alarm is issued, current speed is denoted as initially
Speed, and speed is monitored.
If it is described initial to monitor that current speed is greater than or equal to issuing in the third preset time after default alarm
Speed, then send signal to reduce the speed to the controller of the automobile, and the signal to reduce the speed is used to indicate the controller pair of the automobile
The automobile is braked.
In practical applications, after issuing default alarm, driver may take brake measure, and at this moment speed can decline.If
Speed does not decline, i.e., speed be more than or less than initial speed, then illustrate driver not to be noted preset alarm, and not to be noted before
The barrier of side, road auxiliary monitoring function can replace driver to issue signal to reduce the speed (camera shooting dress to the controller of automobile at this time
It sets and is communicated to connect with automobile controller).The safety of driving can be greatly increased by opening road auxiliary monitoring function.
The embodiment of the present invention passes through the camera of driving photographic device, so that camera can be obtained comprising level Four face
Facial image, by being identified to facial image, to judge whether driver uses mobile phone when driving, if it is, hair
Preset alert out can be reminded by the above method when driver drives and plays mobile phone, effectively prevent playing mobile phone because of driver
The traffic accident of generation.In addition, being the eye socket and pupil first identified in facial image to facial image identification, according to eye socket
The direction of gaze of driver is determined with pupil, and can be relatively accurate by the above method along the image of direction of gaze searching handset
Ground identifies whether driver uses mobile phone when driving.
It should be understood that the size of the serial number of each step is not meant that the order of the execution order in above-described embodiment, each process
Execution sequence should be determined by its function and internal logic, the implementation process without coping with the embodiment of the present invention constitutes any limit
It is fixed.
Fig. 2 is the schematic diagram of photographic device provided in an embodiment of the present invention, for ease of description, is only shown and present invention reality
Apply the relevant part of example.
Photographic device shown in Fig. 2 can be the software unit being built in existing terminal device, hardware cell or soft
Harden the unit closed, can also be used as independent pendant and is integrated into the terminal device, is also used as independent terminal and sets
It is standby to exist.
The photographic device 2 includes:
Driving unit 21, for driving the camera lens of the photographic device when monitoring that the automobile is in driving status
To first position, the first position is the position that the camera lens can take driver.
Recognition unit 22, for obtaining the facial image comprising driver's face by the camera lens, and to the face figure
As being identified, the eye socket and pupil in the facial image are identified.
Judging unit 23, for according in the facial image that identifies eye socket and pupil determine the current side of watching attentively of driver
To, and judge whether the time that driver watches attentively along the direction of gaze reaches the first preset time.
Search unit 24 drives if reaching the first preset time along the time that the direction of gaze is watched attentively for driver
The camera lens is moved to scan for along the direction of gaze.
Warning unit 25 determines that driver checks hand if the image for searching mobile phone along the direction of gaze
Machine, and issue preset alert.
Optionally, the judging unit 23 includes:
First determining module, for determining the first direction of gaze according to the area of eye socket in the facial image.
Second determining module, for determining second side of watching attentively according to the relative position of pupil and eye socket in the facial image
To.
Third determining module, for determining that driver is current according to first direction of gaze and second direction of gaze
Direction of gaze.
Optionally, first determining module includes:
Computational submodule, the area for calculating face in the facial image obtains the first area, and calculates the people
The area of eye socket obtains second area in face image.
Whether the first judging submodule, the ratio for judging the second area and first area are pre- less than first
If threshold value.
First decision sub-module, if for the ratio of the second area and first area less than the first default threshold
Value, then determine that the first direction of gaze is downward.
Second judgment module, if it is default to be equal to or more than first for the ratio of the second area and first area
Threshold value, then judge whether pupil in the facial image is less than to ratio of the distance at a distance from pupil to inferior orbit of superior orbit
Second preset threshold.
Second decision sub-module, if the distance and pupil for pupil in the facial image to superior orbit arrive inferior orbit
The ratio of distance then determines that the first direction of gaze is upward less than the second preset threshold.
Third decision sub-module, if the distance and pupil for pupil in the facial image to superior orbit arrive inferior orbit
The ratio of distance is equal to the second preset threshold, then determines the first direction of gaze for head-up.
Optionally, second determining module includes:
Third judging submodule, the distance and pupil for judging pupil in the facial image to eye socket left edge are to eye
Whether the ratio of the distance of socket of the eye right hand edge is less than third predetermined threshold value.
4th decision sub-module, if distance and pupil to eye socket for pupil in the facial image to eye socket left edge
The ratio of the distance of right hand edge is less than third predetermined threshold value, then determines that the second direction of gaze is to the left.
5th decision sub-module, if distance and pupil to eye socket for pupil in the facial image to eye socket left edge
The ratio of the distance of right hand edge is greater than third predetermined threshold value and less than the 4th preset threshold, then determines that the second direction of gaze is flat
Depending on.
6th decision sub-module, if distance and pupil to eye socket for pupil in the facial image to eye socket left edge
The ratio of the distance of right hand edge is greater than the 4th preset threshold, then determines that the second direction of gaze is to the right.
Optionally, the photographic device 2 further include:
Shooting unit, for after driving the camera lens to scan for along the direction of gaze, if along the note
Apparent direction does not search the image of mobile phone, then the face-image of a driver is shot every the second preset time, and described in identification
Mouth is to folding condition in face-image.
Statistic unit, for counting in all face-images when the quantity of the face-image of shooting reaches preset quantity
The number of transitions of the folding condition of mouth.
Opening unit determines that driver is conversing, and open if being greater than or equal to preset times for the number of transitions
Open road auxiliary monitoring function.
Optionally, the opening unit includes:
Drive module, for driving the camera lens of the photographic device to reaching the second position, and to the front of the automobile into
Row monitoring, the second position are that the camera lens can be to the position shot in front of the automobile.
Monitoring modular will be current if issuing default alarm for monitoring occur barrier in front of the automobile
Speed is denoted as initial speed, and is monitored to speed.
Reduction of speed module, if monitoring that current speed is greater than for issuing in the third preset time after default alarm
Or be equal to the initial speed, then signal to reduce the speed is sent to the controller of the automobile, the signal to reduce the speed is used to indicate described
The controller of automobile brakes the automobile.
It is apparent to those skilled in the art that for convenience of description and succinctly, only with above-mentioned each function
Can unit, module division progress for example, in practical application, can according to need and by above-mentioned function distribution by different
Functional unit, module are completed, i.e., the internal structure of described device is divided into different functional unit or module, more than completing
The all or part of function of description.Each functional unit in embodiment, module can integrate in one processing unit, can also
To be that each unit physically exists alone, can also be integrated in one unit with two or more units, it is above-mentioned integrated
Unit both can take the form of hardware realization, can also realize in the form of software functional units.In addition, each function list
Member, the specific name of module are also only for convenience of distinguishing each other, the protection scope being not intended to restrict the invention.Above system
The specific work process of middle unit, module, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
Fig. 3 is the schematic diagram of photographic device provided in an embodiment of the present invention.As shown in figure 3, the photographic device 3 of the embodiment
Include: processor 30, memory 31 and is stored in the calculating that can be run in the memory 31 and on the processor 30
Machine program 32.The processor 30 realizes that above-mentioned each monitoring driver drives using mobile phone when executing the computer program 32
Step in embodiment of the method, such as step S101 to S105 shown in FIG. 1.Alternatively, the processor 30 executes the calculating
The function of each module/unit in above-mentioned each Installation practice, such as the function of module 21 to 25 shown in Fig. 2 are realized when machine program 32
Energy.
Illustratively, the computer program 32 can be divided into one or more module/units, it is one or
Multiple module/units are stored in the memory 31, and are executed by the processor 30, to complete the present invention.Described one
A or multiple module/units can be the series of computation machine program instruction section that can complete specific function, which is used for
Implementation procedure of the computer program 32 in the photographic device 3 is described.For example, the computer program 32 can be divided
It is cut into driving unit, recognition unit, judging unit, search unit, warning unit, each unit concrete function is as follows:
Driving unit, for driving the camera lens of the photographic device extremely when monitoring that the automobile is in driving status
First position, the first position are the position that the camera lens can take driver.
Recognition unit, for obtaining the facial image comprising driver's face by the camera lens, and to the facial image
It is identified, identifies the eye socket and pupil in the facial image.
Judging unit, for according in the facial image that identifies eye socket and pupil determine the current side of watching attentively of driver
To, and judge whether the time that driver watches attentively along the direction of gaze reaches the first preset time.
Search unit drives if reaching the first preset time along the time that the direction of gaze is watched attentively for driver
The camera lens is scanned for along the direction of gaze.
Warning unit determines that driver checks mobile phone if the image for searching mobile phone along the direction of gaze,
And issue preset alert.
Optionally, the judging unit includes:
First determining module, for determining the first direction of gaze according to the area of eye socket in the facial image.
Second determining module, for determining second side of watching attentively according to the relative position of pupil and eye socket in the facial image
To.
Third determining module, for determining that driver is current according to first direction of gaze and second direction of gaze
Direction of gaze.
Optionally, first determining module includes:
Computational submodule, the area for calculating face in the facial image obtains the first area, and calculates the people
The area of eye socket obtains second area in face image.
Whether the first judging submodule, the ratio for judging the second area and first area are pre- less than first
If threshold value.
First decision sub-module, if for the ratio of the second area and first area less than the first default threshold
Value, then determine that the first direction of gaze is downward.
Second judgment module, if it is default to be equal to or more than first for the ratio of the second area and first area
Threshold value, then judge whether pupil in the facial image is less than to ratio of the distance at a distance from pupil to inferior orbit of superior orbit
Second preset threshold.
Second decision sub-module, if the distance and pupil for pupil in the facial image to superior orbit arrive inferior orbit
The ratio of distance then determines that the first direction of gaze is upward less than the second preset threshold.
Third decision sub-module, if the distance and pupil for pupil in the facial image to superior orbit arrive inferior orbit
The ratio of distance is equal to the second preset threshold, then determines the first direction of gaze for head-up.
Optionally, second determining module includes:
Third judging submodule, the distance and pupil for judging pupil in the facial image to eye socket left edge are to eye
Whether the ratio of the distance of socket of the eye right hand edge is less than third predetermined threshold value.
4th decision sub-module, if distance and pupil to eye socket for pupil in the facial image to eye socket left edge
The ratio of the distance of right hand edge is less than third predetermined threshold value, then determines that the second direction of gaze is to the left.
5th decision sub-module, if distance and pupil to eye socket for pupil in the facial image to eye socket left edge
The ratio of the distance of right hand edge is greater than third predetermined threshold value and less than the 4th preset threshold, then determines that the second direction of gaze is flat
Depending on.
6th decision sub-module, if distance and pupil to eye socket for pupil in the facial image to eye socket left edge
The ratio of the distance of right hand edge is greater than the 4th preset threshold, then determines that the second direction of gaze is to the right.
Optionally, the computer readable storage medium further include:
Shooting unit, for after driving the camera lens to scan for along the direction of gaze, if along the note
Apparent direction does not search the image of mobile phone, then the face-image of a driver is shot every the second preset time, and described in identification
Mouth is to folding condition in face-image.
Statistic unit, for counting in all face-images when the quantity of the face-image of shooting reaches preset quantity
The number of transitions of the folding condition of mouth.
Opening unit determines that driver is conversing, and open if being greater than or equal to preset times for the number of transitions
Open road auxiliary monitoring function.
Optionally, the opening unit includes:
Drive module, for driving the camera lens of the photographic device to reaching the second position, and to the front of the automobile into
Row monitoring, the second position are that the camera lens can be to the position shot in front of the automobile.
Monitoring modular will be current if issuing default alarm for monitoring occur barrier in front of the automobile
Speed is denoted as initial speed, and is monitored to speed.
Reduction of speed module, if monitoring that current speed is greater than for issuing in the third preset time after default alarm
Or be equal to the initial speed, then signal to reduce the speed is sent to the controller of the automobile, the signal to reduce the speed is used to indicate described
The controller of automobile brakes the automobile.
The photographic device 3 can be the calculating such as desktop PC, notebook, palm PC and cloud server and set
It is standby.The photographic device may include, but be not limited only to, processor 30, memory 31.It will be understood by those skilled in the art that Fig. 3
The only example of photographic device 3 does not constitute the restriction to photographic device 3, may include than illustrating more or fewer portions
Part perhaps combines certain components or different components, such as the photographic device can also include input-output equipment, net
Network access device, bus etc..
Alleged processor 30 can be central processing unit (Central Processing Unit, CPU), can also be
Other general processors, digital signal processor (Digital Signal Processor, DSP), specific integrated circuit
(Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field-
Programmable Gate Array, FPGA) either other programmable logic device, discrete gate or transistor logic,
Discrete hardware components etc..General processor can be microprocessor or the processor is also possible to any conventional processor
Deng.
The memory 31 can be the internal storage unit of the photographic device 3, such as the hard disk or interior of photographic device 3
It deposits.The memory 31 is also possible to the External memory equipment of the photographic device 3, such as be equipped on the photographic device 3
Plug-in type hard disk, intelligent memory card (Smart Media Card, SMC), secure digital (Secure Digital, SD) card dodge
Deposit card (Flash Card) etc..Further, the memory 31 can also both include the storage inside list of the photographic device 3
Member also includes External memory equipment.The memory 31 is for storing needed for the computer program and the photographic device
Other programs and data.The memory 31 can be also used for temporarily storing the data that has exported or will export.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, is not described in detail or remembers in some embodiment
The part of load may refer to the associated description of other embodiments.
Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure
Member and algorithm steps can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually
It is implemented in hardware or software, the specific application and design constraint depending on technical solution.Professional technician
Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed
The scope of the present invention.
In embodiment provided by the present invention, it should be understood that disclosed device/terminal device and method, it can be with
It realizes by another way.For example, device described above/terminal device embodiment is only schematical, for example, institute
The division of module or unit is stated, only a kind of logical function partition, there may be another division manner in actual implementation, such as
Multiple units or components can be combined or can be integrated into another system, or some features can be ignored or not executed.Separately
A bit, shown or discussed mutual coupling or direct-coupling or communication connection can be through some interfaces, device
Or the INDIRECT COUPLING or communication connection of unit, it can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list
Member both can take the form of hardware realization, can also realize in the form of software functional units.
If the integrated module/unit be realized in the form of SFU software functional unit and as independent product sale or
In use, can store in a computer readable storage medium.Based on this understanding, the present invention realizes above-mentioned implementation
All or part of the process in example method, can also instruct relevant hardware to complete, the meter by computer program
Calculation machine program can be stored in a computer readable storage medium, the computer program when being executed by processor, it can be achieved that on
The step of stating each embodiment of the method.Wherein, the computer program includes computer program code, the computer program generation
Code can be source code form, object identification code form, executable file or certain intermediate forms etc..The computer-readable medium
It may include: any entity or device, recording medium, USB flash disk, mobile hard disk, magnetic that can carry the computer program code
Dish, CD, computer storage, read-only memory (ROM, Read-Only Memory), random access memory (RAM,
Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium etc..It should be noted that described
The content that computer-readable medium includes can carry out increasing appropriate according to the requirement made laws in jurisdiction with patent practice
Subtract, such as in certain jurisdictions, according to legislation and patent practice, computer-readable medium do not include be electric carrier signal and
Telecommunication signal.
Embodiment described above is merely illustrative of the technical solution of the present invention, rather than its limitations；Although referring to aforementioned reality
Applying example, invention is explained in detail, those skilled in the art should understand that: it still can be to aforementioned each
Technical solution documented by embodiment is modified or equivalent replacement of some of the technical features；And these are modified
Or replacement, the spirit and scope for technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution should all
It is included within protection scope of the present invention.
Claims (10)
- A kind of method for using mobile phone 1. monitoring driver drives, which is characterized in that be applied to photographic device, which comprisesWhen monitoring that the automobile is in driving status, drive the camera lens of the photographic device to first position, described first Position is the position that the camera lens can take driver；The facial image comprising driver's face is obtained by the camera lens, and the facial image is identified, identifies institute State the eye socket and pupil in facial image；According in the facial image identified eye socket and pupil determine the current direction of gaze of driver, and judge driver along institute State whether the time that direction of gaze is watched attentively reaches the first preset time；If driver reaches the first preset time along the time that the direction of gaze is watched attentively, drive the camera lens along the note Apparent direction scans for；If searching the image of mobile phone along the direction of gaze, determine that driver checks mobile phone, and issue preset alert.
- 2. the method that monitoring driver driving uses mobile phone as described in claim 1, which is characterized in that the basis identified Eye socket and pupil in facial image determine the current direction of gaze of driver, comprising:The first direction of gaze is determined according to the area of eye socket in the facial image；The second direction of gaze is determined according to the relative position of pupil and eye socket in the facial image；The current direction of gaze of driver is determined according to first direction of gaze and second direction of gaze.
- 3. the method that monitoring driver driving uses mobile phone as claimed in claim 2, which is characterized in that described according to the face The area of eye socket determines the first direction of gaze in image, comprising:The area for calculating face in the facial image obtains the first area, and the area for calculating eye socket in the facial image obtains To second area；Judge the ratio of the second area and first area whether less than the first preset threshold；If the ratio of the second area and first area less than the first preset threshold, determine the first direction of gaze for Under；If the ratio of the second area and first area is equal to or more than the first preset threshold, the face figure is judged Whether pupil is to ratio of the distance at a distance from pupil to inferior orbit of superior orbit less than the second preset threshold as in；If ratio of the distance at a distance from pupil to inferior orbit of pupil to superior orbit is default less than second in the facial image Threshold value then determines that the first direction of gaze is upward；If it is default to be equal to second for ratio of the distance at a distance from pupil to inferior orbit of pupil to superior orbit in the facial image Threshold value then determines the first direction of gaze for head-up.
- 4. the method that monitoring driver driving uses mobile phone as claimed in claim 2, which is characterized in that described according to the face The relative position of pupil and eye socket determines the second direction of gaze in image, comprising:Judge pupil in the facial image is to ratio of the distance at a distance from pupil to eye socket right hand edge of eye socket left edge It is no to be less than third predetermined threshold value；If ratio of the distance at a distance from pupil to eye socket right hand edge of pupil to eye socket left edge is less than in the facial image Third predetermined threshold value then determines that the second direction of gaze is to the left；If ratio of the distance at a distance from pupil to eye socket right hand edge of pupil to eye socket left edge is greater than in the facial image Third predetermined threshold value and less than the 4th preset threshold then determines the second direction of gaze for head-up；If ratio of the distance at a distance from pupil to eye socket right hand edge of pupil to eye socket left edge is greater than in the facial image 4th preset threshold then determines that the second direction of gaze is to the right.
- 5. the method that monitoring driver driving uses mobile phone as described in claim 1, which is characterized in that driving the camera lens edge After the direction of gaze scans for, further includes:If not searching the image of mobile phone along the direction of gaze, the face of a driver is shot every the second preset time Image, and identify in the face-image mouth to folding condition；When the quantity of the face-image of shooting reaches preset quantity, the change of the folding condition of mouth in all face-images is counted Change number；If the number of transitions is greater than or equal to preset times, determine that driver is conversing, and open road auxiliary monitoring function Energy.
- 6. the method that monitoring driver driving uses mobile phone as claimed in claim 5, which is characterized in that the unlatching road auxiliary Monitoring function, comprising:Drive the camera lens of the photographic device to reaching the second position, and to being monitored in front of the automobile, the second Being set to the camera lens can be to the position shot in front of the automobile；If monitoring occur barrier in front of the automobile, default alarm is issued, current speed is denoted as initial speed, And speed is monitored；If monitoring that current speed is greater than or equal to the initial vehicle issuing in the third preset time after default alarm Speed, then send signal to reduce the speed to the controller of the automobile, and the signal to reduce the speed is used to indicate the controller of the automobile to institute Automobile is stated to be braked.
- 7. a kind of photographic device characterized by comprisingDriving unit, for driving the camera lens of the photographic device to first when monitoring that the automobile is in driving status Position, the first position are the position that the camera lens can take driver；Recognition unit for obtaining the facial image comprising driver's face by the camera lens, and carries out the facial image Identification, identifies the eye socket and pupil in the facial image；Judging unit, for according in the facial image that identifies eye socket and pupil determine the current direction of gaze of driver, and Judge whether the time that driver watches attentively along the direction of gaze reaches the first preset time；Search unit, if reaching the first preset time along the time that the direction of gaze is watched attentively for driver, described in driving Camera lens is scanned for along the direction of gaze；Warning unit determines that driver checks mobile phone, concurrently if the image for searching mobile phone along the direction of gaze Preset alert out.
- 8. a kind of computer readable storage medium, the computer-readable recording medium storage has computer program, and feature exists In realization monitors driver as described in any one of claims 1 to 3 and drives to use when the computer program is executed by processor The step of method of mobile phone.
- 9. a kind of photographic device, including memory, processor and storage are in the memory and can be on the processor The computer program of operation, which is characterized in that the processor realizes following steps when executing the computer program:When monitoring that the automobile is in driving status, drive the camera lens of the photographic device to first position, described first Position is the position that the camera lens can take driver；The facial image comprising driver's face is obtained by the camera lens, and the facial image is identified, identifies institute State the eye socket and pupil in facial image；According in the facial image identified eye socket and pupil determine the current direction of gaze of driver, and judge driver along institute State whether the time that direction of gaze is watched attentively reaches the first preset time；If driver reaches the first preset time along the time that the direction of gaze is watched attentively, drive the camera lens along the note Apparent direction scans for；If searching the image of mobile phone along the direction of gaze, determine that driver checks mobile phone, and issue preset alert.
- 10. photographic device as claimed in claim 9, which is characterized in that the eye socket in facial image that the basis identifies The current direction of gaze of driver is determined with pupil, comprising:The first direction of gaze is determined according to the area of eye socket in the facial image；The second direction of gaze is determined according to the relative position of pupil and eye socket in the facial image；The current direction of gaze of driver is determined according to first direction of gaze and second direction of gaze.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910039743.2A CN109858403A (en) | 2019-01-16 | 2019-01-16 | A kind of method and photographic device that monitoring driver drives using mobile phone |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910039743.2A CN109858403A (en) | 2019-01-16 | 2019-01-16 | A kind of method and photographic device that monitoring driver drives using mobile phone |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109858403A true CN109858403A (en) | 2019-06-07 |
Family
ID=66894915
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910039743.2A Pending CN109858403A (en) | 2019-01-16 | 2019-01-16 | A kind of method and photographic device that monitoring driver drives using mobile phone |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109858403A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110287906A (en) * | 2019-06-26 | 2019-09-27 | 四川长虹电器股份有限公司 | Method and system based on image/video detection people " playing mobile phone " |
| CN110929286A (en) * | 2019-11-20 | 2020-03-27 | 四川虹美智能科技有限公司 | Method for dynamically detecting operation authorization and intelligent equipment |
| CN113392706A (en) * | 2021-05-13 | 2021-09-14 | 上海湃道智能科技有限公司 | Device and method for detecting smoking and using mobile phone behaviors |
| CN113506436A (en) * | 2021-05-19 | 2021-10-15 | 海南师范大学 | System and method for monitoring and detecting whether driver plays mobile phone in vehicle |
| CN115577140A (en) * | 2022-09-16 | 2023-01-06 | 广州汽车集团股份有限公司 | Video recommendation method and device, vehicle and storage medium |
-
2019
- 2019-01-16 CN CN201910039743.2A patent/CN109858403A/en active Pending
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110287906A (en) * | 2019-06-26 | 2019-09-27 | 四川长虹电器股份有限公司 | Method and system based on image/video detection people " playing mobile phone " |
| CN110929286A (en) * | 2019-11-20 | 2020-03-27 | 四川虹美智能科技有限公司 | Method for dynamically detecting operation authorization and intelligent equipment |
| CN113392706A (en) * | 2021-05-13 | 2021-09-14 | 上海湃道智能科技有限公司 | Device and method for detecting smoking and using mobile phone behaviors |
| CN113506436A (en) * | 2021-05-19 | 2021-10-15 | 海南师范大学 | System and method for monitoring and detecting whether driver plays mobile phone in vehicle |
| CN115577140A (en) * | 2022-09-16 | 2023-01-06 | 广州汽车集团股份有限公司 | Video recommendation method and device, vehicle and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109858403A (en) | A kind of method and photographic device that monitoring driver drives using mobile phone | |
| Das et al. | On performance evaluation of driver hand detection algorithms: Challenges, dataset, and metrics | |
| CN105512624B (en) | A kind of smiling face's recognition methods of facial image and its device | |
| CN110858295B (en) | Traffic police gesture recognition method and device, vehicle control unit and storage medium | |
| CN111274881A (en) | Driving safety monitoring method and device, computer equipment and storage medium | |
| CN106682602B (en) | Driver behavior identification method and terminal | |
| WO2020107833A1 (en) | Skeleton-based behavior detection method, terminal device, and computer storage medium | |
| CN111310562B (en) | Vehicle driving risk management and control method based on artificial intelligence and related equipment thereof | |
| CN109670441A (en) | A kind of realization safety cap wearing knows method for distinguishing, system, terminal and computer readable storage medium | |
| CN109243181A (en) | Traffic accident method for early warning, device, terminal device and storage medium | |
| CN109739223A (en) | Robot obstacle-avoiding control method, device and terminal device | |
| US20220277558A1 (en) | Cascaded Neural Network-Based Attention Detection Method, Computer Device, And Computer-Readable Storage Medium | |
| CN110781914A (en) | Equipment fault monitoring processing method, device, equipment and storage medium | |
| TW201928846A (en) | Method and device for processing vehicle loss assessment data and processing device | |
| CN109311425A (en) | A kind of alarming method by monitoring of vehicle blind zone, device, equipment and storage medium | |
| CN110103820A (en) | The method, apparatus and terminal device of the abnormal behaviour of personnel in a kind of detection vehicle | |
| CN110473418A (en) | Dangerous Area recognition methods, device, server and storage medium | |
| CN109732594A (en) | A kind of robot control method, system and robot | |
| CN111488803A (en) | Airport target behavior understanding system integrating target detection and target tracking | |
| US20210155250A1 (en) | Human-computer interaction method, vehicle-mounted device and readable storage medium | |
| CN110277833A (en) | The method and terminal device of substation's pressing plate state recognition | |
| CN106503275A (en) | The tone color collocation method of chat robots and device | |
| CN109214324A (en) | Most face image output method and output system based on polyphaser array | |
| WO2018103024A1 (en) | Intelligent guidance method and apparatus for visually handicapped person | |
| CN115423735A (en) | Passenger flow volume statistical method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |