CN109543491A - A kind of fatigue driving monitoring device and method - Google Patents
A kind of fatigue driving monitoring device and method Download PDFInfo
- Publication number
- CN109543491A CN109543491A CN201710860426.8A CN201710860426A CN109543491A CN 109543491 A CN109543491 A CN 109543491A CN 201710860426 A CN201710860426 A CN 201710860426A CN 109543491 A CN109543491 A CN 109543491A
- Authority
- CN
- China
- Prior art keywords
- image
- camera
- pixel
- human region
- driver
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/12—Details of acquisition arrangements; Constructional details thereof
- G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
- G06V10/141—Control of illumination
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02B—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
- Y02B20/00—Energy efficient lighting technologies, e.g. halogen lamps or gas discharge lamps
- Y02B20/40—Control techniques providing energy savings, e.g. smart controller or presence detection
Abstract
The embodiment of the present invention provides a kind of fatigue driving monitoring device and method, is related to mobile unit technical field, for make driver be located at the acquisition of fatigue driving monitoring device image predeterminated position.The device includes: processing module, camera, light compensating lamp and drive module；Light compensating lamp under the control of processing module for opening or closing；Camera is used under the control of processing module, and when light compensating lamp is closed, shooting driver obtains the first image, and when light compensating lamp is opened, shooting driver obtains the second image；Wherein, the time interval for obtaining the first image and the second image is less than threshold length of time；Processing module is used to obtain the human region in the image of camera shooting according to the first image and the second image, and judges whether human region is in predeterminated position；If it is not, then controlling drive module drives camera adjustment shooting angle.The embodiment of the present invention is monitored for fatigue driving.
Description
Technical field
The present invention relates to mobile unit technical field more particularly to a kind of fatigue driving monitoring devices and method.
Background technique
Fatigue driving refers to that driver after long-duration driving, generates the imbalance of physiological function and mental function, objective
On there is the phenomenon that driving efficiency decline.The attention of driver, feeling, consciousness, thinking, judgement, will, decision when fatigue driving
It will receive different degrees of influence with all various aspects such as movements, may result in the sleepy drowsiness of driver's appearance, weakness of limbs,
Absent minded, judgement decline or even absent-minded or appearance movement are delayed or too early, operate pause or correction time
Improper equal insecurity factors, easily generation road traffic accident.Therefore, in driver tired driving timely to driver into
It is very necessary that row, which is reminded,.
Currently used fatigue driving monitoring method are as follows: then acquisition driver's image first monitors the measurement of driver
Whether head movement, pupil diameter, frequency of wink etc. belong within the scope of fatigue driving；If so, determining current driver's
Belong to fatigue driving and driver is reminded.However, the camera currently used for acquiring driver's image is fixed burnt
Shooting angle away from camera and installation rear camera is fixed, therefore shooting area is limited.If driver's stature differ greatly or
External force factor changes the original shooting angle of camera, then the face that may result in driver cannot be placed in camera shooting
The predeterminated position in region, setting are likely to occur that driver's face image capture is complete, driver's face is located at camera and shoots area
Except domain, this brings very big uncertainty according to the progress fatigue driving monitoring of user's face image to subsequent, be easy to cause tired
Labor erroneous judgement or judgement failure.Upper in order to solve the problems, such as, Japan Patent 2006-311196 discloses a kind of fatigue monitoring method,
And specifically disclose: shooting carries out recognition of face after obtaining driver's image, to judge whether driver's face is located at shooting
The central location of picture adjusts camera by motor if driver's face is not at the central location of shooting picture
Towards the central location for making driver's face be located at shooting picture.However, using recognition of face judge driver's face whether position
Method and apparatus in shooting picture center is sufficiently complex, and not full-time in the face shots of driver, it is likely that can not identify
The facial positions of driver out, and then the direction of camera can not be adjusted.
Summary of the invention
The embodiment of the present invention provides a kind of fatigue driving monitoring device and method, for making driver be located at fatigue driving
The predeterminated position of the image of monitoring device acquisition.
In order to achieve the above objectives, the embodiment of the present invention adopts the following technical scheme that
In a first aspect, providing a kind of fatigue driving monitoring device, comprising: processing module, camera, light compensating lamp and driving
Module
The light compensating lamp under the control of the processing module for opening or closing；
The camera is used under the control of processing module, and when the light compensating lamp is closed, shooting driver obtains first
Image shoots the driver when the light compensating lamp is opened and obtains the second image；Wherein, the first image and described is obtained
The time interval of second image is less than threshold length of time；
The processing module is used to obtain the figure of the camera shooting according to the first image and second image
Human region as in, and judge whether the human region is in predeterminated position；It is driven if it is not, then controlling the drive module
The camera adjusts shooting angle.
Optionally, the processing module obtains the camera shooting according to the first image and second image
Human region in image, comprising:
The brightness of the identical pixel of coordinate in the first image is subtracted with the brightness value of each pixel in second image
Value obtains third image；
It obtains brightness value in the third image and is greater than the pixel set of threshold luminance as the human region.
Optionally, the processing module judges whether the human region is in predeterminated position, comprising:
Obtain the vertex pixel of the human region；The vertex pixel of the human region is each picture of the human region
The maximum pixel of ordinate in element；
Calculate the difference and the vertex pixel of the abscissa of the vertex pixel and the abscissa of preset standard point
The difference of the ordinate of ordinate and preset standard point；
If absolute value and/or the vertex of the difference of the abscissa of the abscissa of the vertex pixel and preset standard point
The absolute value of the difference of the ordinate of the ordinate and preset standard point of pixel is greater than threshold value, it is determined that the human region is not located
In predeterminated position.
Optionally, the processing module controls the drive module and drives the camera adjustment shooting angle, comprising:
According to the difference and the vertex pixel of the abscissa of the vertex pixel and the abscissa of preset standard point
The difference of the ordinate of ordinate and preset standard point controls the drive module and the camera is driven to adjust shooting angle.
Optionally, after the processing module controls the drive module drive camera adjustment shooting angle,
The camera, which is also used to shoot the driver in the control periodical of the processing module, obtains the 4th image；
The processing module is also used to judge whether the driver belongs to fatigue driving according to the 4th image.
Second aspect provides a kind of fatigue driving monitoring method, comprising:
Control light compensating lamp, which closes and controls camera shooting driver, obtains the first image；
The light compensating lamp is controlled to open and control the second image of camera shooting driver's acquisition；Wherein, it obtains
The first image and the time interval of second image is taken to be less than threshold length of time；
The human region in the image of the camera shooting is obtained according to the first image and second image；
Judge whether the human region is in predeterminated position；
If it is not, then controlling drive module drives the camera adjustment shooting angle.
Optionally, described to be obtained in the image of the camera shooting according to the first image with second image
Human region, comprising:
The brightness of the identical pixel of coordinate in the first image is subtracted with the brightness value of each pixel in second image
Value obtains third image；
It obtains brightness value in the third image and is greater than the pixel set of threshold luminance as the human region.
It is optionally, described to judge whether the human region is in predeterminated position, comprising:
Obtain the vertex pixel of the human region；The vertex pixel of the human region is each picture of the human region
The maximum pixel of ordinate in element；
Calculate the difference and the vertex pixel of the abscissa of the vertex pixel and the abscissa of preset standard point
The difference of the ordinate of ordinate and preset standard point；
If absolute value and/or the vertex of the difference of the abscissa of the abscissa of the vertex pixel and preset standard point
The absolute value of the difference of the ordinate of the ordinate and preset standard point of pixel is greater than threshold value, it is determined that the human region is not located
In predeterminated position.
Optionally, the control drive module drives the camera to adjust shooting angle, comprising:
According to the difference and the vertex pixel and preset standard of the vertex pixel and the abscissa of preset standard point
The difference of the ordinate of point controls the drive module and the camera is driven to adjust shooting angle.
Optionally, the method also includes:
After controlling the drive module and driving the camera adjustment shooting angle, the camera is periodically controlled
It shoots driver and obtains the 4th image；
Judge whether the driver belongs to fatigue driving according to the 4th image.
Fatigue driving monitoring device provided in an embodiment of the present invention, comprising: processing module, camera, light compensating lamp and driving
Module；Wherein, light compensating lamp can open or close under the control of processing module, and camera can be shot when light compensating lamp is closed
Driver obtains the first image, and when light compensating lamp is opened, shooting driver obtains the second image, so processing module is available
The image that shooting driver obtains when shooting driver obtains when closing light compensating lamp image and unlatching light compensating lamp；And due to obtaining
The time interval of the first image and the second image is taken to be less than threshold length of time, so in the image that camera shooting the first two times are shot
Driver is in identical position, so processing module can obtain the figure of camera shooting according to the first image and the second image
Human region as in, and then judge whether human region is in predeterminated position, when human region is not in predeterminated position, also
It can control drive module and drive camera adjustment shooting angle, so that human region is in pre- in the image for shooting camera
If position.That is, fatigue driving monitoring device provided in an embodiment of the present invention can make driver be located at fatigue driving monitoring device
The predeterminated position of the image of acquisition.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with
It obtains other drawings based on these drawings.
Fig. 1 is the schematic structure of fatigue driving monitoring device provided in an embodiment of the present invention；
Fig. 2 is the schematic diagram of the first image provided in an embodiment of the present invention；
Fig. 3 is the schematic diagram of the second image provided in an embodiment of the present invention；
Fig. 4 is the schematic diagram of third image provided in an embodiment of the present invention；
Fig. 5 is the schematic diagram of preset standard point A provided in an embodiment of the present invention；
Fig. 6 is the schematic diagram of vertex pixel B provided in an embodiment of the present invention；
Fig. 7 be it is the abscissa of preset standard point A provided in an embodiment of the present invention and vertex pixel and ordinate away from
From schematic diagram；
Fig. 8 is the step flow chart of fatigue driving monitoring method provided in an embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
Term "and/or" in embodiments of the present invention, a kind of only incidence relation for describing affiliated partner, expression can be with
There are three kinds of relationships, for example, A and/or B, can indicate: individualism A exists simultaneously A and B, these three feelings of individualism B
Condition.In addition, character "/" herein, typicallys represent the relationship that forward-backward correlation object is a kind of "or".
It should be noted that for the ease of clearly describing the technical solution of the embodiment of the present invention, in the embodiment of the present invention
In, it uses the printed words such as " first ", " second " and function and the essentially identical identical entry of effect or similar item is distinguished, ability
Field technique personnel are understood that the printed words such as " first ", " second " are not to be defined to quantity and execution order.
It should also be noted that, the embodiment of the present invention in, " illustrative " or " such as " etc. words for expression make example,
Illustration or explanation.Be described as in the embodiment of the present invention " illustrative " or " such as " any embodiment or design scheme not
It should be interpreted than other embodiments or design scheme more preferably or more advantage.Specifically, use " illustrative " or
" such as " etc. words be intended to that related notion is presented in specific ways.In addition, in the embodiment of the present invention, unless otherwise indicated, " multiple "
Meaning refer to two or more.
Based on above content, the embodiment provides a kind of fatigue driving monitoring devices, specifically, referring to Fig.1
It is shown, the fatigue driving monitoring device, comprising: processing module 01, camera 02, light compensating lamp 03 and drive module 04.
Light compensating lamp 03 under the control of processing module 01 for opening or closing.
Camera 02 is used under the control of processing module 01, and when light compensating lamp 03 is closed, shooting driver obtains the first figure
Picture, when light compensating lamp 03 is opened, shooting driver obtains the second image.
Processing module 01 is used to obtain the human body area in the image that camera 02 is shot according to the first image and the second image
Domain, and judge whether human region is in predeterminated position, drive camera 02 to adjust shooting angle if it is not, then controlling drive module 04
Degree.
Wherein, the time interval for obtaining the first image and the second image is less than threshold length of time.
Illustratively, the processing module 11 in the embodiment of the present invention in the embodiment of the present invention can for central processing unit,
Micro-control unit (English name: Microcontroller Unit, referred to as: MCU)；Drive module 04 can be motor, motor
Deng；Light compensating lamp 03 can be light emitting diode (English name: Light Emitting Diode, abbreviation: LED) lamp, flash lamp
Quantity Deng, light compensating lamp 03 can be one or more, with fatigue driving monitoring device include that 4 light compensating lamps 03 are in Fig. 1
Example is illustrated.
It should be noted that the connection relationship of each device in above-mentioned fatigue driving monitoring device is not limited in the present invention, with
It may be implemented subject to information transmitting and driving.Illustratively, the connection relationship of each device can in above-mentioned fatigue driving monitoring device
Are as follows: processor 01 is separately connected camera 02, light compensating lamp 03 and drive module 04, and camera 02 and drive module 04 connect
It connects；Illustratively, the connection relationship of each device may be used also in above-mentioned fatigue driving monitoring device are as follows: processor 01 connects camera 02
With drive module 04, camera 02 connects light compensating lamp 03 and drive module 04.
Specifically, processing module 01 can control light compensating lamp 03 and close and control camera 02 certainly when vehicle powers on
Shooting driver obtains the first image under right luminous environment, and controls light compensating lamp 03 after obtaining the first image and open and control camera shooting
First 02, which shoots driver under light filling environment, obtains the second image.Wherein, due to the time of acquisition the first image and the second image
Interval is less than threshold length of time, so the position of driver region is identical in the first image and the second image.
Illustratively, threshold length of time can be 0.2 second, 0.5 second etc., to threshold length of time in the embodiment of the present invention
Without limitation, be subject to can make camera interval threshold time span obtain two images in driver position it is identical.
It should also be noted that, the stature of driver and position are just relatively true since once driver starts to drive vehicle
Fixed, in the image that this drives in vehicle processes without being again turned on light compensating lamp acquisition camera shooting people's soil region,
Therefore fatigue driving monitoring device provided in an embodiment of the present invention can be only when driver starts to drive vehicle or vehicle launch
A light compensating lamp is opened, and is not then turned on light compensating lamp on the run in driver, can drive to go to avoid in driver in this way
Driver caused by light compensating lamp is constantly opened during sailing is dizzy, so cause driver can not focus on drive ask
Topic.
Below in conjunction with Fig. 2 to Fig. 7 to the working principle of fatigue driving monitoring device provided by the above embodiment and worked
Journey is illustrated.
Firstly, camera 02, under the control of processing module 01, when light compensating lamp 03 is closed, shooting driver obtains first
Image；At this time due to driver's stature and driving habit differ greatly or external force changes the original shooting angle of camera,
Therefore camera 02 shoot under natural light environment driver's acquisition the first image may as shown in Fig. 2, driver positioned at the
The side of one image, and driver's face-image is not complete, such image possibly can not carry out effective fatigue monitoring.
Secondly, controlling light compensating lamp 03 within a preset time after obtaining the first image and opening, control camera 02 in light filling environment
The second image that lower shooting driver obtains；Since driver is located at the forefront of steering position, so what light compensating lamp 03 issued
Light is more obvious to the human body parts light filling effect in vehicle, and unobvious to other interior light filling effects, therefore, such as Fig. 3 institute
Show, in the second image for shooting driver's acquisition under light filling environment compared to the first image control camera 02, human region
Brightness significantly increases, other branch's brightness changes are unobvious.The more apparent region of light filling effect is indicated with oblique line in Fig. 3.
In addition, from the foregoing, it will be observed that driver position is identical in the first image and the second image, and only people in the second image
The brightness of body region significantly increases, so processing module 01 can be according to the brightness value and the first image of pixel each in the second image
The size of the difference of the pixel brightness value of middle same coordinate judges whether each pixel belongs to human region, and then obtains camera and clap
Take the photograph the human region in the image of driver's acquisition.
Optionally, the figure that processing module 01 is shot according to the first image and the second image acquisition camera in above-described embodiment
The process of human region as in, is specifically as follows:
The is obtained with the brightness value that the brightness value of pixel each in the second image subtracts the identical pixel of coordinate in the first image
Three images；
It obtains brightness value in third image and is greater than the pixel set of threshold luminance as human region.
Illustratively, third image can be as shown in figure 4, the region that grid lines indicates in Fig. 4 be bright greater than threshold value as brightness
The region of degree, the region are substantially identical to human region, since each pixel in other regions other than human region is
Brightness change in one image and the second image is unobvious, therefore other regions in third image other than human region
The brightness of each pixel is almost nil, indicates other regions other than human region shown in Fig. 4 with black region.
Further, it obtains human region post-processing module 01 and needs to judge whether human region is in predeterminated position.It can
Choosing, 01 processing module of processing module judges whether human region is in the process of predeterminated position in above-described embodiment, specifically may be used
With are as follows:
1, the vertex pixel of human region is obtained.
Wherein, the vertex pixel of human region is the maximum pixel of ordinate in each pixel of human region.
2, the difference of the abscissa of the vertex pixel and the abscissa of preset standard point and indulging for vertex pixel are calculated
The difference of the ordinate of coordinate and preset standard point.
3, judge the abscissa of the vertex pixel and the absolute value of the difference of the abscissa of preset standard point and/or described
Whether the absolute value of the difference of the ordinate of the ordinate and preset standard point of vertex pixel is greater than threshold value；If the vertex pixel
Abscissa and preset standard point abscissa difference absolute value and/or the vertex pixel ordinate and preset standard
The absolute value of the difference of the ordinate of point is greater than threshold value, it is determined that the human region is not in predeterminated position.
Ideally, camera 02 shoots the image of driver's acquisition as shown in figure 5, human region is in predeterminable area
Within, the center at the top of human region is the maximum point of ordinate in human region, which can be defined as preset standard
Point A (Xa, Ya).
Further, as shown in fig. 6, determining the maximum vertex pixel B (Xb, Yb) of ordinate in human region, due to
Vertex pixel B (Xb, Yb) is the point of the center at the top of human region, should be overlapped in A point in ideal situation, it is possible to pass through
The distance of A point and B point judges whether human region is in predeterminable area.
Preset standard point A and vertex pixel B on transverse axis at a distance from can indicate are as follows:
△ X=| Xa-Xb|。
Preset standard point A and vertex pixel B on longitudinal axis at a distance from can indicate are as follows:
△ Y=| Ya-Yb|。
If threshold value is expressed as N, it includes: following three kinds of situations that human region, which is not in predeterminated position:
The first: △ X=| Xa-Xb| > N and △ Y=| Ya-Yb|≤N；
Second: △ Y=| Ya-Yb| > N and △ X=| Xa-Xb|≤N；
Second: △ Y=| Ya-Yb| > N and △ X=| Xa-Xb|>N。
That is, the absolute value △ X and vertex pixel and preset standard of the difference of the abscissa of vertex pixel and preset standard point
As long as having a National People's Congress threshold value N in the absolute value △ Y of the difference of the ordinate of point, it is determined that human region is not in default position
It sets.
It should be noted that human region is in reason after adjusting shooting angle when threshold value N in the above-described embodiments is zero
Think position, human region is overlapped with predeterminated position at this time, but on the one hand, it is difficult by adjusting human region is made in shooting angle
Be exactly in the center of the image of the shooting of camera 02, on the other hand, in practical application without by human region adjust completely with
Predeterminated position is overlapped；Therefore those skilled in the art can set a value greater than zero for threshold value N according to actual needs.
Optionally, processing module 01 controls drive module 04 and drives the adjustment shooting angle of camera 02 in above-described embodiment,
It is specifically as follows:
According to the difference and the vertex pixel of the abscissa of the vertex pixel and the abscissa of preset standard point
The difference of the ordinate of ordinate and preset standard point controls the drive module 04 and the camera 02 is driven to adjust shooting angle
Degree.
Illustratively, as shown in fig. 7, preset standard point A and vertex pixel B on transverse axis at a distance from be △ X, preset standard
Point A and vertex pixel B on longitudinal axis at a distance from be △ Y, according to it is described in Fig. 7 be orientation, following three kinds of mode controls can be passed through
Drive module processed drives camera to adjust shooting angle.
One, control driving device 04 first drives the shooting direction of camera 02 to move right certain angle, to make to image
Human region is moved to the left △ X in the picture of head shooting, then controls under the shooting direction that driving device 04 drives camera 02
Mobile certain angle, to move up △ Y in the picture for making human region shoot camera 02.
Two, mobile certain angle first under the shooting direction of control driving device 04 drive camera 02, to make human body
△ Y is moved up in the picture that region shoots camera, then controls the shooting direction that driving device 04 drives camera 02
Certain angle is moved right, so that human region is moved to the left △ X in the picture for shooting camera 02.
Three, control driving device 04 drives the mobile certain angle in the shooting direction lower left of camera 02, to make human body
It is mobile to upper right side in the picture that region shoots camera 02
Fatigue driving monitoring device provided in an embodiment of the present invention, comprising: processing module, camera, light compensating lamp and driving
Module；Wherein, light compensating lamp can open or close under the control of processing module, and camera can be shot when light compensating lamp is closed
Driver obtains the first image, and when light compensating lamp is opened, shooting driver obtains the second image, so processing module is available
The image that shooting driver obtains when shooting driver obtains when closing light compensating lamp image and unlatching light compensating lamp；And due to obtaining
The time interval of the first image and the second image is taken to be less than threshold length of time, so in the image that camera shooting the first two times are shot
Driver is in identical position, so processing module can obtain the figure of camera shooting according to the first image and the second image
Human region as in, and then judge whether human region is in predeterminated position, when human region is not in predeterminated position, also
It can control drive module and drive camera adjustment shooting angle, so that human region is in pre- in the image for shooting camera
If position.That is, fatigue driving monitoring device provided in an embodiment of the present invention can make driver be located at fatigue driving monitoring device
The predeterminated position of the image of acquisition.
Further, after processing module 01 controls the drive adjustment shooting angle of camera 02 of drive module 04, camera shooting
First 02 is also used to obtain the 4th image in the control periodical shooting driver of processing module 01；
Processing module 01 is also used to judge whether driver belongs to fatigue driving according to the 4th image.
Since the fatigue driving monitoring device provided through the foregoing embodiment can be such that fatigue driving monitoring device acquires
Driver is located at predeterminated position in image, so the embodiment of the present invention can be led to avoid because of being located at except predeterminable area for driver
The fatigue driving erroneous judgement or fatigue driving of cause judge failure, to improve the accuracy and success rate of fatigue driving monitoring.
In addition, it should be noted that, the fatigue monitoring detection device provided through the foregoing embodiment can make to open in vehicle
It moves or starts to drive vehicle to be the predeterminated position for being located at driver in the image of fatigue driving monitoring device acquisition, and due to one
Denier driver starts to drive vehicle, and the stature of driver and position have just determined relatively, so driving in this driving procedure
Shooting angle of the member without adjusting camera again；But since fatigue driving mostly occurs in driving procedure, driven in driver
The 4th image can be just obtained at interval of predetermined time period during vehicle, and current driver's are judged according to the 4th image
Whether belong to fatigue driving, and driver is reminded when driver belongs to fatigue driving.
Illustrate embodiment of the method corresponding with Installation practice presented above provided in an embodiment of the present invention below.
It should be noted that in following methods embodiment related content explanation, can refer to above-mentioned apparatus embodiment.
The embodiment of the present invention provides a kind of fatigue driving monitoring method, specifically, referring to shown in Fig. 8, this method comprises:
S81, control light compensating lamp, which close and control camera shooting driver, obtains the first image.
S82, control light compensating lamp, which are opened and control camera shooting driver, obtains the second image.
Wherein, the time interval for obtaining the first image and the second image is less than threshold length of time.
S83, human region in the image of camera shooting is obtained according to the first image and the second image.
S84, judge whether human region is in predeterminated position.
In above-mentioned steps S84, it is not in predeterminated position in human region, thens follow the steps S85.
S85, control drive module drive camera to adjust shooting angle.
Fatigue driving monitoring method provided in an embodiment of the present invention, first control light compensating lamp close and control camera shooting
Driver obtains the first image, then controls light compensating lamp and opens and control camera shooting driver's the second image of acquisition, so
The image that shooting driver obtains when shooting driver obtains when available closing light compensating lamp image and unlatching light compensating lamp, and
And the time interval due to obtaining the first image and the second image is less than threshold length of time, so camera shooting the first two times shoot to obtain
Image in driver be in identical position；And then the figure of camera shooting can be obtained according to the first image and the second image
Human region as in, and because may determine that whether human region is in predeterminated position, default position is not in human region
When setting, control drive module drives camera to adjust shooting angle, so that human region is in the image for shooting camera
Predeterminated position, therefore fatigue driving monitoring method provided in an embodiment of the present invention can make driver be located at fatigue driving monitoring dress
Set the predeterminated position of the image of acquisition.
Optionally, the people in the image of camera shooting is obtained in above-mentioned steps S83 according to the first image and the second image
Body region, comprising:
The is obtained with the brightness value that the brightness value of pixel each in the second image subtracts the identical pixel of coordinate in the first image
Three images；
It obtains brightness value in third image and is greater than the pixel set of threshold luminance as human region.
Optionally, judge whether human region is in predeterminated position in above-mentioned steps S84, comprising:
Obtain the vertex pixel of human region；The vertex pixel of human region be human region each pixel in ordinate most
Big pixel；
Calculate the difference and the vertex pixel of the abscissa of the vertex pixel and the abscissa of preset standard point
The difference of the ordinate of ordinate and preset standard point；
If absolute value and/or the vertex of the difference of the abscissa of the abscissa of the vertex pixel and preset standard point
The absolute value of the difference of the ordinate of the ordinate and preset standard point of pixel is greater than threshold value, it is determined that the human region is not located
In predeterminated position.
Optionally, drive module is controlled in above-mentioned steps S85 drives camera to adjust shooting angle, comprising:
According to the difference and the vertex pixel of the abscissa of the vertex pixel and the abscissa of preset standard point
The difference of the ordinate of ordinate and preset standard point controls the drive module and the camera is driven to adjust shooting angle.
Optionally, on the basis of the fatigue driving monitoring method that any of the above-described embodiment provides, the embodiment of the present invention is mentioned
The fatigue driving monitoring method of confession further include:
After control drive module drives camera adjustment shooting angle, control camera shooting driver obtains the 4th
Image；
Judge whether driver belongs to fatigue driving according to the 4th image.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any
In the technical scope disclosed by the present invention, any changes or substitutions that can be easily thought of by those familiar with the art, all answers
It is included within the scope of the present invention.Therefore, protection scope of the present invention should be subject to the protection scope in claims.
Claims (10)
1. a kind of fatigue driving monitoring device characterized by comprising processing module, camera, light compensating lamp and driving mould
Block；
The light compensating lamp under the control of the processing module for opening or closing；
The camera is used under the control of processing module, and when the light compensating lamp is closed, shooting driver obtains the first figure
Picture shoots the driver when the light compensating lamp is opened and obtains the second image；Wherein, the first image and described the are obtained
The time interval of two images is less than threshold length of time；
The processing module is used to be obtained according to the first image and second image in the image of the camera shooting
Human region, and judge whether the human region is in predeterminated position；If it is not, then controlling described in the drive module drive
Camera adjusts shooting angle.
2. fatigue driving monitoring device according to claim 1, which is characterized in that the processing module is according to described first
Image and second image obtain the human region in the image of the camera shooting, comprising:
It is obtained with the brightness value that the brightness value of each pixel in second image subtracts the identical pixel of coordinate in the first image
Take third image；
It obtains brightness value in the third image and is greater than the pixel set of threshold luminance as the human region.
3. fatigue driving monitoring device according to claim 2, which is characterized in that the processing module judges the human body
Whether region is in predeterminated position, comprising:
Obtain the vertex pixel of the human region；The vertex pixel of the human region is in each pixel of the human region
The maximum pixel of ordinate；
Calculate the difference of the abscissa of the vertex pixel and the abscissa of preset standard point and the vertical seat of the vertex pixel
The difference of mark and the ordinate of preset standard point；
If absolute value and/or the vertex pixel of the difference of the abscissa of the abscissa of the vertex pixel and preset standard point
Ordinate and preset standard point ordinate difference absolute value be greater than threshold value, it is determined that the human region is not in pre-
If position.
4. fatigue driving monitoring device according to claim 3, which is characterized in that the processing module controls the driving
Module drives the camera to adjust shooting angle, comprising:
According to the abscissa of the vertex pixel and the difference of the abscissa of preset standard point and the vertical seat of the vertex pixel
The difference of mark and the ordinate of preset standard point controls the drive module and the camera is driven to adjust shooting angle.
5. fatigue driving monitoring device according to claim 1-4, which is characterized in that in the processing module control
After making the drive module drive camera adjustment shooting angle, the camera is also used in the processing module
It controls periodical and shoots the 4th image of driver's acquisition；
The processing module is also used to judge whether the driver belongs to fatigue driving according to the 4th image.
6. a kind of fatigue driving monitoring method characterized by comprising
Control light compensating lamp, which closes and controls camera shooting driver, obtains the first image；
The light compensating lamp is controlled to open and control the second image of camera shooting driver's acquisition；Wherein, institute is obtained
The time interval for stating the first image and second image is less than threshold length of time；
The human region in the image of the camera shooting is obtained according to the first image and second image；
Judge whether the human region is in predeterminated position；
If it is not, then controlling drive module drives the camera adjustment shooting angle.
7. fatigue driving monitoring method according to claim 6, which is characterized in that described according to the first image and institute
It states the second image and obtains human region in the image of camera shooting, comprising:
It is obtained with the brightness value that the brightness value of each pixel in second image subtracts the identical pixel of coordinate in the first image
Take third image；
It obtains brightness value in the third image and is greater than the pixel set of threshold luminance as the human region.
8. fatigue driving monitoring method according to claim 7, which is characterized in that described whether to judge the human region
In predeterminated position, comprising:
Obtain the vertex pixel of the human region；The vertex pixel of the human region is in each pixel of the human region
The maximum pixel of ordinate；
Calculate the difference of the abscissa of the vertex pixel and the abscissa of preset standard point and the vertical seat of the vertex pixel
The difference of mark and the ordinate of preset standard point；
If absolute value and/or the vertex pixel of the difference of the abscissa of the abscissa of the vertex pixel and preset standard point
Ordinate and preset standard point ordinate difference absolute value be greater than threshold value, it is determined that the human region is not in pre-
If position.
9. fatigue driving monitoring method according to claim 8, which is characterized in that described in the control drive module drives
Camera adjusts shooting angle, comprising:
According to the abscissa of the vertex pixel and the difference of the abscissa of preset standard point and the vertical seat of the vertex pixel
The difference of mark and the ordinate of preset standard point controls the drive module and the camera is driven to adjust shooting angle.
10. according to the described in any item fatigue driving monitoring methods of claim 6-9, which is characterized in that the method also includes:
After controlling the drive module and driving the camera adjustment shooting angle, controls the camera and periodically shoot
Driver obtains the 4th image；
Judge whether the driver belongs to fatigue driving according to the 4th image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710860426.8A CN109543491B (en) | 2017-09-21 | 2017-09-21 | Fatigue driving monitoring device and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710860426.8A CN109543491B (en) | 2017-09-21 | 2017-09-21 | Fatigue driving monitoring device and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109543491A true CN109543491A (en) | 2019-03-29 |
| CN109543491B CN109543491B (en) | 2023-04-28 |
Family
ID=65828290
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710860426.8A Active CN109543491B (en) | 2017-09-21 | 2017-09-21 | Fatigue driving monitoring device and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109543491B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111145495A (en) * | 2019-12-31 | 2020-05-12 | 钧捷智能（深圳）有限公司 | Fatigue driving early warning camera test system |
| CN112584058A (en) * | 2019-09-30 | 2021-03-30 | 杭州海康汽车技术有限公司 | Image acquisition system, method and device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2014041758A1 (en) * | 2012-09-17 | 2014-03-20 | 株式会社デンソー | State monitoring device |
| CN104580922A (en) * | 2014-12-02 | 2015-04-29 | 广东欧珀移动通信有限公司 | Control method and device for supplemental lighting during shooting |
| CN105554391A (en) * | 2015-12-31 | 2016-05-04 | 广州广电运通金融电子股份有限公司 | Camera control method and device and financial equipment terminal |
| CN105788028A (en) * | 2016-03-21 | 2016-07-20 | 上海仰笑信息科技有限公司 | Automobile data recorder with fatigue driving pre-warning function |
-
2017
- 2017-09-21 CN CN201710860426.8A patent/CN109543491B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2014041758A1 (en) * | 2012-09-17 | 2014-03-20 | 株式会社デンソー | State monitoring device |
| CN104580922A (en) * | 2014-12-02 | 2015-04-29 | 广东欧珀移动通信有限公司 | Control method and device for supplemental lighting during shooting |
| CN105554391A (en) * | 2015-12-31 | 2016-05-04 | 广州广电运通金融电子股份有限公司 | Camera control method and device and financial equipment terminal |
| CN105788028A (en) * | 2016-03-21 | 2016-07-20 | 上海仰笑信息科技有限公司 | Automobile data recorder with fatigue driving pre-warning function |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112584058A (en) * | 2019-09-30 | 2021-03-30 | 杭州海康汽车技术有限公司 | Image acquisition system, method and device |
| CN112584058B (en) * | 2019-09-30 | 2023-02-07 | 杭州海康汽车技术有限公司 | Image acquisition system, method and device |
| CN111145495A (en) * | 2019-12-31 | 2020-05-12 | 钧捷智能（深圳）有限公司 | Fatigue driving early warning camera test system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109543491B (en) | 2023-04-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104461005B (en) | A kind of Vehicular screen method of controlling switch | |
| CN104238948B (en) | A kind of intelligent watch lights the method and intelligent watch of screen | |
| US10165971B2 (en) | Driver state determination apparatus | |
| CN103423657B (en) | A kind of method of Intelligent lamp and intelligent reminding thereof | |
| CN103019917B (en) | The mobile terminal monitoring method of excess eye-using, system and mobile terminal | |
| KR101355279B1 (en) | Face image detection apparatus | |
| CN104580693B (en) | A kind of user's heads-down posture detection method and device | |
| WO2015131857A2 (en) | Method and apparatus for aiding vision combining camera module and optical sensor | |
| CN105659305B (en) | State monitoring apparatus | |
| AU2003284816A1 (en) | Method and installation for detecting and following an eye and the gaze direction thereof | |
| JP5999013B2 (en) | Open eye state determination device | |
| CN105704886B (en) | Using the car lighting control system of wearable glasses and for the method for the system | |
| CN109543491A (en) | A kind of fatigue driving monitoring device and method | |
| JP2020059325A (en) | Gaze-detection device and congestion control method for the same | |
| CN108534303A (en) | A kind of air conditioning control method, device and air-conditioning system | |
| CN107507395A (en) | A kind of fatigue driving detecting system and method | |
| CN206419861U (en) | A kind of intelligent elevated desk lamp | |
| CN107480629A (en) | A kind of method for detecting fatigue driving and device based on depth information | |
| CN106658842A (en) | Myopia preventing system based on automatic detection technology | |
| CN204887566U (en) | Illumination light control system of exhibition hall | |
| CN104219853B (en) | Illumination control method and device | |
| CN104754835B (en) | A kind of method of night illumination | |
| CN209103360U (en) | A kind of intelligent robot | |
| CN108204532A (en) | A kind of intelligent elevated desk lamp | |
| CN211409015U (en) | Vision screening instrument capable of automatically adjusting brightness of lamp panel |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |