The method of driver drowsy alarm logging and device
Technical field
The invention belongs to a kind of vehicle ' and guarantee the method for safety and the device that this method is used, concrete is by detecting and the vision signal of analyzing and processing driver face situation and the relevant information that car travels, in time give the driver with caution, to guarantee the method and apparatus of traffic safety.
Background technology
The driving of automobile and various vehicles is a kind of work that is very easy to occur accident, and occuring frequently of various traffic hazards causes a lot of materials and the loss of spirit for litigant and society.Along with expanding economy, the rolling up of motor vehicles, the quantity of driving accident is also more and more.So how to improve the security of vehicle, how to prevent driver's driving accident, be numerous Railway Car Plant man, vehicle supervision department and each extensive concern of society and do one's utmost the problem that idea solves.Occurring aspect the outfit of the designing for manufacturing of vehicle, various safety features much about improving the technology of traffic safety.These technology all are about the performance of improving car, brake control, aspect such as crashproof mostly, and are less about the technology with the caution aspect of driver's monitoring.And in real life, because driver tired driving, drive when intoxicated and the driving accident that causes is very many, and this accident often causes very serious consequence.Therefore, a kind of driving condition and mental status that can monitoring driving person be proposed, in time find driver's the improper state of mind, in time point out and warn, in time correct and stop driver's dangerous driving state, prevent trouble before it happens, the generation that tries to forestall traffic accidents obviously is very necessary and important.
Summary of the invention
At the problems referred to above, one of purpose of the present invention: be the method that proposes a kind of driver drowsy alarm logging.This method is utilized a kind of driver drowsy alarm logging device, obtains the situation of eyes nictation of driver, thereby judges its sleepy situation, sends the corresponding warning instruction then, to avoid driving accident.This method is simple and feasible, has advantages of high practicability, has the advantage that prevents driving accident preferably.
One of purpose of the present invention is achieved through the following technical solutions:
A kind of method of driver drowsy alarm logging is characterized in that may further comprise the steps:
(1) utilizes the camera and the rate signals that are arranged on the driver front to control driver's face image signal that infrared light supply obtains continous-stable, after the conversion of vision signal A/D conversion chip, send the DSP data processing module to;
(2) the DSP data processing module is by carrying out the computer instruction of data processing, video signal data to input is handled, determine the position of driver face: the image processing techniques detection of dynamic facial positions of promptly utilizing continuous sequence, the characteristics that small action is promptly always arranged when driving according to driver's face, method with dynamic tracking, determine head position: the first step, with current video image and former frame image subtraction, obtain the poor of two width of cloth images, when head was not moving, the difference of two width of cloth images was zero; When head had, the marginal portion of each organ was non-vanishing on the head, and the edge image that obtains a width of cloth driver face thus is a difference diagram; Second step, calculate the projection of difference image respectively in X-axis and Y-axis, scan downwards from the top of image, obtain the upper limb of head, use the same method from the left-to-right side scanning of image, obtain the left and right edges of head, utilize the Aspect Ratio of head to be about 4: 3, find the profile of head, promptly determine the position of driver's head; When head was moving, the latest position of record-header kept original position when motionless;
(3) the DSP data processing module is by carrying out the computer instruction of data processing, the video signal data of input is handled the position of determining eyes: the method for at first utilizing described edge extracting, a back pixel that is about to each stringer deducts last pixel, detects the last lower edge of eyelid and the position of pupil and iris;
(4) the DSP data processing module is by carrying out the computer instruction at data place, and the driver's eyelid that goes out according to the 3rd pacing and the situation of change of pupil determine that further driver's situation nictation is sleepy situation;
(5) the DSP data processing module is determined the different sleepy rank to the driver according to the fixed driver's of the 4th pacing sleepy situation, extracts different alarm signals from audio memory, and gives sound horn by audio frequency D/A modular converter;
(6) image of detected driver's head portrait of DSP data processing module and described eyes is sent to described LCD by the video d/a conversion chip and shows synchronously;
(8) the detected garage of DSP data processing module situation, driver's head eye status data and caution situation are stored in the storer of DSP data processing module simultaneously.
The present invention is owing to be the condition information data that obtain the driver by light sensor and infrared light supply, and infrared light supply is not subjected to the influence of extraneous light, so data stabilization is reliable; Adopt to follow the tracks of continuously and extract, adjacent image subtracts each other the method for obtaining difference diagram and edge extraction, judge the situation of driver's head and eye, this method is easy to be reliable, by the Control Software of DSP micro treatment module and curing, protect the upright reliability of having demonstrate,proved device performance, and be convenient to modification and perfection constantly, The whole control system novelty simple in structure has very strong practicality.
Two of purpose of the present invention: propose the sleepy alarm logging device of a kind of multifunctional driver person, this device is provided with camera, garage's situation sensors, data processing module and displayed record parts, by and obtain and analyze the signal data of driver and garage's situation, discovery in time may cause the dangerous situation of driving, and timely alerting drivers, make it to take measures in advance, with the generation that tries to forestall traffic accidents.Realize the described method of claim 1, this device control is flexible, and the automaticity height has stronger practicality.
The sleepy alarm logging device of a kind of multifunctional driver person, mainly comprise: vision signal parts, garage's status signals parts, Signal Processing Element and video/audio output block, it is characterized in that: described vision signal parts mainly are made up of camera and rate signals control infrared light supply, and they are mounted with the position of pilothouse facing to driver's head; Described garage status signals parts mainly are made up of garage's situation sensors group that vehicle speed sensor, car turning sensor and brake sensor etc. are formed, and they are arranged on the region of interest of car; Signal Processing Element is mainly by upper signal processing module, DSP data processing module, scrambler, clock module, vision signal A/D chip, vision signal D/A chip, and sound signal storer, sound signal D/A chip are formed; Also have LCD and audio amplifier in addition; The signal of described garage situation sensors group transmits the complete described upper signal processing module of giving through described scrambler, and clock module is connected with upper signal processing module; The input signal of this upper signal processor is connected with the inlet of DSP data processing module; The vision signal that described camera and infrared light supply produce sends the DSP data processing module to through vision signal A/D module, sends LCD through DSP data processing module processed video signal to through vision signal D/A module; The sound signal of described sound signal storer sends described audio amplifier to through sound signal D/A module after the DSP data processor extracts;
After camera and infrared light supply obtain driver's head image signal, give DSP data processing module through analog to digital conversion, the DSP data processing module is by its interpretation software that is set up, draw driver face and eye manifestation situation, image after will handling is on the one hand issued display and is shown, on the other hand when drawing the driver when sleepy situation occurring, taking out corresponding sound signal in the audio memory gives audio amplifier and sounds, with the prompting driver, and garage's situation constantly noted.
The present invention is owing to adopted the structure of utilizing light sensor and rate signals control infrared light supply to obtain stable face image signal, and more weak infrared radiation is not subjected to the influence of external environment condition light at face, so signal stabilization is reliable; Owing in the DSP data processing module, be provided with the expert system of Flame Image Process, can analyze the driver that obtained and the information of garage's situation comparatively exactly, in time find driver's improper situation, in time caution is proposed to the driver; Novel structure of the present invention, the traffic hazard that stable performance is the very strong prevention of a kind of practicality to be caused because of driver fatigue and problem such as drive when intoxicated.
Description of drawings
Fig. 1 is a structural representation of the present invention;
Fig. 2 is a DSP data processing module workflow diagram of the present invention.
Embodiment
The present invention is described further below in conjunction with drawings and Examples: 1, embodiment 1: a kind of method of driver drowsy alarm logging mainly may further comprise the steps:
(1) utilizes the camera and the rate signals that are arranged on the driver front to control driver's face image signal that infrared light supply obtains continous-stable, after the conversion of vision signal A/D conversion chip, send the DSP data processing module to;
(2) the DSP data processing module is handled the position of determining driver face by computer instructions to the video signal data of input: the image processing techniques of promptly utilizing continuous sequence, the detection of dynamic facial positions, the characteristics that small action is promptly always arranged when driving according to driver's face, method with dynamic tracking, determine head position: the first step, with current video image and former frame image subtraction, obtain the poor of two width of cloth images.When head was not moving, the difference of two width of cloth images was zero; When head had, the marginal portion of each organ was non-vanishing on the head, and the edge image that obtains a width of cloth driver face thus is a difference diagram; Second step, calculate the projection of difference image respectively in X-axis and Y-axis, scan downwards from the top of image, obtain the upper limb of head, same method obtains the left and right edges of head from the left-to-right side scanning of image, utilizes the Aspect Ratio of head to be about 4: 3, find the profile of head, promptly determine the position of driver's head.Upper limb may be the hair line of the crown or people's face, as long as the scope that is found comprises that eyes are just to the not influence of follow-up measurement eye pupil position; When head was moving, the latest position of record-header kept original position when motionless;
(3) the DSP data processing module passes through computer instructions, video signal data to input is handled, determine the position of eyes: the method for at first utilizing described edge extracting, a back pixel that is about to each stringer deducts last pixel, detects the last lower edge of eyelid and the position of pupil and iris;
(4) the DSP data processing module is by computer instructions, utilizes the result that the 3rd step detected, and further determines the state of the closing state of promptly blinking of opening of eyes, thereby judges driver's drowsiness level.
(5) the DSP data processing module is according to the fixed driver's of the 4th pacing sleepy situation, and in conjunction with information such as the speed of a motor vehicle, determine driver's different sleepy rank, from audio memory, extract different alarm signals, and give sound horn by audio frequency D/A modular converter; In the present embodiment, when the driver's eyes image deflects away from the camera visual field and the duration exceeds 6s, during less than 15s, send and remind instruction: with 1 time the length auditory tone cues that " ticks " p.s.; When the driver's eyes image deflects away from the camera visual field, and the duration is greater than 15s, perhaps work as time nictation greater than 0.3 second, drowsiness might take place or just take place sleepy in explanation, need alerting drivers to be in sleepy period now, be called " the slight warning " incident, with " ticking " sound caution of short length p.s. one; The time of closing one's eyes in 15 seconds surpasses 30%, and there is " the slight warning " incident the front, the time of perhaps once closing one's eyes was greater than 0.7 second, may be sleepy or sleeping, become " emergency alarm " incident, with " ticking " lasting chimes of doom of per second 10 times, clear-headed up to driving, when system's detection surpasses 15S less than eyes, also use " emergency alarm " incident equally, correct driver's driving mistake;
(6) image of detected driver's head portrait of DSP data processing module and described eyes is sent to described LCD by the video d/a conversion chip and shows synchronously;
(8) the detected garage of DSP data processing module situation, driver's head eye status data and caution situation are stored in the storer of DSP data processing module simultaneously.
Embodiment 2: the sleepy alarm logging device of a kind of multifunctional driver person, mainly comprise: vision signal parts, garage's status signals parts, Signal Processing Element and video/audio output block, it is characterized in that: described vision signal parts are that camera 3 and rate signals control infrared light supply 4 are formed by light sensor mainly, and they are mounted with the position of pilothouse facing to driver's head; Described garage status signals parts mainly are made up of garage's situation sensors group 2 that vehicle speed sensor, car turning sensor and brake sensor etc. are formed, and they are arranged on the region of interest of car; Signal Processing Element is mainly by upper signal processing module 1, DSP data processing module 5, scrambler 11, clock module 10, vision signal A/D chip 12, vision signal D/A chip 13, and sound signal storer 9, sound signal D/A chip are formed; Also have LCD 6 and audio amplifier 7 in addition; The signal of described garage situation sensors group transmits the complete described upper signal processing module of giving through described scrambler, and clock module is connected with upper signal processing module; The input signal of this upper signal processor is connected with the inlet of DSP data processing module; The vision signal that described camera and infrared light supply produce sends the DSP data processing module to through vision signal A/D module, sends LCD 6 through DSP data processing module processed video signal to through vision signal D/A module; The sound signal of described sound signal storer sends described audio amplifier to through sound signal D/A module after the DSP data processor extracts;
After camera and infrared light supply obtain driver's head image signal, give DSP data processing module through analog to digital conversion, the DSP data processing module is by its interpretation software that is set up, draw driver face and eye manifestation situation, image after will handling is on the one hand issued display and is shown, on the other hand when drawing the driver when sleepy situation occurring, taking out corresponding sound signal in the audio memory gives audio amplifier and sounds, with the prompting driver, and garage's situation constantly noted.
The present invention can also at first detect the speed of a motor vehicle in the specific implementation, sets a standard speed of a motor vehicle, starts maim body when the speed of a motor vehicle reaches the established standards rear.Just increased this step in the present embodiment.
Embodiment 2: referring to accompanying drawing, the sleepy alarm logging device of a kind of multifunctional driver person, mainly comprise: vision signal parts, garage's status signals parts, Signal Processing Element and video/audio output block, it is characterized in that: described vision signal parts are that camera 3 and rate signals control infrared light supply 4 are formed by light sensor mainly, and they are mounted with the position of pilothouse facing to driver's head; Described garage status signals parts mainly are made up of garage's situation sensors group 2 that vehicle speed sensor, car turning sensor and brake sensor etc. are formed, and they are arranged on the region of interest of car; Signal Processing Element is mainly by upper signal processing module 1, DSP data processing module 5, scrambler 11, clock module 10, vision signal A/D chip 12, vision signal D/A chip 13, and sound signal storer 9, sound signal D/A chip are formed; Also have LCD 6 and audio amplifier 7 in addition; The signal of described garage situation sensors group transmits the complete described upper signal processing module of giving through described scrambler, and clock module is connected with upper signal processing module; The input signal of this upper signal processor is connected with the inlet of DSP data processing module; The vision signal that described camera and infrared light supply produce sends the DSP data processing module to through vision signal A/D module, sends LCD 6 through DSP data processing module processed video signal to through vision signal D/A module; The sound signal of described sound signal storer sends described audio amplifier to through sound signal D/A module after the DSP data processor extracts.
After camera and infrared light supply obtain driver's head image signal, give DSP data processing module through analog to digital conversion, the DSP data processing module is by its interpretation software that is set up, draw driver face and eye manifestation situation, image after will handling is on the one hand issued display and is shown, on the other hand when drawing the driver when sleepy situation occurring, taking out corresponding sound signal in the audio memory gives audio amplifier and sounds, with the prompting driver, and garage's situation constantly noted.
The method and apparatus of above embodiment after testing, the figure that is obtained is clear, clear picture nictation of driver's head position and eyelid, analysis and judgement is accurate, the statistics of caution report is: " reminding instruction " accuracy rate is 99.00%; " the slight warning " accuracy rate is 99.50%; " emergency alarm " accuracy rate is 99.98%.