The divisional application of the invention of " fatigue of automobile driver state anticipation system " that the present invention is application number is 2013102292353, the applying date, to be June 8, denomination of invention in 2013 be.
Summary of the invention
In order to solve the problem, the invention provides a kind of fatigue of automobile driver state anticipation system, introduce face recognition module, human eye locating module, fatigue state anticipation module, recognition of face, human eye location and final fatigue state anticipation are progressively carried out to the facial image received, and judged result is sent to relevant unit and individual by audio/video information, cordless communication network, to carry out the reduction speed of a motor vehicle and instant alarming when fatigue of automobile driver, the person and the property safety of passenger on automobile are ensured.
According to an aspect of the present invention, provide a kind of fatigue of automobile driver state anticipation system, comprise image capture module, image pre-processing module, fatigue state anticipation module and controller module, image pre-processing module connects image capture module and carries out analogue to digital conversion with the face-image taken image capture module, fatigue state anticipation module judges driver fatigue state according to the driver's eyes closing period in digital image after analogue to digital conversion, controller module connects fatigue state anticipation module to carry out speed of a motor vehicle control and alarm operation according to driver fatigue state.
More specifically, described fatigue of automobile driver state anticipation system comprises further: described image capture module to be arranged in Automobile and to be positioned at the top of automobile driver position, carry out the face-image taking to obtain chaufeur, and exporting analog picture signal, the form of described analog picture signal is Composite Video Baseband Signal CVBS form, described image pre-processing module is arranged in the gauge panel of automobile, connect described image capture module to receive the analog picture signal of CVBS form, the analog picture signal of CVBS form is carried out analogue to digital conversion, obtain and output digital image signal, the form of described data image signal is the ITU 656 YUV 4:4:4 form of 8 bits, color space convert module, be arranged in the gauge panel of automobile, connect described image pre-processing module to receive the data image signal of the ITU656 YUV 4:4:4 form of 8 bits, the data image signal of ITU 656 YUV 4:4:4 form is carried out color space convert, obtains the data image signal of RGB888 form, face recognition module, be arranged in the gauge panel of automobile, connect described image pre-processing module to receive the data image signal of YUV 4:4:4 form, and carry out recognition of face according to the data image signal of described YUV 4:4:4 form, described recognition of face is specially, judge whether the pixel value of the pixel in the data image signal of described YUV 4:4:4 form drops in skin color range, if, then regard as skin pixel, if not, then regard as non-skin pixel, all skin pixels are combined into facial image, human eye locating module, be arranged in the gauge panel of automobile, connect described face recognition module to receive facial image, and the feature bigger than normal according to the brightness value in the pixel value of the pixel at human eye position, assert the pixel belonging to people's eye portion in facial image, all people's eye combination of pixels becomes eye image, described fatigue state anticipation module installation is in the gauge panel of automobile, connect described human eye locating module to receive described eye image, extract driver's eyes closing period according to described eye image, and export described driver's eyes closing period and account for the ratio that described eye image is sampled the time, described controller module is arranged in the gauge panel of automobile, connect described fatigue state anticipation module, enter or exit fatigue state master mode according to the control command that user is sent by the control button on bearing circle, when entering fatigue state master mode, receive the described ratio that described fatigue state anticipation module exports, when described ratio is more than or equal to the first predetermined threshold, send extremely tired alerting signal, when described ratio is between the first predetermined threshold and the second predetermined threshold, send moderate fatigue warning signal, when described ratio is less than or equal to the second predetermined threshold, send state normal signal, described first predetermined threshold is greater than described second predetermined threshold, speed of a motor vehicle control module, be arranged in the gauge panel of automobile, connection control device module is to receive extremely fatigue warning signal, moderate fatigue warning signal or state normal signal, when receiving extremely tired alerting signal, controlling the moving velocity of automobile at 20 kilometers per hour, when receiving moderate fatigue warning signal, controlling the moving velocity of automobile at 40 kilometers per hour, when receiving state normal signal, automobile driving speed is not controlled, wireless data communication module, be arranged on the vehicle body of automobile, connection control device module and speed of a motor vehicle control module, to send on the network of automobile affiliated unit by cordless communication network by extremely tired alerting signal, moderate fatigue warning signal, state normal signal and current vehicle speed or to send on the mobile phone of automobile driver relatives, voice playing module, is arranged in the gauge panel of automobile, connection control device module and speed of a motor vehicle control module, to be play extremely tired alerting signal, moderate fatigue warning signal, state normal signal and current vehicle speed voice content corresponding respectively by microphone, display module, be arranged in the gauge panel of automobile, connect color space convert module, controller module and speed of a motor vehicle control module, the data image signal of the RGB888 form that display color space convert module exports, and the word content that display is corresponding respectively with extremely tired alerting signal, moderate fatigue warning signal, state normal signal and current vehicle speed, solar powered module, comprise and be fixed on car body to gather the photovoltaic panel of solar power, detect the electricity of automobile self storage battery, when the electricity of automobile self storage battery is less than predetermined power threshold, image capture module, image pre-processing module, color space convert module, face recognition module, human eye locating module, fatigue state anticipation module, controller module, speed of a motor vehicle control module, wireless data communication module, voice playing module and display module are powered.
More specifically, described fatigue of automobile driver state anticipation system comprises further: voice playing module and display module are integrated into an audio frequency and video alarm module to carry out audio frequency and video warning.
More specifically, described fatigue of automobile driver state anticipation system comprises further: manual power switching module, switches the power supply of solar powered module and automobile self storage battery under chaufeur M/C.
More specifically, described fatigue of automobile driver state anticipation system comprises further: extremely tired alerting signal, moderate fatigue warning signal, state normal signal and current vehicle speed are also sent on the network of local traffic control department by cordless communication network by wireless data communication module.
Detailed description of the invention
Below with reference to accompanying drawings the embodiment of fatigue of automobile driver state anticipation system of the present invention is described in detail.
Fig. 1 illustrates the block diagram of the fatigue of automobile driver state anticipation system illustrated according to an embodiment of the present invention.Wherein fatigue of automobile driver state anticipation system comprises, image capture module 1, image pre-processing module 2, fatigue state anticipation module 3 and controller module 4, image pre-processing module 2 connects image capture module 1 and carries out analogue to digital conversion with the face-image taken image capture module 1, fatigue state anticipation module 3 judges driver fatigue state according to the driver's eyes closing period in digital image after analogue to digital conversion, and controller module 4 connects fatigue state anticipation module 3 to carry out speed of a motor vehicle control and alarm operation according to driver fatigue state.Further, described fatigue of automobile driver state anticipation system also comprises, described image capture module 1 to be arranged in Automobile and to be positioned at the top of automobile driver position, carry out the face-image taking to obtain chaufeur, and exporting analog picture signal, the form of described analog picture signal is Composite Video Baseband Signal CVBS form, described image pre-processing module 2 is arranged in the gauge panel of automobile, connect described image capture module 1 to receive the analog picture signal of CVBS form, the analog picture signal of CVBS form is carried out analogue to digital conversion, obtain and output digital image signal, the form of described data image signal is the ITU 656YUV 4:4:4 form of 8 bits, color space convert module, be arranged in the gauge panel of automobile, connect described image pre-processing module 2 to receive the data image signal of the ITU 656 YUV 4:4:4 form of 8 bits, the data image signal of ITU 656 YUV 4:4:4 form is carried out color space convert, obtains the data image signal of RGB888 form, face recognition module, be arranged in the gauge panel of automobile, connect described image pre-processing module 2 to receive the data image signal of YUV 4:4:4 form, and carry out recognition of face according to the data image signal of described YUV 4:4:4 form, described recognition of face is specially, judge whether the pixel value of the pixel in the data image signal of described YUV 4:4:4 form drops in skin color range, if, then regard as skin pixel, if not, then regard as non-skin pixel, all skin pixels are combined into facial image, human eye locating module, be arranged in the gauge panel of automobile, connect described face recognition module to receive facial image, and the feature bigger than normal according to the brightness value in the pixel value of the pixel at human eye position, assert the pixel belonging to people's eye portion in facial image, all people's eye combination of pixels becomes eye image, described fatigue state anticipation module 3 is arranged in the gauge panel of automobile, connect described human eye locating module to receive described eye image, extract driver's eyes closing period according to described eye image, and export described driver's eyes closing period and account for the ratio that described eye image is sampled the time, described controller module 4 is arranged in the gauge panel of automobile, connect described fatigue state anticipation module 3, enter or exit fatigue state master mode according to the control command that user is sent by the control button on bearing circle, when entering fatigue state master mode, receive the described ratio that described fatigue state anticipation module 3 exports, when described ratio is more than or equal to the first predetermined threshold, send extremely tired alerting signal, when described ratio is between the first predetermined threshold and the second predetermined threshold, send moderate fatigue warning signal, when described ratio is less than or equal to the second predetermined threshold, send state normal signal, described first predetermined threshold is greater than described second predetermined threshold, speed of a motor vehicle control module, be arranged in the gauge panel of automobile, connection control device module 4 is to receive extremely fatigue warning signal, moderate fatigue warning signal or state normal signal, when receiving extremely tired alerting signal, controlling the moving velocity of automobile at 20 kilometers per hour, when receiving moderate fatigue warning signal, controlling the moving velocity of automobile at 40 kilometers per hour, when receiving state normal signal, automobile driving speed is not controlled, wireless data communication module, be arranged on the vehicle body of automobile, connection control device module 4 and speed of a motor vehicle control module, to send on the network of automobile affiliated unit by cordless communication network by extremely tired alerting signal, moderate fatigue warning signal, state normal signal and current vehicle speed or to send on the mobile phone of automobile driver relatives, voice playing module, is arranged in the gauge panel of automobile, connection control device module 4 and speed of a motor vehicle control module, to be play extremely tired alerting signal, moderate fatigue warning signal, state normal signal and current vehicle speed voice content corresponding respectively by microphone, display module, be arranged in the gauge panel of automobile, connect color space convert module, controller module 4 and speed of a motor vehicle control module, the data image signal of the RGB888 form that display color space convert module exports, and the word content that display is corresponding respectively with extremely tired alerting signal, moderate fatigue warning signal, state normal signal and current vehicle speed, solar powered module, comprise and be fixed on car body to gather the photovoltaic panel of solar power, detect the electricity of automobile self storage battery, when the electricity of automobile self storage battery is less than predetermined power threshold, image capture module 1, image pre-processing module 2, color space convert module, face recognition module, human eye locating module, fatigue state anticipation module 3, controller module 4, speed of a motor vehicle control module, wireless data communication module, voice playing module and display module are powered.
Wherein, the computer technology utilizing com-parison and analysis face visual signature information to carry out identity verify is refered in particular in recognition of face.Recognition of face is a popular computer technology field of research, face light and shade can be detected, and adjustment dynamic exposure compensates automatically, and face tracking is detected, and automatically adjusts image zoom; He belongs to biometrics identification technology, is to distinguish biosome individuality to the biological characteristic of biosome (generally refering in particular to people) itself.Most important technology in face recognition technology is that face looks detect, described looks detect and refer to judge whether to there is image surface in dynamic scene with complicated background, and isolate this image surface, generally there is following several method: (1) reference template method, first the template of or several standard faces is designed, then calculate the matching degree between the sample of test collection and standard form, and passing threshold judges whether to there is face; (2) face rule method, because face has certain structure distribution feature, namely the method for so-called face rule is extracted these features and is generated corresponding rule to judge whether test sample comprises face; (3) sample learning method, namely this method adopts the method for artificial neural net (ANN) in pattern-recognition, namely produces segregator as sample sets and non-face as the study of sample sets by opposite; (4) complexion model method, this method detects according to distribute in the color space rule of Relatively centralized of the looks colours of skin; (5) the sub-face method of feature, this method is that all image surface set are considered as an image surface subspace, and whether there is image surface based on the Distance Judgment detected between sample and its projection between sub-aperture.
In addition, described fatigue of automobile driver state anticipation system comprises further: voice playing module and display module are integrated into an audio frequency and video alarm module to carry out audio frequency and video warning.Described audio frequency and video alarm module realizes the function of original voice playing module and display module, with playing audio-video content timely when there is emergency, reminds automobile driver to take urgent measure.
In addition, described fatigue of automobile driver state anticipation system comprises further: manual power switching module, switches the power supply of solar powered module and automobile self storage battery under chaufeur M/C.Like this, automobile driver according to the charge condition of solar powered module of observation and the charge condition of automobile self storage battery, can carry out the selection of power supply easily between.
Wherein, the automotive battery of described Automobile storage battery electric energy distribution system is lead-acid battery, the chemical reaction of its electric discharge relies on positive plate active substance and positive and negative pole active matter to carry out under the effect of battery acid (dilution heat of sulfuric acid), and wherein the gratings of pole plate manufactures with antimonial lead.When the effect of lead-acid battery has (1) start the engine in the car, provide powerful starting current (generally up to 200 ~ 600A) to starter; (2) when generator overload, electrical generator can be assisted to power to consumer; (3) when driving engine is in idling, power to consumer; (4) when the electro-motive force of generator voltage higher than lead battery, be that chemical power stores by a part of converting electric energy, namely charge; (5) storage battery or a large value capacitor, can protect the current consumer of automobile.Except lead-acid battery, described automotive battery can also adopt nickel-cadmium cell, Ni-MH battery, lithium ion battery, lithium polymer battery equal-specification.
In addition, described fatigue of automobile driver state anticipation system comprises further: extremely tired alerting signal, moderate fatigue warning signal, state normal signal and current vehicle speed are also sent on the network of local traffic control department by cordless communication network by wireless data communication module.Described wireless data communication module can be 3G communication module or 4G communication module.
Wherein, G mobile communication (3rd-generation, 3G), refers to the cellular mobile telecommunications technology supporting high speed data transmission.3G service can transmit sound and data message simultaneously, and speed is generally at more than hundreds of kbps.3G refers to third generation mobile communication system radio communication be combined with multimedia communications such as Internets, and current 3G exists four kinds of standard: CDMA2000, WCDMA, TD-SCDMA, WiMAX.The key distinction of 3G and 2G is the lifting in the speed of transmission voice and data, he can realize radio roaming in the world better, and process the media forms such as image, music, video flowing, the much information service such as providing package purse rope page browsing, conference cal, ecommerce, also will consider the favorable compatibility with existing second-generation system simultaneously.In order to provide this service, wireless network must can support different data rates, that is can support the speed of transmission (this numerical value can change according to network environment) of at least 2Mbps (megabit/per second), 384kbps (kilobit/per second) and 144kbps in environment that is indoor, outdoor and that drive a vehicle respectively.
Wherein, 4G is the abbreviation of forth generation mobile communication and technology thereof, is to integrate 3G and WLAN and can high quality video image and image transmitting quality and the equal technical products of high definition television.4G system can be downloaded with the speed of 100Mbps, and than dialling up on the telephone fast 2000 times, the speed uploaded also can reach 20Mbps, and can meet the requirement of nearly all user for wireless service.In addition, 4G can not have chlamydate place to dispose at DSL and Cable Modem, and then expands to whole distract.Clearly, 4G has incomparable preceence.
Adopt fatigue of automobile driver state anticipation system of the present invention, by image recognition technology, the people's eye portion in the image of shooting is identified, and by means of the feature that eyes closed degree is relevant to degree of fatigue, people's eye portion is analyzed, to draw fatigue strength anticipation result, by local for fatigue strength anticipation result audio and video playing, be wirelessly transmitted to relevant unit and individual, for when unsafe condition occurs, reduce the speed of a motor vehicle and fast notification automobile driver, improve the safety of driving.
Be understandable that, although the present invention with preferred embodiment disclose as above, but above-described embodiment and be not used to limit the present invention.For any those of ordinary skill in the art, do not departing under technical solution of the present invention ambit, the technology contents of above-mentioned announcement all can be utilized to make many possible variations and modification to technical solution of the present invention, or be revised as the Equivalent embodiments of equivalent variations.Therefore, every content not departing from technical solution of the present invention, according to technical spirit of the present invention to any simple modification made for any of the above embodiments, equivalent variations and modification, all still belongs in the scope of technical solution of the present invention protection.