DE10024227B4 - Method and device for the electronic monitoring of the degree of attention - Google Patents

Abstract

A method for electronically monitoring the degree of attention of a motor vehicle driver by electronic monitoring of the eyes and eyelid activity, wherein in electronic registration of fatigue an alarm signal is generated, and with appropriate registration of fatigue, the speed is automatically reduced, characterized in that captures the driver's line of sight and is evaluated, wherein the fatigue and the direction of view are determined by a pattern matching method, and in follow-up driving in situations in which the person in front leaves the road in inattention or technical defects or out of order, an automatic follow this vehicle is suppressed by the fact that the straight Directed look of the motor vehicle driver is assessed.

Description

The The invention relates to methods for the electronic monitoring of the degree of attention or the eyes and / or eyelid activity with motor vehicle drivers, and a corresponding electronic monitoring device the eye area of a motor vehicle driver while driving, according to the preamble of the claims 1, 2 and 7.

method and devices of this kind are already known in the art such known.

So is out of the DE 196 21 435 A1 a device for monitoring the eyes for detecting a drowsiness state of a motor vehicle driver known. A camera picks up the eyes of the driver and evaluates the movement of the eyes as such. With the aid of certain evaluation criteria, a drowsiness state is derived from the evaluation of the eyes and the eyelid activity. Essentially, the focus here is on the eyes or on the said eye area and the tracking operation of the camera in the foreground. With a corresponding rating of drowsiness, a warning signal is then generated.

From the DE 296 07 558 U1 a monitoring of the duration of Augenlidschlusses known, in which when a certain eyelid closure duration exceeded an alarm signal is triggered.

From the DE 197 15 519 A1 is a device for assessing the level of drowsiness of the driver of a vehicle known. The frequency distribution of eye blinks, the duration of the blinking processes, and the proportion of slow blinking processes, measured by the total number of blinking operations of the eyelids, are evaluated. For this purpose, statistical methods are used which determine stochastic values according to accumulation laws and corresponding distribution curves. From these then appropriate logical criteria are derived, which should close a drowsiness state of the motor vehicle driver. Here, too, an alarm signal is generated with appropriate evaluation of a drowsiness condition.

From the DE 295 04 973 U1 is a so-called Einschlafwächter specified with the monitoring of the heat radiation of the open and closed eye. The reflectance of the ocular surface or the state of tension of the ocular muscle influence the heat radiation of the ocular surface. From an assessment of this situation, an evaluation of the drowsiness condition of the driver is derived to the same extent and then a corresponding alarm signal is generated.

All Both methods equally assess drowsiness a motor vehicle driver from their eye activity or eyelid.

in this connection is from the said parameters, such as eyelid duration and heat radiation level out Indirectly it can also be determined if the eyelid is closed or opened is, exclusively only drowsiness certainly.

adversely here is that not all situations alike detectable in this way are. It turns out that the Lidschlußtätigkeit alone and a possibly increased Blinking may also have other causes than drowsiness.

Otherwise it is the generation exclusively an alarm signal no high guarantee that by drowsiness already arising critical traffic situations can be corrected as quickly as possible are. Rather, the triggering exclusively an alarm signal also dangerous fright conditions for the driver and the carried Cause inmates.

The publication DE 198 03 158 C1 describes a device for vigilance state determination of a person, in particular a driver of a motor vehicle, with a camera for receiving the area of at least one eye of the person and an evaluation unit, which includes means for determining the eyelid closure and means for determining the pupil diameter. The state of the driver is determined from the lid closure status information, which includes the duration of the eyelid closure and the lid closing frequency, as well as the pupil diameter information, in particular its oscillation frequency, and, if appropriate, measures such as slowing down the vehicle are initiated. Furthermore, an electronic tracking of the observation window of the camera with respect to the driver's eye is possible.

The publication DE 197 34 307 A1 describes a method and apparatus for monitoring and influencing the vehicle behavior of a driver-controlled motor vehicle, wherein by means of a device for determining the direction of view, the respective instantaneous line of sight of the driver is determined. The particular viewing direction is then compared with the current direction of travel of the vehicle and a warning signal and / or a control signal is generated as a function of the comparison result. In this case, a general statement about the driver's attention is derived from the detected line of vision. Furthermore, the gaze direction signal can also be used in the context of an adaptive distance or cruise control.

The publication DE 195 09 689 C2 describes a method for detecting a vigilance of a person on the basis of eye parameters, in which the face of the person is illuminated, whereby the signals concerning a pupil position and / or pupil shape are extracted on the illuminated face of the person on the basis of the luminance distribution Areas on the face characterized by relatively high luminance, represented by signals at a first predetermined level, and areas characterized by a relatively low luminance being represented by signals at a second predetermined level, and the vigilance by a predetermined parameter is determined, which is derived from the signals relating to the pupil position and / or the pupil shape.

The The invention is therefore based on the object, method and device to improve this type by inattention and not just sleepiness arising traffic situations remain manageable, in particular then when the vehicle is in a short distance to the moving ahead moving vehicle moving column.

The asked task is in a method of the generic type according to the invention by the characterizing features of claim 1 solved.

at another method of the generic type, which content and functionally re its genus is synonymous with the former method, is the task posed by the characterizing features of Claim 2 solved according to the invention.

Further advantageous embodiments of said method according to the invention are dependent on the following claims 3-5 indicated.

in the With regard to a device according to the invention is the task according to the invention by the characterizing Characteristics of claim 6 solved.

Further advantageous embodiments of the device according to the invention are in the dependent other claims.

The Essence of the method according to the invention according to claim 1, that when monitoring of the eye and eyelid-related Level of attention and with appropriate registration of drowsiness taking into account the direction of view, the speed automatically is reduced. This is opposite the prior art now additionally a safety reserve incorporated, characterized in that a Intervention on the active driving depending on the registration such a reduced attention state is effected. It thus remains, opposite the prior art, not only in the triggering of an alarm signal, but dependent on the registered drowsiness state the speed is also automatically reduced.

there is in the following driving in situations in which the person in front the roadway out of inattention or for technical defects or contrary to the situation leaves, an automatic follow-up of the vehicle in question repressed that corrects the straight-ahead view of the motor vehicle driver is evaluated. This will result in functional affiliation all individual measures together a comfortable and safe traffic management also possible in traffic jam situations.

core the invention according to the method according to claim 2 is that a ADR controlled automatically controlled column or jam travel as additional parameter for the Attention and the line of sight of the motor vehicle driver electro-optical eye and eyelid observation is evaluated. In this Trap is the so-described eye activity observation as another Parameters integrated in an ADR control. This can be as claimed 1, for example, have the consequence that in addition to the triggered alarm signal also the speed is reduced, although the automatic Distance control (ADR) a higher Allow speed. Another essential aspect according to the method of claim 2 is that the electronic or opto-electronic eye observation not only on the eyelid activity limited, but that too the viewing direction is determined. Again, this is related to see the ADR regime. This is to prevent that one automatic distance control, which is based on the detection of the preceding Vehicle, willingly follows a vehicle, even if this unintentionally leaves the lane or possibly threatening to suffer an accident.

The corrective detection of the line of sight of the motor vehicle driver attacks here in the right way and compensates for this deficiency or fixes this.

In the case of follow-up driving in situations in which the vehicle driver leaves the road due to inattention, or due to technical deficiencies or in an unconventional way, an automatic follow-up of the relevant vehicle is thereby undermined expresses that the straight-ahead view of the motor vehicle driver is corrective evaluated. As a result, the functional affiliation of all individual measures together makes comfortable and safe traffic routing possible even in congestion situations.

In further advantageous embodiment is specified, and this relates On both a method according to claim 1, as well as a Method according to claim 2, characterized in that appropriate intervention on the electronic accelerator pedal operation and / or the electronic or electric brake and / or an electronic or electric steering operation he follows. In this way, the mentioned methods are in their Mode of operation so comfortable that a driver by correction or corresponding viewing direction and viewing direction evaluation the Vehicle automatically can control.

In Another advantageous embodiment is specified that the observation the eyes of the motor vehicle driver permanently or automatically with electronic jam detection only becomes active. This has the functional advantage that the system can serve as a congestion assistant so to speak and in particular the monotonous, soporific mode of operation counteracts the vehicle in the storage operation, and safety significantly increased.

In Another advantageous embodiment is specified that the electronic detected View of the motor vehicle driver involved in an autopilot control system of the motor vehicle becomes.

The Inclusion in an autopilot system means that the operation of the brake and accelerator pedal, possibly also the steering operation as far as possible automated in conjunction with a navigation system is. The additional Evaluation of the viewing direction of the motor vehicle driver, or the registration a state of drowsiness thus go as other safety-related variables with a, in the autopilot system then certain driving parameters, including, for example, the speed belongs, be significantly reduced by a temporary drowsiness resulting failures expected motor vehicle driver interventions compensated become. This will restore lost safety reserves.

According to the mentioned Device, the essence of the invention is that the detection tiredness and the viewing direction through a camera with a downstream pattern comparison evaluation unit he follows. Across from the beginning already described in the prior art arrangements Here, pattern matching methods or pattern matching evaluation methods are used applied. This is done in a corresponding memory unit Deposited patterns, but as such are adaptively deposited, so that System of the following users and their eye activity can learn, and about this Pattern created in memory. A corresponding evaluation unit This kind of camera also has the advantage that elaborate Calculation method as such omitted and by means of a computer unit only the pattern comparisons are performed. Certain patterns or represent pattern combinations while acute drowsiness or Fatigue.

In Another advantageous embodiment is specified that the camera an automatically tracking Camera is. For this purpose, different sized people are considered as motor vehicle driver, so that the Focusing the camera or the camera lens on the respective eye area automatically tracks.

In further advantageous embodiment of the device according to the invention is specified that electronic Image evaluation of the camera are connected downstream. Furthermore is stated that about the Image evaluation also an electronic tracking of the eye area of the motor vehicle driver containing Image section is feasible. With the help of this electronic Image evaluation means it is now possible that this Objectively quite with appropriate focal length a corresponding huge Viewing angle summarized that, however by electronic post processing of the image analysis on certain Angular ranges or detected Subareas is focusable. In this way, the camera is electronic trackable, by, so to speak, certain pixel segments have different sensitivities be evaluated so that this a mechanical camera tracking comes close.

With An image analysis of this kind can then be the camera as such and their lens also be fixed.

to correspondingly fast image evaluation are the image evaluation means electronically with an on-board motor vehicle computer for the entire transport and / or operational evaluation logically connected. In this way, also other driving data included in this central on-board motor vehicle computer and thus overall situations are detected. In this way is also an appropriate by evaluation of overall situations more complex reaction possibility given.

The The invention is illustrated in the drawing and described in more detail below.

It shows:

1 : View of camera arrangement in the motor vehicle.

2 : Logical interaction of the individual elements according to the invention.

1 shows a corresponding inventive arrangement in its mode of operation, from the perspective of a motor vehicle from behind. The motor vehicle driver 2 has thereby taken the vehicle seat properly and operates the motor vehicle in active driving. He looks as straight as possible or as far as possible through the windscreen 1 , In the middle above is the mirror in otherwise ordinary place 11 arranged, being in the housing of the mirror 11 a camera 10 is integrated. Thus, no additional space for the camera is necessary because this would otherwise sichtverdeckend or disturbing or possibly even distracting.

Through the camera 10 or the lens of the camera is now the field of vision of the motor vehicle driver 2 observed. In this case, the camera and the subsequent electronic system can either be permanently active or, applied to the said congestion and / or column rides, be activated only when the said situations occur. For this purpose, the vehicle still has more advanced sensors and possibly an automatic distance control system.

2 shows the logical connection of all necessary device-specific elements for carrying out the method according to the invention. Starting from a camera 10 The image data are from an image evaluation unit 12 processed. Within the image evaluation unit pattern matching methods are performed in the manner already described. For this purpose, so-called fuzzy methods are used.

The application of so-called fuzzy methods within the image evaluation unit 12 Of course, this assumes that appropriately organized field memories are created with patterns. These can either already be deposited as a basic pattern during vehicle production and, if appropriate, also be adaptively expanded in the further driving operation by the vehicle drivers who actuate or move a corresponding vehicle.

The data of the image evaluation unit 12 be from a motor vehicle computer 13 evaluated below and further. Inside the vehicle computer 13 If necessary, additional sensor data or other data are also cumulatively evaluated, including, for example, sensors 14 used for general traffic recording or monitoring. These can be distance sensors, etc.

Furthermore, the motor vehicle computer 13 in logical and information technology bidirectional connection with a navigation system 15 interconnected, which is also on-board. This navigation system also enables location-related data acquisitions and correlations. Thus, it is also possible to learn from certain situations when re-examining certain routes, possibly even dust-damaged routes as such, with a higher activation readiness of the system.

The output variables of the motor vehicle computer are then the manipulated variables in order to then also control the situation-appropriate behavior, which is evaluated according to image and continues to be evaluated by the motor vehicle computer, on automatic operation intervention. In this case, in fully automatic and thus autopilot-controlled vehicles not only individual intervention can take place, but it can also be a cumulative intervention on electric throttle 16 , on the electric brake control 17 and the electric steering operation 18 Be influenced. In this case, the influence can not be carried out either individually or as summation, ie in the sense of said autopilot system. The motor vehicle driver is thus able to influence the driving operation even with future possibly autopilot-controlled motor vehicles with his gaze and, if necessary, a gaze correction or gaze direction change. Thus, the method according to the invention as well as the device according to the invention are by far different from what is provided in the prior art mentioned at the outset.

Claims (10)

A method for electronically monitoring the degree of attention of a motor vehicle driver by electronic monitoring of the eyes and eyelid activity, wherein in electronic registration of fatigue an alarm signal is generated, and with appropriate registration of fatigue, the speed is automatically reduced, characterized in that captures the driver's line of sight and is evaluated, wherein the fatigue and the direction of view are determined by a pattern matching method, and in follow-up driving in situations in which the person in front leaves the road in inattention or technical defects or out of order, an automatic follow this vehicle is suppressed by the fact that the straight Directed look of the motor vehicle driver is assessed. Procedure for monitoring the eyes and eyelid activity of motor vehicle drivers, since Characterized in that an ADR-controlled automatically controlled column or Staufahrt as additional parameters the attention and the line of sight of the motor vehicle driver by electro-optical eye and Lidbeobachtung evaluated, and that in following situations in which the person in front of the road in inattention or from technical defects or out of order situation, an automatic follow-up of this vehicle is suppressed by the fact that the straight-ahead view of the motor vehicle driver is mitrt evaluating. Method according to claim 1 or 2, characterized that a corresponding intervention on the electronic accelerator pedal operation and / or on the electric, electronic brake and / or on an electric, electronic steering operation he follows. Method according to one of the preceding claims, characterized characterized in that the observation of the eyes or the eye area of the motor vehicle driver is permanently active, or only temporarily with electronic jam detection. Method according to one of the preceding claims, characterized in that the electronically detected view of the motor vehicle driver in an autopilot control system of the motor vehicle involved becomes. Device for electronically monitoring the eye area of a motor vehicle driver while driving, wherein the fatigue caused by a camera ( 10 ) with downstream image evaluation unit ( 12 ), characterized in that by the camera ( 10 ) with downstream image evaluation unit ( 12 ) the driver's line of sight is determined, the fatigue and the viewing direction being determined according to a pattern matching method, and the pattern matching method being stored in a memory of master patterns that are adaptively expandable. Device according to claim 6, characterized in that the camera ( 10 ) is an automatically tracking camera. Device according to one of claims 6 or 7, characterized in that electronic sensors ( 14 ) for recording operating or traffic parameters and the image evaluation of the image evaluation unit ( 12 ) in a motor vehicle computer ( 13 ) are summarized. Device according to claim 8, characterized in that that over the image evaluation means an electronic tracking of the eye area of the motor vehicle driver containing Image section feasible is. Device according to one of claims 6 to 9, characterized in that the image evaluation means electronically with an on-board motor vehicle computer ( 13 ) are logically connected to the overall traffic and / or operational evaluation, and that via the motor vehicle computer ( 13 ) in a similar manner, the operation of the electric accelerator pedal ( 16 ), and / or the electric brake ( 17 ), and / or the electric steering operation takes place.

Images