DE102012009833A1 - Method for assisting rider of motor car, involves recognizing guard reflex reaction of rider based on rider state variable, and triggering intervention into driving dynamics of motor car if guard reflex reaction is recognized - Google Patents

Abstract

The method involves detecting a state of a rider (15) by a sensor unit (30) i.e. acoustic sensor (32), where state of the rider describes rider state variable. A guard reflex reaction e.g. eye protection reaction, of the rider is recognized by a recognizing unit (50) based on the rider state variable. An intervention is triggered into a driving dynamics of a motor car (10) by a control unit (60) if the guard reflex reaction is recognized. A driver assistance system (70) is activated for carrying out autonomous driving maneuvers for triggering the intervention. An independent claim is also included for a super-ordinate driver assistance system for assisting a rider of a motor car.

Description

The invention relates to a method for assisting a driver of a motor vehicle in situations in which the driver is temporarily unable to control the vehicle because of a protective reflex reaction, a corresponding driver assistance system and a vehicle, in particular a motor vehicle, in which the method is carried out or which is a corresponding driver assistance system includes.

Drivers of vehicles are increasingly supported by methods and corresponding driver assistance systems, in particular with the aim of increasing driving safety. Thus, modern vehicles have systems such as lane departure warning or brake assistants. If activated, these systems make the driver aware of the danger situations which have occurred, for example leaving a lane, or even possibly intervene in the driving dynamics of the vehicle in order to defuse the dangerous situation. However, the systems can only operate if they have been activated by the driver. However, there are situations in which a driver may unpredictably be unable, or not fully able, to drive his vehicle for short periods of time.

The present invention has for its object to provide methods and corresponding higher-level driver assistance systems, by means of which the driving safety can be increased even in such unpredictable situations.

The object is achieved by a method having the features of the main claim, a higher-level driver assistance system having the features of the independent claim and a vehicle, in particular a motor vehicle having the features of the further subsidiary claim.

Accordingly, in a first aspect, the invention relates to a method for assisting a driver of a motor vehicle, in which a driver state variable is detected which describes a state of the driver. Depending on the driver state variable, a recognition of a protective reflex reaction of the driver, as a result of which the driver could temporarily be unfit to drive, is either completely unfit to drive or at least partially unfit to drive. If it should be recognized that such a protective reflex reaction actually exists, an intervention in the driving dynamics of the motor vehicle takes place. This intervention in the driving dynamics contributes to increasing driving safety, although the driver himself might not be able to drive his own vehicle due to the protective reflex reaction.

According to one embodiment, the detection of the respective driver state variable takes place with one or more sensor means, in particular with acoustic sensors such as microphones, motion sensors, optical sensors such as cameras, wherein the optical sensors can in particular represent image recognition devices which enable an evaluation of the captured images, and / or with pressure sensors. These sensors detect the driver's utterances, views of his body, body parts or body regions, movements of his or her body or parts of the body, and / or related pressure changes on the driver's seat. Corresponding analysis means recognize on the basis of these driver state variables, for example from the detected vocalizations, movements and / or pressure changes, whether a respective driver protection reaction is present. Examples of corresponding analysis means are vehicle computers or vehicle central computers which are specifically assigned to the method and in which data collected by sensor means of the motor vehicle converge centrally and are analyzed.

Protective reflex reactions that could temporarily disable a driver are widely known and include at least those where the driver performs an involuntary reflex, a reflex that would expire even if the driver were to suppress it. A first example of such a protective reflex reaction is a sneezing, either a single sneezing or a repeated sneezing in the sense of a sneezing attack, as occurs, for example, in the case of a cold, high dust exposure or in particular in the presence of an allergic reaction. Another example is a cough, especially a coughing fit, which, for example, could also be the result of a cold, high dust exposure or an allergic reaction, or the result of swallowing. Another example is an eye protection reaction. Such an eye protection reaction can be a heavy lacrimation of the eyes, for example, triggered by irritating substances, dust or allergens in the vehicle interior, by strong light or glare, or by strong emotions, a closing of the eyes, such as triggered by perceived, fast approaching objects, or a repeated rapid blink of an eye, such as in response to a heavy stream of tears or particles reaching the eye. Another example is rapid movement of the body or body parts of the driver. So it can happen that a driver ducks jerky, because an object abruptly approaching his vehicle, such as whirled up from the road surface objects, or in contact with hot objects such as cigarette holders or cigarette lighter, or sharp objects, such as in careless storage bags Objects, the moving hand pulls away jerkily. In such or similar situations, protective reflex responses provide protection from the threat recognized by the body, such as dust, pollen, sun, threatening rapidly approaching objects, or pain causing objects. They thereby lead to a possible temporary unfitness for driving since they impair or prevent the driver's ability to perceive the current driving situation or to react to it by physical reactions. Another example of protective reflex responses are reflex movements with a movement pattern typical of an impaired driver's health, such as reflex movements with a pattern of motion indicative of an epileptic seizure or myocardial infarction. Upon detection of such a protective reflex reaction advantageously also an automatic emergency call is sent to an emergency call center.

It will be clear to those skilled in the art that, for example, during a sneeze, in spite of best will, no driver will be fully able to pay attention to his vehicle and the surrounding traffic.

Triggering an intervention in the driving dynamics of the motor vehicle in one embodiment includes activating a driver assistance system, which is designed to perform autonomous driving maneuvers, ie driving maneuvers that can be done independently of the driver. Thus, if it is detected that the driver could currently be unable to drive due to a protective reflex reaction, an activation of a driver assistance system takes place within the scope of the method. If necessary, this can intervene in the driving dynamics of the vehicle and prevent, end or at least defuse dangerous driving situations.

In a development of the method, it is provided that activation takes place for a limited period of time. This period of time can be preset at the factory or specified by the driver. Examples of suitable durations are one or a few seconds. For example, a single sneeze or a short cough usually lasts about one to five seconds, especially one to two seconds, as well as a malaise due to lacrimation or knee-jerk body or body motion. Prolonged sneezing, especially those with allergic causes, or coughing fits, such as severe colds or irritant attacks, can last for several seconds to half a minute or longer. The intervention in the driving dynamics takes place in the training for the respective predetermined period of time and ends after their expiration, since it can be assumed that the driver is then again fully roadworthy and can exert unrestricted control of his vehicle.

According to an alternative development, the activation takes place as long as the protective reflex reaction persists and ends thereafter. For example, a sneezing can be detected via acoustic sensors, which can be recognized via a corresponding analysis means as a driver protection reaction. Detection may be via an abrupt increase in volume that would be untypical for a normal conversation between vehicle occupants or for music in the vehicle, or by comparison with sound patterns stored in a vehicle database. Alternatively, a sneeze can be detected by the typical forward movement of the upper body, such as a motion sensor or an image recognition device, or one or more pressure sensors based on the weight shift towards the front part of the seat surface of the driver's seat. Likewise, for example, a reflexive retraction of a hand or arm, such as when touching a hot object that disrupts the driver's attention, or at least restricts his or her motor ability to operate the vehicle, may be detected via optical or motion sensors or an image recognition device and via an analyzing means as a protective reflex response be recognized. As another example, a heavy lachrymation or a repeated blink of eye may be detected via motion sensors oriented on the driver's face or an image recognition device and recognized by an analyzing means as a protective reflex response. Does not resume sneezing after sneezing, or is a jerky reflex movement again detached from immobility or quiet movements, or ends a tear flow or a repeated eyelid, it can be seen through the analysis means that the corresponding protective reflex reaction is completed, so that the Activation of the driver assistance system can be canceled again.

In embodiments of the two developments mentioned above, it is provided that initially a check is carried out as to whether a corresponding driver assistance system is already activated in any case. If this is the case, then no activation of the respective appropriate driver assistance system needs to take place after a detected protective reflex reaction, and accordingly no inactivation of the driver assistance system after completion of the protective reflex reaction, since the driver obviously provided for its operation.

As a driver assistance system, all known systems are in question, with which autonomous driving maneuvers are feasible and which are accordingly suitable to take control of a vehicle partially or completely, if one temporary inability to drive due to a detected protective reflex reaction. According to one embodiment, the driver assistance system fulfills the functions of a lane departure warning assistant and / or an emergency brake assistant and / or an adaptive cruise control system and / or an autonomous driving system and / or a hazard warning activation system, a traffic sign recognition system and / or an electronic stability control system.

A lane departure warning system makes it possible to follow the lane course of the traveled road and prevents the motor vehicle from leaving the lane, bouncing on roadside obstacles, colliding with road users traveling next to the motor vehicle or even oncoming road users. An emergency brake assist initiates autonomous speed reduction or deceleration to a halt when collision course is detected in the direction of travel with road users or objects located within a critical distance. In an adaptive cruise control system, the speed of the own motor vehicle as well as the speed and the distance of a preceding vehicle or vehicle are determined via corresponding sensors, and the speed of the own vehicle is controlled by intervening in its engine management system and / or its brake system taking into account the own speed a safe distance to the preceding road user or vehicle is maintained. An autonomous driving system combines the aforementioned driver assistance systems and enables autonomous longitudinal and transverse guidance of the motor vehicle. A system for warning flashers activates the hazard warning system of the motor vehicle and gives following and oncoming road users the opportunity to adjust to possible obstructions or dangers emanating from the motor vehicle, so that the danger potential as a whole is reduced. A traffic sign recognition system recognizes traffic signs via optical sensors and subsequent image recognition, which provide information on permissible driving directions, permissible turning behavior, permissible trafficable roads and / or permitted maximum or minimum speeds. According recognized limitations can be issued at least acoustically or visually to the driver of the motor vehicle or fed into an autonomous driving system and taken into account by this. A system for electronic stability control enables safer roadholding, lateral and longitudinal guidance of the motor vehicle and can make the driving behavior of the motor vehicle safer with autonomous activation.

If the protective reflex reaction is caused by a sudden health impairment, for example by an epileptic seizure or a heart attack, the vehicle is advantageously braked to a standstill by the driver assistance system. Preferably, the vehicle is thereby held in its current lane, or if at the roadway edge a stop surface suitable for holding is detected, directed to this.

In the context of a method according to the invention, of course, the option is provided that two or more driver state variables are detected and incorporated into the detection of a protective reflex reaction of the driver. For example, a jerky movement of the upper body of a driver can be detected as a driver state variable, which alone could already be used as a basis for the detection of a sneeze as a protective reflex reaction. To increase the accuracy but can be detected as a further driver state variable via an acoustic sensor such as a microphone, a sneezing noise and incorporated into the detection of the protective reflex response. In this way false-positive detections can be better avoided. For example, if a sneeze is detected via an acoustic sensor that is not directionally and positionally selective to the driver, however, a motion sensor selectively oriented to the driver or an image driver selectively oriented to the driver indicates that the sneeze-like jerking typical of sneezing the upper body or at least the neck of the driver is omitted, it can be assumed that not the driver, but another car occupant has sneezed. Triggering an intervention in the driving dynamics of the motor vehicle is thus not required in this case.

In a second aspect, the invention relates to a higher-level driver assistance system for assisting a driver of a motor vehicle. Such a higher-level driver assistance system is particularly suitable for carrying out a method according to the invention. The higher-level driver assistance system comprises at least one sensor means for detecting a state variable describing a condition of the driver, an analysis means for detecting a protective reflex response based on the driver state variable, and a control means for triggering an intervention in the driving dynamics in the event that a protective reflex response has been detected by the analysis means. Reference is also made to the implicit or explicit information on the driver assistance system which has been made in the context of the disclosure of the method according to the invention.

As a sensor means are accordingly suitable, for example, acoustic sensors, optical Sensors, motion sensors, image recognition devices and / or pressure sensors that detect vocalizations of the driver, views of his body, of body parts or body regions, movements of his body or body parts and / or pressure changes related to the driver's seat. Examples of analysis means are vehicle computers or vehicle central computers especially assigned to the driver assistance system, in which data collected by sensor means of the motor vehicle converge and are analyzed centrally. The analysis means and the control means may in particular represent a functional and / or structural unit, wherein after detection of a protective reflex reaction by the analysis means, the control means triggers an intervention in the driving dynamics.

Analogously to the method according to the invention, according to one embodiment, at least one of the following reactions is detected as a protective reflex reaction in the higher-ranking driver assistance system according to the invention: a sneezing or sneezing attack, a coughing or coughing fit, an eye protection reaction, a reflex movement. According to further embodiments, the intervention in the vehicle dynamics takes place via activation of a driver assistance system which is assigned to the higher-level driver assistance system according to the invention and, so to speak, represents a subordinate driver assistance system, since it can be activated and deactivated again by the higher-level driver assistance system. In particular embodiments, the driver assistance system includes at least one of the following systems: a lane departure warning system, an adaptive cruise control system, an emergency brake assistant, an autonomous driving system, a hazard warning activation system, a traffic sign recognition system, an electronic stability control system.

In a third aspect, the invention relates to a vehicle, in particular a motor vehicle, which comprises a driver assistance system according to the invention or in which a method according to the invention is carried out.

Further advantages, features and details will become apparent from the following description of the figures and the examples in which, where appropriate, with reference to the figures, embodiments are described in detail. Described and / or illustrated features form the subject of the invention, or independently of the claims, either alone or in any meaningful combination, and in particular may additionally be the subject of one or more separate applications. The same, similar and / or functionally identical objects are provided with the same reference numerals.

Showing:

1 a schematic flow diagram of a method according to the invention

2 a schematic plan view of a motor vehicle with a higher-level driver assistance system according to the invention

In 1 is shown a schematic flow diagram of a method according to the invention. In a first process step 100 there is a detection of a driver's condition 15 descriptive driver state size. In a second process step 200 is detected depending on the driver state size, whether a protective reflex reaction of the driver 15 is present. If this is not the case, then the first process step 100 repeated until actually a protective reflex reaction of the driver 15 in the process step 200 is recognized. In this case, in a third process step 300 an intervention in the driving dynamics of the motor vehicle 10 triggered. Thereafter, the first process step 100 executed recursively to update the driver state size. Is still a protective reflex response from the driver, depending on the updated driver state size 15 before, so according to the second process step 200 again triggering an intervention in the driving dynamics of the motor vehicle 10 or maintaining the intervention that was already triggered in the previous query cycle. On the other hand, has the driver state variable changed so much that there is no protective reflex response from the driver 15 is detected more, so there is no further triggering an intervention in the vehicle dynamics or a termination of the previous intervention. The car 10 is subject again to the sole control of the driver 15 ,

2 shows a schematic plan view of a motor vehicle 10 with two front seats and a rear seat, the backrests are each hatched vertically. There is a driver in the driver's seat 15 , The car 10 has a superordinate driver assistance system 20 on that in 2 symbolically indicated by a dashed rectangle. The superior driver assistance system 20 is a variety of sensor means 30 assigned with which a condition of the driver 15 descriptive state variables are detectable. The sensor means shown by way of example and arranged by way of example 30 include an acoustic sensor 32 , two optical sensors 36 simultaneously acting as image recognition devices 38 are formed, a motion sensor 34 and four pressure sensors arranged in the seat surface of the driver's seat 40 that are below the driver 20 are symbolized by dotted, obliquely hatched rectangles. Over as dashed lines or Dotted lines symbolized data lines or wireless transmit the sensor means 30 recorded driver state variables of the driver 15 For example, he made utterances, lid positions, head and upper body postures. The transmission takes place to an analysis means 50 in which it is detected whether one or more driver state variables on one or more protective reflex reactions of the driver 15 clues. If this is the case, then via a control means 60 , especially with the analysis means 50 is summarized, a the superior driver assistance system 20 subordinate driver assistance system 70 activated. If necessary, the driver assistance system will take over 70 an intervention in the driving dynamics of the vehicle 10 in front.

Example 1:

A driver 15 drives in his motor vehicle 10 that with an overriding driver assistance system 20 Is provided. The driver 15 Suffers a sudden sneeze. motion sensors 34 and image recognition devices 38 detect as driver state variables repeated jerky prevention of the upper body and the head of the driver 15 , An analysis tool 50 recognizes this as a protective reflex reaction that matches a sneezing attack. At the same time an acoustic sensor detects 32 Loudness as driver state size, which is the analytical tool 50 after matching with a database of phonetic patterns also classified as sneezing and thus recognizes the corresponding protective reflex reaction of sneezing. The detection of the protective reflex response of a sneeze event, which has been carried out twice independently, leads to an intervention in the driving dynamics of the motor vehicle 10 , Because of analysis means 50 detected protective reflex reaction activates a control means 60 several of the parent driver assistance system 20 subordinate driver assistance systems 70 namely, a lane departure warning system and an adaptive cruise control system. The lane departure warning prevents the motor vehicle 10 despite the driver who was not fully able to drive during the sneezing attack 15 his lane leaves and potentially the driver 15 and / or other road users at risk. The system for adaptive cruise control prevents the motor vehicle 10 If necessary, it starts braking too close to the vehicle in front and, if necessary, initiates braking until it stops. Once the sneeze has ended, appropriately updated driver state quantities are captured and analyzed 50 an elimination of the protective reflex reaction of sneezing detected. Then the intervention in the driving dynamics is stopped by the activation of the driver assistance systems 70 on the part of the higher-level driver assistance system 20 aborts. Preferably, a notification is sent to the driver 15 issued and asked the driver hereby, to take over the vehicle again fully.

Example 2:

A driver 15 drives in his motor vehicle 10 that with an overriding driver assistance system 20 Is provided. Suddenly in the car 10 Penetrating pollen dissolves in the driver 15 as an allergic reaction, a strong stream of tearing and frequent blinking. Motion sensors aimed at the driver's eyes 34 As a driver state variable, capture the frequent eyelid stroke from the analysis agent 50 is recognized as an allergic protective reflex reaction. At the same time, an image recognition device detects 38 on the eyes and lower eyelids of the driver 15 also the frequent eyelid strike as well as the strong tear flow as driver state variables, which are aimed by the analysis medium 50 also be recognized as allergic protective reflex reactions. Because the driver may be temporarily unable to drive due to the flow of tears and the distraction of the allergic reaction, the control means 60 the same driver assistance systems 70 activated as in Example 1.

Example 3:

The driver of example 1 drives in his motor vehicle 10 when suddenly a wasp enters the driver's compartment through an open window. The driver 15 Performs with his arm a jerky reflex movement to ward off the insect. This is called driver state size by the motion sensors 34 and the image recognition devices 38 captured and analyzed 50 recognized as a protective reflex reaction. There is the same intervention in the driving dynamics as in Example 1. The intervention ends automatically after ten seconds. This time is variable in the case of reflex movements changeable, since it is assumed that after this period the protective reflex reactions are replaced by controlled rational actions.

LIST OF REFERENCE NUMBERS

10

motor vehicle

15

driver

20

Superior driver assistance system

30

sensor means

32

acoustic sensor

34

motion sensor

36

optical sensor

38

Image recognition device

40

pressure sensor

50

analysis means

60

control means

70

Driver assistance system

100

first process step

200

second process step

200

third process step

Claims (10)

Procedure for assisting a driver ( 15 ) of a motor vehicle ( 10 ), comprising - detecting a condition of the driver ( 15 ) describing driver state variable - depending on the driver state variable recognizing a protective reflex reaction of the driver ( 15 ), due to which the driver could temporarily be unable to drive - triggering an intervention in the driving dynamics of the motor vehicle ( 10 ) if a protective reflex response is detected. A method according to claim 1, characterized in that the driver state quantity with one or more of the following sensor means ( 30 ) is detected: an acoustic sensor ( 32 ), a motion sensor ( 34 ), an optical sensor ( 36 ), an image recognition device ( 38 ), a pressure sensor ( 40 ). Method according to one of the preceding claims, characterized in that one or more of the following reactions are recognized as protective reflex reaction: sneezing or sneezing, coughing or coughing, eye protection reaction or reflex movement. Method according to one of the preceding claims, characterized by activating a driver assistance system designed for carrying out autonomous driving maneuvers ( 70 ) for triggering the procedure. A method according to claim 4, characterized in that the activation takes place for a limited period of time. A method according to claim 4, characterized in that the activation takes place as long as the protective reflex reaction persists. Method according to one of claims 4 to 6, characterized in that the driver assistance system ( 70 ) fulfills the function of a lane departure warning system and / or an Adaptive Cruise Control System and / or an Emergency Brake Assist and / or Autonomous Driving System and / or a hazard warning activation system and / or a traffic sign recognition system and / or an electronic stability control system. Higher level driver assistance system ( 20 ) in support of a driver ( 15 ) of a motor vehicle ( 10 ), comprising - a sensor means ( 30 ) for detecting a condition of the driver ( 15 ) descriptive state variable, - an analysis means ( 50 ) for recognizing a protective reflex response based on the driver state variable, - a control means ( 60 ) for triggering an intervention in the driving dynamics in the event that a protective reflex response from the analysis means ( 50 ) was detected. Higher level driver assistance system ( 20 ) according to claim 8, characterized in that the analysis means ( 50 ) is configured to detect at least one of the following reactions as a protective reflex reaction: a sneezing or sneezing, a coughing or coughing fit, an eye protection reaction, a reflex movement, and / or intervention in driving dynamics by activating a driver assistance system ( 70 ), wherein the driver assistance system ( 70 ) comprises at least one of the following systems: a lane departure warning system, an adaptive cruise control system, an emergency braking assistant, an autonomous driving system, a hazard warning activation system, a traffic sign recognition system, an electronic stability control system. Motor vehicle ( 10 ), in which a method according to one of claims 1 to 7 is carried out, or a higher-level driver assistance system ( 20 ) according to claim 8 or claim 9.

Images