DE102008038816A1 - Method for backup of operation of vehicle, involves detecting condition of driver of vehicle with respect to condition of vehicle - Google Patents

Abstract

The method involves detecting a condition of a driver of a vehicle (10) with respect to the condition of the vehicle. A driving situation is detected, in which the vehicle is placed. A measurement is carried out depending on the condition of the driver and on the driving situation of the driver.

Description

The The present invention relates to a method and a device, to a driver when operating or driving his vehicle to support.

To the prior art are several driver assistance systems, such. As a brake assistant or a lane departure warning known. These known driver assistance systems support the driver while operating his vehicle, although a behavior the driver is not taken into account.

Therefore It is the object of the present invention, the prior art regarding driver assistance systems to improve that behavior of the driver is also taken into account in such a way that the operation of the vehicle is better supported, as this is the case today according to the prior art.

in the Within the scope of the present invention is a method of assistance the operation of a vehicle provided. This is on the one hand a state of a driver of the vehicle with regard to the operation of the vehicle detected and on the other a driving situation in which the vehicle is currently detected. Depending on the condition of the driver and depending on the detected Driving situation, at least one action is taken, the condition of the driver in relation to the operation of his vehicle and / or to improve a driving behavior of the vehicle.

There the condition of the driver, which is defined by, for example, what attention the driver is just keeping his head Vehicle or how tired the driver currently is, one great influence on the assessment of the current Driving situation in which the vehicle is located, is the inventive method a comparable Procedure that does not consider this condition of the driver, superior. If the inventive method, for example captured by an evaluation of camera images that the driver of the vehicle with a programming of its navigation device busy is a distance to one in front of the vehicle slowly before moving other road users more critical evaluate as if the inventive method Captures that the eyes of a sleeper driver forward are directed to the street.

• – Bewegungen des Kopfes des Fahrers; welche z. B. mit einer Kamera erfasst werden.
• – Bewegungen der Augen des Fahrers; welche z. B. mit einer Kamera erfasst werden.
• – Ein Öffnungsgrad der Augen des Fahrers; welcher z. B. mit einer Kamera erfasst wird.
• – Eine Lidschlussdauer der Augen des Fahrers; welcher z. B. mit einer Kamera erfasst wird.
• – Eine Öffnungsdauer der Augen des Fahrers; welche z. B. mit einer Kamera erfasst wird.
• – Eine Lidschlussdauer der Augen des Fahrers; welche z. B. mit einer Kamera erfasst wird.
• – Das Lenkverhalten des Fahrers; welches z. B. mit einer Kamera im Zusammenspiel mit einem Spurhaltesystem erfasst wird.
• – Muskelfunktionen des Fahrers; welche z. B. mit einer Kamera erfasst werden.
• – Der Hautwiderstand des Fahrers; welcher z. B. über Sensoren am Lenkrad erfasst wird.
• – Gehirnströme des Fahrers, welche z. B. durch Sensoren in der Kopfstütze erfasst werden.
• – Die Pulsfrequenz des Fahrers, welche z. B. über Sensoren am Lenkrad erfasst wird.
• – Blutwerte des Fahrers, welche z. B. über Sensoren am Lenkrad erfasst werden.
• – Die Atmung des Fahrers, welche z. B. durch im Dach eingebaute Sensoren erfasst wird.
• – Die Reaktionsfähigkeit des Fahrers; welche z. B. mit einer Kamera erfasst wird.
• – Die Mimik des Fahrers; welche z. B. mit einer Kamera erfasst wird. Aus der Mimik kann auf die Emotion und damit auf den Zustand des Fahrers zurückgeschlossen werden.
• – Die Stimme des Fahrers, über welche auf die Emotion und damit auf den Zustand des Fahrers zurückgeschlossen werden kann.

The condition of the driver can thereby be detected (permanently), for example, by determining at least one parameter of the driver, which is selected from the following group of parameters:

• - movements of the driver's head; which z. B. be detected with a camera.
• - movements of the driver's eyes; which z. B. be detected with a camera.
• - an opening degree of the eyes of the driver; which z. B. is detected with a camera.
• - A blink time of the eyes of the driver; which z. B. is detected with a camera.
• - an opening time of the eyes of the driver; which z. B. is detected with a camera.
• - A blink time of the eyes of the driver; which z. B. is detected with a camera.
• - the driver's steering behavior; which z. B. is detected with a camera in conjunction with a lane keeping system.
• - Muscle functions of the driver; which z. B. be detected with a camera.
• - The skin resistance of the driver; which z. B. is detected by sensors on the steering wheel.
• - Brain currents of the driver, which z. B. detected by sensors in the headrest.
• - The pulse rate of the driver, which z. B. is detected by sensors on the steering wheel.
• - Blood levels of the driver, which z. B. detected via sensors on the steering wheel.
• - The breathing of the driver, which z. B. is detected by built-in sensors in the roof.
• - The responsiveness of the driver; which z. B. is detected with a camera.
• - The facial expressions of the driver; which z. B. is detected with a camera. From the facial expressions can be deduced on the emotion and thus on the condition of the driver.
• - The voice of the driver, through which the emotion and thus the condition of the driver can be deduced.

there The at least one parameter of the driver is analyzed to provide information about a stress level, a fitness level and / or an attention level of the driver, and from this information the condition derive from the driver. In doing so, further eye, head and facial parameters of the driver's worth different psycho-physiological States of the driver are derived or analyzed. About these Analysis can then be a stress level, fitness level (including fatigue) and / or an attention level of the driver but also an intention as well a tension and emotions of the driver determined and from it the Condition of the driver are derived. At the level of attention this is in particular a degree of attention, with which the driver is currently operating or leading dedicated to his vehicle.

The level of attention can be determined in particular via the degree of eye opening or lid closure. Here is the Lidschlussgrad the percentage of a time unit in which the eyelid covers the eye at least 80%. The eye opening time or eyelid closure time are also good parameters for determining the attention level. As a rule, the driver's fatigue is greater the longer the eyelid closure time is and / or the lower the eyelid closure speed. The attention level can also be determined via the steering behavior or tracking. The slower the speed of the steering movements and / or the lower the number of steering movements per unit time, the more tired the driver is usually. In addition, the tracking usually decreases with a tired driver. Also by measuring muscle functions of the driver, the level of attention of the driver can be determined.

The Fatigue of the driver can also be over the head posture and head movement of the driver, his skin resistance, his voice, his brainwaves, his pulse rate, his Blood levels, his breathing, his muscle activity and his Determine responsiveness.

from time to time The driver's condition is also affected by the condition of others Inmates affected. Therefore, from the other inmates the vehicle has the same parameters as those listed at the top of the list are determined to state about these parameters the other inmates and thereby determine the determination of the To improve driver's condition.

• – Ein Bedienumfang von Instrumenten, wie z. B. Radio, Navigationsgerät oder Mobiltelefon, des Fahrzeugs wird abhängig von dem Zustand des Fahrers und/oder von der Fahrsituation eingeschränkt. Gerade bei kritischen Fahrsituationen und einem unaufmerksamen Fahrer kann die Bedienung von Instrumenten des Fahrzeugs auf diejenigen Instrumente eingeschränkt werden, welche den Betrieb des Fahrzeugs unmittelbar verbessern, wie z. B. Einschalten des Abblendlichts, Betätigung des Scheibenwischers oder Aktivierung eines Nachtsichtassistenten, wohingegen die Bedienung von so genannten Infotainmentinstrumenten stark eingeschränkt wird, so dass beispielsweise nur noch ein Abschalten solcher Instrumente möglich ist. Dagegen wird in unkritischen Situationen die Nutzung zusätzlicher Fahrzeugfunktionen, wie beispielsweise von Infotainmentfunktionen, durch das erfindungsgemäße Verfahren ermöglicht.
• – Informationen werden an den Fahrer in Abhängigkeit von dem Zustand des Fahrers und/oder der Fahrsituation ausgegeben. Beispielsweise können in kritischen Fahrsituationen und bei einem nicht aufmerksamen Fahrer nur noch solche Informationen ausgegeben werden, welche den Betrieb des Fahrzeugs in der aktuellen Situation zu verbessern helfen, wie z. B. eine Warnung vor einem sich der Straße nähernden Lebewesen durch einen Nachtsichtassistenten. Dagegen sind Warnungen oder Hinweise, welche sich beispielsweise auf Infotainmentinstrumente oder auf in weiterer Zukunft liegende Betriebszustände des Fahrzeugs beziehen, wie z. B. eine Tankwarnanzeige, in solchen Fällen zu unterdrücken. Es wird dem Fahrer also je nach Aufmerksamkeitsgrad, situationsangepasst und benutzerprofilabhängig im Fahrzeug zur Verfügung stehende Funktionen, wie beispielsweise Infotainmentfunktionen, verschiedenartig angeboten.
• – Gezielte Handlungsaufforderungen oder Handlungsempfehlungen (einschließlich von Warnungen) werden an den Fahrer ausgegeben, um seinen Blick beispielsweise nach vorn auf die Straße zu lenken. Dies umfasst auch Aktionen, um eine Blickzuwendung des Fahrers auf bestimmte Objekte oder Informationen auszulösen.
• – Eine automatisch ermittelte Blickrichtung wird anhand der aktuellen Fahrsituation überprüft und gegebenenfalls an die Fahrsituation angepasst. Wenn beispielsweise erkannt wird, dass der Fahrer auf sein Radio schaut, während er mit hoher Geschwindigkeit auf eine Kurve zufährt, dann wird die Blickrichtung beispielweise mittels optischer oder akustischer Signale, welche aus der Richtung der Windschutzscheibe kommen, auf die Windschutzscheibe und damit weg vom Radio nach draußen auf die Straße gelenkt.
• – Ein Fahrerassistenzsystem des Fahrzeugs wird an den Zustand des Fahrers angepasst. Beispielsweise könnte sich ein Spurhalteassistent automatisch einschalten, wenn durch das erfindungsgemäße Verfahren erfasst wird, dass sich der Fahrer gerade nicht dem Betrieb seines Fahrzeugs widmet.

The at least one measure taken to improve the condition of the driver with regard to the operation of his vehicle and / or the driving behavior of the vehicle may be selected from the following set of measures:

• - A range of instruments, such. As radio, navigation device or mobile phone, the vehicle is limited depending on the condition of the driver and / or the driving situation. Especially in critical driving situations and an inattentive driver, the operation of instruments of the vehicle can be limited to those instruments that directly improve the operation of the vehicle, such as. B. switching on the low beam, operation of the windscreen wiper or activation of a night vision assistant, whereas the operation of so-called infotainment instruments is severely limited, so that, for example, only a shutdown of such instruments is possible. In contrast, the use of additional vehicle functions, such as infotainment functions, made possible by the inventive method in uncritical situations.
• Information is output to the driver depending on the condition of the driver and / or the driving situation. For example, in critical driving situations and in a non-attentive driver only such information can be output, which help to improve the operation of the vehicle in the current situation, such. B. a warning of approaching the roadside creatures by a night vision assistant. On the other hand, warnings or hints, which relate, for example, to infotainment instruments or operating states of the vehicle lying in the future, such as, for example, As a tank warning indicator to suppress in such cases. Depending on the level of attention, situation-adapted and user-profile-dependent functions available to the driver, such as infotainment functions, the driver is thus offered variously.
• - Targeted calls for action or recommendations for action (including warnings) are issued to the driver in order, for example, to direct his gaze to the road ahead. This also includes actions to trigger a glance of the driver at certain objects or information.
• An automatically determined viewing direction is checked on the basis of the current driving situation and, if appropriate, adapted to the driving situation. For example, if it is detected that the driver is looking at his radio while driving at high speed on a turn, then the line of sight is, for example, by means of optical or acoustic signals, which come from the direction of the windshield, on the windshield and thus away from the radio directed outside to the street.
• A driver assistance system of the vehicle is adapted to the condition of the driver. For example, a lane departure warning system could turn on automatically when it is detected by the inventive method that the driver is not currently dedicated to the operation of his vehicle.

With In other words, according to the invention, prior to an output of information, How much attention potential is left to the driver? is, and depending on this remaining attention potential Information is then output to the driver (or not issued). In this case, necessary driver information can be appropriate to the situation represented and so perceived by the driver easier and safer become.

• – Eine bestimmte Information wird auf einer optischen Anzeige erst dann ausgeblendet oder durch eine andere Anzeige überdeckt, wenn anhand einer von dem erfindungsgemäßen Verfahren erfassten Blickrichtung und einer Blickdauer des Fahrers abgeleitet wird, dass der Fahrer diese bestimmte Information auch erfasst hat. Dadurch ist auch eine blickgesteuerte Benutzerschnittstelle, z. B. als Ergänzung einer Hand-Bedienung, möglich, durch welche Funktionen des Fahrzeugs über die Blickrichtung und Blickdauer gesteuert werden.
• – Eine bestimmte Information wird auf einer optischen Anzeige abhängig von der erfassten Blickrichtung in dieser Blickrichtung angezeigt, so dass davon auszugehen ist, dass der Fahrer diese Informationen sofort erfasst, was anhand der weiteren Blickrichtung des Fahrers und der Blickdauer überprüft werden kann. Für eine solche blickrichtungsabhängige Ausgabe von Informationen eignen sich beispielsweise Darstellungssysteme, welche die Informationen auf der Frontscheibe des Fahrzeugs darstellen.
• – Eine optische Darstellung von sich überdeckenden Anzeigen wird vermieden, wenn die Fahrsituation als kritisch eingestuft wird und/oder der Zustand des Fahrers in einem kritischen Bereich liegt.
• – Dem Fahrer wird durch einen optischen, akustischen oder haptischen Hinweis signalisiert, wie sein von dem erfindungsgemäßen Verfahren erfasster Zustand hinsichtlich des Betriebs des Fahrzeugs zu bewerten ist. Dabei kann der Zustand den Betrieb des Fahrzeugs uneingeschränkt zulassen, aber auch derart sein, dass das erfindungsgemäße Verfahren dem Fahrer zu einer Fahrpause rät. Mit anderen Worten kann dem Fahrer bei unkritischen Situationen signalisiert werden, dass er im ”grünen Bereich” fährt und somit weitere Fahrzeugfunktionen, wie Infotainmentfunktionen, sicher nutzen kann, da er ein freies Aufmerksamkeitspotenzial für weitere Tätigkeiten neben der Fahrzeugführung hat. Bei einem Ausbleiben dieser Information (”grüner Bereich”) wird dem Fahrer andererseits im Sinn einer Komfortfunktion indirekt signalisiert, dass er kein freies Aufmerksamkeitspotenzial mehr besitzt. Um dem Fahrer geeignet darzustellen, dass dieser im sicheren Fahrzustand fährt und weitere Fahrzeugfunktionalität sicher nutzen kann, können vom Fahrzeugsystem ver schiedene Lichteffekte mit verschiedenen Farben und animierte Grafiken sowie Ikons oder Symbole eingeblendet werden. Ziel ist es dem Fahrer auf geeignete Weise optisch zu signalisieren, dass dieser freie Zeitressourcen, die durch weniger durchzuführende Fahraufgaben entstehen, aufgrund der Unterstützung durch Fahrerassistenzsysteme, sicher für andere Aktivitäten zusätzlich zur Fahraufgabe nutzen kann. Es wird dem Fahrer z. B. über Lichteffekte und animierte Grafiken im Hintergrund signalisiert, dass dieser sich sicher zusätzlichen Aktivitäten wie zusätzlicher Büroarbeit, Unterhaltung oder auch Erholung widmen kann. Mit LED, Lampen, Beamer oder über Anzeigeflächen wie Displays oder leuchtende bzw. für eine Anzeige von Informationen geeignete Kunststoffoberflächen werden für den Fahrer verschiedene Lichteffekte bzw. animierte Grafiken erzeugt. So wird vom Fahrer z. B. über im Innenraum eingeblendete Lichteffekte auf der Fahrerseite in grüner Farbe sowohl unbewusst als auch bewusst wahrnehmbar signalisiert, dass dieser im sicheren Fahrzustand fährt. (D. h. die Fahrsituation ist unkompliziert und der Fahrer hat noch freies Aufmerksamkeitspotential für weitere Tätigkeiten neben der Fahrt und zur Nutzung weiterer Fahrzeugfunktionalität. Dies ist vor allem dann der Fall wenn die Fahrerassistenzsysteme einen wesentlichen Teil der Fahraufgabe übernehmen, wie z. B. bei automatischem oder teilautomatischem Fahren bei Stau oder über längere Strecken, Unterstützung durch ACC.) Lichteffekte können vom Fahrer bewusst bzw. auch unbewusst, z. B. über Strukturen, die durch das Licht oder verschiedene Farbeffekte bzw. durch Beamer entstehen, wahrgenommen werden. Zusätzlich ergänzend bzw. alternativ zu den Lichteffekten im Innenraum auf der Fahrerseite bzw. auf den Anzeigeflächen kann dem Fahrer, insbesondere nach nicht erfolgter Reaktion auf die visuellen Signale, akustisch über Klänge (z. B. nur auf der Fahrerseite zu hören), haptisch z. B. über Vibration am Lenkrad signalisiert werden, dass dieser sich vermehrt bzw. voll auf die Fahraufgabe konzentrieren muss. Diese Klänge sind so gestaltet, dass diese z. B. vom Fahrer als aufmunternd bis hin zu warnend empfunden werden. Wenn der Fahrer im sicheren Bereich fährt können gelegentlich emotional positiv empfundene Klänge, z. B. beruhigende Klänge, in regelmäßigen Abständen zu hören sein.

The outputting of information to the driver depending on the condition of the driver and / or depending on the current driving situation may include at least one of the following operations include:

• - A certain information is only hidden on an optical display or covered by another display when it is derived from a detected by the method according to the invention viewing direction and a gaze of the driver that the driver has also detected this particular information. This also provides a look-ahead user interface, eg. B. as a supplement to a hand-operated, possible, are controlled by which functions of the vehicle on the line of sight and viewing time.
• - Certain information is displayed on an optical display depending on the detected viewing direction in this viewing direction, so that it can be assumed that the driver detects this information immediately, which can be checked on the basis of the driver's further viewing direction and the viewing time. For example, display systems that display the information on the windshield of the vehicle are suitable for such information-dependent output of information.
• - A visual representation of overlapping displays is avoided if the driving situation is classified as critical and / or the driver's condition is in a critical range.
• The driver is signaled by an optical, acoustic or haptic indication of how his state detected by the method according to the invention is to be evaluated with regard to the operation of the vehicle. In this case, the state of the operation of the vehicle allow unrestricted, but also be such that the inventive method advises the driver to a driving break. In other words, the driver can be signaled in uncritical situations that he drives in the "green area" and thus can safely use other vehicle functions, such as infotainment functions, since he has a free attention potential for other activities in addition to driving the vehicle. In the absence of this information ("green area"), on the other hand, the driver is indirectly signaled in the sense of a comfort function that he no longer has any free attention potential. In order to present the driver in a safe driving condition and to be able to use further vehicle functionality safely, the vehicle system can display different light effects with different colors and animated graphics as well as icons or symbols. The aim is to visually signal to the driver optically that, due to the assistance of driver assistance systems, this free time resources, which arise as a result of fewer driving tasks, can certainly be used for other activities in addition to the driving task. It is the driver z. This is signaled by light effects and animated graphics in the background, for example, which can certainly be dedicated to additional activities such as additional office work, entertainment or recreation. With LED, lamps, beamer or on display surfaces such as displays or luminous or for a display of information suitable plastic surfaces for the driver different light effects or animated graphics are generated. So is the driver z. B. signalized in the interior lighting effects on the driver's side in green color both unconsciously and aware of perceptible that this is driving in safe driving condition. (Ie the driving situation is uncomplicated and the driver still has free attention potential for further activities in addition to driving and for using further vehicle functionality.) This is especially the case when the driver assistance systems take over a substantial part of the driving task, such as in automatic or semi-automatic driving in traffic jams or over long distances, assistance by ACC.) Light effects can be consciously or unconsciously, for example by the driver. B. on structures that are caused by the light or different color effects or beamer, are perceived. In addition to or as an alternative to the light effects in the interior on the driver's side or on the display surfaces, the driver, in particular after not responding to the visual signals, can hear acoustically via sounds (eg only on the driver's side), haptically z , B. be signaled via vibration on the steering wheel, that this must be increased or fully focused on the driving task. These sounds are designed so that these z. B. be felt by the driver as encouraging to warning. When the driver drives in the safe area occasionally emotionally positive sounds, such. B. soothing sounds to be heard at regular intervals.

If the driving situation changes, giving the driver his Attention strengthened or exclusively on the driving task must concentrate z. B. in the interior lighting effects on the driver's side in other colors, eg. B. the stronger the more the driver is to concentrate on the driving task, so that the driver perceived both unconsciously and consciously is signaled that this is on the driving task and traffic situation must focus.

The determination of the viewing direction can take place by means of two cameras, via which a three-dimensional model of the head of the driver is created. Thereby become characteristic Merk male of the head, such. As nostrils, corners of the mouth, detected at the driver's head, analyzed and measured. On the basis of this, vectors are calculated on each eye which correspond to the line of vision of the driver with the corresponding eye. An intersection of these vectors with a predetermined plane, such. A screen viewed by the driver, then provides the two-dimensional coordinates of the driver's gaze focus in that plane.

at Another method for determining the viewing direction is the so-called cornea reflex exploited. The corneal reflex is based on the reflection of a light source on the cornea. Is about it In addition, a fixed position on the eye known, then the visual axis be calculated (point-of-respect-measurement). A possibility is to assume the center of the pupil as a fixed point and to calculate the distance to the corneal reflex to that place. Becomes the head moves at a fixed look, the calculated changes Do not leave a gap, as the view remains focused on the fixed object. change However, if the line of vision changes, the corneal reflex shifts relative to the center of the pupil. This in turn can be the calculate new visual axis. The intersection of the visual axis with the observed plane of a screen provides two-dimensional coordinates the eye movement.

A device for determining the direction of view is for example from the DE 19734307 known.

A Human-vehicle interface or HMI, about which information be issued to the driver and about which the driver Serves devices of the vehicle, according to the invention on a necessary attention of the driver to the driving environment or adapted to the operation of the vehicle. For this adjustment The human-vehicle interface can be a driver model used be the adequacy of the human-vehicle interface rated and allows an adjustment. An adaptation Driver information systems (part of the human-vehicle interface) can by changing the operating and display scope these driver information systems take place. Furthermore The driver can be included in a control loop, which over Action requests and recommendations for action to the driver the human-vehicle interface as well as through a situativadaptive User guidance a corresponding regulation of attention the driver takes place. Through targeted action requests and recommendations for action to the driver can act on the driving behavior of the driver become. So driver actions can be intuitively initiated before a critical situation occurs during the operation of the vehicle. For example, the driver becomes dependent on driver condition parameters informed of situational calls for action and recommendations for action.

• – Einem Zustand des Fahrzeugs, welcher beispielsweise abhängig von der Beschaffenheit der Räder, dem maximal zur Verfügung stehenden Bremsdruck oder abhängig von bekannten Ausfällen von für den Betrieb des Fahrzeugs wichtigen Systemen, z. B. Bremsassistent oder ESP, definiert werden kann.
• – Einer Verkehrssituation, in welcher sich das Fahrzeug aktuell befindet. Die Verkehrssituation kann sich dabei beispielsweise aus der Art der Straße (z. B. Autobahn, Landstraße oder kleinere Stadtstraße), der Verkehrsdichte, der Geschwindigkeit des Fahrzeugs und einem Abstand zu dem vorher fahrenden Fahrzeug ableiten.
• – Einer Eigenschaft einer Fahrbahn, auf welcher sich das Fahrzeug befindet. Unter der Eigenschaft der Fahrbahn wird dabei erfindungsgemäß insbesondere verstanden, ob die Fahrbahn vereist, verschmutzt oder trocken ist und ob die Fahrbahn aus einem festen Untergrund, z. B. Asphalt, oder aus einem eher lockeren Untergrund, z. B. Erde, besteht.
• – Einer Wettersituation, was z. B. Regen, Schnee aber auch eine Temperatur umfasst.

The driving situation is determined according to the present invention, in particular depending on at least one of the following properties:

• - A condition of the vehicle, which, for example, depending on the nature of the wheels, the maximum available brake pressure or depending on known failures of important for the operation of the vehicle systems, eg. B. Brake Assist or ESP, can be defined.
• - A traffic situation in which the vehicle is currently located. The traffic situation can be derived, for example, from the type of road (eg motorway, country road or smaller city street), the traffic density, the speed of the vehicle and a distance to the vehicle previously traveling.
• - A characteristic of a roadway on which the vehicle is located. Under the property of the road is understood according to the invention in particular whether the road is icy, dirty or dry and whether the road from a solid surface, z. As asphalt, or from a rather loose ground, z. B. earth exists.
• - A weather situation, what z. As rain, snow but also includes a temperature.

According to one embodiment of the invention optical and / or acoustic information from the interior of the Vehicle detected as so-called indoor information. About one Driver's model (model of the driver with which depends from the interior information an attention level of the driver can be determined) becomes an actual attention level of the driver derived. In addition, environmental information about an environment of the vehicle and vehicle information (eg state of the vehicle). About a driving model (model with which the current driving situation is modeled and over which depends on the environment information and the vehicle information on the operation of the vehicle currently necessary attention level can be determined) derived a desired level of attention. Between the actual attention level and the target attention level, a difference is determined and depending on this difference, the at least a measure taken to the driver's condition regarding the operation of the vehicle and / or to improve driveability.

According to another embodiment of the invention are also optical and / or acoustic information from the interior of the vehicle detected as interior information. Depending on this interior information, an actual attention level of the driver is determined. In addition, environmental information about an environment of the vehicle is recorded. By way of another driver model (model of the driver with which, depending on the surroundings information, a driver's attention level currently required for operation of the vehicle can be determined), a desired attention level is determined. Depending on a difference between the actual attention level and the target attention level, the at least one measure is taken to improve the driver's state of operation of the vehicle and / or drivability.

In order to depends on the level of attention, stress and / or fitness (ie Condition) of the driver an additional infotainment functionality (eg making calls, editing e-mails, audiobooks listen, listen to texts, etc.) or restricted, giving the driver free attention potential for the infotainment functionality. According to the invention, for. B. by a driver assistance system or vehicle system the driver depending on the situation issued and adapted to the load of the driver Infotainmentangebot made available. The driver can thus by support the vehicle system advanced Infotainmentfunkqualität use, because he through the vehicle system free attention potential receives. Due to the possibility of semi-automatic Driving supported by the vehicle system, the driver can use extensive infotainment offers.

in the The scope of the present invention also provides a device for Assist the operation of a vehicle provided. In this case, the device is designed such that it has a state a driver of the vehicle with regard to the operation of the vehicle recorded and also a driving situation in which the vehicle currently detected. Depending on the state of the Driver and from the driving situation, the device at least a measure related to the condition of the driver the operation of the vehicle and / or a driving behavior of the vehicle to improve.

The Advantages of the device according to the invention correspond essentially the advantages of the invention Procedure, which is why here is waived a repetition.

The Device comprises in particular an interior camera, with which Moving images of the interior of the vehicle can be detected. Based become the captured by the interior camera images of the driver Movements of the driver's head and / or eyes analyzed to deduce the condition of the driver.

• – Einschränken eines Bedienumfangs der Instrumente des Fahrzeugs in Abhängigkeit von dem Zustand des Fahrers und/oder der Fahrsituation.
• – Ausgeben von Informationen für den Fahrer über das Informationssystem in Abhängigkeit von dem Zustand des Fahrers und/oder der Fahrsituation.
• – Ausgeben gezielter Handlungsaufforderungen für den Fahrer über das Informationssystem, um insbesondere die Aufmerksamkeit des Fahrers auf den Betrieb seines Fahrzeugs zu lenken.
• – Anpassen von einem oder von mehreren Fahrerassistenzsystemen an den Zustand des Fahrers, wobei die Fahrerassistenzsysteme den Betrieb des Fahrzeugs durch den Fahrer unterstützen.

In addition, the device may include an information system for outputting information to the driver and instruments, e.g. B. infotainment instruments include the vehicle. In this case, the device selects, in particular, the at least one measure in order to improve the condition of the driver with respect to the operation of the vehicle and / or the driving behavior, from the following measures:

• Restricting a scope of operation of the instruments of the vehicle depending on the condition of the driver and / or the driving situation.
• - Output information to the driver via the information system depending on the driver's condition and / or the driving situation.
• - issuing targeted action requests to the driver via the information system, in particular to direct the driver's attention to the operation of his vehicle.
• - adapting one or more driver assistance systems to the driver's condition, the driver assistance systems assisting the operation of the vehicle by the driver.

Of Furthermore, the device can be an environment sensor, for example a camera or a radar system, with which environment information can be determined in the environment of the vehicle. Of these Environment information derives the device from the driving situation.

After all For example, the present invention discloses a vehicle comprising a device according to the invention to support the operation of the vehicle.

The The present invention is particularly suited to a driver of a vehicle depending on the traffic situation and their criticality for a minimum Attention to the driving task or the operation of the Vehicle in order to assist him in the operation of the vehicle. Of course, the present invention is not limited to this preferred scope, but Can also be used on ships, airplanes or track-bound vehicles be used.

in the The following is the present invention with reference to preferred inventive Embodiments with reference to the drawings explained in detail.

1 schematically represents a erfindungsge moderate vehicle with a device according to the invention for supporting the operation of the vehicle.

In 2 an inventive method for adjusting a level of attention of a driver is shown.

In 3 another method of adjusting a driver's attentiveness level is illustrated.

In 1 is a motor vehicle according to the invention 10 shown, which is a device according to the invention 1 includes. In this case, the device according to the invention comprises 1 in turn a computer unit 14 as well as an interior camera 3 , a driver assistance system 6 , an environment sensor 11 , an indicator 15 , a radio 16 and a speakerphone 17 for a mobile phone, all with the computing unit 14 are connected. By means of the interior camera 3 in particular pictures of a driver of the vehicle 10 captured to these pictures via the arithmetic unit 14 derive a condition of the driver, which is defined in particular by a level of attention, a stress level and a fitness level of the driver. By means of the environment sensor 11 determines the device according to the invention 1 also by means of the arithmetic unit 14 Environment information from the environment of the vehicle 10 to deduce the current driving situation. Depending on the condition of the driver and the driving situation is then on the computing unit 14 the driver assistance system 6 adapted and appropriate information on the ad 15 output. The operation of the radio 16 and the handsfree 17 is optionally via the arithmetic unit 14 restricted, if the condition of the driver and the driving situation an operation of the radio 16 or the handsfree 17 to forbid.

In 2 an inventive method is shown to be an actual attention 4 the driver to a target attention 5 to adapt, which is determined according to the invention. In this case, by means of an interior sensor, such as an interior camera 3 , data collected by the driver analyzed. About a driver model 2 then becomes dependent on those with the interior sensor 3 captured data is the actual attention 4 of the driver representing the condition of the driver. Similarly, there is an environment sensor 11 Environment information from the environment of the vehicle 10 detected. By means of a driving model 12 becomes the target attention depending on the environmental information 5 calculated. Depends on a difference from the actual attention 4 and the target attention 5 will be an adaptation 9 the human-vehicle interface 8th and an adaptation 7 the driver assistance systems 6 performed. It is under the human-vehicle interface or the HMI 8th in particular the interface between the driver and the vehicle 10 understood, ie any input from the driver with respect to the vehicle 10 and with regard to any instruments (eg infotainment instruments) of the vehicle 10 as well as any expenses of the vehicle 10 to the driver via this human-vehicle interface 8th ,

By the human-vehicle interface 8th depending on the difference from the actual attention 4 and the target attention 5 is adjusted, the driver or the condition of the driver is also affected. The way this influencing or changing the driver's condition is in turn via the interior sensor 3 captures, thereby increasing the actual attention 4 about the driver model 2 changes accordingly.

In the lower branch (7 → 6 → 11 → 12) are the driver assistance systems 6 according to the difference of the actual attention 4 and the target attention 5 customized. This adaptation or modification of the driver assistance systems on the one hand, the state of the vehicle 10 but also the criticality of the traffic changed accordingly. About the environment sensor 11 and the driver model 12 These changes are recorded and evaluated and the target attention is changed or recalculated accordingly.

An influence on the driving situation and thus the target attention 5 depending on the interior sensor system 3 Although captured information is also possible, plays in the 2 illustrated embodiment but a minor role.

In 3 another embodiment of a method according to the invention is shown to the actual attention 4 to the target attention 5 adapt. This is from information, which by means of an interior sensor 3 , z. As an interior camera, are detected, the actual attention 4 determined by the driver. About environment information, which has an environment sensor 11 are determined and which in particular reflect a complexity of a driving situation, by means of a driver model 2 the target attention 5 certainly. As with the in 2 embodiment shown are also in the in 3 illustrated embodiment, the human-vehicle interface 8th and the driver assistance systems 6 depending on the difference between the actual attention 4 and the target attention 5 adjusted, resulting in a feedback on the actual attention 4 (via the interior sensor system 3 ) or a feedback to the target attention 5 (about the environment sensor 11 and the driver model 2 ).

It plays in both in 2 and 3 illustrated embodiments, the human-vehicle interface adaptation the role of a controller with which the human-vehicle interface 8th is changed so that the actual attention 4 in the direction of the target attention 5 emotional. Similarly, the driver assistance adjustment provides 7 for the driver assistance systems 6 change, so that the target attention 5 the actual attention 4 approaches.

In the present invention, a context manager may be used to merge information regarding the driving situation (exterior) and attention (interior). A fusion or merger of information and an evaluation of this information, for example, from this an attention level 4 derive from the driver, are components of this context manager.

By the present invention, in particular by the in 2 and 3 illustrated embodiments, will be a prioritization of attention 4 supported and steered by the driver to the driving task. The driver is informed about his driver parameters or his driver model 2 in the control loop of the driver assistance systems 6 and the human-vehicle interface 9 integrated. As a result, for example, intuitive initiations of actions of the driver can be carried out, in particular in crisis situations, so that the driver is assisted in comfortable and safe driving. In addition, the involvement of the driver in the control loop of the driver assistance systems 6 a personalization and individualization of these driver assistance systems 6 allows.

With the present invention is also a habituation of the driver to driver assistance systems 6 with negative consequences for driving safety due to the situational adaptive adaptation of the human-vehicle interface 8th and the adaptation of driver assistance systems 6 prevented. When the driver's attention decreases or his inattention increases, the human-vehicle interface becomes 8th and the driver assistance systems 6 situativadaptiv adapted adequately, until again an uncritical state during operation of the vehicle 10 is reached. Therefore, via the situativadaptive human-vehicle interface 8th and driver assistance systems 6 also a positive influence on the driver's condition.

1

contraption

2

driver model

3

Interior camera

4

Actual attention

5

Target attention

6

Driver assistance system

7

Driver assistance system adaptation

8th

Human-vehicle interface

9

Adaptation the human-vehicle interface

10

vehicle

11

environment sensors

12

Fahr model

13

Measure for the complexity of the driving situation

14

computer unit

15

display

16

radio

17

speakerphone

QUOTES INCLUDE IN THE DESCRIPTION

This list The documents listed by the applicant have been automated generated and is solely for better information recorded by the reader. The list is not part of the German Patent or utility model application. The DPMA takes over no liability for any errors or omissions.

Cited patent literature

• DE 19734307 [0017]

Claims (13)

Method for supporting the operation of a vehicle, characterized in that a condition of a driver of the vehicle ( 10 ) with regard to the operation of the vehicle ( 10 ) detects that a driving situation in which the vehicle ( 10 ), and that at least one measure is taken, depending on the condition of the driver and on the driving situation, in order to determine the condition of the driver with regard to the operation of the vehicle ( 10 ) and / or a driving behavior of the vehicle ( 10 ) to improve. Method according to claim 1, characterized in that that the condition of the driver is detected by at least one parameter the driver is determined, which is selected from a parameter group comprising: - movements of the Head of the driver, - movements of the driver's eyes, - an opening degree the eyes of the driver, - a lid closure period of Eyes of the driver, - an opening period of Eyes of the driver, - Eyelid eyelid duration the driver, A steering behavior of the driver, - Muscle functions the driver, - skin resistance of the driver, - brain waves the driver, Pulse rate of the driver, - Blood values the driver, - Respiration of the driver and - Responsiveness the driver, and that analyzes the at least one parameter of the driver is going to get information about a stress level, a fitness level and / or to determine an attention level of the driver, and that derived from this information the condition of the driver becomes. A method according to claim 1 or 2, characterized in that the at least one measure to the driver's condition regarding the operation of the vehicle ( 10 ) and / or to improve driving behavior, is selected from a group of measures comprising - Restricting the scope of use of instruments ( 16 ; 17 ) of the vehicle ( 10 Depending on the driver's condition and / or on the driving situation, outputting of information for the driver depending on the driver's condition and / or on the driving situation, correction of the driver's direction of vision not adapted to the driving situation, issuing of targeted action calls for the driver, and adjusting a driver assistance system ( 6 ) of the vehicle ( 10 ) to the condition of the driver. A method according to claim 3, characterized in that the outputting of information for the driver depending on the state of the driver comprises at least one of the following measures: - a specific display is only hidden when it is detected by detecting a line of sight and a driver's gaze in that the driver has detected the particular display, - a specific display is displayed depending on a detected line of sight of the driver in the driver's line of sight, - a display of overlapping displays is avoided, and - the driver is informed by means of information that its condition is such that operation of the vehicle ( 10 ) is not limited by the state. Method according to one of the preceding claims, characterized in that the driving situation is determined depending on at least one property from a property group, wherein the property group comprises: - a state of the vehicle ( 10 ), - a traffic situation in which the vehicle ( 10 ) is currently located, - a characteristic of a roadway on which the vehicle ( 10 ), and - a weather situation. Method according to one of the preceding claims, characterized in that optical and / or acoustic information from an interior of the vehicle ( 10 ) are detected as interior information that by means of a driver model ( 2 ), on which a driver's attention level can be determined depending on the interior information, an actual attention level ( 4 ) of the driver is detected that environmental information about an environment of the vehicle ( 10 ) and vehicle information that by means of a driving model ( 12 ), via which, depending on the surroundings information and the vehicle information, an operation of the vehicle ( 10 ) currently required attention level is determinable, a target attention level ( 5 ) determines that a difference between the actual attention level ( 4 ) and the target attention level ( 5 ) and that, depending on the difference, the at least one measure is taken to determine the condition of the driver with regard to the operation of the vehicle ( 10 ) and / or to improve the driving behavior. Method according to one of the preceding claims, characterized in that optical and / or acoustic information from an interior of the vehicle ( 10 ) are detected as interior information that, depending on the interior information, an actual attention level ( 4 ) the driver is determined that environmental information about an environment of the vehicle ( 10 ) that by means of a driver model ( 2 ), via which, depending on the surroundings information, a driver's attention level currently required for operation of the vehicle can be determined, a target attention level ( 5 ) determines that a difference between the actual attention level ( 4 ) and the target attention level ( 5 ) and that, depending on the difference, the at least one measure is taken to determine the condition of the driver with regard to the operation of the vehicle ( 10 ) and / or to improve the driving behavior. Device for assisting the operation of a vehicle, characterized in that the device ( 1 ) is configured such that the device ( 1 ) a condition of a driver of the vehicle ( 10 ) with regard to the operation of the vehicle ( 10 ) detects that the device ( 1 ) a driving situation in which the vehicle ( 10 ), and that the device ( 1 ) takes at least one measure, depending on the condition of the driver and the driving situation, of the condition of the driver with regard to the operation of the vehicle ( 10 ) and / or a driving behavior of the vehicle ( 10 ) to improve. Device according to claim 8, characterized in that the device ( 1 ) an interior camera ( 3 ) and that the device ( 1 ) is configured such that the interior camera ( 3 ) Images of the driver and analyzed from these images movements of the head and / or eyes of the driver to detect the condition of the driver. Apparatus according to claim 8 or 9, characterized in that the device is an information system ( 15 ) and instruments ( 16 ; 17 ) of the vehicle, and that the device ( 1 ) is configured such that the device ( 1 ) the at least one measure to determine the condition of the driver with regard to the operation of the vehicle ( 10 ) and / or to improve driving behavior, selected from a set of measures comprising - Restricting a scope of operation of the instruments ( 16 ; 17 ) of the vehicle ( 10 ) depending on the condition of the driver and / or on the driving situation, - output of information for the driver by means of the information system ( 15 ) depending on the condition of the driver and / or the driving situation, - issuing targeted action requests for the driver by means of the information system ( 15 ), and - adapting a driver assistance system ( 6 ) of the device ( 1 ) to the condition of the driver, wherein by means of the driver assistance system ( 6 ) an operation of the vehicle ( 10 ) is supported by the driver. Device according to one of claims 8-10, characterized in that the device ( 1 ) an environment sensor system ( 11 ), with which environment information in the environment of the vehicle ( 10 ) and that the device ( 1 ) is configured such that the device ( 1 ) detects the vehicle situation by means of the environment information. Device according to one of claims 8-11, characterized in that the device ( 1 ) is configured for carrying out the method according to any one of claims 1-7. Vehicle with a device according to one of the claims 8-11.