EP1756787B1 - Night-vision device for motor vehicles - Google Patents

Night-vision device for motor vehicles Download PDF

Info

Publication number
EP1756787B1
EP1756787B1 EP05726510A EP05726510A EP1756787B1 EP 1756787 B1 EP1756787 B1 EP 1756787B1 EP 05726510 A EP05726510 A EP 05726510A EP 05726510 A EP05726510 A EP 05726510A EP 1756787 B1 EP1756787 B1 EP 1756787B1
Authority
EP
European Patent Office
Prior art keywords
night
vision
vision device
hazard potential
control unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Not-in-force
Application number
EP05726510A
Other languages
German (de)
French (fr)
Other versions
EP1756787A1 (en
Inventor
Karsten Haug
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Robert Bosch GmbH
Original Assignee
Robert Bosch GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Robert Bosch GmbH filed Critical Robert Bosch GmbH
Publication of EP1756787A1 publication Critical patent/EP1756787A1/en
Application granted granted Critical
Publication of EP1756787B1 publication Critical patent/EP1756787B1/en
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • G08G1/166—Anti-collision systems for active traffic, e.g. moving vehicles, pedestrians, bikes

Definitions

  • the invention relates to a night vision device for motor vehicles with a display unit for displaying the vehicle surroundings recorded with at least one night vision sensor.
  • Night vision devices for motor vehicles are sufficient, for example from the WO 02/36389 A1 known. They have night vision sensors which, for example, on the basis of near-infrared with active illumination (NIR) or on the basis of thermal radiation (FIR), take an image of the vehicle surroundings with a range of vision that generally exceeds the visibility of the human eye.
  • the image of the vehicle environment is displayed to the driver via a display unit.
  • the display unit may be a conventional display in the dashboard or a head-up display that projects the image onto the windshield with a projector. Head-up projectors are for example from the DE 101 31 720 A1 known.
  • the object of the invention is therefore to provide an improved night vision device for motor vehicles with a display unit for displaying the recorded with at least one night vision sensor vehicle environment.
  • the night vision device has a control unit for determining a value for the hazard potential by the night vision device from the current driving situation, which is characterized at least by vehicle speed.
  • the night vision device is switched off if the potential value of the potential exceeds a defined limit.
  • Parameters for determining the hazard potential value may also include the steering wheel angle, the vehicle movement, the road course, weather parameters (ice, snow, temperature, etc.), rain sensor signals, time of day information, the light state (dipped and / or high beam), the current visibility, the availability of night vision infrared headlights or the like.
  • Parameters can also be parameters for determining the attentiveness of the driver, which can be obtained, for example, via an analysis of the gas, braking and steering behavior or via an analysis of the eye movements with an interior camera.
  • An immediate shutdown of the night vision device as soon as the hazard potential value exceeds the defined limit value should be avoided. Rather, it is advantageous to issue a warning beforehand acoustically and / or optically as soon as such a limit value violation has been detected. This is followed by a time-delayed shutdown of the night-vision device if, after a defined waiting time, the hazard potential value is still greater than the defined limit value, ie if the hazard potential has not decreased.
  • the night-vision device for issuing a warning is visually and / or acoustically designed if the hazard potential value exceeds a further defined limit value, but is still less than the first defined limit value.
  • the driver can be forewarned to prevent increased danger in time.
  • the defined limit value is preferably set variably as a function of useful parameter parameters, such as the visibility, for example.
  • useful parameter parameters such as the visibility, for example.
  • the shutdown of the night vision device is preferably carried out by gradually or continuously reducing the night vision display on the display unit.
  • the display may also blink first or be faded in pieces, for example, from top to bottom. Only then is the complete shutdown of the night vision display and then the night vision device itself.
  • the night vision device has an interface to a navigation device in order to transmit data for determining the hazard potential, in particular road course information and / or weather parameters, from the navigation device to the night vision device.
  • This parameter of the navigation device for the determination of the hazard potential value are shared.
  • a radio interface in the night-vision device may optionally be provided for warning beacons in the road area in order to transmit data for determining the hazard potential from the warning beacons.
  • a radio interface in the night-vision device may optionally be provided for warning beacons in the road area in order to transmit data for determining the hazard potential from the warning beacons.
  • control unit of the night-vision device for deactivating further assistance devices in the motor vehicle such as Adaptive Cruise Control ACC or lane keeping support
  • the control unit of the night-vision device for deactivating further assistance devices in the motor vehicle is designed as a function of the hazard potential value.
  • the risk potential determined for the shutdown of the night-vision device can still be used for other purposes.
  • warning and shutdown strategy information from other assistance devices can be included in the warning and shutdown strategy.
  • a shutdown of the night vision device is possible when a Abstandstempomat ACC has detected a vehicle ahead in the low beam range.
  • FIG. 1 1 shows a block diagram of a night vision device 1 according to the invention, which has a preferably programmable control unit 2 with a microprocessor, to which a display unit 3 for displaying the night vision image recorded with at least one night vision sensor 4 is connected in a conventional manner.
  • the night vision sensor 4 may be a conventional sensor device based on near infrared with active illumination (NIR) or based on thermal radiation (FIR).
  • NIR near infrared with active illumination
  • FIR thermal radiation
  • the display unit 3 may be a conventional display or head-up projector or the like.
  • Such a night vision device 1 can be dangerous if the driver respects exclusively or predominantly the display unit 3 in critical driving situations, instead of observing the street scene directly through the windshield of the motor vehicle.
  • a driving situation becomes critical, inter alia, when the speed v of the motor vehicle is not adapted to driving, taking into account the displayed night vision image.
  • control unit 2 is preferably coupled to a speed sensor 6 via a data bus 5 in the vehicle, for example a CAN bus. From the speed sensor 6, the speed v is passed as a parameter for calculating a hazard potential value in the control unit.
  • a hazard potential value which represents the danger of the current driving situation with regard to the use of the night vision device 1
  • further parameters can be taken into account, which are routed for example via the data bus 5, but also optionally directly into the control unit 2.
  • the information about the road can be extracted from a navigation device 7. This can also take into account critical road conditions that are not yet in the field of vision of the night vision sensor 4 (eg curves behind a crest).
  • the specific weather situation for example black ice in the next curve, could also be a parameter for calculating the hazard potential value, which can be supplied by a navigation device 7, for example.
  • the parameters extracted by the navigation device 7 can for example be read out on a data carrier available in the vehicle or can be obtained online via radio communication from a control center.
  • the control unit 2 is now so formed, for example, by programming that the night-vision mode for the driver is traceable disabled if the risk exceeds the benefits of the night vision device 1.
  • the potential value of the potential is calculated by the control unit 2 as a function of the vehicle speed v and possibly other parameters mentioned above and compared with a defined limit value.
  • the threat posed by the night vision device 1 also results from looking in the wrong direction on the display unit 3 instead of directly on the street.
  • the night vision device 1 only partially detected or animals / pedestrians, which is limited to the vehicle in the lateral vicinity of the night vision device 1 is detected, approach from the side.
  • the hazard potential value is, in a preferred embodiment, divided into at least three levels of risk.
  • the night vision device 1 can be activated without restriction and remains active after activation.
  • the efficiency of the function of the night-vision device 1 still exceeds the hazard potential, for example when driving at slightly too high speed for the available night-vision range. Then the night-vision function still remains active, but an indication on the display unit 3 is added that, for example, the speed is too high. This note is preferably marked in color.
  • a hazard level of two is assumed. This is the case, for example, when driving at a much too high speed, for which the visibility of the night-vision device 1 is no longer sufficient.
  • the night-vision device can only show the driver an area in front of the vehicle which ensures safe driving at a speed of at most 50 km / h.
  • a warning is first displayed which indicates the cause of the warning and announces that the warning is being issued Night vision image in a defined turn-off (for example, 10 seconds) is disabled.
  • the warning should also be color coded, preferably in red letters.
  • the deactivation should be delayed, since the driver must be given the chance to reduce his speed with the help of the night vision image.
  • An immediate deactivation could be fatal, since then the visibility decreases abruptly from the increased by the night vision visibility on the visibility with low beam, for example, from 150 m to 50 m.
  • the night vision image Only when the driver does not respond to the warning is the night vision image deactivated stepwise or continuously after the defined switch-off time.
  • the night vision image can also slowly fade or fade from top to bottom, so that the visibility for the driver is virtually continuously reduced.
  • the displayed night vision image may also flash, wherein the flashing frequency may be variable depending on the current hazard potential or on the shutdown time.
  • the night vision image may initially be flashing slowly and then flashing faster and faster before the night vision image is finally turned off.
  • an activation of the night vision device is prevented, if this is not yet activated.
  • the driver is then informed via a short message, for example that the speed is too high for the night vision mode.
  • the hazard level can also be set to 2 if the activation of the night vision function is detected as a mere gimmick, for example, during the day when the vehicle is traveling outside a diagnostic mode.
  • the control unit 2 may be connected to other devices for the exercise of automatic functions to disable them from a certain hazard potential value or degree of risk.
  • Such automatic functions may, for example, be implemented in distance-learning or lane-keeping-support devices. Again, a warning should first be generated to give the driver a certain reaction time.
  • the deactivation of the night-vision device 1 can take place by a state machine of the light mode of the night-vision device 1 being expanded by corresponding states and transitions.
  • the night vision device 1 may be coupled to radio receivers in order to receive radio data on parameters for calculating the hazard potential of stationary roadside warning beacons with transponders with a short range. This can take into account local traffic conditions, such as rain, sub-freezing temperatures, which can lead to local ice, dangerous sections, etc.
  • the warning information may be superimposed on the display unit 3 to the night vision image (destructive or non-destructive), displayed as an icon on the edge or centrally in the image, stationary or blinking in the image, or the like.
  • the warnings may also be graded according to the severity of the hazard. The more dangerous, the larger and more central they should be displayed on the display unit 3. Then they should also have a more aggressive color.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Traffic Control Systems (AREA)
  • Instrument Panels (AREA)
  • Control Of Stepping Motors (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
  • Non-Portable Lighting Devices Or Systems Thereof (AREA)

Abstract

A night vision device for motor vehicles, having a display unit for depicting the vehicle surroundings imaged with at least one night vision sensor, has a control unit for ascertaining, from the current driving situation, a value for the risk potential as a result of the night vision device, which value is influenced at least by the vehicle speed; and switching off the night vision device if the risk potential value exceeds a defined limit value.

Description

Die Erfindung betrifft ein Nachtsichtgerät für Kraftfahrzeuge mit einer Anzeigeeinheit zur Darstellung der mit mindestens einem Nachtsichtsensor aufgenommenen Fahrzeugumgebung.The invention relates to a night vision device for motor vehicles with a display unit for displaying the vehicle surroundings recorded with at least one night vision sensor.

Nachtsichtgeräte für Kraftfahrzeuge sind hinreichend, beispielsweise aus der WO 02/36389 A1 bekannt. Sie haben Nachtsichtsensoren, die beispielsweise auf der Basis von nahem Infrarot mit aktiver Beleuchtung (NIR) oder auf Basis von Wärmestrahlung (FIR) ein Bild der Fahzeugumgebung mit einer Sichtweite aufnehmen, die in der Regel die Sichtweite des menschlichen Auges übersteigt. Das Bild der Fahrzeugumgebung wird dem Fahrer über einen Anzeigeeinheit dargestellt. Die Anzeigeeinheit kann ein herkömmliches Display im Armaturenbrett oder ein Head-Up Display sein, das mit einem Projektor das Bild auf die Windschutzscheibe projiziert. Head-Up Projektoren sind beispielsweise aus der DE 101 31 720 A1 bekannt.Night vision devices for motor vehicles are sufficient, for example from the WO 02/36389 A1 known. They have night vision sensors which, for example, on the basis of near-infrared with active illumination (NIR) or on the basis of thermal radiation (FIR), take an image of the vehicle surroundings with a range of vision that generally exceeds the visibility of the human eye. The image of the vehicle environment is displayed to the driver via a display unit. The display unit may be a conventional display in the dashboard or a head-up display that projects the image onto the windshield with a projector. Head-up projectors are for example from the DE 101 31 720 A1 known.

In der US 2002/0070852 A1 ist ein Anzeige-Kontrollsystem für Kraftfahrzeuge beschrieben, das die Sicherheit des Fahrers erhöht, wenn das Fahrzeug in Bewegung ist. Das System überwacht den Zustand des Fahrzeugs und aktiviert oder deaktiviert verschiedene Systemkomponenten, wie Mikrofone, Lautsprecher, Displays und Eingabegeräte.In the US 2002/0070852 A1 An automotive display control system is described that increases the safety of the driver when the vehicle is in motion. The system monitors the condition of the vehicle and enables or disables various system components such as microphones, speakers, displays and input devices.

Bei Nachtsichtgeräten in Kraftfahrzeugen stellt sich das besondere Problem, dass sich zwar einerseits die Fahrsicherheit durch die größere Sichtweite verbessert, andererseits ein Nachtsichtgerät aber auch ein Gefährdungspotential darstellt.In night vision devices in motor vehicles, there is the particular problem that on the one hand the driving safety improved by the greater visibility, on the other hand, a night vision device but also represents a potential hazard.

Aufgabe der Erfindung ist es daher, ein verbessertes Nachtsichtgerät für Kraftfahrzeuge mit einer Anzeigeeinheit zur Darstellung der mit mindestens einem Nachtsichtsensor aufgenommenen Fahrzeugumgebung zu schaffen.The object of the invention is therefore to provide an improved night vision device for motor vehicles with a display unit for displaying the recorded with at least one night vision sensor vehicle environment.

Die Aufgabe wird mit dem gattungsgemäßen Nachtsichtgerät erfindungsgemäß dadurch gelöst, dass das Nachtsichtgerät eine Steuerungseinheit zum Ermitteln eines Wertes für das Gefährdungspotential durch das Nachtsichtgerät aus der aktuellen Fahrsituation hat, die mindestens durch Fahrzeuggeschwindigkeit geprägt ist. Das Nachtsichtgerät wird abgeschaltet, wenn der Gefährungspotentialwert einen definierten Grenzwert übersteigt.The object is achieved with the generic night vision device according to the invention that the night vision device has a control unit for determining a value for the hazard potential by the night vision device from the current driving situation, which is characterized at least by vehicle speed. The night vision device is switched off if the potential value of the potential exceeds a defined limit.

Es wird also vorgeschlagen, das Nachtsichtgerät mindestens in Abhängigkeit der Fahrzeuggeschwindigkeit als Parameter für den Gefährdungspotentialwert gesteuert abzuschalten. Damit wird verhindert, dass das Nachtsichtgerät durch die gewonnene größere Sichtweite vom Fahrer missbraucht wird und dieser zum unangemessen schnellen Fahren verleitet wird.It is therefore proposed to switch off the night-vision device controlled at least as a function of the vehicle speed as a parameter for the hazard potential value. This prevents the night-vision device from being abused by the driver due to the greater visibility that is gained and that leads to unreasonably fast driving.

Parameter zur Ermittlung des Gefährdungspotentialwertes können auch der Lenkradeinschlag, die Fahrzeugbewegung, der Straßenverlauf, Witterungsparameter (Eis, Schnee, Temperatur, etc.), Regensensorsignale, Tageszeitinformationen, der Lichtzustand (eingeschaltetes Abblend- und/oder Fernlicht), die aktuelle Sichtweite, die Verfügbarkeit von Nachtsicht-Infrarotscheinwerfern oder Ähnliches sein. Parameter können auch Kenngrößen zur Bestimmung des Aufmerksamkeitszustands des Fahrers sein, die beispielsweise über eine Analyse des Gas-, Brems- und Lenkverhaltens oder über eine Analyse der Augenbewegungen mit einer Innenraumkamera gewonnen werden können.Parameters for determining the hazard potential value may also include the steering wheel angle, the vehicle movement, the road course, weather parameters (ice, snow, temperature, etc.), rain sensor signals, time of day information, the light state (dipped and / or high beam), the current visibility, the availability of night vision infrared headlights or the like. Parameters can also be parameters for determining the attentiveness of the driver, which can be obtained, for example, via an analysis of the gas, braking and steering behavior or via an analysis of the eye movements with an interior camera.

Ein sofortiges Abschalten des Nachtsichtgerätes, sobald der Gefährdungspotentialwert den definierten Grenzwert übersteigt, sollte vermieden werden. Vielmehr ist es vorteilhaft, vorher einen Warnhinweis akustisch und/oder optisch auszugeben, sobald eine solche Grenzwertüberschreitung festgestellt wurde. Anschließend erfolgt ein zeitverzögertes Abschalten des Nachtsichtgerätes, wenn nach einer festgelegten Wartezeit der Gefährdungspotentialwert immer noch größer als der definierte Grenzwert ist, d. h. wenn sich das Gefährdungspotential nicht verringert hat.An immediate shutdown of the night vision device as soon as the hazard potential value exceeds the defined limit value should be avoided. Rather, it is advantageous to issue a warning beforehand acoustically and / or optically as soon as such a limit value violation has been detected. This is followed by a time-delayed shutdown of the night-vision device if, after a defined waiting time, the hazard potential value is still greater than the defined limit value, ie if the hazard potential has not decreased.

Vorteilhaft ist es auch, wenn in einer Zwischenphase das Nachtsichtgerät zum Ausgeben eines Warnhinweises optisch und/oder akustisch ausgebildet ist, wenn der Gefährdungspotentialwert einen weiteren definierten Grenzwert überschreitet, aber immer noch kleiner als der erste definierte Grenzwert ist. Damit kann der Fahrer vorgewarnt werden, um eine erhöhte Gefährdung rechtzeitig zu verhindern.It is also advantageous if, in an intermediate phase, the night-vision device for issuing a warning is visually and / or acoustically designed if the hazard potential value exceeds a further defined limit value, but is still less than the first defined limit value. Thus, the driver can be forewarned to prevent increased danger in time.

Der definierte Grenzwert wird vorzugsweise variabel in Abhängigkeit von Nutzeffektparametern, wie beispielsweise der Sichtweite, festgelegt. Damit wird das Gefährdungspotential im Verhältnis zu dem Nutzeffekt des Nachtsichtgerätes bewertet und nicht absolut.The defined limit value is preferably set variably as a function of useful parameter parameters, such as the visibility, for example. Thus, the hazard potential in relation to the efficiency of the night vision device is evaluated and not absolute.

Damit kann im Sonderfall, wenn das Nachtsichtgerät überhaupt keinen Nutzen hat, beispielsweise tagsüber bei bestem Wetter und guten Straßenbedingungen, bereits ein Einschalten des Nachtsichtgerätes verhindert werden.Thus, in special cases, when the night vision device has no use, for example, during the day in the best weather and good road conditions, already switching on the night vision device can be prevented.

Das Abschalten des Nachtsichtgerätes erfolgt vorzugsweise durch stufenweises oder kontinuierliches Reduzieren der Nachtsichtanzeige auf der Anzeigeeinheit. Optional kann die Anzeige aber auch zunächst blinken oder stückweise beispielsweise von oben nach unten ausgeblendet werden. Erst anschließend erfolgt das vollständige Abschalten zunächst der Nachtsichtanzeige und dann des Nachtsichtgerätes selbst.The shutdown of the night vision device is preferably carried out by gradually or continuously reducing the night vision display on the display unit. Optionally, however, the display may also blink first or be faded in pieces, for example, from top to bottom. Only then is the complete shutdown of the night vision display and then the night vision device itself.

Besonders vorteilhaft ist es, wenn das Nachtsichtgerät eine Schnittstelle zu einem Navigationsgerät hat, um Daten zur Ermittlung des Gefährdungspotentials, insbesondere von Straßenverlaufsinformationen und/oder Witterungsparametem von dem Navigationsgerät an das Nachtsichtgerät zu übertragen. Damit werden Parameter des Navigationsgerätes zur Ermittlung des Gefährdungspotentialwertes mitgenutzt.It is particularly advantageous if the night vision device has an interface to a navigation device in order to transmit data for determining the hazard potential, in particular road course information and / or weather parameters, from the navigation device to the night vision device. This parameter of the navigation device for the determination of the hazard potential value are shared.

Weiterhin kann optional eine Funkschnittstelle in dem Nachtsichtgerät zu Warnbaken im Straßenbereich vorgesehen sein, um Daten zur Ermittlung des Gefährdungspotentials von den Warnbaken zu übertragen. So können beispielsweise am Straßenrand aufgestellte oder in der Straße eingelassene Transponder zur Übertragung von Warnsignale beispielsweise vor folgenden engen Kurven installiert werden.Furthermore, a radio interface in the night-vision device may optionally be provided for warning beacons in the road area in order to transmit data for determining the hazard potential from the warning beacons. Thus, for example, erected on the roadside or embedded in the road transponder for the transmission of warning signals, for example, before the following tight bends are installed.

Besonders vorteilhaft ist es auch, wenn die Steuereinheit des Nachtsichtgerätes zum Deaktivieren weiterer Assistenzgeräte im Kraftfahrzeug, wie beispielsweise Abstandstempomaten (Adaptive Cruise Control ACC) oder Spurhaltegeräte (Lane-Keeping-Support) in Abhängigkeit von dem Gefährdungspotentialwert ausgebildet ist. Damit kann das für die Abschaltung des Nachtsichtgerätes ermittelte Gefährdungspotential noch für andere Zwecke mitgenutzt werden.It is also particularly advantageous if the control unit of the night-vision device for deactivating further assistance devices in the motor vehicle, such as Adaptive Cruise Control ACC or lane keeping support, is designed as a function of the hazard potential value. Thus, the risk potential determined for the shutdown of the night-vision device can still be used for other purposes.

Umgekehrt können Informationen weiterer Assistenzgeräte in die Warn- und Abschaltstrategie mit einbezogen werden. So ist zum Beispiel ein Abschalten des Nachtsichtgerätes möglich, wenn ein Abstandstempomat ACC ein vorausfahrendes Fahrzeug im Abblendlichtbereich detektiert hat.Conversely, information from other assistance devices can be included in the warning and shutdown strategy. For example, a shutdown of the night vision device is possible when a Abstandstempomat ACC has detected a vehicle ahead in the low beam range.

Die Erfindung wird nachfolgend anhand der beigefügten Zeichnung beispielhaft näher erläutert. Es zeigt:

  • Figur 1 - Blockdiagramm eines Nachtsichtgerätes für Kraftfahrzeuge.
The invention will now be described by way of example with reference to the accompanying drawings. It shows:
  • FIG. 1 - Block diagram of a night vision device for motor vehicles.

Die Figur 1 lässt ein Blockdiagramm eines erfindungsgemäßen Nachtsichtgerätes 1 erkennen, das eine vorzugsweise programmierbare Steuerungseinheit 2 mit einem Mikroprozessor hat, an die eine Anzeigeeinheit 3 zur Darstellung des mit mindestens einem Nachtsichtsensor 4 aufgenommenen Nachtsichtbildes in herkömmlicher Weise verbunden ist.The FIG. 1 1 shows a block diagram of a night vision device 1 according to the invention, which has a preferably programmable control unit 2 with a microprocessor, to which a display unit 3 for displaying the night vision image recorded with at least one night vision sensor 4 is connected in a conventional manner.

Der Nachtsichtsensor 4 kann eine herkömmliche Sensoreinrichtung auf Basis von nahem Infrarot mit aktiver Beleuchtung (NIR) oder auf Basis von Wärmestrahlung (FIR) sein.The night vision sensor 4 may be a conventional sensor device based on near infrared with active illumination (NIR) or based on thermal radiation (FIR).

Die Anzeigeeinheit 3 kann ein herkömmliches Display oder Head-Up-Projektor o. ä. sein.The display unit 3 may be a conventional display or head-up projector or the like.

Ein solches Nachtsichtgerät 1 kann dann gefährlich werden, wenn der Fahrer bei kritischen Fahrsituationen ausschließlich oder überwiegend auf die Anzeigeeinheit 3 achtet, anstatt die Straßenszene direkt durch die Windschutzscheibe des Kraftfahrzeuges hindurch zu beobachten. Kritisch wird eine Fahrsituation unter anderem dann, wenn die Geschwindigkeit v des Kraftfahrzeugs dem Fahren mit Berücksichtigung des angezeigten Nachtsichtbildes nicht angepasst ist.Such a night vision device 1 can be dangerous if the driver respects exclusively or predominantly the display unit 3 in critical driving situations, instead of observing the street scene directly through the windshield of the motor vehicle. A driving situation becomes critical, inter alia, when the speed v of the motor vehicle is not adapted to driving, taking into account the displayed night vision image.

Daher ist die Steuerungseinheit 2 vorzugsweise über einen Datenbus 5 im Fahrzeug, zum Beispiel einem CAN Bus mit einem Geschwindigkeitssensor 6 gekoppelt. Von dem Geschwindigkeitssensor 6 wird die Geschwindigkeit v als Parameter zur Berechnung eines Gefährdungspotentialwertes in die Steuerungseinheit geleitet.Therefore, the control unit 2 is preferably coupled to a speed sensor 6 via a data bus 5 in the vehicle, for example a CAN bus. From the speed sensor 6, the speed v is passed as a parameter for calculating a hazard potential value in the control unit.

Bei der Ermittlung eines Gefährdungspotentialwertes, der die Gefährlichkeit der momentanen Fahrsituation im Hinblick auf die Nutzung des Nachtsichtgerätes 1 repräsentiert, können noch weitere Parameter berücksichtigt werden, die beispielsweise über den Datenbus 5, aber auch optional direkt in die Steuerungseinheit 2 geleitet werden. Kritisch kann auch das Fahren auf kurviger Strecke mit einer Geschwindigkeit sein, für die die Sichtweite des Nachtsichtgerätes 1 auf geraden Passagen zwar ausreichen würde, die aber auf Grund des komplexen Straßenverlaufs für das Verfahren mit Nachtsichtgerät 1 zu hoch ist. Die Informationen über den Straßenverlauf können von einem Navigationsgerät 7 extrahiert werden. Hiermit können auch kritische Straßenbedingungen berücksichtigt werden, die noch nicht im Sichtbereich des Nachtsichtsensors 4 sind (z. B. Kurven hinter einer Kuppe).When determining a hazard potential value, which represents the danger of the current driving situation with regard to the use of the night vision device 1, further parameters can be taken into account, which are routed for example via the data bus 5, but also optionally directly into the control unit 2. Driving on a winding track at a speed for which the visibility of the night-vision device 1 on straight passages would indeed be sufficient, but which is too high for the method with night-vision device 1 due to the complex road course, can also be critical. The information about the road can be extracted from a navigation device 7. This can also take into account critical road conditions that are not yet in the field of vision of the night vision sensor 4 (eg curves behind a crest).

Auch die spezifische Witterungssituation, zum Beispiel Glatteis in der nächsten Kurve, könnte ein Parameter zur Berechnung des Gefährdungspotentialwertes sein, der beispielsweise von einem Navigationsgerät 7 geliefert werden kann.The specific weather situation, for example black ice in the next curve, could also be a parameter for calculating the hazard potential value, which can be supplied by a navigation device 7, for example.

Die von dem Navigationsgerät 7 extrahierten Parameter können beispielsweise auf einem im Fahrzeug verfügbaren Datenträger ausgelesen oder Online über Funkkommunikation von einer Zentrale gewonnen werden.The parameters extracted by the navigation device 7 can for example be read out on a data carrier available in the vehicle or can be obtained online via radio communication from a control center.

Weitere Parameter zur Berechnung des Gefährdungspotentialwertes können sein:

  • der Lenkradeinschlag oder die Fahrzeugbewegung; (durch eine Fahrdynamikregelung - Electronic Stability Program ESP -bereitgestellt)
  • Regen, beispielsweise durch integrierten Regensensor ermittelt;
  • Parameter über den Aufmerksamkeitszustand des Fahrers, die zum Beispiel über Analyse des Gas-, Brems- und Lenkverhaltens oder über eine Innenraumkamera durch Augenbewegungsanalyse gewonnen werden;
  • Informationen über die Tageszeit, zum Beispiel durch Ankoppeln einer Uhr an die Steuerungseinheit 2;
  • der Lichtzustand, der beispielsweise durch ein Lichtsensor ermittelt werden kann;
  • die aktuelle Sichtweite, die beispielsweise durch eine im Nachtsichtgerät 1 integrierte Auswerteeinheit berechnet werden kann;
  • im Bereich der Straße installierte ortsfeste Warnbaken, die über Funk mit dem Fahrzeug kommunizieren und Warnparameter abgeben;
  • der Verfügbarkeitszustand der Infrarot-Scheinwerfer des Nachtsichtsensors 4 (Scheinwerfer defekt, Scheinwerfer auf Grund Personen in der Nähe nicht aktivierbar, o. ä.);
  • Reifendruck, zum Beispiel mit einem Reifendrucksensor gemessen.
Other parameters for calculating the hazard potential value can be:
  • the steering wheel or vehicle movement; (provided by a vehicle dynamics control system - Electronic Stability Program ESP)
  • Rain, determined for example by integrated rain sensor;
  • Parameters on the attentiveness of the driver, obtained for example by analysis of the gas, braking and steering behavior or via an interior camera by eye movement analysis;
  • Information about the time of day, for example by coupling a clock to the control unit 2;
  • the light state, which can be determined for example by a light sensor;
  • the current visibility, which can be calculated for example by an integrated in the night-vision device 1 evaluation;
  • fixed warning beacons installed in the area of the road, which communicate with the vehicle via radio and issue warning parameters;
  • the availability status of the night vision sensor 4 infrared headlamps (headlamp defective, headlamp not activatable due to nearby people, or similar);
  • Tire pressure, measured for example with a tire pressure sensor.

Die Steuerungseinheit 2 ist nunmehr so beispielsweise durch Programmierung ausgebildet, dass der Nachtsicht-Modus für den Fahrer nachvollziehbar deaktiviert wird, wenn das Gefährdungspotential den Nutzen des Nachtsichtgerätes 1 übersteigt.The control unit 2 is now so formed, for example, by programming that the night-vision mode for the driver is traceable disabled if the risk exceeds the benefits of the night vision device 1.

Hierzu wird der Gefährungspotentialwert durch die Steuerungseinheit 2 in Abhängigkeit von der Fahrzeuggeschwindigkeit v und gegebenenfalls weiteren oben genannten Parametern berechnet und mit einem definierten Grenzwert verglichen.For this purpose, the potential value of the potential is calculated by the control unit 2 as a function of the vehicle speed v and possibly other parameters mentioned above and compared with a defined limit value.

Neben der erforderlichen Verarbeitung zusätzlicher Informationen durch den Fahrer, der sowohl das reale Bild und das Nachtsichtbild bei ortskorrektem Head-Up-Display erfassen muss, resultiert die Gefährdung durch das Nachtsichtgerät 1 auch aus dem Blick in die falsche Richtung auf die Anzeigeeinheit 3 anstatt direkt auf die Straße. Insbesondere z. B. in scharfen Kurven, die vom Nachtsichtgerät 1 nur teilweise erfasst oder Tieren/Fußgängern, die sich dem Fahrzeug im seitlichen Nahbereich der vom Nachtsichtgerät 1 nur begrenzt erfasst wird, von der Seite nähern.In addition to the required processing of additional information by the driver who has to capture both the real image and the night vision with a correct head-up display, the threat posed by the night vision device 1 also results from looking in the wrong direction on the display unit 3 instead of directly on the street. In particular z. B. in sharp turns, the night vision device 1 only partially detected or animals / pedestrians, which is limited to the vehicle in the lateral vicinity of the night vision device 1 is detected, approach from the side.

Der Gefährdungspotentialwert wird in einer bevorzugten Ausführungsform in mindestens drei Gefährungsniveaus aufgeteilt.The hazard potential value is, in a preferred embodiment, divided into at least three levels of risk.

Bei nichtvorhandener Gefährdung durch die Funktion des Nachtsichtgerätes 1 (Gefährdungsgrad = 0) kann das Nachtsichtgerät 1 unbeschränkt aktiviert werden und bleibt nach einer Aktivierung aktiv.If there is no danger due to the function of the night vision device 1 (degree of danger = 0), the night vision device 1 can be activated without restriction and remains active after activation.

Verschlechtert sich der Gefährdungsgrad, zum Beispiel durch Erhöhen der Geschwindigkeit, eine stärkere Krümmung von Kurven, ein Absinken der Außentemperatur etc., dann werden verschiedene, abgestufte Strategien angewendet.If the degree of danger deteriorates, for example by increasing the speed, a greater curvature of curves, a lowering of the outside temperature, etc., then different graded strategies are applied.

Bei einem Gefährdungsgrad von eins übersteigt der Nutzeffekt der Funktion des Nachtsichtgerätes 1 noch das Gefährdungspotential, beispielsweise beim Fahren mit etwas zu hoher Geschwindigkeit für die verfügbare Nachtsicht-Sichtweite. Dann bleibt die Nachtsichtfunktion zwar noch aktiv, es wird jedoch ein Hinweis auf der Anzeigeeinheit 3 ergänzt, dass zum Beispiel die Geschwindigkeit zu hoch ist. Dieser Hinweis ist vorzugsweise farblich markiert.At a hazard level of one, the efficiency of the function of the night-vision device 1 still exceeds the hazard potential, for example when driving at slightly too high speed for the available night-vision range. Then the night-vision function still remains active, but an indication on the display unit 3 is added that, for example, the speed is too high. This note is preferably marked in color.

Ermöglicht die zur Verfügung stehende Nachtsicht-Sichtweite eine Geschwindigkeit von 50 km/h bei voller Verfügbarkeit eines Sicherheitspuffers, so wird bei einer Geschwindigkeit von mehr als 59 km/h ein Gefährdungsgrad von 1 angenommen.If the available night-vision visibility allows a speed of 50 km / h with full availability of a safety buffer, then a speed of more than 59 km / h assumes a hazard level of 1.

Für den Fall, dass das Gefährdungspotential den Nutzeffekt des Nachtsichtgerätes 1 erreicht oder diesen übersteigt, wird ein Gefährdungsgrad von zwei angenommen. Dies ist zum Beispiel bei Fahren mit einer deutlich zu hohen Geschwindigkeit der Fall, für die die Sichtweite des Nachtsichtgerätes 1 nicht mehr ausreicht.In the event that the potential hazard reaches or exceeds the efficiency of the night vision device 1, a hazard level of two is assumed. This is the case, for example, when driving at a much too high speed, for which the visibility of the night-vision device 1 is no longer sufficient.

Eine solche, wesentliche Geschwindigkeitsüberschreitung wäre z.B. gegeben, wenn das Fahrzeug eine Geschwindigkeit von 75 km/h hat, das Nachtsichtgerät dem Fahrer jedoch nur einen Bereich vor dem Fahrzeug anzeigen kann, der bei einer Geschwindigkeit von höchstens 50 km/h eine sichere Fahrt gewährleistet.Such a substantial speed overrun would be e.g. given the vehicle has a speed of 75 km / h, however, the night-vision device can only show the driver an area in front of the vehicle which ensures safe driving at a speed of at most 50 km / h.

Welche Geschwindigkeit jeweils gefahrlos ist, ist von den aktuellen Sichtmöglichkeiten, aber auch von der Art der befahrenen Straße, also von der Straßenklasse oder dem Straßenverlauf, abhängig. Daher sind die oben angegebenen Geschwindigkeitswerte nur als Beispiel für eine spezielle Situation zu sehen. Die Geschwindigkeitsgrenzen können sich je nach entsprechender Situation nach oben oder nach unten verschieben.Whichever speed is safe depends on the current visibility, but also on the type of road you are driving, ie the road class or the road. Therefore, the speed values given above are only an example of a particular situation. The speed limits may shift up or down depending on the situation.

Recht die Sichtweite des Nachtsichtgerätes nicht mehr aus, so wird zunächst eine Warnung eingeblendet, die die Ursache für die Warnung nennt und ankündigt, dass das Nachtsichtbild in einer definierten Abschaltzeit (beispielsweise 10 Sekunden) deaktiviert wird. Die Warnung sollte ebenfalls farblich markiert werden, vorzugsweise in roter Schrift.If the visibility of the night-vision device is no longer sufficient, a warning is first displayed which indicates the cause of the warning and announces that the warning is being issued Night vision image in a defined turn-off (for example, 10 seconds) is disabled. The warning should also be color coded, preferably in red letters.

Die Deaktivierung sollte nur verzögert erfolgen, da dem Fahrer die Chance gegeben werden muss, mit Hilfe des Nachtsichtbildes seine Geschwindigkeit gezielt zu verringern. Eine sofortige Deaktivierung könnte fatal sein, da dann die Sichtweite schlagartig von der durch das Nachtsichtbild vergrößerten Sichtweite auf die Sichtweite mit Abblendlicht zurückgeht, beispielsweise von 150 m auf 50 m.The deactivation should be delayed, since the driver must be given the chance to reduce his speed with the help of the night vision image. An immediate deactivation could be fatal, since then the visibility decreases abruptly from the increased by the night vision visibility on the visibility with low beam, for example, from 150 m to 50 m.

Erst wenn der Fahrer nicht auf die Warnung reagiert wird das Nachtsichtbild nach der definierten Abschaltzeit stufenweise oder kontinuierlich deaktiviert. Das Nachtsichtbild kann auch langsam verblassen oder von oben nach unten ausgeblendet werden, so dass die Sichtweite für den Fahrer quasi kontinuierlich reduziert wird.Only when the driver does not respond to the warning is the night vision image deactivated stepwise or continuously after the defined switch-off time. The night vision image can also slowly fade or fade from top to bottom, so that the visibility for the driver is virtually continuously reduced.

Optional kann das angezeigte Nachtsichtbild auch blinken, wobei die Blinkfrequenz in Abhängigkeit vom noch aktuellen Gefährdungspotential oder von der Abschaltzeit variabel sein kann. So kann anfangs das Nachtsichtbild langsam blinkend und dann immer schneller blinkend angezeigt werden, bevor das Nachtsichtbild endgültig abgeschaltet wird.Optionally, the displayed night vision image may also flash, wherein the flashing frequency may be variable depending on the current hazard potential or on the shutdown time. For example, the night vision image may initially be flashing slowly and then flashing faster and faster before the night vision image is finally turned off.

Bei einem Gefährdungsgrad von zwei wird auch eine Aktivierung des Nachtsichtgerätes verhindert, wenn dieses noch nicht aktiviert ist. Der Fahrer wird dann über eine kurze Meldung hierüber informiert, zum Beispiel dass die Geschwindigkeit für den Nachtsicht-Modus zu hoch ist.At a hazard level of two, an activation of the night vision device is prevented, if this is not yet activated. The driver is then informed via a short message, for example that the speed is too high for the night vision mode.

Der Gefährdungsgrad kann ebenfalls auf den Wert 2 gesetzt werden, wenn die Aktivierung der Nachtsichtfunktion als reine Spielerei entdeckt wird, zum Beispiel am Tag bei fahrendem Fahrzeug außerhalb eines Diagnose-Modus.The hazard level can also be set to 2 if the activation of the night vision function is detected as a mere gimmick, for example, during the day when the vehicle is traveling outside a diagnostic mode.

Bei einem Gefährdungsgrad von eins ist eine Aktivierung des Nachtsichtgerätes 1 möglich, wobei jedoch stets ein Hinweis auf den Gefährdungsgrad beziehungsweise die Ursache des Gefährdungspotentials eingeblendet wird.With a degree of danger of one activation of the night-vision device 1 is possible, but always an indication of the degree of danger or the cause of the hazard potential is displayed.

Die Steuerungseinheit 2 kann mit weiteren Geräten zur Ausübung von Automatikfunktionen verbunden sein, um diese ab einem bestimmten Gefährdungspotentialwert oder Gefährdungsgrad zu deaktivieren. Solche Automatikfunktionen können beispielsweise in Abstandstempomaten oder Geräten zur Spurhalteunterstützung (Lane-Keeping-Support) implementiert sein. Auch hier sollte zunächst eine Warnung generiert werden, um den Fahrer eine gewisse Reaktionszeit einzuräumen.The control unit 2 may be connected to other devices for the exercise of automatic functions to disable them from a certain hazard potential value or degree of risk. Such automatic functions may, for example, be implemented in distance-learning or lane-keeping-support devices. Again, a warning should first be generated to give the driver a certain reaction time.

Die Deaktivierung des Nachtsichtgerätes 1 kann erfolgen, indem eine Zustandsmaschine des Lichtmodus des Nachtsichtgerätes 1 um entsprechende Zustände und Übergänge erweitert wird.The deactivation of the night-vision device 1 can take place by a state machine of the light mode of the night-vision device 1 being expanded by corresponding states and transitions.

Weiterhin kann das Nachtsichtgerät 1 an Funkempfänger gekoppelt sein, um Funkdaten über Parameter zur Berechnung des Gefährdungspotentials von ortsfesten am Straßenrand installierten Warnbaken mit Transpondem mit kleiner Reichweite zu empfangen. Damit können lokale Verkehrsbedingungen, wie zum Beispiel Regen, Temperaturen unter dem Gefrierpunkt, die zu lokalem Glatteis führen können, gefährliche Streckenabschnitte etc. berücksichtigt werden.Furthermore, the night vision device 1 may be coupled to radio receivers in order to receive radio data on parameters for calculating the hazard potential of stationary roadside warning beacons with transponders with a short range. This can take into account local traffic conditions, such as rain, sub-freezing temperatures, which can lead to local ice, dangerous sections, etc.

Die Warninformationen können auf der Anzeigeeinheit 3 dem Nachtsichtbild überlagert (destruktiv oder nicht-destruktiv), als Ikon am Rand oder zentral im Bild, stationär oder blinkend bewegt im Bild oder ähnlich angezeigt werden. Die Warnhinweise können auch je nach Schwere der Gefahr abgestuft sein. Je gefährlicher, desto größer und zentraler sollten diese auf der Anzeigeeinheit 3 dargestellt werden. Dann sollten sie auch eine aggressivere Farbe haben.The warning information may be superimposed on the display unit 3 to the night vision image (destructive or non-destructive), displayed as an icon on the edge or centrally in the image, stationary or blinking in the image, or the like. The warnings may also be graded according to the severity of the hazard. The more dangerous, the larger and more central they should be displayed on the display unit 3. Then they should also have a more aggressive color.

Claims (10)

  1. Night-vision device (1) for motor vehicles, having a display unit (3) for representing the surroundings of the vehicle recorded with at least one night-vision sensor (4), characterized in that the night-vision device (1) has a control unit (2)
    - for determining a value of the hazard potential by means of an activated display unit of the night-vision device (1) from the current driving situation which is conditioned at least via the velocity (v) of the vehicle, and
    - switching off of at least the display unit (3) of the night-vision device (1) if the hazard potential value exceeds a defined limiting value.
  2. Night-vision device (1) according to Claim 1, characterized in that the control unit (2) is designed to output a warning message as soon as the hazard potential value exceeds the defined limiting value, and to deactivate the night-vision device (1) with a time delay if the hazard potential value is still higher than the defined limiting value after a defined waiting time.
  3. Night-vision device (1) according to Claim 1 or 2, characterized in that the control unit (2) is designed to determine the hazard potential value as a function of steering wheel movement or vehicle movement, the course of the road, weather parameters, control sensor signals, parameters relating to the state of alertness of the driver, daytime information, the state of the light, the current visibility and/or availability of night-vision infrared headlights.
  4. Night-vision device (1) according to one of the preceding claims, characterized by an interface with a navigation apparatus (7) for transmitting data for determining the hazard potential, in particular information about the course of the road and/or weather parameters, from the navigation apparatus (7) to the night-vision apparatus (1).
  5. Night-vision apparatus (1) according to one of the preceding claims, characterized by a radio interface for warning beacons in the vicinity of the road, for transmitting data for determining the hazard potential.
  6. Night-vision apparatus (1) according to one of the preceding claims, characterized in that the night-vision apparatus (1) is designed to output warning messages if the hazard potential value rises and is lower than the defined limiting value.
  7. Night-vision apparatus (1) according to one of the preceding claims, characterized in that the control unit (2) is designed to specify the defined limiting value in a variable fashion as a function of the use effect parameters, for example the visibility.
  8. Night-vision apparatus (1) according to Claim 7, characterized in that the control unit (2) is designed to prevent the activation of the night-vision apparatus (1) if no use effect of the night-vision apparatus (1) on the driver of the motor vehicle has been ascertained.
  9. Night-vision apparatus (1) according to one of the preceding claims, characterized in that the control unit (2) is designed to deactivate the night-vision apparatus (1) in order to incrementally or continuously reduce the night-vision display on the display unit (3), to make said night-vision display flash on the display unit (3) or to remove it incrementally from the display unit (3) and subsequently to completely switch off the night-vision apparatus (1).
  10. Night-vision apparatus (1) according to one of the preceding claims, characterized in that the control unit (2) is designed to deactivate further assistance devices in the motor vehicle, in particular cruise controllers with an inter-vehicle distance control feature (ACC) or lane holding apparatuses as a function of the hazard potential value.
EP05726510A 2004-06-02 2005-04-05 Night-vision device for motor vehicles Not-in-force EP1756787B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102004026847A DE102004026847A1 (en) 2004-06-02 2004-06-02 Night vision device for motor vehicles
PCT/EP2005/051518 WO2005119623A1 (en) 2004-06-02 2005-04-05 Night-vision device for motor vehicles

Publications (2)

Publication Number Publication Date
EP1756787A1 EP1756787A1 (en) 2007-02-28
EP1756787B1 true EP1756787B1 (en) 2008-12-31

Family

ID=34968549

Family Applications (1)

Application Number Title Priority Date Filing Date
EP05726510A Not-in-force EP1756787B1 (en) 2004-06-02 2005-04-05 Night-vision device for motor vehicles

Country Status (6)

Country Link
US (1) US8125519B2 (en)
EP (1) EP1756787B1 (en)
AT (1) ATE419607T1 (en)
DE (2) DE102004026847A1 (en)
ES (1) ES2317217T3 (en)
WO (1) WO2005119623A1 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4321543B2 (en) 2006-04-12 2009-08-26 トヨタ自動車株式会社 Vehicle periphery monitoring device
DE102013003187A1 (en) * 2013-02-26 2014-09-11 Audi Ag Method for operating a motor vehicle side driver assistance system with a combined longitudinal and transverse guidance function
JP2016521480A (en) 2013-03-22 2016-07-21 セイコーエプソン株式会社 Infrared video display eyewear
US9099006B2 (en) 2013-08-22 2015-08-04 GM Global Technology Operations LLC Context-aware threat response arbitration
JP6969072B2 (en) * 2016-03-14 2021-11-24 ソニーグループ株式会社 Information processing equipment, information processing methods, programs, and vehicles
KR20220000536A (en) * 2020-06-26 2022-01-04 현대자동차주식회사 Apparatus and method for controlling driving of vehicle

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001150977A (en) * 1999-11-25 2001-06-05 Mazda Motor Corp Display for vehicle
US6556905B1 (en) * 2000-08-31 2003-04-29 Lisa M. Mittelsteadt Vehicle supervision and monitoring
SE520042C2 (en) * 2000-10-26 2003-05-13 Autoliv Dev Device for improving the night vision of a vehicle such as a car
DE10131720B4 (en) 2001-06-30 2017-02-23 Robert Bosch Gmbh Head-Up Display System and Procedures
DE10203413C2 (en) 2002-01-28 2003-11-27 Daimler Chrysler Ag Automobile infrared night vision device
US6864784B1 (en) * 2002-07-19 2005-03-08 Barry Loeb Vehicle speed and safety warning system
DE10346507B4 (en) * 2003-10-02 2007-10-11 Daimlerchrysler Ag Device for improving the visibility in a motor vehicle
DE10346482B4 (en) * 2003-10-02 2008-08-28 Daimler Ag Device for improving the visibility in a motor vehicle
US7107138B2 (en) * 2004-11-02 2006-09-12 Joseph Edward Currie Automotive speed control disable switch

Also Published As

Publication number Publication date
DE102004026847A1 (en) 2005-12-22
ES2317217T3 (en) 2009-04-16
DE502005006385D1 (en) 2009-02-12
US8125519B2 (en) 2012-02-28
WO2005119623A1 (en) 2005-12-15
EP1756787A1 (en) 2007-02-28
US20070291113A1 (en) 2007-12-20
ATE419607T1 (en) 2009-01-15

Similar Documents

Publication Publication Date Title
EP1751728B1 (en) Assistance system for motor vehicles
EP3931020B1 (en) Method for operating a driver information system in an ego-vehicle and driver information system
EP3931022B1 (en) Method for operating a driver information system in an ego vehicle and driver information system
EP3931026B1 (en) Method for operating a driver information system in an ego-vehicle and driver information system
EP3931034B1 (en) Method for operating a driver information system in an ego-vehicle and driver information system
DE102011055495B4 (en) Method for operating a driver assistance system of a vehicle
EP3931021B1 (en) Method for operating a driver information system in an ego vehicle and driver information system
EP3931029B1 (en) Method for operating a driver information system in an ego-vehicle and driver information system
EP3931028B1 (en) Method for operating a driver information system in an ego-vehicle and driver information system
EP3931023B1 (en) Method for operating a driver information system in an ego-vehicle and driver information system
EP3931033B1 (en) Method for operating a driver information system in an ego vehicle and driver information system
DE102016203080A1 (en) Method for operating a head-up display, head-up display device
DE102005023185A1 (en) Lane change assistant for motor vehicles
DE102005057251A1 (en) Drive assistance system e.g. lane keeping system, operating method for use in motor vehicle, involves automatically deactivating system by boundary condition during exceedance or falling below of threshold value
EP3717327B1 (en) Method and device for displaying a feasibility of an at least semi-automatically executable driving maneuver in a vehicle
DE102012108563A1 (en) Method and devices for collision warning during lane changes
EP1756787B1 (en) Night-vision device for motor vehicles
DE202014006923U1 (en) Driver assistance system, computer program product and motor vehicle
DE102012023630A1 (en) Method for informing driver of motor vehicle with respect to environmental data driver assistance system, involves displaying driver running maneuver by assistance system of first vehicle by first icon in field of view of first vehicle
DE102013219447A1 (en) Method for operating a warning device of a vehicle, warning device
DE102015008263A1 (en) Method and device for assisting a driver in driving a vehicle
EP3931024B1 (en) Method for operating a driver information system in an ego-vehicle and driver information system
EP1898381B1 (en) Apparatus and method for driver information
EP3931030B1 (en) Method for operating a driver information system in an ego-vehicle and driver information system
EP3931025B1 (en) Method for operating a driver information system in an ego-vehicle and driver information system

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20070102

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU MC NL PL PT RO SE SI SK TR

DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU MC NL PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REF Corresponds to:

Ref document number: 502005006385

Country of ref document: DE

Date of ref document: 20090212

Kind code of ref document: P

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2317217

Country of ref document: ES

Kind code of ref document: T3

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20081231

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20081231

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20081231

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20081231

NLV1 Nl: lapsed or annulled due to failure to fulfill the requirements of art. 29p and 29m of the patents act
PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20081231

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20081231

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20081231

REG Reference to a national code

Ref country code: IE

Ref legal event code: FD4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20090601

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20081231

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20090331

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20090430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20081231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20081231

Ref country code: IE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20081231

BERE Be: lapsed

Owner name: ROBERT BOSCH G.M.B.H.

Effective date: 20090430

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

26N No opposition filed

Effective date: 20091001

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20090405

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20090430

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20090331

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20090430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20090430

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20090405

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20090430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20090405

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20090401

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20090405

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20090701

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20081231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20081231

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20120423

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20130424

Year of fee payment: 9

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20140416

Year of fee payment: 10

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140405

REG Reference to a national code

Ref country code: ES

Ref legal event code: FD2A

Effective date: 20150527

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140406

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20151231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20150430

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20190627

Year of fee payment: 15

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 502005006385

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201103