DE4032927A1 - Motor vehicle driver's vision enhancement by IR imaging - involves head=up display virtual image converted from reflection of IR component of headlamp emission - Google Patents

Motor vehicle driver's vision enhancement by IR imaging - involves head=up display virtual image converted from reflection of IR component of headlamp emission

Info

Publication number
DE4032927A1
DE4032927A1 DE4032927A DE4032927A DE4032927A1 DE 4032927 A1 DE4032927 A1 DE 4032927A1 DE 4032927 A DE4032927 A DE 4032927A DE 4032927 A DE4032927 A DE 4032927A DE 4032927 A1 DE4032927 A1 DE 4032927A1
Authority
DE
Germany
Prior art keywords
motor vehicle
driver
camera
component
virtual image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
DE4032927A
Other languages
German (de)
Other versions
DE4032927C2 (en
Inventor
Frieder Heizmann
Christian Dipl Ing Lietar
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Robert Bosch GmbH
Original Assignee
Robert Bosch GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Robert Bosch GmbH filed Critical Robert Bosch GmbH
Priority to DE4032927A priority Critical patent/DE4032927A1/en
Publication of DE4032927A1 publication Critical patent/DE4032927A1/en
Application granted granted Critical
Publication of DE4032927C2 publication Critical patent/DE4032927C2/de
Granted legal-status Critical Current

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q1/00Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
    • B60Q1/02Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments
    • B60Q1/04Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights
    • B60Q1/14Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights having dimming means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/24Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view in front of the vehicle
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/23Head-up displays [HUD]
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/40Instruments specially adapted for improving the visibility thereof to the user, e.g. fogging prevention or anti-reflection arrangements
    • B60K35/405Fogging prevention
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/65Instruments specially adapted for specific vehicle types or users, e.g. for left- or right-hand drive
    • B60K35/654Instruments specially adapted for specific vehicle types or users, e.g. for left- or right-hand drive the user being the driver
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/30Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles providing vision in the non-visible spectrum, e.g. night or infrared vision
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • G01S17/93Lidar systems specially adapted for specific applications for anti-collision purposes
    • G01S17/931Lidar systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/20Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/106Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using night vision cameras
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/20Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used
    • B60R2300/205Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used using a head-up display
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8053Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for bad weather conditions or night vision
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0138Head-up displays characterised by optical features comprising image capture systems, e.g. camera

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • Transportation (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Optics & Photonics (AREA)
  • Instrument Panels (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

The range of vision of the driver (17) is extended by an IR sensitive camera (14) connected to a display device (16) which projects the image onto the windscreen. The driver sees simultaneously and uninterruptedly the areas served by the fog lamps (11) and the IR camera (14). For good superposition of the virtual and real images, the camera should be mounted close to the driver's eyes, e.g. on the internal rear-view mirror. Halogen lamp emission contains a sufficient IR component. USE/ADVANTAGE - IR vision system for car driver. Safety, esp. in fog, is enhanced without additional dazzle of oncoming drivers.

Description

Stand der TechnikState of the art

Die Erfindung geht aus von einer Vorrichtung zur Verbesserung der Sichtverhältnisse in einem Kraftfahrzeug nach der Gattung des Haupt­ anspruchs. Aus der DE-OS 38 32 720 ist eine Abstandsmeßeinrichtung zur berührungslosen Abstands- und Winkelerkennung von Gegenständen, insbesondere im Nahbereich von Kraftfahrzeugen bekannt, bei der die Abstandsmeßeinrichtung auf einem Ultraschallverfahren beruht, während die Winkelerkennung ein Infrarotverfahren verwendet. Die bekannte Vorrichtung weist gegenüber der menschlichen Wahrnehmung den Vorteil auf, daß selbst bei ungünstigen Sichtverhältnissen für einen Fahrer des Kraftfahrzeugs, insbesondere bei Nebel, jeweils Meßwerte erhalten werden. Dieser Vorteil wird dadurch erreicht, daß insbesondere die Infrarotstrahlung durch Nebel weniger gedämpft wird als der sichtbare Strahlungsbereich. Zur Anzeige der erfaßten Meß­ werte ist beispielsweise ein graphikfähiger Bildschirm vorgesehen, der die Umgebung des Kraftfahrzeugs darstellt und gegebenenfalls Meßwerte einblendet. The invention relates to a device for improving the Visibility in a motor vehicle according to the type of the main demanding DE-OS 38 32 720 is a distance measuring device for non-contact distance and angle detection of objects, especially known in the vicinity of motor vehicles, in which the Distance measuring device is based on an ultrasound method, while angle detection uses an infrared technique. The known device points towards human perception the advantage that even with poor visibility for a driver of the motor vehicle, especially in fog, in each case Measured values are obtained. This advantage is achieved in that In particular, infrared radiation is less dampened by fog than the visible radiation area. To display the recorded measurement values, a graphics-capable screen is provided, for example, which represents the surroundings of the motor vehicle and, if appropriate Fade in measured values.  

Eine andere Anzeigevorrichtung, die Anwendung in Kraftfahrzeugen findet, ist aus der DE-OS 38 22 222 bekannt, die eine Einrichtung für Head-up-Displays in Kraftfahrzeugen beschreibt. Ein Head-up-Dis­ play spiegelt bildhaft dargestellte Anzeigemuster in das Sichtfeld des Fahrers. Dabei werden auf einen Teil der Windschutzscheibe, der im Sichtfeld des Fahrers liegt, Meß- oder Warnsignale eingeblendet. Zur Überlagerung des virtuellen Bildes, das aus den Anzeigenele­ menten gebildet wird, mit dem tatsächlichen Bild der äußeren Land­ schaft ist beispielsweise ein teildurchlässiger Spiegel vorgesehen, wobei die Reflexion an der Windschutzscheibe ausgenutzt werden kann oder eine vor der Windschutzscheibe stehende zusätzliche Scheibe (Combiner) benutzt werden kann.Another display device for use in motor vehicles finds is known from DE-OS 38 22 222, which is a device for head-up displays in motor vehicles. A head-up dis play reflects pictorial display patterns in the field of vision of the driver. Do this on part of the windshield, the is in the driver's field of vision, measurement or warning signals are displayed. For overlaying the virtual image from the display element ment is formed with the actual image of the outer country for example, a partially transparent mirror is provided, the reflection on the windshield can be exploited or an additional pane in front of the windshield (Combiner) can be used.

Der erfindungsgemäßen Vorrichtung liegt die Aufgabe zugrunde, die Sichtverhältnisse, insbesondere bei Nebel, zu verbessern.The device of the invention is based on the task To improve visibility, especially in fog.

Diese Aufgabe wird durch die im Hauptanspruch angegebenen Merkmale gelöst.This object is achieved by the features specified in the main claim solved.

Vorteile der ErfindungAdvantages of the invention

Die erfindungsgemäße Vorrichtung weist den Vorteil auf, daß die Ver­ kehrssicherheit durch eine Vergrößerung des Sichtbereichs erhöht wird. Innerhalb des Sichtbereichs und zumindest innerhalb eines be­ stimmten Blickwinkels, der von der erfindungsgemäßen Vorrichtung er­ faßt wird, wird der Straßenraum oder die äußere Landschaft nahezu vollständig gesehen.The device according to the invention has the advantage that the Ver Road safety increased by increasing the field of vision becomes. Within the field of view and at least within a be agreed viewing angle of the device according to the invention is grasped, the street space or the external landscape becomes almost completely seen.

Die Auswertung eines erfaßten Bildes erfolgt durch den Fahrer des Kraftfahrzeugs, ohne daß eine aufwendige Signalverarbeitung not­ wendig wäre. The evaluation of a captured image is carried out by the driver of the Motor vehicle, without the need for complex signal processing would be agile.  

Die erfindungsgemäße Vorrichtung weist ferner den Vorteil auf, daß keine zusätzliche Blendung anderer Verkehrsteilnehmer auftritt.The device according to the invention also has the advantage that there is no additional glare to other road users.

Vorteilhafte Weiterbildungen und Verbesserungen der erfindungsge­ mäßen Vorrichtung ergeben sich aus Unteransprüchen und werden in der folgenden Beschreibung näher erläutert.Advantageous further developments and improvements of the fiction moderate device result from subclaims and are in the following description explained in more detail.

Zeichnungdrawing

Eine erfindungsgemäße Vorrichtung zur Verbesserung der Sichtver­ hältnisse in einem Kraftfahrzeug ist in der Figur dargestellt.A device according to the invention for improving the sight Ratios in a motor vehicle is shown in the figure.

In der Figur ist ein Kraftfahrzeug 10 gezeigt, dessen Scheinwerfer und/oder Nebelscheinwerfer 11 den vor dem Fahrzeug 10 liegenden Sichtbereich 12 bestrahlen. Die Grenzen 13 der von den Scheinwerfern 11 ausgehenden Strahlung sind in der Figur strichliniert mit kurzen Strichen eingetragen. Die Strahlung der Scheinwerfer 11 enthält einen Infrarotstrahlungsanteil, der von einer im Fahrzeug 10 ange­ ordneten infrarotempfindlichen Kamera 14 erfaßt wird. Die Grenzen 15 der von der Kamera 14 erfaßten Strahlung sind in der Figur strich­ liniert mit langen Strichen eingetragen. Das von der Kamera 14 ab­ gegebene Bild ist einer Anzeigevorrichtung 16 zugeführt, die das Bild der Kamera 14 als virtuelles Bild dem Bild der äußeren Land­ schaft visuell überlagert.In the figure, a motor vehicle 10 is shown, the headlights and / or fog lights 11 of which illuminate the visible area 12 lying in front of the vehicle 10 . The limits 13 of the radiation emanating from the headlights 11 are shown in the figure by dashed lines with short dashes. The radiation of the headlights 11 contains an infrared radiation component which is detected by an infrared-sensitive camera 14 arranged in the vehicle 10 . The boundaries 15 of the radiation detected by the camera 14 are shown in the figure with dashed lines and long lines. The image given by the camera 14 is supplied to a display device 16 which visually overlays the image of the camera 14 as a virtual image of the image of the outer landscape.

Mit der erfindungsgemäßen Vorrichtung sieht der Fahrer 17 gleich­ zeitig und ununterbrochen den Sichtbereich 12 soweit wie möglich direkt mit der sichtbaren Strahlung und den entfernteren Straßen­ raum, der beispielsweise in Nebel gehüllt ist, mit Hilfe der von der Kamera 14 erfaßten Infrarotstrahlung. Die Auswertung der über­ lagerten Bilder erfolgt ausschließlich durch einen Fahrer 17, wobei keine weitere Signalverarbeitung nötig ist. With the device according to the invention, the driver 17 sees the viewing area 12 simultaneously and continuously as far as possible directly with the visible radiation and the more distant road space, which is, for example, enveloped in fog, with the help of the infrared radiation detected by the camera 14 . The overlaid images are evaluated exclusively by a driver 17 , no further signal processing being necessary.

Um eine gute Überlagerung des virtuellen Bildes mit dem tatsäch­ lichen Bild der äußeren Landschaft zu erhalten, sollte die Infrarot­ kamera 14 möglichst in Augennähe des Fahrers 17, beispielsweise bei einem Rückspiegel des Kraftfahrzeugs 10 angeordnet sein. Anderer­ seits sollte das optische System, das die Kamera 14 und die Anzeige­ vorrichtung 16 enthält, so ausgelegt sein, daß ein Betrachtungs­ winkel α der sichtbar gemachten Infrarotaufnahme der äußeren Land­ schaft dem Betrachtungswinkel β des direkt betrachteten Sichtbe - reichs 12 entsprechen. Weiterhin sollte die Darstellung der Infra­ rotaufnahme vor den Augen so weit entfernt sein, daß beim Betrachten keine Akkommodation nötig ist. Als Anzeigevorrichtung ist ein be­ kanntes Head-up-Display vorgesehen.In order to obtain a good overlay of the virtual image with the actual image of the outer landscape, the infrared camera 14 should be arranged as close as possible to the eyes of the driver 17 , for example in a rearview mirror of the motor vehicle 10 . On the other hand, the optical system, which contains the camera 14 and the display device 16 , should be designed such that a viewing angle α of the infrared image made visible of the outer landscape corresponds to the viewing angle β of the directly viewed viewing area 12 . Furthermore, the representation of the infrared image in front of the eyes should be so far away that no accommodation is necessary when viewing. A known head-up display is provided as a display device.

Der Infrarotstrahlungsanteil der derzeit verwendeten Glühlampen, gegebenenfalls mit Halogenzusatz, ist für die Bestrahlung des Sicht­ bereichs 12 ausreichend. Die in Zukunft gegebenenfalls vorgesehenen Entladungslampen weisen ein in Richtung auf kürzere Wellenlängen hin verschobenes Spektrum auf, so daß gegebenenfalls zusätzliche Infrarotstrahler erforderlich werden. Eine zusätzliche Blendung ent­ gegenkommender Fahrer von Kraftfahrzeugen tritt nicht auf.The infrared radiation component of the incandescent lamps currently used, possibly with halogen addition, is sufficient for irradiating the viewing area 12 . The discharge lamps which may be provided in the future have a spectrum which is shifted towards shorter wavelengths, so that additional infrared radiators may be required. There is no additional glare for oncoming drivers of motor vehicles.

Claims (4)

1. Vorrichtung zur Verbesserung der Sichtverhältnisse in einem Kraftfahrzeug, dadurch gekennzeichnet, daß zur Bestrahlung des von einem Fahrer (17) erfaßten Sichtbereichs (12) in Fahrtrichtung wenigstens eine Strahlungsquelle (11) mit einem Infrarotstrahlungs­ anteil vorgesehen ist, daß eine infrarotempfindliche Kamera (14) den Sichtbereich (12) wenigstens näherungsweise unter einem gleichen Blickwinkel wie der Fahrer (17) aufnimmt, und daß eine Anzeigevor­ richtung (16) vorgesehen ist, die das Bild der Kamera (17) als virtuelles Bild dem Bild der äußeren Landschaft visuell überlagert.1. A device for improving the visibility in a motor vehicle, characterized in that at least one radiation source ( 11 ) with an infrared radiation portion is provided for irradiating the visual range ( 12 ) detected by a driver ( 17 ) in the direction of travel, that an infrared-sensitive camera ( 14 ) the viewing area ( 12 ) at least approximately at the same angle as the driver ( 17 ), and that a device ( 16 ) is provided which visually superimposes the image of the camera ( 17 ) as a virtual image on the image of the external landscape. 2. Vorrichtung nach Anspruch 2, dadurch gekennzeichnet, daß als Infrarotstrahlungsquelle (11) die vorhandenen Schweinwerfer des Kraftfahrzeugs (10) vorgesehen sind.2. Device according to claim 2, characterized in that the existing headlights of the motor vehicle ( 10 ) are provided as the infrared radiation source ( 11 ). 3. Vorrichtung nach Anspruch 1, dadurch gekennzeichnet, daß als Infrarotstrahlungsquelle (11) spezielle Infrarotstrahler vorgesehen sind.3. Apparatus according to claim 1, characterized in that special infrared emitters are provided as the infrared radiation source ( 11 ). 4. Vorrichtung nach einem der vorhergehenden Ansprüche, dadurch gekennzeichnet, daß die Kamera (17) bei einem Rückspiegel des Kraft­ fahrzeugs (10) angeordnet ist.4. Device according to one of the preceding claims, characterized in that the camera ( 17 ) is arranged at a rearview mirror of the motor vehicle ( 10 ).
DE4032927A 1990-10-17 1990-10-17 Motor vehicle driver's vision enhancement by IR imaging - involves head=up display virtual image converted from reflection of IR component of headlamp emission Granted DE4032927A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
DE4032927A DE4032927A1 (en) 1990-10-17 1990-10-17 Motor vehicle driver's vision enhancement by IR imaging - involves head=up display virtual image converted from reflection of IR component of headlamp emission

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE4032927A DE4032927A1 (en) 1990-10-17 1990-10-17 Motor vehicle driver's vision enhancement by IR imaging - involves head=up display virtual image converted from reflection of IR component of headlamp emission

Publications (2)

Publication Number Publication Date
DE4032927A1 true DE4032927A1 (en) 1992-04-30
DE4032927C2 DE4032927C2 (en) 1993-04-15

Family

ID=6416456

Family Applications (1)

Application Number Title Priority Date Filing Date
DE4032927A Granted DE4032927A1 (en) 1990-10-17 1990-10-17 Motor vehicle driver's vision enhancement by IR imaging - involves head=up display virtual image converted from reflection of IR component of headlamp emission

Country Status (1)

Country Link
DE (1) DE4032927A1 (en)

Cited By (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2692852A1 (en) * 1992-06-30 1993-12-31 Cibie Pierre Method and device for long-distance night vision for motor vehicles
FR2705293A1 (en) * 1993-05-18 1994-11-25 Valeo Vision System for assisting vision in a motor vehicle
EP0686865A1 (en) * 1994-06-09 1995-12-13 Delco Electronics Corporation Night vision system for motor vehicles
FR2721872A1 (en) * 1994-07-01 1996-01-05 Renault Nationale Usines Head-up display device for producing additional image of road ahead
FR2725576A1 (en) * 1994-10-11 1996-04-12 Peugeot METHOD FOR IMPROVING THE NIGHT VIEW OF THE DRIVER OF A MOTOR VEHICLE AND DEVICE FOR IMPLEMENTING SUCH A METHOD
FR2726144A1 (en) * 1994-10-24 1996-04-26 Valeo Vision Night vision improvement method esp. for driver of motor vehicle
FR2730035A1 (en) * 1995-01-30 1996-08-02 Valeo Vision Infra-red headlamp to aid night vision in motor vehicle
FR2730201A1 (en) * 1995-02-02 1996-08-09 Valeo Vision DEVICE FOR THE AUTOMATIC CORRECTION OF THE ORIENTATION OF AT LEAST ONE VEHICLE PROJECTOR DURING VARIATIONS OF PLATES THEREOF
FR2730334A1 (en) * 1995-02-08 1996-08-09 Peugeot Motor vehicle night vision system
US5729016A (en) * 1994-04-12 1998-03-17 Hughes Aircraft Company Low cost night vision system for nonmilitary surface vehicles
WO1999001845A1 (en) * 1997-07-02 1999-01-14 Raytheon Ti Systems, Inc. Method and apparatus for providing vision using virtual image
US6061068A (en) * 1998-06-30 2000-05-09 Raytheon Company Method and apparatus for providing synthetic vision using reality updated virtual image
EP1146497A1 (en) * 2000-04-12 2001-10-17 Peugeot Citroen Automobiles SA Secure driving aid for motor vehicles
US6491417B1 (en) 2001-06-13 2002-12-10 Bendix Commercial Vehicle Systems Llc Night vision clearance light
EP1275981A2 (en) * 2001-06-30 2003-01-15 DaimlerChrysler AG Device for improving visibility in vehicles
WO2003005102A1 (en) * 2001-06-30 2003-01-16 Robert Bosch Gmbh Head-up display system and method for carrying out the location-correct display of an object situated outside a vehicle with regard to the position of the driver
EP1026031A3 (en) * 1999-02-02 2003-01-22 C.R.F. Società Consortile per Azioni Dual-band infra-red vision system for motor-vehicles
US6552342B2 (en) 2000-01-18 2003-04-22 Daimlerchrysler Ag System for improving the visibility in vehicles
EP1262795A3 (en) * 2001-05-31 2004-04-14 DaimlerChrysler AG Method and apparatus for improving visibility in a vehicle
WO2004059978A1 (en) * 2002-12-20 2004-07-15 Daimlerchrysler Ag Area of representation in an automotive night vision system
FR2860467A1 (en) * 2003-10-02 2005-04-08 Daimler Chrysler Ag DEVICE FOR IMPROVING VISION CONDITIONS IN A VEHICLE
FR2860464A1 (en) 2003-10-02 2005-04-08 Daimler Chrysler Ag DEVICE FOR IMPROVING VISION CONDITIONS IN A VEHICLE
FR2860456A1 (en) * 2003-10-02 2005-04-08 Daimler Chrysler Ag DEVICE FOR IMPROVING VISION CONDITIONS IN A VEHICLE
FR2860463A1 (en) 2003-10-02 2005-04-08 Daimler Chrysler Ag DEVICE FOR IMPROVING VISION CONDITIONS IN A VEHICLE
DE10343479A1 (en) * 2003-09-19 2005-04-28 Bosch Gmbh Robert Method for improving the visibility in a motor vehicle
DE10346482A1 (en) * 2003-10-02 2005-05-12 Daimler Chrysler Ag Device for improving the visibility in a motor vehicle
EP1544640A1 (en) 2003-12-16 2005-06-22 DaimlerChrysler AG Device for improving the visibilities in a motor vehicle
EP1580092A2 (en) 2004-03-26 2005-09-28 Robert Bosch Gmbh Camera in a vehicle
EP1607771A1 (en) * 2004-06-12 2005-12-21 Robert Bosch Gmbh Camera objective
US7222999B2 (en) 2003-01-20 2007-05-29 Robert Bosch Gmbh Headlight for vehicles
WO2008000564A1 (en) 2006-06-29 2008-01-03 Robert Bosch Gmbh System and method for displaying images of the surroundings of a motor vehicle
US7372030B2 (en) 2004-07-12 2008-05-13 Siemens Aktiengesellschaft Method for representing a front field of vision from a motor vehicle
EP1378396B1 (en) * 2002-07-05 2008-09-17 Robert Bosch Gmbh Device for increasing visibility
DE19826283B4 (en) * 1997-06-19 2008-10-16 Volkswagen Ag Method for displaying an object located in front of a motor vehicle, in particular a motor vehicle driving in front
US7667585B2 (en) 2004-03-18 2010-02-23 Robert Bosch Gmbh Method and device for improving visibility in a vehicle
US8818042B2 (en) 2004-04-15 2014-08-26 Magna Electronics Inc. Driver assistance system for vehicle
US8842176B2 (en) 1996-05-22 2014-09-23 Donnelly Corporation Automatic vehicle exterior light control
US8917169B2 (en) 1993-02-26 2014-12-23 Magna Electronics Inc. Vehicular vision system
US8993951B2 (en) 1996-03-25 2015-03-31 Magna Electronics Inc. Driver assistance system for a vehicle
US9171217B2 (en) 2002-05-03 2015-10-27 Magna Electronics Inc. Vision system for vehicle
US9436880B2 (en) 1999-08-12 2016-09-06 Magna Electronics Inc. Vehicle vision system
US10071676B2 (en) 2006-08-11 2018-09-11 Magna Electronics Inc. Vision system for vehicle
JP2019048536A (en) * 2017-09-08 2019-03-28 三菱自動車工業株式会社 Vehicular headlight control apparatus

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19900366C2 (en) * 1998-06-16 2000-05-18 Limat Ag Eschen Transmission device for the hidden transmission of image content
DE10016184C2 (en) * 2000-03-31 2002-02-07 Audi Ag Device for displaying the surroundings of a vehicle
DE10301829B4 (en) * 2003-01-20 2010-10-28 Automotive Lighting Reutlingen Gmbh Headlights for vehicles
DE10346508B4 (en) * 2003-10-02 2007-10-11 Daimlerchrysler Ag Device for improving the visibility in a motor vehicle
DE10346483B4 (en) 2003-10-02 2007-11-22 Daimlerchrysler Ag Device for improving the visibility in a motor vehicle
DE102007043113A1 (en) 2007-09-10 2009-03-12 Robert Bosch Gmbh Headlights for vehicles
DE102008033493A1 (en) * 2008-07-16 2010-01-21 Heese, Werner, Dipl.-Ing. Method for improving visibility in motor vehicle during e.g. night, involves providing windscreen part with organic LEDs in type of flat screen, which reproduces image of road in monitor using night vision and/or infrared camera
DE102008040467A1 (en) 2008-07-16 2010-01-21 Robert Bosch Gmbh Method for improving the view of a driver in a vehicle and arrangement therefor
DE102008042204A1 (en) 2008-09-18 2010-04-01 Robert Bosch Gmbh Camera system for use in vehicle, has evaluating and controlling unit for evaluating images, which are detected by camera for producing information for driver assistance system
DE102008043880A1 (en) 2008-11-19 2010-05-20 Robert Bosch Gmbh Lighting unit for a vehicle, vehicle and method therefor
DE102008055168A1 (en) 2008-12-29 2010-07-01 Robert Bosch Gmbh Device for a motor vehicle
US10706295B2 (en) 2018-06-29 2020-07-07 Ford Global Technologies, Llc Street light with infrared illumination

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3438737A1 (en) * 1984-10-23 1985-05-15 Ochs, Klaus, 5090 Leverkusen Camera for a car for taking pictures of incidents
GB2189365A (en) * 1986-03-20 1987-10-21 Rank Xerox Ltd Imaging apparatus
DE3900667A1 (en) * 1989-01-09 1990-07-12 Fahri Kirsever Periscope for a motor vehicle

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3438737A1 (en) * 1984-10-23 1985-05-15 Ochs, Klaus, 5090 Leverkusen Camera for a car for taking pictures of incidents
GB2189365A (en) * 1986-03-20 1987-10-21 Rank Xerox Ltd Imaging apparatus
DE3900667A1 (en) * 1989-01-09 1990-07-12 Fahri Kirsever Periscope for a motor vehicle

Cited By (80)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0577501A1 (en) * 1992-06-30 1994-01-05 Valeo Vision Method and device for long distance night vision for motor vehicles
FR2692852A1 (en) * 1992-06-30 1993-12-31 Cibie Pierre Method and device for long-distance night vision for motor vehicles
US8917169B2 (en) 1993-02-26 2014-12-23 Magna Electronics Inc. Vehicular vision system
FR2705293A1 (en) * 1993-05-18 1994-11-25 Valeo Vision System for assisting vision in a motor vehicle
US5729016A (en) * 1994-04-12 1998-03-17 Hughes Aircraft Company Low cost night vision system for nonmilitary surface vehicles
EP0686865A1 (en) * 1994-06-09 1995-12-13 Delco Electronics Corporation Night vision system for motor vehicles
FR2721872A1 (en) * 1994-07-01 1996-01-05 Renault Nationale Usines Head-up display device for producing additional image of road ahead
FR2725576A1 (en) * 1994-10-11 1996-04-12 Peugeot METHOD FOR IMPROVING THE NIGHT VIEW OF THE DRIVER OF A MOTOR VEHICLE AND DEVICE FOR IMPLEMENTING SUCH A METHOD
EP0707424A1 (en) * 1994-10-11 1996-04-17 Automobiles Peugeot Method and apparatus for improved night vision of a motorist
FR2726144A1 (en) * 1994-10-24 1996-04-26 Valeo Vision Night vision improvement method esp. for driver of motor vehicle
FR2730035A1 (en) * 1995-01-30 1996-08-02 Valeo Vision Infra-red headlamp to aid night vision in motor vehicle
FR2730201A1 (en) * 1995-02-02 1996-08-09 Valeo Vision DEVICE FOR THE AUTOMATIC CORRECTION OF THE ORIENTATION OF AT LEAST ONE VEHICLE PROJECTOR DURING VARIATIONS OF PLATES THEREOF
FR2730334A1 (en) * 1995-02-08 1996-08-09 Peugeot Motor vehicle night vision system
US8993951B2 (en) 1996-03-25 2015-03-31 Magna Electronics Inc. Driver assistance system for a vehicle
US8842176B2 (en) 1996-05-22 2014-09-23 Donnelly Corporation Automatic vehicle exterior light control
DE19826283B4 (en) * 1997-06-19 2008-10-16 Volkswagen Ag Method for displaying an object located in front of a motor vehicle, in particular a motor vehicle driving in front
WO1999001845A1 (en) * 1997-07-02 1999-01-14 Raytheon Ti Systems, Inc. Method and apparatus for providing vision using virtual image
US6061068A (en) * 1998-06-30 2000-05-09 Raytheon Company Method and apparatus for providing synthetic vision using reality updated virtual image
EP1026031A3 (en) * 1999-02-02 2003-01-22 C.R.F. Società Consortile per Azioni Dual-band infra-red vision system for motor-vehicles
US9436880B2 (en) 1999-08-12 2016-09-06 Magna Electronics Inc. Vehicle vision system
US6552342B2 (en) 2000-01-18 2003-04-22 Daimlerchrysler Ag System for improving the visibility in vehicles
EP1146497A1 (en) * 2000-04-12 2001-10-17 Peugeot Citroen Automobiles SA Secure driving aid for motor vehicles
FR2807856A1 (en) * 2000-04-12 2001-10-19 Peugeot Citroen Automobiles Sa METHOD FOR ASSISTING THE DRIVING OF A MOTOR VEHICLE
EP1262795A3 (en) * 2001-05-31 2004-04-14 DaimlerChrysler AG Method and apparatus for improving visibility in a vehicle
US6491417B1 (en) 2001-06-13 2002-12-10 Bendix Commercial Vehicle Systems Llc Night vision clearance light
WO2002100682A1 (en) * 2001-06-13 2002-12-19 Bendix Commercial Vehicle Systems Llc Night vision clearance light
EP1275981A2 (en) * 2001-06-30 2003-01-15 DaimlerChrysler AG Device for improving visibility in vehicles
EP1275981A3 (en) * 2001-06-30 2004-01-02 DaimlerChrysler AG Device for improving visibility in vehicles
US7605773B2 (en) 2001-06-30 2009-10-20 Robert Bosch Gmbh Head-up display system and method for carrying out the location-correct display of an object situated outside a vehicle with regard to the position of the driver
WO2003005102A1 (en) * 2001-06-30 2003-01-16 Robert Bosch Gmbh Head-up display system and method for carrying out the location-correct display of an object situated outside a vehicle with regard to the position of the driver
US7015944B2 (en) 2001-06-30 2006-03-21 Daimlerchrysler Ag Device for improving visibility in vehicles
US11203340B2 (en) 2002-05-03 2021-12-21 Magna Electronics Inc. Vehicular vision system using side-viewing camera
US9555803B2 (en) 2002-05-03 2017-01-31 Magna Electronics Inc. Driver assistance system for vehicle
US9171217B2 (en) 2002-05-03 2015-10-27 Magna Electronics Inc. Vision system for vehicle
US9643605B2 (en) 2002-05-03 2017-05-09 Magna Electronics Inc. Vision system for vehicle
US9834216B2 (en) 2002-05-03 2017-12-05 Magna Electronics Inc. Vehicular control system using cameras and radar sensor
US10118618B2 (en) 2002-05-03 2018-11-06 Magna Electronics Inc. Vehicular control system using cameras and radar sensor
US10351135B2 (en) 2002-05-03 2019-07-16 Magna Electronics Inc. Vehicular control system using cameras and radar sensor
US10683008B2 (en) 2002-05-03 2020-06-16 Magna Electronics Inc. Vehicular driving assist system using forward-viewing camera
EP1378396B1 (en) * 2002-07-05 2008-09-17 Robert Bosch Gmbh Device for increasing visibility
US7408478B2 (en) 2002-12-20 2008-08-05 Daimler Ag Area of representation in an automotive night vision system
WO2004059978A1 (en) * 2002-12-20 2004-07-15 Daimlerchrysler Ag Area of representation in an automotive night vision system
US7222999B2 (en) 2003-01-20 2007-05-29 Robert Bosch Gmbh Headlight for vehicles
US7400266B2 (en) 2003-09-19 2008-07-15 Robert Bosch Gmbh Method for improving vision in a motor vehicle
DE10343479A1 (en) * 2003-09-19 2005-04-28 Bosch Gmbh Robert Method for improving the visibility in a motor vehicle
FR2860467A1 (en) * 2003-10-02 2005-04-08 Daimler Chrysler Ag DEVICE FOR IMPROVING VISION CONDITIONS IN A VEHICLE
DE10346482B4 (en) * 2003-10-02 2008-08-28 Daimler Ag Device for improving the visibility in a motor vehicle
FR2860464A1 (en) 2003-10-02 2005-04-08 Daimler Chrysler Ag DEVICE FOR IMPROVING VISION CONDITIONS IN A VEHICLE
FR2860456A1 (en) * 2003-10-02 2005-04-08 Daimler Chrysler Ag DEVICE FOR IMPROVING VISION CONDITIONS IN A VEHICLE
FR2860463A1 (en) 2003-10-02 2005-04-08 Daimler Chrysler Ag DEVICE FOR IMPROVING VISION CONDITIONS IN A VEHICLE
DE10346482A1 (en) * 2003-10-02 2005-05-12 Daimler Chrysler Ag Device for improving the visibility in a motor vehicle
EP1544640A1 (en) 2003-12-16 2005-06-22 DaimlerChrysler AG Device for improving the visibilities in a motor vehicle
US7667585B2 (en) 2004-03-18 2010-02-23 Robert Bosch Gmbh Method and device for improving visibility in a vehicle
EP1580092A2 (en) 2004-03-26 2005-09-28 Robert Bosch Gmbh Camera in a vehicle
US10735695B2 (en) 2004-04-15 2020-08-04 Magna Electronics Inc. Vehicular control system with traffic lane detection
US10306190B1 (en) 2004-04-15 2019-05-28 Magna Electronics Inc. Vehicular control system
US9609289B2 (en) 2004-04-15 2017-03-28 Magna Electronics Inc. Vision system for vehicle
US9191634B2 (en) 2004-04-15 2015-11-17 Magna Electronics Inc. Vision system for vehicle
US9736435B2 (en) 2004-04-15 2017-08-15 Magna Electronics Inc. Vision system for vehicle
US11847836B2 (en) 2004-04-15 2023-12-19 Magna Electronics Inc. Vehicular control system with road curvature determination
US9948904B2 (en) 2004-04-15 2018-04-17 Magna Electronics Inc. Vision system for vehicle
US10015452B1 (en) 2004-04-15 2018-07-03 Magna Electronics Inc. Vehicular control system
US11503253B2 (en) 2004-04-15 2022-11-15 Magna Electronics Inc. Vehicular control system with traffic lane detection
US10110860B1 (en) 2004-04-15 2018-10-23 Magna Electronics Inc. Vehicular control system
US9008369B2 (en) 2004-04-15 2015-04-14 Magna Electronics Inc. Vision system for vehicle
US10187615B1 (en) 2004-04-15 2019-01-22 Magna Electronics Inc. Vehicular control system
US8818042B2 (en) 2004-04-15 2014-08-26 Magna Electronics Inc. Driver assistance system for vehicle
US9428192B2 (en) 2004-04-15 2016-08-30 Magna Electronics Inc. Vision system for vehicle
US10462426B2 (en) 2004-04-15 2019-10-29 Magna Electronics Inc. Vehicular control system
DE102004028616A1 (en) * 2004-06-12 2006-02-02 Robert Bosch Gmbh camera lens
EP1607771A1 (en) * 2004-06-12 2005-12-21 Robert Bosch Gmbh Camera objective
US7372030B2 (en) 2004-07-12 2008-05-13 Siemens Aktiengesellschaft Method for representing a front field of vision from a motor vehicle
WO2008000564A1 (en) 2006-06-29 2008-01-03 Robert Bosch Gmbh System and method for displaying images of the surroundings of a motor vehicle
US10787116B2 (en) 2006-08-11 2020-09-29 Magna Electronics Inc. Adaptive forward lighting system for vehicle comprising a control that adjusts the headlamp beam in response to processing of image data captured by a camera
US11148583B2 (en) 2006-08-11 2021-10-19 Magna Electronics Inc. Vehicular forward viewing image capture system
US11396257B2 (en) 2006-08-11 2022-07-26 Magna Electronics Inc. Vehicular forward viewing image capture system
US10071676B2 (en) 2006-08-11 2018-09-11 Magna Electronics Inc. Vision system for vehicle
US11623559B2 (en) 2006-08-11 2023-04-11 Magna Electronics Inc. Vehicular forward viewing image capture system
US11951900B2 (en) 2006-08-11 2024-04-09 Magna Electronics Inc. Vehicular forward viewing image capture system
JP2019048536A (en) * 2017-09-08 2019-03-28 三菱自動車工業株式会社 Vehicular headlight control apparatus

Also Published As

Publication number Publication date
DE4032927C2 (en) 1993-04-15

Similar Documents

Publication Publication Date Title
DE4032927C2 (en)
DE69618192T2 (en) VEHICLE REVIEW SYSTEM WITH PANORAMIC VIEW
DE102016111783B4 (en) Display device for superimposing a virtual image in the field of view of a user
DE10304703B4 (en) Method and device for visualizing the environment of a vehicle with environment-dependent fusion of an infrared and a visual image
EP1673751B1 (en) Method and device for visualising the surroundings of a vehicle
EP1706773B1 (en) Night vision system for motor vehicles, comprising a partial optical filter
EP1194805B1 (en) Image representation system and method for vehicles
EP1214224B1 (en) Sensor device for a motor vehicle used for detecting environmental parameters
DE69110752T2 (en) Lighting and display system for vehicles.
DE102004015040A1 (en) Camera in a motor vehicle
WO1999037503A1 (en) Vehicle monitoring system
DE102006047777A1 (en) Virtual spotlight for marking objects of interest in image data
DE102004050181A1 (en) Active night vision system with adaptive imaging
DE19741896A1 (en) Automobile image screen display for potentially hazardous situations, e.g. traffic accidents during parking
EP1566060A1 (en) Device and method for improving visibility in a motor vehicle
EP1617371A2 (en) Method for marking information in a displayed night vision image being captured by a vehicle-mounted image recording device and night vision device therefor
DE102009002979A1 (en) Projection display device for vehicles, comprises sensor units formed to generate projection data from sensor values and location information, where control unit is formed to perform filtering of projection data
DE102009028498A1 (en) Projection display device for vehicles, has flat combiner element, where combiner element is arranged between vehicle occupant and disk of vehicle
EP1339228B1 (en) Method and device for visualization of a detail of a vehicle's environment and calibration unit for calibrating the device
DE10359192A1 (en) Night vision system for motor vehicle, includes camera which records image in infrared range
DE10218175B4 (en) Method and device for visualizing the environment of a vehicle with a driving-dependent fusion of an infrared and a visual image
DE212013000187U1 (en) System Image of an outdoor scene using an application-specific image sensor
DE10030359A1 (en) Dynamic control of the background lighting of in road vehicle displays used to show external camera inputs
DE112021002765T5 (en) Convex lens/concave lens based see-through virtual display device of dead zone directly in front of a vehicle and associated method
EP3856557B1 (en) Method for detecting light conditions in a vehicle

Legal Events

Date Code Title Description
OP8 Request for examination as to paragraph 44 patent law
D2 Grant after examination
8364 No opposition during term of opposition
8339 Ceased/non-payment of the annual fee