WO2011153990A1 - Dispositif optique comportant un élément optique bifocal et un élément réfléchissant - Google Patents

Dispositif optique comportant un élément optique bifocal et un élément réfléchissant Download PDF

Info

Publication number
WO2011153990A1
WO2011153990A1 PCT/DE2011/001119 DE2011001119W WO2011153990A1 WO 2011153990 A1 WO2011153990 A1 WO 2011153990A1 DE 2011001119 W DE2011001119 W DE 2011001119W WO 2011153990 A1 WO2011153990 A1 WO 2011153990A1
Authority
WO
WIPO (PCT)
Prior art keywords
optical device
vehicle
windshield
image sensor
mirror
Prior art date
Application number
PCT/DE2011/001119
Other languages
German (de)
English (en)
Inventor
Wilfried Mehr
Konrad ROTHENHÄUSLER
Original Assignee
Conti Temic Microelectronic Gmbh
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Conti Temic Microelectronic Gmbh filed Critical Conti Temic Microelectronic Gmbh
Priority to DE112011101084T priority Critical patent/DE112011101084A5/de
Publication of WO2011153990A1 publication Critical patent/WO2011153990A1/fr

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60S—SERVICING, CLEANING, REPAIRING, SUPPORTING, LIFTING, OR MANOEUVRING OF VEHICLES, NOT OTHERWISE PROVIDED FOR
    • B60S1/00—Cleaning of vehicles
    • B60S1/02—Cleaning windscreens, windows or optical devices
    • B60S1/04—Wipers or the like, e.g. scrapers
    • B60S1/06—Wipers or the like, e.g. scrapers characterised by the drive
    • B60S1/08—Wipers or the like, e.g. scrapers characterised by the drive electrically driven
    • B60S1/0818—Wipers or the like, e.g. scrapers characterised by the drive electrically driven including control systems responsive to external conditions, e.g. by detection of moisture, dirt or the like
    • B60S1/0822—Wipers or the like, e.g. scrapers characterised by the drive electrically driven including control systems responsive to external conditions, e.g. by detection of moisture, dirt or the like characterized by the arrangement or type of detection means
    • B60S1/0833—Optical rain sensor
    • B60S1/0837—Optical rain sensor with a particular arrangement of the optical elements
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60S—SERVICING, CLEANING, REPAIRING, SUPPORTING, LIFTING, OR MANOEUVRING OF VEHICLES, NOT OTHERWISE PROVIDED FOR
    • B60S1/00—Cleaning of vehicles
    • B60S1/02—Cleaning windscreens, windows or optical devices
    • B60S1/04—Wipers or the like, e.g. scrapers
    • B60S1/06—Wipers or the like, e.g. scrapers characterised by the drive
    • B60S1/08—Wipers or the like, e.g. scrapers characterised by the drive electrically driven
    • B60S1/0818—Wipers or the like, e.g. scrapers characterised by the drive electrically driven including control systems responsive to external conditions, e.g. by detection of moisture, dirt or the like
    • B60S1/0822—Wipers or the like, e.g. scrapers characterised by the drive electrically driven including control systems responsive to external conditions, e.g. by detection of moisture, dirt or the like characterized by the arrangement or type of detection means
    • B60S1/0833—Optical rain sensor
    • B60S1/0844—Optical rain sensor including a camera

Definitions

  • Optical device with a bifocal optical element and a mirror element
  • the invention relates to an optical device that can be used as a camera system in a vehicle as environment sensor for driver assistance systems.
  • Intelligent driver assistance systems often use a camera system as environment sensor, for example, to detect a variety of objects in the traffic.
  • the camera system is often located behind the windshield of the vehicle and looks through it. Examples include vehicle cameras for detecting lane markings, night vision cameras or stereo cameras as optical distance sensors.
  • vehicle cameras for detecting lane markings include vehicle cameras for detecting lane markings, night vision cameras or stereo cameras as optical distance sensors.
  • stereo cameras as optical distance sensors.
  • driver assistance systems are currently used in vehicles that combine intelligent lighting control, traffic sign recognition and lane keeping assistance that use a common camera as an environment sensor.
  • DE 102004037871 B4 shows a camera system for an assistance system which detects the outer vestibule in the direction of travel of a motor vehicle.
  • a conversion lens In a partial field of vision in front of the lens of the vehicle camera remote (road scene) and close range (windshield) are imaged on an image sensor.
  • the near field can be imaged by the partial conversion lens or a partial near-vision optics. It is proposed to use an image sensor alternately for an outdoor space assist function and a rain function.
  • the general approach with a camera to depict a distance and a close range on an image sensor sometimes brings with it some difficulties.
  • the imaging of the near range may be subject to disturbing light influences from the far range, which makes an evaluation of the near range imaging more difficult.
  • An object of the invention is therefore to provide a cost-effective, stable and reliable optics for a vehicle camera sensor, by which, in particular, disturbing light influences can be minimized.
  • a further object is to simultaneously increase or guarantee the reliability of the image data captured by the camera system and to realize or facilitate further assistance functions with a camera system.
  • an optical device is arranged behind the windshield in the interior of a vehicle, which detects the outside in the direction of travel.
  • the optical device comprises an image sensor, an objective, a bi-focal optical element and a mirror element.
  • the image sensor is a semiconductor element with a surface sensitive to electromagnetic radiation, in particular a CCD or CMOS chip.
  • the semiconductor element may be arranged on a printed circuit board.
  • the objective for projecting electromagnetic radiation onto the sensitive surface of the image sensor preferably comprises at least one lens and a lens holder.
  • the bifocal optical element may be a bifocal lens, a plane-parallel plate that lies only in a partial area (lateral) of the imaging beam path, or a continuous element with at least two partial areas of different thickness.
  • the bifocal optical element causes a near optical area, in particular a region of the windshield, to be imaged focused in a first image area of the image sensor and a remote optical area in a second image area of the same image sensor, typically an area in front of the vehicle, i. the vehicle environment.
  • the mirror element serves, in particular, to project electromagnetic radiation from a defined object area into the objective such that this radiation is imaged in at least one image area of the image sensor.
  • a camera-based rain sensor may be provided in a preferred embodiment.
  • the images from the first area of the sensitive area of the image sensor (outside of the windshield) are evaluated, whereby rain or dirt particles are detected on the windshield.
  • An output signal for activation may be on a wiper control and / or windscreen cleaning are issued.
  • the images of the second area of the sensitive area of the image sensor (area in front of the vehicle) can be made available to one or more driver assistance systems such as traffic sign recognition and / or lane keeping assistance / warning warning as raw data.
  • the mirror element is arranged in such a way that electromagnetic radiation falling from an area above the vehicle through the windshield onto the mirror element is directed onto a region of the sensitive surface of the image sensor.
  • an ambient light sensor is preferably realized, which can detect daylight, night and the entrance into a tunnel and controls the dipped beam accordingly.
  • the mirror element is arranged, for example, as a part of a scattered light diaphragm adjoining the windscreen such that electromagnetic radiation incident on the mirror element from an area above the vehicle through the windshield is reflected by the mirror element , is reflected again at the bottom of the windshield and is directed to an area of the sensitive area of the image sensor.
  • the region of the scattered light diaphragm adjoining the windshield can be made so smooth that it acts as a mirror element, the area of the lens hood, however, can be designed to be typically very rough to minimize further reflections.
  • the electromagnetic radiation reflected by the mirror element is directed to an area of the sensitive area of the image sensor in which the far-field is focused, ideally not superimposed with the image of the far-field corresponding to the area in front of the vehicle.
  • the same image sensor can be used to determine the brightness in the front-facing field of view at the same time.
  • the mirror element is arranged in such a way that electromagnetic radiation incident on the mirror element from a region of the windshield is imaged in a first subregion of the (first) subarea of the near field image on the sensitive surface of the image sensor and in the second subregion of this subregion the one area of the windshield is shown directly.
  • the mirror element preferably has an opposite pitch angle with respect to the camera field of view in comparison to the inclination of the windshield.
  • the mirror edge is preferably located in the middle of the Nah Kirsaboul and thus represents a plane of symmetry. Objects on the windshield, such as rain droplets can be represented on the image sensor at this symmetry plane once normal and once mirrored.
  • object edges can be better distinguished from interfering light influences, since interfering factors from the far - end range will only occur on one image, and not, for example, in the image reflected by the mirror element.
  • the quality of the detection of objects in the area of the windshield can thus be further optimized.
  • the mirror element can preferably be designed as a hollow mirror arrangement.
  • electromagnetic radiation which falls from an area of the windshield onto the concave mirror arrangement is reflected at the concave mirror elements, is reflected again at the underside of the windshield and directed to a region of the sensitive area of the image sensor.
  • the concave mirror elements preferably integrated into the scattered light diaphragm, the imaging beam path of objects on the windscreen is collimated.
  • the bifocal optical element can do this serve to keep the required radius of curvature of the concave mirror elements small.
  • the vehicle comprises a lighting element for illuminating the area of the windshield. Due to the external illumination, objects on the windscreen can be reliably detected, for example even in the dark.
  • a lighting element can serve in particular a light emitting diode.
  • an illumination with electromagnetic radiation in the infrared wavelength range since this is not visible to the driver, but can be detected by a corresponding image sensor.
  • the electromagnetic radiation emitted by the lighting element is coupled via a coupling element ⁇ eg a flexible light guide body) into the windshield of the vehicle.
  • a coupling element offers a good possibility for distinguishing between near-range and far-field imaging.
  • the lighting is preferably coupled via a light guide with an integrated concave mirror profile in cylindrical design.
  • the symmetry of the image data can advantageously be used as a parameter for the separation between objects on the windshield and disturbing factors from the environment.
  • the mirror element can be designed as part of the coupling element, for example as an (outwardly) reflecting edge of the element, which serves for coupling the radiation into the windshield.
  • the lighting element can also be arranged within the coupling element.
  • the edge of the coupling-in element can preferably be designed as a double-sided mirror element, ie the radiation emitted by the lighting element is reflected inward, while radiation impinging on the edge from the outside is reflected outwards, in particular for imaging onto the image sensor.
  • the mirror element is arranged below a device for the periodic light passage.
  • the mirror element could be under an LCD array, a mechanical shutter, or another optoelectronic periodic light transmission system.
  • the temporally varied reflection facilitates the identification of the mirrored image on the image sensor.
  • the illumination is modulated by the lighting element.
  • the distinction between the near field and the far field could be supported by a modulated illumination, wherein in particular a lighting coupling into the windshield or a transillumination of the windscreen can be provided by the lighting element.
  • a modulation of lighting can additionally help reliably distinguish near-range imaging.
  • the invention also relates to a method for evaluating image data taken with an optical device according to the invention of a vehicle, wherein the evaluation takes into account the mirror image in order to eliminate disturbances from the far-field imaging in the field of near-field imaging.
  • FIG. 1 imaging properties (schematic) of an optical device in a motor vehicle with a bifocal optical element, a mirror element and an image sensor.
  • Fig. 2 Example of an image taken by the image sensor
  • Fig. 3 Einkopplungselement with mirror element
  • Fig. 4 Double-sided mirror element with lighting and coupling element
  • Fig. 5 optical device with concave mirror assembly and lighting element
  • FIG. 1 schematically shows the imaging properties of an optical device with an objective (1), a bifocal optical element (8), a mirror element (S1) and an image sensor (4) for detecting electromagnetic radiation. shear radiation shown.
  • the image sensor (4) is further provided with a cover glass (3).
  • the optical device is disposed below a windshield (5) of a vehicle. Within the dotted lines lies the field of view of the optical device, which is limited downwards by a lens hood (7).
  • the illustrated bifocal optical element (8) is a partial optical element, e.g. a plane-parallel glass plate, which fills only a portion of the field of view.
  • a bifocal optical element ⁇ 8 ⁇ could be used, which e.g. the image sensor (4) completely covers and has two different thickness subregions.
  • the illustrated cover glass (3) for the image sensor (4) could be omitted.
  • the principle for this bifocal optics is based on the axial offset of a non-parallel beam path of a refractive plane surface.
  • the objective (1) is focused in such a way that the distant region (S4) is imaged sharply on the sensitive surface of the image sensor (4) only by the partial optical element (8) and the near region (S2, S3) without the partial optical Element to traverse is shown.
  • the near plane (S2, S3) is focused on the outside of the windshield (5) so that there are raindrops (6) or dirt particles in the corresponding part (T4, T2
  • the far-range map (S4) is evaluated for camera-based assistance functions, eg lane recognition, traffic sign recognition, etc.
  • the sensitivity of a rain sensor function to a bifocal optical device can be limited by confounding light sources from the far field.
  • a modulated approximately monochromatic illumination and the color filters of the Bayer pattern can be used for signal filtering.
  • a mirror element (S1) is provided, which can also be combined with an input element for illumination, as illustrated in FIGS. 3 and 4.
  • the mirror element (S1) has an opposite pitch angle to the field of view of the image sensor (4) as the inclined windshield (5).
  • the beam path of the near-field imaging (S2) via the mirror element (S1), the beam path of the near-field image (S3) without mirror element and the beam path of the far-field imaging (S4) are also shown.
  • FIG. 2 shows an example of an image taken by the image sensor 4 of an optical device according to the invention.
  • the image shown corresponds to a rotated by 180 ° image that could have been taken in front of the image sensor (4) in Fig. 1.
  • the upper approximately 60 percent of the total image shows the far-field imaging (Tl), which correspond to the beam path (S4) of Fig. 1.
  • the near-field upper map (T2) results from the direct beam path of the near-field map (S3) of Fig. 1.
  • the lower near-field map (T4) is substantially mirrored horizontally, the mirror edge (T3) separates both near-field images (T4, T2).
  • the lower Nah Schlsab Struktur (T4) resulting from the beam path of Nah Kirsab Struktur (S2) on the mirror element (Sl) of Fig .1.
  • the mirror edge (T3) is preferably located in the middle of the Nah Kunststoffsab Struktur and thus represents a plane of symmetry.
  • Raindrops (6) on the windshield (5) are on the image sensor ⁇ 4) at this symmetry plane (T3) once normal and once mirrored imaged.
  • Interference factors from the far-end range are only displayed in one of the two sub-ranges of the near-field images.
  • the image analysis uses the symmetry of the two near-field images (T2, T4) as a parameter for separation between actual objects (e.g., raindrops (6)) on the windshield (5) and environmental disturbances in a captured image.
  • Fig. 3 shows a mirror element (Sl), which is designed as part of the coupling element (Bl).
  • a reflective surface is realized as a mirror element (S1) in a desired inclination relative to the windshield (5) as the edge of the illuminating coupling element (B1).
  • the mirror element (S1) is an interesting possibility for distinguishing between near and far range.
  • the lighting coupling can also be done via a light guide with an integrated concave mirror profile in a cylindrical design. 4, an arrangement for coupling a lighting is shown schematically. Behind the windshield (a) is a double-sided mirror element
  • Fig. 5 shows an embodiment of the optical device in a vehicle with an arrangement of concave mirrors ⁇ e ⁇ as a mirror element.
  • electromagnetic radiation (S5) which from a portion of the windshield (5) on the hollow mirror assembly (e) is reflected on the concave reflecting elements is reflected on the underside of the windshield (5) again and on a Directed area of the sensitive surface of the image sensor (4).
  • a bifocal optical element (8) is not shown in FIG. 5, but could, for example, be located inside the objective (1) or be arranged between the objective and the image sensor.
  • the beam path of the near-range imaging (S5) focused in the area of the windshield can, for example, be transferred to another area via the bifocal optical element (8) of the image sensor are referred to as the far-field map (S4).
  • the bifocal optical element (8) helps to keep the required radius of curvature of the concave mirror elements (e) small.

Landscapes

  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Mechanical Engineering (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)
  • Studio Devices (AREA)

Abstract

L'invention concerne un véhicule comportant un dispositif optique. Le dispositif optique est monté dans l'habitacle du véhicule, derrière le pare-brise (5), de façon à détecter l'espace extérieur dans la direction de la marche. Le dispositif optique comprend : - un capteur d'images (4) comportant une surface sensible au rayonnement électromagnétique; - un objectif (1) destiné à projeter un rayonnement électromagnétique sur la surface sensible du capteur d'images (4); - un élément optique bifocal (8) destiné à reproduire simultanément une image focalisée d'une zone du pare-brise (5) et une zone en avant du véhicule sur deux sous-domaines de la surface sensible du capteur d'images (4); et - un élément réfléchissant (S1).
PCT/DE2011/001119 2010-06-12 2011-05-26 Dispositif optique comportant un élément optique bifocal et un élément réfléchissant WO2011153990A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
DE112011101084T DE112011101084A5 (de) 2010-06-12 2011-05-26 Optische vorrichtung mit einem bifokalen optischen element und einem spiegelelement

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102010023593A DE102010023593A1 (de) 2010-06-12 2010-06-12 Optische Vorrichtung mit einem bifokalen optischen Element und einem Spiegelelement
DE102010023593.8 2010-06-12

Publications (1)

Publication Number Publication Date
WO2011153990A1 true WO2011153990A1 (fr) 2011-12-15

Family

ID=44510617

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/DE2011/001119 WO2011153990A1 (fr) 2010-06-12 2011-05-26 Dispositif optique comportant un élément optique bifocal et un élément réfléchissant

Country Status (2)

Country Link
DE (2) DE102010023593A1 (fr)
WO (1) WO2011153990A1 (fr)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012145501A1 (fr) 2011-04-20 2012-10-26 Magna Electronics Inc. Filtre angulaire pour une caméra installée sur un véhicule
US9871971B2 (en) 2011-08-02 2018-01-16 Magma Electronics Inc. Vehicle vision system with light baffling system
CN108449533B (zh) * 2011-08-02 2020-07-28 马格纳电子系统公司 车辆摄像机系统
JP5656131B2 (ja) 2012-02-13 2015-01-21 株式会社リコー 撮像ユニット及びその設置方法
JP6246808B2 (ja) * 2012-08-06 2017-12-13 コンティ テミック マイクロエレクトロニック ゲゼルシャフト ミット ベシュレンクテル ハフツングＣｏｎｔｉ Ｔｅｍｉｃ ｍｉｃｒｏｅｌｅｃｔｒｏｎｉｃ ＧｍｂＨ カメラ及び照明を用いたガラス面の雨滴検出
US9896039B2 (en) 2014-05-09 2018-02-20 Magna Electronics Inc. Vehicle vision system with forward viewing camera
US10640043B2 (en) 2018-05-08 2020-05-05 Magna Electronics Inc. Vehicular rain sensing system using forward viewing camera

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE20207170U1 (de) * 2002-05-07 2002-08-14 Sick AG, 79183 Waldkirch Multifokale Bilderfassung
JP2006184844A (ja) * 2004-12-03 2006-07-13 Tochigi Nikon Corp 結像光学系及びこれを用いた撮像装置
DE102004037871B4 (de) 2004-08-04 2006-10-12 Siemens Ag Optisches Modul für ein den Außenvorraum in Fahrtrichtung eines Kraftfahrzeuges erfassendes Assistenzsystem
EP2062777A1 (fr) * 2007-11-21 2009-05-27 Delphi Technologies, Inc. Module optique

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB0216483D0 (en) * 2002-07-16 2002-08-21 Trw Ltd Vehicle window cleaning apparatus and method
DE102004015040A1 (de) * 2004-03-26 2005-10-13 Robert Bosch Gmbh Kamera in einem Kraftfahrzeug
DE102008062977A1 (de) * 2008-12-23 2010-06-24 Adc Automotive Distance Control Systems Gmbh Optisches Modul mit multifokaler Optik zur Erfassung von Fern- und Nahbereich in einem Bild

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE20207170U1 (de) * 2002-05-07 2002-08-14 Sick AG, 79183 Waldkirch Multifokale Bilderfassung
DE102004037871B4 (de) 2004-08-04 2006-10-12 Siemens Ag Optisches Modul für ein den Außenvorraum in Fahrtrichtung eines Kraftfahrzeuges erfassendes Assistenzsystem
JP2006184844A (ja) * 2004-12-03 2006-07-13 Tochigi Nikon Corp 結像光学系及びこれを用いた撮像装置
EP2062777A1 (fr) * 2007-11-21 2009-05-27 Delphi Technologies, Inc. Module optique

Also Published As

Publication number Publication date
DE112011101084A5 (de) 2013-04-11
DE102010023593A1 (de) 2011-12-15

Similar Documents

Publication Publication Date Title
EP2384292B1 (fr) Système de caméra pour un véhicule automobile et véhicule automobile comprenant un système de caméra
DE69836344T2 (de) Regensensor mit nebelerkennung
EP2558336B1 (fr) Procédé et dispositif d'assistance au conducteur lors de la conduite d'un véhicule consistant à détecter une visibilité réduite due aux conditions atmosphériques
EP2715446B1 (fr) Système de caméra pour un véhicule
WO2011153990A1 (fr) Dispositif optique comportant un élément optique bifocal et un élément réfléchissant
EP2452213B1 (fr) Module optique destiné à la focalisation simultanée de deux champs de vision
EP2370297B1 (fr) Module optique comportant une optique multifocale pour detecter une zone lointaine et une zone proche sur une image
DE60214593T2 (de) Stereoabbildung mit einem bildsensor verwendender feuchtigkeitssensor
EP1580092B1 (fr) Caméra pour un véhicule automobile
DE102006008274B4 (de) Kraftfahrzeug mit einer optischen Erfassungsvorrichtung und Verfahren zum Betreiben eines Kraftfahrzeugs
DE102012200200B4 (de) Kamerasystem, insbesondere für ein Fahrzeug, sowie ein Fahrzeug
WO2006015905A1 (fr) Module optique pour un systeme d'assistance au conducteur operant une detection dans l'espace exterieur avant, dans le sens de roulement, d'un vehicule a moteur
DE102005000650A1 (de) Vorrichtung zur Erfassung visueller Daten
EP2646802A1 (fr) Détection de gouttes de pluie sur une vitre au moyen d'une caméra et d'un éclairage
DE102010023591A1 (de) Stereokamerasystem
DE102010043479B4 (de) Kameraanordnung und Verfahren zum Betreiben einer Kameraanordnung für ein Kraftfahrzeug
EP2844529A1 (fr) Détection de gouttes de pluie sur un pare-brise au moyen d'une caméra et d'un éclairage
DE102009027512A1 (de) Vorrichtung zur Erfassung von Bilddaten
EP1159169A1 (fr) Dispositif de surveillance optoelectronique pour un vehicule a moteur
DE102017222614A1 (de) Vorrichtung zur Umgebungserfassung sowie Verfahren zu dessen Betrieb
EP1282097A2 (fr) Système pour l'amélioration de la vue, en particulier dans des véhicules.
DE102019206370A1 (de) Außenleuchteinrichtung für ein Kraftfahrzeug
EP3077255B1 (fr) Éclairage destiné à détecter des gouttes de pluie sur une vitre au moyen d'une caméra
WO2013091619A1 (fr) Procédé et dispositif pour détecter de l'humidité sur une vitre de véhicule
US7491939B2 (en) Photosensitive sensor and applications in the automotive field

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11741086

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 112011101084

Country of ref document: DE

Ref document number: 1120111010842

Country of ref document: DE

REG Reference to national code

Ref country code: DE

Ref legal event code: R225

Ref document number: 112011101084

Country of ref document: DE

Effective date: 20130411

122 Ep: pct application non-entry in european phase

Ref document number: 11741086

Country of ref document: EP

Kind code of ref document: A1