WO2010060413A1 - Verfahren zur erkennung von fahrzeuglichtern und retroreflektoren mit einem kamerasystem - Google Patents
Verfahren zur erkennung von fahrzeuglichtern und retroreflektoren mit einem kamerasystem Download PDFInfo
- Publication number
- WO2010060413A1 WO2010060413A1 PCT/DE2009/001645 DE2009001645W WO2010060413A1 WO 2010060413 A1 WO2010060413 A1 WO 2010060413A1 DE 2009001645 W DE2009001645 W DE 2009001645W WO 2010060413 A1 WO2010060413 A1 WO 2010060413A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- light
- image
- vehicle
- intensity
- retroreflectors
- Prior art date
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
- B60Q1/02—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments
- B60Q1/04—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights
- B60Q1/14—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights having dimming means
- B60Q1/1415—Dimming circuits
- B60Q1/1423—Automatic dimming circuits, i.e. switching between high beam and low beam due to change of ambient light or light level in road traffic
- B60Q1/143—Automatic dimming circuits, i.e. switching between high beam and low beam due to change of ambient light or light level in road traffic combined with another condition, e.g. using vehicle recognition from camera images or activation of wipers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06V20/584—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of vehicle lights or traffic lights
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q2300/00—Indexing codes for automatically adjustable headlamps or automatically dimmable headlamps
- B60Q2300/40—Indexing codes relating to other road users or special conditions
- B60Q2300/42—Indexing codes relating to other road users or special conditions oncoming vehicle
Definitions
- the invention relates to a method for distinguishing oncoming vehicle lights and retroreflectors in the dark according to the preamble of claim 1 in the field of automatic light control in motor vehicles.
- the detection of vehicles at night is needed in particular in an automatic light control in a vehicle.
- the aim of an automatic light control is to control the brightness and / or direction of their own vehicle headlights such that other road users are not dazzled.
- An important feature for detecting vehicles by means of a camera in the dark is the vehicle lighting of oncoming vehicles, which is reflected in the camera image by high-intensity points.
- WO 2008/064621 A1 shows a method for detecting reflectors and vehicle lights with a camera sensor system in a vehicle environment. For this purpose, a sequence of images of the vehicle environment is recorded. At least one point of light in the image sequence is tracked (tracked). The intensity of the light spot in the image sequence is determined and analyzed. Light points above a first threshold are detected as vehicle lights, and light spots below a second threshold are detected as reflectors.
- EP 1837803 A2 shows a method for detecting vehicle headlights, rear lights and street lighting. A classifier is proposed, which is trained and then, for example, to distinguish a street lighting from reflectors based on a Gaussian intensity distribution in the camera image.
- Distinguishing vehicles and retroreflectors is often difficult because the characterizing classifier characteristics for these two classes are very similar in some situations, resulting in misclassifications.
- the object of the present invention is to specify a method which offers increased reliability of the distinction between oncoming vehicle lights and retroreflectors.
- the method according to the invention for distinguishing oncoming vehicle lights and retroreflectors in the dark, which are recorded as light surfaces by an image acquisition device oriented in the surroundings of a vehicle comprises the following steps.
- the image pickup device which is an analog or digital camera system, is at least one About the vehicle environment.
- the image is evaluated by image processing. On the image located light surfaces are analyzed.
- the aim of the analysis is to determine the optical interaction of light sources with other objects in the image.
- the light of an oncoming vehicle is scattered by particles such as dust or pollen or by water droplets that are in the air. This results in an image surrounding the light source that is brighter than the background. The intensity of this area decreases continuously from the edge of the light source to the level of the background brightness.
- Another example of an optical interaction is the reflection of the vehicle lights on the road surface. This results in an area below the vehicle lights in which there are light areas which correspond to the mirrored vehicle lights.
- a retroreflector causes a reflection in which the radiation is reflected back in directions which are approximately opposite to the radiation direction, this type of reflection being largely independent of the illumination.
- traffic signs, guide posts and road markings are usually designed as retroreflectors.
- light surfaces mirrored in the image on the road surface are identified as vehicle lights. Retroreflectors show almost no reflection on the road surface.
- Retroreflectors create light surfaces in the picture when they are illuminated by the headlights of their own vehicle. Due to the position and the arrangement of the retroreflectors and the directional direction of the light reflected by the retroreflectors, no reflection occurs on the road surface.
- the spatial profile of the intensity of light surfaces is analyzed.
- the intensity profile can preferably be analyzed in the direction of the horizontal image axis.
- Retroreflectors appear in the picture as clearly demarcated areas with a high contrast between the light surface and the background.
- the spatial course of the intensity is characterized by unsteady or erratic increases or decreases on the periphery. The reason for this is that retroreflectors only reflect back towards the headlights of their own vehicle and thus the image pickup device.
- the gradient (spatial derivative) of the intensity in an image direction in the region of a light surface is calculated. With an almost constant gradient of the intensity gradient in a region around the edge of a light surface this is identified as vehicle light. With a narrow and pronounced maximum of the gradient of the intensity in an area around the edge of a light surface, however, it is identified as a retroreflector.
- the method can be used according to a further embodiment for verification of a first classification according to any classification method.
- a first classification e.g. Based on the intensity of classifies as vehicle lights or retroreflectors.
- This initial classification is verified by the method described here. This verification increases the reliability of a first classification and may correct misclassifications if necessary.
- the invention includes a device for distinguishing retroreflectors and vehicle lights in the dark in a vehicle environment.
- the device comprises an image recording device and an evaluation unit, which evaluates the image data acquired by the image recording device and uses one of the described methods for this purpose.
- the advantage of the invention is increased reliability of the classification. Compared with tracking methods, the method according to the invention offers the advantage that it can be classified on the basis of a single image. Thus, the process is fast. If an image sequence is analyzed by the method according to the invention, the reliability of the distinction between vehicle lights and retroreflectors is further optimized.
- Fig. 1 shows images of an oncoming vehicle.
- FIG. 2 shows a picture with a retroreflector at the roadside.
- FIG 3 shows the spatial intensity profile of a vehicle light and a retroreflector.
- the lights of an oncoming vehicle (FL) in the far, middle and near range are seen as a pair of light areas of increasing magnitude. Below the vehicle lights (FL) a further pair of light surfaces can be seen. These areas of light are caused by a reflection of the vehicle lights on the road surface (rFL).
- the occurrence of reflections of light surfaces on the road surface (rFL) in this embodiment is the criterion that the light source of the light surfaces are vehicle lights (FL).
- the location of the road surface can be determined and provided, for example, by a lane guide.
- a retroreflector (R) can be seen at the roadside as a light surface. Below the retroreflector (R) there is no reflection on the road (0). This is because the retroreflector (R) is not an active light source but is illuminated by the headlamps of the vehicle and reflects this light in a directed manner.
- the retroreflector (R) is not an active light source but is illuminated by the headlamps of the vehicle and reflects this light in a directed manner.
- the spatial progression of the intensity I (x) at the edge of light surfaces is illustrated and analyzed.
- the image in Fig. 3a corresponds to that shown in Fig. Ic.
- FIG. 3c shows the intensity profile I (x) of the region defined in FIG. 3a.
- FIG. 3e shows the spatial derivative dl / dx of the intensity in the x-direction, that is to say the intensity gradient for the intensity profile according to FIG. 3c.
- FIG. 3b shows the intensity profile I (x) of the region defined in FIG. 3b around the region of the light surface of the retroreflector (R).
- I intensity
- FIG. 3f shows the intensity gradient d1 / dx for the intensity profile from FIG. 3d.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Mechanical Engineering (AREA)
- Traffic Control Systems (AREA)
- Image Analysis (AREA)
Abstract
Description
Claims
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE112009002511T DE112009002511A5 (de) | 2008-11-28 | 2009-11-23 | Verfahren zur Erkennung von Fahrzeuglichtern und Retroreflektoren mit einem Kamerasystem |
US13/131,376 US20110228089A1 (en) | 2008-11-28 | 2009-11-23 | Method for detecting vehicle lights and retroreflectors with a camera system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102008059630.2 | 2008-11-28 | ||
DE102008059630A DE102008059630A1 (de) | 2008-11-28 | 2008-11-28 | Verfahren zur Erkennung von Fahrzeuglichtern und Retroreflektoren mit einem Kamerasystem |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2010060413A1 true WO2010060413A1 (de) | 2010-06-03 |
Family
ID=41718897
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/DE2009/001645 WO2010060413A1 (de) | 2008-11-28 | 2009-11-23 | Verfahren zur erkennung von fahrzeuglichtern und retroreflektoren mit einem kamerasystem |
Country Status (3)
Country | Link |
---|---|
US (1) | US20110228089A1 (de) |
DE (2) | DE102008059630A1 (de) |
WO (1) | WO2010060413A1 (de) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2014507332A (ja) * | 2011-03-01 | 2014-03-27 | オートリブ ディベロップメント エービー | 車両用ドライバ支援システムおよびドライバ支援方法 |
CN106529411A (zh) * | 2016-10-11 | 2017-03-22 | 北京小米移动软件有限公司 | 车辆提示方法及装置 |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103249597B (zh) * | 2010-08-06 | 2015-04-29 | 丰田自动车株式会社 | 车辆配光控制装置以及方法 |
DE102011006564A1 (de) * | 2011-03-31 | 2012-10-04 | Robert Bosch Gmbh | Verfahren zur Auswertung eines von einer Kamera eines Fahrzeugs aufgenommenen Bildes und Bildaufbereitungsvorrichtung |
DE102011076341A1 (de) * | 2011-05-24 | 2012-11-29 | Robert Bosch Gmbh | Verfahren zum Steuern der Lichtfunktion eines Fahrzeuges und Fahrzeug mit einem Fahrerassistenzsystem zum Durchführen des Verfahrens |
DE102011081398B4 (de) | 2011-08-23 | 2018-09-13 | Robert Bosch Gmbh | Verfahren und Vorrichtung zum Unterscheiden eines selbstleuchtenden Objekts von einem reflektierenden Objekt |
JP2013186681A (ja) * | 2012-03-08 | 2013-09-19 | Omron Corp | 画像処理装置、画像処理方法、および画像処理プログラム |
DE102013012325A1 (de) * | 2013-07-25 | 2015-01-29 | GM Global Technology Operations LLC (n. d. Ges. d. Staates Delaware) | Fahrerassistenzsystem und Betriebsverfahren dafür |
US10356312B2 (en) | 2014-03-27 | 2019-07-16 | Htc Corporation | Camera device, video auto-tagging method and non-transitory computer readable medium thereof |
DE102016213858A1 (de) * | 2016-07-28 | 2018-02-01 | Continental Teves Ag & Co. Ohg | Fahrassistenzsystem und Verfahren zur Erkennung von Verkehrsteilnehmern |
TW201832136A (zh) | 2017-02-20 | 2018-09-01 | 美商3M新設資產公司 | 光學物品及與其交互作用之系統 |
CN111164605A (zh) | 2017-09-27 | 2020-05-15 | 3M创新有限公司 | 使用光学图案以用于设备和安全监控的个人防护设备管理系统 |
US11417111B2 (en) | 2017-12-22 | 2022-08-16 | Terra Scientia, Llc | Method, system and material for detecting objects of high interest with laser scanning systems |
US10493900B2 (en) | 2018-05-04 | 2019-12-03 | International Business Machines Corporation | Adaptive headlights for the trajectory of a vehicle |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS61285153A (ja) * | 1985-06-13 | 1986-12-15 | Nippon Soken Inc | 車両用ヘツドライト自動切替装置 |
JPH06276524A (ja) * | 1993-03-19 | 1994-09-30 | Toyota Motor Corp | 対向車両認識装置 |
EP1580074A1 (de) * | 2004-03-26 | 2005-09-28 | Valeo Vision | Verfahren zur Detektion einer nassen Strasse und Beleuchtungssystem zu dessen Implementierung |
EP1832471A2 (de) * | 2006-03-10 | 2007-09-12 | Valeo Vision | Verfahren zur Steuerung der automatischen Schaltung eines Fahrzeugscheinwerfers |
EP1837803A2 (de) | 2006-03-24 | 2007-09-26 | MobilEye Technologies, Ltd. | Vorderlicht-, Schlusslicht- und Straßenbeleuchtungsdetektion |
WO2008064621A1 (de) | 2006-11-27 | 2008-06-05 | Adc Automotive Distance Control Systems Gmbh | Erkennung und kategorisierung von lichtpunkten mit einer kamera in einer fahrzeugumgebung |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4891559A (en) * | 1985-06-13 | 1990-01-02 | Nippondenso Soken, Inc. | Apparatus for controlling a headlight of a vehicle |
US5796094A (en) * | 1993-02-26 | 1998-08-18 | Donnelly Corporation | Vehicle headlight control using imaging sensor |
US6049171A (en) * | 1998-09-18 | 2000-04-11 | Gentex Corporation | Continuously variable headlamp control |
AU1089300A (en) * | 1999-11-03 | 2001-05-14 | Cet Technologies Pte Ltd | Image processing techniques for a video based traffic monitoring system and methods therefor |
DE102006016073A1 (de) * | 2005-08-24 | 2007-03-22 | Dr.Ing.H.C. F. Porsche Ag | Verfahren zur Steuerung der Leuchtweite eines Kraftfahrzeuges |
DE102006055906A1 (de) * | 2005-12-05 | 2007-06-14 | Adc Automotive Distance Control Systems Gmbh | Verfahren zur Erkennung von Reflektoren, Schildern und Fahrzeuglichtern |
-
2008
- 2008-11-28 DE DE102008059630A patent/DE102008059630A1/de active Pending
-
2009
- 2009-11-23 US US13/131,376 patent/US20110228089A1/en not_active Abandoned
- 2009-11-23 DE DE112009002511T patent/DE112009002511A5/de not_active Withdrawn
- 2009-11-23 WO PCT/DE2009/001645 patent/WO2010060413A1/de active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS61285153A (ja) * | 1985-06-13 | 1986-12-15 | Nippon Soken Inc | 車両用ヘツドライト自動切替装置 |
JPH06276524A (ja) * | 1993-03-19 | 1994-09-30 | Toyota Motor Corp | 対向車両認識装置 |
EP1580074A1 (de) * | 2004-03-26 | 2005-09-28 | Valeo Vision | Verfahren zur Detektion einer nassen Strasse und Beleuchtungssystem zu dessen Implementierung |
EP1832471A2 (de) * | 2006-03-10 | 2007-09-12 | Valeo Vision | Verfahren zur Steuerung der automatischen Schaltung eines Fahrzeugscheinwerfers |
EP1837803A2 (de) | 2006-03-24 | 2007-09-26 | MobilEye Technologies, Ltd. | Vorderlicht-, Schlusslicht- und Straßenbeleuchtungsdetektion |
WO2008064621A1 (de) | 2006-11-27 | 2008-06-05 | Adc Automotive Distance Control Systems Gmbh | Erkennung und kategorisierung von lichtpunkten mit einer kamera in einer fahrzeugumgebung |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2014507332A (ja) * | 2011-03-01 | 2014-03-27 | オートリブ ディベロップメント エービー | 車両用ドライバ支援システムおよびドライバ支援方法 |
KR101746746B1 (ko) * | 2011-03-01 | 2017-06-13 | 오토리브 디벨로프먼트 에이비 | 자동차를 위한 운전자 보조 시스템 및 방법 |
CN106529411A (zh) * | 2016-10-11 | 2017-03-22 | 北京小米移动软件有限公司 | 车辆提示方法及装置 |
US10664711B2 (en) | 2016-10-11 | 2020-05-26 | Beijing Xiaomi Mobile Software Co., Ltd. | Vehicle prompt apparatus and operating method thereof |
CN106529411B (zh) * | 2016-10-11 | 2020-07-28 | 北京小米移动软件有限公司 | 车辆提示方法及装置 |
Also Published As
Publication number | Publication date |
---|---|
DE102008059630A1 (de) | 2010-06-02 |
DE112009002511A5 (de) | 2011-07-21 |
US20110228089A1 (en) | 2011-09-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2010060413A1 (de) | Verfahren zur erkennung von fahrzeuglichtern und retroreflektoren mit einem kamerasystem | |
EP2571725B1 (de) | Verfahren und steuergerät zum plausibilisieren eines leuchtweite-testwerts eines lichtkegels eines fahrzeugscheinwerfers | |
EP1506893B1 (de) | Kraftfahrzeug mit Erfassung und Analyse der Objekten in dem Umfeld des Fahrzeugs | |
DE102011081428A1 (de) | Verfahren zum Bestimmen einer Objektklasse eines Objekts, von dem aus Licht zu einem Fahrzeug ausgesandt und/oder reflektiert wird | |
EP2294380B1 (de) | Verfahren zur dejustageerkennung eines fahrzeugscheinwerfers mit einer kamera | |
DE102011088130B4 (de) | Verfahren und Vorrichtung zur Erkennung einer Bremssituation | |
DE102014209197B4 (de) | Vorrichtung und Verfahren zum Erkennen von Niederschlag für ein Kraftfahrzeug | |
EP2748032B1 (de) | Verfahren und vorrichtung zur ansteuerung eines scheinwerfers eines fahrzeugs | |
DE102011004937A1 (de) | Verfahren und Steuergerät zum Beeinflussen einer Beleuchtungsszene vor einem Fahrzeug | |
DE112017006833T5 (de) | Fahrzeugbeleuchtungssystem | |
DE102011077038A1 (de) | Verfahren und Vorrichtung zur Erkennung von Objekten in einem Umfeld eines Fahrzeugs | |
EP2562044B1 (de) | Verfahren zur Steuerung einer Lichtaussendung eines Scheinwerfers eines Fahrzeugs | |
DE102013226760A1 (de) | Verfahren und Vorrichtung zur Erkennung von Objektreflexionen | |
EP3140672B1 (de) | System zur detektion von nebel direkt vor einem kraftfahrzeug | |
DE102011081398A1 (de) | Verfahren und Vorrichtung zum Unterscheiden eines selbstleuchtenden Objekts von einem reflektierenden Objekt | |
DE102014019420A1 (de) | Kraftfahrzeugscheinwerfersystem, Kraftfahrzeug, Verfahren zum Betrieb eines Kraftfahrzeugscheinwerfersystems sowie Computerprogrammprodukt | |
EP2562685B1 (de) | Verfahren und Vorrichtung zur Klassifizierung eines sich in einem Vorfeld eines Fahrzeugs befindlichen Lichtobjekts | |
DE102006004770B4 (de) | Verfahren zur bildgestützten Erkennung von Fahrzeugen im Umfeld eines Sraßenfahrzeugs | |
EP2131308B1 (de) | Verfahren und Vorrichtung zum Klassifizieren eines in mindestens einem Bild einer Abbildung eines Bereichs vor einem Fahrzeug detektierten Objekts | |
DE102005047331A1 (de) | Verfahren und Vorrichtung zur Beleuchtungssteuerung bei Straßenfahrzeugen | |
DE102015209550A1 (de) | Verfahren und vorrichtung zur erkennung von objekten in einer fahrzeugumgebung eines fahrzeugs | |
DE102011081391A1 (de) | Verfahren und Vorrichtung zum Erkennen von Störobjekten in der Umgebungsluft eines Fahrzeugs | |
DE102008059629A1 (de) | Verfahren zur adaptiven Erkennung von Fahrzeuglichtern und Retroreflektoren mit einem Kamerasystem | |
EP2103984B1 (de) | Verfahren und Vorrichtung zum Verarbeiten von Bilddaten | |
DE102007008543A1 (de) | Verfahren und Vorrichtung zum Ermitteln des Bewegungszustands von Objekten |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 09801142 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1120090025110 Country of ref document: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13131376 Country of ref document: US |
|
REG | Reference to national code |
Ref country code: DE Ref legal event code: R225 Ref document number: 112009002511 Country of ref document: DE Effective date: 20110721 |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 09801142 Country of ref document: EP Kind code of ref document: A1 |