DE102017127489A1 - Verkehrsampelerfassung und -klassifizierung unter verwendung von computervision und deep learning - Google Patents

Verkehrsampelerfassung und -klassifizierung unter verwendung von computervision und deep learning Download PDF

Info

Publication number
DE102017127489A1
DE102017127489A1 DE102017127489.8A DE102017127489A DE102017127489A1 DE 102017127489 A1 DE102017127489 A1 DE 102017127489A1 DE 102017127489 A DE102017127489 A DE 102017127489A DE 102017127489 A1 DE102017127489 A1 DE 102017127489A1
Authority
DE
Germany
Prior art keywords
frame
class
saturation
contour
traffic light
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
DE102017127489.8A
Other languages
German (de)
English (en)
Inventor
Maryam Moosaei
Madeline J Goh
Vidya Nariyambut murali
Yi Zhang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ford Global Technologies LLC
Original Assignee
Ford Global Technologies LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ford Global Technologies LLC filed Critical Ford Global Technologies LLC
Publication of DE102017127489A1 publication Critical patent/DE102017127489A1/de
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G06V20/584—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of vehicle lights or traffic lights
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/90—Dynamic range modification of images or parts thereof
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/90—Determination of colour characteristics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/56—Extraction of image or video features relating to colour
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/09—Arrangements for giving variable traffic instructions
    • G08G1/095—Traffic lights
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20024—Filtering details
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20112—Image segmentation details
    • G06T2207/20132—Image cropping

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Biophysics (AREA)
  • Molecular Biology (AREA)
  • Artificial Intelligence (AREA)
  • Biomedical Technology (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Traffic Control Systems (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
DE102017127489.8A 2016-11-23 2017-11-21 Verkehrsampelerfassung und -klassifizierung unter verwendung von computervision und deep learning Pending DE102017127489A1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15/360,883 2016-11-23
US15/360,883 US10185881B2 (en) 2016-11-23 2016-11-23 Traffic-light detection and classification using computer vision and deep learning

Publications (1)

Publication Number Publication Date
DE102017127489A1 true DE102017127489A1 (de) 2018-05-24

Family

ID=60805820

Family Applications (1)

Application Number Title Priority Date Filing Date
DE102017127489.8A Pending DE102017127489A1 (de) 2016-11-23 2017-11-21 Verkehrsampelerfassung und -klassifizierung unter verwendung von computervision und deep learning

Country Status (6)

Country Link
US (3) US10185881B2 (zh)
CN (1) CN108090411B (zh)
DE (1) DE102017127489A1 (zh)
GB (1) GB2559005A (zh)
MX (1) MX2017014963A (zh)
RU (1) RU2017135215A (zh)

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10185881B2 (en) * 2016-11-23 2019-01-22 Ford Global Technologies, Llc Traffic-light detection and classification using computer vision and deep learning
JP6834425B2 (ja) * 2016-12-02 2021-02-24 スズキ株式会社 運転支援装置
US10650257B2 (en) * 2017-02-09 2020-05-12 SMR Patents S.à.r.l. Method and device for identifying the signaling state of at least one signaling device
US10614326B2 (en) * 2017-03-06 2020-04-07 Honda Motor Co., Ltd. System and method for vehicle control based on object and color detection
US11055991B1 (en) 2018-02-09 2021-07-06 Applied Information, Inc. Systems, methods, and devices for communication between traffic controller systems and mobile transmitters and receivers
CN108830199B (zh) * 2018-05-31 2021-04-16 京东方科技集团股份有限公司 识别交通灯信号的方法、装置、可读介质及电子设备
US11205345B1 (en) 2018-10-02 2021-12-21 Applied Information, Inc. Systems, methods, devices, and apparatuses for intelligent traffic signaling
CN109508635B (zh) * 2018-10-08 2022-01-07 海南师范大学 一种基于TensorFlow结合多层CNN网络的交通灯识别方法
US11056005B2 (en) 2018-10-24 2021-07-06 Waymo Llc Traffic light detection and lane state recognition for autonomous vehicles
JP7172441B2 (ja) * 2018-10-25 2022-11-16 トヨタ自動車株式会社 進行可能方向検出装置及び進行可能方向検出方法
US10467487B1 (en) * 2018-12-11 2019-11-05 Chongqing Jinkang New Energy Automobile Co., Ltd. Fusion-based traffic light recognition for autonomous driving
CN111723614A (zh) * 2019-03-20 2020-09-29 北京四维图新科技股份有限公司 交通信号灯识别方法及装置
DE102019207580A1 (de) 2019-05-23 2020-11-26 Volkswagen Aktiengesellschaft Verfahren zum Betreiben eines tiefen Neuronalen Netzes
US10944912B2 (en) 2019-06-04 2021-03-09 Ford Global Technologies, Llc Systems and methods for reducing flicker artifacts in imaged light sources
CN110633635A (zh) * 2019-08-08 2019-12-31 北京联合大学 一种基于roi的交通标志牌实时检测方法及系统
DE102019129029A1 (de) * 2019-10-28 2021-04-29 Bayerische Motoren Werke Aktiengesellschaft System und verfahren zur objektdetektion
US11210571B2 (en) 2020-03-13 2021-12-28 Argo AI, LLC Using rasterization to identify traffic signal devices
US12073632B2 (en) * 2020-05-11 2024-08-27 Toyota Research Institute, Inc. Structural object detector for hierarchical ontology for traffic light handling
CN111723690B (zh) * 2020-06-03 2023-10-20 北京全路通信信号研究设计院集团有限公司 一种电路设备状态监测方法和系统
US11900689B1 (en) * 2020-06-04 2024-02-13 Aurora Operations, Inc. Traffic light identification and/or classification for use in controlling an autonomous vehicle
US11704912B2 (en) * 2020-06-16 2023-07-18 Ford Global Technologies, Llc Label-free performance evaluator for traffic light classifier system
WO2022185452A1 (ja) 2021-03-03 2022-09-09 三菱電機株式会社 信号処理装置、制御回路、記憶媒体および信号処理方法

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4380838B2 (ja) * 1999-04-08 2009-12-09 アジア航測株式会社 ビデオ画像の道路標識自動認識方法及び道路標識自動認識装置並びに道路標識自動認識プログラム
JP3621065B2 (ja) * 2000-12-25 2005-02-16 松下電器産業株式会社 画像検出装置、プログラムおよび記録媒体
US7724962B2 (en) 2006-07-07 2010-05-25 Siemens Corporation Context adaptive approach in vehicle detection under various visibility conditions
US8358806B2 (en) * 2007-08-02 2013-01-22 Siemens Corporation Fast crowd segmentation using shape indexing
CN101408942B (zh) * 2008-04-17 2011-01-12 浙江师范大学 一种复杂背景下的车牌定位方法
CN103020623B (zh) * 2011-09-23 2016-04-06 株式会社理光 交通标志检测方法和交通标志检测设备
CN102542260A (zh) 2011-12-30 2012-07-04 中南大学 一种面向无人驾驶车的道路交通标志识别方法
US9530056B2 (en) 2012-06-15 2016-12-27 Bhaskar Saha Day night classification of images using thresholding on HSV histogram
CN103489324B (zh) * 2013-09-22 2015-09-09 北京联合大学 一种基于无人驾驶的实时动态红绿灯检测识别方法
CN104778833B (zh) 2014-01-10 2018-05-08 北京信路威科技股份有限公司 识别交通信号灯的方法
CN103955705B (zh) * 2014-04-29 2017-11-28 银江股份有限公司 基于视频分析的交通信号灯定位、识别与分类方法
US20150339589A1 (en) * 2014-05-21 2015-11-26 Brain Corporation Apparatus and methods for training robots utilizing gaze-based saliency maps
CN104021378B (zh) * 2014-06-07 2017-06-30 北京联合大学 基于时空关联与先验知识的交通信号灯实时识别方法
CN105404856B (zh) * 2015-11-02 2018-08-24 长安大学 一种公交车辆座位占用状态检测方法
CN106101632A (zh) * 2016-06-29 2016-11-09 韦醒妃 基于视觉特征的图像处理装置
US10185881B2 (en) * 2016-11-23 2019-01-22 Ford Global Technologies, Llc Traffic-light detection and classification using computer vision and deep learning
CN106909937B (zh) 2017-02-09 2020-05-19 北京汽车集团有限公司 交通信号灯识别方法、车辆控制方法、装置及车辆

Also Published As

Publication number Publication date
GB2559005A (en) 2018-07-25
US20190005340A1 (en) 2019-01-03
MX2017014963A (es) 2018-10-04
CN108090411A (zh) 2018-05-29
US10185881B2 (en) 2019-01-22
US10402667B2 (en) 2019-09-03
US20190340450A1 (en) 2019-11-07
RU2017135215A (ru) 2019-04-05
US20180144203A1 (en) 2018-05-24
CN108090411B (zh) 2023-06-02
US10614327B2 (en) 2020-04-07
GB201718962D0 (en) 2018-01-03

Similar Documents

Publication Publication Date Title
DE102017127489A1 (de) Verkehrsampelerfassung und -klassifizierung unter verwendung von computervision und deep learning
DE102017127346A1 (de) Bremslichterkennung
DE102018101366A1 (de) Fahrzeuge in schlechten lichtverhältnissen
DE102011106050B4 (de) Schattenentfernung in einem durch eine fahrzeugbasierte Kamera erfassten Bild zur Detektion eines freien Pfads
DE102016111307B4 (de) Fahrzeug-Außenumgebungs-Erkennungsvorrichtung
DE102018101318A1 (de) Objekterkennung unter verwendung eines rekurrenten neuronalen netzwerks und einer verketteten merkmalsabbildung
DE102007034657B4 (de) Bildverarbeitungsvorrichtung
DE112013001858T5 (de) Mehrfachhinweis-Objekterkennung und -Analyse
DE112010005786B4 (de) Vorrichtung und Verfahren zum Messen eines Spektrums eines bewegbaren Körpers
DE102009025545A1 (de) Verfahren und Vorrichtung zum Erkennen von Bremslichtsystemen
DE102011055458A1 (de) Adaptierungstechnik zur Erkennung einer freien Fahrbahn mittels verlässlicher lokaler Modellkalibrierung
DE102016111304B4 (de) Fahrzeug-Außenumgebungs-Erkennungsvorrichtung
DE102011006564A1 (de) Verfahren zur Auswertung eines von einer Kamera eines Fahrzeugs aufgenommenen Bildes und Bildaufbereitungsvorrichtung
DE102011106052A1 (de) Schattenentfernung in einem durch eine fahrzeugbasierte Kamera erfassten Bild unter Verwendung eines nichtlinearen beleuchtungsinvarianten Kerns
DE102018119663B4 (de) Verfahren zum klassifizieren eines zustands einer fahrbahnoberfläche
DE102011055459A1 (de) Adaptierungstechnik zur Erkennung einer freien Fahrbahn mit zusätzlichen Klassifikatoren
DE102018116036A1 (de) Training eines tiefen konvolutionellen neuronalen Netzwerks für individuelle Routen
WO2018157893A1 (de) Vorrichtung und verfahren zum detektieren einer ampelphase für ein kraftfahrzeug
DE102018109276A1 (de) Bildhintergrundsubtraktion für dynamische beleuchtungsszenarios
DE102014009083A1 (de) Vorrichtung und verfahren zur steuerung der fahrzeugsicherheit mithilfe von kameras
EP4078941A2 (de) Umwandlung von eingangs-bilddaten einer mehrzahl von fahrzeugkameras eines rundumsichtsystems in optimierte ausgangs-bilddaten
DE102021131701A1 (de) Systeme und verfahren zum erfassen von abgelenktem fahren eines fahrers eines fahrzeugs
DE102019220168A1 (de) Helligkeits-Umwandlung von Bildern einer Kamera
DE102013226725A1 (de) Verfahren und system für das erkennen einer handgeste, wobei selektive beleuchtung benutzt wird
WO2021122338A1 (de) Verfahren und vorrichtung zum robustifizieren von sensordaten gegen adversariale störungen

Legal Events

Date Code Title Description
R082 Change of representative

Representative=s name: BONSMANN - BONSMANN - FRANK PATENTANWAELTE, DE

R079 Amendment of ipc main class

Free format text: PREVIOUS MAIN CLASS: G06K0009620000

Ipc: G06V0030190000

R012 Request for examination validly filed