JP6453490B2 - 路面反射を認識し評価するための方法及び装置 - Google Patents

路面反射を認識し評価するための方法及び装置 Download PDF

Info

Publication number
JP6453490B2
JP6453490B2 JP2017557347A JP2017557347A JP6453490B2 JP 6453490 B2 JP6453490 B2 JP 6453490B2 JP 2017557347 A JP2017557347 A JP 2017557347A JP 2017557347 A JP2017557347 A JP 2017557347A JP 6453490 B2 JP6453490 B2 JP 6453490B2
Authority
JP
Japan
Prior art keywords
road surface
camera
images
vehicle
average
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2017557347A
Other languages
English (en)
Japanese (ja)
Other versions
JP2018516799A (ja
JP2018516799A5 (enExample
Inventor
フリッツ・シュテファン
ハルトマン・ベルント
アムトール・マヌエル
ダンツラー・ヨアヒム
Original Assignee
コンティネンタル・テーベス・アクチエンゲゼルシヤフト・ウント・コンパニー・オッフェネ・ハンデルスゲゼルシヤフト
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by コンティネンタル・テーベス・アクチエンゲゼルシヤフト・ウント・コンパニー・オッフェネ・ハンデルスゲゼルシヤフト filed Critical コンティネンタル・テーベス・アクチエンゲゼルシヤフト・ウント・コンパニー・オッフェネ・ハンデルスゲゼルシヤフト
Publication of JP2018516799A publication Critical patent/JP2018516799A/ja
Publication of JP2018516799A5 publication Critical patent/JP2018516799A5/ja
Application granted granted Critical
Publication of JP6453490B2 publication Critical patent/JP6453490B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • B60W40/06—Road conditions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
    • G06V10/462—Salient features, e.g. scale invariant feature transforms [SIFT]
    • G06V10/464—Salient features, e.g. scale invariant feature transforms [SIFT] using a plurality of salient features, e.g. bag-of-words [BoW] representations
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/60—Extraction of image or video features relating to illumination properties, e.g. using a reflectance or lighting model
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/588—Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2552/00—Input parameters relating to infrastructure
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30252—Vehicle exterior; Vicinity of vehicle
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/24—Aligning, centring, orientation detection or correction of the image
    • G06V10/247—Aligning, centring, orientation detection or correction of the image by affine transforms, e.g. correction due to perspective effects; Quadrilaterals, e.g. trapezoids

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Software Systems (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Mathematical Physics (AREA)
  • Automation & Control Theory (AREA)
  • Image Analysis (AREA)
  • Traffic Control Systems (AREA)
  • Image Processing (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
JP2017557347A 2015-05-06 2016-05-04 路面反射を認識し評価するための方法及び装置 Active JP6453490B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
DE102015208429.9 2015-05-06
DE102015208429.9A DE102015208429A1 (de) 2015-05-06 2015-05-06 Verfahren und Vorrichtung zur Erkennung und Bewertung von Fahrbahnreflexionen
PCT/DE2016/200207 WO2016177371A1 (de) 2015-05-06 2016-05-04 Verfahren und vorrichtung zur erkennung und bewertung von fahrbahnreflexionen

Publications (3)

Publication Number Publication Date
JP2018516799A JP2018516799A (ja) 2018-06-28
JP2018516799A5 JP2018516799A5 (enExample) 2018-10-11
JP6453490B2 true JP6453490B2 (ja) 2019-01-16

Family

ID=56097956

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2017557347A Active JP6453490B2 (ja) 2015-05-06 2016-05-04 路面反射を認識し評価するための方法及び装置

Country Status (7)

Country Link
US (1) US10442438B2 (enExample)
EP (1) EP3292510B1 (enExample)
JP (1) JP6453490B2 (enExample)
KR (1) KR101891460B1 (enExample)
CN (1) CN107667378B (enExample)
DE (2) DE102015208429A1 (enExample)
WO (1) WO2016177371A1 (enExample)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114612877B (zh) * 2016-01-05 2025-08-19 御眼视觉技术有限公司 用于估计未来路径的系统和方法
GB201711409D0 (en) * 2016-12-30 2017-08-30 Maxu Tech Inc Early entry
CN106686165B (zh) * 2016-12-30 2018-08-17 维沃移动通信有限公司 一种路况检测的方法及移动终端
DE102018203807A1 (de) 2018-03-13 2019-09-19 Continental Teves Ag & Co. Ohg Verfahren und Vorrichtung zur Erkennung und Bewertung von Fahrbahnzuständen und witterungsbedingten Umwelteinflüssen
DE102018218733B4 (de) * 2018-10-31 2025-03-13 Robert Bosch Gmbh Verfahren zur Unterstützung einer kamerabasierten Umfelderkennung eines Fortbewegungsmittels mittels einer Strassennässeinformation eines ersten Ultraschallsensors
FI128495B (en) * 2019-05-21 2020-06-15 Vaisala Oyj Method for calibrating optical surface monitoring system, arrangement, device and computer readable memory
FR3103303B1 (fr) * 2019-11-14 2022-07-22 Continental Automotive Détermination d’un coefficient de friction pour un véhicule sur une route
EP3866055B1 (en) * 2020-02-12 2025-09-24 Aptiv Technologies AG System and method for displaying spatial information in the field of view of a driver of a vehicle
US20220198200A1 (en) * 2020-12-22 2022-06-23 Continental Automotive Systems, Inc. Road lane condition detection with lane assist for a vehicle using infrared detecting device
CN112597666B (zh) * 2021-01-08 2022-05-24 北京深睿博联科技有限责任公司 一种基于表面材质建模的路面状态分析方法及装置
DE102021101788A1 (de) 2021-01-27 2022-07-28 Zf Cv Systems Global Gmbh Verfahren zum ortsaufgelösten Ermitteln einer Oberflächeneigenschaft eines Untergrundes, Verarbeitungseinheit und Fahrzeug
JP6955295B1 (ja) * 2021-02-16 2021-10-27 株式会社アーバンエックステクノロジーズ 識別装置、識別プログラム、および識別方法
CN115201218A (zh) * 2022-07-13 2022-10-18 鲁朗软件(北京)有限公司 一种车载路面病害智能检测方法及系统

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3023444C2 (de) * 1979-06-29 1985-07-11 Omron Tateisi Electronics Co., Kyoto Einrichtung zur Ermittlung des witterungsbedingten Straßenzustandes
JPS6015015B2 (ja) 1979-06-29 1985-04-17 株式会社 レオ技研 路面水分検知装置
DE3738221A1 (de) * 1987-11-11 1989-06-08 Bayerische Motoren Werke Ag Verfahren und einrichtung zum erkennen des zustandes einer strasse
DE4235104A1 (de) * 1992-10-17 1994-04-21 Sel Alcatel Ag Straßenzustandsdetektor
AU3201101A (en) * 2000-02-07 2001-08-14 Intelligent Security Limited Smoke and flame detection
JP3626905B2 (ja) * 2000-11-24 2005-03-09 富士重工業株式会社 車外監視装置
JP3759429B2 (ja) * 2001-05-23 2006-03-22 株式会社東芝 障害物検出装置及びその方法
JP3783588B2 (ja) 2001-08-20 2006-06-07 オムロン株式会社 路面判別装置
DK1890128T3 (da) 2003-03-14 2012-03-19 Liwas Aps Anordning til detektering af vejoverfladetilstand
US8184194B2 (en) 2008-06-26 2012-05-22 Panasonic Corporation Image processing apparatus, image division program and image synthesising method
DE112010005669B4 (de) * 2010-06-18 2017-10-26 Honda Motor Co., Ltd. System zur Straßenoberflächenreflektivitätsklassifizierung
JP5761601B2 (ja) * 2010-07-01 2015-08-12 株式会社リコー 物体識別装置
JP5892876B2 (ja) 2011-07-28 2016-03-23 クラリオン株式会社 車載用環境認識装置
TWI467498B (zh) * 2011-12-19 2015-01-01 Ind Tech Res Inst 影像識別方法及系統
EP2947866B1 (en) * 2013-01-21 2019-06-19 Kowa Company Ltd. Image processing device, image processing method, image processing program, and recording medium storing said program
US10188036B2 (en) * 2015-10-23 2019-01-29 Carnegie Mellon University System for evaluating agricultural material

Also Published As

Publication number Publication date
EP3292510B1 (de) 2021-07-07
US10442438B2 (en) 2019-10-15
EP3292510A1 (de) 2018-03-14
US20180141561A1 (en) 2018-05-24
CN107667378B (zh) 2021-04-27
CN107667378A (zh) 2018-02-06
DE112016002050A5 (de) 2018-01-11
JP2018516799A (ja) 2018-06-28
KR20170127036A (ko) 2017-11-20
DE102015208429A1 (de) 2016-11-10
WO2016177371A1 (de) 2016-11-10
KR101891460B1 (ko) 2018-08-24

Similar Documents

Publication Publication Date Title
JP6453490B2 (ja) 路面反射を認識し評価するための方法及び装置
JP2018516799A5 (enExample)
US12249153B2 (en) Method and device for recognizing and evaluating roadway conditions and weather-related environmental influences
US11093801B2 (en) Object detection device and object detection method
US10685449B2 (en) Surrounding environment recognition device for moving body
Wang et al. Appearance-based brake-lights recognition using deep learning and vehicle detection
Rezaei et al. Robust vehicle detection and distance estimation under challenging lighting conditions
US10627228B2 (en) Object detection device
US11308717B2 (en) Object detection device and object detection method
JP7135665B2 (ja) 車両制御システム、車両の制御方法及びコンピュータプログラム
US20180060676A1 (en) Method and device for detecting and evaluating environmental influences and road condition information in the vehicle surroundings
US20200394435A1 (en) Distance estimation device, distance estimation method, and distance estimation computer program
US10984264B2 (en) Detection and validation of objects from sequential images of a camera
JPWO2019174682A5 (enExample)
US20190064841A1 (en) Cross traffic detection using cameras
Aytekin et al. Increasing driving safety with a multiple vehicle detection and tracking system using ongoing vehicle shadow information
US11069049B2 (en) Division line detection device and division line detection method
JP2008310440A (ja) 歩行者検出装置
JP3562278B2 (ja) 環境認識装置
EP3392730B1 (en) Device for enabling a vehicle to automatically resume moving
Dai et al. A driving assistance system with vision based vehicle detection techniques
Satzoda et al. Vision-based front and rear surround understanding using embedded processors
US12167171B2 (en) Vehicular vision system with object classification based on change in orientation of object
JP7103202B2 (ja) 画像認識装置
Wang et al. A monovision-based 3D pose estimation system for vehicle behavior prediction

Legal Events

Date Code Title Description
A529 Written submission of copy of amendment under article 34 pct

Free format text: JAPANESE INTERMEDIATE CODE: A529

Effective date: 20171102

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20171102

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20171102

A975 Report on accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A971005

Effective date: 20180412

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20180606

A524 Written submission of copy of amendment under article 19 pct

Free format text: JAPANESE INTERMEDIATE CODE: A524

Effective date: 20180829

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20181121

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20181212

R150 Certificate of patent or registration of utility model

Ref document number: 6453490

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313113

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250