CN107667378B - 用于识别和评估路面反射的方法和装置 - Google Patents

用于识别和评估路面反射的方法和装置 Download PDF

Info

Publication number
CN107667378B
CN107667378B CN201680026128.2A CN201680026128A CN107667378B CN 107667378 B CN107667378 B CN 107667378B CN 201680026128 A CN201680026128 A CN 201680026128A CN 107667378 B CN107667378 B CN 107667378B
Authority
CN
China
Prior art keywords
road surface
image
vehicle
road
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201680026128.2A
Other languages
English (en)
Chinese (zh)
Other versions
CN107667378A (zh
Inventor
S·弗里茨
B·哈特曼
M·阿姆托尔
J·登茨勒
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Continental Zhixing Germany Co ltd
Original Assignee
Continental Teves AG and Co OHG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Continental Teves AG and Co OHG filed Critical Continental Teves AG and Co OHG
Publication of CN107667378A publication Critical patent/CN107667378A/zh
Application granted granted Critical
Publication of CN107667378B publication Critical patent/CN107667378B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • B60W40/06Road conditions
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/50Depth or shape recovery
    • G06T7/55Depth or shape recovery from multiple images
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/46Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
    • G06V10/462Salient features, e.g. scale invariant feature transforms [SIFT]
    • G06V10/464Salient features, e.g. scale invariant feature transforms [SIFT] using a plurality of salient features, e.g. bag-of-words [BoW] representations
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/60Extraction of image or video features relating to illumination properties, e.g. using a reflectance or lighting model
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/588Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2552/00Input parameters relating to infrastructure
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30248Vehicle exterior or interior
    • G06T2207/30252Vehicle exterior; Vicinity of vehicle
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/24Aligning, centring, orientation detection or correction of the image
    • G06V10/247Aligning, centring, orientation detection or correction of the image by affine transforms, e.g. correction due to perspective effects; Quadrilaterals, e.g. trapezoids

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Software Systems (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Mathematical Physics (AREA)
  • Automation & Control Theory (AREA)
  • Image Analysis (AREA)
  • Traffic Control Systems (AREA)
  • Image Processing (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
CN201680026128.2A 2015-05-06 2016-05-04 用于识别和评估路面反射的方法和装置 Active CN107667378B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
DE102015208429.9 2015-05-06
DE102015208429.9A DE102015208429A1 (de) 2015-05-06 2015-05-06 Verfahren und Vorrichtung zur Erkennung und Bewertung von Fahrbahnreflexionen
PCT/DE2016/200207 WO2016177371A1 (de) 2015-05-06 2016-05-04 Verfahren und vorrichtung zur erkennung und bewertung von fahrbahnreflexionen

Publications (2)

Publication Number Publication Date
CN107667378A CN107667378A (zh) 2018-02-06
CN107667378B true CN107667378B (zh) 2021-04-27

Family

ID=56097956

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201680026128.2A Active CN107667378B (zh) 2015-05-06 2016-05-04 用于识别和评估路面反射的方法和装置

Country Status (7)

Country Link
US (1) US10442438B2 (enExample)
EP (1) EP3292510B1 (enExample)
JP (1) JP6453490B2 (enExample)
KR (1) KR101891460B1 (enExample)
CN (1) CN107667378B (enExample)
DE (2) DE102015208429A1 (enExample)
WO (1) WO2016177371A1 (enExample)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114612877B (zh) * 2016-01-05 2025-08-19 御眼视觉技术有限公司 用于估计未来路径的系统和方法
GB201711409D0 (en) * 2016-12-30 2017-08-30 Maxu Tech Inc Early entry
CN106686165B (zh) * 2016-12-30 2018-08-17 维沃移动通信有限公司 一种路况检测的方法及移动终端
DE102018203807A1 (de) 2018-03-13 2019-09-19 Continental Teves Ag & Co. Ohg Verfahren und Vorrichtung zur Erkennung und Bewertung von Fahrbahnzuständen und witterungsbedingten Umwelteinflüssen
DE102018218733B4 (de) * 2018-10-31 2025-03-13 Robert Bosch Gmbh Verfahren zur Unterstützung einer kamerabasierten Umfelderkennung eines Fortbewegungsmittels mittels einer Strassennässeinformation eines ersten Ultraschallsensors
FI128495B (en) * 2019-05-21 2020-06-15 Vaisala Oyj Method for calibrating optical surface monitoring system, arrangement, device and computer readable memory
FR3103303B1 (fr) * 2019-11-14 2022-07-22 Continental Automotive Détermination d’un coefficient de friction pour un véhicule sur une route
EP3866055B1 (en) * 2020-02-12 2025-09-24 Aptiv Technologies AG System and method for displaying spatial information in the field of view of a driver of a vehicle
US20220198200A1 (en) * 2020-12-22 2022-06-23 Continental Automotive Systems, Inc. Road lane condition detection with lane assist for a vehicle using infrared detecting device
CN112597666B (zh) * 2021-01-08 2022-05-24 北京深睿博联科技有限责任公司 一种基于表面材质建模的路面状态分析方法及装置
DE102021101788A1 (de) 2021-01-27 2022-07-28 Zf Cv Systems Global Gmbh Verfahren zum ortsaufgelösten Ermitteln einer Oberflächeneigenschaft eines Untergrundes, Verarbeitungseinheit und Fahrzeug
JP6955295B1 (ja) * 2021-02-16 2021-10-27 株式会社アーバンエックステクノロジーズ 識別装置、識別プログラム、および識別方法
CN115201218A (zh) * 2022-07-13 2022-10-18 鲁朗软件(北京)有限公司 一种车载路面病害智能检测方法及系统

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102017601A (zh) * 2008-06-26 2011-04-13 松下电器产业株式会社 图像处理装置、图像分割程序及图像合成方法
CN102902952A (zh) * 2011-07-28 2013-01-30 株式会社日立制作所 车载用环境识别装置

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3023444C2 (de) * 1979-06-29 1985-07-11 Omron Tateisi Electronics Co., Kyoto Einrichtung zur Ermittlung des witterungsbedingten Straßenzustandes
JPS6015015B2 (ja) 1979-06-29 1985-04-17 株式会社 レオ技研 路面水分検知装置
DE3738221A1 (de) * 1987-11-11 1989-06-08 Bayerische Motoren Werke Ag Verfahren und einrichtung zum erkennen des zustandes einer strasse
DE4235104A1 (de) * 1992-10-17 1994-04-21 Sel Alcatel Ag Straßenzustandsdetektor
AU3201101A (en) * 2000-02-07 2001-08-14 Intelligent Security Limited Smoke and flame detection
JP3626905B2 (ja) * 2000-11-24 2005-03-09 富士重工業株式会社 車外監視装置
JP3759429B2 (ja) * 2001-05-23 2006-03-22 株式会社東芝 障害物検出装置及びその方法
JP3783588B2 (ja) 2001-08-20 2006-06-07 オムロン株式会社 路面判別装置
DK1890128T3 (da) 2003-03-14 2012-03-19 Liwas Aps Anordning til detektering af vejoverfladetilstand
DE112010005669B4 (de) * 2010-06-18 2017-10-26 Honda Motor Co., Ltd. System zur Straßenoberflächenreflektivitätsklassifizierung
JP5761601B2 (ja) * 2010-07-01 2015-08-12 株式会社リコー 物体識別装置
TWI467498B (zh) * 2011-12-19 2015-01-01 Ind Tech Res Inst 影像識別方法及系統
EP2947866B1 (en) * 2013-01-21 2019-06-19 Kowa Company Ltd. Image processing device, image processing method, image processing program, and recording medium storing said program
US10188036B2 (en) * 2015-10-23 2019-01-29 Carnegie Mellon University System for evaluating agricultural material

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102017601A (zh) * 2008-06-26 2011-04-13 松下电器产业株式会社 图像处理装置、图像分割程序及图像合成方法
CN102902952A (zh) * 2011-07-28 2013-01-30 株式会社日立制作所 车载用环境识别装置

Also Published As

Publication number Publication date
EP3292510B1 (de) 2021-07-07
US10442438B2 (en) 2019-10-15
EP3292510A1 (de) 2018-03-14
US20180141561A1 (en) 2018-05-24
JP6453490B2 (ja) 2019-01-16
CN107667378A (zh) 2018-02-06
DE112016002050A5 (de) 2018-01-11
JP2018516799A (ja) 2018-06-28
KR20170127036A (ko) 2017-11-20
DE102015208429A1 (de) 2016-11-10
WO2016177371A1 (de) 2016-11-10
KR101891460B1 (ko) 2018-08-24

Similar Documents

Publication Publication Date Title
CN107667378B (zh) 用于识别和评估路面反射的方法和装置
Rezaei et al. Robust vehicle detection and distance estimation under challenging lighting conditions
US10949684B2 (en) Vehicle image verification
US8355539B2 (en) Radar guided vision system for vehicle validation and vehicle motion characterization
JP5297078B2 (ja) 車両の死角における移動物体を検知するための方法、および死角検知装置
US20180150704A1 (en) Method of detecting pedestrian and vehicle based on convolutional neural network by using stereo camera
Zhang et al. Night time vehicle detection and tracking by fusing vehicle parts from multiple cameras
US11308717B2 (en) Object detection device and object detection method
WO2017175025A2 (en) Detecting visual information corresponding to an animal
JP2018516799A5 (enExample)
JP7003972B2 (ja) 距離推定装置、距離推定方法及び距離推定用コンピュータプログラム
KR20180047149A (ko) 충돌 위험 경고 장치 및 방법
JP2014164601A (ja) 車両諸元計測処理装置、車両諸元計測方法及びプログラム
CN112200087A (zh) 一种用于车辆碰撞预警的障碍物图像自动标定装置
Yang et al. On-road collision warning based on multiple FOE segmentation using a dashboard camera
JP3562278B2 (ja) 環境認識装置
WO2017169704A1 (ja) 環境認識装置
KR102559936B1 (ko) 단안 카메라를 이용하여 깊이 정보를 추정하는 방법 및 장치
JP7363717B2 (ja) 物体検出システム、物体検出方法及びプログラム
Yun et al. Video-based detection and analysis of driver distraction and inattention
WO2017077261A1 (en) A monocular camera cognitive imaging system for a vehicle
Lashkov et al. Computing‐efficient video analytics for nighttime traffic sensing
Sivaraman Learning, modeling, and understanding vehicle surround using multi-modal sensing
JP2023116424A (ja) 歩行者の位置を決定する方法及び装置
CN118843892A (zh) 通过比较传感器数据与期望较高安全完整性地识别情景的特性

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20230106

Address after: Germany Ingolstadt

Patentee after: Continental Zhixing Germany Co.,Ltd.

Address before: Frankfurt, Germany

Patentee before: CONTINENTAL TEVES AG & Co. OHG

TR01 Transfer of patent right