CN111357012B - 用于识别与评估车道状况和与天气相关的环境影响的方法和装置 - Google Patents

用于识别与评估车道状况和与天气相关的环境影响的方法和装置 Download PDF

Info

Publication number
CN111357012B
CN111357012B CN201980005798.XA CN201980005798A CN111357012B CN 111357012 B CN111357012 B CN 111357012B CN 201980005798 A CN201980005798 A CN 201980005798A CN 111357012 B CN111357012 B CN 111357012B
Authority
CN
China
Prior art keywords
lane
vehicle
image
disturbance
reflection type
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201980005798.XA
Other languages
English (en)
Chinese (zh)
Other versions
CN111357012A (zh
Inventor
B·哈特曼
M·阿姆托尔
J·登茨勒
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Continental Zhixing Germany Co ltd
Original Assignee
Continental Zhixing Germany Co ltd
Continental Teves AG and Co OHG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Continental Zhixing Germany Co ltd, Continental Teves AG and Co OHG filed Critical Continental Zhixing Germany Co ltd
Publication of CN111357012A publication Critical patent/CN111357012A/zh
Application granted granted Critical
Publication of CN111357012B publication Critical patent/CN111357012B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • B60W40/06—Road conditions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/25—Fusion techniques
    • G06F18/254—Fusion techniques of classification results, e.g. of results related to same input data
    • G06F18/256—Fusion techniques of classification results, e.g. of results related to same input data of results relating to different input data, e.g. multimodal recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/60—Extraction of image or video features relating to illumination properties, e.g. using a reflectance or lighting model
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/80—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level
    • G06V10/809—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level of classification results, e.g. where the classifiers operate on the same input data
    • G06V10/811—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level of classification results, e.g. where the classifiers operate on the same input data the classifiers operating on different input data, e.g. multi-modal recognition
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403—Image sensing, e.g. optical camera
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2552/00—Input parameters relating to infrastructure
    • B60W2552/05—Type of road, e.g. motorways, local streets, paved or unpaved roads
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2555/00—Input parameters relating to exterior conditions, not covered by groups B60W2552/00, B60W2554/00
    • B60W2555/20—Ambient conditions, e.g. wind or rain

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Medical Informatics (AREA)
  • Data Mining & Analysis (AREA)
  • Mathematical Physics (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Databases & Information Systems (AREA)
  • Transportation (AREA)
  • Automation & Control Theory (AREA)
  • Mechanical Engineering (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Traffic Control Systems (AREA)
  • Image Analysis (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
CN201980005798.XA 2018-03-13 2019-02-26 用于识别与评估车道状况和与天气相关的环境影响的方法和装置 Active CN111357012B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
DE102018203807.4A DE102018203807A1 (de) 2018-03-13 2018-03-13 Verfahren und Vorrichtung zur Erkennung und Bewertung von Fahrbahnzuständen und witterungsbedingten Umwelteinflüssen
DE102018203807.4 2018-03-13
PCT/DE2019/200016 WO2019174682A1 (de) 2018-03-13 2019-02-26 Verfahren und vorrichtung zur erkennung und bewertung von fahrbahnzuständen und witterungsbedingten umwelteinflüssen

Publications (2)

Publication Number Publication Date
CN111357012A CN111357012A (zh) 2020-06-30
CN111357012B true CN111357012B (zh) 2025-02-18

Family

ID=66175116

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201980005798.XA Active CN111357012B (zh) 2018-03-13 2019-02-26 用于识别与评估车道状况和与天气相关的环境影响的方法和装置

Country Status (5)

Country Link
US (1) US12249153B2 (enExample)
JP (1) JP7291129B2 (enExample)
CN (1) CN111357012B (enExample)
DE (2) DE102018203807A1 (enExample)
WO (1) WO2019174682A1 (enExample)

Families Citing this family (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102017214030A1 (de) * 2017-08-11 2019-02-14 Robert Bosch Gmbh Verfahren zum Bestimmen eines Reibwerts für einen Kontakt zwischen einem Reifen eines Fahrzeugs und einer Fahrbahn und Verfahren zum Steuern einer Fahrzeugfunktion eines Fahrzeugs
DE102019209268B4 (de) * 2019-06-26 2023-03-02 Continental Automotive Technologies GmbH Verfahren zur Bewertung eines Fahrbahnzustandes einer Fahrbahn, auf der sich ein Kraftfahrzeug bewegt, sowie Verfahren zum Reduzieren eines Gefährdungsgrades für ein sich auf einer Fahrbahn bewegendes Kraftfahrzeug in Bezug auf eine Gefahrenstelle
KR102297683B1 (ko) * 2019-07-01 2021-09-07 (주)베이다스 복수의 카메라들을 캘리브레이션하는 방법 및 장치
DE102019210935A1 (de) * 2019-07-24 2021-01-28 Zf Friedrichshafen Ag Erkennen und Bewerten einer Wasseransammlung auf einer Fahrbahn
DE102019218461A1 (de) * 2019-11-28 2021-06-02 Robert Bosch Gmbh Verfahren und Vorrichtung zum Ermitteln einer Aquaplaninggefahr für ein Fortbewegungsmittel
DE102019135751B4 (de) 2019-12-23 2024-11-14 Nira Dynamics Ab Verfahren, Vorrichtungen, Systeme und Computerprogrammprodukte zum Schätzen einer Fahrbahnoberflächentemperatur
US11521127B2 (en) 2020-06-05 2022-12-06 Waymo Llc Road condition deep learning model
KR20220027327A (ko) * 2020-08-26 2022-03-08 현대모비스 주식회사 딥러닝 기반 노면판단 모델을 이용한 터레인모드 제어 방법 및 장치
CN112131963B (zh) * 2020-08-31 2023-09-01 青岛秀山移动测量有限公司 一种基于行驶方向结构特征约束的道路标识线提取方法
AT524256B1 (de) * 2020-10-08 2023-06-15 Thomas Genitheim Ing Dipl Ing Fh Verfahren zur Ermittlung eines Reibbeiwertes
DE102021101788A1 (de) * 2021-01-27 2022-07-28 Zf Cv Systems Global Gmbh Verfahren zum ortsaufgelösten Ermitteln einer Oberflächeneigenschaft eines Untergrundes, Verarbeitungseinheit und Fahrzeug
JP2022152402A (ja) * 2021-03-29 2022-10-12 本田技研工業株式会社 認識装置、車両システム、認識方法、およびプログラム
DE102021110184A1 (de) 2021-04-22 2022-10-27 Dr. Ing. H.C. F. Porsche Aktiengesellschaft Computerimplementiertes Verfahren zur Abschätzung von Fahrbahneigenschaften
US12066571B2 (en) 2021-05-03 2024-08-20 Waymo Llc Methods and systems for detecting adverse road conditions using radar
JP7600971B2 (ja) * 2021-12-03 2024-12-17 トヨタ自動車株式会社 車載通知装置
KR102414233B1 (ko) * 2022-01-18 2022-06-29 (주)에스알디코리아 주행차량의 노면인지에 의한 제어 시스템 및 그 방법
US11878717B2 (en) 2022-01-24 2024-01-23 International Business Machines Corporation Mirage detection by autonomous vehicles
US20250201114A1 (en) * 2022-03-11 2025-06-19 Hitachi Astemo, Ltd. External environment recognition device and external environment recognition method
DE102022206625A1 (de) 2022-06-29 2024-01-04 Continental Autonomous Mobility Germany GmbH Verfahren und System zur Straßenzustandsüberwachung durch ein maschinelles Lernsystem sowie Verfahren zum Trainieren des maschinellen Lernsystems
KR102449392B1 (ko) * 2022-07-05 2022-10-07 전해석 노면 상태에 기반한 주행 안전 확보를 위한 차량용 ecu의 최적화 및 제어 시스템 및 이를 이용한 차량용 ecu의 최적화 및 제어 방법
IT202200015960A1 (it) * 2022-07-28 2024-01-28 Fca Italy Spa Assistenza alla guida di un autoveicolo in presenza di aquaplaning
US12462447B2 (en) 2022-10-04 2025-11-04 Nvidia Corporation Image stitching with color harmonization of de-processed images for surround view systems and applications
US12327413B2 (en) * 2022-10-04 2025-06-10 Nvidia Corporation Image stitching with color harmonization for surround view systems and applications
DE102022211241A1 (de) 2022-10-24 2024-04-25 Continental Autonomous Mobility Germany GmbH Erkennen von Fahrbahnauflage auf einer Fahrbahn
CN116229765B (zh) * 2023-05-06 2023-07-21 贵州鹰驾交通科技有限公司 一种基于数字数据处理的车路协同方法
US20250182491A1 (en) * 2023-12-01 2025-06-05 Lytx, Inc. Road condition tagging
US12600381B2 (en) * 2024-07-09 2026-04-14 Scott C Harris Vehicle operation modification based on weather sensing sensors
US20260077787A1 (en) * 2024-09-13 2026-03-19 International Business Machines Corporation Proactive vehicle aquaplaning mitigation system

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102016009928A1 (de) * 2016-08-16 2017-02-02 Daimler Ag Verfahren zum Erfassen von Nässe auf einer Fahrbahn
CN107667378A (zh) * 2015-05-06 2018-02-06 大陆-特韦斯贸易合伙股份公司及两合公司 用于识别和评估路面反射的方法和装置

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ATE375585T1 (de) * 2003-03-14 2007-10-15 Liwas Aps Einrichtung zur detektion eines strassenoberflächenzustands
DE10346510B4 (de) * 2003-10-02 2007-11-15 Daimlerchrysler Ag Vorrichtung zur Verbesserung der Sichtverhältnisse in einem Kraftfahrzeug
DE102005044486B4 (de) * 2005-09-16 2009-02-05 Daimler Ag Verfahren zur Detektion des Oberflächenzustands einer Fahrbahn, sowie Detektionssystem und Fahrerassistenzsystem zur Umsetzung des Verfahrens
WO2009030419A2 (de) * 2007-08-28 2009-03-12 Valeo Schalter Und Sensoren Gmbh Verfahren und anordnung zur auswertung von helligkeitswerten in sensorbildern bei bildauswertenden umfelderkennungssystemen, insbesondere hinsichtlich einer tag-/nachtunterscheidung
US8781170B2 (en) * 2011-12-06 2014-07-15 GM Global Technology Operations LLC Vehicle ghosting on full windshield display
DE102013101639A1 (de) 2013-02-19 2014-09-04 Continental Teves Ag & Co. Ohg Verfahren und Vorrichtung zur Bestimmung eines Fahrbahnzustands
JP6036421B2 (ja) 2013-03-14 2016-11-30 富士通株式会社 道路管理支援方法、道路管理支援装置、及び道路管理支援プログラム
US9286520B1 (en) * 2013-07-16 2016-03-15 Google Inc. Real-time road flare detection using templates and appropriate color spaces
DE102013223367A1 (de) 2013-11-15 2015-05-21 Continental Teves Ag & Co. Ohg Verfahren und Vorrichtung zur Bestimmung eines Fahrbahnzustands mittels eines Fahrzeugkamerasystems
DE102015208428A1 (de) * 2015-05-06 2016-11-10 Continental Teves Ag & Co. Ohg Verfahren und Vorrichtung zur Erkennung und Bewertung von Umwelteinflüssen und Fahrbahnzustandsinformationen im Fahrzeugumfeld
US10832426B2 (en) * 2015-09-24 2020-11-10 Apple Inc. Systems and methods for surface monitoring
JP2017078972A (ja) 2015-10-20 2017-04-27 トヨタ自動車株式会社 運転支援装置
US10562412B1 (en) * 2016-03-24 2020-02-18 Xsensor Technology Corporation Intelligent seat systems
US10082795B2 (en) * 2016-08-24 2018-09-25 GM Global Technology Operations LLC Vision-based on-board real-time estimation of water film thickness

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107667378A (zh) * 2015-05-06 2018-02-06 大陆-特韦斯贸易合伙股份公司及两合公司 用于识别和评估路面反射的方法和装置
DE102016009928A1 (de) * 2016-08-16 2017-02-02 Daimler Ag Verfahren zum Erfassen von Nässe auf einer Fahrbahn

Also Published As

Publication number Publication date
DE112019000092A5 (de) 2020-06-10
WO2019174682A1 (de) 2019-09-19
US20200406897A1 (en) 2020-12-31
CN111357012A (zh) 2020-06-30
DE102018203807A1 (de) 2019-09-19
US12249153B2 (en) 2025-03-11
JP7291129B2 (ja) 2023-06-14
JP2021517675A (ja) 2021-07-26

Similar Documents

Publication Publication Date Title
CN111357012B (zh) 用于识别与评估车道状况和与天气相关的环境影响的方法和装置
JP2021517675A5 (enExample)
US8436902B2 (en) Method and system for weather condition detection with image-based road characterization
US10289920B2 (en) Method and device for determining a roadway state by means of a vehicle camera system
JP6174975B2 (ja) 周囲環境認識装置
JP6133861B2 (ja) 状態認識システム及び状態認識方法
US20150371095A1 (en) Method and Apparatus for Determining a Road Condition
KR101891460B1 (ko) 차도 위의 반사체를 인식하고 평가하기 위한 방법 및 장치
EP3410146B1 (en) Determining objects of interest for active cruise control
WO2014017403A1 (ja) 車載用画像認識装置
JP5879219B2 (ja) 車載用環境認識装置
CN111414857B (zh) 一种基于视觉的多特征融合的前方车辆检测方法
CN107609472A (zh) 一种基于车载双摄像头的无人驾驶汽车机器视觉系统
US20250175582A1 (en) Vehicular trailer assist system
US8379088B2 (en) Method and system for evaluating brightness values in sensor images of image-evaluating adaptive cruise control systems
JP2025533175A (ja) 道路上の路面被覆物の認識
Tsuchiya et al. Real-time vehicle detection using a single rear camera for a blind spot warning system
CN103748600A (zh) 用于识别车辆的周围空气中的干扰对象的方法和设备
CN121291271A (zh) 一种路面状态警示系统与方法
Persson Rukin Active safety sensor verification-Development of image analysis support tool

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20230110

Address after: Germany Ingolstadt

Applicant after: Continental Zhixing Germany Co.,Ltd.

Address before: Frankfurt, Germany

Applicant before: CONTINENTAL TEVES AG & Co. OHG

GR01 Patent grant
GR01 Patent grant