JP7291129B2 - 路面状態と天候に基づく環境影響を認識し評価する方法及び装置 - Google Patents

路面状態と天候に基づく環境影響を認識し評価する方法及び装置 Download PDF

Info

Publication number
JP7291129B2
JP7291129B2 JP2020519331A JP2020519331A JP7291129B2 JP 7291129 B2 JP7291129 B2 JP 7291129B2 JP 2020519331 A JP2020519331 A JP 2020519331A JP 2020519331 A JP2020519331 A JP 2020519331A JP 7291129 B2 JP7291129 B2 JP 7291129B2
Authority
JP
Japan
Prior art keywords
road surface
vehicle
camera
road
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020519331A
Other languages
English (en)
Japanese (ja)
Other versions
JP2021517675A5 (enExample
JP2021517675A (ja
Inventor
ハルトマン・ベルント
アムトール・マヌエル
デンツラー・ヨアヒム
Original Assignee
コンティネンタル・テーベス・アクチエンゲゼルシヤフト・ウント・コンパニー・オッフェネ・ハンデルスゲゼルシヤフト
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by コンティネンタル・テーベス・アクチエンゲゼルシヤフト・ウント・コンパニー・オッフェネ・ハンデルスゲゼルシヤフト filed Critical コンティネンタル・テーベス・アクチエンゲゼルシヤフト・ウント・コンパニー・オッフェネ・ハンデルスゲゼルシヤフト
Publication of JP2021517675A publication Critical patent/JP2021517675A/ja
Publication of JP2021517675A5 publication Critical patent/JP2021517675A5/ja
Application granted granted Critical
Publication of JP7291129B2 publication Critical patent/JP7291129B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • B60W40/06—Road conditions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/25—Fusion techniques
    • G06F18/254—Fusion techniques of classification results, e.g. of results related to same input data
    • G06F18/256—Fusion techniques of classification results, e.g. of results related to same input data of results relating to different input data, e.g. multimodal recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/60—Extraction of image or video features relating to illumination properties, e.g. using a reflectance or lighting model
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/80—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level
    • G06V10/809—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level of classification results, e.g. where the classifiers operate on the same input data
    • G06V10/811—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level of classification results, e.g. where the classifiers operate on the same input data the classifiers operating on different input data, e.g. multi-modal recognition
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403—Image sensing, e.g. optical camera
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2552/00—Input parameters relating to infrastructure
    • B60W2552/05—Type of road, e.g. motorways, local streets, paved or unpaved roads
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2555/00—Input parameters relating to exterior conditions, not covered by groups B60W2552/00, B60W2554/00
    • B60W2555/20—Ambient conditions, e.g. wind or rain

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Medical Informatics (AREA)
  • Data Mining & Analysis (AREA)
  • Mathematical Physics (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Databases & Information Systems (AREA)
  • Transportation (AREA)
  • Automation & Control Theory (AREA)
  • Mechanical Engineering (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Traffic Control Systems (AREA)
  • Image Analysis (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
JP2020519331A 2018-03-13 2019-02-26 路面状態と天候に基づく環境影響を認識し評価する方法及び装置 Active JP7291129B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
DE102018203807.4A DE102018203807A1 (de) 2018-03-13 2018-03-13 Verfahren und Vorrichtung zur Erkennung und Bewertung von Fahrbahnzuständen und witterungsbedingten Umwelteinflüssen
DE102018203807.4 2018-03-13
PCT/DE2019/200016 WO2019174682A1 (de) 2018-03-13 2019-02-26 Verfahren und vorrichtung zur erkennung und bewertung von fahrbahnzuständen und witterungsbedingten umwelteinflüssen

Publications (3)

Publication Number Publication Date
JP2021517675A JP2021517675A (ja) 2021-07-26
JP2021517675A5 JP2021517675A5 (enExample) 2023-02-02
JP7291129B2 true JP7291129B2 (ja) 2023-06-14

Family

ID=66175116

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2020519331A Active JP7291129B2 (ja) 2018-03-13 2019-02-26 路面状態と天候に基づく環境影響を認識し評価する方法及び装置

Country Status (5)

Country Link
US (1) US12249153B2 (enExample)
JP (1) JP7291129B2 (enExample)
CN (1) CN111357012B (enExample)
DE (2) DE102018203807A1 (enExample)
WO (1) WO2019174682A1 (enExample)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20250029399A1 (en) * 2022-01-18 2025-01-23 SRD Korea Co., Ltd. Control system using road surface recognition of driving vehicle and method using the same

Families Citing this family (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102017214030A1 (de) * 2017-08-11 2019-02-14 Robert Bosch Gmbh Verfahren zum Bestimmen eines Reibwerts für einen Kontakt zwischen einem Reifen eines Fahrzeugs und einer Fahrbahn und Verfahren zum Steuern einer Fahrzeugfunktion eines Fahrzeugs
DE102019209268B4 (de) * 2019-06-26 2023-03-02 Continental Automotive Technologies GmbH Verfahren zur Bewertung eines Fahrbahnzustandes einer Fahrbahn, auf der sich ein Kraftfahrzeug bewegt, sowie Verfahren zum Reduzieren eines Gefährdungsgrades für ein sich auf einer Fahrbahn bewegendes Kraftfahrzeug in Bezug auf eine Gefahrenstelle
KR102297683B1 (ko) * 2019-07-01 2021-09-07 (주)베이다스 복수의 카메라들을 캘리브레이션하는 방법 및 장치
DE102019210935A1 (de) * 2019-07-24 2021-01-28 Zf Friedrichshafen Ag Erkennen und Bewerten einer Wasseransammlung auf einer Fahrbahn
DE102019218461A1 (de) * 2019-11-28 2021-06-02 Robert Bosch Gmbh Verfahren und Vorrichtung zum Ermitteln einer Aquaplaninggefahr für ein Fortbewegungsmittel
DE102019135751B4 (de) 2019-12-23 2024-11-14 Nira Dynamics Ab Verfahren, Vorrichtungen, Systeme und Computerprogrammprodukte zum Schätzen einer Fahrbahnoberflächentemperatur
US11521127B2 (en) 2020-06-05 2022-12-06 Waymo Llc Road condition deep learning model
KR20220027327A (ko) * 2020-08-26 2022-03-08 현대모비스 주식회사 딥러닝 기반 노면판단 모델을 이용한 터레인모드 제어 방법 및 장치
CN112131963B (zh) * 2020-08-31 2023-09-01 青岛秀山移动测量有限公司 一种基于行驶方向结构特征约束的道路标识线提取方法
AT524256B1 (de) * 2020-10-08 2023-06-15 Thomas Genitheim Ing Dipl Ing Fh Verfahren zur Ermittlung eines Reibbeiwertes
DE102021101788A1 (de) * 2021-01-27 2022-07-28 Zf Cv Systems Global Gmbh Verfahren zum ortsaufgelösten Ermitteln einer Oberflächeneigenschaft eines Untergrundes, Verarbeitungseinheit und Fahrzeug
JP2022152402A (ja) * 2021-03-29 2022-10-12 本田技研工業株式会社 認識装置、車両システム、認識方法、およびプログラム
DE102021110184A1 (de) 2021-04-22 2022-10-27 Dr. Ing. H.C. F. Porsche Aktiengesellschaft Computerimplementiertes Verfahren zur Abschätzung von Fahrbahneigenschaften
US12066571B2 (en) 2021-05-03 2024-08-20 Waymo Llc Methods and systems for detecting adverse road conditions using radar
JP7600971B2 (ja) * 2021-12-03 2024-12-17 トヨタ自動車株式会社 車載通知装置
US11878717B2 (en) 2022-01-24 2024-01-23 International Business Machines Corporation Mirage detection by autonomous vehicles
US20250201114A1 (en) * 2022-03-11 2025-06-19 Hitachi Astemo, Ltd. External environment recognition device and external environment recognition method
DE102022206625A1 (de) 2022-06-29 2024-01-04 Continental Autonomous Mobility Germany GmbH Verfahren und System zur Straßenzustandsüberwachung durch ein maschinelles Lernsystem sowie Verfahren zum Trainieren des maschinellen Lernsystems
KR102449392B1 (ko) * 2022-07-05 2022-10-07 전해석 노면 상태에 기반한 주행 안전 확보를 위한 차량용 ecu의 최적화 및 제어 시스템 및 이를 이용한 차량용 ecu의 최적화 및 제어 방법
IT202200015960A1 (it) * 2022-07-28 2024-01-28 Fca Italy Spa Assistenza alla guida di un autoveicolo in presenza di aquaplaning
US12462447B2 (en) 2022-10-04 2025-11-04 Nvidia Corporation Image stitching with color harmonization of de-processed images for surround view systems and applications
US12327413B2 (en) * 2022-10-04 2025-06-10 Nvidia Corporation Image stitching with color harmonization for surround view systems and applications
DE102022211241A1 (de) 2022-10-24 2024-04-25 Continental Autonomous Mobility Germany GmbH Erkennen von Fahrbahnauflage auf einer Fahrbahn
CN116229765B (zh) * 2023-05-06 2023-07-21 贵州鹰驾交通科技有限公司 一种基于数字数据处理的车路协同方法
US20250182491A1 (en) * 2023-12-01 2025-06-05 Lytx, Inc. Road condition tagging
US12600381B2 (en) * 2024-07-09 2026-04-14 Scott C Harris Vehicle operation modification based on weather sensing sensors
US20260077787A1 (en) * 2024-09-13 2026-03-19 International Business Machines Corporation Proactive vehicle aquaplaning mitigation system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014178843A (ja) 2013-03-14 2014-09-25 Fujitsu Ltd 道路管理支援方法、道路管理支援装置、及び道路管理支援プログラム
JP2017503715A (ja) 2013-11-15 2017-02-02 コンティネンタル・テーベス・アクチエンゲゼルシヤフト・ウント・コンパニー・オッフェネ・ハンデルスゲゼルシヤフト 車載カメラ・システムを用いた路面状態を割り出すための方法および装置
JP2017078972A (ja) 2015-10-20 2017-04-27 トヨタ自動車株式会社 運転支援装置

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ATE375585T1 (de) * 2003-03-14 2007-10-15 Liwas Aps Einrichtung zur detektion eines strassenoberflächenzustands
DE10346510B4 (de) * 2003-10-02 2007-11-15 Daimlerchrysler Ag Vorrichtung zur Verbesserung der Sichtverhältnisse in einem Kraftfahrzeug
DE102005044486B4 (de) * 2005-09-16 2009-02-05 Daimler Ag Verfahren zur Detektion des Oberflächenzustands einer Fahrbahn, sowie Detektionssystem und Fahrerassistenzsystem zur Umsetzung des Verfahrens
WO2009030419A2 (de) * 2007-08-28 2009-03-12 Valeo Schalter Und Sensoren Gmbh Verfahren und anordnung zur auswertung von helligkeitswerten in sensorbildern bei bildauswertenden umfelderkennungssystemen, insbesondere hinsichtlich einer tag-/nachtunterscheidung
US8781170B2 (en) * 2011-12-06 2014-07-15 GM Global Technology Operations LLC Vehicle ghosting on full windshield display
DE102013101639A1 (de) 2013-02-19 2014-09-04 Continental Teves Ag & Co. Ohg Verfahren und Vorrichtung zur Bestimmung eines Fahrbahnzustands
US9286520B1 (en) * 2013-07-16 2016-03-15 Google Inc. Real-time road flare detection using templates and appropriate color spaces
DE102015208429A1 (de) * 2015-05-06 2016-11-10 Continental Teves Ag & Co. Ohg Verfahren und Vorrichtung zur Erkennung und Bewertung von Fahrbahnreflexionen
DE102015208428A1 (de) * 2015-05-06 2016-11-10 Continental Teves Ag & Co. Ohg Verfahren und Vorrichtung zur Erkennung und Bewertung von Umwelteinflüssen und Fahrbahnzustandsinformationen im Fahrzeugumfeld
US10832426B2 (en) * 2015-09-24 2020-11-10 Apple Inc. Systems and methods for surface monitoring
US10562412B1 (en) * 2016-03-24 2020-02-18 Xsensor Technology Corporation Intelligent seat systems
DE102016009928A1 (de) * 2016-08-16 2017-02-02 Daimler Ag Verfahren zum Erfassen von Nässe auf einer Fahrbahn
US10082795B2 (en) * 2016-08-24 2018-09-25 GM Global Technology Operations LLC Vision-based on-board real-time estimation of water film thickness

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014178843A (ja) 2013-03-14 2014-09-25 Fujitsu Ltd 道路管理支援方法、道路管理支援装置、及び道路管理支援プログラム
JP2017503715A (ja) 2013-11-15 2017-02-02 コンティネンタル・テーベス・アクチエンゲゼルシヤフト・ウント・コンパニー・オッフェネ・ハンデルスゲゼルシヤフト 車載カメラ・システムを用いた路面状態を割り出すための方法および装置
JP2017078972A (ja) 2015-10-20 2017-04-27 トヨタ自動車株式会社 運転支援装置

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20250029399A1 (en) * 2022-01-18 2025-01-23 SRD Korea Co., Ltd. Control system using road surface recognition of driving vehicle and method using the same

Also Published As

Publication number Publication date
DE112019000092A5 (de) 2020-06-10
WO2019174682A1 (de) 2019-09-19
US20200406897A1 (en) 2020-12-31
CN111357012A (zh) 2020-06-30
DE102018203807A1 (de) 2019-09-19
US12249153B2 (en) 2025-03-11
JP2021517675A (ja) 2021-07-26
CN111357012B (zh) 2025-02-18

Similar Documents

Publication Publication Date Title
JP7291129B2 (ja) 路面状態と天候に基づく環境影響を認識し評価する方法及び装置
JP2021517675A5 (enExample)
EP3807128B1 (en) A rider assistance system and method
JP6174975B2 (ja) 周囲環境認識装置
EP3161507B1 (en) Method for tracking a target vehicle approaching a motor vehicle by means of a camera system of the motor vehicle, camera system and motor vehicle
CN107782727B (zh) 基于融合的湿路面检测
US10147002B2 (en) Method and apparatus for determining a road condition
US10289920B2 (en) Method and device for determining a roadway state by means of a vehicle camera system
KR101891460B1 (ko) 차도 위의 반사체를 인식하고 평가하기 위한 방법 및 장치
CN114415171A (zh) 一种基于4d毫米波雷达的汽车可行驶区域检测方法
JP6045889B2 (ja) 車載用制御装置
CN106845332B (zh) 利用轮胎旁溅的基于视觉的潮湿路面状况检测
US20240383479A1 (en) Vehicular sensing system with lateral threat assessment
JP2018516799A5 (enExample)
KR20180075985A (ko) 주행환경 감응형 자율 조향 예측 장치 및 그 방법
US12559118B2 (en) Vehicular control system with detection and prevention of unintended motion
Tsuchiya et al. Real-time vehicle detection using a single rear camera for a blind spot warning system
Su et al. Study of Integrated Vehicle Image System Including LDW, FCW, and AFS
Chen et al. Forward safety system using cameras with different focal lengths

Legal Events

Date Code Title Description
RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20200707

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220204

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20221214

A524 Written submission of copy of amendment under article 19 pct

Free format text: JAPANESE INTERMEDIATE CODE: A524

Effective date: 20230124

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230125

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20230510

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20230602

R150 Certificate of patent or registration of utility model

Ref document number: 7291129

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313113

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350