JP5859652B2 - 水滴検出装置及び水滴検出装置を用いた立体物検出装置 - Google Patents

水滴検出装置及び水滴検出装置を用いた立体物検出装置 Download PDF

Info

Publication number
JP5859652B2
JP5859652B2 JP2014526964A JP2014526964A JP5859652B2 JP 5859652 B2 JP5859652 B2 JP 5859652B2 JP 2014526964 A JP2014526964 A JP 2014526964A JP 2014526964 A JP2014526964 A JP 2014526964A JP 5859652 B2 JP5859652 B2 JP 5859652B2
Authority
JP
Japan
Prior art keywords
dimensional object
detected
detection unit
object detection
water droplet
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2014526964A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2014017523A1 (ja
Inventor
早川　泰久
泰久 早川
修 深田
修 深田
雅幸 竹村
雅幸 竹村
玲 宇田川
玲 宇田川
彰二 村松
彰二 村松
耕太 入江
耕太 入江
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nissan Motor Co Ltd
Faurecia Clarion Electronics Co Ltd
Original Assignee
Clarion Co Ltd
Nissan Motor Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Clarion Co Ltd, Nissan Motor Co Ltd filed Critical Clarion Co Ltd
Priority to JP2014526964A priority Critical patent/JP5859652B2/ja
Application granted granted Critical
Publication of JP5859652B2 publication Critical patent/JP5859652B2/ja
Publication of JPWO2014017523A1 publication Critical patent/JPWO2014017523A1/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/97—Determining parameters from multiple pictures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60S—SERVICING, CLEANING, REPAIRING, SUPPORTING, LIFTING, OR MANOEUVRING OF VEHICLES, NOT OTHERWISE PROVIDED FOR
    • B60S1/00—Cleaning of vehicles
    • B60S1/02—Cleaning windscreens, windows or optical devices
    • B60S1/04—Wipers or the like, e.g. scrapers
    • B60S1/06—Wipers or the like, e.g. scrapers characterised by the drive
    • B60S1/08—Wipers or the like, e.g. scrapers characterised by the drive electrically driven
    • B60S1/0818—Wipers or the like, e.g. scrapers characterised by the drive electrically driven including control systems responsive to external conditions, e.g. by detection of moisture, dirt or the like
    • B60S1/0822—Wipers or the like, e.g. scrapers characterised by the drive electrically driven including control systems responsive to external conditions, e.g. by detection of moisture, dirt or the like characterized by the arrangement or type of detection means
    • B60S1/0833—Optical rain sensor
    • B60S1/0844—Optical rain sensor including a camera
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/174—Segmentation; Edge detection involving the use of two or more images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/254—Analysis of motion involving subtraction of images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/40—Analysis of texture
    • G06T7/41—Analysis of texture based on statistical description of texture
    • G06T7/42—Analysis of texture based on statistical description of texture using transform domain methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • G08G1/166—Anti-collision systems for active traffic, e.g. moving vehicles, pedestrians, bikes
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • G08G1/167—Driving aids for lane monitoring, lane changing, e.g. blind spot detection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60S—SERVICING, CLEANING, REPAIRING, SUPPORTING, LIFTING, OR MANOEUVRING OF VEHICLES, NOT OTHERWISE PROVIDED FOR
    • B60S1/00—Cleaning of vehicles
    • B60S1/02—Cleaning windscreens, windows or optical devices
    • B60S1/04—Wipers or the like, e.g. scrapers
    • B60S1/06—Wipers or the like, e.g. scrapers characterised by the drive
    • B60S1/08—Wipers or the like, e.g. scrapers characterised by the drive electrically driven
    • B60S1/0818—Wipers or the like, e.g. scrapers characterised by the drive electrically driven including control systems responsive to external conditions, e.g. by detection of moisture, dirt or the like
    • B60S1/0822—Wipers or the like, e.g. scrapers characterised by the drive electrically driven including control systems responsive to external conditions, e.g. by detection of moisture, dirt or the like characterized by the arrangement or type of detection means
    • B60S1/0833—Optical rain sensor
    • B60S1/0844—Optical rain sensor including a camera
    • B60S1/0848—Cleaning devices for cameras on vehicle
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60S—SERVICING, CLEANING, REPAIRING, SUPPORTING, LIFTING, OR MANOEUVRING OF VEHICLES, NOT OTHERWISE PROVIDED FOR
    • B60S1/00—Cleaning of vehicles
    • B60S1/02—Cleaning windscreens, windows or optical devices
    • B60S1/56—Cleaning windscreens, windows or optical devices specially adapted for cleaning other parts or devices than front windows or windscreens
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20224—Image subtraction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30252—Vehicle exterior; Vicinity of vehicle
    • G06T2207/30261—Obstacle
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G06V20/584—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of vehicle lights or traffic lights
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/62—Detection or reduction of noise due to excess charges produced by the exposure, e.g. smear, blooming, ghost image, crosstalk or leakage between pixels
    • H04N25/625—Detection or reduction of noise due to excess charges produced by the exposure, e.g. smear, blooming, ghost image, crosstalk or leakage between pixels for the control of smear

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Mechanical Engineering (AREA)
  • Automation & Control Theory (AREA)
  • Probability & Statistics with Applications (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Geophysics And Detection Of Objects (AREA)
  • Traffic Control Systems (AREA)
  • Emergency Alarm Devices (AREA)
  • Studio Devices (AREA)
JP2014526964A 2012-07-27 2013-07-24 水滴検出装置及び水滴検出装置を用いた立体物検出装置 Active JP5859652B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2014526964A JP5859652B2 (ja) 2012-07-27 2013-07-24 水滴検出装置及び水滴検出装置を用いた立体物検出装置

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
JP2012166526 2012-07-27
JP2012166526 2012-07-27
JP2012166525 2012-07-27
JP2012166525 2012-07-27
PCT/JP2013/070012 WO2014017523A1 (ja) 2012-07-27 2013-07-24 水滴検出装置及び水滴検出装置を用いた立体物検出装置
JP2014526964A JP5859652B2 (ja) 2012-07-27 2013-07-24 水滴検出装置及び水滴検出装置を用いた立体物検出装置

Publications (2)

Publication Number Publication Date
JP5859652B2 true JP5859652B2 (ja) 2016-02-10
JPWO2014017523A1 JPWO2014017523A1 (ja) 2016-07-11

Family

ID=49997332

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2014526964A Active JP5859652B2 (ja) 2012-07-27 2013-07-24 水滴検出装置及び水滴検出装置を用いた立体物検出装置

Country Status (10)

Country Link
US (1) US10096124B2 (de)
EP (1) EP2879369B1 (de)
JP (1) JP5859652B2 (de)
CN (1) CN104509091B (de)
BR (1) BR112015001804B1 (de)
IN (1) IN2015KN00384A (de)
MX (1) MX361919B (de)
MY (1) MY191193A (de)
RU (1) RU2644518C2 (de)
WO (1) WO2014017523A1 (de)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6348770B2 (ja) * 2014-05-08 2018-06-27 日産自動車株式会社 カメラ装置および立体物検出装置
US9990853B1 (en) * 2016-03-02 2018-06-05 Lockheed Martin Corporation Material detection on a road
FR3054459B1 (fr) * 2016-07-28 2020-09-04 Valeo Systemes Dessuyage Dispositif de protection d'un capteur optique et systeme d'assistance a la conduite comprenant un capteur optique
DE102016116964B4 (de) * 2016-09-09 2019-05-16 Knorr-Bremse Systeme für Nutzfahrzeuge GmbH Vorrichtung zum Warnen eines Fahrzeugführers eines Fahrzeugs vor einem stationären Objekt sowie Fahrzeug mit einer solchen Vorrichtung
JP6832105B2 (ja) * 2016-09-23 2021-02-24 株式会社デンソーテン 水滴検出装置、水滴検出方法および水滴検出プログラム
JP6772113B2 (ja) * 2017-08-02 2020-10-21 クラリオン株式会社 付着物検出装置、および、それを備えた車両システム
CN107657822A (zh) * 2017-11-17 2018-02-02 嘉兴四维智城信息科技有限公司 用于交通视频自动识别的高速公路水膜预警系统及方法
US10789502B2 (en) 2018-01-24 2020-09-29 Denso Ten Limited Extraneous-matter detecting apparatus and extraneous-matter detecting method
JP7163766B2 (ja) * 2018-12-28 2022-11-01 株式会社デンソーテン 付着物検出装置および付着物検出方法
CN115339555A (zh) * 2021-05-15 2022-11-15 无锡市铭淇电动科技有限公司 一种智能电动车仪表的使用系统及其方法
CN116402823B (zh) * 2023-06-09 2023-08-04 深圳市思拓通信系统有限公司 基于图像增强的路面垃圾滴漏检测方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006261761A (ja) * 2005-03-15 2006-09-28 Secom Co Ltd 画像信号処理装置
JP2006262242A (ja) * 2005-03-18 2006-09-28 Secom Co Ltd 画像信号処理装置
JP2007226605A (ja) * 2006-02-24 2007-09-06 Secom Co Ltd 画像センサ
JP2009130700A (ja) * 2007-11-26 2009-06-11 Panasonic Corp 撮像装置
JP2010273014A (ja) * 2009-05-20 2010-12-02 Toshiba Alpine Automotive Technology Corp 移動体用カメラ装置及び付着物検出方法

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH03273499A (ja) * 1990-03-23 1991-12-04 Matsushita Electric Ind Co Ltd 車間距離認識装置
JPH08164825A (ja) * 1994-12-14 1996-06-25 Omron Corp ワイパ装置
JP3412757B2 (ja) 2000-01-17 2003-06-03 株式会社アドバネット レンズ保護容器
JP2002079880A (ja) 2000-09-06 2002-03-19 Auto Network Gijutsu Kenkyusho:Kk 車両周辺視認装置
JP4326999B2 (ja) * 2003-08-12 2009-09-09 株式会社日立製作所 画像処理システム
JP2005225250A (ja) * 2004-02-10 2005-08-25 Murakami Corp 車載用監視装置
US8553088B2 (en) * 2005-11-23 2013-10-08 Mobileye Technologies Limited Systems and methods for detecting obstructions in a camera field of view
JP2007215151A (ja) * 2006-01-12 2007-08-23 Canon Inc 撮像装置及びその制御方法及びプログラム
JP5022609B2 (ja) * 2006-02-27 2012-09-12 日立オートモティブシステムズ株式会社 撮像環境認識装置
JP2008060874A (ja) * 2006-08-31 2008-03-13 Hitachi Ltd 車載カメラ及び車載カメラ用付着物検出装置
DE102006062061B4 (de) * 2006-12-29 2010-06-10 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Vorrichtung, Verfahren und Computerprogramm zum Bestimmen einer Position basierend auf einem Kamerabild von einer Kamera
JP2008219063A (ja) 2007-02-28 2008-09-18 Sanyo Electric Co Ltd 車両周辺監視装置及び方法
JP4989385B2 (ja) * 2007-09-12 2012-08-01 キヤノン株式会社 撮像装置及びその制御方法及びプログラム
US8238639B2 (en) * 2008-04-09 2012-08-07 Cognex Corporation Method and system for dynamic feature detection
JP2010041120A (ja) 2008-07-31 2010-02-18 Olympus Corp 撮像装置及びこの撮像装置に適用されるレンズカバー
JP2010097438A (ja) * 2008-10-16 2010-04-30 Keyence Corp 画像処理を用いた輪郭情報抽出方法、画像処理におけるパターンモデルの作成方法、画像処理におけるパターンモデルの位置決め方法、画像処理装置、画像処理プログラム及びコンピュータで読み取り可能な記録媒体
WO2010084521A1 (ja) * 2009-01-20 2010-07-29 本田技研工業株式会社 ウインドシールド上の雨滴を同定するための方法及び装置
RU2441283C2 (ru) * 2009-04-10 2012-01-27 Учреждение Российской академии наук Центр информационных технологий в проектировании РАН Оптико-электронное устройство предупреждения столкновений транспортного средства
JP5699845B2 (ja) * 2011-07-29 2015-04-15 富士通株式会社 生体情報処理装置、生体情報処理方法及び生体情報処理用コンピュータプログラム
EP2756450B1 (de) * 2011-09-13 2018-04-04 Valeo Schalter und Sensoren GmbH Verfahren zur erkennung von regentropfen auf der windschutzscheibe eines fahrzeugs und fahrerassistenzsystem

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006261761A (ja) * 2005-03-15 2006-09-28 Secom Co Ltd 画像信号処理装置
JP2006262242A (ja) * 2005-03-18 2006-09-28 Secom Co Ltd 画像信号処理装置
JP2007226605A (ja) * 2006-02-24 2007-09-06 Secom Co Ltd 画像センサ
JP2009130700A (ja) * 2007-11-26 2009-06-11 Panasonic Corp 撮像装置
JP2010273014A (ja) * 2009-05-20 2010-12-02 Toshiba Alpine Automotive Technology Corp 移動体用カメラ装置及び付着物検出方法

Also Published As

Publication number Publication date
US20150325005A1 (en) 2015-11-12
CN104509091A (zh) 2015-04-08
EP2879369A4 (de) 2016-09-07
EP2879369B1 (de) 2018-10-31
RU2644518C2 (ru) 2018-02-12
EP2879369A1 (de) 2015-06-03
WO2014017523A1 (ja) 2014-01-30
BR112015001804B1 (pt) 2021-11-16
MX2015001227A (es) 2017-06-19
JPWO2014017523A1 (ja) 2016-07-11
CN104509091B (zh) 2019-03-26
BR112015001804A2 (pt) 2017-08-08
MY191193A (en) 2022-06-07
RU2015106690A (ru) 2016-09-20
US10096124B2 (en) 2018-10-09
MX361919B (es) 2018-12-19
IN2015KN00384A (de) 2015-07-10

Similar Documents

Publication Publication Date Title
JP5859652B2 (ja) 水滴検出装置及び水滴検出装置を用いた立体物検出装置
JP5900623B2 (ja) 立体物検出装置及び立体物検出方法
JP5997276B2 (ja) 立体物検出装置及び異物検出装置
JP5900622B2 (ja) 立体物検出装置及び立体物検出方法
JP5896027B2 (ja) 立体物検出装置及び立体物検出方法
US9721460B2 (en) In-vehicle surrounding environment recognition device
JP5776795B2 (ja) 立体物検出装置
JP6020567B2 (ja) 立体物検出装置および立体物検出方法
JP6348770B2 (ja) カメラ装置および立体物検出装置
JPWO2013129354A1 (ja) 立体物検出装置
JP6260444B2 (ja) カメラ装置及びレンズ洗浄方法
JP6003986B2 (ja) 立体物検出装置、立体物検出方法及び異物検出装置
JP6435633B2 (ja) 立体物検出装置及び立体物検出方法
JP6011110B2 (ja) 立体物検出装置および立体物検出方法
JP6020568B2 (ja) 立体物検出装置および立体物検出方法
JP5768927B2 (ja) 立体物検出装置
JP5817913B2 (ja) 立体物検出装置及び立体物検出方法

Legal Events

Date Code Title Description
TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20151201

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20151216

R150 Certificate of patent or registration of utility model

Ref document number: 5859652

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

S533 Written request for registration of change of name

Free format text: JAPANESE INTERMEDIATE CODE: R313533

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313117

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

R370 Written measure of declining of transfer procedure

Free format text: JAPANESE INTERMEDIATE CODE: R370

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313117

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350