IN2015KN00384A - - Google Patents

Download PDF

Info

Publication number
IN2015KN00384A
IN2015KN00384A IN384KON2015A IN2015KN00384A IN 2015KN00384 A IN2015KN00384 A IN 2015KN00384A IN 384KON2015 A IN384KON2015 A IN 384KON2015A IN 2015KN00384 A IN2015KN00384 A IN 2015KN00384A
Authority
IN
India
Prior art keywords
dimensional object
image
water droplet
detection means
bird
Prior art date
Application number
Inventor
Hayakawa Yasuhisa
Fukata Osamu
Takemura Masayuki
Utagawa Akira
Muramatsu Shoji
Irie Kota
Original Assignee
Nissan Motor
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nissan Motor filed Critical Nissan Motor
Publication of IN2015KN00384A publication Critical patent/IN2015KN00384A/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/97—Determining parameters from multiple pictures
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60S—SERVICING, CLEANING, REPAIRING, SUPPORTING, LIFTING, OR MANOEUVRING OF VEHICLES, NOT OTHERWISE PROVIDED FOR
    • B60S1/00—Cleaning of vehicles
    • B60S1/02—Cleaning windscreens, windows or optical devices
    • B60S1/04—Wipers or the like, e.g. scrapers
    • B60S1/06—Wipers or the like, e.g. scrapers characterised by the drive
    • B60S1/08—Wipers or the like, e.g. scrapers characterised by the drive electrically driven
    • B60S1/0818—Wipers or the like, e.g. scrapers characterised by the drive electrically driven including control systems responsive to external conditions, e.g. by detection of moisture, dirt or the like
    • B60S1/0822—Wipers or the like, e.g. scrapers characterised by the drive electrically driven including control systems responsive to external conditions, e.g. by detection of moisture, dirt or the like characterized by the arrangement or type of detection means
    • B60S1/0833—Optical rain sensor
    • B60S1/0844—Optical rain sensor including a camera
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/254—Analysis of motion involving subtraction of images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/40—Analysis of texture
    • G06T7/41—Analysis of texture based on statistical description of texture
    • G06T7/42—Analysis of texture based on statistical description of texture using transform domain methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • G08G1/166—Anti-collision systems for active traffic, e.g. moving vehicles, pedestrians, bikes
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • G08G1/167—Driving aids for lane monitoring, lane changing, e.g. blind spot detection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60S—SERVICING, CLEANING, REPAIRING, SUPPORTING, LIFTING, OR MANOEUVRING OF VEHICLES, NOT OTHERWISE PROVIDED FOR
    • B60S1/00—Cleaning of vehicles
    • B60S1/02—Cleaning windscreens, windows or optical devices
    • B60S1/04—Wipers or the like, e.g. scrapers
    • B60S1/06—Wipers or the like, e.g. scrapers characterised by the drive
    • B60S1/08—Wipers or the like, e.g. scrapers characterised by the drive electrically driven
    • B60S1/0818—Wipers or the like, e.g. scrapers characterised by the drive electrically driven including control systems responsive to external conditions, e.g. by detection of moisture, dirt or the like
    • B60S1/0822—Wipers or the like, e.g. scrapers characterised by the drive electrically driven including control systems responsive to external conditions, e.g. by detection of moisture, dirt or the like characterized by the arrangement or type of detection means
    • B60S1/0833—Optical rain sensor
    • B60S1/0844—Optical rain sensor including a camera
    • B60S1/0848—Cleaning devices for cameras on vehicle
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60S—SERVICING, CLEANING, REPAIRING, SUPPORTING, LIFTING, OR MANOEUVRING OF VEHICLES, NOT OTHERWISE PROVIDED FOR
    • B60S1/00—Cleaning of vehicles
    • B60S1/02—Cleaning windscreens, windows or optical devices
    • B60S1/56—Cleaning windscreens, windows or optical devices specially adapted for cleaning other parts or devices than front windows or windscreens
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20224—Image subtraction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30252—Vehicle exterior; Vicinity of vehicle
    • G06T2207/30261—Obstacle
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/174—Segmentation; Edge detection involving the use of two or more images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G06V20/584—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of vehicle lights or traffic lights
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/62—Detection or reduction of noise due to excess charges produced by the exposure, e.g. smear, blooming, ghost image, crosstalk or leakage between pixels
    • H04N25/625—Detection or reduction of noise due to excess charges produced by the exposure, e.g. smear, blooming, ghost image, crosstalk or leakage between pixels for the control of smear

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Mechanical Engineering (AREA)
  • Automation & Control Theory (AREA)
  • Probability & Statistics with Applications (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Geophysics And Detection Of Objects (AREA)
  • Traffic Control Systems (AREA)
  • Emergency Alarm Devices (AREA)
  • Studio Devices (AREA)

Abstract

A three-dimensional object detection device provided with: an image conversion means (31) for converting the point of view of an image obtained by means of an imaging means (10) into a bird's-eye view image; a water droplet detection means (40) for detecting water droplets that attached to an imaging optical system; a first three-dimensional object detection means (33) for detecting a three- dimensional object on the basis of a differential image of bird s eye view images captured at different times; a first three- dimensional object determination means (38) for determining whether the three-dimensional object detected by means of the first three dimensional object detection means is another vehicle; and a control means (39) for driving a water droplet removal means in accordance with the attachment state of the water droplets detected by means of the water droplet detection means.
IN384KON2015 2012-07-27 2013-07-24 IN2015KN00384A (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2012166525 2012-07-27
JP2012166526 2012-07-27
PCT/JP2013/070012 WO2014017523A1 (en) 2012-07-27 2013-07-24 Water droplet detection device, and three-dimensional object detection device using said water droplet detection device

Publications (1)

Publication Number Publication Date
IN2015KN00384A true IN2015KN00384A (en) 2015-07-10

Family

ID=49997332

Family Applications (1)

Application Number Title Priority Date Filing Date
IN384KON2015 IN2015KN00384A (en) 2012-07-27 2013-07-24

Country Status (10)

Country Link
US (1) US10096124B2 (en)
EP (1) EP2879369B1 (en)
JP (1) JP5859652B2 (en)
CN (1) CN104509091B (en)
BR (1) BR112015001804B1 (en)
IN (1) IN2015KN00384A (en)
MX (1) MX361919B (en)
MY (1) MY191193A (en)
RU (1) RU2644518C2 (en)
WO (1) WO2014017523A1 (en)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6348770B2 (en) * 2014-05-08 2018-06-27 日産自動車株式会社 Camera device and three-dimensional object detection device
US9990853B1 (en) * 2016-03-02 2018-06-05 Lockheed Martin Corporation Material detection on a road
FR3054459B1 (en) * 2016-07-28 2020-09-04 Valeo Systemes Dessuyage PROTECTION DEVICE FOR AN OPTICAL SENSOR AND DRIVING ASSISTANCE SYSTEM INCLUDING AN OPTICAL SENSOR
DE102016116964B4 (en) * 2016-09-09 2019-05-16 Knorr-Bremse Systeme für Nutzfahrzeuge GmbH Device for warning a driver of a vehicle in front of a stationary object and vehicle with such a device
JP6832105B2 (en) * 2016-09-23 2021-02-24 株式会社デンソーテン Water drop detector, water drop detection method and water drop detection program
JP6772113B2 (en) * 2017-08-02 2020-10-21 クラリオン株式会社 Adhesion detection device and vehicle system equipped with it
CN107657822A (en) * 2017-11-17 2018-02-02 嘉兴四维智城信息科技有限公司 Highway moisture film early warning system and method for traffic video automatic identification
US10789502B2 (en) 2018-01-24 2020-09-29 Denso Ten Limited Extraneous-matter detecting apparatus and extraneous-matter detecting method
JP7163766B2 (en) * 2018-12-28 2022-11-01 株式会社デンソーテン Attached matter detection device and attached matter detection method
CN115339555A (en) * 2021-05-15 2022-11-15 无锡市铭淇电动科技有限公司 Use system and method of intelligent electric vehicle instrument
CN116402823B (en) * 2023-06-09 2023-08-04 深圳市思拓通信系统有限公司 Road surface garbage drip detection method based on image enhancement

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH03273499A (en) * 1990-03-23 1991-12-04 Matsushita Electric Ind Co Ltd Device for recognizing distance between vehicles
JPH08164825A (en) * 1994-12-14 1996-06-25 Omron Corp Wiper device
JP3412757B2 (en) 2000-01-17 2003-06-03 株式会社アドバネット Lens protection container
JP2002079880A (en) * 2000-09-06 2002-03-19 Auto Network Gijutsu Kenkyusho:Kk Vehicle periphery visually confirming device
JP4326999B2 (en) * 2003-08-12 2009-09-09 株式会社日立製作所 Image processing system
JP2005225250A (en) 2004-02-10 2005-08-25 Murakami Corp On-vehicle surveillance device
JP4611776B2 (en) * 2005-03-15 2011-01-12 セコム株式会社 Image signal processing device
JP4542929B2 (en) * 2005-03-18 2010-09-15 セコム株式会社 Image signal processing device
US8553088B2 (en) * 2005-11-23 2013-10-08 Mobileye Technologies Limited Systems and methods for detecting obstructions in a camera field of view
JP2007215151A (en) * 2006-01-12 2007-08-23 Canon Inc Imaging apparatus, control method thereof, and program
JP4611911B2 (en) * 2006-02-24 2011-01-12 セコム株式会社 Image sensor
JP5022609B2 (en) * 2006-02-27 2012-09-12 日立オートモティブシステムズ株式会社 Imaging environment recognition device
JP2008060874A (en) * 2006-08-31 2008-03-13 Hitachi Ltd On-vehicle camera and stain detector for on-vehicle camera
DE102006062061B4 (en) * 2006-12-29 2010-06-10 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus, method and computer program for determining a position based on a camera image from a camera
JP2008219063A (en) 2007-02-28 2008-09-18 Sanyo Electric Co Ltd Apparatus and method for monitoring vehicle's surrounding
JP4989385B2 (en) * 2007-09-12 2012-08-01 キヤノン株式会社 Imaging apparatus, control method thereof, and program
JP2009130700A (en) * 2007-11-26 2009-06-11 Panasonic Corp Imaging apparatus
US8238639B2 (en) * 2008-04-09 2012-08-07 Cognex Corporation Method and system for dynamic feature detection
JP2010041120A (en) * 2008-07-31 2010-02-18 Olympus Corp Imaging apparatus and lens cover applied to same
JP2010097438A (en) * 2008-10-16 2010-04-30 Keyence Corp Outline information extraction method using image processing, creation method for pattern model in image processing, positioning method for pattern model in image processing, image processor, image processing program and computer-readable recording medium
WO2010084521A1 (en) * 2009-01-20 2010-07-29 本田技研工業株式会社 Method and apparatus for identifying raindrops on a windshield
RU2441283C2 (en) * 2009-04-10 2012-01-27 Учреждение Российской академии наук Центр информационных технологий в проектировании РАН Electro-optical apparatus for preventing vehicle collision
JP2010273014A (en) * 2009-05-20 2010-12-02 Toshiba Alpine Automotive Technology Corp Camera device for mobile object and method of detecting attachment
JP5699845B2 (en) * 2011-07-29 2015-04-15 富士通株式会社 Biological information processing apparatus, biological information processing method, and computer program for biological information processing
EP2756450B1 (en) * 2011-09-13 2018-04-04 Valeo Schalter und Sensoren GmbH Method for detection of a rain drop on the windscreen of a vehicle and driver assistance system

Also Published As

Publication number Publication date
EP2879369A4 (en) 2016-09-07
BR112015001804A2 (en) 2017-08-08
RU2015106690A (en) 2016-09-20
MY191193A (en) 2022-06-07
JPWO2014017523A1 (en) 2016-07-11
US10096124B2 (en) 2018-10-09
CN104509091B (en) 2019-03-26
MX361919B (en) 2018-12-19
WO2014017523A1 (en) 2014-01-30
RU2644518C2 (en) 2018-02-12
EP2879369A1 (en) 2015-06-03
US20150325005A1 (en) 2015-11-12
BR112015001804B1 (en) 2021-11-16
JP5859652B2 (en) 2016-02-10
CN104509091A (en) 2015-04-08
EP2879369B1 (en) 2018-10-31
MX2015001227A (en) 2017-06-19

Similar Documents

Publication Publication Date Title
IN2015KN00384A (en)
MY165967A (en) Moving-body-detecting device and moving-body-detecting system
WO2011053616A3 (en) Three dimensional imaging device, system, and method
MY172250A (en) Three-dimensional object detection device
EP2682897A3 (en) Lane departure warning device
IN2015KN00489A (en)
EP2348280A3 (en) Systems and methods for monocular airborne object detection
MX2015001229A (en) Three-dimensional object detection device, three-dimensional object detection method.
MY183995A (en) Object detector device and object detection method
WO2012135018A3 (en) System and method for determining driver alertness
WO2012033658A3 (en) A 3-d camera
MY179728A (en) Three-dimensional object detection device
EP2682899A3 (en) Environment recognition device
EP3851351A3 (en) A robust method for detecting traffic signals and their associated states
EP2602741A3 (en) Detection of the vertical contour of a road
EP2851841A8 (en) System and method of alerting a driver that visual perception of pedestrian may be difficult
EP2693416A3 (en) Moving object recognition systems, moving object recognition programs, and moving object recognition methods
MX2018014750A (en) Imaging control device and method, and vehicle.
EP2541465A3 (en) Vehicle periphery monitoring system
WO2010013782A1 (en) Image processing device
IN2015KN00490A (en)
MY171160A (en) Driving assistance system and raindrop detection method thereof
MX367068B (en) Traffic light recognition device and traffic light recognition method.
MX349873B (en) Three-dimensional object detection device.
MY156197A (en) Three-dimensional object detection device and three-dimensional object detection method