JP6126094B2 - 車載用画像認識装置 - Google Patents

車載用画像認識装置 Download PDF

Info

Publication number
JP6126094B2
JP6126094B2 JP2014526897A JP2014526897A JP6126094B2 JP 6126094 B2 JP6126094 B2 JP 6126094B2 JP 2014526897 A JP2014526897 A JP 2014526897A JP 2014526897 A JP2014526897 A JP 2014526897A JP 6126094 B2 JP6126094 B2 JP 6126094B2
Authority
JP
Japan
Prior art keywords
vehicle
degree
image
lens
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2014526897A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2014017403A1 (ja
Inventor
耕太 入江
耕太 入江
雅幸 竹村
雅幸 竹村
彰二 村松
彰二 村松
早川 泰久
泰久 早川
修 深田
修 深田
將裕 清原
將裕 清原
玲 宇田川
玲 宇田川
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nissan Motor Co Ltd
Faurecia Clarion Electronics Co Ltd
Original Assignee
Clarion Co Ltd
Nissan Motor Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Clarion Co Ltd, Nissan Motor Co Ltd filed Critical Clarion Co Ltd
Publication of JPWO2014017403A1 publication Critical patent/JPWO2014017403A1/ja
Application granted granted Critical
Publication of JP6126094B2 publication Critical patent/JP6126094B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0006Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means to keep optical surfaces clean, e.g. by preventing or removing dirt, stains, contamination, condensation
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/002Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles specially adapted for covering the peripheral part of the vehicle, e.g. for viewing tyres, bumpers or the like
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • G06T7/254Analysis of motion involving subtraction of images
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G06V20/584Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of vehicle lights or traffic lights
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/588Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems
    • G08G1/166Anti-collision systems for active traffic, e.g. moving vehicles, pedestrians, bikes
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems
    • G08G1/167Driving aids for lane monitoring, lane changing, e.g. blind spot detection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • H04N23/81Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation
    • H04N23/811Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation by dust removal, e.g. from surfaces of the image sensor or processing of the image signal output by the electronic image sensor
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20212Image combination
    • G06T2207/20224Image subtraction
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30248Vehicle exterior or interior
    • G06T2207/30252Vehicle exterior; Vicinity of vehicle
    • G06T2207/30261Obstacle

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Optics & Photonics (AREA)
  • Signal Processing (AREA)
  • Mechanical Engineering (AREA)
  • Traffic Control Systems (AREA)
  • Image Analysis (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)
JP2014526897A 2012-07-27 2013-07-19 車載用画像認識装置 Active JP6126094B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2012167702 2012-07-27
JP2012167702 2012-07-27
PCT/JP2013/069667 WO2014017403A1 (ja) 2012-07-27 2013-07-19 車載用画像認識装置

Publications (2)

Publication Number Publication Date
JPWO2014017403A1 JPWO2014017403A1 (ja) 2016-07-11
JP6126094B2 true JP6126094B2 (ja) 2017-05-10

Family

ID=49997216

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2014526897A Active JP6126094B2 (ja) 2012-07-27 2013-07-19 車載用画像認識装置

Country Status (10)

Country Link
US (1) US9288381B2 (enExample)
EP (1) EP2879370B1 (enExample)
JP (1) JP6126094B2 (enExample)
CN (1) CN104509090B (enExample)
BR (1) BR112015001872B1 (enExample)
IN (1) IN2015KN00489A (enExample)
MX (1) MX341857B (enExample)
MY (1) MY184347A (enExample)
RU (1) RU2573110C1 (enExample)
WO (1) WO2014017403A1 (enExample)

Families Citing this family (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014007175A1 (ja) * 2012-07-03 2014-01-09 クラリオン株式会社 車載環境認識装置
US9445057B2 (en) * 2013-02-20 2016-09-13 Magna Electronics Inc. Vehicle vision system with dirt detection
WO2015008566A1 (ja) * 2013-07-18 2015-01-22 クラリオン株式会社 車載装置
JP6380843B2 (ja) * 2013-12-19 2018-08-29 株式会社リコー 物体検出装置及びこれを備えた移動体機器制御システム並びに物体検出用プログラム
US10013616B2 (en) * 2014-05-27 2018-07-03 Robert Bosch Gmbh Detection, identification, and mitigation of lens contamination for vehicle mounted camera systems
CN104299244B (zh) * 2014-09-26 2017-07-25 东软集团股份有限公司 基于单目相机的障碍物检测方法及装置
KR102263731B1 (ko) 2014-11-11 2021-06-11 현대모비스 주식회사 주변차량의 위치정보 보정 시스템 및 방법
JP6476921B2 (ja) * 2015-01-29 2019-03-06 住友電気工業株式会社 危険車両検知システム及び車載情報処理装置
KR101757263B1 (ko) * 2015-07-08 2017-07-12 현대자동차주식회사 근거리 물체 감지 장치 및 방법과 이를 이용한 차량
JP6644509B2 (ja) * 2015-10-01 2020-02-12 アルパイン株式会社 車両検知警報装置および車両検知警報方法
SE541846C2 (en) 2016-02-10 2019-12-27 Scania Cv Ab Method and control unit for rear view
US11176698B2 (en) 2016-03-30 2021-11-16 Nec Corporation Analysis apparatus, analysis method, and storage medium
US10904409B2 (en) * 2016-07-27 2021-01-26 Kyocera Corporation Detection apparatus, imaging apparatus, moveable body, and detection method
EP3306523A1 (en) * 2016-10-06 2018-04-11 Continental Automotive GmbH Device for determining a glare situation caused by a transparent screen of a vehicle
EP3306522A1 (en) * 2016-10-06 2018-04-11 Continental Automotive GmbH Device for determining a region of interest on and/or within a vehicle windscreen
JP6755161B2 (ja) * 2016-10-24 2020-09-16 株式会社デンソーテン 付着物検出装置および付着物検出方法
US11034295B2 (en) * 2017-02-02 2021-06-15 Magna Electronics Inc. Vehicle vision system using at least two cameras
JP7112181B2 (ja) * 2017-03-24 2022-08-03 株式会社Screenホールディングス 画像処理方法および画像処理装置
JP6832224B2 (ja) * 2017-04-28 2021-02-24 株式会社デンソーテン 付着物検出装置および付着物検出方法
CN107317700B (zh) * 2017-06-09 2020-06-30 湖北理工学院 车载边缘计算节点选择系统及方法
JP6772113B2 (ja) * 2017-08-02 2020-10-21 クラリオン株式会社 付着物検出装置、および、それを備えた車両システム
JP6996200B2 (ja) * 2017-09-29 2022-01-17 富士通株式会社 画像処理方法、画像処理装置、および画像処理プログラム
EP3483781B1 (en) * 2017-11-13 2021-10-06 Continental Automotive GmbH Device for detecting windshield blockage
JP7210882B2 (ja) * 2018-01-30 2023-01-24 株式会社デンソーテン 付着物検出装置および付着物検出方法
US10691957B2 (en) * 2018-02-12 2020-06-23 ITS Plus, Inc. Method for increasing the accuracy of traffic cameras using optical masking technology
JP7163766B2 (ja) * 2018-12-28 2022-11-01 株式会社デンソーテン 付着物検出装置および付着物検出方法
JP7234630B2 (ja) * 2018-12-28 2023-03-08 株式会社デンソーテン 付着物検出装置
JP2020109541A (ja) * 2018-12-28 2020-07-16 株式会社デンソーテン 付着物検出装置および付着物検出方法
US11257375B2 (en) * 2018-12-31 2022-02-22 Ficosa Adas, S.L.U. Method and system for detecting objects in a vehicle blind spot
US10943129B2 (en) 2019-01-04 2021-03-09 Ford Global Technologies, Llc Low-light sensor cleaning
CN111583169A (zh) * 2019-01-30 2020-08-25 杭州海康威视数字技术股份有限公司 一种车载相机镜头的污染处理方法及系统
CN113632450B (zh) * 2019-03-26 2023-07-04 株式会社小糸制作所 摄影系统及图像处理装置
WO2020230237A1 (ja) * 2019-05-13 2020-11-19 日本電信電話株式会社 交通流推定装置、交通流推定方法、交通流推定プログラムおよび交通流推定プログラムを記憶した記憶媒体
JP7151675B2 (ja) * 2019-09-20 2022-10-12 株式会社デンソーテン 付着物検出装置および付着物検出方法
JP7200894B2 (ja) * 2019-09-20 2023-01-10 株式会社デンソーテン 付着物検出装置および付着物検出方法
GB2588655B (en) * 2019-10-31 2022-08-17 Jaguar Land Rover Ltd Control system and method for a vehicle
CN111405177B (zh) * 2020-03-09 2021-09-24 Oppo广东移动通信有限公司 图像处理方法、终端及计算机可读存储介质
WO2021191998A1 (ja) * 2020-03-24 2021-09-30 株式会社日立国際電気 監視システム及びカメラ
CN111443490B (zh) * 2020-04-15 2022-11-18 杭州赶梦科技有限公司 一种ar hud的虚像显示区域调节方法
CN115578669A (zh) * 2022-09-21 2023-01-06 浙江大华技术股份有限公司 一种相机镜头异物的识别方法及装置

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS6369650U (enExample) * 1986-10-27 1988-05-11
JP3734512B2 (ja) * 1993-12-27 2006-01-11 株式会社メニコン コンタクトレンズ外観検査方法および外観検査装置
JP2001052185A (ja) * 1999-08-13 2001-02-23 Mitsubishi Precision Co Ltd 車両検出方法および車両検出装置
JP3651387B2 (ja) * 2000-11-22 2005-05-25 日産自動車株式会社 白線検出装置
JP2003044863A (ja) 2001-07-30 2003-02-14 Nissan Motor Co Ltd 仕切線認識装置
JP3756452B2 (ja) * 2002-01-18 2006-03-15 本田技研工業株式会社 赤外線画像処理装置
JP2004153422A (ja) * 2002-10-29 2004-05-27 Toshiba Corp 撮影装置、顔照合装置、撮影装置の汚れ検知方法、及び顔照合方法
JP3987048B2 (ja) * 2003-03-20 2007-10-03 本田技研工業株式会社 車両周辺監視装置
US7340767B2 (en) * 2003-06-26 2008-03-04 Matsushita Electric Industrial Co, Ltd. Camera apparatus, image server and image server system
RU2286267C2 (ru) * 2004-11-09 2006-10-27 Аркадий Вениаминович Дубровский Система зеркал транспортного средства
JP2007318355A (ja) 2006-05-24 2007-12-06 Matsushita Electric Ind Co Ltd 撮像装置およびレンズ汚れ検出方法
JP2008064630A (ja) * 2006-09-07 2008-03-21 Hitachi Ltd 付着物検知機能付き車載用撮像装置
WO2010038223A1 (en) * 2008-10-01 2010-04-08 Hi-Key Limited A method and a system for detecting the presence of an impediment on a lens of an image capture device to light passing through the lens of an image capture device
JP2012038048A (ja) 2010-08-06 2012-02-23 Alpine Electronics Inc 車両用障害物検出装置
KR101042302B1 (ko) * 2010-12-27 2011-06-17 위재영 차량 외부 영상 장치용 하우징
JP6120395B2 (ja) * 2012-07-03 2017-04-26 クラリオン株式会社 車載装置
WO2014007153A1 (ja) * 2012-07-03 2014-01-09 クラリオン株式会社 車両周囲監視装置

Also Published As

Publication number Publication date
EP2879370A4 (en) 2016-05-11
US20150201120A1 (en) 2015-07-16
JPWO2014017403A1 (ja) 2016-07-11
WO2014017403A1 (ja) 2014-01-30
US9288381B2 (en) 2016-03-15
MX341857B (es) 2016-09-05
MY184347A (en) 2021-04-01
RU2573110C1 (ru) 2016-01-20
EP2879370B1 (en) 2020-09-02
EP2879370A1 (en) 2015-06-03
IN2015KN00489A (enExample) 2015-07-17
BR112015001872A2 (pt) 2017-08-08
MX2015001004A (es) 2015-11-23
CN104509090A (zh) 2015-04-08
CN104509090B (zh) 2016-08-24
BR112015001872B1 (pt) 2021-11-03

Similar Documents

Publication Publication Date Title
JP6126094B2 (ja) 車載用画像認識装置
CN104508727B (zh) 三维物体检测装置和三维物体检测方法
JP6174975B2 (ja) 周囲環境認識装置
JP5997276B2 (ja) 立体物検出装置及び異物検出装置
JP5787024B2 (ja) 立体物検出装置
JP6117634B2 (ja) レンズ付着物検知装置、レンズ付着物検知方法、および、車両システム
JP5776795B2 (ja) 立体物検出装置
JP5902049B2 (ja) レンズ白濁状態診断装置
EP2879385B1 (en) Three-dimensional object detection device and three-dimensional object detection method
CN104115188A (zh) 立体物检测装置
JP5743020B2 (ja) 立体物検出装置
JP6003986B2 (ja) 立体物検出装置、立体物検出方法及び異物検出装置
JP5835459B2 (ja) 立体物検出装置
JP6011110B2 (ja) 立体物検出装置および立体物検出方法
JP6020568B2 (ja) 立体物検出装置および立体物検出方法
Basu et al. Night Time Vehicle Detection for Adaptive Beam and Collision Avoidance Systems

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20160407

RD02 Notification of acceptance of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7422

Effective date: 20160407

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20170110

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20170228

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20170404

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20170406

R150 Certificate of patent or registration of utility model

Ref document number: 6126094

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

S533 Written request for registration of change of name

Free format text: JAPANESE INTERMEDIATE CODE: R313533

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313117

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

R370 Written measure of declining of transfer procedure

Free format text: JAPANESE INTERMEDIATE CODE: R370

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313117

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350