JP6939580B2 - 車両用画像合成装置 - Google Patents

車両用画像合成装置 Download PDF

Info

Publication number
JP6939580B2
JP6939580B2 JP2018001883A JP2018001883A JP6939580B2 JP 6939580 B2 JP6939580 B2 JP 6939580B2 JP 2018001883 A JP2018001883 A JP 2018001883A JP 2018001883 A JP2018001883 A JP 2018001883A JP 6939580 B2 JP6939580 B2 JP 6939580B2
Authority
JP
Japan
Prior art keywords
image
boundary
similarity
camera
compositing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2018001883A
Other languages
English (en)
Japanese (ja)
Other versions
JP2019121270A5 (enExample
JP2019121270A (ja
Inventor
洋介 酒井
洋介 酒井
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Denso Corp
Original Assignee
Denso Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Denso Corp filed Critical Denso Corp
Priority to JP2018001883A priority Critical patent/JP6939580B2/ja
Priority to CN201880085804.2A priority patent/CN111566698A/zh
Priority to PCT/JP2018/045894 priority patent/WO2019138771A1/ja
Priority to DE112018006812.9T priority patent/DE112018006812T5/de
Publication of JP2019121270A publication Critical patent/JP2019121270A/ja
Publication of JP2019121270A5 publication Critical patent/JP2019121270A5/ja
Priority to US16/921,311 priority patent/US11270440B2/en
Application granted granted Critical
Publication of JP6939580B2 publication Critical patent/JP6939580B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/20—Processor architectures; Processor configuration, e.g. pipelining
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/12—Edge-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/136—Segmentation; Edge detection involving thresholding
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/174—Segmentation; Edge detection involving the use of two or more images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0818—Inactivity or incapacity of driver
    • B60W2040/0827—Inactivity or incapacity of driver due to sleepiness
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/32—Indexing scheme for image data processing or generation, in general involving image mosaicing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30268—Vehicle interior
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G06V10/16—Image acquisition using multiple overlapping images; Image stitching

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
JP2018001883A 2018-01-10 2018-01-10 車両用画像合成装置 Active JP6939580B2 (ja)

Priority Applications (5)

Application Number Priority Date Filing Date Title
JP2018001883A JP6939580B2 (ja) 2018-01-10 2018-01-10 車両用画像合成装置
CN201880085804.2A CN111566698A (zh) 2018-01-10 2018-12-13 车辆用图像合成装置
PCT/JP2018/045894 WO2019138771A1 (ja) 2018-01-10 2018-12-13 車両用画像合成装置
DE112018006812.9T DE112018006812T5 (de) 2018-01-10 2018-12-13 Fahrzeugbildsynthesevorrichtung
US16/921,311 US11270440B2 (en) 2018-01-10 2020-07-06 Vehicular image synthesis apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2018001883A JP6939580B2 (ja) 2018-01-10 2018-01-10 車両用画像合成装置

Publications (3)

Publication Number Publication Date
JP2019121270A JP2019121270A (ja) 2019-07-22
JP2019121270A5 JP2019121270A5 (enExample) 2020-05-28
JP6939580B2 true JP6939580B2 (ja) 2021-09-22

Family

ID=67218596

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018001883A Active JP6939580B2 (ja) 2018-01-10 2018-01-10 車両用画像合成装置

Country Status (5)

Country Link
US (1) US11270440B2 (enExample)
JP (1) JP6939580B2 (enExample)
CN (1) CN111566698A (enExample)
DE (1) DE112018006812T5 (enExample)
WO (1) WO2019138771A1 (enExample)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2023036288A (ja) * 2021-09-02 2023-03-14 豊田合成株式会社 操舵装置
JP7750206B2 (ja) * 2022-10-19 2025-10-07 トヨタ自動車株式会社 車室内状態認識装置

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3902473B2 (ja) * 2002-01-17 2007-04-04 富士通株式会社 生体情報を用いた本人認証方法
US7054857B2 (en) 2002-05-08 2006-05-30 Overture Services, Inc. Use of extensible markup language in a system and method for influencing a position on a search result list generated by a computer network search engine
JP2005202599A (ja) * 2004-01-14 2005-07-28 Advanced Telecommunication Research Institute International 居眠り防止装置
JP4380412B2 (ja) * 2004-05-10 2009-12-09 株式会社デンソー 撮像制御装置及びプログラム
JP4739870B2 (ja) 2005-09-05 2011-08-03 アイシン精機株式会社 サングラス検出装置及び顔中心位置検出装置
JP2007069680A (ja) 2005-09-05 2007-03-22 Toyota Motor Corp 顔画像撮影カメラの搭載構造
JP4606322B2 (ja) * 2005-12-27 2011-01-05 アルパイン株式会社 車両運転支援装置
JP2007328582A (ja) * 2006-06-08 2007-12-20 Matsushita Electric Ind Co Ltd 画像合成装置およびその方法
JP2008199515A (ja) * 2007-02-15 2008-08-28 Fujifilm Corp 同乗者着座姿勢検出・判定装置及び方法
JP2007234060A (ja) * 2007-05-31 2007-09-13 Advanced Telecommunication Research Institute International 居眠り防止装置
JP4981700B2 (ja) * 2008-01-29 2012-07-25 パナソニック株式会社 顔認証装置
WO2009116242A1 (ja) 2008-03-18 2009-09-24 パナソニック株式会社 運転者監視装置、運転者監視方法及び車両
JP2009011005A (ja) * 2008-10-10 2009-01-15 Panasonic Corp 画像処理装置
JP5256060B2 (ja) * 2009-01-23 2013-08-07 トヨタ自動車株式会社 撮像装置
JP5503660B2 (ja) * 2009-09-24 2014-05-28 パナソニック株式会社 運転支援表示装置
JP5419757B2 (ja) 2010-03-09 2014-02-19 セコム株式会社 顔画像合成装置
WO2014033886A1 (ja) * 2012-08-30 2014-03-06 富士通株式会社 画像処理装置、画像処理方法、及びプログラム
JP6024581B2 (ja) * 2013-04-15 2016-11-16 株式会社デンソー 車両用画像処理装置
JP6452235B2 (ja) * 2014-11-20 2019-01-16 国立大学法人静岡大学 顔検出方法、顔検出装置、及び顔検出プログラム
CN104590130A (zh) * 2015-01-06 2015-05-06 上海交通大学 基于图像识别的后视镜自适应调节方法
KR101730321B1 (ko) * 2015-08-03 2017-04-27 엘지전자 주식회사 운전자 보조 장치 및 그 제어방법
JP6594180B2 (ja) * 2015-11-25 2019-10-23 キヤノン株式会社 撮像装置、撮像装置の制御方法及びプログラム
JP6289439B2 (ja) * 2015-12-16 2018-03-07 オムロンオートモーティブエレクトロニクス株式会社 画像処理装置
KR101949358B1 (ko) * 2016-04-04 2019-02-18 엘지전자 주식회사 차량용 어라운드뷰 제공 장치 및 이를 구비한 차량
JP6809262B2 (ja) * 2017-02-08 2021-01-06 トヨタ自動車株式会社 ドライバ状態検出装置

Also Published As

Publication number Publication date
CN111566698A (zh) 2020-08-21
DE112018006812T5 (de) 2020-09-17
US11270440B2 (en) 2022-03-08
JP2019121270A (ja) 2019-07-22
US20200334822A1 (en) 2020-10-22
WO2019138771A1 (ja) 2019-07-18

Similar Documents

Publication Publication Date Title
JP4763250B2 (ja) 物体検出装置
JP5421072B2 (ja) 接近物体検知システム
US10620000B2 (en) Calibration apparatus, calibration method, and calibration program
US20100066516A1 (en) Image displaying in-vehicle system, image displaying control in-vehicle apparatus and computer readable medium comprising program for the same
JP6548900B2 (ja) 画像生成装置、画像生成方法及びプログラム
JP7000383B2 (ja) 画像処理装置および画像処理方法
JP7426174B2 (ja) 車両周囲画像表示システム及び車両周囲画像表示方法
US20060188130A1 (en) Apparatus and method for normalizing face image used for detecting drowsy driving
JP2014154898A (ja) 物体検知装置
JP6890288B2 (ja) 画像処理装置、画像表示システムおよび画像処理方法
JP6939580B2 (ja) 車両用画像合成装置
WO2018042976A1 (ja) 画像生成装置、画像生成方法、記録媒体、および画像表示システム
KR102429490B1 (ko) Bvm 영상 제공 기능을 가지는 svm 시스템 및 그 동작 방법
JP2010225089A (ja) 運転者監視装置
US10867400B2 (en) System for processing an image obtained by using stereo photography
JP6927167B2 (ja) 電子制御装置及び電子制御方法
US12333852B2 (en) Face detection device
EP2100772A2 (en) Imaging device and method thereof, as well as image processing device and method thereof
JP2017065351A (ja) 駐車支援装置及び駐車支援方法
JP2004334784A (ja) 確認動作検出装置及び警報システム
JP3858534B2 (ja) 眼の状態検出装置
JP2009044631A (ja) 物体検出装置
JP6781010B2 (ja) 画像表示装置及び画像処理方法
KR101659606B1 (ko) 뒷바퀴 위치 표시 차량 후진 영상 시스템의 영상 표시 방법
JP2017112566A (ja) パラメータ特定装置

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20200415

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20200415

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20201104

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20201223

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20210525

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210726

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20210803

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20210816

R151 Written notification of patent or utility model registration

Ref document number: 6939580

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250