JP7262021B2 - 奥行取得装置、奥行取得方法およびプログラム - Google Patents

奥行取得装置、奥行取得方法およびプログラム Download PDF

Info

Publication number
JP7262021B2
JP7262021B2 JP2020548353A JP2020548353A JP7262021B2 JP 7262021 B2 JP7262021 B2 JP 7262021B2 JP 2020548353 A JP2020548353 A JP 2020548353A JP 2020548353 A JP2020548353 A JP 2020548353A JP 7262021 B2 JP7262021 B2 JP 7262021B2
Authority
JP
Japan
Prior art keywords
image
depth
flare
region
infrared
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020548353A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2020059565A1 (ja
Inventor
智 佐藤
健夫 吾妻
信彦 若井
康介 吉岡
規貴 清水
良直 河合
高明 天田
陽子 川合
猛 村井
宏樹 竹内
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Intellectual Property Management Co Ltd
Original Assignee
Panasonic Intellectual Property Management Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Panasonic Intellectual Property Management Co Ltd filed Critical Panasonic Intellectual Property Management Co Ltd
Publication of JPWO2020059565A1 publication Critical patent/JPWO2020059565A1/ja
Priority to JP2023053739A priority Critical patent/JP7745176B2/ja
Application granted granted Critical
Publication of JP7262021B2 publication Critical patent/JP7262021B2/ja
Priority to JP2024205989A priority patent/JP2025023015A/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C3/00—Measuring distances in line of sight; Optical rangefinders
    • G01C3/02—Details
    • G01C3/06—Use of electric means to obtain final indication
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06—Systems determining position data of a target
    • G01S17/46—Indirect determination of position data
    • G01S17/48—Active triangulation systems, i.e. using the transmission and reflection of electromagnetic waves other than radio waves
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88—Lidar systems specially adapted for specific applications
    • G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/77—Retouching; Inpainting; Scratch removal
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/521—Depth or shape recovery from laser ranging, e.g. using interferometry; from the projection of structured light
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/571—Depth or shape recovery from multiple images from focus
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H04N23/11—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths for generating image signals from visible and infrared light wavelengths
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H04N23/81—Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/61—Noise processing, e.g. detecting, correcting, reducing or removing noise the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/2224—Studio circuitry; Studio devices; Studio equipment related to virtual studio applications
    • H04N5/2226—Determination of depth image, e.g. for foreground/background separation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10048—Infrared image

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Optics & Photonics (AREA)
  • Measurement Of Optical Distance (AREA)
  • Image Analysis (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Traffic Control Systems (AREA)
  • Optical Radar Systems And Details Thereof (AREA)
  • Studio Devices (AREA)
JP2020548353A 2018-09-18 2019-09-09 奥行取得装置、奥行取得方法およびプログラム Active JP7262021B2 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2023053739A JP7745176B2 (ja) 2018-09-18 2023-03-29 撮像装置および撮像方法
JP2024205989A JP2025023015A (ja) 2018-09-18 2024-11-27 情報処理方法、情報処理装置、およびプログラム

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2018174277 2018-09-18
JP2018174277 2018-09-18
PCT/JP2019/035420 WO2020059565A1 (ja) 2018-09-18 2019-09-09 奥行取得装置、奥行取得方法およびプログラム

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2023053739A Division JP7745176B2 (ja) 2018-09-18 2023-03-29 撮像装置および撮像方法

Publications (2)

Publication Number Publication Date
JPWO2020059565A1 JPWO2020059565A1 (ja) 2021-09-16
JP7262021B2 true JP7262021B2 (ja) 2023-04-21

Family

ID=69887442

Family Applications (3)

Application Number Title Priority Date Filing Date
JP2020548353A Active JP7262021B2 (ja) 2018-09-18 2019-09-09 奥行取得装置、奥行取得方法およびプログラム
JP2023053739A Active JP7745176B2 (ja) 2018-09-18 2023-03-29 撮像装置および撮像方法
JP2024205989A Pending JP2025023015A (ja) 2018-09-18 2024-11-27 情報処理方法、情報処理装置、およびプログラム

Family Applications After (2)

Application Number Title Priority Date Filing Date
JP2023053739A Active JP7745176B2 (ja) 2018-09-18 2023-03-29 撮像装置および撮像方法
JP2024205989A Pending JP2025023015A (ja) 2018-09-18 2024-11-27 情報処理方法、情報処理装置、およびプログラム

Country Status (5)

Country Link
US (3) US11636615B2 (enExample)
EP (2) EP3855395B1 (enExample)
JP (3) JP7262021B2 (enExample)
CN (2) CN120339355A (enExample)
WO (1) WO2020059565A1 (enExample)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110136183B (zh) * 2018-02-09 2021-05-18 华为技术有限公司 一种图像处理的方法、装置以及摄像装置
CN120339355A (zh) * 2018-09-18 2025-07-18 松下知识产权经营株式会社 信息处理方法、信息处理装置以及计算机程序产品
EP3925510B1 (en) * 2019-03-28 2024-09-04 Sony Group Corporation Signal processing device, signal processing method, program and medical image processing system
KR20210128803A (ko) 2020-04-17 2021-10-27 삼성전자주식회사 다중 포토다이오드 센서에 의해 획득된 서브 이미지들의 차이에 기반하여 이미지의 결함을 검출하는 전자 장치 및 이의 동작 방법
EP4149104A4 (en) * 2020-05-08 2023-10-25 Sony Semiconductor Solutions Corporation ELECTRONIC DEVICE AND IMAGING DEVICE
CN114066785B (zh) * 2020-07-31 2025-05-23 北京小米移动软件有限公司 图像处理方法及装置、终端和存储介质
US11715195B2 (en) * 2021-03-22 2023-08-01 International Business Machines Corporation Machine learning-based circuit board inspection
JP6966011B1 (ja) * 2021-03-23 2021-11-10 株式会社リコー 撮像装置、撮像方法および情報処理装置
EP4315247A1 (en) * 2021-03-23 2024-02-07 Ricoh Company, Ltd. Imaging device, imaging method, and information processing device
CN113034915B (zh) * 2021-03-29 2023-06-20 北京卓视智通科技有限责任公司 一种双光谱交通事件检测方法及装置
US12393021B2 (en) * 2021-03-31 2025-08-19 Teledyne Flir Commercial Systems, Inc. Optical components for ghost image suppression systems and methods
CN113222922B (zh) * 2021-04-30 2024-02-27 杭州海康威视数字技术股份有限公司 红外爆闪灯补光范围检测方法、装置及设备
CN113643244B (zh) * 2021-07-23 2024-05-21 中国资源卫星应用中心 一种光学遥感卫星影像水体耀斑快速检测方法
JP2023037966A (ja) * 2021-09-06 2023-03-16 株式会社デンソー フレア検出システム、フレア検出装置、フレア検出方法、フレア検出プログラム
US20250024145A1 (en) * 2021-12-09 2025-01-16 Sony Group Corporation Information processing device, information processing method, and program

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011257956A (ja) 2010-06-08 2011-12-22 Toyota Motor Corp 周辺状況認識装置

Family Cites Families (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0282876A (ja) 1988-09-20 1990-03-23 Sony Corp カラーモード・赤外モード共用ビデオカメラ
EP1528797B1 (en) * 2003-10-31 2015-07-08 Canon Kabushiki Kaisha Image processing apparatus, image-taking system and image processing method
JP4939901B2 (ja) * 2006-11-02 2012-05-30 富士フイルム株式会社 距離画像生成方法及びその装置
US7808512B1 (en) * 2006-12-19 2010-10-05 Nvidia Corporation Bounding region accumulation for graphics rendering
JP5448617B2 (ja) * 2008-08-19 2014-03-19 パナソニック株式会社 距離推定装置、距離推定方法、プログラム、集積回路およびカメラ
JP5743390B2 (ja) 2009-09-15 2015-07-01 本田技研工業株式会社 測距装置、及び測距方法
JP2011103070A (ja) 2009-11-11 2011-05-26 Toyota Motor Corp 夜間車両検知装置
JP5842808B2 (ja) * 2010-02-20 2016-01-13 株式会社ニコン 瞳強度分布を調整する方法
JP5539123B2 (ja) * 2010-08-31 2014-07-02 キヤノン株式会社 眼科撮影装置および眼科撮影装置を用いた撮影方法
JP2012068762A (ja) * 2010-09-21 2012-04-05 Sony Corp 検出装置、検出方法、プログラム、及び電子機器
CN103477186B (zh) * 2011-04-07 2016-01-27 松下知识产权经营株式会社 立体摄像装置
US9378542B2 (en) * 2011-09-28 2016-06-28 The United States Of America As Represented By The Secretary Of The Army System and processor implemented method for improved image quality and generating an image of a target illuminated by quantum particles
WO2013179539A1 (ja) * 2012-05-28 2013-12-05 パナソニック株式会社 画像処理装置、撮像装置、画像処理方法、およびプログラム
WO2014174765A1 (ja) * 2013-04-26 2014-10-30 コニカミノルタ株式会社 撮像装置および撮像方法
JP2015185947A (ja) * 2014-03-20 2015-10-22 株式会社東芝 撮像システム
JP2016004017A (ja) * 2014-06-19 2016-01-12 ダブル技研株式会社 情報取得装置及び画像処理方法
JP6394338B2 (ja) * 2014-12-04 2018-09-26 ソニー株式会社 画像処理装置、画像処理方法、及び撮像システム
JP6528193B2 (ja) 2015-02-10 2019-06-12 任天堂株式会社 電子機器
US9804667B2 (en) 2015-02-10 2017-10-31 Nintendo Co., Ltd. Electronic apparatus
WO2016158196A1 (ja) * 2015-03-31 2016-10-06 富士フイルム株式会社 撮像装置及び撮像装置の画像処理方法及びプログラム
JP6563243B2 (ja) * 2015-04-28 2019-08-21 マクセル株式会社 撮像装置及びカメラシステム
CN106296621B (zh) * 2015-05-22 2019-08-23 腾讯科技（深圳）有限公司 图像处理方法和装置
JP2017067503A (ja) * 2015-09-28 2017-04-06 富士通株式会社 位置推定装置、位置推定方法、及び位置推定プログラム
JP6624939B2 (ja) * 2016-01-14 2019-12-25 キヤノン株式会社 画像処理装置、撮像装置および画像処理プログラム
US9928592B2 (en) * 2016-03-14 2018-03-27 Sensors Unlimited, Inc. Image-based signal detection for object metrology
KR20170107269A (ko) * 2016-03-15 2017-09-25 한국전자통신연구원 Rgbd 카메라의 깊이 영상 필터링 장치 및 방법
WO2017159312A1 (ja) * 2016-03-15 2017-09-21 ソニー株式会社 画像処理装置、撮像装置、および画像処理方法、並びにプログラム
US10841491B2 (en) * 2016-03-16 2020-11-17 Analog Devices, Inc. Reducing power consumption for time-of-flight depth imaging
CN107438148B (zh) 2016-05-27 2021-08-24 松下知识产权经营株式会社 摄像系统
US10712561B2 (en) * 2016-11-04 2020-07-14 Microsoft Technology Licensing, Llc Interference mitigation via adaptive depth imaging
US10445928B2 (en) * 2017-02-11 2019-10-15 Vayavision Ltd. Method and system for generating multidimensional maps of a scene using a plurality of sensors of various types
US10924670B2 (en) * 2017-04-14 2021-02-16 Yang Liu System and apparatus for co-registration and correlation between multi-modal imagery and method for same
US10791283B2 (en) * 2017-09-01 2020-09-29 Facebook Technologies, Llc Imaging device based on lens assembly with embedded filter
US10607352B2 (en) * 2018-05-17 2020-03-31 Microsoft Technology Licensing, Llc Reduced power operation of time-of-flight camera
TWI689892B (zh) * 2018-05-18 2020-04-01 瑞昱半導體股份有限公司 基於前景影像的背景虛化方法與電子裝置
US10848693B2 (en) * 2018-07-18 2020-11-24 Apple Inc. Image flare detection using asymmetric pixels
US10382712B1 (en) * 2018-08-01 2019-08-13 Qualcomm Incorporated Automatic removal of lens flares from images
CN120339355A (zh) * 2018-09-18 2025-07-18 松下知识产权经营株式会社 信息处理方法、信息处理装置以及计算机程序产品
US11158074B1 (en) * 2018-10-02 2021-10-26 Facebook Technologies, Llc Depth sensing using temporal coding

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011257956A (ja) 2010-06-08 2011-12-22 Toyota Motor Corp 周辺状況認識装置

Also Published As

Publication number Publication date
JP2025023015A (ja) 2025-02-14
JP2023100611A (ja) 2023-07-19
US20210150742A1 (en) 2021-05-20
US12361579B2 (en) 2025-07-15
US20230215029A1 (en) 2023-07-06
CN112534474B (zh) 2025-05-09
CN112534474A (zh) 2021-03-19
CN120339355A (zh) 2025-07-18
EP4390835A3 (en) 2024-09-11
WO2020059565A1 (ja) 2020-03-26
EP3855395B1 (en) 2024-05-15
US20240303845A1 (en) 2024-09-12
US11636615B2 (en) 2023-04-25
EP3855395A4 (en) 2022-03-02
EP3855395A1 (en) 2021-07-28
JPWO2020059565A1 (ja) 2021-09-16
JP7745176B2 (ja) 2025-09-29
US12026904B2 (en) 2024-07-02
EP4390835A2 (en) 2024-06-26

Similar Documents

Publication Publication Date Title
JP7262021B2 (ja) 奥行取得装置、奥行取得方法およびプログラム
JP7624611B2 (ja) 撮像装置、情報処理装置、撮像方法およびプログラム
CN112513677B (zh) 纵深取得装置、纵深取得方法以及记录介质
JP7281775B2 (ja) 奥行取得装置、奥行取得方法およびプログラム
US10354413B2 (en) Detection system and picture filtering method thereof
US10803625B2 (en) Detection system and picturing filtering method thereof
JP5754931B2 (ja) 画像解析装置、画像解析方法及びプログラム
JP6565513B2 (ja) 色補正装置、色補正方法及び色補正用コンピュータプログラム
JP7792618B2 (ja) 情報処理方法、情報処理装置、およびプログラム
TW202314643A (zh) 自動搜尋多灰階感興趣區域的方法與系統

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210113

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220620

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20230228

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20230329

R151 Written notification of patent or utility model registration

Ref document number: 7262021

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151