JP7886889B2 - マルチセンサー画像キャプチャデバイスのための変換行列学習 - Google Patents

マルチセンサー画像キャプチャデバイスのための変換行列学習

Info

Publication number
JP7886889B2
JP7886889B2 JP2023552555A JP2023552555A JP7886889B2 JP 7886889 B2 JP7886889 B2 JP 7886889B2 JP 2023552555 A JP2023552555 A JP 2023552555A JP 2023552555 A JP2023552555 A JP 2023552555A JP 7886889 B2 JP7886889 B2 JP 7886889B2
Authority
JP
Japan
Prior art keywords
image
image sensor
determining
disparity
depth
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2023552555A
Other languages
English (en)
Japanese (ja)
Other versions
JP2024510128A5 (cg-RX-API-DMAC7.html
JP2024510128A (ja
Inventor
シジョン・リュウ
ジンチェン・ファン
ウェイリアン・リュウ
ジャンフェン・レン
サフル・マダナヤカナハッリ・ファニラジ・ベンカテシュ
Original Assignee
クアルコム,インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by クアルコム,インコーポレイテッド filed Critical クアルコム,インコーポレイテッド
Publication of JP2024510128A publication Critical patent/JP2024510128A/ja
Publication of JP2024510128A5 publication Critical patent/JP2024510128A5/ja
Application granted granted Critical
Publication of JP7886889B2 publication Critical patent/JP7886889B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/80—Geometric correction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/18—Image warping, e.g. rearranging pixels individually
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/04—Context-preserving transformations, e.g. by using an importance map
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/521—Depth or shape recovery from laser ranging, e.g. using interferometry; from the projection of structured light
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/571—Depth or shape recovery from multiple images from focus
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/268—Signal distribution or switching
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20076—Probabilistic image processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20172—Image enhancement details
    • G06T2207/20208—High dynamic range [HDR] image processing

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Optics & Photonics (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)
  • Focusing (AREA)
  • Automatic Focus Adjustment (AREA)
  • Image Analysis (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Geometry (AREA)
JP2023552555A 2021-03-15 2022-03-03 マルチセンサー画像キャプチャデバイスのための変換行列学習 Active JP7886889B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US17/201,660 2021-03-15
US17/201,660 US11908100B2 (en) 2021-03-15 2021-03-15 Transform matrix learning for multi-sensor image capture devices
PCT/US2022/070948 WO2022198168A1 (en) 2021-03-15 2022-03-03 Transform matrix learning for multi-sensor image capture devices

Publications (3)

Publication Number Publication Date
JP2024510128A JP2024510128A (ja) 2024-03-06
JP2024510128A5 JP2024510128A5 (cg-RX-API-DMAC7.html) 2025-02-26
JP7886889B2 true JP7886889B2 (ja) 2026-07-08

Family

ID=80820105

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2023552555A Active JP7886889B2 (ja) 2021-03-15 2022-03-03 マルチセンサー画像キャプチャデバイスのための変換行列学習

Country Status (7)

Country Link
US (1) US11908100B2 (cg-RX-API-DMAC7.html)
EP (1) EP4309114A1 (cg-RX-API-DMAC7.html)
JP (1) JP7886889B2 (cg-RX-API-DMAC7.html)
KR (1) KR20230156326A (cg-RX-API-DMAC7.html)
CN (1) CN116940961B (cg-RX-API-DMAC7.html)
BR (1) BR112023017974A2 (cg-RX-API-DMAC7.html)
WO (1) WO2022198168A1 (cg-RX-API-DMAC7.html)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022245177A1 (en) * 2021-05-20 2022-11-24 Samsung Electronics Co., Ltd. Method and electronic device for obtaining reconstructed image
US12315182B2 (en) * 2022-02-02 2025-05-27 Rapyuta Robotics Co., Ltd. Apparatus and a method for estimating depth of a scene
US12670622B2 (en) * 2024-03-08 2026-06-30 Caterpillar Inc. System and methods for mitigating sensor interference using on-sensor field-of-view analytics
CN120751252B (zh) * 2024-08-21 2026-08-04 荣耀终端股份有限公司 图像处理方法及其相关设备

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008053787A (ja) 2006-08-22 2008-03-06 Hitachi Maxell Ltd 多眼電子カメラ及び多眼電子カメラの視差補正方法
WO2013099169A1 (ja) 2011-12-27 2013-07-04 パナソニック株式会社 ステレオ撮影装置

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20080081693A (ko) * 2007-03-06 2008-09-10 삼성전자주식회사 카메라의 자동초점조절 방법
CN102075779B (zh) * 2011-02-21 2013-05-08 北京航空航天大学 一种基于块匹配视差估计的中间视图合成方法
US9113142B2 (en) * 2012-01-06 2015-08-18 Thomson Licensing Method and device for providing temporally consistent disparity estimations
WO2013109252A1 (en) * 2012-01-17 2013-07-25 Thomson Licensing Generating an image for another view
JP6668594B2 (ja) 2014-02-25 2020-03-18 株式会社リコー 視差演算システム、情報処理装置、情報処理方法及びプログラム
CN107924572B (zh) * 2015-04-17 2021-06-15 快图有限公司 使用阵列相机执行高速视频捕获和深度估计的系统和方法
GB2553782B (en) * 2016-09-12 2021-10-20 Niantic Inc Predicting depth from image data using a statistical model
CN111476837B (zh) * 2019-01-23 2023-02-24 上海科技大学 自适应立体匹配优化方法及其装置、设备和存储介质
US11315328B2 (en) * 2019-03-18 2022-04-26 Facebook Technologies, Llc Systems and methods of rendering real world objects using depth information
JP7180783B2 (ja) * 2019-07-26 2022-11-30 オムロン株式会社 コンピュータビジョンシステムのキャリブレーション方法及びこれに用いる基準立体物
US11816855B2 (en) * 2020-02-11 2023-11-14 Samsung Electronics Co., Ltd. Array-based depth estimation
CN111464804A (zh) * 2020-04-08 2020-07-28 北京小米松果电子有限公司 一种全向视差视图合成方法、装置及存储介质
US11490067B2 (en) * 2020-08-07 2022-11-01 Owl Autonomous Imaging, Inc. Multi-aperture ranging devices and methods
TWI790471B (zh) * 2020-08-26 2023-01-21 財團法人工業技術研究院 基於深度學習的影像校正方法及系統

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008053787A (ja) 2006-08-22 2008-03-06 Hitachi Maxell Ltd 多眼電子カメラ及び多眼電子カメラの視差補正方法
WO2013099169A1 (ja) 2011-12-27 2013-07-04 パナソニック株式会社 ステレオ撮影装置

Also Published As

Publication number Publication date
BR112023017974A2 (pt) 2023-10-03
WO2022198168A1 (en) 2022-09-22
EP4309114A1 (en) 2024-01-24
US20220292630A1 (en) 2022-09-15
CN116940961B (zh) 2026-06-23
KR20230156326A (ko) 2023-11-14
TW202239190A (zh) 2022-10-01
JP2024510128A (ja) 2024-03-06
CN116940961A (zh) 2023-10-24
US11908100B2 (en) 2024-02-20

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20250214

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20250214

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20260310

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20260501

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20260602

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20260626

R150 Certificate of patent or registration of utility model

Ref document number: 7886889

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150