KR20230156326A - 다중-센서 이미지 캡처 디바이스들을 위한 변환 행렬 학습 - Google Patents

다중-센서 이미지 캡처 디바이스들을 위한 변환 행렬 학습 Download PDF

Info

Publication number
KR20230156326A
KR20230156326A KR1020237029705A KR20237029705A KR20230156326A KR 20230156326 A KR20230156326 A KR 20230156326A KR 1020237029705 A KR1020237029705 A KR 1020237029705A KR 20237029705 A KR20237029705 A KR 20237029705A KR 20230156326 A KR20230156326 A KR 20230156326A
Authority
KR
South Korea
Prior art keywords
determining
image frame
image sensor
image
disparity
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
KR1020237029705A
Other languages
English (en)
Korean (ko)
Inventor
시종 리우
진청 황
웨이량 리우
지안펑 렌
벤카테쉬 사훌 마다나야카날리 파니라즈
Original Assignee
퀄컴 인코포레이티드
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 퀄컴 인코포레이티드 filed Critical 퀄컴 인코포레이티드
Publication of KR20230156326A publication Critical patent/KR20230156326A/ko
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/18—Image warping, e.g. rearranging pixels individually
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/80—Geometric correction
    • G06T5/006—
    • G06T3/0012—
    • G06T3/0093—
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/04—Context-preserving transformations, e.g. by using an importance map
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/521—Depth or shape recovery from laser ranging, e.g. using interferometry; from the projection of structured light
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/571—Depth or shape recovery from multiple images from focus
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/268—Signal distribution or switching
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20076—Probabilistic image processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20172—Image enhancement details
    • G06T2207/20208—High dynamic range [HDR] image processing

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Optics & Photonics (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)
  • Focusing (AREA)
  • Automatic Focus Adjustment (AREA)
  • Image Analysis (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Geometry (AREA)
KR1020237029705A 2021-03-15 2022-03-03 다중-센서 이미지 캡처 디바이스들을 위한 변환 행렬 학습 Pending KR20230156326A (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US17/201,660 2021-03-15
US17/201,660 US11908100B2 (en) 2021-03-15 2021-03-15 Transform matrix learning for multi-sensor image capture devices
PCT/US2022/070948 WO2022198168A1 (en) 2021-03-15 2022-03-03 Transform matrix learning for multi-sensor image capture devices

Publications (1)

Publication Number Publication Date
KR20230156326A true KR20230156326A (ko) 2023-11-14

Family

ID=80820105

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020237029705A Pending KR20230156326A (ko) 2021-03-15 2022-03-03 다중-센서 이미지 캡처 디바이스들을 위한 변환 행렬 학습

Country Status (7)

Country Link
US (1) US11908100B2 (cg-RX-API-DMAC7.html)
EP (1) EP4309114A1 (cg-RX-API-DMAC7.html)
JP (1) JP7886889B2 (cg-RX-API-DMAC7.html)
KR (1) KR20230156326A (cg-RX-API-DMAC7.html)
CN (1) CN116940961B (cg-RX-API-DMAC7.html)
BR (1) BR112023017974A2 (cg-RX-API-DMAC7.html)
WO (1) WO2022198168A1 (cg-RX-API-DMAC7.html)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022245177A1 (en) * 2021-05-20 2022-11-24 Samsung Electronics Co., Ltd. Method and electronic device for obtaining reconstructed image
US12315182B2 (en) * 2022-02-02 2025-05-27 Rapyuta Robotics Co., Ltd. Apparatus and a method for estimating depth of a scene
US12670622B2 (en) * 2024-03-08 2026-06-30 Caterpillar Inc. System and methods for mitigating sensor interference using on-sensor field-of-view analytics
CN120751252B (zh) * 2024-08-21 2026-08-04 荣耀终端股份有限公司 图像处理方法及其相关设备

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008053787A (ja) * 2006-08-22 2008-03-06 Hitachi Maxell Ltd 多眼電子カメラ及び多眼電子カメラの視差補正方法
KR20080081693A (ko) * 2007-03-06 2008-09-10 삼성전자주식회사 카메라의 자동초점조절 방법
CN102075779B (zh) * 2011-02-21 2013-05-08 北京航空航天大学 一种基于块匹配视差估计的中间视图合成方法
WO2013099169A1 (ja) * 2011-12-27 2013-07-04 パナソニック株式会社 ステレオ撮影装置
US9113142B2 (en) * 2012-01-06 2015-08-18 Thomson Licensing Method and device for providing temporally consistent disparity estimations
WO2013109252A1 (en) * 2012-01-17 2013-07-25 Thomson Licensing Generating an image for another view
JP6668594B2 (ja) 2014-02-25 2020-03-18 株式会社リコー 視差演算システム、情報処理装置、情報処理方法及びプログラム
CN107924572B (zh) * 2015-04-17 2021-06-15 快图有限公司 使用阵列相机执行高速视频捕获和深度估计的系统和方法
GB2553782B (en) * 2016-09-12 2021-10-20 Niantic Inc Predicting depth from image data using a statistical model
CN111476837B (zh) * 2019-01-23 2023-02-24 上海科技大学 自适应立体匹配优化方法及其装置、设备和存储介质
US11315328B2 (en) * 2019-03-18 2022-04-26 Facebook Technologies, Llc Systems and methods of rendering real world objects using depth information
JP7180783B2 (ja) * 2019-07-26 2022-11-30 オムロン株式会社 コンピュータビジョンシステムのキャリブレーション方法及びこれに用いる基準立体物
US11816855B2 (en) * 2020-02-11 2023-11-14 Samsung Electronics Co., Ltd. Array-based depth estimation
CN111464804A (zh) * 2020-04-08 2020-07-28 北京小米松果电子有限公司 一种全向视差视图合成方法、装置及存储介质
US11490067B2 (en) * 2020-08-07 2022-11-01 Owl Autonomous Imaging, Inc. Multi-aperture ranging devices and methods
TWI790471B (zh) * 2020-08-26 2023-01-21 財團法人工業技術研究院 基於深度學習的影像校正方法及系統

Also Published As

Publication number Publication date
BR112023017974A2 (pt) 2023-10-03
WO2022198168A1 (en) 2022-09-22
EP4309114A1 (en) 2024-01-24
US20220292630A1 (en) 2022-09-15
CN116940961B (zh) 2026-06-23
TW202239190A (zh) 2022-10-01
JP2024510128A (ja) 2024-03-06
JP7886889B2 (ja) 2026-07-08
CN116940961A (zh) 2023-10-24
US11908100B2 (en) 2024-02-20

Similar Documents

Publication Publication Date Title
US11908100B2 (en) Transform matrix learning for multi-sensor image capture devices
KR102213744B1 (ko) 선명하고 정확한 주밍 메커니즘 구현을 위한 광각 이미지 캡쳐링 요소 및 장초점 이미지 캡쳐링 요소의 활용방법
CN108419023B (zh) 一种生成高动态范围图像的方法以及相关设备
WO2020037959A1 (en) Image processing method, image processing apparatus, electronic device and storage medium
CN104219436B (zh) 光学装置及其控制方法
US20220286611A1 (en) Electrical image stabilization (eis)-assisted digital image stabilization (dis)
CN112889068A (zh) 用于图像处理的神经网络对象识别的方法和系统
KR20170074538A (ko) 타임랩스 영상을 생성하는 장치 및 방법
CN106257917B (zh) 曝光控制装置和曝光控制方法
US11810275B2 (en) Temporal filtering restart for improved scene integrity
US20150062410A1 (en) Image stabilization method and electronic device therefor
US9111129B2 (en) Subject detecting method and apparatus, and digital photographing apparatus
CN116368814A (zh) 无fov损失的空间对准变换
CN119137968B (zh) 用于图像处理的方法、装置、介质和产品
KR20240001131A (ko) 계산적 사진촬영을 위한 이미지 정렬
US20110242346A1 (en) Compound eye photographing method and apparatus
KR20240031246A (ko) 다수의 관심 영역들을 갖는 장면들에서 선택적으로 증가하는 피사계 심도
CN115314635B (zh) 用于离焦量确定的模型训练方法及装置
TW202345086A (zh) 可變光圈(va)相機系統中的散景效果
US20220277585A1 (en) Image processing device and control method thereof, imaging apparatus, and recording medium
US20250142215A1 (en) Precise field-of-view transitions with autofocus for variable optical zoom systems
WO2024263152A1 (en) Learning-based camera autofocus prediction for sparse phase detection imaging sensors
WO2024048069A1 (ja) 情報処理装置、情報処理方法およびプログラム
CN117750215A (zh) 拍摄参数更新方法和电子设备
CN121548837A (zh) 用于处理高位深图像的位分割

Legal Events

Date Code Title Description
PA0105 International application

Patent event date: 20230831

Patent event code: PA01051R01D

Comment text: International Patent Application

PG1501 Laying open of application
A201 Request for examination
PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20250217

Comment text: Request for Examination of Application