KR20230156326A - 다중-센서 이미지 캡처 디바이스들을 위한 변환 행렬 학습 - Google Patents
다중-센서 이미지 캡처 디바이스들을 위한 변환 행렬 학습 Download PDFInfo
- Publication number
- KR20230156326A KR20230156326A KR1020237029705A KR20237029705A KR20230156326A KR 20230156326 A KR20230156326 A KR 20230156326A KR 1020237029705 A KR1020237029705 A KR 1020237029705A KR 20237029705 A KR20237029705 A KR 20237029705A KR 20230156326 A KR20230156326 A KR 20230156326A
- Authority
- KR
- South Korea
- Prior art keywords
- determining
- image frame
- image sensor
- image
- disparity
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/18—Image warping, e.g. rearranging pixels individually
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/80—Geometric correction
-
- G06T5/006—
-
- G06T3/0012—
-
- G06T3/0093—
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/04—Context-preserving transformations, e.g. by using an importance map
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
- G06T7/521—Depth or shape recovery from laser ranging, e.g. using interferometry; from the projection of structured light
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
- G06T7/55—Depth or shape recovery from multiple images
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
- G06T7/55—Depth or shape recovery from multiple images
- G06T7/571—Depth or shape recovery from multiple images from focus
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/268—Signal distribution or switching
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10028—Range image; Depth image; 3D point clouds
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20076—Probabilistic image processing
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20172—Image enhancement details
- G06T2207/20208—High dynamic range [HDR] image processing
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Optics & Photonics (AREA)
- Studio Devices (AREA)
- Image Processing (AREA)
- Focusing (AREA)
- Automatic Focus Adjustment (AREA)
- Image Analysis (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Geometry (AREA)
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US17/201,660 | 2021-03-15 | ||
| US17/201,660 US11908100B2 (en) | 2021-03-15 | 2021-03-15 | Transform matrix learning for multi-sensor image capture devices |
| PCT/US2022/070948 WO2022198168A1 (en) | 2021-03-15 | 2022-03-03 | Transform matrix learning for multi-sensor image capture devices |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| KR20230156326A true KR20230156326A (ko) | 2023-11-14 |
Family
ID=80820105
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| KR1020237029705A Pending KR20230156326A (ko) | 2021-03-15 | 2022-03-03 | 다중-센서 이미지 캡처 디바이스들을 위한 변환 행렬 학습 |
Country Status (7)
| Country | Link |
|---|---|
| US (1) | US11908100B2 (cg-RX-API-DMAC7.html) |
| EP (1) | EP4309114A1 (cg-RX-API-DMAC7.html) |
| JP (1) | JP7886889B2 (cg-RX-API-DMAC7.html) |
| KR (1) | KR20230156326A (cg-RX-API-DMAC7.html) |
| CN (1) | CN116940961B (cg-RX-API-DMAC7.html) |
| BR (1) | BR112023017974A2 (cg-RX-API-DMAC7.html) |
| WO (1) | WO2022198168A1 (cg-RX-API-DMAC7.html) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022245177A1 (en) * | 2021-05-20 | 2022-11-24 | Samsung Electronics Co., Ltd. | Method and electronic device for obtaining reconstructed image |
| US12315182B2 (en) * | 2022-02-02 | 2025-05-27 | Rapyuta Robotics Co., Ltd. | Apparatus and a method for estimating depth of a scene |
| US12670622B2 (en) * | 2024-03-08 | 2026-06-30 | Caterpillar Inc. | System and methods for mitigating sensor interference using on-sensor field-of-view analytics |
| CN120751252B (zh) * | 2024-08-21 | 2026-08-04 | 荣耀终端股份有限公司 | 图像处理方法及其相关设备 |
Family Cites Families (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008053787A (ja) * | 2006-08-22 | 2008-03-06 | Hitachi Maxell Ltd | 多眼電子カメラ及び多眼電子カメラの視差補正方法 |
| KR20080081693A (ko) * | 2007-03-06 | 2008-09-10 | 삼성전자주식회사 | 카메라의 자동초점조절 방법 |
| CN102075779B (zh) * | 2011-02-21 | 2013-05-08 | 北京航空航天大学 | 一种基于块匹配视差估计的中间视图合成方法 |
| WO2013099169A1 (ja) * | 2011-12-27 | 2013-07-04 | パナソニック株式会社 | ステレオ撮影装置 |
| US9113142B2 (en) * | 2012-01-06 | 2015-08-18 | Thomson Licensing | Method and device for providing temporally consistent disparity estimations |
| WO2013109252A1 (en) * | 2012-01-17 | 2013-07-25 | Thomson Licensing | Generating an image for another view |
| JP6668594B2 (ja) | 2014-02-25 | 2020-03-18 | 株式会社リコー | 視差演算システム、情報処理装置、情報処理方法及びプログラム |
| CN107924572B (zh) * | 2015-04-17 | 2021-06-15 | 快图有限公司 | 使用阵列相机执行高速视频捕获和深度估计的系统和方法 |
| GB2553782B (en) * | 2016-09-12 | 2021-10-20 | Niantic Inc | Predicting depth from image data using a statistical model |
| CN111476837B (zh) * | 2019-01-23 | 2023-02-24 | 上海科技大学 | 自适应立体匹配优化方法及其装置、设备和存储介质 |
| US11315328B2 (en) * | 2019-03-18 | 2022-04-26 | Facebook Technologies, Llc | Systems and methods of rendering real world objects using depth information |
| JP7180783B2 (ja) * | 2019-07-26 | 2022-11-30 | オムロン株式会社 | コンピュータビジョンシステムのキャリブレーション方法及びこれに用いる基準立体物 |
| US11816855B2 (en) * | 2020-02-11 | 2023-11-14 | Samsung Electronics Co., Ltd. | Array-based depth estimation |
| CN111464804A (zh) * | 2020-04-08 | 2020-07-28 | 北京小米松果电子有限公司 | 一种全向视差视图合成方法、装置及存储介质 |
| US11490067B2 (en) * | 2020-08-07 | 2022-11-01 | Owl Autonomous Imaging, Inc. | Multi-aperture ranging devices and methods |
| TWI790471B (zh) * | 2020-08-26 | 2023-01-21 | 財團法人工業技術研究院 | 基於深度學習的影像校正方法及系統 |
-
2021
- 2021-03-15 US US17/201,660 patent/US11908100B2/en active Active
-
2022
- 2022-03-03 EP EP22711846.0A patent/EP4309114A1/en active Pending
- 2022-03-03 BR BR112023017974A patent/BR112023017974A2/pt unknown
- 2022-03-03 WO PCT/US2022/070948 patent/WO2022198168A1/en not_active Ceased
- 2022-03-03 KR KR1020237029705A patent/KR20230156326A/ko active Pending
- 2022-03-03 JP JP2023552555A patent/JP7886889B2/ja active Active
- 2022-03-03 CN CN202280018177.7A patent/CN116940961B/zh active Active
Also Published As
| Publication number | Publication date |
|---|---|
| BR112023017974A2 (pt) | 2023-10-03 |
| WO2022198168A1 (en) | 2022-09-22 |
| EP4309114A1 (en) | 2024-01-24 |
| US20220292630A1 (en) | 2022-09-15 |
| CN116940961B (zh) | 2026-06-23 |
| TW202239190A (zh) | 2022-10-01 |
| JP2024510128A (ja) | 2024-03-06 |
| JP7886889B2 (ja) | 2026-07-08 |
| CN116940961A (zh) | 2023-10-24 |
| US11908100B2 (en) | 2024-02-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11908100B2 (en) | Transform matrix learning for multi-sensor image capture devices | |
| KR102213744B1 (ko) | 선명하고 정확한 주밍 메커니즘 구현을 위한 광각 이미지 캡쳐링 요소 및 장초점 이미지 캡쳐링 요소의 활용방법 | |
| CN108419023B (zh) | 一种生成高动态范围图像的方法以及相关设备 | |
| WO2020037959A1 (en) | Image processing method, image processing apparatus, electronic device and storage medium | |
| CN104219436B (zh) | 光学装置及其控制方法 | |
| US20220286611A1 (en) | Electrical image stabilization (eis)-assisted digital image stabilization (dis) | |
| CN112889068A (zh) | 用于图像处理的神经网络对象识别的方法和系统 | |
| KR20170074538A (ko) | 타임랩스 영상을 생성하는 장치 및 방법 | |
| CN106257917B (zh) | 曝光控制装置和曝光控制方法 | |
| US11810275B2 (en) | Temporal filtering restart for improved scene integrity | |
| US20150062410A1 (en) | Image stabilization method and electronic device therefor | |
| US9111129B2 (en) | Subject detecting method and apparatus, and digital photographing apparatus | |
| CN116368814A (zh) | 无fov损失的空间对准变换 | |
| CN119137968B (zh) | 用于图像处理的方法、装置、介质和产品 | |
| KR20240001131A (ko) | 계산적 사진촬영을 위한 이미지 정렬 | |
| US20110242346A1 (en) | Compound eye photographing method and apparatus | |
| KR20240031246A (ko) | 다수의 관심 영역들을 갖는 장면들에서 선택적으로 증가하는 피사계 심도 | |
| CN115314635B (zh) | 用于离焦量确定的模型训练方法及装置 | |
| TW202345086A (zh) | 可變光圈(va)相機系統中的散景效果 | |
| US20220277585A1 (en) | Image processing device and control method thereof, imaging apparatus, and recording medium | |
| US20250142215A1 (en) | Precise field-of-view transitions with autofocus for variable optical zoom systems | |
| WO2024263152A1 (en) | Learning-based camera autofocus prediction for sparse phase detection imaging sensors | |
| WO2024048069A1 (ja) | 情報処理装置、情報処理方法およびプログラム | |
| CN117750215A (zh) | 拍摄参数更新方法和电子设备 | |
| CN121548837A (zh) | 用于处理高位深图像的位分割 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PA0105 | International application |
Patent event date: 20230831 Patent event code: PA01051R01D Comment text: International Patent Application |
|
| PG1501 | Laying open of application | ||
| A201 | Request for examination | ||
| PA0201 | Request for examination |
Patent event code: PA02012R01D Patent event date: 20250217 Comment text: Request for Examination of Application |