JP2024504270A - 複数の深度のオブジェクトがあるシーンの画像融合 - Google Patents

複数の深度のオブジェクトがあるシーンの画像融合 Download PDF

Info

Publication number
JP2024504270A
JP2024504270A JP2023539173A JP2023539173A JP2024504270A JP 2024504270 A JP2024504270 A JP 2024504270A JP 2023539173 A JP2023539173 A JP 2023539173A JP 2023539173 A JP2023539173 A JP 2023539173A JP 2024504270 A JP2024504270 A JP 2024504270A
Authority
JP
Japan
Prior art keywords
image frame
depth
determining
pixels
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2023539173A
Other languages
English (en)
Japanese (ja)
Other versions
JP2024504270A5 (enExample
Inventor
ウェン－チュン・フェン
シュアン－ミン・リュウ
ユ－レン・ライ
Original Assignee
クアルコム，インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by クアルコム，インコーポレイテッド filed Critical クアルコム，インコーポレイテッド
Publication of JP2024504270A publication Critical patent/JP2024504270A/ja
Publication of JP2024504270A5 publication Critical patent/JP2024504270A5/ja
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/571—Depth or shape recovery from multiple images from focus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/20—Image enhancement or restoration using local operators
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/70—Denoising; Smoothing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/45—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/2224—Studio circuitry; Studio devices; Studio equipment related to virtual studio applications
    • H04N5/2226—Determination of depth image, e.g. for foreground/background separation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265—Mixing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/272—Means for inserting a foreground image in a background image, i.e. inlay, outlay
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10141—Special mode during image acquisition
    • G06T2207/10148—Varying focus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging

Landscapes

  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Studio Devices (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
  • Cameras In General (AREA)
JP2023539173A 2021-01-28 2022-01-18 複数の深度のオブジェクトがあるシーンの画像融合 Pending JP2024504270A (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US17/161,355 2021-01-28
US17/161,355 US11756221B2 (en) 2021-01-28 2021-01-28 Image fusion for scenes with objects at multiple depths
PCT/US2022/070230 WO2022165462A1 (en) 2021-01-28 2022-01-18 Image fusion for scenes with objects at multiple depths

Publications (2)

Publication Number Publication Date
JP2024504270A true JP2024504270A (ja) 2024-01-31
JP2024504270A5 JP2024504270A5 (enExample) 2025-01-08

Family

ID=80445554

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2023539173A Pending JP2024504270A (ja) 2021-01-28 2022-01-18 複数の深度のオブジェクトがあるシーンの画像融合

Country Status (8)

Country Link
US (1) US11756221B2 (enExample)
EP (1) EP4285581A1 (enExample)
JP (1) JP2024504270A (enExample)
KR (1) KR20230137316A (enExample)
CN (1) CN116762356A (enExample)
BR (1) BR112023014085A2 (enExample)
TW (1) TWI899424B (enExample)
WO (1) WO2022165462A1 (enExample)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11853845B2 (en) * 2020-09-02 2023-12-26 Cognex Corporation Machine vision system and method with multi-aperture optics assembly
US11727537B1 (en) * 2022-03-24 2023-08-15 Qualcomm Incorporated Bokeh effect in variable aperture (VA) camera systems
CN119174187A (zh) * 2022-05-10 2024-12-20 高通股份有限公司 具有可变光圈能力的图像捕获设备的相机转换
DE102022118582B4 (de) * 2022-07-25 2025-07-31 Carl Zeiss Industrielle Messtechnik Gmbh Computerimplementiertes Verfahren zum Erzeugen eines korrigierten Bildes mit erweiterter Schärfentiefe, Verfahren, Messgerät und Computerprogrammprodukt
TWI819752B (zh) * 2022-08-18 2023-10-21 緯創資通股份有限公司 拍攝系統及影像融合的方法
US12586207B2 (en) 2022-12-01 2026-03-24 Samsung Electronics Co., Ltd. System and method for AI segmentation-based registration for multi-frame processing
EP4390865A1 (en) * 2022-12-23 2024-06-26 Moxa Inc. Object recognizing method and object recognizing device
JP2024109161A (ja) * 2023-02-01 2024-08-14 キヤノン株式会社 画像処理装置、制御方法、およびプログラム
JP7866525B2 (ja) * 2023-03-29 2026-05-27 株式会社日立ソリューションズ 対象物抽出システム、対象物抽出方法、及び対象物抽出プログラム
EP4649448A4 (en) * 2023-04-18 2026-04-08 Samsung Electronics Co Ltd SYSTEM AND METHOD FOR IMPROVING IMAGE DETAIL ON AN ELECTRONIC DEVICE
FR3148856A1 (fr) * 2023-05-16 2024-11-22 Orange dispositif et procédé de détection de région d’intérêt dans une image
US20240430567A1 (en) * 2023-06-20 2024-12-26 Google Llc Depth-Histogram Based Autofocus
US12561768B2 (en) 2023-09-26 2026-02-24 Adobe Inc. Generating non-destructive synthetic lens blur with in-focus edge rendering
US12586163B2 (en) * 2023-09-26 2026-03-24 Adobe Inc. Interactively refining a digital image depth map for non destructive synthetic lens blur
CN117934301A (zh) * 2024-01-07 2024-04-26 Oppo广东移动通信有限公司 图像处理方法、装置、电子设备和计算机可读存储介质
JP2025127097A (ja) * 2024-02-20 2025-09-01 ソニーセミコンダクタソリューションズ株式会社 撮像システム、撮像装置、撮像方法およびプログラム
TWI884776B (zh) * 2024-04-26 2025-05-21 台達電子工業股份有限公司 影像數據採集系統、影像模型的訓練方法、提高影像解析度的裝置
CN119996596B (zh) * 2025-01-23 2026-01-23 广州奥舜创电子科技有限公司 一种多模式成像融合系统、装置和方法

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012132486A1 (ja) * 2011-03-31 2012-10-04 富士フイルム株式会社 撮像装置、撮像方法、プログラム、及びプログラム記憶媒体
JP2014119715A (ja) * 2012-12-19 2014-06-30 Casio Comput Co Ltd 撮像装置、撮像方法及びプログラム

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7720371B2 (en) * 2007-01-18 2010-05-18 Nikon Corporation Depth layer extraction and image synthesis from focus varied multiple images
WO2012140869A1 (ja) 2011-04-12 2012-10-18 パナソニック株式会社 動き推定装置、奥行き推定装置、及び動き推定方法
US9501834B2 (en) * 2011-08-18 2016-11-22 Qualcomm Technologies, Inc. Image capture for later refocusing or focus-manipulation
US9344619B2 (en) * 2013-08-30 2016-05-17 Qualcomm Incorporated Method and apparatus for generating an all-in-focus image
US9971153B2 (en) * 2014-03-29 2018-05-15 Frimory Technologies Ltd. Method and apparatus for displaying video data
CN105100579B (zh) * 2014-05-09 2018-12-07 华为技术有限公司 一种图像数据的采集处理方法及相关装置
KR102220443B1 (ko) * 2014-06-09 2021-02-25 삼성전자주식회사 깊이 정보를 활용하는 전자 장치 및 방법
US10582125B1 (en) 2015-06-01 2020-03-03 Amazon Technologies, Inc. Panoramic image generation from video
JP6700813B2 (ja) * 2016-01-29 2020-05-27 キヤノン株式会社 画像処理装置、撮像装置、画像処理方法、及びプログラム
KR20240056796A (ko) 2016-12-23 2024-04-30 매직 립, 인코포레이티드 콘텐츠 캡처 디바이스에 대한 세팅들을 결정하기 위한 기술들
EP3488603B1 (en) 2017-05-24 2021-07-28 SZ DJI Technology Co., Ltd. Methods and systems for processing an image
CN108200344A (zh) * 2018-01-23 2018-06-22 江苏冠达通电子科技有限公司 摄像机的调整变焦方法
US10917571B2 (en) * 2018-11-05 2021-02-09 Sony Corporation Image capture device control based on determination of blur value of objects in images
WO2021000063A1 (en) 2019-06-29 2021-01-07 Qualcomm Incorporated Automatic focus distance extension
CN112529951B (zh) * 2019-09-18 2024-06-25 华为技术有限公司 扩展景深图像的获取方法、装置及电子设备

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012132486A1 (ja) * 2011-03-31 2012-10-04 富士フイルム株式会社 撮像装置、撮像方法、プログラム、及びプログラム記憶媒体
JP2014119715A (ja) * 2012-12-19 2014-06-30 Casio Comput Co Ltd 撮像装置、撮像方法及びプログラム

Also Published As

Publication number Publication date
CN116762356A (zh) 2023-09-15
WO2022165462A1 (en) 2022-08-04
US20220237813A1 (en) 2022-07-28
BR112023014085A2 (pt) 2023-12-12
TW202236840A (zh) 2022-09-16
KR20230137316A (ko) 2023-10-04
TWI899424B (zh) 2025-10-01
US11756221B2 (en) 2023-09-12
EP4285581A1 (en) 2023-12-06

Similar Documents

Publication Publication Date Title
US11756221B2 (en) Image fusion for scenes with objects at multiple depths
KR102278776B1 (ko) 이미지 처리 방법, 기기, 및 장치
CN107977940B (zh) 背景虚化处理方法、装置及设备
US8666191B2 (en) Systems and methods for image capturing
EP2768214A2 (en) Method of tracking object using camera and camera system for object tracking
WO2018201809A1 (zh) 基于双摄像头的图像处理装置及方法
US9792698B2 (en) Image refocusing
US11863881B2 (en) Selectively increasing depth-of-field in scenes with multiple regions of interest
CN110324532A (zh) 一种图像虚化方法、装置、存储介质及电子设备
US20120141029A1 (en) Apparatus and method creating ghost-free high dynamic range image using filtering
WO2017045558A1 (zh) 景深调节方法、装置及终端
US20180183998A1 (en) Power reduction and performance improvement through selective sensor image downscaling
CN119137968B (zh) 用于图像处理的方法、装置、介质和产品
JP2024524035A (ja) シーン完全性の向上のための時間フィルタリングリスタート
CN114071009A (zh) 一种拍摄方法及设备
CN120712784A (zh) 具有可调整背景虚化效果的图像处理
CN120303687A (zh) 图像帧内的选择性运动失真校正
EP4349008B1 (en) Infrared-based white balancing of an image
KR20240031246A (ko) 다수의 관심 영역들을 갖는 장면들에서 선택적으로 증가하는 피사계 심도
US12028609B2 (en) Camera sensor changes in multi-sensor device
CN110365897B (zh) 图像修正方法和装置、电子设备、计算机可读存储介质
CN106878604A (zh) 一种基于电子设备的图像生成的方法和电子设备
JP2020009099A (ja) 画像処理装置、画像処理方法、及びプログラム
CN118871946A (zh) 使用感兴趣区域（roi）细化的多相机对齐
CN103516999A (zh) 图像处理方法及图像处理装置

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20241224

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20241224

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20251104

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20260202

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20260519