TWI899424B - 用於針對具有多個深度處的目標的場景的影像融合的方法、設備，和非暫時性電腦可讀取媒體 - Google Patents

用於針對具有多個深度處的目標的場景的影像融合的方法、設備，和非暫時性電腦可讀取媒體

Info

Publication number
TWI899424B
TWI899424B TW111102208A TW111102208A TWI899424B TW I899424 B TWI899424 B TW I899424B TW 111102208 A TW111102208 A TW 111102208A TW 111102208 A TW111102208 A TW 111102208A TW I899424 B TWI899424 B TW I899424B
Authority
TW
Taiwan
Prior art keywords
image frame
image
depth
determining
group
Prior art date
Application number
TW111102208A
Other languages
English (en)
Chinese (zh)
Other versions
TW202236840A (zh
Inventor
馮文春
劉軒銘
賴宇任
Original Assignee
美商高通公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 美商高通公司 filed Critical 美商高通公司
Publication of TW202236840A publication Critical patent/TW202236840A/zh
Application granted granted Critical
Publication of TWI899424B publication Critical patent/TWI899424B/zh

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/571—Depth or shape recovery from multiple images from focus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/20—Image enhancement or restoration using local operators
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/70—Denoising; Smoothing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/45—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/2224—Studio circuitry; Studio devices; Studio equipment related to virtual studio applications
    • H04N5/2226—Determination of depth image, e.g. for foreground/background separation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265—Mixing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/272—Means for inserting a foreground image in a background image, i.e. inlay, outlay
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10141—Special mode during image acquisition
    • G06T2207/10148—Varying focus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation

Landscapes

  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Studio Devices (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
  • Cameras In General (AREA)
TW111102208A 2021-01-28 2022-01-19 用於針對具有多個深度處的目標的場景的影像融合的方法、設備，和非暫時性電腦可讀取媒體 TWI899424B (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US17/161,355 2021-01-28
US17/161,355 US11756221B2 (en) 2021-01-28 2021-01-28 Image fusion for scenes with objects at multiple depths

Publications (2)

Publication Number Publication Date
TW202236840A TW202236840A (zh) 2022-09-16
TWI899424B true TWI899424B (zh) 2025-10-01

Family

ID=80445554

Family Applications (1)

Application Number Title Priority Date Filing Date
TW111102208A TWI899424B (zh) 2021-01-28 2022-01-19 用於針對具有多個深度處的目標的場景的影像融合的方法、設備，和非暫時性電腦可讀取媒體

Country Status (8)

Country Link
US (1) US11756221B2 (enExample)
EP (1) EP4285581A1 (enExample)
JP (1) JP2024504270A (enExample)
KR (1) KR20230137316A (enExample)
CN (1) CN116762356A (enExample)
BR (1) BR112023014085A2 (enExample)
TW (1) TWI899424B (enExample)
WO (1) WO2022165462A1 (enExample)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11853845B2 (en) * 2020-09-02 2023-12-26 Cognex Corporation Machine vision system and method with multi-aperture optics assembly
US11727537B1 (en) * 2022-03-24 2023-08-15 Qualcomm Incorporated Bokeh effect in variable aperture (VA) camera systems
CN119174187A (zh) * 2022-05-10 2024-12-20 高通股份有限公司 具有可变光圈能力的图像捕获设备的相机转换
DE102022118582B4 (de) * 2022-07-25 2025-07-31 Carl Zeiss Industrielle Messtechnik Gmbh Computerimplementiertes Verfahren zum Erzeugen eines korrigierten Bildes mit erweiterter Schärfentiefe, Verfahren, Messgerät und Computerprogrammprodukt
TWI819752B (zh) * 2022-08-18 2023-10-21 緯創資通股份有限公司 拍攝系統及影像融合的方法
US12586207B2 (en) 2022-12-01 2026-03-24 Samsung Electronics Co., Ltd. System and method for AI segmentation-based registration for multi-frame processing
EP4390865A1 (en) * 2022-12-23 2024-06-26 Moxa Inc. Object recognizing method and object recognizing device
JP2024109161A (ja) * 2023-02-01 2024-08-14 キヤノン株式会社 画像処理装置、制御方法、およびプログラム
JP7866525B2 (ja) * 2023-03-29 2026-05-27 株式会社日立ソリューションズ 対象物抽出システム、対象物抽出方法、及び対象物抽出プログラム
EP4649448A4 (en) * 2023-04-18 2026-04-08 Samsung Electronics Co Ltd SYSTEM AND METHOD FOR IMPROVING IMAGE DETAIL ON AN ELECTRONIC DEVICE
FR3148856A1 (fr) * 2023-05-16 2024-11-22 Orange dispositif et procédé de détection de région d’intérêt dans une image
US20240430567A1 (en) * 2023-06-20 2024-12-26 Google Llc Depth-Histogram Based Autofocus
US12561768B2 (en) 2023-09-26 2026-02-24 Adobe Inc. Generating non-destructive synthetic lens blur with in-focus edge rendering
US12586163B2 (en) * 2023-09-26 2026-03-24 Adobe Inc. Interactively refining a digital image depth map for non destructive synthetic lens blur
CN117934301A (zh) * 2024-01-07 2024-04-26 Oppo广东移动通信有限公司 图像处理方法、装置、电子设备和计算机可读存储介质
JP2025127097A (ja) * 2024-02-20 2025-09-01 ソニーセミコンダクタソリューションズ株式会社 撮像システム、撮像装置、撮像方法およびプログラム
TWI884776B (zh) * 2024-04-26 2025-05-21 台達電子工業股份有限公司 影像數據採集系統、影像模型的訓練方法、提高影像解析度的裝置
CN119996596B (zh) * 2025-01-23 2026-01-23 广州奥舜创电子科技有限公司 一种多模式成像融合系统、装置和方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103888659A (zh) * 2012-12-19 2014-06-25 卡西欧计算机株式会社 摄像装置以及摄像方法
US20150356738A1 (en) * 2014-06-09 2015-12-10 Samsung Electronics Co., Ltd. Method and apparatus for generating images
CN108200344A (zh) * 2018-01-23 2018-06-22 江苏冠达通电子科技有限公司 摄像机的调整变焦方法
CN112529951A (zh) * 2019-09-18 2021-03-19 华为技术有限公司 扩展景深图像的获取方法、装置及电子设备

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7720371B2 (en) * 2007-01-18 2010-05-18 Nikon Corporation Depth layer extraction and image synthesis from focus varied multiple images
JP5484631B2 (ja) * 2011-03-31 2014-05-07 富士フイルム株式会社 撮像装置、撮像方法、プログラム、及びプログラム記憶媒体
WO2012140869A1 (ja) 2011-04-12 2012-10-18 パナソニック株式会社 動き推定装置、奥行き推定装置、及び動き推定方法
US9501834B2 (en) * 2011-08-18 2016-11-22 Qualcomm Technologies, Inc. Image capture for later refocusing or focus-manipulation
US9344619B2 (en) * 2013-08-30 2016-05-17 Qualcomm Incorporated Method and apparatus for generating an all-in-focus image
US9971153B2 (en) * 2014-03-29 2018-05-15 Frimory Technologies Ltd. Method and apparatus for displaying video data
CN105100579B (zh) * 2014-05-09 2018-12-07 华为技术有限公司 一种图像数据的采集处理方法及相关装置
US10582125B1 (en) 2015-06-01 2020-03-03 Amazon Technologies, Inc. Panoramic image generation from video
JP6700813B2 (ja) * 2016-01-29 2020-05-27 キヤノン株式会社 画像処理装置、撮像装置、画像処理方法、及びプログラム
KR20240056796A (ko) 2016-12-23 2024-04-30 매직 립, 인코포레이티드 콘텐츠 캡처 디바이스에 대한 세팅들을 결정하기 위한 기술들
EP3488603B1 (en) 2017-05-24 2021-07-28 SZ DJI Technology Co., Ltd. Methods and systems for processing an image
US10917571B2 (en) * 2018-11-05 2021-02-09 Sony Corporation Image capture device control based on determination of blur value of objects in images
WO2021000063A1 (en) 2019-06-29 2021-01-07 Qualcomm Incorporated Automatic focus distance extension

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103888659A (zh) * 2012-12-19 2014-06-25 卡西欧计算机株式会社 摄像装置以及摄像方法
US20150356738A1 (en) * 2014-06-09 2015-12-10 Samsung Electronics Co., Ltd. Method and apparatus for generating images
CN108200344A (zh) * 2018-01-23 2018-06-22 江苏冠达通电子科技有限公司 摄像机的调整变焦方法
CN112529951A (zh) * 2019-09-18 2021-03-19 华为技术有限公司 扩展景深图像的获取方法、装置及电子设备

Also Published As

Publication number Publication date
CN116762356A (zh) 2023-09-15
WO2022165462A1 (en) 2022-08-04
US20220237813A1 (en) 2022-07-28
BR112023014085A2 (pt) 2023-12-12
JP2024504270A (ja) 2024-01-31
TW202236840A (zh) 2022-09-16
KR20230137316A (ko) 2023-10-04
US11756221B2 (en) 2023-09-12
EP4285581A1 (en) 2023-12-06

Similar Documents

Publication Publication Date Title
US11756221B2 (en) Image fusion for scenes with objects at multiple depths
CN107087107B (zh) 基于双摄像头的图像处理装置及方法
CN110473185B (zh) 图像处理方法和装置、电子设备、计算机可读存储介质
CN107977940B (zh) 背景虚化处理方法、装置及设备
KR102278776B1 (ko) 이미지 처리 방법, 기기, 및 장치
TWI526068B (zh) 圖像擷取裝置及影像處理方法
US9325899B1 (en) Image capturing device and digital zooming method thereof
CN110661977B (zh) 主体检测方法和装置、电子设备、计算机可读存储介质
CN111028189A (zh) 图像处理方法、装置、存储介质及电子设备
US8675089B2 (en) Apparatus and method for assisting composition of photographic image
WO2017045558A1 (zh) 景深调节方法、装置及终端
US20180183998A1 (en) Power reduction and performance improvement through selective sensor image downscaling
CN110349163A (zh) 图像处理方法和装置、电子设备、计算机可读存储介质
CN105657237A (zh) 图像获取装置及其数字变焦方法
JP2015040941A (ja) 撮像装置、その制御方法およびプログラム
JP2024524035A (ja) シーン完全性の向上のための時間フィルタリングリスタート
CN119156830A (zh) 智能高动态范围图像钳制
CN105939439B (zh) 图像处理装置、摄像装置及图像处理方法
JP6975144B2 (ja) 撮像処理装置、電子機器、撮像処理方法、撮像処理装置制御プログラム
CN110365897B (zh) 图像修正方法和装置、电子设备、计算机可读存储介质
JP2021532640A (ja) ただ二つのカメラを備える装置およびこの装置を用いて二つの画像を生成する方法
CN117356102A (zh) 多相机系统中辅助相机的镜头定位
CN103516999A (zh) 图像处理方法及图像处理装置
JP7458723B2 (ja) 画像処理装置、撮像装置、制御方法、およびプログラム
JP5871590B2 (ja) 撮像装置、及びその制御方法