CN116762356A - 具有多深度的对象的场景的图像融合 - Google Patents

具有多深度的对象的场景的图像融合 Download PDF

Info

Publication number
CN116762356A
CN116762356A CN202280011085.6A CN202280011085A CN116762356A CN 116762356 A CN116762356 A CN 116762356A CN 202280011085 A CN202280011085 A CN 202280011085A CN 116762356 A CN116762356 A CN 116762356A
Authority
CN
China
Prior art keywords
image frame
pixels
depth
image
determining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202280011085.6A
Other languages
English (en)
Chinese (zh)
Inventor
冯文俊
H-M·刘
Y-R·赖
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of CN116762356A publication Critical patent/CN116762356A/zh
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/571—Depth or shape recovery from multiple images from focus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/20—Image enhancement or restoration using local operators
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/70—Denoising; Smoothing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/45—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/2224—Studio circuitry; Studio devices; Studio equipment related to virtual studio applications
    • H04N5/2226—Determination of depth image, e.g. for foreground/background separation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265—Mixing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/272—Means for inserting a foreground image in a background image, i.e. inlay, outlay
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10141—Special mode during image acquisition
    • G06T2207/10148—Varying focus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Studio Devices (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
  • Cameras In General (AREA)
CN202280011085.6A 2021-01-28 2022-01-18 具有多深度的对象的场景的图像融合 Pending CN116762356A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US17/161,355 2021-01-28
US17/161,355 US11756221B2 (en) 2021-01-28 2021-01-28 Image fusion for scenes with objects at multiple depths
PCT/US2022/070230 WO2022165462A1 (en) 2021-01-28 2022-01-18 Image fusion for scenes with objects at multiple depths

Publications (1)

Publication Number Publication Date
CN116762356A true CN116762356A (zh) 2023-09-15

Family

ID=80445554

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202280011085.6A Pending CN116762356A (zh) 2021-01-28 2022-01-18 具有多深度的对象的场景的图像融合

Country Status (8)

Country Link
US (1) US11756221B2 (https=)
EP (1) EP4285581A1 (https=)
JP (1) JP2024504270A (https=)
KR (1) KR20230137316A (https=)
CN (1) CN116762356A (https=)
BR (1) BR112023014085A2 (https=)
TW (1) TWI899424B (https=)
WO (1) WO2022165462A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119996596A (zh) * 2025-01-23 2025-05-13 广州奥舜创电子科技有限公司 一种多模式成像融合系统、装置和方法

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11853845B2 (en) * 2020-09-02 2023-12-26 Cognex Corporation Machine vision system and method with multi-aperture optics assembly
US11727537B1 (en) * 2022-03-24 2023-08-15 Qualcomm Incorporated Bokeh effect in variable aperture (VA) camera systems
EP4523423A4 (en) * 2022-05-10 2026-03-11 Qualcomm Inc CAMERA TRANSITION FOR IMAGE CAPTURE DEVICES WITH VARIABLE APERTURE CAPABILITY
DE102022118582B4 (de) * 2022-07-25 2025-07-31 Carl Zeiss Industrielle Messtechnik Gmbh Computerimplementiertes Verfahren zum Erzeugen eines korrigierten Bildes mit erweiterter Schärfentiefe, Verfahren, Messgerät und Computerprogrammprodukt
TWI819752B (zh) * 2022-08-18 2023-10-21 緯創資通股份有限公司 拍攝系統及影像融合的方法
US12586207B2 (en) 2022-12-01 2026-03-24 Samsung Electronics Co., Ltd. System and method for AI segmentation-based registration for multi-frame processing
EP4390865A1 (en) * 2022-12-23 2024-06-26 Moxa Inc. Object recognizing method and object recognizing device
JP2024109161A (ja) * 2023-02-01 2024-08-14 キヤノン株式会社 画像処理装置、制御方法、およびプログラム
JP2024141898A (ja) * 2023-03-29 2024-10-10 株式会社日立ソリューションズ 対象物抽出システム、対象物抽出方法、及び対象物抽出プログラム
WO2024219855A1 (en) * 2023-04-18 2024-10-24 Samsung Electronics Co., Ltd. System and method for enhancing details of an image on an electronic device
FR3148856A1 (fr) * 2023-05-16 2024-11-22 Orange dispositif et procédé de détection de région d’intérêt dans une image
US12586163B2 (en) * 2023-09-26 2026-03-24 Adobe Inc. Interactively refining a digital image depth map for non destructive synthetic lens blur
US12561768B2 (en) 2023-09-26 2026-02-24 Adobe Inc. Generating non-destructive synthetic lens blur with in-focus edge rendering
CN117934301A (zh) * 2024-01-07 2024-04-26 Oppo广东移动通信有限公司 图像处理方法、装置、电子设备和计算机可读存储介质
JP2025127097A (ja) * 2024-02-20 2025-09-01 ソニーセミコンダクタソリューションズ株式会社 撮像システム、撮像装置、撮像方法およびプログラム
TWI884776B (zh) * 2024-04-26 2025-05-21 台達電子工業股份有限公司 影像數據採集系統、影像模型的訓練方法、提高影像解析度的裝置

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7720371B2 (en) * 2007-01-18 2010-05-18 Nikon Corporation Depth layer extraction and image synthesis from focus varied multiple images
US9092875B2 (en) 2011-04-12 2015-07-28 Panasonic Intellectual Property Management Co., Ltd. Motion estimation apparatus, depth estimation apparatus, and motion estimation method
US9501834B2 (en) * 2011-08-18 2016-11-22 Qualcomm Technologies, Inc. Image capture for later refocusing or focus-manipulation
JP5786847B2 (ja) * 2012-12-19 2015-09-30 カシオ計算機株式会社 撮像装置、撮像方法及びプログラム
US9344619B2 (en) * 2013-08-30 2016-05-17 Qualcomm Incorporated Method and apparatus for generating an all-in-focus image
US9971153B2 (en) * 2014-03-29 2018-05-15 Frimory Technologies Ltd. Method and apparatus for displaying video data
CN105100579B (zh) * 2014-05-09 2018-12-07 华为技术有限公司 一种图像数据的采集处理方法及相关装置
KR102220443B1 (ko) * 2014-06-09 2021-02-25 삼성전자주식회사 깊이 정보를 활용하는 전자 장치 및 방법
US10582125B1 (en) 2015-06-01 2020-03-03 Amazon Technologies, Inc. Panoramic image generation from video
JP6700813B2 (ja) * 2016-01-29 2020-05-27 キヤノン株式会社 画像処理装置、撮像装置、画像処理方法、及びプログラム
EP3559862B1 (en) 2016-12-23 2022-06-15 Magic Leap, Inc. Techniques for determining settings for a content capture device
CN110663246B (zh) 2017-05-24 2021-08-06 深圳市大疆创新科技有限公司 用于处理图像的方法和系统
CN108200344A (zh) * 2018-01-23 2018-06-22 江苏冠达通电子科技有限公司 摄像机的调整变焦方法
US10917571B2 (en) * 2018-11-05 2021-02-09 Sony Corporation Image capture device control based on determination of blur value of objects in images
WO2021000063A1 (en) 2019-06-29 2021-01-07 Qualcomm Incorporated Automatic focus distance extension
CN112529951B (zh) * 2019-09-18 2024-06-25 华为技术有限公司 扩展景深图像的获取方法、装置及电子设备

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119996596A (zh) * 2025-01-23 2025-05-13 广州奥舜创电子科技有限公司 一种多模式成像融合系统、装置和方法

Also Published As

Publication number Publication date
KR20230137316A (ko) 2023-10-04
US20220237813A1 (en) 2022-07-28
US11756221B2 (en) 2023-09-12
EP4285581A1 (en) 2023-12-06
BR112023014085A2 (pt) 2023-12-12
TWI899424B (zh) 2025-10-01
JP2024504270A (ja) 2024-01-31
TW202236840A (zh) 2022-09-16
WO2022165462A1 (en) 2022-08-04

Similar Documents

Publication Publication Date Title
US11756221B2 (en) Image fusion for scenes with objects at multiple depths
KR102278776B1 (ko) 이미지 처리 방법, 기기, 및 장치
CN107977940B (zh) 背景虚化处理方法、装置及设备
CN110473185B (zh) 图像处理方法和装置、电子设备、计算机可读存储介质
US20210390747A1 (en) Image fusion for image capture and processing systems
CN107087107B (zh) 基于双摄像头的图像处理装置及方法
US9325899B1 (en) Image capturing device and digital zooming method thereof
US8942509B2 (en) Apparatus and method creating ghost-free high dynamic range image using filtering
CN108259770B (zh) 图像处理方法、装置、存储介质及电子设备
US11863881B2 (en) Selectively increasing depth-of-field in scenes with multiple regions of interest
US20180183998A1 (en) Power reduction and performance improvement through selective sensor image downscaling
CN119137968B (zh) 用于图像处理的方法、装置、介质和产品
JP2024524035A (ja) シーン完全性の向上のための時間フィルタリングリスタート
CN120112935A (zh) 针对图像感兴趣区域的图像增强
KR20240031246A (ko) 다수의 관심 영역들을 갖는 장면들에서 선택적으로 증가하는 피사계 심도
CN120712784A (zh) 具有可调整背景虚化效果的图像处理
CN110365897B (zh) 图像修正方法和装置、电子设备、计算机可读存储介质
CN106878604A (zh) 一种基于电子设备的图像生成的方法和电子设备
JP2020009099A (ja) 画像処理装置、画像処理方法、及びプログラム
US20240209843A1 (en) Scalable voxel block selection
CN117356102A (zh) 多相机系统中辅助相机的镜头定位
US20250086821A1 (en) Image frame blending control using eye detection
JP7458723B2 (ja) 画像処理装置、撮像装置、制御方法、およびプログラム
CN118871946A (zh) 使用感兴趣区域（roi）细化的多相机对齐
CN117616449A (zh) 选择性地增加具有多个感兴趣区域的场景中的景深

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination