KR20230137316A - 다수의 심도들에서의 객체들을 갖는 장면들을 위한이미지 융합 - Google Patents

다수의 심도들에서의 객체들을 갖는 장면들을 위한이미지 융합 Download PDF

Info

Publication number
KR20230137316A
KR20230137316A KR1020237024724A KR20237024724A KR20230137316A KR 20230137316 A KR20230137316 A KR 20230137316A KR 1020237024724 A KR1020237024724 A KR 1020237024724A KR 20237024724 A KR20237024724 A KR 20237024724A KR 20230137316 A KR20230137316 A KR 20230137316A
Authority
KR
South Korea
Prior art keywords
image frame
depth
determining
pixels
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
KR1020237024724A
Other languages
English (en)
Korean (ko)
Inventor
원-춘 펑
솬-밍 리우
위-런 라이
Original Assignee
퀄컴 인코포레이티드
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 퀄컴 인코포레이티드 filed Critical 퀄컴 인코포레이티드
Publication of KR20230137316A publication Critical patent/KR20230137316A/ko
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/571—Depth or shape recovery from multiple images from focus
    • G06T5/002—
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/20—Image enhancement or restoration using local operators
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/70—Denoising; Smoothing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/45—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/2224—Studio circuitry; Studio devices; Studio equipment related to virtual studio applications
    • H04N5/2226—Determination of depth image, e.g. for foreground/background separation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265—Mixing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/272—Means for inserting a foreground image in a background image, i.e. inlay, outlay
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10141—Special mode during image acquisition
    • G06T2207/10148—Varying focus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Studio Devices (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
  • Cameras In General (AREA)
KR1020237024724A 2021-01-28 2022-01-18 다수의 심도들에서의 객체들을 갖는 장면들을 위한이미지 융합 Pending KR20230137316A (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US17/161,355 2021-01-28
US17/161,355 US11756221B2 (en) 2021-01-28 2021-01-28 Image fusion for scenes with objects at multiple depths
PCT/US2022/070230 WO2022165462A1 (en) 2021-01-28 2022-01-18 Image fusion for scenes with objects at multiple depths

Publications (1)

Publication Number Publication Date
KR20230137316A true KR20230137316A (ko) 2023-10-04

Family

ID=80445554

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020237024724A Pending KR20230137316A (ko) 2021-01-28 2022-01-18 다수의 심도들에서의 객체들을 갖는 장면들을 위한이미지 융합

Country Status (8)

Country Link
US (1) US11756221B2 (https=)
EP (1) EP4285581A1 (https=)
JP (1) JP2024504270A (https=)
KR (1) KR20230137316A (https=)
CN (1) CN116762356A (https=)
BR (1) BR112023014085A2 (https=)
TW (1) TWI899424B (https=)
WO (1) WO2022165462A1 (https=)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11853845B2 (en) * 2020-09-02 2023-12-26 Cognex Corporation Machine vision system and method with multi-aperture optics assembly
US11727537B1 (en) * 2022-03-24 2023-08-15 Qualcomm Incorporated Bokeh effect in variable aperture (VA) camera systems
EP4523423A4 (en) * 2022-05-10 2026-03-11 Qualcomm Inc CAMERA TRANSITION FOR IMAGE CAPTURE DEVICES WITH VARIABLE APERTURE CAPABILITY
DE102022118582B4 (de) * 2022-07-25 2025-07-31 Carl Zeiss Industrielle Messtechnik Gmbh Computerimplementiertes Verfahren zum Erzeugen eines korrigierten Bildes mit erweiterter Schärfentiefe, Verfahren, Messgerät und Computerprogrammprodukt
TWI819752B (zh) * 2022-08-18 2023-10-21 緯創資通股份有限公司 拍攝系統及影像融合的方法
US12586207B2 (en) 2022-12-01 2026-03-24 Samsung Electronics Co., Ltd. System and method for AI segmentation-based registration for multi-frame processing
EP4390865A1 (en) * 2022-12-23 2024-06-26 Moxa Inc. Object recognizing method and object recognizing device
JP2024109161A (ja) * 2023-02-01 2024-08-14 キヤノン株式会社 画像処理装置、制御方法、およびプログラム
JP2024141898A (ja) * 2023-03-29 2024-10-10 株式会社日立ソリューションズ 対象物抽出システム、対象物抽出方法、及び対象物抽出プログラム
WO2024219855A1 (en) * 2023-04-18 2024-10-24 Samsung Electronics Co., Ltd. System and method for enhancing details of an image on an electronic device
FR3148856A1 (fr) * 2023-05-16 2024-11-22 Orange dispositif et procédé de détection de région d’intérêt dans une image
US12586163B2 (en) * 2023-09-26 2026-03-24 Adobe Inc. Interactively refining a digital image depth map for non destructive synthetic lens blur
US12561768B2 (en) 2023-09-26 2026-02-24 Adobe Inc. Generating non-destructive synthetic lens blur with in-focus edge rendering
CN117934301A (zh) * 2024-01-07 2024-04-26 Oppo广东移动通信有限公司 图像处理方法、装置、电子设备和计算机可读存储介质
JP2025127097A (ja) * 2024-02-20 2025-09-01 ソニーセミコンダクタソリューションズ株式会社 撮像システム、撮像装置、撮像方法およびプログラム
TWI884776B (zh) * 2024-04-26 2025-05-21 台達電子工業股份有限公司 影像數據採集系統、影像模型的訓練方法、提高影像解析度的裝置
CN119996596B (zh) * 2025-01-23 2026-01-23 广州奥舜创电子科技有限公司 一种多模式成像融合系统、装置和方法

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7720371B2 (en) * 2007-01-18 2010-05-18 Nikon Corporation Depth layer extraction and image synthesis from focus varied multiple images
US9092875B2 (en) 2011-04-12 2015-07-28 Panasonic Intellectual Property Management Co., Ltd. Motion estimation apparatus, depth estimation apparatus, and motion estimation method
US9501834B2 (en) * 2011-08-18 2016-11-22 Qualcomm Technologies, Inc. Image capture for later refocusing or focus-manipulation
JP5786847B2 (ja) * 2012-12-19 2015-09-30 カシオ計算機株式会社 撮像装置、撮像方法及びプログラム
US9344619B2 (en) * 2013-08-30 2016-05-17 Qualcomm Incorporated Method and apparatus for generating an all-in-focus image
US9971153B2 (en) * 2014-03-29 2018-05-15 Frimory Technologies Ltd. Method and apparatus for displaying video data
CN105100579B (zh) * 2014-05-09 2018-12-07 华为技术有限公司 一种图像数据的采集处理方法及相关装置
KR102220443B1 (ko) * 2014-06-09 2021-02-25 삼성전자주식회사 깊이 정보를 활용하는 전자 장치 및 방법
US10582125B1 (en) 2015-06-01 2020-03-03 Amazon Technologies, Inc. Panoramic image generation from video
JP6700813B2 (ja) * 2016-01-29 2020-05-27 キヤノン株式会社 画像処理装置、撮像装置、画像処理方法、及びプログラム
EP3559862B1 (en) 2016-12-23 2022-06-15 Magic Leap, Inc. Techniques for determining settings for a content capture device
CN110663246B (zh) 2017-05-24 2021-08-06 深圳市大疆创新科技有限公司 用于处理图像的方法和系统
CN108200344A (zh) * 2018-01-23 2018-06-22 江苏冠达通电子科技有限公司 摄像机的调整变焦方法
US10917571B2 (en) * 2018-11-05 2021-02-09 Sony Corporation Image capture device control based on determination of blur value of objects in images
WO2021000063A1 (en) 2019-06-29 2021-01-07 Qualcomm Incorporated Automatic focus distance extension
CN112529951B (zh) * 2019-09-18 2024-06-25 华为技术有限公司 扩展景深图像的获取方法、装置及电子设备

Also Published As

Publication number Publication date
US20220237813A1 (en) 2022-07-28
CN116762356A (zh) 2023-09-15
US11756221B2 (en) 2023-09-12
EP4285581A1 (en) 2023-12-06
BR112023014085A2 (pt) 2023-12-12
TWI899424B (zh) 2025-10-01
JP2024504270A (ja) 2024-01-31
TW202236840A (zh) 2022-09-16
WO2022165462A1 (en) 2022-08-04

Similar Documents

Publication Publication Date Title
US11756221B2 (en) Image fusion for scenes with objects at multiple depths
KR102278776B1 (ko) 이미지 처리 방법, 기기, 및 장치
CN107977940B (zh) 背景虚化处理方法、装置及设备
CN107087107B (zh) 基于双摄像头的图像处理装置及方法
US20210390747A1 (en) Image fusion for image capture and processing systems
US9325899B1 (en) Image capturing device and digital zooming method thereof
US20140226858A1 (en) Method of tracking object using camera and camera system for object tracking
US8942509B2 (en) Apparatus and method creating ghost-free high dynamic range image using filtering
US9792698B2 (en) Image refocusing
US11863881B2 (en) Selectively increasing depth-of-field in scenes with multiple regions of interest
US20180183998A1 (en) Power reduction and performance improvement through selective sensor image downscaling
CN119137968B (zh) 用于图像处理的方法、装置、介质和产品
KR20240024821A (ko) 개선된 장면 무결성을 위한 시간적 필터링 재시작
EP4349008B1 (en) Infrared-based white balancing of an image
CN120303687A (zh) 图像帧内的选择性运动失真校正
KR20240031246A (ko) 다수의 관심 영역들을 갖는 장면들에서 선택적으로 증가하는 피사계 심도
CN110365897B (zh) 图像修正方法和装置、电子设备、计算机可读存储介质
US20240209843A1 (en) Scalable voxel block selection
US12401897B2 (en) Lens positioning for secondary camera in multi-camera system
US12028609B2 (en) Camera sensor changes in multi-sensor device
CN117616449A (zh) 选择性地增加具有多个感兴趣区域的场景中的景深
CN118871946A (zh) 使用感兴趣区域（roi）细化的多相机对齐

Legal Events

Date Code Title Description
PA0105 International application

Patent event date: 20230719

Patent event code: PA01051R01D

Comment text: International Patent Application

PG1501 Laying open of application
A201 Request for examination
PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20241227

Comment text: Request for Examination of Application