JP2025513696A - 可変絞り(va)カメラシステムにおけるボケ効果 - Google Patents

可変絞り(va)カメラシステムにおけるボケ効果 Download PDF

Info

Publication number
JP2025513696A
JP2025513696A JP2024554199A JP2024554199A JP2025513696A JP 2025513696 A JP2025513696 A JP 2025513696A JP 2024554199 A JP2024554199 A JP 2024554199A JP 2024554199 A JP2024554199 A JP 2024554199A JP 2025513696 A JP2025513696 A JP 2025513696A
Authority
JP
Japan
Prior art keywords
image data
determining
map
image
blur
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2024554199A
Other languages
English (en)
Japanese (ja)
Other versions
JP2025513696A5 (enExample
Inventor
ウェン-チュン・フェン
フイ・シャン・カオ
カイ・リウ
Original Assignee
クアルコム,インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by クアルコム,インコーポレイテッド filed Critical クアルコム,インコーポレイテッド
Publication of JP2025513696A publication Critical patent/JP2025513696A/ja
Publication of JP2025513696A5 publication Critical patent/JP2025513696A5/ja
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2621—Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/60—Image enhancement or restoration using machine learning, e.g. neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/70—Denoising; Smoothing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/73—Deblurring; Sharpening
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H04N23/676—Bracketing for image capture at varying focusing conditions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/743—Bracketing, i.e. taking a series of images with varying exposure conditions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H04N23/958—Computational photography systems, e.g. light-field imaging systems for extended depth of field imaging
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/2224—Studio circuitry; Studio devices; Studio equipment related to virtual studio applications
    • H04N5/2226—Determination of depth image, e.g. for foreground/background separation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10141—Special mode during image acquisition
    • G06T2207/10148—Varying focus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20004—Adaptive image processing
    • G06T2207/20012—Locally adaptive
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computing Systems (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
JP2024554199A 2022-03-24 2023-03-15 可変絞り(va)カメラシステムにおけるボケ効果 Pending JP2025513696A (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US17/656,361 US11727537B1 (en) 2022-03-24 2022-03-24 Bokeh effect in variable aperture (VA) camera systems
US17/656,361 2022-03-24
PCT/US2023/064445 WO2023183743A1 (en) 2022-03-24 2023-03-15 Bokeh effect in variable aperture (va) camera systems

Publications (2)

Publication Number Publication Date
JP2025513696A true JP2025513696A (ja) 2025-04-30
JP2025513696A5 JP2025513696A5 (enExample) 2026-03-10

Family

ID=86226972

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2024554199A Pending JP2025513696A (ja) 2022-03-24 2023-03-15 可変絞り(va)カメラシステムにおけるボケ効果

Country Status (7)

Country Link
US (1) US11727537B1 (enExample)
EP (1) EP4500843A1 (enExample)
JP (1) JP2025513696A (enExample)
KR (1) KR20240167802A (enExample)
CN (1) CN118872259A (enExample)
TW (1) TW202345086A (enExample)
WO (1) WO2023183743A1 (enExample)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119174187A (zh) * 2022-05-10 2024-12-20 高通股份有限公司 具有可变光圈能力的图像捕获设备的相机转换

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5478215B2 (ja) * 2009-11-25 2014-04-23 オリンパスイメージング株式会社 撮影装置および撮影装置の制御方法
US20160042522A1 (en) * 2010-02-19 2016-02-11 Dual Aperture International Co. Ltd. Processing Multi-Aperture Image Data
US8363085B2 (en) * 2010-07-06 2013-01-29 DigitalOptics Corporation Europe Limited Scene background blurring including determining a depth map
US8593565B2 (en) * 2011-03-25 2013-11-26 Gary S. Shuster Simulated large aperture lens
JP5830348B2 (ja) * 2011-10-26 2015-12-09 オリンパス株式会社 撮像装置
AU2012258467A1 (en) * 2012-12-03 2014-06-19 Canon Kabushiki Kaisha Bokeh amplification
US9497380B1 (en) * 2013-02-15 2016-11-15 Red.Com, Inc. Dense field imaging
US9734551B1 (en) * 2013-12-01 2017-08-15 Google Inc. Providing depth-of-field renderings
CN103945118B (zh) * 2014-03-14 2017-06-20 华为技术有限公司 图像虚化方法、装置及电子设备
US9787899B1 (en) * 2014-08-12 2017-10-10 Amazon Technologies, Inc. Multiple captures with a variable aperture
US9292926B1 (en) * 2014-11-24 2016-03-22 Adobe Systems Incorporated Depth map generation
US9530214B2 (en) * 2014-12-04 2016-12-27 Sony Corporation Image processing system with depth map determination based on iteration count of blur difference and method of operation thereof
US10284835B2 (en) * 2015-09-04 2019-05-07 Apple Inc. Photo-realistic shallow depth-of-field rendering from focal stacks
CN106504220B (zh) * 2016-08-19 2019-07-23 华为机器有限公司 一种图像处理方法及装置
KR102229811B1 (ko) * 2016-10-28 2021-03-18 후아웨이 테크놀러지 컴퍼니 리미티드 단말기를 위한 촬영 방법 및 단말기
US10200599B1 (en) * 2017-09-07 2019-02-05 Qualcomm Incorporated Image capture setting determination in devices having access to multiple cameras
WO2019089039A1 (en) * 2017-11-03 2019-05-09 Google Llc Aperture supervision for single-view depth prediction
US10810707B2 (en) * 2018-11-29 2020-10-20 Adobe Inc. Depth-of-field blur effects generating techniques
WO2020187425A1 (en) * 2019-03-21 2020-09-24 Huawei Technologies Co., Ltd. Depth of field image refocusing
US11132772B2 (en) * 2019-06-11 2021-09-28 Samsung Electronics Co., Ltd. Asymmetric normalized correlation layer for deep neural network feature matching
US11094041B2 (en) * 2019-11-29 2021-08-17 Samsung Electronics Co., Ltd. Generation of bokeh images using adaptive focus range and layered scattering
US11941782B2 (en) * 2020-06-16 2024-03-26 Adobe Inc. GPU-based lens blur rendering using depth maps
US11184553B1 (en) * 2020-09-23 2021-11-23 Qualcomm Incorporated Image signal processing in multi-camera system
US11756221B2 (en) * 2021-01-28 2023-09-12 Qualcomm Incorporated Image fusion for scenes with objects at multiple depths
US11863729B2 (en) * 2021-09-21 2024-01-02 Qualcomm Incorporated Systems and methods for generating synthetic depth of field effects

Also Published As

Publication number Publication date
EP4500843A1 (en) 2025-02-05
US11727537B1 (en) 2023-08-15
WO2023183743A1 (en) 2023-09-28
TW202345086A (zh) 2023-11-16
CN118872259A (zh) 2024-10-29
KR20240167802A (ko) 2024-11-28

Similar Documents

Publication Publication Date Title
US12096129B2 (en) Multi-frame auto exposure control (AEC)
US12526539B2 (en) Image processing with adjustable Bokeh effect
JP2025503391A (ja) インセンサズームを用いた高ダイナミックレンジ(hdr)写真撮影
US20240193789A1 (en) Selective motion distortion correction within image frames
US12375806B2 (en) Dynamic image capture device configuration for improved image stabilization
CN118235422A (zh) 图像捕获设备中减少的时延模式切换
KR20240031246A (ko) 다수의 관심 영역들을 갖는 장면들에서 선택적으로 증가하는 피사계 심도
US20250200710A1 (en) Camera transition for image capture devices with variable aperture capability
US11727537B1 (en) Bokeh effect in variable aperture (VA) camera systems
US12015856B2 (en) Image processing for aperture size transition in a variable aperture (VA) camera
WO2023178656A1 (en) Multi-camera alignment using region of interest (roi) refinement
CN118489254A (zh) 基于活动检测的图像校正
JP7744447B2 (ja) ノイズ低減のためのカスケード画像処理
US20250086821A1 (en) Image frame blending control using eye detection
US12627896B2 (en) Image processing for exposure bracketing
EP4544784A1 (en) Dynamic image capture device configuration for improved image stabilization
WO2024206028A1 (en) Image processing with single interpolation operation for de-mosaicing and warping

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20260227

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20260227