JP7696702B2 - 画像処理装置、撮像装置、及び画像処理装置の制御方法並びにプログラム - Google Patents

画像処理装置、撮像装置、及び画像処理装置の制御方法並びにプログラム Download PDF

Info

Publication number
JP7696702B2
JP7696702B2 JP2020151561A JP2020151561A JP7696702B2 JP 7696702 B2 JP7696702 B2 JP 7696702B2 JP 2020151561 A JP2020151561 A JP 2020151561A JP 2020151561 A JP2020151561 A JP 2020151561A JP 7696702 B2 JP7696702 B2 JP 7696702B2
Authority
JP
Japan
Prior art keywords
image
images
synthesis
alignment
group
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020151561A
Other languages
English (en)
Japanese (ja)
Other versions
JP2022045787A (ja
JP2022045787A5 (https=
Inventor
友美 上杉
晃一 鷲巣
光洋 齊藤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Priority to JP2020151561A priority Critical patent/JP7696702B2/ja
Priority to US17/467,337 priority patent/US12020410B2/en
Priority to CN202111051189.3A priority patent/CN114244972B/zh
Publication of JP2022045787A publication Critical patent/JP2022045787A/ja
Publication of JP2022045787A5 publication Critical patent/JP2022045787A5/ja
Application granted granted Critical
Publication of JP7696702B2 publication Critical patent/JP7696702B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/80Geometric correction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/50Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/30Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • G06T7/337Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods involving reference images or patches
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/54Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/62Control of parameters via user interfaces
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/681Motion detection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/681Motion detection
    • H04N23/6812Motion detection based on additional sensors, e.g. acceleration sensors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682Vibration or motion blur correction
    • H04N23/683Vibration or motion blur correction performed by a processor, e.g. controlling the readout of an image memory
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682Vibration or motion blur correction
    • H04N23/685Vibration or motion blur correction performed by mechanical compensation
    • H04N23/687Vibration or motion blur correction performed by mechanical compensation by shifting the lens or sensor position
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/741Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20212Image combination
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20212Image combination
    • G06T2207/20221Image fusion; Image merging

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Studio Devices (AREA)
  • Adjustment Of Camera Lenses (AREA)
  • Stroboscope Apparatuses (AREA)
  • Geometry (AREA)
JP2020151561A 2020-09-09 2020-09-09 画像処理装置、撮像装置、及び画像処理装置の制御方法並びにプログラム Active JP7696702B2 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2020151561A JP7696702B2 (ja) 2020-09-09 2020-09-09 画像処理装置、撮像装置、及び画像処理装置の制御方法並びにプログラム
US17/467,337 US12020410B2 (en) 2020-09-09 2021-09-06 Image processing apparatus that aligns images, image pickup apparatus including image processing apparatus, and control method for image processing apparatus
CN202111051189.3A CN114244972B (zh) 2020-09-09 2021-09-08 图像处理设备、摄像设备和图像处理方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2020151561A JP7696702B2 (ja) 2020-09-09 2020-09-09 画像処理装置、撮像装置、及び画像処理装置の制御方法並びにプログラム

Publications (3)

Publication Number Publication Date
JP2022045787A JP2022045787A (ja) 2022-03-22
JP2022045787A5 JP2022045787A5 (https=) 2023-09-14
JP7696702B2 true JP7696702B2 (ja) 2025-06-23

Family

ID=80469922

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2020151561A Active JP7696702B2 (ja) 2020-09-09 2020-09-09 画像処理装置、撮像装置、及び画像処理装置の制御方法並びにプログラム

Country Status (3)

Country Link
US (1) US12020410B2 (https=)
JP (1) JP7696702B2 (https=)
CN (1) CN114244972B (https=)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11711613B2 (en) * 2021-04-27 2023-07-25 Qualcomm Incorporated Image alignment for computational photography

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080106608A1 (en) 2006-11-08 2008-05-08 Airell Richard Clark Systems, devices and methods for digital camera image stabilization
JP2013141105A (ja) 2011-12-29 2013-07-18 Nikon Corp 画像処理装置および電子カメラ、並びに画像処理プログラム
JP2016076838A (ja) 2014-10-07 2016-05-12 キヤノン株式会社 画像処理装置及び画像処理装置の制御方法
JP2017220745A (ja) 2016-06-06 2017-12-14 オリンパス株式会社 撮像装置

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4418632B2 (ja) 2003-01-15 2010-02-17 キヤノン株式会社 撮影装置、合成画像生成方法およびプログラム
JP2008079123A (ja) * 2006-09-22 2008-04-03 Olympus Corp 撮像装置及びフォーカス制御プログラム
JP2008219124A (ja) * 2007-02-28 2008-09-18 Sanyo Electric Co Ltd 撮像装置
US8189061B1 (en) * 2007-03-21 2012-05-29 Ambarella, Inc. Digital still camera with multiple frames combined into a single frame for digital anti-shake/anti-blur
JP4492724B2 (ja) * 2008-03-25 2010-06-30 ソニー株式会社 画像処理装置、画像処理方法、プログラム
JP2010187207A (ja) * 2009-02-12 2010-08-26 Olympus Corp 画像合成装置、画像合成プログラム、および画像合成方法
JP5596959B2 (ja) * 2009-10-29 2014-09-24 キヤノン株式会社 撮像装置およびその制御方法
JP2011176776A (ja) * 2010-02-25 2011-09-08 Olympus Corp 画像処理装置及び画像処理方法
US9324190B2 (en) * 2012-02-24 2016-04-26 Matterport, Inc. Capturing and aligning three-dimensional scenes
JP5948960B2 (ja) * 2012-02-29 2016-07-06 株式会社ニコン カメラ、画像処理装置及びプログラム
JP2016163327A (ja) * 2015-03-05 2016-09-05 キヤノン株式会社 画像処理装置、画像処理方法及びプログラム
CN111524067B (zh) * 2020-04-01 2023-09-12 北京东软医疗设备有限公司 一种图像处理方法、装置和设备

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080106608A1 (en) 2006-11-08 2008-05-08 Airell Richard Clark Systems, devices and methods for digital camera image stabilization
JP2013141105A (ja) 2011-12-29 2013-07-18 Nikon Corp 画像処理装置および電子カメラ、並びに画像処理プログラム
JP2016076838A (ja) 2014-10-07 2016-05-12 キヤノン株式会社 画像処理装置及び画像処理装置の制御方法
JP2017220745A (ja) 2016-06-06 2017-12-14 オリンパス株式会社 撮像装置

Also Published As

Publication number Publication date
JP2022045787A (ja) 2022-03-22
US12020410B2 (en) 2024-06-25
CN114244972A (zh) 2022-03-25
CN114244972B (zh) 2025-10-31
US20220076390A1 (en) 2022-03-10

Similar Documents

Publication Publication Date Title
JP4960907B2 (ja) 撮影装置および撮影方法
CN103533230B (zh) 摄像设备、光学设备、摄像系统和控制方法
JP4618100B2 (ja) 撮像装置、撮像方法、およびプログラム
CN100525384C (zh) 图像摄取装置及其控制方法、图像处理装置和图像处理方法
US8379096B2 (en) Information processing apparatus and method for synthesizing corrected image data
CN102340626B (zh) 摄像装置、及图像合成方法
US20100295954A1 (en) Image processing apparatus and image processing method
JP2012147379A (ja) 撮像装置及び撮像装置の制御方法
JP2013165485A (ja) 画像処理装置、撮像装置およびコンピュータブログラム
US10257437B2 (en) Imaging apparatus and control method for positioning a plurality of images continuously captured by an image sensor
JP2013165483A (ja) 画像処理装置、撮像装置、およびコンピュータブログラム
JP2006080844A (ja) 電子カメラ
JP7696702B2 (ja) 画像処理装置、撮像装置、及び画像処理装置の制御方法並びにプログラム
JP2017225072A (ja) 撮像装置、その制御方法、及びプログラム
JP2002247444A (ja) 画像処理装置及び画像処理プログラムを記録した記録媒体
JP2021118466A (ja) 撮像装置およびその制御方法
JP4636979B2 (ja) 撮像装置及びその制御方法
JP2022045787A5 (https=)
JP5962974B2 (ja) 撮像装置、撮像方法、及びプログラム
JP2006157342A (ja) カメラモジュール
JP5284195B2 (ja) 画像処理装置、画像処理方法、プログラム及び記録媒体
US9549112B2 (en) Image capturing apparatus, and control method therefor
JP2006086741A (ja) 画像処理装置及び画像処理方法
JP2003018461A (ja) 画像合成方法及び画像合成装置
WO2011118134A1 (ja) 撮影装置、画像合成方法及び画像合成プログラム

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230905

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20230905

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20240628

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240709

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240829

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20241210

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20250210

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20250513

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20250611

R150 Certificate of patent or registration of utility model

Ref document number: 7696702

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150