WO2023053674A1 - 検出方法、撮像装置、及びプログラム - Google Patents

検出方法、撮像装置、及びプログラム Download PDF

Info

Publication number
WO2023053674A1
WO2023053674A1 PCT/JP2022/027947 JP2022027947W WO2023053674A1 WO 2023053674 A1 WO2023053674 A1 WO 2023053674A1 JP 2022027947 W JP2022027947 W JP 2022027947W WO 2023053674 A1 WO2023053674 A1 WO 2023053674A1
Authority
WO
WIPO (PCT)
Prior art keywords
signal
image
input
model
focus position
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2022/027947
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
仁史 桜武
秀昭 國分
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujifilm Corp
Original Assignee
Fujifilm Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujifilm Corp filed Critical Fujifilm Corp
Priority to CN202280065355.1A priority Critical patent/CN118043714A/zh
Priority to JP2023550400A priority patent/JPWO2023053674A1/ja
Publication of WO2023053674A1 publication Critical patent/WO2023053674A1/ja
Priority to US18/600,784 priority patent/US20240214677A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/28—Systems for automatic generation of focusing signals
    • G02B7/34—Systems for automatic generation of focusing signals using different areas in a pupil plane
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B13/00—Viewfinders; Focusing aids for cameras; Means for focusing for cameras; Autofocus systems for cameras
    • G03B13/32—Means for focusing
    • G03B13/34—Power focusing
    • G03B13/36—Autofocus systems
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B15/00—Special procedures for taking photographs; Apparatus therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H04N23/672—Focus control based on electronic image sensor signals based on the phase difference signals

Definitions

  • the input image is rotated and input to the model, and in the first focus position detection step, the focus position is detected based on the rotated input image.
  • the exposure amount of the phase difference pixels P1 and P2 and the exposure amount of the imaging pixel N are different.
  • the phase difference detection direction by the phase difference pixels P1 and P2 of the imaging sensor 20 is the horizontal direction.
  • the clearer the luminance difference in the horizontal direction in the phase-difference image IP the higher the detection accuracy of the in-focus position. Therefore, by performing horizontal pooling on the phase difference image IP in the second sub-network 62, the feature in the horizontal direction is emphasized, thereby improving the inference accuracy regarding the in-focus position.
  • the image processing unit 52 generates a normal image IN based on the signals generated by the imaging pixels N, and generates a phase difference image IP based on the signals generated by the phase difference pixels P1 and P2 (step S12).
  • the input unit 53 performs input processing for inputting the phase difference image IP to the model M as an input image (step S13).
  • the subject detection unit 54 performs subject detection processing for detecting a specific subject included in the normal image IN using the model M for which the input processing has been performed (step S14).
  • step S20 If there is an imaging instruction (step S20: YES), the main control unit 50 causes the imaging sensor 20 to perform an imaging operation, and records the normal image IN generated by the image processing unit 52 in the memory 42 as a still image. Still image pickup processing is performed (step S21).
  • the detection accuracy of the subject and the in-focus position is improved, so a highly accurate subject tracking function can be realized.
  • This makes it possible to perform control such that an in-focus subject is set as a tracking target and an out-of-focus subject is not set as a tracking target.
  • the model M by detecting the in-focus position using the model M, it may be possible to detect the in-focus position with high accuracy in a situation where the detection accuracy of the in-focus position by correlation calculation is low.
  • the memory 42 may store the first model M1 and the second model M2.
  • the first model M1 is a model suitable for detection of the in-focus position when the phase difference detection direction is the horizontal direction.
  • the second model M2 is a model suitable for detecting the in-focus position when the phase difference detection direction is the vertical direction.
  • the first model M1 and the second model M2 have basically the same configuration as the model M of the above embodiment, but the first model M1 is configured to perform horizontal pooling in the second sub-network, A second model M2 is configured for vertical pooling in the second sub-network.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Evolutionary Computation (AREA)
  • Health & Medical Sciences (AREA)
  • Databases & Information Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Artificial Intelligence (AREA)
  • Optics & Photonics (AREA)
  • Focusing (AREA)
  • Studio Devices (AREA)
PCT/JP2022/027947 2021-09-30 2022-07-15 検出方法、撮像装置、及びプログラム Ceased WO2023053674A1 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN202280065355.1A CN118043714A (zh) 2021-09-30 2022-07-15 检测方法、摄像装置及程序
JP2023550400A JPWO2023053674A1 (https=) 2021-09-30 2022-07-15
US18/600,784 US20240214677A1 (en) 2021-09-30 2024-03-11 Detection method, imaging apparatus, and program

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2021161788 2021-09-30
JP2021-161788 2021-09-30

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/600,784 Continuation US20240214677A1 (en) 2021-09-30 2024-03-11 Detection method, imaging apparatus, and program

Publications (1)

Publication Number Publication Date
WO2023053674A1 true WO2023053674A1 (ja) 2023-04-06

Family

ID=85782270

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/027947 Ceased WO2023053674A1 (ja) 2021-09-30 2022-07-15 検出方法、撮像装置、及びプログラム

Country Status (4)

Country Link
US (1) US20240214677A1 (https=)
JP (1) JPWO2023053674A1 (https=)
CN (1) CN118043714A (https=)
WO (1) WO2023053674A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2025089013A1 (ja) * 2023-10-25 2025-05-01 富士フイルム株式会社 位相差マップ生成装置及び生成方法、画像データ取得装置、合焦制御方法、学習方法、及び位相差マップ生成器

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007065002A (ja) * 2005-08-29 2007-03-15 Canon Inc 焦点検出装置及び撮像装置
JP2016153984A (ja) * 2015-02-20 2016-08-25 株式会社デンソーアイティーラボラトリ ニューラルネットワーク処理装置、ニューラルネットワーク処理方法、検出装置、検出方法、および、車両
US20170094153A1 (en) * 2015-07-02 2017-03-30 Pixart Imaging Inc. Distance measurement device based on phase difference and distance measurement method thereof
WO2019073814A1 (ja) * 2017-10-13 2019-04-18 ソニー株式会社 焦点検出装置および方法、並びにプログラム
JP2019215489A (ja) * 2018-06-14 2019-12-19 オリンパス株式会社 撮像装置および焦点調節方法

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2020198470A (ja) * 2019-05-30 2020-12-10 ソニーセミコンダクタソリューションズ株式会社 画像認識装置および画像認識方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007065002A (ja) * 2005-08-29 2007-03-15 Canon Inc 焦点検出装置及び撮像装置
JP2016153984A (ja) * 2015-02-20 2016-08-25 株式会社デンソーアイティーラボラトリ ニューラルネットワーク処理装置、ニューラルネットワーク処理方法、検出装置、検出方法、および、車両
US20170094153A1 (en) * 2015-07-02 2017-03-30 Pixart Imaging Inc. Distance measurement device based on phase difference and distance measurement method thereof
WO2019073814A1 (ja) * 2017-10-13 2019-04-18 ソニー株式会社 焦点検出装置および方法、並びにプログラム
JP2019215489A (ja) * 2018-06-14 2019-12-19 オリンパス株式会社 撮像装置および焦点調節方法

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2025089013A1 (ja) * 2023-10-25 2025-05-01 富士フイルム株式会社 位相差マップ生成装置及び生成方法、画像データ取得装置、合焦制御方法、学習方法、及び位相差マップ生成器

Also Published As

Publication number Publication date
CN118043714A (zh) 2024-05-14
US20240214677A1 (en) 2024-06-27
JPWO2023053674A1 (https=) 2023-04-06

Similar Documents

Publication Publication Date Title
JP5207797B2 (ja) 撮像装置およびその制御方法
US8730374B2 (en) Focus detection apparatus
TWI462055B (zh) 具有合成全色影像之彩色濾光器陣列影像
JP6584149B2 (ja) 撮像装置
US20100110272A1 (en) Image pickup apparatus
JP6249825B2 (ja) 撮像装置、その制御方法、および制御プログラム
JP2008015754A (ja) 撮像装置、画像処理装置および画像処理方法
JP2009217074A (ja) 焦点検出装置
JP6486149B2 (ja) 画像処理装置、撮像装置、画像処理方法、プログラム、および、記憶媒体
JP5348258B2 (ja) 撮像装置
JP2019095480A (ja) 撮像装置及びその制御方法、プログラム、記憶媒体
JP2016213819A (ja) 画像処理装置、撮像装置、画像処理方法、プログラム、および、記憶媒体
JP7005236B2 (ja) 撮像装置及びその制御方法、プログラム、記憶媒体
JP2024071452A (ja) 撮像装置、撮像装置の駆動方法、及びプログラム
JP2017158018A (ja) 画像処理装置およびその制御方法、撮像装置
WO2019202984A1 (ja) 撮像装置並びに距離計測方法、距離計測プログラム及び記録媒体
JP6254843B2 (ja) 画像処理装置およびその制御方法
US20240214677A1 (en) Detection method, imaging apparatus, and program
JP2010014788A (ja) 撮像素子、撮像装置
JP2019219577A (ja) 検出装置および検出方法
JP2020171050A (ja) 画像処理装置、撮像装置、画像処理方法、および、記憶媒体
CN114518641B (zh) 摄像设备、镜头设备及其控制方法和存储介质
JP2021071573A (ja) 撮像装置及びその制御方法
JP6526294B2 (ja) 撮像装置及びレンズ装置
JP7071165B2 (ja) 表示制御装置及び方法、及び撮像装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22875552

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2023550400

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 202280065355.1

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22875552

Country of ref document: EP

Kind code of ref document: A1