WO2019242617A1 - Determining device, photographing device, determining method, and program - Google Patents

Determining device, photographing device, determining method, and program Download PDF

Info

Publication number
WO2019242617A1
WO2019242617A1 PCT/CN2019/091744 CN2019091744W WO2019242617A1 WO 2019242617 A1 WO2019242617 A1 WO 2019242617A1 CN 2019091744 W CN2019091744 W CN 2019091744W WO 2019242617 A1 WO2019242617 A1 WO 2019242617A1
Authority
WO
WIPO (PCT)
Prior art keywords
contrast evaluation
evaluation values
frequency component
image
focus lens
Prior art date
Application number
PCT/CN2019/091744
Other languages
French (fr)
Chinese (zh)
Inventor
永山佳范
关范江
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to CN201980005655.9A priority Critical patent/CN111344631A/en
Publication of WO2019242617A1 publication Critical patent/WO2019242617A1/en

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/28Systems for automatic generation of focusing signals
    • G02B7/36Systems for automatic generation of focusing signals using image sharpness techniques, e.g. image processing techniques for generating autofocus signals
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B13/00Viewfinders; Focusing aids for cameras; Means for focusing for cameras; Autofocus systems for cameras
    • G03B13/32Means for focusing
    • G03B13/34Power focusing
    • G03B13/36Autofocus systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules

Definitions

  • the invention relates to a determination device, an imaging device, a determination method and a program.
  • Patent Document 1 describes that a defocus amount is corrected based on a spatial frequency component included in a subject image.
  • the determination device may include an acquisition section that acquires an image captured by an imaging device including a focusing lens.
  • the determination device may include a first filter section that passes a first frequency component of a spatial frequency component of the image.
  • the determination device may include a second filter section that passes a second frequency component of a higher frequency band than the first frequency component of the spatial frequency component of the image.
  • the determining device may include a deriving section that derives a first contrast evaluation value of the image using a first frequency component of the image, and derives a second contrast evaluation value of the image using a second frequency component of the image.
  • the determination device may include a detection section that detects peaks of a plurality of first contrast evaluation values of each of the plurality of images.
  • the determining device may include a determination section that, when a plurality of peaks of the first contrast evaluation values are detected by the detection section, determines whether the plurality of second contrast evaluation values of each of the plurality of images satisfy a predetermined condition.
  • the determination device may include a determination section that determines the position of the focus lens based on the plurality of second contrast evaluation values when the plurality of second contrast evaluation values satisfy a predetermined condition.
  • the determination section may determine the position of the focusing lens based on the plurality of first contrast evaluation values.
  • the detection unit may detect a plurality of peaks of the second contrast evaluation value.
  • the predetermined condition may be that a plurality of peaks of the second contrast evaluation value are detected by the detection section.
  • the detection unit may detect a plurality of peaks of the second contrast evaluation value.
  • the predetermined condition may be that a plurality of peak values of the second contrast evaluation values detected by the detection section are equal to or greater than a predetermined value.
  • the detection unit may detect a plurality of peaks of the second contrast evaluation value.
  • the predetermined condition may be that peaks of the plurality of second contrast evaluation values detected by the detection section are greater than or equal to a predetermined value, and a difference between a maximum value and a minimum value of the plurality of second contrast evaluation values is greater than or equal to the predetermined difference.
  • the predetermined condition may be that a difference between a position of the focus lens determined based on the plurality of first contrast evaluation values and a position of the focus lens determined based on the plurality of second contrast evaluation values is within a predetermined range.
  • the detection unit may detect a plurality of peaks of the second contrast evaluation value.
  • the predetermined condition may be that a difference between a position of the focus lens determined based on the plurality of first contrast evaluation values and a position of the focus lens determined based on the plurality of second contrast evaluation values is within a predetermined range, and The peak values of the two second contrast evaluation values are greater than or equal to a predetermined value, and the difference between the maximum value and the minimum value of the plurality of second contrast evaluation values is greater than or equal to the predetermined difference.
  • the imaging device may include the above-mentioned determination device.
  • the imaging device may include a focusing lens.
  • the imaging device may include a control section that controls the position of the focus lens based on the position of the focus lens determined by the determination device.
  • the determination method may include a stage of acquiring an image captured by an imaging device including a focusing lens.
  • the determination method may include a stage of passing a first frequency component among the spatial frequency components of the image via the first filter section.
  • the determination method may include a stage of passing a second frequency component of a higher frequency band than a first frequency component of a spatial frequency component of the image via a second filter.
  • the determination method may include a stage of deriving a first contrast evaluation value of the image using a first frequency component of the image.
  • the determination method may include a stage of deriving a second contrast evaluation value of the image using the second frequency component of the image.
  • the determination method may include a step of detecting peaks of a plurality of first contrast evaluation values of each of the plurality of images.
  • the determining method may include a stage of determining whether a plurality of second contrast evaluation values of each of the plurality of images satisfy a predetermined condition when a plurality of peaks of the first contrast evaluation values are detected in a detection stage.
  • the determination method may include a stage of determining a position of the focus lens based on the plurality of second contrast evaluation values when the plurality of second contrast evaluation values satisfy a predetermined condition.
  • the program according to one aspect of the present invention may be a program for causing a computer to function as the determination device.
  • the accuracy of the process of determining the position of the focus lens can be further improved.
  • FIG. 1 is a diagram illustrating an example of a functional block of the imaging device.
  • FIG. 2 is a diagram showing an example of functional blocks of an imaging control unit.
  • FIG. 3 is a diagram showing a relationship between a contrast evaluation value of each spatial frequency component and a position of a focus lens.
  • FIG. 4 is a flowchart illustrating an example of a process for determining a position of a focus lens for bringing a desired subject into an in-focus state.
  • a frame may represent (1) a stage of a process of performing an operation or (2) a "part" of a device having a role of performing an operation.
  • the specified stages and "departments" may be implemented by programmable circuits and / or processors.
  • the dedicated circuits may include digital and / or analog hardware circuits. It may include integrated circuits (ICs) and / or discrete circuits.
  • Programmable circuits may include reconfigurable hardware circuits.
  • Reconfigurable hardware circuits can include logical AND, logical OR, logical XOR, logical NAND, logical NOR, and other logical operations, flip-flops, registers, field programmable gate arrays (FPGAs), and programmable logic arrays (PLAs) ) And other memory elements.
  • Computer-readable media can include any tangible device capable of storing instructions for execution by a suitable device.
  • a computer-readable medium having instructions stored thereon includes a product including instructions that can be executed to create a means for performing the operations specified by the flowchart or block diagram.
  • an electronic storage medium, a magnetic storage medium, an optical storage medium, an electromagnetic storage medium, a semiconductor storage medium, and the like may be included.
  • a floppy disk (registered trademark), a floppy disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory) may be included ), Electrically erasable programmable read-only memory (EEPROM), static random access memory (SRAM), compact disc read-only memory (CD-ROM), digital versatile disc (DVD), Blu-ray (RTM) disc, memory stick, IC cards, etc.
  • EEPROM Electrically erasable programmable read-only memory
  • SRAM static random access memory
  • CD-ROM compact disc read-only memory
  • DVD digital versatile disc
  • RTM Blu-ray
  • Computer-readable instructions may include any of source code or object code described by any combination of one or more programming languages.
  • the source or object code includes traditional procedural programming languages.
  • Traditional programming languages can be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or Smalltalk, JAVA (registered trademark), C ++, etc.
  • the computer-readable instructions may be provided to a processor or a programmable circuit of a general-purpose computer, a special-purpose computer, or other programmable data processing device locally or via a wide area network (WAN) such as a local area network (LAN) or the Internet.
  • WAN wide area network
  • LAN local area network
  • a processor or programmable circuit can execute computer-readable instructions to create a means for performing the operations specified in the flowchart or block diagram.
  • Examples of the processor include a computer processor, a processing unit, a microprocessor, a digital signal processor, a controller, a microcontroller, and the like.
  • FIG. 1 illustrates an example of functional blocks of an imaging device 100 according to the present embodiment.
  • the imaging device 100 includes an imaging section 102 and a lens section 200.
  • the imaging section 102 includes an image sensor 120, an imaging control section 110, a memory 170, a display section 160, and an operation section 162.
  • the image sensor 120 may be composed of a CCD or a CMOS.
  • the image sensor 120 converts an optical image imaged through the plurality of lenses 210 into an electric signal.
  • the image sensor 120 outputs image data of an optical image formed by the plurality of lenses 210 to the imaging control section 110.
  • the imaging control unit 110 may be composed of a microprocessor such as a CPU or an MPU, and a microcontroller such as an MCU.
  • the imaging control unit 110 may control the imaging apparatus 100 according to an operation instruction from the control unit 162.
  • the memory 170 may be a computer-readable recording medium, and may include at least one of flash memories such as SRAM, DRAM, EPROM, EEPROM, and USB memory.
  • the memory 170 stores programs and the like necessary for the imaging control unit 110 to control the image sensor 120 and the like.
  • the memory 170 may be provided inside the casing of the imaging device 100.
  • the memory 170 may be provided so as to be detachable from the casing of the imaging apparatus 100.
  • the display section 160 may display image data output from the image sensor 120.
  • the display unit 160 can display various setting information of the imaging device 100.
  • the display section 160 may be a liquid crystal display, a touch panel display, or the like.
  • the display section 160 may include a plurality of liquid crystal displays or a touch panel display.
  • the lens unit 200 includes a plurality of lenses 210, a lens moving mechanism 212, and a lens control unit 220.
  • the multiple lenses 210 can function as zoom lenses, varifocal lenses, and focusing lenses. At least a part or all of the plurality of lenses 210 are configured to be movable along the optical axis.
  • the lens unit 200 may be an interchangeable lens provided to be detachable from the imaging unit 102.
  • the lens moving mechanism 212 can move at least a part or all of the plurality of lenses 210 along the optical axis.
  • the lens control section 220 drives the lens moving mechanism 212 according to a lens control instruction from the imaging section 102 to move one or more lenses 210 along the optical axis direction.
  • the lens control command is, for example, a zoom control command and a focus control command.
  • the imaging apparatus 100 configured in this manner derives the peak value of the contrast evaluation value based on a plurality of contrast evaluation values of the focus lens at a plurality of positions, and determines the position of the focus lens that brings a desired subject into an in-focus state. That is, the imaging apparatus 100 determines the position of the focus lens that brings a desired subject into an in-focus state through contrast AF processing.
  • the imaging device 100 extracts a predetermined specific spatial frequency component from an image via a filter. Furthermore, the imaging device 100 determines the position of the focus lens that brings a desired subject into an in-focus state by deriving a peak of a contrast evaluation value of a specific spatial frequency component.
  • a filter for extracting a specific spatial frequency component for example, a band-pass filter composed of an infinite impulse response (IIR) filter is sometimes used.
  • IIR infinite impulse response
  • the imaging device 100 determines the position of the focusing lens based on the contrast evaluation value of the spatial frequency component of 10 line pairs / mm.
  • the position of the focus lens that is determined based on the contrast evaluation value of the relatively lower frequency component may not be the position of the focus lens that brings the desired subject into the in-focus state.
  • the imaging device 100 corrects the position of the focus lens that obtains the peak value of the contrast evaluation value, and determines the position of the focus lens that is expected to bring a desired subject into an in-focus state. For example, the imaging apparatus 100 determines a position obtained by adding or subtracting a position of a focus lens that obtains a peak value of a contrast evaluation value with a predetermined correction amount as a position of the focus lens.
  • a correction amount is not necessarily the best correction amount for all subjects.
  • the imaging device 100 further improves the accuracy of the process of determining the focus lens position for bringing a desired subject into a focused state.
  • FIG. 2 is an example of functional blocks of the imaging control unit 110 according to the present embodiment.
  • the imaging control unit 110 includes an acquisition unit 111, a first filter unit 112, a second filter unit 113, a derivation unit 114, a detection unit 115, a determination unit 116, and a determination unit 117.
  • the acquisition unit 111 acquires an image captured by the imaging device 100.
  • the acquisition section 111 can acquire RAW data output from the image sensor 120.
  • the first filter unit 112 passes a first frequency component among the spatial frequency components of the image.
  • the second filter unit 113 passes a second frequency component of a higher frequency band than the first frequency component of the spatial frequency component of the image.
  • the first filter section 112 and the second filter section 113 may be band-pass filters made of IIR filters.
  • the second filter unit 113 can pass a spatial frequency component corresponding to the resolution of the imaging device 100.
  • the second filter section 113 can pass a spatial frequency component corresponding to a limit spatial frequency component which can obtain a predetermined contrast depending on the optical characteristics of the lens section 200 and the image sensor 120.
  • the second filter unit 113 can pass a spatial frequency component of 40 line pairs / mm from the image, for example.
  • the first filter section 112 can pass a spatial frequency component corresponding to a limit spatial frequency component obtained from a live view image displayed on the display section 160 of the imaging device 100.
  • the first filter unit 112 can pass a spatial frequency component of 10 line pairs / mm from the image, for example.
  • the deriving unit 114 may derive a first contrast evaluation value of the image using the first frequency component of the image.
  • the derivation unit 114 may use the second frequency component of the image to derive a second contrast evaluation value of the image.
  • the detection unit 115 detects peaks of a plurality of first contrast evaluation values of a plurality of images.
  • the detection unit 115 detects peaks of a plurality of first contrast evaluation values of a plurality of images captured by the imaging device 100 at a plurality of positions of the focus lens.
  • the detection unit 115 may detect a plurality of peaks of the first contrast evaluation values by a so-called mountain climbing method.
  • the detection section 115 may detect a plurality of second contrast evaluation values of each of the plurality of images.
  • the detection unit 115 detects peaks of a plurality of second contrast evaluation values of each of a plurality of images captured by the imaging device 100 at a plurality of positions of the focus lens.
  • the detection section 115 may detect a plurality of peaks of the second contrast evaluation value by a so-called mountain climbing method.
  • the detection section 115 may detect a peak of the first contrast evaluation value from a curve 500 obtained from a plurality of first contrast evaluation values as shown in FIG. 3.
  • the detection section 115 may detect a peak value of the second contrast evaluation value from a curve 502 obtained from a plurality of second contrast evaluation values as shown in FIG. 3.
  • the second frequency component is a relatively high spatial frequency component.
  • Contrast evaluation values of relatively high spatial frequency components tend to have relatively steep peaks. Contrast estimates of relatively high spatial frequency components sometimes contain a lot of noise.
  • the position of the focusing lens determined based on the peak of the contrast evaluation value of the relatively high spatial frequency component is sometimes more accurate than the position of the focusing lens determined based on the peak of the contrast evaluation value of the relatively low spatial frequency component .
  • the position of the focusing lens determined based on the peak value of the contrast evaluation value of the relatively high spatial frequency component and the peak value of the contrast evaluation value based on the relatively low spatial frequency component Compared to the position of the focusing lens, the accuracy is sometimes lower.
  • the determination section 116 determines whether the plurality of second contrast evaluation values of each of the plurality of images satisfy a predetermined condition.
  • the predetermined condition may be determined according to an index indicating the reliability of the second contrast evaluation value.
  • the predetermined condition may be that a plurality of peaks of the second contrast evaluation value are detected by the detection section 115.
  • the predetermined condition may be that a plurality of peak values of the second contrast evaluation values detected by the detection section 115 are equal to or greater than a predetermined value.
  • the predetermined condition may be that peaks of the plurality of second contrast evaluation values detected by the detection section 115 are greater than or equal to a predetermined value, and a difference between a maximum value and a minimum value of the plurality of second contrast evaluation values is greater than or equal to the predetermined difference.
  • the predetermined condition may be that a difference between a position of the focus lens determined based on the plurality of first contrast evaluation values and a position of the focus lens determined based on the plurality of second contrast evaluation values is within a predetermined range.
  • the predetermined condition may be that a difference between a position of the focus lens determined based on the plurality of first contrast evaluation values and a position of the focus lens determined based on the plurality of second contrast evaluation values is within a predetermined range, and is detected by the detection unit 115.
  • the peak values of the plurality of second contrast evaluation values are greater than or equal to a predetermined value, and the difference between the maximum value and the minimum value of the plurality of second contrast evaluation values is greater than or equal to a predetermined difference.
  • the determination unit 117 determines whether to select the first contrast evaluation value or the second contrast evaluation value according to whether or not the plurality of second contrast evaluation values satisfy a predetermined condition as the position for determining the focus lens.
  • Reference contrast evaluation value That is, when the plurality of second contrast evaluation values satisfy a predetermined condition, the determination section 117 may determine the position of the focus lens based on the plurality of second contrast evaluation values. When the plurality of second contrast evaluation values do not satisfy the predetermined condition, the determination section 117 may determine the position of the focus lens based on the plurality of first contrast evaluation values.
  • the imaging control section 110 may output a driving instruction of the focus lens to the lens control section 220 so as to move the focus lens to the position of the focus lens determined by the determination section 117.
  • the lens control section 220 may move the lens 210 serving as the focus lens to the position of the focus lens determined by the determination section 117 via the lens moving mechanism 212.
  • the respective contrast evaluation values of different spatial frequency components are derived, and the position of the focusing lens is determined based on the contrast evaluation values of the spatial frequency components with relatively high reliability. Thereby, the accuracy of the process of determining the position of the focus lens can be further improved.
  • FIG. 4 is a flowchart showing an example of a routine for determining a position of a focus lens for bringing a desired subject into an in-focus state.
  • the imaging control section 110 instructs the lens control section 220 to move the focus lens by a predetermined movement amount (S100).
  • the acquisition section 111 acquires an image captured by the imaging device 100 (S102).
  • the acquisition section 111 can acquire RAW data output from the image sensor 120 as an image.
  • the first filter section 112 extracts a first frequency component of an image (S104).
  • the deriving unit 114 derives a contrast evaluation value of the first frequency component of the image (S106).
  • the second filter section 113 extracts a second frequency component of the image (S108).
  • the deriving unit 114 derives a contrast evaluation value of the second frequency component of the image (S110).
  • the detection unit 115 sequentially detects the peaks of the contrast evaluation values based on the contrast evaluation value of the first frequency component of the image in accordance with the mountain climbing method.
  • the detection unit 115 sequentially detects the peaks of the contrast evaluation values based on the contrast evaluation value of the first frequency component of the image in accordance with the mountain climbing method.
  • the imaging control unit 110 determines whether the detection unit 115 has detected the peak of the contrast evaluation value of the first frequency component of the image (S112). If the detection section 115 fails to detect the peak of the contrast evaluation value of the first frequency component of the image, the imaging control section 110 repeats the processing from step S100.
  • the derivation unit 114 stops deriving the contrast evaluation value of the second frequency component of the image (S114).
  • the determination section 116 determines whether the contrast evaluation value of the second frequency component satisfies a predetermined condition (S116).
  • the determination unit 116 determines that the contrast evaluation value of the second frequency component satisfies a predetermined value. condition.
  • the determination section 117 determines a position of a focus lens that brings a desired subject into an in-focus state based on the plurality of second contrast evaluation values (S118).
  • the determination section 117 determines a position of a focus lens that brings a desired subject into an in-focus state based on the plurality of first contrast evaluation values (S120).
  • the determination section 117 may determine to make the expectation by adding or subtracting the focus lens positions that obtain the peaks of the plurality of first contrast evaluation values by a predetermined correction amount. Of the subject reaches the position of the focusing lens.
  • the imaging control section 110 instructs the lens control section 220 to move the focus lens so as to move the focus lens to the position of the focus lens determined by the determination section 117 (S122).
  • the contrast evaluation values of the spatial frequency components that are referred to in order to determine the position of the focusing lens are appropriately selected. Therefore, the accuracy of the process of determining the focus lens position for bringing the desired subject into the in-focus state can be further improved.
  • FIG. 5 illustrates an example of a computer 1200 that may fully or partially embody aspects of the present invention.
  • the program installed on the computer 1200 enables the computer 1200 to function as an operation associated with a device according to an embodiment of the present invention or one or more “parts” of the device. Alternatively, the program can cause the computer 1200 to perform the operation or the one or more "parts".
  • This program enables the computer 1200 to execute a process or a stage of the process according to an embodiment of the present invention.
  • Such a program may be executed by the CPU 1212 to cause the computer 1200 to perform specified operations associated with some or all of the blocks in the flowcharts and block diagrams described in this specification.
  • the computer 1200 includes a CPU 1212 and a RAM 1214, which are connected to each other through a host controller 1210.
  • the computer 1200 also includes a communication interface 1222, an input / output unit, and they are connected to the host controller 1210 through an input / output controller 1220.
  • the computer 1200 also includes a ROM 1230.
  • the CPU 1212 operates according to the programs stored in the ROM 1230 and the RAM 1214, thereby controlling each unit.
  • the communication interface 1222 communicates with other electronic devices via a network.
  • the hard disk drive can store programs and data used by the CPU 1212 in the computer 1200.
  • the ROM 1230 stores therein a boot program and the like executed by the computer 1200 at the time of operation, and / or a program that depends on the hardware of the computer 1200.
  • the program is provided through a computer-readable recording medium such as a CR-ROM, a USB memory, or an IC card, or a network.
  • the program is installed in a RAM 1214 or a ROM 1230 which is also an example of a computer-readable recording medium, and is executed by the CPU 1212.
  • the information processing described in these programs is read by the computer 1200 and causes the cooperation between the program and the above-mentioned various types of hardware resources.
  • the operation or processing of information can be realized with the use of the computer 1200, thereby constituting a device or method.
  • the CPU 1212 may execute a communication program loaded in the RAM 1214, and based on the processing described in the communication program, instruct the communication interface 1222 to perform communication processing.
  • the communication interface 1222 reads the transmission data stored in a transmission buffer provided in a recording medium such as a RAM 1214 or a USB memory, and sends the read transmission data to the network, or from The received data received by the network is written into a receiving buffer provided on the recording medium.
  • the CPU 1212 can cause the RAM 1214 to read all or necessary parts of a file or database stored in an external recording medium such as a USB memory, and perform various types of processing on the data on the RAM 1214. The CPU 1212 can then write the processed data back to the external recording medium.
  • an external recording medium such as a USB memory
  • the CPU 1212 can perform various types of operations, including information specified by the program's instruction sequence, described throughout the disclosure, information processing, conditional judgment, conditional transfer, unconditional transfer, information Retrieve / replace various types of processing, and write the results back to RAM 1214.
  • the CPU 1212 can retrieve information in files, databases, etc. in the recording medium. For example, when a plurality of entries having the attribute value of the first attribute respectively associated with the attribute value of the second attribute are stored in the recording medium, the CPU 1212 may retrieve the attribute that specifies the first attribute from the plurality of entries. The entry whose value matches the condition, and reads the attribute value of the second attribute stored in the entry, thereby obtaining the attribute value of the second attribute associated with the first attribute meeting the predetermined condition.
  • the above program or software module may be stored on the computer 1200 or a computer-readable storage medium near the computer 1200.
  • a recording medium such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, so that the program can be provided to the computer 1200 via the network.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Optics & Photonics (AREA)
  • Automatic Focus Adjustment (AREA)
  • Studio Devices (AREA)
  • Focusing (AREA)

Abstract

The present invention further improves the processing precision of making an expected photographed body reach the position of a focus lens that is in a focus state. The determining device can comprise: a deriving part that derives a first contrast evaluation value of an image by using a first frequency component of the image, and derives a second contrast evaluation value of the image by using a second frequency component of the image; a detecting part that detects the peak values of respective multiple first contrast evaluation values of multiple images; a judging part that determines, when the detecting part detects the peak values of multiple first contrast evaluation values, whether the respective multiple second contrast evaluation values of the multiple images meet a predetermined condition; and a determining part that determines the position of the focus lens according to multiple second contrast evaluation values when the multiple second contrast evaluation values meet the predetermined condition.

Description

确定装置、摄像装置、确定方法以及程序Determination device, imaging device, determination method, and program 技术领域Technical field
本发明涉及一种确定装置、摄像装置、确定方法以及程序。The invention relates to a determination device, an imaging device, a determination method and a program.
背景技术Background technique
专利文献1中记载了根据被摄体图像中包含的空间频率分量来校正散焦量。Patent Document 1 describes that a defocus amount is corrected based on a spatial frequency component included in a subject image.
专利文献1特开平9-297259号公报。Japanese Patent Application Laid-Open No. 9-297259.
发明内容Summary of the Invention
期望进一步提高确定使期望的被摄体达到对焦状态的聚焦镜头位置的处理的精度。It is desirable to further improve the accuracy of the process of determining the focus lens position that brings the desired subject into the in-focus state.
本发明的一个方面所涉及的确定装置可以包括获取部,其获取由包括聚焦镜头的摄像装置拍摄的图像。确定装置可以包括第一滤波器部,其使图像的空间频率分量中的第一频率分量通过。确定装置可以包括第二滤波器部,其使比图像的空间频率分量中的第一频率分量更高频段的第二频率分量通过。确定装置可以包括导出部,其使用图像的第一频率分量导出图像的第一对比度评估值,并使用图像的第二频率分量导出图像的第二对比度评估值。确定装置可以包括检测部,其检测多个图像各自的多个第一对比度评估值的峰值。确定装置可以包括判断部,当由检测部检测到多个第一对比度评估值的峰值时,其判断多个图像各自的多个第二对比度评估值是否满足预定条件。确定装置可以包括确定部,当多个第二对比度评估值满足预定条件时,其基于多个第二对比度评估值确定聚焦镜头的位置。The determination device according to an aspect of the present invention may include an acquisition section that acquires an image captured by an imaging device including a focusing lens. The determination device may include a first filter section that passes a first frequency component of a spatial frequency component of the image. The determination device may include a second filter section that passes a second frequency component of a higher frequency band than the first frequency component of the spatial frequency component of the image. The determining device may include a deriving section that derives a first contrast evaluation value of the image using a first frequency component of the image, and derives a second contrast evaluation value of the image using a second frequency component of the image. The determination device may include a detection section that detects peaks of a plurality of first contrast evaluation values of each of the plurality of images. The determining device may include a determination section that, when a plurality of peaks of the first contrast evaluation values are detected by the detection section, determines whether the plurality of second contrast evaluation values of each of the plurality of images satisfy a predetermined condition. The determination device may include a determination section that determines the position of the focus lens based on the plurality of second contrast evaluation values when the plurality of second contrast evaluation values satisfy a predetermined condition.
当多个第二对比度评估值不满足预定条件时,确定部可以基于多个第一对比度评估值确定聚焦镜头的位置。When the plurality of second contrast evaluation values do not satisfy the predetermined condition, the determination section may determine the position of the focusing lens based on the plurality of first contrast evaluation values.
检测部可以检测多个第二对比度评估值的峰值。预定条件可以为,由检测部检测到多个第二对比度评估值的峰值。The detection unit may detect a plurality of peaks of the second contrast evaluation value. The predetermined condition may be that a plurality of peaks of the second contrast evaluation value are detected by the detection section.
检测部可以检测多个第二对比度评估值的峰值。预定条件可以为,由检测部检测到的多个第二对比度评估值的峰值大于等于预定值。The detection unit may detect a plurality of peaks of the second contrast evaluation value. The predetermined condition may be that a plurality of peak values of the second contrast evaluation values detected by the detection section are equal to or greater than a predetermined value.
检测部可以检测多个第二对比度评估值的峰值。预定条件可以为,由检测部检测到多个第二对比度评估值的峰值大于或等于预定值,并且多个第二对比度评估值的最大值和最小值之差大于或等于预定差。The detection unit may detect a plurality of peaks of the second contrast evaluation value. The predetermined condition may be that peaks of the plurality of second contrast evaluation values detected by the detection section are greater than or equal to a predetermined value, and a difference between a maximum value and a minimum value of the plurality of second contrast evaluation values is greater than or equal to the predetermined difference.
预定条件可以为,基于多个第一对比度评估值而确定的聚焦镜头的位置与基于多个第二对比度评估值而确定的聚焦镜头的位置之差在预定范围内。The predetermined condition may be that a difference between a position of the focus lens determined based on the plurality of first contrast evaluation values and a position of the focus lens determined based on the plurality of second contrast evaluation values is within a predetermined range.
检测部可以检测多个第二对比度评估值的峰值。预定条件可以为,基于多个第一对比度评估值而确定的聚焦镜头的位置与基于多个第二对比度评估值而确定的聚焦镜头的位置之差在预定范围内,由检测部检测到的多个第二对比度评估值的峰值大于或等于预定值,并且多个第二对比度评估值的最大值和最小值之差大于或等于预定差。The detection unit may detect a plurality of peaks of the second contrast evaluation value. The predetermined condition may be that a difference between a position of the focus lens determined based on the plurality of first contrast evaluation values and a position of the focus lens determined based on the plurality of second contrast evaluation values is within a predetermined range, and The peak values of the two second contrast evaluation values are greater than or equal to a predetermined value, and the difference between the maximum value and the minimum value of the plurality of second contrast evaluation values is greater than or equal to the predetermined difference.
本发明的一个方面所涉及的摄像装置可以包括上述确定装置。摄像装置可以包括聚焦镜头。摄像装置可以包括控制部,其基于由确定装置确定的聚焦镜头的位置来控制聚焦镜头的位置。The imaging device according to an aspect of the present invention may include the above-mentioned determination device. The imaging device may include a focusing lens. The imaging device may include a control section that controls the position of the focus lens based on the position of the focus lens determined by the determination device.
本发明的一个方面所涉及的确定方法可以包括获取由包括聚焦镜头的摄像装置拍摄的图像的阶段。确定方法可以包括经由第一滤波器部使图像的空间频率分量中的第一频率分量通过的阶段。确定方法可以包括经由第二滤波器使比图像的空间频率分量中的第一频率分量更高频段的第二频率分量通过的阶段。确定方法可以包括使用图像的第一频率分量导出图像的第一对比度评估值的阶段。确定方法可以包括使用图像的第二频率分量导出图像的第二对比度评估值的阶段。确定方法可以包括检测多个图像各自的多个第一对比度评估值的峰值的阶段。确定方法可以包括当在检测阶段检测到多个第一对比度评估值的峰值时,判断多个图像各自的多个第二对比度评估值是否满足预定条件的阶段。确定方法可以包括当多个第二对比度评估值满足预定条件时,基于多个第二对比度评估值确定聚焦镜头的位置的阶段。The determination method according to an aspect of the present invention may include a stage of acquiring an image captured by an imaging device including a focusing lens. The determination method may include a stage of passing a first frequency component among the spatial frequency components of the image via the first filter section. The determination method may include a stage of passing a second frequency component of a higher frequency band than a first frequency component of a spatial frequency component of the image via a second filter. The determination method may include a stage of deriving a first contrast evaluation value of the image using a first frequency component of the image. The determination method may include a stage of deriving a second contrast evaluation value of the image using the second frequency component of the image. The determination method may include a step of detecting peaks of a plurality of first contrast evaluation values of each of the plurality of images. The determining method may include a stage of determining whether a plurality of second contrast evaluation values of each of the plurality of images satisfy a predetermined condition when a plurality of peaks of the first contrast evaluation values are detected in a detection stage. The determination method may include a stage of determining a position of the focus lens based on the plurality of second contrast evaluation values when the plurality of second contrast evaluation values satisfy a predetermined condition.
本发明的一个方面所涉及的程序,可以是一种用于使计算机作为上述确定装置发挥功能的程序。The program according to one aspect of the present invention may be a program for causing a computer to function as the determination device.
根据本发明的一个方面,可以进一步提高确定聚焦镜头位置的处理的精度。According to one aspect of the present invention, the accuracy of the process of determining the position of the focus lens can be further improved.
此外,上述发明内容未列举本发明的必要的全部特征。此外,这些特征组的子组合也可以构成发明。In addition, the above summary does not list all necessary features of the present invention. In addition, a sub-combination of these feature groups may also constitute an invention.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1是示出摄像装置的功能块的一个示例的图。FIG. 1 is a diagram illustrating an example of a functional block of the imaging device.
图2是示出摄像控制部的功能块的一个示例的图。FIG. 2 is a diagram showing an example of functional blocks of an imaging control unit.
图3是示出每个空间频率分量的对比度评估值与聚焦镜头的位置之间的关系的图。FIG. 3 is a diagram showing a relationship between a contrast evaluation value of each spatial frequency component and a position of a focus lens.
图4是示出用于确定使期望的被摄体达到对焦状态的聚焦镜头的位置的过程的一个示例的流程图。FIG. 4 is a flowchart illustrating an example of a process for determining a position of a focus lens for bringing a desired subject into an in-focus state.
图5是用于说明硬件构成的一个示例的图。FIG. 5 is a diagram for explaining an example of a hardware configuration.
具体实施方式detailed description
以下,通过发明的实施方式来对本发明进行说明,但是以下的实施方式并不限定权利要求书所涉及的发明。此外,并不是所有实施方式中所说明的特征组合对于发明的解决方案所必须的。对本领域普通技术人员来说,显然可以对以下实施方式加以各种变更或改良。从权利要求书的描述中显而易见的是,进行了这样的变更或改进的方式也可包含于本发明的技术范围。Hereinafter, the present invention will be described with embodiments of the invention, but the following embodiments do not limit the invention according to the claims. Furthermore, not all feature combinations described in the embodiments are necessary for the inventive solution. It will be apparent to those skilled in the art that various changes or improvements can be added to the following embodiments. It is apparent from the description of the claims that the manner in which such a change or improvement is made may also be included in the technical scope of the present invention.
权利要求书、说明书、附图以及摘要中包含作为著作权所保护对象的事项。任何人只要如专利局的文档或者记录所显示的那样进行这些文件的复制,著作权不会提出异议。但是,在除此以外的情况下,保留一切的著作权。The claims, the description, the drawings, and the abstract include matters protected by copyright. Anyone who makes a copy of these documents as shown in the patent office's files or records will not dispute the copyright. However, in all other cases, all copyrights are reserved.
本发明的各种实施方式可参照流程图及框图来描述,这里,框可表示(1)执行操作的过程的阶段或者(2)具有执行操作的作用的装置的“部”。指定的阶段和“部”可以通过可编程电路和/或处理器来实现。专用电路可以包括数字和/或模拟硬件电路。可以包括集成电路(IC)和/或分立电路。可编程电路可以包括可重构硬件电路。可重构硬件电路可以包括逻辑与、逻辑或、逻辑异或、逻辑与非、逻辑或非、及其它逻辑操作、触发器、寄存器、现场可编程门阵列(FPGA)、可编程逻辑阵列(PLA)等存储器元件等。Various embodiments of the present invention may be described with reference to flowcharts and block diagrams. Here, a frame may represent (1) a stage of a process of performing an operation or (2) a "part" of a device having a role of performing an operation. The specified stages and "departments" may be implemented by programmable circuits and / or processors. The dedicated circuits may include digital and / or analog hardware circuits. It may include integrated circuits (ICs) and / or discrete circuits. Programmable circuits may include reconfigurable hardware circuits. Reconfigurable hardware circuits can include logical AND, logical OR, logical XOR, logical NAND, logical NOR, and other logical operations, flip-flops, registers, field programmable gate arrays (FPGAs), and programmable logic arrays (PLAs) ) And other memory elements.
计算机可读介质可以包括能够存储由合适设备执行的指令的任何有形设备。其结果是,其上存储有指令的计算机可读介质包括一种包括指令的产品,该指令可被执行以创建用于执行流程图或框图所指定的操作的手段。作为计算机可读介质的示例,可以包括电子存储介质、磁存储介质、光学存储介质、电磁存储介质、半导体存储介质等。作为计算机可读介质的更具体的示例,可以包括软盘(注册商标)、软磁盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或者闪存)、电可擦可编程只读存储器(EEPROM)、静态随机存取存储器(SRAM)、光盘只读存储器(CD-ROM)、数字多用途光盘(DVD)、蓝光(RTM)光盘、记忆棒、集成电路卡等。Computer-readable media can include any tangible device capable of storing instructions for execution by a suitable device. As a result, a computer-readable medium having instructions stored thereon includes a product including instructions that can be executed to create a means for performing the operations specified by the flowchart or block diagram. As examples of the computer-readable medium, an electronic storage medium, a magnetic storage medium, an optical storage medium, an electromagnetic storage medium, a semiconductor storage medium, and the like may be included. As a more specific example of a computer-readable medium, a floppy disk (registered trademark), a floppy disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory) may be included ), Electrically erasable programmable read-only memory (EEPROM), static random access memory (SRAM), compact disc read-only memory (CD-ROM), digital versatile disc (DVD), Blu-ray (RTM) disc, memory stick, IC cards, etc.
计算机可读指令可以包括由一种或多种编程语言的任意组合描述的源代码或者目标代码中的任意一个。源代码或者目标代码包括传统的程序式编程语言。传统的程序式编程语言可以为汇编指令、指令集架构(ISA)指令、机器指令、与机器相关的指令、微代码、固件指令、状态设置数据、或者Smalltalk、JAVA(注册商标)、C++等面向对象编程语言以及“C”编程语言或者类似的编程语言。计算机可读指令可以在本地或者经由局域网(LAN)、互联网等广域网(WAN)提供给通用计算机、专用计算机或者其它可编程数据处理装置的处理器或可编程电路。处理器或可编程电路可以执行计算机可读指令,以创建用于执行流程图或框图所指定操作的手段。作为处理器的示例,包括计算机处理器、处理单元、微处理器、数字信号处 理器、控制器、微控制器等。Computer-readable instructions may include any of source code or object code described by any combination of one or more programming languages. The source or object code includes traditional procedural programming languages. Traditional programming languages can be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or Smalltalk, JAVA (registered trademark), C ++, etc. Object programming languages and "C" programming languages or similar programming languages. The computer-readable instructions may be provided to a processor or a programmable circuit of a general-purpose computer, a special-purpose computer, or other programmable data processing device locally or via a wide area network (WAN) such as a local area network (LAN) or the Internet. A processor or programmable circuit can execute computer-readable instructions to create a means for performing the operations specified in the flowchart or block diagram. Examples of the processor include a computer processor, a processing unit, a microprocessor, a digital signal processor, a controller, a microcontroller, and the like.
图1示出了本实施方式所涉及的摄像装置100的功能块的一个示例。摄像装置100包括摄像部102及镜头部200。摄像部102具有图像传感器120、摄像控制部110、存储器170、显示部160及操作部162。FIG. 1 illustrates an example of functional blocks of an imaging device 100 according to the present embodiment. The imaging device 100 includes an imaging section 102 and a lens section 200. The imaging section 102 includes an image sensor 120, an imaging control section 110, a memory 170, a display section 160, and an operation section 162.
图像传感器120可以由CCD或CMOS构成。图像传感器120将通过多个镜头210成像的光学图像转换为电信号。图像传感器120将通过多个镜头210成像的光学图像的图像数据输出至摄像控制部110。摄像控制部110可以由CPU或MPU等微处理器、MCU等微控制器等构成。摄像控制部110可以根据来自控制部162的操作指令来控制摄像装置100。The image sensor 120 may be composed of a CCD or a CMOS. The image sensor 120 converts an optical image imaged through the plurality of lenses 210 into an electric signal. The image sensor 120 outputs image data of an optical image formed by the plurality of lenses 210 to the imaging control section 110. The imaging control unit 110 may be composed of a microprocessor such as a CPU or an MPU, and a microcontroller such as an MCU. The imaging control unit 110 may control the imaging apparatus 100 according to an operation instruction from the control unit 162.
存储器170可以为计算机可读记录介质,可以包括SRAM、DRAM、EPROM、EEPROM及USB存储器等闪存中的至少1个。存储器170储存摄像控制部110对图像传感器120等进行控制所需的程序等。存储器170可以设置于摄像装置100的壳体内部。存储器170可以设置成可从摄像装置100的壳体上拆卸下来。The memory 170 may be a computer-readable recording medium, and may include at least one of flash memories such as SRAM, DRAM, EPROM, EEPROM, and USB memory. The memory 170 stores programs and the like necessary for the imaging control unit 110 to control the image sensor 120 and the like. The memory 170 may be provided inside the casing of the imaging device 100. The memory 170 may be provided so as to be detachable from the casing of the imaging apparatus 100.
显示部160可以显示从图像传感器120输出的图像数据。显示部160可以显示摄像装置100的各种设定信息。显示部160可以是液晶显示器、触摸板显示器等。显示部160可以包括多个液晶显示器或触摸板显示器。The display section 160 may display image data output from the image sensor 120. The display unit 160 can display various setting information of the imaging device 100. The display section 160 may be a liquid crystal display, a touch panel display, or the like. The display section 160 may include a plurality of liquid crystal displays or a touch panel display.
镜头部200具有多个镜头210、镜头移动机构212及镜头控制部220。多个镜头210可以起到变焦镜头(zoom lens)、可变焦距镜头(varifocal lens)及聚焦镜头的作用。多个镜头210中的至少一部分或全部被配置为能够沿着光轴移动。镜头部200可以是被设置成能够相对摄像部102拆装的可更换镜头。镜头移动机构212可以使多个镜头210中的至少一部分或全部沿着光轴移动。镜头控制部220按照来自摄像部102的镜头控制指令驱动镜头移动机构212,使一个或多个镜头210沿着光轴方向移动。镜头控制指令例如为变焦控制指令及聚焦控制指令。The lens unit 200 includes a plurality of lenses 210, a lens moving mechanism 212, and a lens control unit 220. The multiple lenses 210 can function as zoom lenses, varifocal lenses, and focusing lenses. At least a part or all of the plurality of lenses 210 are configured to be movable along the optical axis. The lens unit 200 may be an interchangeable lens provided to be detachable from the imaging unit 102. The lens moving mechanism 212 can move at least a part or all of the plurality of lenses 210 along the optical axis. The lens control section 220 drives the lens moving mechanism 212 according to a lens control instruction from the imaging section 102 to move one or more lenses 210 along the optical axis direction. The lens control command is, for example, a zoom control command and a focus control command.
这样构成的摄像装置100基于聚焦镜头在多个位置处的多个对比度评估值来导出对比度评估值的峰值,并确定使期望的被摄体达到对焦状态的聚焦镜头的位置。即,摄像装置100通过对比度AF处理,确定使期望的被摄体达到对焦状态的聚焦镜头的位置。The imaging apparatus 100 configured in this manner derives the peak value of the contrast evaluation value based on a plurality of contrast evaluation values of the focus lens at a plurality of positions, and determines the position of the focus lens that brings a desired subject into an in-focus state. That is, the imaging apparatus 100 determines the position of the focus lens that brings a desired subject into an in-focus state through contrast AF processing.
摄像装置100经由滤波器从图像中提取预定的特定空间频率分量。进而,摄像装置100通过导出特定空间频率分量的对比度评估值的峰值来确定使期望的被摄体达到对焦状态的聚焦镜头的位置。The imaging device 100 extracts a predetermined specific spatial frequency component from an image via a filter. Furthermore, the imaging device 100 determines the position of the focus lens that brings a desired subject into an in-focus state by deriving a peak of a contrast evaluation value of a specific spatial frequency component.
作为用于提取特定空间频率分量的滤波器,例如,有时使用由无限冲激响应(IIR)滤波器构成的带通滤波器。在这种带通滤波器中,由于易于设计等,多利用使相对较低空间频率分量通过的滤波器。例如,摄像装置100基于10线对/毫米的空间频率分量的对比度评估值 来确定聚焦镜头的位置。然而,基于相对较低频率分量的对比度评估值而确定的聚焦镜头的位置可能不是使期望的被摄体达到对焦状态的聚焦镜头的位置。As a filter for extracting a specific spatial frequency component, for example, a band-pass filter composed of an infinite impulse response (IIR) filter is sometimes used. In such a band-pass filter, since it is easy to design and the like, a filter that passes relatively low spatial frequency components is often used. For example, the imaging device 100 determines the position of the focusing lens based on the contrast evaluation value of the spatial frequency component of 10 line pairs / mm. However, the position of the focus lens that is determined based on the contrast evaluation value of the relatively lower frequency component may not be the position of the focus lens that brings the desired subject into the in-focus state.
此外,由于摄像装置100的镜头系统的球面像差或彗形像差,获得对比度评估值的峰值的聚焦镜头的位置和获得聚焦状态的聚焦镜头的位置不一定一致。因此,摄像装置100对获得对比度评估值的峰值的聚焦镜头的位置进行校正,并确定预期会使期望的被摄体达到对焦状态的聚焦镜头的位置。例如,摄像装置100将通过以预定校正量对获得对比度评估值的峰值的聚焦镜头的位置进行相加或相减而得到的位置确定为聚焦镜头的位置。然而,这样的校正量未必是针对所有被摄体的最佳校正量。In addition, due to spherical aberration or coma aberration of the lens system of the imaging apparatus 100, the position of the focus lens that obtains the peak value of the contrast evaluation value and the position of the focus lens that obtains the focus state are not necessarily consistent. Therefore, the imaging device 100 corrects the position of the focus lens that obtains the peak value of the contrast evaluation value, and determines the position of the focus lens that is expected to bring a desired subject into an in-focus state. For example, the imaging apparatus 100 determines a position obtained by adding or subtracting a position of a focus lens that obtains a peak value of a contrast evaluation value with a predetermined correction amount as a position of the focus lens. However, such a correction amount is not necessarily the best correction amount for all subjects.
如上所述,由对比度AF处理确定的聚焦镜头的位置精度有可能产生偏差。因此,本实施方式所涉及的摄像装置100进一步提高了确定使期望的被摄体达到聚焦状态的聚焦镜头位置的处理的精度。As described above, the positional accuracy of the focus lens determined by the contrast AF process may be biased. Therefore, the imaging device 100 according to the present embodiment further improves the accuracy of the process of determining the focus lens position for bringing a desired subject into a focused state.
图2是本实施方式所涉及的摄像控制部110的功能块的一个示例。摄像控制部110具有获取部111、第一滤波器部112、第二滤波器部113、导出部114、检测部115、判断部116和确定部117。FIG. 2 is an example of functional blocks of the imaging control unit 110 according to the present embodiment. The imaging control unit 110 includes an acquisition unit 111, a first filter unit 112, a second filter unit 113, a derivation unit 114, a detection unit 115, a determination unit 116, and a determination unit 117.
获取部111获取由摄像装置100拍摄的图像。获取部111可以获取从图像传感器120输出的RAW数据。第一滤波器部112使图像的空间频率分量中的第一频率分量通过。第二滤波器部113使比图像的空间频率分量中的第一频率分量更高频段的第二频率分量通过。第一滤波器部112及第二滤波器部113可以是IIR滤波器构成的带通滤波器。The acquisition unit 111 acquires an image captured by the imaging device 100. The acquisition section 111 can acquire RAW data output from the image sensor 120. The first filter unit 112 passes a first frequency component among the spatial frequency components of the image. The second filter unit 113 passes a second frequency component of a higher frequency band than the first frequency component of the spatial frequency component of the image. The first filter section 112 and the second filter section 113 may be band-pass filters made of IIR filters.
第二滤波器部113可以使与摄像装置100的分辨率对应的空间频率分量通过。第二滤波器部113可以使与极限空间频率分量对应的空间频率分量通过,该极限空间频率分量可获得依赖于镜头部200和图像传感器120的光学特性的预定对比度。第二滤波器部113例如可以从图像使40线对/毫米的空间频率分量通过。第一滤波器部112可以使与极限空间频率分量对应的空间频率分量通过,该极限空间频率分量由摄像装置100的显示部160上显示的实时取景图像获得。第一滤波器部112例如可以从图像使10线对/毫米的空间频率分量通过。The second filter unit 113 can pass a spatial frequency component corresponding to the resolution of the imaging device 100. The second filter section 113 can pass a spatial frequency component corresponding to a limit spatial frequency component which can obtain a predetermined contrast depending on the optical characteristics of the lens section 200 and the image sensor 120. The second filter unit 113 can pass a spatial frequency component of 40 line pairs / mm from the image, for example. The first filter section 112 can pass a spatial frequency component corresponding to a limit spatial frequency component obtained from a live view image displayed on the display section 160 of the imaging device 100. The first filter unit 112 can pass a spatial frequency component of 10 line pairs / mm from the image, for example.
导出部114可以使用图像的第一频率分量导出图像的第一对比度评估值。导出部114可以使用图像的第二频率分量导出图像的第二对比度评估值。The deriving unit 114 may derive a first contrast evaluation value of the image using the first frequency component of the image. The derivation unit 114 may use the second frequency component of the image to derive a second contrast evaluation value of the image.
检测部115检测多个图像各自的多个第一对比度评估值的峰值。检测部115检测由摄像装置100在聚焦镜头的多个位置处所拍摄的多个图像各自的多个第一对比度评估值的峰值。检测部115可以通过所谓的爬山法检测多个第一对比度评估值的峰值。检测部115可以检测多个图像的每一个图像的多个第二对比度评估值。检测部115检测由摄像装置100在聚焦镜头的多个位置处所拍摄的多个图像各自的多个第二对比度评估值的峰值。检测部115可以通 过所谓的爬山法检测多个第二对比度评估值的峰值。检测部115可以从根据如图3所示的多个第一对比度评估值获得的曲线500中检测第一对比度评估值的峰值。此外,检测部115可以从根据如图3所示的多个第二对比度评估值获得的曲线502中检测出第二对比度评估值的峰值。The detection unit 115 detects peaks of a plurality of first contrast evaluation values of a plurality of images. The detection unit 115 detects peaks of a plurality of first contrast evaluation values of a plurality of images captured by the imaging device 100 at a plurality of positions of the focus lens. The detection unit 115 may detect a plurality of peaks of the first contrast evaluation values by a so-called mountain climbing method. The detection section 115 may detect a plurality of second contrast evaluation values of each of the plurality of images. The detection unit 115 detects peaks of a plurality of second contrast evaluation values of each of a plurality of images captured by the imaging device 100 at a plurality of positions of the focus lens. The detection section 115 may detect a plurality of peaks of the second contrast evaluation value by a so-called mountain climbing method. The detection section 115 may detect a peak of the first contrast evaluation value from a curve 500 obtained from a plurality of first contrast evaluation values as shown in FIG. 3. In addition, the detection section 115 may detect a peak value of the second contrast evaluation value from a curve 502 obtained from a plurality of second contrast evaluation values as shown in FIG. 3.
这里,第二频率分量是相对较高的空间频率分量。相对较高的空间频率分量的对比度评估值倾向于具有相对陡峭的峰值。相对较高的空间频率分量的对比度评估值有时会包含许多噪声。基于相对较高的空间频率分量的对比度评估值的峰值而确定的聚焦镜头的位置与基于相对较低的空间频率分量的对比度评估值的峰值而确定的聚焦镜头的位置相比,精度有时更高。另一方面,根据被摄体的不同,基于相对较高的空间频率分量的对比度评估值的峰值而确定的聚焦镜头的位置与基于相对较低的空间频率分量的对比度评估值的峰值而确定的聚焦镜头的位置相比,精度有时更低。Here, the second frequency component is a relatively high spatial frequency component. Contrast evaluation values of relatively high spatial frequency components tend to have relatively steep peaks. Contrast estimates of relatively high spatial frequency components sometimes contain a lot of noise. The position of the focusing lens determined based on the peak of the contrast evaluation value of the relatively high spatial frequency component is sometimes more accurate than the position of the focusing lens determined based on the peak of the contrast evaluation value of the relatively low spatial frequency component . On the other hand, depending on the subject, the position of the focusing lens determined based on the peak value of the contrast evaluation value of the relatively high spatial frequency component and the peak value of the contrast evaluation value based on the relatively low spatial frequency component Compared to the position of the focusing lens, the accuracy is sometimes lower.
由此,当由检测部115检测到多个第一对比度评估值的峰值时,判断部116判断多个图像各自的多个第二对比度评估值是否满足预定条件。预定条件可以根据表示第二对比度评估值的可靠性的指标来确定。Thus, when the peaks of the plurality of first contrast evaluation values are detected by the detection section 115, the determination section 116 determines whether the plurality of second contrast evaluation values of each of the plurality of images satisfy a predetermined condition. The predetermined condition may be determined according to an index indicating the reliability of the second contrast evaluation value.
例如,预定条件可以为,由检测部115检测到多个第二对比度评估值的峰值。预定条件可以为,由检测部115检测到的多个第二对比度评估值的峰值大于等于预定值。预定条件可以为,由检测部115检测到多个第二对比度评估值的峰值大于或等于预定值,并且多个第二对比度评估值的最大值和最小值之差大于或等于预定差。预定条件可以为,基于多个第一对比度评估值而确定的聚焦镜头的位置与基于多个第二对比度评估值而确定的聚焦镜头的位置之差在预定范围内。预定条件可以为,基于多个第一对比度评估值而确定的聚焦镜头的位置与基于多个第二对比度评估值而确定的聚焦镜头的位置之差在预定范围内,由检测部115检测到的多个第二对比度评估值的峰值大于或等于预定值,并且多个第二对比度评估值的最大值和最小值之差大于或等于预定差。For example, the predetermined condition may be that a plurality of peaks of the second contrast evaluation value are detected by the detection section 115. The predetermined condition may be that a plurality of peak values of the second contrast evaluation values detected by the detection section 115 are equal to or greater than a predetermined value. The predetermined condition may be that peaks of the plurality of second contrast evaluation values detected by the detection section 115 are greater than or equal to a predetermined value, and a difference between a maximum value and a minimum value of the plurality of second contrast evaluation values is greater than or equal to the predetermined difference. The predetermined condition may be that a difference between a position of the focus lens determined based on the plurality of first contrast evaluation values and a position of the focus lens determined based on the plurality of second contrast evaluation values is within a predetermined range. The predetermined condition may be that a difference between a position of the focus lens determined based on the plurality of first contrast evaluation values and a position of the focus lens determined based on the plurality of second contrast evaluation values is within a predetermined range, and is detected by the detection unit 115. The peak values of the plurality of second contrast evaluation values are greater than or equal to a predetermined value, and the difference between the maximum value and the minimum value of the plurality of second contrast evaluation values is greater than or equal to a predetermined difference.
当多个第二对比度评估值满足预定条件时,基于多个第二对比度评估值的聚焦镜头的位置具有较高的可靠性。由此,本实施方式中,确定部117根据多个第二对比度评估值是否满足预定条件,来判断选择第一对比度评估值,还是选择第二对比度评估值,作为用于确定聚焦镜头的位置而参考的对比度评估值。即,当多个第二对比度评估值满足预定条件时,确定部117可以基于多个第二对比度评估值确定聚焦镜头的位置。当多个第二对比度评估值不满足预定条件时,确定部117可以基于多个第一对比度评估值来确定聚焦镜头的位置。When the plurality of second contrast evaluation values satisfy a predetermined condition, the position of the focusing lens based on the plurality of second contrast evaluation values has high reliability. Therefore, in this embodiment, the determination unit 117 determines whether to select the first contrast evaluation value or the second contrast evaluation value according to whether or not the plurality of second contrast evaluation values satisfy a predetermined condition as the position for determining the focus lens. Reference contrast evaluation value. That is, when the plurality of second contrast evaluation values satisfy a predetermined condition, the determination section 117 may determine the position of the focus lens based on the plurality of second contrast evaluation values. When the plurality of second contrast evaluation values do not satisfy the predetermined condition, the determination section 117 may determine the position of the focus lens based on the plurality of first contrast evaluation values.
摄像控制部110可以将聚焦镜头的驱动指令输出到镜头控制部220,以便将聚焦镜头移动到由确定部117确定的聚焦镜头的位置。镜头控制部220可以将用作聚焦镜头的镜头210 经由镜头移动机构212移动到由确定部117确定的聚焦镜头的位置。The imaging control section 110 may output a driving instruction of the focus lens to the lens control section 220 so as to move the focus lens to the position of the focus lens determined by the determination section 117. The lens control section 220 may move the lens 210 serving as the focus lens to the position of the focus lens determined by the determination section 117 via the lens moving mechanism 212.
如上所述,导出不同空间频率分量的各自的对比度评估值,并且基于可靠性相对较高的空间频率分量的对比度评估值来确定聚焦镜头的位置。从而,可以进一步提高确定聚焦镜头位置的处理的精度。As described above, the respective contrast evaluation values of different spatial frequency components are derived, and the position of the focusing lens is determined based on the contrast evaluation values of the spatial frequency components with relatively high reliability. Thereby, the accuracy of the process of determining the position of the focus lens can be further improved.
图4是示出用于确定使期望的被摄体达到对焦状态的聚焦镜头的位置的程序的一个示例的流程图。FIG. 4 is a flowchart showing an example of a routine for determining a position of a focus lens for bringing a desired subject into an in-focus state.
在执行自动聚焦处理时,摄像控制部110指示镜头控制部220将聚焦镜头移动预定移动量(S100)。在聚焦镜头移动预定移动量之后,获取部111获取由摄像装置100拍摄的图像(S102)。获取部111可以获取从图像传感器120输出的RAW数据作为图像。When the autofocus processing is performed, the imaging control section 110 instructs the lens control section 220 to move the focus lens by a predetermined movement amount (S100). After the focus lens is moved by a predetermined amount of movement, the acquisition section 111 acquires an image captured by the imaging device 100 (S102). The acquisition section 111 can acquire RAW data output from the image sensor 120 as an image.
第一滤波器部112提取图像的第一频率分量(S104)。导出部114导出图像的第一频率分量的对比度评估值(S106)。第二滤波器部113提取图像的第二频率分量(S108)。导出部114导出图像的第二频率分量的对比度评估值(S110)。The first filter section 112 extracts a first frequency component of an image (S104). The deriving unit 114 derives a contrast evaluation value of the first frequency component of the image (S106). The second filter section 113 extracts a second frequency component of the image (S108). The deriving unit 114 derives a contrast evaluation value of the second frequency component of the image (S110).
检测部115根据图像的第一频率分量的对比度评估值,按照爬山法依次检测对比度评估值的峰值。检测部115根据图像的第一频率分量的对比度评估值,按照爬山法依次检测对比度评估值的峰值。The detection unit 115 sequentially detects the peaks of the contrast evaluation values based on the contrast evaluation value of the first frequency component of the image in accordance with the mountain climbing method. The detection unit 115 sequentially detects the peaks of the contrast evaluation values based on the contrast evaluation value of the first frequency component of the image in accordance with the mountain climbing method.
摄像控制部110判定检测部115是否检测到图像的第一频率分量的对比度评估值的峰值(S112)。如果检测部115未能检测到图像的第一频率分量的对比度评估值的峰值,则摄像控制部110重复从步骤S100开始的处理。The imaging control unit 110 determines whether the detection unit 115 has detected the peak of the contrast evaluation value of the first frequency component of the image (S112). If the detection section 115 fails to detect the peak of the contrast evaluation value of the first frequency component of the image, the imaging control section 110 repeats the processing from step S100.
如果检测部115检测到图像的第一频率分量的对比度评估值的峰值,则导出部114停止导出图像的第二频率分量的对比度评估值(S114)。判断部116判断第二频率分量的对比度评估值是否满足预定条件(S116)。例如,当基于多个第一对比度评估值而确定的聚焦镜头的位置与基于多个第二对比度评估值而确定的聚焦镜头的位置之差在预定范围内,由检测部115检测到的多个第二对比度评估值的峰值大于或等于预定值,并且多个第二对比度评估值的最大值和最小值之差大于或等于预定差时,判断部116判断第二频率分量的对比度评估值满足预定条件。If the detection unit 115 detects a peak value of the contrast evaluation value of the first frequency component of the image, the derivation unit 114 stops deriving the contrast evaluation value of the second frequency component of the image (S114). The determination section 116 determines whether the contrast evaluation value of the second frequency component satisfies a predetermined condition (S116). For example, when the difference between the position of the focus lens determined based on the plurality of first contrast evaluation values and the position of the focus lens determined based on the plurality of second contrast evaluation values is within a predetermined range, the plurality of When the peak value of the second contrast evaluation value is greater than or equal to the predetermined value, and the difference between the maximum value and the minimum value of the plurality of second contrast evaluation values is greater than or equal to the predetermined difference, the determination unit 116 determines that the contrast evaluation value of the second frequency component satisfies a predetermined value. condition.
当第二频率分量的对比度评估值满足预定条件时,确定部117基于多个第二对比度评估值来确定使期望的被摄体达到对焦状态的聚焦镜头的位置(S118)。当第二频率分量的对比度评估值不满足预定条件时,确定部117基于多个第一对比度评估值来确定使期望的被摄体达到对焦状态的聚焦镜头的位置(S120)。当第二频率分量的对比度评估值不满足预定条件时,确定部117可以通过以预定校正量对获得多个第一对比度评估值的峰值的聚焦镜头位置进行相加或相减,来确定使期望的被摄体达到对焦状态的聚焦镜头的位置。When the contrast evaluation value of the second frequency component satisfies a predetermined condition, the determination section 117 determines a position of a focus lens that brings a desired subject into an in-focus state based on the plurality of second contrast evaluation values (S118). When the contrast evaluation value of the second frequency component does not satisfy the predetermined condition, the determination section 117 determines a position of a focus lens that brings a desired subject into an in-focus state based on the plurality of first contrast evaluation values (S120). When the contrast evaluation value of the second frequency component does not satisfy the predetermined condition, the determination section 117 may determine to make the expectation by adding or subtracting the focus lens positions that obtain the peaks of the plurality of first contrast evaluation values by a predetermined correction amount. Of the subject reaches the position of the focusing lens.
摄像控制部110向镜头控制部220指示聚焦镜头的移动,以便将聚焦镜头移动到由确定部117确定的聚焦镜头的位置(S122)。The imaging control section 110 instructs the lens control section 220 to move the focus lens so as to move the focus lens to the position of the focus lens determined by the determination section 117 (S122).
如上所述,基于不同空间频率分量的对比度评估值的相对可靠性,适当地选择为确定聚焦镜头的位置而参考的空间频率分量的对比度评估值。从而,可以进一步提高确定使期望的被摄体达到对焦状态的聚焦镜头位置的处理的精度。As described above, based on the relative reliability of the contrast evaluation values of different spatial frequency components, the contrast evaluation values of the spatial frequency components that are referred to in order to determine the position of the focusing lens are appropriately selected. Therefore, the accuracy of the process of determining the focus lens position for bringing the desired subject into the in-focus state can be further improved.
图5表示可全部或部分地体现本发明的多个方面的计算机1200的一个示例。安装在计算机1200上的程序能够使计算机1200作为与本发明的实施方式所涉及的装置相关联的操作或者该装置的一个或多个“部”而起作用。或者,该程序能够使计算机1200执行该操作或者该一个或多个“部”。该程序能够使计算机1200执行本发明的实施方式所涉及的过程或者该过程的阶段。这种程序可以由CPU 1212执行,以使计算机1200执行与本说明书所述的流程图及框图中的一些或者全部方框相关联的指定操作。FIG. 5 illustrates an example of a computer 1200 that may fully or partially embody aspects of the present invention. The program installed on the computer 1200 enables the computer 1200 to function as an operation associated with a device according to an embodiment of the present invention or one or more “parts” of the device. Alternatively, the program can cause the computer 1200 to perform the operation or the one or more "parts". This program enables the computer 1200 to execute a process or a stage of the process according to an embodiment of the present invention. Such a program may be executed by the CPU 1212 to cause the computer 1200 to perform specified operations associated with some or all of the blocks in the flowcharts and block diagrams described in this specification.
根据本实施方式的计算机1200包括CPU 1212和RAM 1214,它们通过主机控制器1210相互连接。计算机1200还包括通信接口1222、输入/输出单元,它们通过输入/输出控制器1220与主机控制器1210连接。计算机1200还包括ROM 1230。CPU 1212根据存储在ROM 1230和RAM 1214中的程序进行操作,从而控制每个单元。The computer 1200 according to the present embodiment includes a CPU 1212 and a RAM 1214, which are connected to each other through a host controller 1210. The computer 1200 also includes a communication interface 1222, an input / output unit, and they are connected to the host controller 1210 through an input / output controller 1220. The computer 1200 also includes a ROM 1230. The CPU 1212 operates according to the programs stored in the ROM 1230 and the RAM 1214, thereby controlling each unit.
通信接口1222经由网络与其他电子设备通信。硬盘驱动器可以储存计算机1200内的CPU 1212所使用的程序及数据。ROM 1230在其中储存运行时由计算机1200执行的引导程序等、和/或依赖于计算机1200的硬件的程序。程序通过CR-ROM、USB存储器或IC卡之类的计算机可读记录介质或者网络来提供。程序安装在也作为计算机可读记录介质的示例的RAM 1214或ROM 1230中,并通过CPU 1212执行。这些程序中记述的信息处理由计算机1200读取,并引起程序与上述各种类型的硬件资源之间的协作。可以随着计算机1200的使用而实现信息的操作或者处理,从而构成装置或方法。The communication interface 1222 communicates with other electronic devices via a network. The hard disk drive can store programs and data used by the CPU 1212 in the computer 1200. The ROM 1230 stores therein a boot program and the like executed by the computer 1200 at the time of operation, and / or a program that depends on the hardware of the computer 1200. The program is provided through a computer-readable recording medium such as a CR-ROM, a USB memory, or an IC card, or a network. The program is installed in a RAM 1214 or a ROM 1230 which is also an example of a computer-readable recording medium, and is executed by the CPU 1212. The information processing described in these programs is read by the computer 1200 and causes the cooperation between the program and the above-mentioned various types of hardware resources. The operation or processing of information can be realized with the use of the computer 1200, thereby constituting a device or method.
例如,当在计算机1200和外部设备之间执行通信时,CPU 1212可以执行加载在RAM 1214中的通信程序,并且基于通信程序中描述的处理,命令通信接口1222进行通信处理。在CPU 1212的控制下,通信接口1222读取存储在诸如RAM 1214或USB存储器之类的记录介质中提供的发送缓冲区中的发送数据,并将读取的发送数据发送到网络,或者将从网络接收的接收数据写入记录介质上提供的接收缓冲区等。For example, when performing communication between the computer 1200 and an external device, the CPU 1212 may execute a communication program loaded in the RAM 1214, and based on the processing described in the communication program, instruct the communication interface 1222 to perform communication processing. Under the control of the CPU 1212, the communication interface 1222 reads the transmission data stored in a transmission buffer provided in a recording medium such as a RAM 1214 or a USB memory, and sends the read transmission data to the network, or from The received data received by the network is written into a receiving buffer provided on the recording medium.
另外,CPU 1212可以使RAM 1214读取存储在诸如USB存储器等外部记录介质中的文件或数据库的全部或必要部分,并对RAM 1214上的数据执行各种类型的处理。接着,CPU 1212可以将处理过的数据写回到外部记录介质中。In addition, the CPU 1212 can cause the RAM 1214 to read all or necessary parts of a file or database stored in an external recording medium such as a USB memory, and perform various types of processing on the data on the RAM 1214. The CPU 1212 can then write the processed data back to the external recording medium.
诸如各种类型的程序、数据、表格和数据库的各种类型的信息可以存储在记录介质中并 且接受信息处理。对于从RAM 1214读取的数据,CPU 1212可执行在本公开的各处描述的、包括由程序的指令序列指定的各种类型的操作、信息处理、条件判断、条件转移、无条件转移、信息的检索/替换等各种类型的处理,并将结果写回到RAM 1214中。此外,CPU 1212可以检索记录介质内的文件、数据库等中的信息。例如,在记录介质中储存具有分别与第二属性的属性值建立了关联的第一属性的属性值的多个条目时,CPU 1212可以从该多个条目中检索出与指定第一属性的属性值的条件相匹配的条目,并读取该条目内储存的第二属性的属性值,从而获取与满足预定条件的第一属性相关联的第二属性的属性值。Various types of information such as various types of programs, data, tables, and databases can be stored in a recording medium and subjected to information processing. For the data read from the RAM 1214, the CPU 1212 can perform various types of operations, including information specified by the program's instruction sequence, described throughout the disclosure, information processing, conditional judgment, conditional transfer, unconditional transfer, information Retrieve / replace various types of processing, and write the results back to RAM 1214. In addition, the CPU 1212 can retrieve information in files, databases, etc. in the recording medium. For example, when a plurality of entries having the attribute value of the first attribute respectively associated with the attribute value of the second attribute are stored in the recording medium, the CPU 1212 may retrieve the attribute that specifies the first attribute from the plurality of entries. The entry whose value matches the condition, and reads the attribute value of the second attribute stored in the entry, thereby obtaining the attribute value of the second attribute associated with the first attribute meeting the predetermined condition.
上述程序或软件模块可以存储在计算机1200上或计算机1200附近的计算机可读存储介质上。此外,连接到专用通信网络或因特网的服务器系统中提供的诸如硬盘或RAM之类的记录介质可以用作计算机可读存储介质,从而可以经由网络将程序提供到计算机1200。The above program or software module may be stored on the computer 1200 or a computer-readable storage medium near the computer 1200. In addition, a recording medium such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, so that the program can be provided to the computer 1200 via the network.
应该注意的是,权利要求书、说明书以及附图中所示的装置、系统、程序以及方法中的动作、顺序、步骤以及阶段等各项处理的执行顺序,只要没有特别明示“在…之前”、“事先”等,且只要前面处理的输出并不用在后面的处理中,则可以任意顺序实现。关于权利要求书、说明书以及附图中的操作流程,为方便起见而使用“首先”、“接着”等进行了说明,但并不意味着必须按照这样的顺序实施。It should be noted that the order of execution of each process such as actions, sequences, steps, and stages in the devices, systems, programs, and methods shown in the claims, the description, and the drawings is not specifically stated "before" , "In advance", and so on, and as long as the output of the previous processing is not used in the subsequent processing, it can be implemented in any order. The operation flow in the claims, the description, and the drawings is described using “first”, “next”, and the like for convenience, but it is not meant to be implemented in this order.
以上使用实施方式对本发明进行了说明,但是本发明的技术范围并不限于上述实施方式所描述的范围。对本领域普通技术人员来说,显然可对上述实施方式加以各种变更或改良。从权利要求书的描述显而易见的是,加以了这样的变更或改良的方式都可包含在本发明的技术范围之内。The present invention has been described using the embodiments, but the technical scope of the present invention is not limited to the scope described in the above embodiments. It will be apparent to those skilled in the art that various changes or improvements can be made to the above-mentioned embodiments. It is apparent from the description of the claims that the manner in which such changes or improvements are added can be included in the technical scope of the present invention.
【符号说明】【Symbol Description】
100 摄像装置100 camera
102 摄像部102 camera department
110 摄像控制部110 camera control section
111 获取部111 acquisition department
112 第一滤波器部112 first filter section
113 第二滤波器部113 second filter section
114 导出部114 export department
115 检测部115 inspection department
116 判断部116 Judgment Department
117 确定部117 Confirmation Department
120 图像传感器120 image sensor
160 显示部160 display
162 操作部162 Operation Department
170 存储器170 memory
200 镜头部200 lens section
210 镜头210 lens
212 镜头移动机构212 lens movement mechanism
220 镜头控制部220 lens control section
1200 计算机1200 computer
1210 主机控制器1210 Host Controller
1212 CPU1212 CPU
1214 RAM1214 RAM
1220 输入/输出控制器1220 input / output controller
1222 通信接口1222 communication interface
1230 ROM1230 ROM

Claims (10)

  1. 一种确定装置,包括:A determining device includes:
    获取部,其获取由包括聚焦镜头的摄像装置拍摄的图像;An acquisition unit that acquires an image captured by an imaging device including a focusing lens;
    第一滤波器部,其使所述图像的空间频率分量中的第一频率分量通过;A first filter unit that passes a first frequency component of a spatial frequency component of the image;
    第二滤波器部,其使比所述图像的空间频率分量中的所述第一频率分量更高频段的第二频率分量通过;A second filter unit that passes a second frequency component of a higher frequency band than the first frequency component of the spatial frequency component of the image;
    导出部,其使用所述图像的第一频率分量导出所述图像的第一对比度评估值,并使用所述图像的第二频率分量导出所述图像的第二对比度评估值;A deriving unit, which uses a first frequency component of the image to derive a first contrast evaluation value of the image, and uses a second frequency component of the image to derive a second contrast evaluation value of the image;
    检测部,其检测多个所述图像各自的多个所述第一对比度评估值的峰值;A detecting unit that detects peaks of a plurality of the first contrast evaluation values each of a plurality of the images;
    判断部,当由所述检测部检测到所述多个第一对比度评估值的峰值时,其判断所述多个图像各自的多个所述第二对比度评估值是否满足预定条件;以及A judging section that, when the peaks of the plurality of first contrast evaluation values are detected by the detecting section, it determines whether the plurality of second contrast evaluation values of each of the plurality of images satisfy a predetermined condition; and
    确定部,当所述多个第二对比度评估值满足所述预定条件时,其基于所述多个第二对比度评估值确定所述聚焦镜头的位置。The determining unit determines a position of the focus lens based on the plurality of second contrast evaluation values when the plurality of second contrast evaluation values satisfy the predetermined condition.
  2. 如权利要求1所述的确定装置,其中,The determination apparatus according to claim 1, wherein:
    当所述多个第二对比度评估值不满足所述预定条件时,所述确定部基于所述多个第一对比度评估值确定所述聚焦镜头的位置。When the plurality of second contrast evaluation values do not satisfy the predetermined condition, the determination section determines a position of the focus lens based on the plurality of first contrast evaluation values.
  3. 如权利要求1所述的确定装置,其中,The determination apparatus according to claim 1, wherein:
    所述检测部还检测所述多个第二对比度评估值的峰值,The detecting unit further detects peaks of the plurality of second contrast evaluation values,
    所述预定条件为,由所述检测部检测到所述多个第二对比度评估值的峰值。The predetermined condition is that peaks of the plurality of second contrast evaluation values are detected by the detection section.
  4. 如权利要求1所述的确定装置,其中,The determination apparatus according to claim 1, wherein:
    所述检测部还检测所述多个第二对比度评估值的峰值,The detecting unit further detects peaks of the plurality of second contrast evaluation values,
    所述预定条件为,由所述检测部检测到的所述多个第二对比度评估值的峰值大于等于预定值。The predetermined condition is that a peak value of the plurality of second contrast evaluation values detected by the detection unit is equal to or greater than a predetermined value.
  5. 如权利要求1所述的确定装置,其中,The determination apparatus according to claim 1, wherein:
    所述检测部还检测所述多个第二对比度评估值的峰值,The detecting unit further detects peaks of the plurality of second contrast evaluation values,
    所述预定条件为,由所述检测部检测到所述多个第二对比度评估值的峰值大于或等于预定值,并且所述多个第二对比度评估值的最大值和最小值之差大于或等于预定差。The predetermined condition is that peaks of the plurality of second contrast evaluation values detected by the detection section are greater than or equal to a predetermined value, and a difference between a maximum value and a minimum value of the plurality of second contrast evaluation values is greater than or Equal to the predetermined difference.
  6. 如权利要求1所述的确定装置,其中,The determination apparatus according to claim 1, wherein:
    所述预定条件为,基于所述多个第一对比度评估值而确定的所述聚焦镜头的位置与基于所述多个第二对比度评估值而确定的所述聚焦镜头的位置之差在预定范围内。The predetermined condition is that a difference between a position of the focus lens determined based on the plurality of first contrast evaluation values and a position of the focus lens determined based on the plurality of second contrast evaluation values is within a predetermined range. Inside.
  7. 如权利要求1所述的确定装置,其中,The determination apparatus according to claim 1, wherein:
    所述检测部还检测所述多个第二对比度评估值的峰值,The detecting unit further detects peaks of the plurality of second contrast evaluation values,
    所述预定条件为,基于所述多个第一对比度评估值而确定的所述聚焦镜头的位置与基于所述多个第二对比度评估值而确定的所述聚焦镜头的位置之差在预定范围内,由所述检测部检测到的所述多个第二对比度评估值的峰值大于或等于预定值,并且所述多个第二对比度评估值的最大值和最小值之差大于或等于预定差。The predetermined condition is that a difference between a position of the focus lens determined based on the plurality of first contrast evaluation values and a position of the focus lens determined based on the plurality of second contrast evaluation values is within a predetermined range. Within, the peaks of the plurality of second contrast evaluation values detected by the detection section are greater than or equal to a predetermined value, and the difference between the maximum value and the minimum value of the plurality of second contrast evaluation values is greater than or equal to a predetermined difference .
  8. 一种确定装置,包括:A determining device includes:
    如权利要求1至7中任一项所述的确定装置;The determining device according to any one of claims 1 to 7;
    所述聚焦镜头;以及The focusing lens; and
    控制部,其基于由所述确定装置确定的所述聚焦镜头的位置来控制所述聚焦镜头的位置。A control unit controls the position of the focus lens based on the position of the focus lens determined by the determination device.
  9. 一种确定方法,包括:A determination method, including:
    获取由包括聚焦镜头的摄像装置拍摄的图像的阶段;A stage of acquiring an image captured by an imaging device including a focusing lens;
    经由第一滤波器部使所述图像的空间频率分量中的第一频率分量通过的阶段;A stage in which a first frequency component of a spatial frequency component of the image is passed through a first filter section;
    经由第二滤波器使比所述图像的空间频率分量中的所述第一频率分量更高频段的第二频率分量通过的阶段;A stage of passing a second frequency component of a higher frequency band than the first frequency component of the spatial frequency component of the image via a second filter;
    使用所述图像的第一频率分量导出所述图像的第一对比度评估值的阶段;A stage of deriving a first contrast evaluation value of the image using a first frequency component of the image;
    使用所述图像的第二频率分量导出所述图像的第二对比度评估值的阶段;A stage of deriving a second contrast evaluation value of the image using a second frequency component of the image;
    检测多个所述图像各自的多个所述第一对比度评估值的峰值的阶段;A stage of detecting peaks of a plurality of the first contrast evaluation values of each of the plurality of images;
    当在所述检测阶段检测到所述多个第一对比度评估值的峰值时,判断所述多个图像各自的多个所述第二对比度评估值是否满足预定条件的阶段;以及A stage of determining whether the plurality of second contrast evaluation values of each of the plurality of images satisfy a predetermined condition when peaks of the plurality of first contrast evaluation values are detected in the detection stage;
    当所述多个第二对比度评估值满足所述预定条件时,基于所述多个第二对比度评估值确定所述聚焦镜头的位置的阶段。When the plurality of second contrast evaluation values meet the predetermined condition, a stage of determining a position of the focusing lens based on the plurality of second contrast evaluation values.
  10. 一种程序,其用于使计算机作为如权利要求1至7中任一项所述的确定装置发挥功能。A program for causing a computer to function as the determination device according to any one of claims 1 to 7.
PCT/CN2019/091744 2018-06-19 2019-06-18 Determining device, photographing device, determining method, and program WO2019242617A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201980005655.9A CN111344631A (en) 2018-06-19 2019-06-18 Specifying device, imaging device, specifying method, and program

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018-116392 2018-06-19
JP2018116392A JP6561370B1 (en) 2018-06-19 2018-06-19 Determination device, imaging device, determination method, and program

Publications (1)

Publication Number Publication Date
WO2019242617A1 true WO2019242617A1 (en) 2019-12-26

Family

ID=67689573

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/091744 WO2019242617A1 (en) 2018-06-19 2019-06-18 Determining device, photographing device, determining method, and program

Country Status (3)

Country Link
JP (1) JP6561370B1 (en)
CN (1) CN111344631A (en)
WO (1) WO2019242617A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6961889B1 (en) * 2020-06-30 2021-11-05 エスゼット ディージェイアイ テクノロジー カンパニー リミテッドSz Dji Technology Co., Ltd Control device, imaging device, control method, and program

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101310205A (en) * 2006-01-17 2008-11-19 索尼株式会社 Focus control device and imaging device
CN101738826A (en) * 2008-11-17 2010-06-16 株式会社日立制作所 Focus control device and focus control method
WO2014073441A1 (en) * 2012-11-06 2014-05-15 富士フイルム株式会社 Imaging device and method for controlling operation thereof
US20140313398A1 (en) * 2013-04-17 2014-10-23 Canon Kabushiki Kaisha Imaging apparatus and imaging method

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4470651B2 (en) * 2003-08-29 2010-06-02 日本ビクター株式会社 Automatic focus adjustment device
JP2005309323A (en) * 2004-04-26 2005-11-04 Kodak Digital Product Center Japan Ltd Focal length detecting method of imaging, and imaging apparatus
JP4885156B2 (en) * 2008-02-07 2012-02-29 株式会社日立製作所 Focus control apparatus and method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101310205A (en) * 2006-01-17 2008-11-19 索尼株式会社 Focus control device and imaging device
CN101738826A (en) * 2008-11-17 2010-06-16 株式会社日立制作所 Focus control device and focus control method
WO2014073441A1 (en) * 2012-11-06 2014-05-15 富士フイルム株式会社 Imaging device and method for controlling operation thereof
US20140313398A1 (en) * 2013-04-17 2014-10-23 Canon Kabushiki Kaisha Imaging apparatus and imaging method

Also Published As

Publication number Publication date
JP2019219501A (en) 2019-12-26
CN111344631A (en) 2020-06-26
JP6561370B1 (en) 2019-08-21

Similar Documents

Publication Publication Date Title
US10237491B2 (en) Electronic apparatus, method of controlling the same, for capturing, storing, and reproducing multifocal images
CN111052725B (en) Control device, imaging device, control method, and program
CN111932542B (en) Image identification method and device based on multiple focal lengths and storage medium
JP2007212724A5 (en)
WO2019242617A1 (en) Determining device, photographing device, determining method, and program
US10277795B2 (en) Image pickup apparatus for taking static image, control method therefor, and storage medium storing control program therefor
US10311097B2 (en) Image retrieving apparatus and method
US9781331B2 (en) Imaging apparatus, and control method thereof
EP3218756B1 (en) Direction aware autofocus
US20160295101A1 (en) Image capturing apparatus and control method thereof
WO2020038439A1 (en) Determining device, control device, photography device, determining method, and program
JP6623419B2 (en) Display control device, imaging device, smartphone, display control method, and program
US11546502B2 (en) Image processing apparatus and method of controlling the same
WO2019065582A1 (en) Image data discrimination system, image data discrimination program, image data discrimination method and imaging system
JP6911250B2 (en) Control device, imaging device, control method, and program
US9232132B1 (en) Light field image processing
US10321043B2 (en) Focus detection apparatus, focus control apparatus, image-capturing apparatus and focus detection method
JP2021110794A (en) Control device, imaging apparatus, control method and program
JP2019203967A (en) Display controller, imaging apparatus, method for controlling display, and program
JP2016114785A (en) Imaging device, imaging method and imaging program
WO2021057462A1 (en) Control device, photographing device, control method, and program
CN104349035A (en) Image capturing equipment and method
US9049382B2 (en) Image processing apparatus and image processing method
JP6623414B2 (en) Lens device, imaging device, control method, and program
EP3474226A1 (en) Information processing device, system, information processing method, and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19821603

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19821603

Country of ref document: EP

Kind code of ref document: A1