WO2012081647A1 - Automatic focusing apparatus and lens apparatus including the automatic focusing apparatus - Google Patents

Automatic focusing apparatus and lens apparatus including the automatic focusing apparatus Download PDF

Info

Publication number
WO2012081647A1
WO2012081647A1 PCT/JP2011/078979 JP2011078979W WO2012081647A1 WO 2012081647 A1 WO2012081647 A1 WO 2012081647A1 JP 2011078979 W JP2011078979 W JP 2011078979W WO 2012081647 A1 WO2012081647 A1 WO 2012081647A1
Authority
WO
WIPO (PCT)
Prior art keywords
focus
detection result
focusing
focus detection
execution
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2011/078979
Other languages
French (fr)
Inventor
Ryohei Sasaki
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Priority to US13/990,484 priority Critical patent/US8890997B2/en
Publication of WO2012081647A1 publication Critical patent/WO2012081647A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/28Systems for automatic generation of focusing signals
    • G02B7/30Systems for automatic generation of focusing signals using parallactic triangle with a base line
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/28Systems for automatic generation of focusing signals
    • G02B7/36Systems for automatic generation of focusing signals using image sharpness techniques, e.g. image processing techniques for generating autofocus signals
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B13/00Viewfinders; Focusing aids for cameras; Means for focusing for cameras; Autofocus systems for cameras
    • G03B13/32Means for focusing
    • G03B13/34Power focusing
    • G03B13/36Autofocus systems
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B3/00Focusing arrangements of general interest for cameras, projectors or printers
    • G03B3/10Power-operated focusing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals
    • H04N23/672Focus control based on electronic image sensor signals based on the phase difference signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals
    • H04N23/673Focus control based on electronic image sensor signals based on contrast or high frequency components of image signals, e.g. hill climbing method

Definitions

  • the present invention relates to an automatic focusing apparatus, and particularly, to an automatic focusing apparatus used in a still camera, a TV camera, and a video camera and a lens apparatus including the
  • contrast AF high frequency components of the image picked up by a picked up image element is extracted and the focus position is controlled by maximizing an evaluation value
  • the focusing accuracy of the contrast AF is high, because focusing is determined using an image signal obtained based on an output signal from the image pickup element that picks up an image of an object.
  • phase difference AF Phase difference system automatic focusing
  • the beam from the object is divided into two beams in an in-focus state detecting apparatus to form two images on sensors.
  • Correlation computing is applied to photoelectrically converted signals of two images to detect the phase difference.
  • a defocus amount and an object distance are calculated from the phase difference, and the defocus amount and the object distance are converted to a drive target position of the focus lens to control the focus lens to perform focusing .
  • a hybrid AF system in which a combination of the contrast AF and external measuring AF and phase difference AF is further proposed.
  • an automatic focusing operation needs to be executed every time the object distance changes to cause the object being out of focus.
  • the automatic focusing apparatus including only the contrast AF, if the evaluation value of the contrast AF for an object for which a focusing operation was once performed to obtain an in-focus state, decreases by a value greater than a predetermined value, an automatic focusing operation is executed again (hereinafter, focusing operation executed again after focusing will be described as "re-execution operation").
  • the evaluation value of the contrast AF may reduces when the object is moving while the object is in in-focus state.
  • contrast AF evaluation value reduces by more than a predetermined value, it is difficult to determine whether the object distance is changed or the object has moved without involving a change in the object distance.
  • the re-execution operation of AF that would not be necessary if the object is in in-focus state is executed, and it is significantly uncomfortable to view the picked up image if a search operation is performed.
  • 2007-174521 discloses a technique of using a blur detector to detect a change in the composition and controlling not to perform the focus adjustment during the change in the composition.
  • the AF search may be performed and the focus may become unstable if the contrast AF evaluation value reduces during the movement of the object, because the change in the composition is not detected.
  • An object of the present invention is to provide an automatic focusing apparatus that can attain both the stability and the followability in AF by appropriately executing an AF re-execution operation when there is a movement of an object or a change in a composition.
  • invention includes: a focus lens unit; a focus driver that drives the focus lens unit; a first focus detector that detects an in-focus state based on a phase
  • a second focus detector that detects an in- focus state using a signal from an image pickup
  • a focus controller that controls the focus driver to perform focusing based on a first focus detection result detected by the first focus detector and a second focus detection result detected by the second focus detector; a movement detector that detects a movement of an object with components in a direction perpendicular to an optical axis based on an image signal obtained from the first focus detector; and a re-execution determination unit that determines whether to control the focus driver to re-execute focusing based on the first focus detection result and the second focus detection result that are newly detected after the execution of focusing and based on a movement detection result detected by the movement detector.
  • the present invention can provide an automatic focusing apparatus that can attain both the stability and the followability in automatic focusing.
  • Fig. 1 is a block diagram illustrating a
  • Fig. 2 is a diagram for describing a concept of phase difference detection using external measuring sensors .
  • Fig. 3 is a flow chart for describing a
  • Fig. 4 is a flow chart for describing a process of external measuring AF according to the embodiment.
  • Fig. 5 is a flow cart for describing a process of contrast AF according to the embodiment.
  • Fig. 6 is a flow chart for describing a process of AF re-execution determination (a contrast AF evaluation value and an external measuring AF result) according to the embodiment.
  • Fig. 7 is a flow chart for describing a process of parallel movement detection of an object according to the embodiment.
  • Fig. 8 is a diagram for describing a principle of the parallel movement detection according to the embodiment .
  • Fig. 9 is a flow chart for describing a process of AF re-execution determination (only the contrast AF evaluation value) according to the embodiment.
  • Fig. 1 is a block diagram illustrating a configuration of an automatic focusing apparatus according to the embodiment of the present invention.
  • the automatic focusing apparatus of the present invention includes a lens apparatus 100 and a camera apparatus 200.
  • he lens apparatus 100 includes a focus driver
  • the focus motor 112 driven by the driver 113 moves the focus lens unit 111 in an optical axis direction.
  • the focus position detector 114 detects the position of the focus lens unit 111.
  • the sensor imaging lenses 121 are arranged at positions independent from an optical system where the beam entering an image pickup element 201 described later passes through.
  • the beam that has entered the sensor imaging lenses 121 is divided into two beams, and a pair of images (hereinafter, called "two images") are formed on the external measuring sensors 122.
  • the external measuring sensors 122 photoelectrically convert the formed two images and output two image signals .
  • ig. 2 illustrates a conceptual diagram of phase
  • the sensor imaging lenses 121 include a pair of lenses 121-1 and 121-2, and the external measuring sensors 122 include a pair of area sensors 122-1 and 122-2.
  • a base length of the external measuring sensors 122 is designated with B, a focal length of the sensor imaging lenses 121 is designated with f, and a phase difference between image signals formed on the area sensors 122-1 and 122-2 is
  • An object distance L which is a distance from the object to the sensor imaging lenses 121, can be calculated by Expression (1) .
  • the lens apparatus 100 includes a CPU 130, and the CPU 130 includes a sensor controller 131, a phase difference detector 132, a movement detector 133, a controller 134, a contrast detector 135, a lens controller 136, and a memory 137 described later.
  • the sensor controller 131 controls the external
  • measuring sensors 122 obtains two image signals from the external measuring sensors 122, and outputs
  • difference detector 132 performs correlation computing to calculate the phase difference to calculate the object distance based on Expression (1).
  • the sensor imaging lenses 121, the external measuring sensors 122, the sensor controller 131, and the phase difference detector 132 constitute a first focus detector (external measuring AF mechanism) of a phase difference detection system
  • the contrast detector 135 constitutes a second focus detector of a contrast system.
  • detector 133 detects (determines) whether the object has moved with components in a direction perpendicular to the optical axis of the external measuring sensors 122.
  • the movement of the object with components in a direction perpendicular to the optical axis of the external measuring sensors 122 denotes a movement of the object with components in a direction parallel to the imaging plane in a normal case in which the imaging plane is arranged perpendicular to the optical axis.
  • the present embodiment describes a case in which the object moves with components in a horizontal direction of the imaging plane perpendicular to the optical axis (hereinafter, the movement is referred to as "parallel movement").
  • parallel movement a method of detecting the parallel
  • the controller 134 serving as a focus controlling unit outputs a command value to the lens controller 136 for driving the focus lens unit 111 described later based on an object distance (first focus detection result) obtained from the phase difference detector 132 and a contrast AF evaluation value (second focus detection result) obtained from the contrast detector 135
  • the camera apparatus 200 includes the image pickup
  • the image pickup element 201 receives a beam passed through the optical system including the focus lens unit 111 and photoelectrically converts and outputs the beam.
  • the image processor 202 converts the photoelectrically converted signal to an image signal and outputs the image signal to the lens apparatus 100.
  • the contrast detector 135 of the lens apparatus 100 obtains the image signal from the image processor 202 of the camera apparatus 200.
  • the contrast detector 135 further extracts high frequency components from the obtained image signal to calculate a contrast AF evaluation value used to determine the focus.
  • the lens controller 136 moves the focus lens unit 111 to the target position in the optical axis direction through the driver 113 and the focus motor 112.
  • the memory 137 stores information necessary for the controller 134 (re-execution determination unit) to determine whether to perform a re-execution operation of AF, such as the waveforms of two images obtained from the external measuring sensors 122, the object distance obtained by the phase difference detector 132, the contrast AF evaluation value obtained by the contrast detector 135, and the focus position.
  • a flow of a series of AF operations of the automatic focusing apparatus according to the present embodiment will be described with reference to flow charts and drawings of Fig. 3 and subsequent drawings.
  • Fig. 3 illustrates a flow of processes of the AF operations according to the present embodiment.
  • the CPU 130 controls the processes according to a computer program stored in a memory not illustrated. When the power of the lens apparatus 100 is turned on, the CPU 130
  • step S110 executes the processes from step S110.
  • the automatic focusing apparatus attains an in-focus state for the target object by way of steps S110 to S170. If it is determined that re- execution of the AF operation is necessary in step S190 or S200, the process is executed again from step S110.
  • step S110 the controller 134 initializes the
  • the information necessary for re-execution determination such as the waveforms of two images of the external measuring AF, the object distance, the contrast AF evaluation value, and the focus position, stored in the memory 137.
  • step S120 the external measuring AF mechanism
  • step S121 of Fig. 4 the phase difference detector 132 calculates the phase difference by correlation computing based on the obtained waveforms of two images. At this point, waveforms of two images Wl are stored in the memory 137.
  • the first focus detector outputs the external measuring AF reliability value, the waveforms of two images, and the object distance as the first focus detection result which is information which relates to the in-focus state detection.
  • step S122 if the external measuring AF reliability value is greater than the predetermined value, the process proceeds to step S123. If the external
  • step S123 the phase difference detector 132
  • step S124 the controller 134 calculates a focus target position Pt corresponding to the object distance Dl calculated in step S123.
  • the focus target position is obtained using the object distance Dl calculated in step S123 and a table stored in a program not
  • step S140 an external measuring AF_OK flag is set to ON indicating that the external measuring AF is reliable, and the process proceeds to step S160.
  • step S130 If the external measuring AF reliability value is equal to or smaller than the predetermined value in step S130, the process proceeds to step S150.
  • the external measuring AF reliability value is equal to or smaller than the predetermined value in step S130, the process proceeds to step S150.
  • step S170 measuring AF_OK flag is set to OFF, and the process proceeds to step S170.
  • step S160 the lens controller 136 drives the focus lens unit 111 to the focus target position Pt obtained in step S124 through the driver 113 and the focus motor 112.
  • step S170 a focusing operation by the contrast AF is performed.
  • the contrast AF of step S170 will be described with reference to the flow chart of Fig. 5.
  • step S171 the controller 134 performs, at the
  • a wobbling operation that is, an operation in which the focus position is moved to the near side direction and to the infinity direction, to determine the driving direction of the focus lens unit 111 in which the contrast AF evaluation value becomes large.
  • step S172 the focus target position is updated to a position separated by a predetermined sampling interval.
  • the lens controller 136 drives the focus lens unit 111 toward the focus target position obtained in step S172.
  • step S174 the contrast detector 135 extracts high frequency components from the image signal obtained from the image processor 202 to calculate the contrast AF evaluation value.
  • step S175 whether the contrast AF evaluation value obtained in step S174 is the maximum value is determined.
  • Steps S171 to S175 are so-called hill- climbing detection, and the search operation is repeated until the maximum value is detected.
  • step S175 If the maximum value is detected in step S175, the
  • step S176 the lens controller 136 drives the focus lens unit 111 to the focus position where the maximum value is indicated.
  • the focus position serves as the in-focus point.
  • step S177 the controller 134 stores an in-focus contrast AF evaluation value VI in the memory 137. The process then proceeds to step S180.
  • step S180 the controller 134 proceeds to a re- execution determination 1 of step S190 if the external measuring AF_OK flag stored in the memory 137 is ON and proceeds to a re-execution determination 2 of step S200 if the external measuring AF_OK flag is OFF.
  • step S190 or S200 If it is determined that the re-execution of the AF operation is necessary in step S190 or S200 based on a newly detected object distance (first focus detection evaluation value) and a contrast AF evaluation value (second focus detection evaluation value) after the adjustment of focus and focusing of the object in step S170, the process is executed again from step S110.
  • step S190 The re-execution determination 1 of step S190 will be described using a flow chart of Fig. 6.
  • step S191 the contrast detector 135 executes the same process as in step S174 and calculates a contrast AF evaluation value Vnow.
  • step S192 the controller 134 compares the in-focus contrast AF evaluation value VI stored in step S177 of Fig. 5 with the contrast AF evaluation value Vnow calculated in step S191, and if the difference
  • step S191 (variation amount) between VI and Vnow is equal to or smaller than a threshold value ThVl (equal to or smaller than the first predetermined value) . If the difference between VI and Vnow is greater than the threshold value ThVl, the process proceeds to step S193.
  • the threshold value ThVl is a threshold value for
  • the threshold value ThVl be a relative value with respect to VI, such as 20% of the contrast AF evaluation value VI in the in-focus state.
  • An appropriate value may be set in each case for the threshold value ThVl according to the imaging
  • step S193 the phase difference detector 132
  • step S121 executes the same process as in step S121 based on the waveforms of two images obtained through the external measuring sensors 122 and the sensor controller 131 and calculates the phase difference by correlation
  • step S194 the phase difference detector 132
  • step S195 the controller 134 compares the object distance Dl in the in-focus state by the external measuring AF stored in step S123 with the object distance Dnow calculated in step S194. If the absolute value of the difference (variation amount) between Dl and Dnow is greater than a threshold value ThD (second predetermined value) , it is determined that the re- execution of AF is necessary, and the process returns to step S110 of Fig. 3. The process is executed when the object moves, the object distance changes, and the focus state becomes out of focus.
  • ThD second predetermined value
  • step S196 If the absolute value of the difference between Dl and Dnow is equal to or smaller than the threshold value ThD (equal to or smaller than the second predetermined value) , it is determined that the object distance is not changed or that the change in the object distance is within the focusing range, and the process proceeds to step S196.
  • the threshold value ThD is a distance from the position of the object to the edge of the depth of field beyond which the object would be out of focus.
  • An appropriate value may be set each time for the threshold value ThD according to the depth of field determined from the focal length, an aperture value, and the like of the optical system not illustrated, or a fixed value may be written in a program in advance and used.
  • step S196 the movement detector 133 detects whether the object has moved with components parallel to the imaging plane (hereinafter, described as "parallel movement detection") from step S121 to step S193 based on the waveforms of two images Wl stored in step S121 and the waveforms of two images now stored in step S193.
  • step S196 The parallel movement detection of step S196 will be described with reference to Figs. 7 and 8.
  • step S1961 of Fig. 7 an index (coordinates) Idx_Wl of a pixel indicating the maximum value of the
  • step S1962 an index Idx_Wnow of a pixel indicating the maximum value of the brightness level in the waveforms of two images Wnow obtained in step S193 is calculated .
  • FIG. 8 illustrates the waveforms of two images Wl in step S121 of Fig. 3.
  • FIG. 8 illustrates the waveforms of two images Wnow of the object moving to the right without involving a change in the object distance in step S193. Only one of the waveforms of two images is illustrated.
  • the vertical axis indicates the brightness level, and the horizontal axis indicates pixels of the external measuring sensors.
  • step S1963 the indices of the pixels obtained in
  • steps S1961 and S1962 are compared. As a result of the comparison, if there is a difference between Idx_Wl and Idx_Wnow as in Fig. 8, the process proceeds to step S1964, and a parallel movement flag is set to ON. On the other hand, if Idx_Wl and Idx_Wnow are equal, the process proceeds to step S1965, and the parallel
  • step S191 the process returns to step S191, and the re- execution determination 1 is executed again.
  • the process is executed while the object is moving in a direction not involving a change in the object distance.
  • step S197 If the parallel movement flag is OFF in step S197, the process proceeds to step S198.
  • step S198 the controller 134 compares the contrast AF evaluation value VI stored in step S177 of Fig. 3 with the contrast AF evaluation value Vnow obtained in step S191.
  • Vnow is equal to or smaller than a threshold value ThV2 (equal to or smaller than a third predetermined value) that is greater than the threshold value ThVl
  • the process returns to step S191, and the re-execution determination 1 is executed again.
  • the process is executed when the brightness of the object or the brightness of the surrounding is reduced while the position of the object is not changed.
  • the process returns to step S110 of Fig. 3 to re-execute the AF.
  • the contrast AF evaluation value often significantly decreases when the imaging scene is changed.
  • the value of the threshold value ThV2 needs to be a value greater than the
  • threshold value ThVl to detect the change in the imaging scene and the change in the imaging target object (completion of the change in the composition) .
  • step S201 of Fig. 9 the contrast detector 135
  • step S174 calculates the contrast AF evaluation value.
  • Vnow calculates the contrast AF evaluation value
  • step S202 the controller 134 compares the in-focus contrast AF evaluation value VI stored in step S177 of Fig. 3 with the contrast AF evaluation value Vnow calculated in step S201. If the difference between VI and Vnow is greater than a threshold value ThV3 in step S202, the process proceeds to step S203.
  • step S203 a counter i for counting the number of times that the difference between VI and Vnow has exceeded the threshold value is incremented. It is desirable that the threshold value ThV3 be a value equal to the threshold value VI described above.
  • step S205 whether the number of times the difference has exceeded the threshold value is greater than a predetermined number of times is determined. If the number is greater than the predetermined number of times, it is determined that the object is completely out of focus or that the imaging scene is changed
  • step S206 if the number is not over the predetermined number of times, it is determined that the composition is being changed, and the process proceeds to step S206.
  • step S206 if the difference between VI and Vnow is greater than a threshold value ThV4 (>ThV3) , the process returns to step S110 of Fig. 3 to perform the re-execution of the AF regardless of the number of times the difference between VI and Vnow has exceeded the threshold value.
  • ThV4 a threshold value
  • the threshold value ThV4 is a threshold value for determining that the object focused in step S176 is completely out of focus or that the imaging scene is changed (change in the composition is finished) .
  • the threshold value ThV4 needs to be a value greater than the threshold value ThV3.
  • step S202 the controller 134 compares the contrast AF evaluation value VI stored in step S170 of Fig. 3 with the contrast AF evaluation value Vnow calculated in step S201. If the difference is equal to or smaller than the threshold value ThV3, the process proceeds to step S204 to clear i. The process returns to step S201 to execute the process of the re-execution
  • the re-execution of the AF can be immediately performed when the object distance is changed and the target object becomes out of focus after the object is focused.
  • unstable focusing caused by a search operation can be prevented by continuing the re-execution determination process of the AF if the in-focus state is maintained.
  • whether to perform the re-execution operation of the AF is determined by comparing three elements, the change in the contrast AF evaluation value, the change in the object distance, and the parallel movement, with those when the object is in focus. More specifically, the object distance of the AF, the contrast AF evaluation value, and the like are also detected during the re- execution determination. The detection system is always operating, and the re-execution operation can be immediately performed if the re-execution of the AF is necessary .
  • the threshold values may be automatically set based on the external measuring target position calculation of step S120 or the results of computation performed in the contrast AF focusing operations of step S170, or
  • arbitrary values may be able to be set from the outside. Enabling to arbitrarily set the threshold values allows flexibly changing the threshold values in accordance with imaging conditions, such as indoor image pickup, outdoor image pickup, and night time image pickup, as well as features of a connected image pickup apparatus, and picking up image in excellent conditions can be realized.
  • indices (coordinates) of pixels at the centers of gravity of the waveforms in the waveforms of two images Wl stored in step S121 and the waveforms of two images Wnow stored in step SI93 may be compared.
  • Fig. 8 it may be determined that the object has moved parallel. More specifically, it can be determined that the object has moved parallel when a phase difference is obtained as a result of correlation computing of waveforms at a plurality of different times. In this way, the parallel movement can be highly accurately detected even if the image shapes of Wl and Wnow do not completely match each other.
  • the driving direction of the focus lens unit 111 is determined by the wobbling operation in step S171 of Fig. 5, the driving direction may be determined based on the focus target position Pt calculated in step S124 of Fig. 4.
  • the present invention is not limited to the processing procedure and the processing content.
  • the in-focus state for the target object may be obtained only by the contrast AF or only by the external measuring AF. More
  • step S190 determination 1 of step S190 and the re-execution determination 2 of step S200, can be adopted.
  • a movement of the object moving in the vertical direction may also be detected depending on the angle of attaching the

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Automatic Focus Adjustment (AREA)
  • Studio Devices (AREA)
  • Focusing (AREA)

Abstract

An automatic focusing apparatus includes: a focus lens unit; a focus driver; a first focus detector that detects an in-focus state based on a phase difference; a second focus detector that detects an in-focus state using a signal from an image pickup element; a focus controller that controls the focus driver to perform focusing based on a first focus detection result and a second focus detection result; a movement detector that detects a movement of an object with components in a direction perpendicular to an optical axis based on an image signal obtained from the first focus detector; and a re-execution determination unit that determines whether to control the focus driver to re-execute focusing based on the first focus detection result and the second focus detection result that are newly detected after the execution of focusing and based on a movement detection result detected by the movement detector.

Description

DESCRIPTION
AUTOMATIC FOCUSING APPARATUS AND LENS APPARATUS INCLUDING THE AUTOMATIC FOCUSING APPARATUS
Technical Field
[0001] The present invention relates to an automatic focusing apparatus, and particularly, to an automatic focusing apparatus used in a still camera, a TV camera, and a video camera and a lens apparatus including the
automatic focusing apparatus.
Background Art
[0002] Conventionally, there are various proposals related to an automatic focusing technique used in a still camera, a TV camera, and a video camera.
[0003] For example, contrast based automatic focusing
(hereinafter "contrast AF") is proposed, in which high frequency components of the image picked up by a picked up image element is extracted and the focus position is controlled by maximizing an evaluation value
corresponding to the sharpness of the image to perform focusing. In the contrast AF, a search operation, that is, changing the position of the focus lens, is
required to determine the direction of the movement of the focus lens where the evaluation value corresponding to the contrast of the image relative to the focus position is the maximum and to determine the maximum point. It is known that the focusing accuracy of the contrast AF is high, because focusing is determined using an image signal obtained based on an output signal from the image pickup element that picks up an image of an object.
[0004 ] So-called external measuring AF is also proposed, in which a distance measuring sensor is arranged
independently from an image pickup lens, and the in- focus position of the focus lens is calculated from an obtained object distance to control the focus lens to perform focusing. Phase difference system automatic focusing (hereinafter, "phase difference AF" ) is also proposed, in which a split optical system splits a beam passed through an image pickup lens, an in-focus state with respect to the object is detected from the split beams, and focusing is performed based on the result.
[0005]Among these, in the external measuring AF and the phase difference AF, the beam from the object is divided into two beams in an in-focus state detecting apparatus to form two images on sensors. Correlation computing is applied to photoelectrically converted signals of two images to detect the phase difference. A defocus amount and an object distance are calculated from the phase difference, and the defocus amount and the object distance are converted to a drive target position of the focus lens to control the focus lens to perform focusing .
[0006] In the external measuring AF and the phase difference AF, it is known that there is no need to perform a search operation performed in the contrast AF, and the focusing speed is fast.
[0007] o utilize the high focusing accuracy of the contrast AF and the high focusing speed of the external
measuring AF and the phase difference AF, a hybrid AF system in which a combination of the contrast AF and external measuring AF and phase difference AF is further proposed.
[0008] To maintain the in-focus state with respect to the
target object by automatic focusing, an automatic focusing operation needs to be executed every time the object distance changes to cause the object being out of focus.
[0009] In the automatic focusing apparatus including only the contrast AF, if the evaluation value of the contrast AF for an object for which a focusing operation was once performed to obtain an in-focus state, decreases by a value greater than a predetermined value, an automatic focusing operation is executed again (hereinafter, focusing operation executed again after focusing will be described as "re-execution operation").
[0010] In this case, if the object moves without involving a change in the object distance, such as when the object moves in a parallel direction (horizontal direction) relative to the imaging plane or when panning operation is performed, the evaluation value of the contrast AF may reduces when the object is moving while the object is in in-focus state.
[0011] Therefore, based only on the condition that the
contrast AF evaluation value reduces by more than a predetermined value, it is difficult to determine whether the object distance is changed or the object has moved without involving a change in the object distance. The re-execution operation of AF that would not be necessary if the object is in in-focus state is executed, and it is significantly uncomfortable to view the picked up image if a search operation is performed.
[0012] For example, Japanese Patent Application Laid-Open No.
2007-174521 discloses a technique of using a blur detector to detect a change in the composition and controlling not to perform the focus adjustment during the change in the composition. When there is a change in the composition during shooting of a video, such as by panning, unstable focusing caused by the AF
following the change in the distance status of the object in the screen can be prevented.
[0013] In the conventional technique disclosed in Japanese
Patent Application Laid-Open No. 2007-174521, the AF is terminated during the detection of the change in the composition. Therefore, unstable focusing can be prevented as described above when there is panning.
[ 0014 ] However, when the object moves parallel to the imaging plane instead of the change in the composition, the AF search may be performed and the focus may become unstable if the contrast AF evaluation value reduces during the movement of the object, because the change in the composition is not detected.
An object of the present invention is to provide an automatic focusing apparatus that can attain both the stability and the followability in AF by appropriately executing an AF re-execution operation when there is a movement of an object or a change in a composition. Citation List
Patent Literature
PTL 1: Japanese Patent Application Laid-Open No. 2007- 174521
Summary of Invention
[0015]An automatic focusing apparatus of the present
invention includes: a focus lens unit; a focus driver that drives the focus lens unit; a first focus detector that detects an in-focus state based on a phase
difference; a second focus detector that detects an in- focus state using a signal from an image pickup
element; a focus controller that controls the focus driver to perform focusing based on a first focus detection result detected by the first focus detector and a second focus detection result detected by the second focus detector; a movement detector that detects a movement of an object with components in a direction perpendicular to an optical axis based on an image signal obtained from the first focus detector; and a re-execution determination unit that determines whether to control the focus driver to re-execute focusing based on the first focus detection result and the second focus detection result that are newly detected after the execution of focusing and based on a movement detection result detected by the movement detector.
[0016] The present invention can provide an automatic focusing apparatus that can attain both the stability and the followability in automatic focusing.
[0017] Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings.
Brief Description of Drawings
[0018] [Fig. l]Fig. 1 is a block diagram illustrating a
configuration of an automatic focusing apparatus according to an embodiment.
[Fig. 2] Fig. 2 is a diagram for describing a concept of phase difference detection using external measuring sensors .
[Fig. 3] Fig. 3 is a flow chart for describing a
focusing operation according to the embodiment.
[Fig. 4] Fig. 4 is a flow chart for describing a process of external measuring AF according to the embodiment.
[Fig. 5] Fig. 5 is a flow cart for describing a process of contrast AF according to the embodiment.
[Fig. 6] Fig. 6 is a flow chart for describing a process of AF re-execution determination (a contrast AF evaluation value and an external measuring AF result) according to the embodiment.
[Fig. 7] Fig. 7 is a flow chart for describing a process of parallel movement detection of an object according to the embodiment.
[Fig. 8] Fig. 8 is a diagram for describing a principle of the parallel movement detection according to the embodiment .
[Fig. 9] Fig. 9 is a flow chart for describing a process of AF re-execution determination (only the contrast AF evaluation value) according to the embodiment.
Description of Embodiments
[ 0019] Preferred embodiments of the present invention will now be described in detail in accordance with the
accompanying drawings .
[0020] Fig. 1 is a block diagram illustrating a configuration of an automatic focusing apparatus according to the embodiment of the present invention. In Fig. 1, the automatic focusing apparatus of the present invention includes a lens apparatus 100 and a camera apparatus 200.
[0021] he lens apparatus 100 includes a focus driver
including a focus lens unit 111, a focus motor 112, a driver 113, and a focus position detector 114. The focus motor 112 driven by the driver 113 moves the focus lens unit 111 in an optical axis direction.
The focus position detector 114 detects the position of the focus lens unit 111.
[0022] The sensor imaging lenses 121 are arranged at positions independent from an optical system where the beam entering an image pickup element 201 described later passes through. The beam that has entered the sensor imaging lenses 121 is divided into two beams, and a pair of images (hereinafter, called "two images") are formed on the external measuring sensors 122. The external measuring sensors 122 photoelectrically convert the formed two images and output two image signals .
[0023] ig. 2 illustrates a conceptual diagram of phase
difference detection and object distance calculation using the sensor imaging lenses 121 and the external measuring sensors 122. The sensor imaging lenses 121 include a pair of lenses 121-1 and 121-2, and the external measuring sensors 122 include a pair of area sensors 122-1 and 122-2. A base length of the external measuring sensors 122 is designated with B, a focal length of the sensor imaging lenses 121 is designated with f, and a phase difference between image signals formed on the area sensors 122-1 and 122-2 is
designated with P. An object distance L, which is a distance from the object to the sensor imaging lenses 121, can be calculated by Expression (1) .
L=fxB/P (1) [0024] Returning to the description of Fig. 1, the lens apparatus 100 includes a CPU 130, and the CPU 130 includes a sensor controller 131, a phase difference detector 132, a movement detector 133, a controller 134, a contrast detector 135, a lens controller 136, and a memory 137 described later.
[0025] The sensor controller 131 controls the external
measuring sensors 122, obtains two image signals from the external measuring sensors 122, and outputs
waveforms of two images (waveforms expressed by signals of two images) . Based on the waveforms of two images output by the sensor controller 131, the phase
difference detector 132 performs correlation computing to calculate the phase difference to calculate the object distance based on Expression (1).
[0026] In the automatic focusing apparatus of the present
invention, the sensor imaging lenses 121, the external measuring sensors 122, the sensor controller 131, and the phase difference detector 132 constitute a first focus detector (external measuring AF mechanism) of a phase difference detection system, and the contrast detector 135 constitutes a second focus detector of a contrast system.
[0027] Based on the waveforms of two images, the movement
detector 133 detects (determines) whether the object has moved with components in a direction perpendicular to the optical axis of the external measuring sensors 122. The movement of the object with components in a direction perpendicular to the optical axis of the external measuring sensors 122 denotes a movement of the object with components in a direction parallel to the imaging plane in a normal case in which the imaging plane is arranged perpendicular to the optical axis.
The present embodiment describes a case in which the object moves with components in a horizontal direction of the imaging plane perpendicular to the optical axis (hereinafter, the movement is referred to as "parallel movement"). A method of detecting the parallel
movement of the object will be described later.
[0028] The controller 134 serving as a focus controlling unit outputs a command value to the lens controller 136 for driving the focus lens unit 111 described later based on an object distance (first focus detection result) obtained from the phase difference detector 132 and a contrast AF evaluation value (second focus detection result) obtained from the contrast detector 135
described later.
[0029] The camera apparatus 200 includes the image pickup
element 201 and an image processor 202. The image pickup element 201 receives a beam passed through the optical system including the focus lens unit 111 and photoelectrically converts and outputs the beam. The image processor 202 converts the photoelectrically converted signal to an image signal and outputs the image signal to the lens apparatus 100.
[0030] The contrast detector 135 of the lens apparatus 100 obtains the image signal from the image processor 202 of the camera apparatus 200. The contrast detector 135 further extracts high frequency components from the obtained image signal to calculate a contrast AF evaluation value used to determine the focus. The lens controller 136 moves the focus lens unit 111 to the target position in the optical axis direction through the driver 113 and the focus motor 112.
[0031] The memory 137 stores information necessary for the controller 134 (re-execution determination unit) to determine whether to perform a re-execution operation of AF, such as the waveforms of two images obtained from the external measuring sensors 122, the object distance obtained by the phase difference detector 132, the contrast AF evaluation value obtained by the contrast detector 135, and the focus position. [0032]A flow of a series of AF operations of the automatic focusing apparatus according to the present embodiment will be described with reference to flow charts and drawings of Fig. 3 and subsequent drawings. Fig. 3 illustrates a flow of processes of the AF operations according to the present embodiment. The CPU 130 controls the processes according to a computer program stored in a memory not illustrated. When the power of the lens apparatus 100 is turned on, the CPU 130
executes the processes from step S110. The automatic focusing apparatus according to the present embodiment attains an in-focus state for the target object by way of steps S110 to S170. If it is determined that re- execution of the AF operation is necessary in step S190 or S200, the process is executed again from step S110.
[0033] Hereinafter, the processes will be sequentially
described.
In step S110, the controller 134 initializes the
information necessary for re-execution determination, such as the waveforms of two images of the external measuring AF, the object distance, the contrast AF evaluation value, and the focus position, stored in the memory 137.
[0034] In step S120, the external measuring AF mechanism
calculates the focus target position. External
measuring target position calculation of step S120 will be described with reference to the flow chart of Fig. 4.
[0035] In step S121 of Fig. 4, the phase difference detector 132 calculates the phase difference by correlation computing based on the obtained waveforms of two images. At this point, waveforms of two images Wl are stored in the memory 137.
[0036] In the correlation computing, a coincidence between two images indicating a degree of coincidence between image shapes of the waveforms of two images is taken into consideration. The coincidence between two images is obtained in the process of the correlation computing. The larger the coincidence between two images is, the higher the reliability of the correlation computation result is.
[ 0037 ] Therefore, if an external measuring AF reliability
value is greater than a predetermined value, the correlation computation result is reliable. If the external measuring AF reliability value is smaller than the predetermined value, the correlation computation result is not reliable. In the present embodiment, the coincidence between two images will be called an external measuring AF reliability value. The first focus detector outputs the external measuring AF reliability value, the waveforms of two images, and the object distance as the first focus detection result which is information which relates to the in-focus state detection.
[0038] In step S122, if the external measuring AF reliability value is greater than the predetermined value, the process proceeds to step S123. If the external
measuring AF reliability value is equal to or smaller than the predetermined value, the focus target position based on the external measuring AF is not calculated, and the process proceeds to step S130 of Fig. 3.
[0039] In step S123, the phase difference detector 132
calculates an object distance Dl of the object, not illustrated, by Expression (1) based on the phase difference .
[0040] In step S124, the controller 134 calculates a focus target position Pt corresponding to the object distance Dl calculated in step S123. The focus target position is obtained using the object distance Dl calculated in step S123 and a table stored in a program not
illustrated. The controller 134 stores the object distance Dl in the memory 137. The process then proceeds to step S130 of Fig. 3. [0041] The process proceeds to step S130 of Fig. 3, and if the external measuring AF reliability value is greater than the predetermined value, the process proceeds to step S140. In step S140, an external measuring AF_OK flag is set to ON indicating that the external measuring AF is reliable, and the process proceeds to step S160.
[0042] If the external measuring AF reliability value is equal to or smaller than the predetermined value in step S130, the process proceeds to step S150. The external
measuring AF_OK flag is set to OFF, and the process proceeds to step S170.
[0043] In step S160, the lens controller 136 drives the focus lens unit 111 to the focus target position Pt obtained in step S124 through the driver 113 and the focus motor 112.
[0044] In step S170, a focusing operation by the contrast AF is performed. The contrast AF of step S170 will be described with reference to the flow chart of Fig. 5.
[0045] In step S171, the controller 134 performs, at the
current focus position, a wobbling operation, that is, an operation in which the focus position is moved to the near side direction and to the infinity direction, to determine the driving direction of the focus lens unit 111 in which the contrast AF evaluation value becomes large.
[0046] In step S172, the focus target position is updated to a position separated by a predetermined sampling interval.
[0047] In S173, the lens controller 136 drives the focus lens unit 111 toward the focus target position obtained in step S172.
[0048] In step S174, the contrast detector 135 extracts high frequency components from the image signal obtained from the image processor 202 to calculate the contrast AF evaluation value.
[0049] In step S175, whether the contrast AF evaluation value obtained in step S174 is the maximum value is determined. Steps S171 to S175 are so-called hill- climbing detection, and the search operation is repeated until the maximum value is detected.
[0050] If the maximum value is detected in step S175, the
process proceeds to step S176. In step S176, the lens controller 136 drives the focus lens unit 111 to the focus position where the maximum value is indicated. The focus position serves as the in-focus point.
[0051] In step S177, the controller 134 stores an in-focus contrast AF evaluation value VI in the memory 137. The process then proceeds to step S180.
[0052] In step S180, the controller 134 proceeds to a re- execution determination 1 of step S190 if the external measuring AF_OK flag stored in the memory 137 is ON and proceeds to a re-execution determination 2 of step S200 if the external measuring AF_OK flag is OFF.
[0053] If it is determined that the re-execution of the AF operation is necessary in step S190 or S200 based on a newly detected object distance (first focus detection evaluation value) and a contrast AF evaluation value (second focus detection evaluation value) after the adjustment of focus and focusing of the object in step S170, the process is executed again from step S110.
[0054] The re-execution determination 1 of step S190 will be described using a flow chart of Fig. 6.
[0055] In step S191, the contrast detector 135 executes the same process as in step S174 and calculates a contrast AF evaluation value Vnow.
[0056] In step S192, the controller 134 compares the in-focus contrast AF evaluation value VI stored in step S177 of Fig. 5 with the contrast AF evaluation value Vnow calculated in step S191, and if the difference
(variation amount) between VI and Vnow is equal to or smaller than a threshold value ThVl (equal to or smaller than the first predetermined value) , the process returns to step S191. It is determined at this point that there is no change in the position of the object from when the object is focused in step S180. If the difference between VI and Vnow is greater than the threshold value ThVl, the process proceeds to step S193.
[0057] The threshold value ThVl is a threshold value for
determining, for the object focused in step S176, that there is a possibility that the object is out of focus, and it is desirable that the threshold value ThVl be a relative value with respect to VI, such as 20% of the contrast AF evaluation value VI in the in-focus state. An appropriate value may be set in each case for the threshold value ThVl according to the imaging
environment, or a fixed value may be written in a program in advance and used.
[0058] In step S193, the phase difference detector 132
executes the same process as in step S121 based on the waveforms of two images obtained through the external measuring sensors 122 and the sensor controller 131 and calculates the phase difference by correlation
computing. At this point, waveforms of two images now are stored in the memory 137.
[0059] In step S194, the phase difference detector 132
executes the same process as in step S123 and
calculates an object distance Dnow from the phase difference .
[0060] In step S195, the controller 134 compares the object distance Dl in the in-focus state by the external measuring AF stored in step S123 with the object distance Dnow calculated in step S194. If the absolute value of the difference (variation amount) between Dl and Dnow is greater than a threshold value ThD (second predetermined value) , it is determined that the re- execution of AF is necessary, and the process returns to step S110 of Fig. 3. The process is executed when the object moves, the object distance changes, and the focus state becomes out of focus.
[0061] If the absolute value of the difference between Dl and Dnow is equal to or smaller than the threshold value ThD (equal to or smaller than the second predetermined value) , it is determined that the object distance is not changed or that the change in the object distance is within the focusing range, and the process proceeds to step S196.
[0062] The threshold value ThD is a distance from the position of the object to the edge of the depth of field beyond which the object would be out of focus. An appropriate value may be set each time for the threshold value ThD according to the depth of field determined from the focal length, an aperture value, and the like of the optical system not illustrated, or a fixed value may be written in a program in advance and used.
[0063] In step S196, the movement detector 133 detects whether the object has moved with components parallel to the imaging plane (hereinafter, described as "parallel movement detection") from step S121 to step S193 based on the waveforms of two images Wl stored in step S121 and the waveforms of two images now stored in step S193.
[0064] The parallel movement detection of step S196 will be described with reference to Figs. 7 and 8.
[0065] In step S1961 of Fig. 7, an index (coordinates) Idx_Wl of a pixel indicating the maximum value of the
brightness level in the waveforms of two images Wl stored in step S122 is calculated.
[0066] In step S1962, an index Idx_Wnow of a pixel indicating the maximum value of the brightness level in the waveforms of two images Wnow obtained in step S193 is calculated .
[0067] (a) of Fig. 8 illustrates the waveforms of two images Wl in step S121 of Fig. 3. (b) of Fig. 8 illustrates the waveforms of two images Wnow of the object moving to the right without involving a change in the object distance in step S193. Only one of the waveforms of two images is illustrated. The vertical axis indicates the brightness level, and the horizontal axis indicates pixels of the external measuring sensors.
[0068] In step S1963, the indices of the pixels obtained in
steps S1961 and S1962 are compared. As a result of the comparison, if there is a difference between Idx_Wl and Idx_Wnow as in Fig. 8, the process proceeds to step S1964, and a parallel movement flag is set to ON. On the other hand, if Idx_Wl and Idx_Wnow are equal, the process proceeds to step S1965, and the parallel
movement flag is set to OFF. The process then proceeds to step S197 of Fig. 6.
[0069] If the parallel movement flag is ON in step S197 of Fig.
6, the process returns to step S191, and the re- execution determination 1 is executed again. For example, the process is executed while the object is moving in a direction not involving a change in the object distance.
[0070] If the parallel movement flag is OFF in step S197, the process proceeds to step S198.
[0071] In step S198, the controller 134 compares the contrast AF evaluation value VI stored in step S177 of Fig. 3 with the contrast AF evaluation value Vnow obtained in step S191.
[0072] If the difference (variation amount) between VI and
Vnow is equal to or smaller than a threshold value ThV2 (equal to or smaller than a third predetermined value) that is greater than the threshold value ThVl, the process returns to step S191, and the re-execution determination 1 is executed again. For example, the process is executed when the brightness of the object or the brightness of the surrounding is reduced while the position of the object is not changed.
[0073] On the other hand, if the difference between VI and Vnow is greater than the threshold value ThV2, it is determined that the imaging scene is changed and that the situation is changed from when the object is focused in step S180 (change in the composition is finished), and the process returns to step S110 of Fig. 3 to re-execute the AF. In general, the contrast AF evaluation value often significantly decreases when the imaging scene is changed. The value of the threshold value ThV2 needs to be a value greater than the
threshold value ThVl to detect the change in the imaging scene and the change in the imaging target object (completion of the change in the composition) .
[0074] A flow of the process when the process proceeds to the re-execution determination 2 of step S200 will be described with reference to a flow chart of Fig. 9. Since the external measuring AF reliability value decreases when the contrast of the object is low, only the contrast AF evaluation value is used to perform the re-execution determination by a known method. An example will be described here.
[0075] In step S201 of Fig. 9, the contrast detector 135
calculates the contrast AF evaluation value. The same process as in step S174 is executed to calculate the contrast AF evaluation value Vnow.
[0076] In step S202, the controller 134 compares the in-focus contrast AF evaluation value VI stored in step S177 of Fig. 3 with the contrast AF evaluation value Vnow calculated in step S201. If the difference between VI and Vnow is greater than a threshold value ThV3 in step S202, the process proceeds to step S203.
[0077] In step S203, a counter i for counting the number of times that the difference between VI and Vnow has exceeded the threshold value is incremented. It is desirable that the threshold value ThV3 be a value equal to the threshold value VI described above.
[0078] In step S205, whether the number of times the difference has exceeded the threshold value is greater than a predetermined number of times is determined. If the number is greater than the predetermined number of times, it is determined that the object is completely out of focus or that the imaging scene is changed
(change in the composition is finished) . The process returns to step S110 of Fig. 3 to perform the re- execution of the AF.
On the other hand, if the number is not over the predetermined number of times, it is determined that the composition is being changed, and the process proceeds to step S206.
[0079] In step S206, if the difference between VI and Vnow is greater than a threshold value ThV4 (>ThV3) , the process returns to step S110 of Fig. 3 to perform the re-execution of the AF regardless of the number of times the difference between VI and Vnow has exceeded the threshold value.
[0080] On the other hand, if the difference between VI and
Vnow is equal to smaller than the threshold value ThV4 , the process returns to step S201, and the process of the re-execution determination 2 is executed again. The threshold value ThV4 is a threshold value for determining that the object focused in step S176 is completely out of focus or that the imaging scene is changed (change in the composition is finished) . The threshold value ThV4 needs to be a value greater than the threshold value ThV3.
[0081] In step S202, the controller 134 compares the contrast AF evaluation value VI stored in step S170 of Fig. 3 with the contrast AF evaluation value Vnow calculated in step S201. If the difference is equal to or smaller than the threshold value ThV3, the process proceeds to step S204 to clear i. The process returns to step S201 to execute the process of the re-execution
determination 2 again. [0082]As described, according to the present embodiment, the re-execution of the AF can be immediately performed when the object distance is changed and the target object becomes out of focus after the object is focused.
[0083] Even when the contrast AF evaluation value decreases
due to panning of the image pickup apparatus in
addition to when the object moves without involving a change in the object distance, unstable focusing caused by a search operation can be prevented by continuing the re-execution determination process of the AF if the in-focus state is maintained.
[0084 ] Furthermore, according to the present embodiment,
whether to perform the re-execution operation of the AF is determined by comparing three elements, the change in the contrast AF evaluation value, the change in the object distance, and the parallel movement, with those when the object is in focus. More specifically, the object distance of the AF, the contrast AF evaluation value, and the like are also detected during the re- execution determination. The detection system is always operating, and the re-execution operation can be immediately performed if the re-execution of the AF is necessary .
[0085] In this way, an automatic focusing apparatus that can attain both the stability and the followability in the AF can be provided.
[0086] As for the setting method of the threshold values ThVl, ThV2, and ThD described in the present embodiment, the threshold values may be automatically set based on the external measuring target position calculation of step S120 or the results of computation performed in the contrast AF focusing operations of step S170, or
arbitrary values may be able to be set from the outside. Enabling to arbitrarily set the threshold values allows flexibly changing the threshold values in accordance with imaging conditions, such as indoor image pickup, outdoor image pickup, and night time image pickup, as well as features of a connected image pickup apparatus, and picking up image in excellent conditions can be realized.
[0087] In the present embodiment, although the indices of the pixels with the maximum values of brightness level indicated by the waveforms in the waveforms of two images Wl stored in step S121 and the waveforms of two images Wnow stored in step S193 are compared in the method of parallel movement detection in the
description, the following method may be used.
[0088] For example, indices (coordinates) of pixels at the centers of gravity of the waveforms in the waveforms of two images Wl stored in step S121 and the waveforms of two images Wnow stored in step SI93 may be compared.
[0089] For example, when there is a phase difference as a
result of correlation computing of Wl and Wnow
illustrated in Fig. 8, it may be determined that the object has moved parallel. More specifically, it can be determined that the object has moved parallel when a phase difference is obtained as a result of correlation computing of waveforms at a plurality of different times. In this way, the parallel movement can be highly accurately detected even if the image shapes of Wl and Wnow do not completely match each other.
[0090] In the present embodiment, although the driving
direction of the focus lens unit 111 is determined by the wobbling operation in step S171 of Fig. 5, the driving direction may be determined based on the focus target position Pt calculated in step S124 of Fig. 4.
[0091] Although the power of the lens apparatus 100 is turned on, and an in-focus state for the target object is obtained through steps S110 to S180 of Fig. 3 in the description of the present embodiment, the present invention is not limited to the processing procedure and the processing content. The in-focus state for the target object may be obtained only by the contrast AF or only by the external measuring AF. More
specifically, a method of obtaining, when the object is focused, the object distance Dl, the contrast AF
evaluation value VI, and the waveforms of two images Wl, which are values necessary for the re-execution
determination 1 of step S190 and the re-execution determination 2 of step S200, can be adopted.
[0092] In the present embodiment, an example of the object
moving to the right without involving a change in the object distance is illustrated in Fig. 8, a movement of the object moving in the vertical direction may also be detected depending on the angle of attaching the
external measuring sensors 122.
[0093] Although an example of configuration based on the
external measuring AF (non-TTL phase difference AF) is illustrated in the present embodiment, the same
advantageous effects can be obtained in a configuration based on TTL phase difference AF.
[0094] Although the exemplary embodiment of the present
invention has been described, the present invention is not limited to the embodiment, and various
modifications and changes can be made within the scope of the present invention.
[0095] While the present invention has been described with
reference to exemplary embodiments, it is to be
understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest
interpretation so as to encompass all such
modifications and equivalent structures and functions.
[0096] This application claims the benefit of Japanese
Patent Application No. 2010-281466, filed December 17, 2010, which is hereby incorporated by reference herein in its entirety.

Claims

An automatic focusing apparatus comprising:
a focus lens unit;
a focus driver that drives the focus lens unit;
a first focus detector that detects an in-focus state based on a phase difference;
a second focus detector that detects an in-focus state using a signal from an image pickup element;
a focus controller that controls the focus driver to perform focusing based on a first focus detection result detected by the first focus detector and a second focus detection result detected by the second focus detector;
a movement detector that detects a movement of an object with components in a direction perpendicular to an optical axis based on an image signal obtained from the first focus detector; and
a re-execution determination unit that determines whether to control the focus driver to re-execute focusing based on the first focus detection result and the second focus detection result that are newly detected after the execution of focusing and based on a movement detection result detected by the movement detector .
The automatic focusing apparatus according to claim 1, wherein
the re-execution determination unit does not re-execute focusing if a variation amount of the second focus detection result newly detected after the execution of focusing with respect to the second focus detection result in an in-focus state is equal to or smaller than a first predetermined value.
The automatic focusing apparatus according to claim 1, wherein
the re-execution determination unit re-executes focusing if the variation amount of the second focus detection result newly detected after the execution of focusing with respect to the second focus detection result in an in-focus state is greater than a first predetermined value, and a variation amount of the first focus detection result newly detected after the execution of focusing with respect to the first focus detection result in the in-focus state is greater than a second predetermined value.
The automatic focusing apparatus according to claim 1, wherein
the re-execution determination unit does not re-execute focusing if the variation amount of the second focus detection result newly detected after the execution of focusing with respect to the second focus detection result in an in-focus state is greater than a first predetermined value, the variation amount of the first focus detection result newly detected after the execution of focusing with respect to the first focus detection result in the in-focus state is equal to or smaller than a second predetermined value, and the movement detector detects the movement of the object with components in the perpendicular direction.
The automatic focusing apparatus according to claim 1, wherein
the re-execution determination unit re-executes focusing if the variation amount of the second focus detection result newly detected after the execution of focusing with respect to the second focus detection result in an in-focus state is greater than a first predetermined value, the variation amount of the first focus detection result newly detected after the execution of focusing with respect to the first focus detection result in the in-focus state is equal to or smaller than a second predetermined value, the
movement detector does not detect the movement of the object with components in the perpendicular direction, and the variation amount of the second focus detection result newly detected after the execution of focusing with respect to the second focus detection result in the in-focus state is greater than a third
predetermined value.
The automatic focusing apparatus according to claim 1, wherein
the re-execution determination unit does not re-execute focusing if the variation amount of the second focus detection result newly detected after the execution of focusing with respect to the second focus detection result in an in-focus state is greater than a first predetermined value, the variation amount of the first focus detection result newly detected after the
execution of focusing with respect to the first focus detection result in the in-focus state is equal to or smaller than a second predetermined value, the
movement detector does not detect the movement of the object with components in the perpendicular direction, and the variation amount of the second focus detection result newly detected after the execution of focusing with respect to the second focus detection result in the in-focus state is equal to or smaller than a third predetermined value.
The automatic focusing apparatus according to claims 1, wherein
the movement detector determines that the object has moved with components in the perpendicular direction when coordinates of a maximum value of brightness indicated by waveforms for calculating the phase difference change.
The automatic focusing apparatus according to claims 1, wherein
the movement detector determines that the object has moved with components in the perpendicular direction when coordinates of centers of gravity of the waveforms for calculating the phase difference change.
[9] The automatic focusing apparatus according to claims 1, wherein
the movement detector determines whether the object has moved with components in the direction perpendicular to the optical axis based on the phase difference obtained by applying correlation computing to the waveforms at a plurality of different times.
[10] A lens apparatus comprising the automatic focusing
apparatus according to any one of claims 1 to 9.
PCT/JP2011/078979 2010-12-17 2011-12-08 Automatic focusing apparatus and lens apparatus including the automatic focusing apparatus Ceased WO2012081647A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US13/990,484 US8890997B2 (en) 2010-12-17 2011-12-08 Automatic focusing apparatus and lens apparatus including the automatic focusing apparatus

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2010-281466 2010-12-17
JP2010281466A JP5800498B2 (en) 2010-12-17 2010-12-17 Automatic focus adjustment device and lens device having the same

Publications (1)

Publication Number Publication Date
WO2012081647A1 true WO2012081647A1 (en) 2012-06-21

Family

ID=46244742

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2011/078979 Ceased WO2012081647A1 (en) 2010-12-17 2011-12-08 Automatic focusing apparatus and lens apparatus including the automatic focusing apparatus

Country Status (3)

Country Link
US (1) US8890997B2 (en)
JP (1) JP5800498B2 (en)
WO (1) WO2012081647A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104796587A (en) * 2014-01-20 2015-07-22 日立产业控制解决方案有限公司 Imaging apparatus, imaging method, and focus control apparatus
CN104823094A (en) * 2012-11-29 2015-08-05 富士胶片株式会社 Image capture device and focus control method

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013057889A (en) * 2011-09-09 2013-03-28 Toshiba Corp Image processing device and camera module
JP5743236B2 (en) 2013-09-17 2015-07-01 オリンパス株式会社 Photographing equipment and photographing method
US9794467B2 (en) 2013-11-01 2017-10-17 Canon Kabushiki Kaisha Focus adjustment apparatus, method for controlling focus adjustment apparatus, and storage medium
JP6351234B2 (en) * 2013-11-01 2018-07-04 キヤノン株式会社 Automatic focusing device, control method for automatic focusing device, control program for automatic focusing device, and storage medium
CN105960604B (en) * 2014-02-07 2018-07-31 富士胶片株式会社 Photographic device and focusing control method
US9288379B2 (en) * 2014-03-12 2016-03-15 Omnivision Technologies, Inc. System and method for continuous auto focus within camera module
US9338345B2 (en) * 2014-06-13 2016-05-10 Intel Corporation Reliability measurements for phase based autofocus
US9769371B1 (en) * 2014-09-09 2017-09-19 Amazon Technologies, Inc. Phase detect auto-focus
US9703175B2 (en) * 2015-07-02 2017-07-11 Qualcomm Incorporated Systems and methods for autofocus trigger
WO2017102428A1 (en) * 2015-12-18 2017-06-22 Asml Netherlands B.V. Focus monitoring arrangement and inspection apparatus including such an arrangement
JP6843558B2 (en) * 2016-08-31 2021-03-17 キヤノン株式会社 Lens control device, its control method
WO2018063625A1 (en) * 2016-09-28 2018-04-05 Kla-Tencor Corporation Direct focusing with image binning in metrology tools
JP7536529B2 (en) * 2020-06-29 2024-08-20 キヤノン株式会社 Control device, method, program and storage medium

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH02162308A (en) * 1988-12-15 1990-06-21 Olympus Optical Co Ltd Camera
JPH02205810A (en) * 1989-02-06 1990-08-15 Canon Inc Automatic focus adjusting device
JPH0561092A (en) * 1990-12-15 1993-03-12 Olympus Optical Co Ltd Camera jiggle preventing device
JPH07154669A (en) * 1993-11-25 1995-06-16 Canon Inc Automatic focus adjustment device
JP2001194578A (en) * 1999-11-02 2001-07-19 Olympus Optical Co Ltd Multipoint automatic focusing camera
JP2007065290A (en) * 2005-08-31 2007-03-15 Nikon Corp Autofocus device
JP2008160315A (en) * 2006-12-21 2008-07-10 Olympus Imaging Corp Imaging device
JP2009139688A (en) * 2007-12-07 2009-06-25 Nikon Corp Focus adjustment device and camera
JP2009157130A (en) * 2007-12-27 2009-07-16 Sanyo Electric Co Ltd Electronic camera
JP2009171301A (en) * 2008-01-17 2009-07-30 Panasonic Corp Imaging apparatus, portable terminal, and camera control method

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4532865B2 (en) * 2003-09-09 2010-08-25 キヤノン株式会社 Imaging device and focus control method of imaging device
US7773146B2 (en) * 2004-06-15 2010-08-10 Canon Kabushiki Kaisha Focus control apparatus and optical apparatus
JP2007174521A (en) 2005-12-26 2007-07-05 Nikon Corp Movie shooting device
JP4928190B2 (en) * 2006-08-11 2012-05-09 キヤノン株式会社 Focus control device and imaging device
JP5012091B2 (en) * 2007-03-02 2012-08-29 株式会社ニコン Focus adjustment device
JP2009115893A (en) * 2007-11-02 2009-05-28 Canon Inc Imaging device
US8760567B2 (en) * 2010-12-21 2014-06-24 Samsung Electronics Co., Ltd. Photographing apparatus and method to reduce auto-focus time

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH02162308A (en) * 1988-12-15 1990-06-21 Olympus Optical Co Ltd Camera
JPH02205810A (en) * 1989-02-06 1990-08-15 Canon Inc Automatic focus adjusting device
JPH0561092A (en) * 1990-12-15 1993-03-12 Olympus Optical Co Ltd Camera jiggle preventing device
JPH07154669A (en) * 1993-11-25 1995-06-16 Canon Inc Automatic focus adjustment device
JP2001194578A (en) * 1999-11-02 2001-07-19 Olympus Optical Co Ltd Multipoint automatic focusing camera
JP2007065290A (en) * 2005-08-31 2007-03-15 Nikon Corp Autofocus device
JP2008160315A (en) * 2006-12-21 2008-07-10 Olympus Imaging Corp Imaging device
JP2009139688A (en) * 2007-12-07 2009-06-25 Nikon Corp Focus adjustment device and camera
JP2009157130A (en) * 2007-12-27 2009-07-16 Sanyo Electric Co Ltd Electronic camera
JP2009171301A (en) * 2008-01-17 2009-07-30 Panasonic Corp Imaging apparatus, portable terminal, and camera control method

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104823094A (en) * 2012-11-29 2015-08-05 富士胶片株式会社 Image capture device and focus control method
US9488898B2 (en) 2012-11-29 2016-11-08 Fujifilm Corporation Imaging apparatus and focus control method
CN104823094B (en) * 2012-11-29 2017-08-11 富士胶片株式会社 Camera device and focusing control method
CN104796587A (en) * 2014-01-20 2015-07-22 日立产业控制解决方案有限公司 Imaging apparatus, imaging method, and focus control apparatus
US20150207982A1 (en) * 2014-01-20 2015-07-23 Hitachi Industry & Control Solutions, Ltd. Imaging apparatus, imaging method, and focus control apparatus
US9509896B2 (en) * 2014-01-20 2016-11-29 Hitachi Industry & Control Solutions, Ltd. Apparatus, imaging method, and focus control apparatus to control autofocus based on contrast signal

Also Published As

Publication number Publication date
JP5800498B2 (en) 2015-10-28
JP2012128316A (en) 2012-07-05
US20130250162A1 (en) 2013-09-26
US8890997B2 (en) 2014-11-18

Similar Documents

Publication Publication Date Title
WO2012081647A1 (en) Automatic focusing apparatus and lens apparatus including the automatic focusing apparatus
US9411128B2 (en) Automatic focusing apparatus with cyclic pattern determination
CN102591098B (en) Automatic focusing system and comprise its lens devices and image picking system
US11956536B2 (en) Methods and apparatus for defocus reduction using laser autofocus
EP2624538B1 (en) Image signal processing apparatus and image signal processing method
US20080002960A1 (en) Auto-focus apparatus, image-capture apparatus, and auto-focus method
US10863079B2 (en) Control apparatus, image capturing apparatus, and non-transitory computer-readable storage medium
JP2011039454A (en) Automatic focusing device, automatic focusing method, and program
US9154689B2 (en) Focus detector, and lens apparatus and image pickup apparatus including the same
US10165188B2 (en) Optical apparatus, display controlling method, and non-transitory computer readable storage medium storing a program, that display object distance information
US7830445B2 (en) Image-pickup apparatus and focus control method for the same
US12041350B2 (en) Imaging apparatus and control method thereof
KR102669853B1 (en) Camera switchover control techniques for multiple-camera systems
JP2014215475A5 (en)
JP2014215476A5 (en)
JP2019070737A (en) Observation device, focusing control method, and program
JP2014174441A (en) Image capturing device and control method therefor
US11622070B2 (en) Apparatus, method, and storage medium
JP5420034B2 (en) Imaging apparatus, control method therefor, program, and storage medium
JP2018004904A (en) Subject tracking device and imaging device
US20250024145A1 (en) Information processing device, information processing method, and program
JP5743710B2 (en) Imaging apparatus and control method thereof
JP5541396B2 (en) Image tracking device
JP2018116225A5 (en) Focus detection device, control method and program thereof, and imaging device
JP2015152750A (en) Focus adjustment device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11848710

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 13990484

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11848710

Country of ref document: EP

Kind code of ref document: A1