JP5312502B2 - Optical equipment - Google Patents

Optical equipment Download PDF

Info

Publication number
JP5312502B2
JP5312502B2 JP2011055188A JP2011055188A JP5312502B2 JP 5312502 B2 JP5312502 B2 JP 5312502B2 JP 2011055188 A JP2011055188 A JP 2011055188A JP 2011055188 A JP2011055188 A JP 2011055188A JP 5312502 B2 JP5312502 B2 JP 5312502B2
Authority
JP
Japan
Prior art keywords
focus
detection
lens
subject
control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2011055188A
Other languages
Japanese (ja)
Other versions
JP2011154385A (en
Inventor
健二 伊藤
Original Assignee
キヤノン株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to JP2004204649 priority Critical
Priority to JP2004204649 priority
Application filed by キヤノン株式会社 filed Critical キヤノン株式会社
Priority to JP2011055188A priority patent/JP5312502B2/en
Publication of JP2011154385A publication Critical patent/JP2011154385A/en
Application granted granted Critical
Publication of JP5312502B2 publication Critical patent/JP5312502B2/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B7/00Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/02Mountings, adjusting means, or light-tight connections, for optical elements for lenses
    • G02B7/04Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification
    • G02B7/10Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification by relative axial movement of several lenses, e.g. of varifocal objective lens
    • G02B7/102Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification by relative axial movement of several lenses, e.g. of varifocal objective lens controlled by a microcomputer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/225Television cameras ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, camcorders, webcams, camera modules specially adapted for being embedded in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/232Devices for controlling television cameras, e.g. remote control ; Control of cameras comprising an electronic image sensor
    • H04N5/23212Focusing based on image signals provided by the electronic image sensor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/225Television cameras ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, camcorders, webcams, camera modules specially adapted for being embedded in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/232Devices for controlling television cameras, e.g. remote control ; Control of cameras comprising an electronic image sensor
    • H04N5/23212Focusing based on image signals provided by the electronic image sensor
    • H04N5/232122Focusing based on image signals provided by the electronic image sensor based on the difference in phase of signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/225Television cameras ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, camcorders, webcams, camera modules specially adapted for being embedded in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/232Devices for controlling television cameras, e.g. remote control ; Control of cameras comprising an electronic image sensor
    • H04N5/23212Focusing based on image signals provided by the electronic image sensor
    • H04N5/232123Focusing based on image signals provided by the electronic image sensor based on contrast or high frequency components of image signals, e.g. hill climbing method

Abstract

An optical apparatus which achieves fast focusing operation and allows accurate focusing is disclosed. The optical apparatus includes a first focus detector which detects a focus state on a subject, a second focus detector which detects a focus state on the subject in a detection method different from a detection method of the first focus detector, and a controller which has a function of detecting whether or not the subject is a moving body and a function of performing focus control of an image-taking optical system in a first sequence in which at least one of the first and second focus detectors is used and a second sequence in which at least the other of the focus detectors is used. The controller preferentially uses one of the first and second sequences depending on the result of the detection with the moving body detecting function.

Description

  The present invention relates to an optical apparatus such as a camera, and more particularly to a focusing operation and control.

  In recent years, a subject image is imaged on a semiconductor image pickup device (CCD sensor, CMOS sensor, etc.) by an imaging optical system and converted into an electrical signal, and image information of the obtained image is converted into a semiconductor memory or a magnetic disk. A so-called digital camera for recording on a recording medium is widely used.

  This type of electronic camera is equipped with an autofocus (AF) function for controlling shooting conditions to automatically focus a subject image. As the autofocus control method, a contrast AF method or a phase difference detection AF method is used. Is adopted.

In the contrast AF method, the focus lens is moved in the direction in which the high frequency component of the luminance signal obtained from the image sensor (hereinafter referred to as AF evaluation value (sharpness)) increases, and the lens position where the AF evaluation value is maximized is adjusted. A hill-climbing method with a focal position, an AF evaluation value stored while driving the focus lens over the entire range, and a whole-area scanning method with the lens position corresponding to the maximum value of the stored AF evaluation value as the in-focus position It has been known. In particular, this contrast AF method is widely used because it uses an image pickup device for image pickup as it is and detects an AF evaluation value based on an output from the image pickup device.

In addition, a phase difference detection AF method is adopted in a single-lens reflex camera. This phase difference detection method has an optical system that uses a light beam that passes through pupil regions of a plurality of different photographing lenses with respect to an imaging surface and forms a secondary image thereof.

  Then, the two secondary images are detected using two line sensors, and the defocus state (amount) of the subject image is detected by detecting the phase difference between the image data of the two images. By controlling the focus position and performing predetermined lens driving, control is performed so that the in-focus state is obtained.

  Furthermore, focus control, which is a hybrid AF method combining these AF methods, has also been proposed. In this hybrid AF method, for example, the focus lens is driven to the vicinity of the focal point by the phase difference detection AF method, and then the focus lens is driven to the in-focus position by the contrast AF method with higher accuracy (see, for example, Patent Document 1). ).

Japanese Laid-Open Patent Publication No. 7-043605 (paragraph 0010, FIG. 6 etc.)

  However, in the focus detection of the contrast AF method, since the range of defocus amount that can be detected is narrow, it is difficult to detect the focus when the focus is largely out of focus, and in order to know the in-focus position. Since it takes time to scan the lens from infinity to the close end, it is not suitable for photographing a system that requires a quick operation and a rapidly moving subject. Furthermore, since there is little change in the high frequency component of the luminance signal at the part away from the in-focus position, there is a problem that it is difficult to know whether the focus shift is the front pin or the rear pin.

  In focus detection using the phase difference detection AF method, the range of defocus amounts that can be detected is wide, but there is a problem that a dead zone occurs in the focus detection area. In addition, since the amount of movement of the focus lens is determined by the shift of the imaging position in the image sensor, the AF possible range (AF range) is limited depending on the image sensor and the lens system. Therefore, when the range from infinity to the close end is large, if the lens system is set so that AF is possible in all the shootable ranges, the resolution will drop due to factors such as the element size of the image sensor, and the AF accuracy will decrease There is.

  For this reason, the hybrid AF method disclosed in Japanese Patent Application Laid-Open No. 7-043605 performs focus adjustment by focus detection using a phase difference detection method, and then performs fine adjustment using focus detection using a contrast method, and then performs focus adjustment. The above-mentioned problem is being addressed by performing the focusing operation.

  However, even when only focus detection using the phase difference detection method is sufficient in terms of focus accuracy, the focus detection is always performed using the contrast method, so that the focusing operation takes time and the opportunity to shoot a fast-moving subject is missed. , It takes time every time when shooting.

  It is an object of the present invention to provide an optical apparatus that can obtain a quick focusing operation and enables accurate focusing.

An optical apparatus according to one aspect of the present invention uses a first focus detection unit that detects a defocus amount, a second focus detection unit that detects a focus state by a contrast detection method, and a first focus detection unit. Control means for performing focus control of the photographing optical system by the first sequence and the second sequence using the first and second focus detection means. Then, the control means performs the first sequence when the movement of the subject image continues in the same direction from the detection results of a plurality of times by the first focus detection means , and the movement of the subject image is determined from the detection results of the plurality of times. If the directions are not the same, the second sequence is performed .

  According to the present invention, since focus control is performed in an optimal sequence according to the detection result of moving object detection or the detection result of the focal length, an optical apparatus that can perform a quick and accurate focusing operation is provided. Can do.

It is a block diagram of the camera system in Example 1 of this invention. 1 is a configuration block diagram of a camera system in Embodiment 1 of the present invention. It is principle explanatory drawing of the phase difference detection system in Example 1 of this invention. It is principle explanatory drawing of the phase difference detection system in Example 1 of this invention. It is principle explanatory drawing of the phase difference detection system in Example 1 of this invention. It is the block diagram which showed the operation | movement and structure of the phase difference detection system in Example 1 of this invention. It is the figure which showed an example of the moving body detection means in Example 1 of this invention. It is the schematic of the imaging | photography area | region of the image pick-up element in Example 1 of this invention. It is the figure which showed the relationship between the lens position in the contrast system of Example 1 of this invention, and a high frequency component. It is a flowchart of the focus detection of the contrast method in Example 1 of this invention. It is a flowchart which shows the focus control in Example 1 of this invention. It is a flowchart which shows the focus control in Example 2 of this invention. It is a figure which shows the main structures in the camera system (optical apparatus) which is Example 3 of this invention. FIG. 10 is a flowchart illustrating focus control corresponding to FIG. 9. It is a flowchart explaining the focus control corresponding to FIG.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a diagram illustrating a main configuration of a camera system (optical apparatus) that is Embodiment 1 of the present invention. The camera system of the present embodiment includes a camera main body 102 and a lens device 101 attached to the camera main body 102. The present embodiment will be described assuming an optical device in which the lens apparatus 101 can be attached to and detached from the camera main body 102, for example, a device configuration such as a single-lens reflex camera, but may be a lens-integrated optical device.

  Reference numerals 1 and 2 denote photographing lenses. Specifically, the photographing lens 1 is a zoom lens that can move in the optical axis direction to change the focal length of the photographing optical system, and the photographing lens 2 is a focus lens that moves in the optical axis L direction to perform focus adjustment. Each lens may be composed of one or a plurality of lenses. Reference numeral 3 denotes a stop as a light amount adjusting member that adjusts the amount of light incident on the image plane in accordance with the luminance of the subject. Here, the photographing lenses 1 and 2 and the diaphragm 3 are provided in the lens device 101.

  Reference numeral 5 denotes a mirror, which is disposed in the photographing optical path when the camera body 102 is in the non-photographing state, and is in a position retracted from the photographing optical path when in the photographing state. The mirror 5 has a half mirror 5a and a sub mirror 5b.

  When the half mirror 5a is in a non-photographing state, the half mirror 5a transmits a part of the light flux that has passed through the photographing lenses 1 and 2 to be directed toward the image plane, and reflects the remaining light flux in the camera body 102. To a finder optical system (not shown). The sub-mirror 5b disposed on the image plane side with respect to the half mirror 5a reflects the light beam transmitted through the half mirror 5a and guides it to the focus detection unit 9 described later when in the non-photographing state.

  L <b> 1 and L <b> 2 are the optical axis of the light beam toward the image plane and the optical axis of the light beam toward the focus detection unit 9 among the light beams divided by the half mirror 5. Reference numeral 8 denotes an image sensor (for example, a CCD or CMOS sensor) that photoelectrically converts a subject image (optical image) formed by the photographing lenses 1 and 2.

  Reference numeral 10 denotes a shutter (focal plane shutter) that limits the amount of light incident on the image sensor 8 by opening and closing the front curtain and the rear curtain. The shutter member 10 is retracted from the optical path of the photographic light beam in response to the ON / OFF of the release switch during imaging to start exposure, and the shutter 10 is closed when data is read from the image sensor 8.

  Reference numeral 9 denotes a focus detection unit which is a first focus detection unit, which receives a light beam (AF light beam) reflected by the sub mirror 5b and uses the phase difference detection method to focus the photographic optical system (including the photographic lenses 1 and 2). Is detected. Here, 9a is an AF mirror (a mirror with high reflectivity), which reflects the AF light flux from the sub-mirror 5b and guides it to an AF sensor described later. Reference numeral 9b denotes a separator lens for dividing the pupil of the AF light beam. An AF sensor 9c receives the AF light beam divided by the separator lens 9b, and detects a focus adjustment state (defocus amount) by a phase difference detection method.

  Next, the circuit configuration of the camera system of the present embodiment will be described with reference to FIG. FIG. 2 is a block diagram showing the configuration of the camera system of this embodiment. The same members as those described in FIG. 1 are denoted by the same reference numerals.

  The system controller 46 controls driving of the image sensor 8 via the imaging circuit 30. The signal read from the image sensor 8 is converted into a digital signal by the A / D converter 31 and subjected to predetermined image processing (color processing or the like) by the image processing circuit 32. The image signal generated by the image processing circuit 32 is temporarily stored in the buffer memory 33.

  When storing image information, the data stored in the buffer memory 33 is compressed in the compression / decompression circuit 34 by the JPEG method or the like, and then stored in a recording medium (for example, a semiconductor memory or a magnetic disk) 36 via the disk drive 35. To be recorded.

  The image information recorded on the recording medium 36 is decompressed by the compression / decompression circuit 34 and stored in the buffer memory 33, and then passed through the VRAM (video RAM) 42 and then by the display control circuit 43 by the display unit (LCD monitor). , Liquid crystal display) 44, and displayed as a photographed image.

  Further, the system controller 46 is provided with an AF control unit 45, a moving object detection unit 49, and a contrast signal generation unit 50. As a second focus detection unit, the contrast signal generation unit 50 generates an AF evaluation value (sharpness; high frequency component of the luminance signal of the subject) based on the output signal from the image sensor 8, and the AF control unit 45. Output to.

  Therefore, the AF control unit 45 receives the output signal from the AF sensor 9c and the AF evaluation value from the contrast signal generation unit 50, and both the AF control by the phase difference detection method and the AF control by the contrast method. Take control. Then, the system controller 46 performs drive control of the focus motor 21 via the focus drive circuit 19 in accordance with AF control by the AF control unit 45 to drive the focus lens 2.

  The system controller 46 performs control in the camera system, receives instructions from the release switch 41 and the zoom switch 48, and performs operations in accordance with these instructions.

  The release switch 41 is a switch SW1 for instructing start of a shooting preparation operation (photometry operation, focus adjustment operation, etc.) and a shooting operation (recording of a signal read from the image sensor 8 on the recording medium 36, etc.). And a switch SW2 for instructing. The zoom switch 48 is a switch for instructing switching of the focal length of the photographing optical system.

  When the system controller 46 receives an instruction from the zoom switch 48, the system controller 46 controls the zoom motor 40 via the zoom drive circuit 39 to drive the zoom lens 1 and also from the focal length detection circuit 47. Based on the output signal, the position of the zoom lens 1 (focal length of the photographing optical system) is monitored (detected).

  If the camera body 102 and the lens device 101 are each provided with a controller, some of the operations of the system controller 46 are performed by the controller in the camera body 102, and other operations are performed by the lens device 101. Can be done by the controller inside.

  Next, the principle and processing of the phase difference detection method in the focus detection unit 9 will be described with reference to FIGS. 3A to 3C and FIG.

9b is a separator lens for condensing the AF light beam reflected by the sub mirror 5 b to the photoelectric conversion element array 9D1,9d2. FIG. 3A shows the lens position and the sensor output in the focused state, and images are formed at the central portions on the respective photoelectric conversion element arrays 9d1 and 9d2 in the focused state.

  On the other hand, when the focus lens 2 moves to the right side or the left side in the drawing from the in-focus position shown in FIG. 3A, as shown in FIGS. 3B and 3C, the imaging position on the photoelectric conversion element arrays 9d1 and 9d2 becomes the photoelectric conversion element. It moves to the end side of the rows 9d1, 9d2. That is, in the state shown in FIG. 3B (the state of the front pin), the imaging positions of the two light beams are displaced in a direction approaching each other. In the state shown in FIG. 3C (rear pin state), the imaging positions of the two light beams are displaced in directions away from each other.

  Therefore, if a shift amount and a shift direction of the imaging position are detected and calculated, a signal necessary for driving the focus lens 2 to the in-focus position can be specified.

  FIG. 4 is a block diagram showing a configuration for performing the AF operation by the phase difference detection method.

  In the photoelectric conversion element arrays 9d1 and 9d2, the level of the output signal of the AF sensor 9c reaches a predetermined value or the measurement time in the accumulation time measurement unit 18 provided in the system controller 46 reaches a predetermined time (Tmax). When the charge accumulation is completed, the output signal of the AF sensor 9 c is quantized by the A / D 15 and then input to the system controller 46.

  The quantized quantum information is input to the Df amount calculation unit 16 to perform a shift amount calculation, and is normalized as a defocus amount Df. The normalized defocus amount Df is input to the motor drive amount conversion unit 17, and the motor drive amount conversion unit 17 calculates the drive amount of the focus motor 21 corresponding to the defocus amount Df. Then, the focus motor 21 is driven by a necessary amount according to the value, and the focus lens 2 is guided to the in-focus position.

  The defocus amount Df output by this phase difference detection method is also used for the moving object detection process of the moving object detection unit 49. That is, as described above, once in focus, the focused state is maintained unless the subject moves. Therefore, if it is detected whether the focused state is maintained, whether the subject is moving can be detected. .

Specifically, once the focus lens 2 is moved to the in-focus position by the in-focus processing, the in-focus state is maintained unless the subject moves, so the defocus amount Df calculated at this time does not change. Therefore, the moving object detection unit 49 performs the calculation of the defocus amount Df for a predetermined time a predetermined number of times, and calculates the change amount ΔDf of the defocus amount Df that has been calculated for the predetermined number of times.
Then, it is detected whether or not ΔDf is equal to or greater than a predetermined value (threshold). If the amount of change ΔDf is equal to or greater than the threshold, it is determined that the subject is moving, that is, the subject is a moving object, and the AF control unit 45 Output.

  In this way, the moving object detection unit 49 performs the calculation of the defocus amount Df a predetermined number of times, thereby detecting the distance to the subject each time and examining the change in the distance to recognize whether or not the subject is in a moving state. State recognition processing is performed.

  The calculation of the defocus amount Df and the calculation of the change amount ΔDf may be performed by the moving object detection unit 49, but the processing signal is output to the Df amount calculation unit 16 to calculate the calculated defocus amount Df at a predetermined time interval. A predetermined number of times may be acquired, the amount of change ΔDf may be calculated, and it may be determined whether the subject is a moving object by comparison with a threshold value.

Besides the above-mentioned detection methods moving object detection means definitive of the present embodiment also, for example, the phase difference, the distance may be detected based on a change in the switch such as a change in contrast, imaging device, or the subject moving object Any detection method that can detect whether or not can be applied without limitation.

  For example, as shown in FIG. 5, the defocus amount Df of the phase difference detection method is calculated, and the defocus amount Df2 at time T2 is repeatedly detected. Note that the defocus amount detected at the previous time T1 is DF1.

At this time, the system controller 46 obtains the feed amount LM of the focus lens 2 between times T1 and T2. Further, the system controller 46 sets the subject speed V1 with respect to the position of the focus lens 2,
V1 = (DF2 + LM-DF1) / (T2-T1) (1)
Calculate based on When the movement of the subject image obtained in this way continues in the same direction, it can be determined that the subject is a moving object.

  FIG. 6 shows a schematic diagram of the imaging region of the image sensor 8. In this embodiment, in order to speed up the read operation, only the necessary read area is read out at a normal speed, and the rest is read out at a high speed. 25 is a normal read transfer area, and 26 and 27 are high-speed read transfer areas in the first half and the latter half, respectively. Thus, the partial read operation can be speeded up by sweeping the area other than the necessary read area at high speed.

  Next, contrast type AF control will be described with reference to FIGS. FIG. 7 shows the relationship between the position of the focus lens 2 and the AF evaluation value in the whole area scanning method, and FIG. 8 is a flowchart of focus detection in the contrast method.

  If the movement position of the focus lens 2 in the phase difference detection method is the X position and the movement direction of the focus lens 2 is the right direction in the figure, the focus lens 2 is first moved from the X position to the left to the A position (infinity or Move to the nearest edge. Then, the focus lens 2 is shifted rightward by a small shift amount a starting from the A position, and the AF evaluation value is output by the contrast signal generation unit 50 based on the signal output from the image sensor 8 at each position. . The A position described here does not need to be at infinity or the closest end, and can be a predetermined position. Any position A that provides the desired in-focus position between the AX positions is sufficient.

  Specifically, as shown in FIG. 8, photometry (S40) is first performed. An exposure condition is set based on the photometric result (S41), and exposure and charge accumulation (S42) are performed. Then, the charge accumulation information is read from the image sensor 8 (S43) and output to the contrast signal generation unit 50. The contrast signal generator 50 outputs an AF evaluation value (S44), and stores the maximum value of the AF evaluation value and the lens position of the focus lens 2 corresponding to the maximum value (S45). Thereafter, the focus lens 2 is moved by a minute shift amount a (S46).

  Note that the smaller the shift amount “a” is, the higher the accuracy is as much as possible. However, the smaller the shift amount “a” is, the larger the number of times of detection becomes, and the longer the focus operation time becomes. On the other hand, if the minute shift amount a is too large, the accuracy is lowered and the system cannot be used, and the lens moving speed, the reading speed of the image sensor 8 and the like are also involved. Therefore, the minute shift amount a is changed according to the lens unit to be mounted.

  Then, after the focus lens 2 is moved, it is determined whether or not the lens position after the focus lens 2 is moved by the minute shift amount a is within the scan range. If the lens position is within the range (S47), the mounted lens unit or the like A series of processes from setting the exposure condition of the image sensor 8 is repeated so as to scan a predetermined scan range determined according to (S41 to S46).

When it is out of the scan range (S47), it is determined that all scans in the scan range have been completed, a series of repetitive processes are stopped, and the maximum value is obtained from the AF evaluation values stored so far. It is determined that the image plane position corresponding to the maximum AF evaluation value is the in-focus position, and the focus lens 2 is moved to that position (S48).
Next, AF control of the camera system of the present embodiment will be described. FIG. 9 is a flowchart showing the focus control of this embodiment.

  First, when the release switch SW1 is turned on and the focus detection operation is started, the focus detection unit 9 until the output of the AF sensor 9c reaches a certain value as described above or until a predetermined time (Tmax) elapses. Charge accumulation is performed in the photoelectric conversion element arrays 9d1 and 9d2 (S1). When the charge accumulation process ends (S2), the Df amount calculation unit 16 calculates the defocus amount Df (S3), and the lens of the focus lens 2 is driven based on the calculation result (S4).

  Next, the system controller 46 performs subject state recognition processing by the moving object detection unit 49 (S5). If it is not known whether or not the subject is moving, the process returns from step 5 to step 1 and the processing from step 1 to step 5, that is, the calculation of the defocus amount Df is repeated a predetermined number of times, and the predetermined number of times of the Df calculation processing ends ( S5), it is determined whether or not the subject is a moving object (S6).

Whether the subject is a moving object, the moving object detection unit 49 as described above is performed for a predetermined number of times calculation of the defocus amount Df in a predetermined time, calculates the amount of change ΔDf of the predetermined number of times computed defocus amount Df . Then, it is detected whether or not ΔDf is equal to or greater than a predetermined value (threshold value). If the change amount ΔDf is equal to or greater than the threshold value, it is determined that the subject is a moving object. If it is determined that the subject is not a moving object, the system controller 46 calculates the defocus amount Df by the phase difference detection method again (S7), and performs lens driving based on the calculation result (S8).

  Then, it is determined whether or not the phase difference detection method is in focus (S9). If it is determined that the phase difference detection method is not in focus, the defocus amount Df is recalculated and again. Repeat step 7 to step 9.

  When it is determined that the in-focus state is detected by the AF control of the phase difference detection method (S9), the process shifts to the focus detection processing by the contrast method (S10). The focus detection processing by the contrast method is performed by the above-described processing in FIGS. Then, it is determined whether or not it is in focus as a result of contrast focus detection (S13).

  If the subject is not a moving object, it is possible to shift to the contrast focus detection process without performing the processing in steps 7 and 8. However, in this embodiment, the subject is stationary compared to the case where the subject is a moving object. In order to cope with the case, it is desirable to perform the processes in steps 7 and 8 even when the subject is not a moving object.

  On the other hand, if it is determined in step 6 that the subject is a moving object, the defocus amount Df by the phase difference detection method is calculated (S11), and the lens is driven according to the calculation result (S12). Proceed to the focus confirmation process. If it is determined in this in-focus confirmation (determination) that the in-focus state is not achieved (S13), the process returns to step S1 to detect the phase difference by the focus detection unit 9 again.

  As described above, in step 13, when the process passes through step 10, the in-focus state is determined based on the contrast method, and when the process passes through step 12, the focus is determined based on the phase difference method.

  When it is determined in step 13 that the subject is in focus, a focus display is performed to notify the photographer or the like of the focus (S14), and the release switch SW2 is turned on (S15). A photographing operation is performed (S16).

  As described above, in this embodiment, the focus control can be performed by the optimum processing sequence according to the photographing situation while selecting the first sequence based on the phase difference detection method and the second sequence based on the contrast method.

  In particular, the AF control circuit 45 selects the first focus detection sequence in the focus detection unit 9 when it is detected that the subject is a moving object, and the contrast signal generator when it is detected that the subject is not a moving object. The second sequence based on the AF evaluation value generated by 50 is selected.

  Therefore, for example, when the moving subject is fast, the focus detection operation is slow, so it is possible to automatically select (switch) without missing the subject to be photographed, without bothering the photographer. Since focus control is performed in an optimal sequence according to the state of the subject, it is possible to provide an optical apparatus that can perform a quick and accurate focusing operation.

  Furthermore, since the moving object detection of the subject is performed based on the defocus amount Df (change amount ΔDf) calculated in the phase difference detection type focus detection unit 9, no special detection circuit, arithmetic circuit, or the like is required. A simplified AF control can be realized.

  FIG. 10 shows a second embodiment of the present invention. FIG. 10 is a flowchart of AF control in the camera system according to the second embodiment. Since the camera body 102, the lens device 101, the circuit configuration, and the like are the same as those in the first embodiment, the description thereof is omitted.

  In this embodiment, the focal depth becomes deeper as the focal length becomes shorter, and the focal depth becomes shallower as the focal length becomes longer. Therefore, it is necessary to perform precise AF control when the focal length is long. Therefore, this is an embodiment of a camera system that performs AF control based on the focal length detected by the focal length detection circuit 47.

  First, the focal length detection circuit 47 detects the position of the zoom lens 1, calculates the focal length based on the position of the zoom lens 1, and outputs it to the system controller 46 as focal length information.

  When it is determined that the focal length information input to the system controller 46 is longer than a predetermined value (threshold value) (S20), the focus detection unit 9 calculates the defocus amount (Df) by the phase difference detection method (S21). . The lens is driven according to the result of the Df calculation (S22), and it is determined whether or not the focus is obtained in the AF control of the phase difference detection method (S23).

  If it is determined that the in-focus state is not in focus by the phase difference detection AF control, the processes of Step 21 to Step 23 are repeated to calculate the defocus amount Df again. When it is determined that the in-focus state is achieved by the AF control of the phase difference detection method (S23), the process proceeds to the focus detection processing by the contrast method (S24, see FIG. 8). It is determined whether or not the image is in focus by contrast-type focus detection (S25). If it is determined that the image is not in focus, the process returns to the focal length detection process by the focal length detection circuit 47 (S20).

  On the other hand, when it is determined that the focal length is shorter than the predetermined value (below the predetermined value), the defocus amount Df by the phase difference detection method is calculated (S26). Then, the lens is driven according to the Df calculation result (S27), and the process proceeds to the focus confirmation process (S25). If it is determined that the in-focus state is not in focus (S25), the process returns to step 20 and the focal length detection circuit 47 performs the focal length detection process again.

If it is determined in step 25 that the subject is in focus, a focus indication is displayed to the photographer (S28), and if the release switch SW2 is turned on (S29), photographing control is performed (S30). .

  As described above, in this embodiment, when the focal length detected by the focal length detection circuit 47 is short, the AF control circuit 45 selects the first focal point detection sequence in the focal point detection unit 9 and the focal length is long. In this case, the second sequence based on the AF evaluation value generated by the contrast signal generation unit 50 is selected.

  Therefore, the optimum sequence is automatically switched without bothering the photographer and quick and accurate focus control is possible.

  FIG. 11 is a diagram illustrating a main configuration in a camera system (optical apparatus) that is Embodiment 3 of the present invention. The camera system of this embodiment has elements that are partially different from the camera system (optical apparatus) described in FIG. About the same element, description is abbreviate | omitted with the same code | symbol. Here, the characteristic is the mirror 105.

  Specifically, as the first state, when in the OVF (Optical View Finder) state, the half mirror 105a transmits a part of the light beams that have passed through the photographing lenses 1 and 2 to the image plane side. At the same time, the remaining light flux is reflected and guided to a finder optical system (not shown) provided in the camera body 102. The sub mirror 105b disposed on the image plane side with respect to the half mirror 105a reflects the light beam transmitted through the half mirror 105a and guides it to the focus detection unit 9 when in the non-photographing state. This is a state that exists also in the first and second embodiments.

  On the other hand, as the second state, when in the LCD monitor state, the half mirror 105a transmits a part of the light beams that have passed through the photographing lenses 1 and 2 and transmits the image sensor (for example, a CCD or CMOS sensor) 8. And the remaining light flux is reflected and guided to the focus detection unit 9. When in the LCD monitor state, the sub mirror 105b has moved to a position retracted from the optical path of the subject.

  Unlike the OVF state, the LCD monitor state can have the image sensor 8 on the optical path of the subject. Therefore, the system controller 46 can display the captured image on the display unit (LCD monitor, Liquid Crystal Display) 44 by the display control circuit 43 while performing the phase difference AF in the focus detection unit 9.

  Furthermore, in the LCD monitor state, the system controller 46 can perform contrast AF while performing phase difference AF in the focus detection unit 9. That is, the system controller 46 can also control the AF control unit 45, the moving object detection unit 49, and the contrast signal generation unit 50 in parallel.

  As the third state, when in the photographing state, both the half mirror 105a and the sub mirror 105b move to a position retracted from the optical path that has passed through the photographing lenses 1 and 2, and an image sensor (for example, on the optical path) A CCD or CMOS sensor) 8 may be present for photographing. This is a state that exists also in the first and second embodiments.

  Thus, in the camera system (optical apparatus) according to the third embodiment, the focus control has the following characteristics. 12 and 13 are flowcharts for explaining the focus control corresponding to FIGS. 9 and 10, respectively.

  After Step 6 in the flow of FIGS. 12 and 13, that is, after Step 7 or Step 11, the control flow in the second state described above is followed. Similar processing steps are denoted by the same reference numerals. The characteristic here is step 121 in FIG. That is, the defocus amount Df by the phase difference detection method is calculated (S7), and the focus detection process of the contrast method is performed in parallel with the lens driving based on the calculation result (S8).

  Thereby, it is possible to omit the processing time of the focus detection processing in the subsequent step 10 or shorten the processing time. In step 121, an AF evaluation value is acquired in accordance with lens driving. The focus determination in step 9 is focus determination based on the phase difference AF. In step 13, as in the first embodiment, the focus state is determined based on the contrast method when passing through step 10, and the focus state is determined based on the phase difference method when passing through step 12. Judge the focus.

  Here, in the third embodiment, a contrast type focus detection process may be performed in parallel with the processes in steps 11 and 12. However, in such a case, since there is a high possibility that the subject is moving, in step 13, the focus determination based on the phase difference AF is also given priority.

  On the other hand, in FIG. That is, the defocus amount Df by the phase difference detection method is calculated (S21), and the focus detection process of the contrast method is performed in parallel with the lens driving based on the calculation result (S22). Thereby, it is possible to omit the processing time of the focus detection processing in the subsequent step 24 or shorten the processing time. In step 131, an AF evaluation value is acquired in accordance with lens driving. The focus determination in step 23 is focus determination based on the phase difference AF. In step 25, as in the second embodiment, the focus state is determined based on the contrast method when passing through step 22, and the focus state is determined based on the phase difference method when passing through step 27. Judge the focus. In the third embodiment, contrast type focus detection processing may be performed in parallel with the processing in steps 26 and 27.

  In Embodiments 2 and 3 described above, in the hybrid AF control in which the first focus detection unit based on the phase difference detection method and the second focus detection unit based on the contrast method are combined, the focus based on the phase difference detection method according to the focal length. For example, instead of performing the focus detection process by the phase difference detection method of the hybrid AF control, the focus control may be performed by switching to the focus detection process of the contrast method when the focal length is long.

9 Focus detection unit 46 System controller 47 Focal length detection circuit 49 Moving object detection circuit 50 Contrast signal generator

Claims (4)

  1. First focus detection means for detecting a defocus amount;
    Second focus detection means for detecting a focus state by a contrast detection method;
    Control means for performing focus control of the photographing optical system by a first sequence using the first focus detection means and a second sequence using the first and second focus detection means;
    The control means performs the first sequence when the movement of the subject image continues in the same direction from the detection results of a plurality of times by the first focus detection means , and the movement of the subject image from the detection results of the plurality of times. When the two are not in the same direction, the second sequence is performed .
  2.   The optical apparatus according to claim 1, wherein the first focus detection unit detects the defocus amount by a phase difference detection method.
  3. The control means obtains a change amount of a plurality of detection results by the first focus detection means , performs the first sequence when the change amount is larger than a predetermined value, and determines the change from the detection results of the plurality of times. The optical apparatus according to claim 1, wherein the second sequence is performed when the amount of change is smaller than the predetermined value.
  4. 4. The optical apparatus according to claim 1, wherein the control unit performs the first sequence when the subject is a moving object. 5.
JP2011055188A 2004-07-12 2011-03-14 Optical equipment Expired - Fee Related JP5312502B2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2004204649 2004-07-12
JP2004204649 2004-07-12
JP2011055188A JP5312502B2 (en) 2004-07-12 2011-03-14 Optical equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2011055188A JP5312502B2 (en) 2004-07-12 2011-03-14 Optical equipment

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2005203410 Division 2005-07-12

Publications (2)

Publication Number Publication Date
JP2011154385A JP2011154385A (en) 2011-08-11
JP5312502B2 true JP5312502B2 (en) 2013-10-09

Family

ID=34941833

Family Applications (3)

Application Number Title Priority Date Filing Date
JP2011055188A Expired - Fee Related JP5312502B2 (en) 2004-07-12 2011-03-14 Optical equipment
JP2013028806A Pending JP2013137560A (en) 2004-07-12 2013-02-18 Optical device
JP2014107653A Expired - Fee Related JP5911531B2 (en) 2004-07-12 2014-05-26 Optical equipment

Family Applications After (2)

Application Number Title Priority Date Filing Date
JP2013028806A Pending JP2013137560A (en) 2004-07-12 2013-02-18 Optical device
JP2014107653A Expired - Fee Related JP5911531B2 (en) 2004-07-12 2014-05-26 Optical equipment

Country Status (5)

Country Link
US (2) US7469098B2 (en)
EP (2) EP2015567A1 (en)
JP (3) JP5312502B2 (en)
CN (1) CN100464243C (en)
DE (1) DE602005009440D1 (en)

Families Citing this family (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7469098B2 (en) 2004-07-12 2008-12-23 Canon Kabushiki Kaisha Optical apparatus
JP2006254413A (en) * 2005-02-08 2006-09-21 Nikon Corp Imaging apparatus and camera body
JP4865284B2 (en) * 2005-09-13 2012-02-01 キヤノン株式会社 Focusing optical system
US7751700B2 (en) * 2006-03-01 2010-07-06 Nikon Corporation Focus adjustment device, imaging device and focus adjustment method
CN101473641B (en) 2006-06-20 2011-04-06 松下电器产业株式会社 Camera system
JP4795155B2 (en) * 2006-07-28 2011-10-19 キヤノン株式会社 Optical device, imaging device, and control method thereof
JP5098259B2 (en) * 2006-09-04 2012-12-12 株式会社ニコン Camera
US10298834B2 (en) 2006-12-01 2019-05-21 Google Llc Video refocusing
CN101779154B (en) 2007-08-13 2012-03-07 松下电器产业株式会社 Imaging device and camera
JP2009069255A (en) 2007-09-11 2009-04-02 Sony Corp Imaging device and focusing control method
WO2009126710A2 (en) * 2008-04-10 2009-10-15 Perceptive Pixel, Inc. Methods of interfacing with multi-input devices and multi-input display systems employing interfacing techniques
KR101176840B1 (en) * 2009-12-22 2012-08-23 삼성전자주식회사 Camera and method for auto-focusing
JP5653035B2 (en) * 2009-12-22 2015-01-14 キヤノン株式会社 Imaging apparatus, focus detection method, and control method
US7961401B1 (en) * 2009-12-23 2011-06-14 Ge Inspection Technologies, Lp System for providing two position zoom-focus
JP5623254B2 (en) * 2010-11-29 2014-11-12 キヤノン株式会社 Imaging apparatus and control method thereof
JP5454508B2 (en) 2011-04-06 2014-03-26 株式会社ニコン Optical equipment
KR101710633B1 (en) * 2011-08-05 2017-02-27 삼성전자주식회사 Auto focus adjusting method, auto focus adjusting apparatus, and digital photographing apparatus including the same
WO2013021744A1 (en) * 2011-08-10 2013-02-14 オリンパスメディカルシステムズ株式会社 Endoscope device
JP6035777B2 (en) * 2012-02-28 2016-11-30 株式会社ニコン Imaging device
JP5799178B2 (en) * 2012-11-29 2015-10-21 富士フイルム株式会社 Imaging apparatus and focus control method
US10334151B2 (en) * 2013-04-22 2019-06-25 Google Llc Phase detection autofocus using subaperture images
JP6457740B2 (en) * 2014-05-13 2019-01-23 キヤノン株式会社 Imaging device and its control method, lens unit, imaging system
JP2016133595A (en) * 2015-01-19 2016-07-25 キヤノン株式会社 Controller, imaging device, control method, program, and storage medium
US10540818B2 (en) 2015-04-15 2020-01-21 Google Llc Stereo image generation and interactive playback
US10419737B2 (en) 2015-04-15 2019-09-17 Google Llc Data structures and delivery methods for expediting virtual reality playback
US10469873B2 (en) 2015-04-15 2019-11-05 Google Llc Encoding and decoding virtual reality video
US10546424B2 (en) 2015-04-15 2020-01-28 Google Llc Layered content delivery for virtual and augmented reality experiences
US10567464B2 (en) 2015-04-15 2020-02-18 Google Llc Video compression with adaptive view-dependent lighting removal
US10341632B2 (en) 2015-04-15 2019-07-02 Google Llc. Spatial random access enabled video system with a three-dimensional viewing volume
US10362249B2 (en) 2015-07-31 2019-07-23 Sony Corporation Image capturing device, image capturing method, capable of improving trackability of focus position and focusing accuracy with respect to subject
CN105141858B (en) * 2015-08-13 2018-10-12 上海斐讯数据通信技术有限公司 The background blurring system and method for photo
JP6255542B2 (en) 2015-09-30 2017-12-27 富士フイルム株式会社 Focus control device, focus control method, focus control program, lens device, imaging device
US20170230649A1 (en) * 2016-02-05 2017-08-10 Qualcomm Incorporated Calibration of hybrid auto focus (af) imaging systems
US10044926B2 (en) * 2016-11-04 2018-08-07 Qualcomm Incorporated Optimized phase detection autofocus (PDAF) processing
US10146975B2 (en) 2016-11-17 2018-12-04 Datalogic Ip Tech S.R.L. Data reader with hybrid auto focus system
US10679361B2 (en) 2016-12-05 2020-06-09 Google Llc Multi-view rotoscope contour propagation
CN106713750B (en) * 2016-12-19 2019-07-19 Oppo广东移动通信有限公司 Focusing control method, device, electronic device and terminal device
US10594945B2 (en) 2017-04-03 2020-03-17 Google Llc Generating dolly zoom effect using light field image data
US10474227B2 (en) 2017-05-09 2019-11-12 Google Llc Generation of virtual reality with 6 degrees of freedom from limited viewer data
US10444931B2 (en) 2017-05-09 2019-10-15 Google Llc Vantage generation and interactive playback
US10354399B2 (en) 2017-05-25 2019-07-16 Google Llc Multi-view back-projection to a light-field

Family Cites Families (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4855776A (en) * 1987-01-12 1989-08-08 Canon Kabushiki Kaisha Camera with automatic focusing device
EP0364137A3 (en) * 1988-09-29 1991-07-03 Nikon Corporation Automatic focus state detecting apparatus
JPH02814A (en) * 1989-02-12 1990-01-05 Minolta Camera Co Ltd Camera with automatic focusing function
JP3183902B2 (en) * 1991-04-02 2001-07-09 オリンパス光学工業株式会社 Autofocus device
JPH0618772A (en) * 1992-06-29 1994-01-28 Canon Inc Camera provided with function for detecting line of sight
JPH0743605A (en) 1993-08-02 1995-02-14 Minolta Co Ltd Automatic focusing device
JPH07270674A (en) * 1994-03-29 1995-10-20 Canon Inc Focusing detecting device
US5563678A (en) * 1994-06-06 1996-10-08 Nikon Corporation Focus detection device and method
JP3585291B2 (en) * 1995-06-29 2004-11-04 オリンパス株式会社 Automatic focusing device
US5913079A (en) * 1995-07-31 1999-06-15 Canon Kabushiki Kaisha Optical apparatus having a line of sight detection device
JPH09274129A (en) * 1996-04-08 1997-10-21 Nikon Corp Automatic focusing device and camera
JP3344209B2 (en) * 1996-05-09 2002-11-11 ミノルタ株式会社 Camera
JP3939828B2 (en) * 1996-09-26 2007-07-04 ペンタックス株式会社 Multi-point automatic focus detection device
JPH11142723A (en) * 1997-11-05 1999-05-28 Canon Inc Image pickup device
JP2001004909A (en) 1999-06-18 2001-01-12 Olympus Optical Co Ltd Camera having automatic focusing device
JP3795723B2 (en) * 2000-03-08 2006-07-12 株式会社リコー Automatic focusing device, digital camera, portable information input device and focusing position detection method
JP2001255456A (en) * 2000-03-13 2001-09-21 Olympus Optical Co Ltd Range-finding device
JP3761383B2 (en) * 2000-03-15 2006-03-29 株式会社リコー Automatic focusing device, camera, portable information input device, focusing position detection method, and computer-readable recording medium
US6453124B2 (en) 2000-03-27 2002-09-17 Minolta Co., Ltd. Digital camera
JP2003029135A (en) * 2001-07-17 2003-01-29 Canon Inc Camera, camera system and photographic lens device
JP3977062B2 (en) * 2001-11-21 2007-09-19 キヤノン株式会社 Imaging apparatus and focus adjustment method
JP4393034B2 (en) * 2002-04-11 2010-01-06 キヤノン株式会社 Automatic focusing method, automatic focusing apparatus, and imaging apparatus
JP2003315670A (en) * 2002-04-26 2003-11-06 Nikon Corp Camera
JP2004085843A (en) * 2002-08-26 2004-03-18 Canon Inc Camera
US6895181B2 (en) * 2002-08-27 2005-05-17 Olympus Corporation Camera and distance measuring method thereof
JP2004109690A (en) 2002-09-19 2004-04-08 Canon Inc Camera system and camera
JP2004157456A (en) 2002-11-08 2004-06-03 Olympus Corp Camera and range-finding method of camera
JP4125101B2 (en) 2002-12-06 2008-07-30 キヤノン株式会社 Imaging device, automatic focusing device, and control method thereof
JP2004191674A (en) * 2002-12-11 2004-07-08 Kyocera Corp Automatic focusing device and photographing device
JP2005070450A (en) * 2003-08-25 2005-03-17 Sanyo Electric Co Ltd Video camera
US7469098B2 (en) * 2004-07-12 2008-12-23 Canon Kabushiki Kaisha Optical apparatus
JP5100400B2 (en) * 2008-01-08 2012-12-19 キヤノン株式会社 Focus adjustment device and optical equipment using the same

Also Published As

Publication number Publication date
US7778539B2 (en) 2010-08-17
CN1721970A (en) 2006-01-18
US20090074394A1 (en) 2009-03-19
US7469098B2 (en) 2008-12-23
JP5911531B2 (en) 2016-04-27
EP1617652B1 (en) 2008-09-03
JP2011154385A (en) 2011-08-11
JP2014194570A (en) 2014-10-09
DE602005009440D1 (en) 2008-10-16
CN100464243C (en) 2009-02-25
JP2013137560A (en) 2013-07-11
EP1617652A2 (en) 2006-01-18
US20060008265A1 (en) 2006-01-12
EP2015567A1 (en) 2009-01-14
EP1617652A3 (en) 2006-04-05

Similar Documents

Publication Publication Date Title
US9277112B2 (en) Auto focusing apparatus and auto focusing method, and image sensing apparatus
US9894280B2 (en) Imaging apparatus for displaying selected face in in-focus state and method for controlling imaging apparatus
US8928761B2 (en) Digital camera
US8036521B2 (en) Image pickup apparatus and focus control method
JP3975395B2 (en) Camera system
US8264592B2 (en) Image pickup apparatus having improved contrast autofocus accuracy
JP5034556B2 (en) Focus detection apparatus and imaging apparatus
JP3823921B2 (en) Imaging device
JP4674471B2 (en) Digital camera
RU2456654C2 (en) Image capturing device, control method thereof and data medium
US7711260B2 (en) Digital camera and camera system
CN100464243C (en) Optical apparatus
JP3697256B2 (en) Imaging device and lens device
JP5388544B2 (en) Imaging apparatus and focus control method thereof
JP4794963B2 (en) Imaging apparatus and imaging program
US7391461B2 (en) Apparatus, method and control computer program for imaging a plurality of objects at different distances
JP4094458B2 (en) Image input device
JP4797522B2 (en) Imaging apparatus and program thereof
JP4731705B2 (en) Imaging apparatus, camera, photographing lens, focus adjustment method, and storage medium
JP3634232B2 (en) Digital still camera
JP2008015274A (en) Digital camera
JP2005221602A (en) Image pickup device
JP5247044B2 (en) Imaging device
US20100271510A1 (en) Focus control apparatus and optical apparatus
TW539910B (en) Object image adjustment device and imaging apparatus

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20110314

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20120619

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20120820

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20121218

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20130218

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20130625

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20130702

LAPS Cancellation because of no payment of annual fees