EP2007135B1 - Imaging apparatus - Google Patents
Imaging apparatus Download PDFInfo
- Publication number
- EP2007135B1 EP2007135B1 EP08252097A EP08252097A EP2007135B1 EP 2007135 B1 EP2007135 B1 EP 2007135B1 EP 08252097 A EP08252097 A EP 08252097A EP 08252097 A EP08252097 A EP 08252097A EP 2007135 B1 EP2007135 B1 EP 2007135B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- focus
- interval
- evaluation value
- focus evaluation
- predetermined
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
- 238000003384 imaging method Methods 0.000 title claims description 56
- 238000011156 evaluation Methods 0.000 claims description 126
- 238000004364 calculation method Methods 0.000 claims description 20
- 238000012634 optical imaging Methods 0.000 claims description 3
- 230000008859 change Effects 0.000 description 18
- 230000015654 memory Effects 0.000 description 13
- 230000003247 decreasing effect Effects 0.000 description 12
- 238000004422 calculation algorithm Methods 0.000 description 11
- 230000007246 mechanism Effects 0.000 description 11
- 238000000034 method Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 7
- 238000001514 detection method Methods 0.000 description 6
- 238000005375 photometry Methods 0.000 description 6
- 239000000284 extract Substances 0.000 description 3
- 239000011435 rock Substances 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 2
- 239000002131 composite material Substances 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 210000000887 face Anatomy 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000011514 reflex Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000004904 shortening Methods 0.000 description 1
- GGCZERPQGJTIQP-UHFFFAOYSA-N sodium;9,10-dioxoanthracene-2-sulfonic acid Chemical compound [Na+].C1=CC=C2C(=O)C3=CC(S(=O)(=O)O)=CC=C3C(=O)C2=C1 GGCZERPQGJTIQP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
- H04N23/673—Focus control based on electronic image sensor signals based on contrast or high frequency components of image signals, e.g. hill climbing method
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
- H04N23/676—Bracketing for image capture at varying focusing conditions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/743—Bracketing, i.e. taking a series of images with varying exposure conditions
Definitions
- the present invention relates to an imaging apparatus which electronically captures an image of a subject, particularly to one with autofocus system.
- the principle of the contrast autofocus system is to capture images of a subject while changing the position of a focus lens at a minute interval, extract high frequency components of captured image data to calculate a focus evaluation value, and determine a focus position from a curve representing a distribution of the focus evaluation value.
- the most general operation thereof is to sequentially image a subject while moving a focus lens (imaging means) at a minute step (interval) before actual shooting, extract high frequency components of image data to calculate the focus evaluation value, and select and store a largest maximal value as a focal point from a portion of the curve of the focus evaluation value having maximal values. Further, upon completion of the minute-step drive operation, the focus lens is moved again to the focal point for actual shooting. This operation has been widely used owing to its accurate focus positioning without an additional sensor although it takes time to decide the focal point.
- a focus bracket function has been developed based on the auto bracket function for auto exposure.
- the focus bracketing is a known technique to continuously shoot a predetermined number of images at points shifted with a predetermined interval precedingly and succeedingly to the focal point a camera has decided, store all the shot images, and then allow an operator to select a desired image.
- the focus bracketing has a problem that the number of images to be shot (generally, 3) and the focus interval arc pre-fixed, resulting in capturing and storing unnecessary images when the focal point is accurate and consuming extraneous power therefor as well as not dealing with a change in photographic condition with the fixed interval.
- Japanese Laid-open Patent Application Publication No. 2004-333924 discloses a digital camera which calculates depth of field according to a photographic condition (mainly f-number) and determines a focus interval at which the focus position is changed and a total number of shots according to the depth of field.
- This technique is intended for adjusting the aperture diaphragm to have a subject within the depth of field or reducing the number of shots to be taken when the subject is within the depth of field.
- the depth of field is an impractical calculation from a measured distance and an f-number so that it is not certain that this technique achieves capturing of images in accordance with the operator's intention.
- Japanese Laid-open Patent Application Publication No. 2003-333411 discloses imaging apparatus and method and image control computer program in which an image is shot at each point with maximum focus evaluation value (extracted high frequency component value).
- this technique is problematic in terms of power saving and usability such as extraneous shooting time or storage time, or ineffective usage of memories since without autofocus system, a large number of images are always captured and stored even with the focus interval changed according to a photographic condition.
- US 2003/0169363 discloses an image pick up apparatus in which when a plurality of objects are present at different distances in the field of view, a plurality of photographs are taken with focus set for each of the different objects.
- the present invention aims to provide an imaging apparatus which can increase/decrease the number of focus brackets and the focus interval according to accuracy of a focal point which the apparatus has decided, thereby increasing possibility to capture images in accordance with an operator's intention and reasonably reducing the number of shots to be taken.
- the imaging apparatus further comprises a major subject designating unit which designates on the subject image in advance an area or a point which is to be focused on.
- the number of focus brackets to be shot is set to be smaller than a predetermined number; and when it is smaller than a second predetermined value smaller than the first predetermined value, the number of focus brackets to be shot is set to be larger than the predetermined number.
- the focus interval is set to be smaller than a predetermined interval; and when it is smaller than a second predetermined value smaller than the first predetermined value, the focus interval is set to be larger than the predetermined interval.
- the number of focus brackets to be shot is set to be smaller than a predetermined number; and when it is smaller than a second predetermined value smaller than the first predetermined value, the number of focus brackets to be shot is set to be larger than the predetermined number.
- the focus interval is set to be smaller than a predetermined interval; and when it is smaller than a second predetermined value smaller than the first predetermined value, the focus interval is set to be larger than the predetermined interval.
- the present invention it is made possible to reduce the number of shots to be taken while improving a rate at which the operator can capture desired images as well as to achieve power saving through shortening of the shooting time and storage time and effective usage of storage medium
- FIG. 1 The configuration of an imaging apparatus (camera) according to a preferable embodiment of the present invention will be described with reference to FIG. 1 .
- the imaging apparatus comprises a controller (CPU) 1 controlling all operations of the imaging apparatus, a photometric sensor 2, first and second release switches 3, 4, a focus drive unit 5, a shutter drive unit (including aperture diaphragm) 6, a display unit 7, an image capturing device (electric imaging unit) 8, and a storage unit 9.
- the controller incorporates a calculation unit 10 to perform various calculations and decisions, a timer unit 11 to count time, volatile or nonvolatile memories 12 (focus interval memory and focus bracket number memory) storing various set values therein, an optical imaging system 13 obtaining an image of a subject, and so on. It does not have to be structured on a single chip, and it can be structured as composite element including image processing chip or as a control unit including plural elements.
- the controller 1 functions as a focus evaluation value calculation unit which calculates, by use of an output signal from the photometric sensor 2, a focus evaluation value at a plurality of points on a subject image in accordance with a contrast component.
- it functions as a major subject designating unit which designates on a subject image in advance an area or a point which is to be focused on (fourth embodiment), and a processing unit which performs image processing for the subject image in accordance with at least one of the number of focus brackets to be shot and the focus interval.
- the photometric sensor 2 detects brightness of a subject and is driven and controlled by the controller 1. It detects electric signals (image signals) relative to brightness of the subject at plural points of a shooting area (frame) and input them to the controller 1. Note that it can be configured without a dedicated photometric sensor that brightness in plural areas is calculated according to image data from the image capturing device 8.
- a first release switch (RL1SW) 3 turns on by half press thereto while a second release switch (RL2SW) 4 turns on by full press thereto. Although they are illustrated as separate switches in FIG. 1 , they are actually one switch which operates by being halfway pressed and fully pressed.
- the focus drive unit 5 and shutter drive unit 6 drive a focus lens and a shutter mechanism inclusive of an aperture diaphragm for shooting, respectively.
- the focus drive unit 5 also obtains captured image data (for autofocus) from the image capturing device 8 and scans a focus area (generally from a photographable shortest distance (point-blank range) to infinity) to find a focusable point.
- a focus area generally from a photographable shortest distance (point-blank range) to infinity
- the aperture diaphragm and the shatter mechanism can be provided separately and controlled separately.
- the display device 7 can be a liquid crystal device (LCD), an organic EL element, LED, or the like to display an operation menu for viewfinder display at prc-shooting, reproduced images, or pre-setting.
- LCD liquid crystal device
- organic EL element organic EL element
- LED organic EL element
- the storage unit 9 such as built-in flash memory, external memory card, or HDD stores captured image data converted in a predetermined format by the controller 1.
- the image capturing device 8 is an element such as CCD, CMOS to convert an image of a subject into an electric signal to output it to the controller 1.
- the camera Upon power-on of a main switch, the camera is generally in a viewfinder mode in which captured images are displayed on an LCD display or other display devices, and stands by to receive an instruction through operation switches.
- the camera decides which one of the switches is manipulated (step S3).
- it starts the viewfinder mode (step S2) and then decides the manipulation to the switch.
- the first release switch 3 (RL1SW) is ON
- it stops the viewfinder mode (step S4), performs auto exposure (step S5), autofocus (step S6), and focus drive (step S7) and then returns to the viewfinder mode.
- the second release switch 4 (RL2SW) is ON, it stops the viewfinder mode (step S8), performs still-image recording (step S9) and then returns to the viewfinder mode.
- any of other switches than the first and second release switches 3, 4 is ON, it performs associated operation with the switch (step S10) and returns to the viewfinder mode. Having decided that the manipulation is invalid, it remains in the viewfinder mode.
- FIG. 3 shows a positional relation of subjects in a shooting area. It is assumed that there are a rock (area C) on the right front side, a person (area B) behind the rock, and a blackboard obliquely placed on the back side on which characters A (near point, area D) and Z (far point, area E)) are written.
- FIG. 4 shows curves (focus evaluation curves) indicating distribution of focus evaluation values when the subjects of FIG. 3 are focused in autofocus.
- the focus evaluation value represents contrast of an image and is calculated by use of high-frequency components of light from a subject.
- the focus evaluation value is smallest at the area E as the far point on the blackboard.
- the focus evaluation values of the area D (near point on the blackboard) and area C (rock) are larger than that of the area E.
- the focus evaluation value is largest at the area B (person).
- the focus evaluation curve of the area E is a gentlest curve and the peak thereof is unrecognizable; therefore, an error in deciding a focus position is likely to occur.
- the focus evaluation curves of the area C and area D are steeper than that of the area E and the peak thereof have a general steepness, and that of the area B is steepest so that focus decision can be easily made.
- all the focus evaluation values are assumed to be over a predetermined threshold for the focus decision.
- the focal point can be the point with the largest focus evaluation value or the point with the focus evaluation value over and closest to a later-described second predetermined value (maximal value of the right curve in FIG. 4 ).
- the focal point can be limited within a certain distance or it can be set so that all maximal values fall within depth of field.
- the initial number of focus brackets is set at a general number, 3.
- the focus evaluation value is acquired for focus detection by moving a focus lens by a predetermined interval (step S13) after stoppage of the viewfinder mode (step S11) and auto exposure processing (photometry, photometric calculation, etc) (step S12).
- the focus evaluation value is data relative to high-frequency components of an image signal at each focal point.
- Magnitude of the maximal value of the focus evaluation value is evaluated to determine the focal point of the camera by a predetermined algorithm.
- the focus evaluation value being over a predetermined value and obtained at a shortest focal length is set for the focal point by the predetermined algorithm.
- Various algorithms can be used therefor, and the focal point can be set at the maximal value of the highest focus evaluation value, for example.
- step S15 magnitude of the focus evaluation value at the determined focal point is evaluated using first and second predetermined values.
- the initial number of focus brackets is changed automatically according to a pre-stored program in the focus bracket number memory in the memories 12, as follows.
- the accuracy of the focal point is determined to be very high, so that the number of focus brackets is deceased to 1, and a shot is taken only at the determined focal point (step S16).
- the number of focus brackets is settable to an arbitrary number, Even with high focus accuracy, there may be a case where shooting only at the focal point is not sufficient, such as when for portrait shooting a photographer wants to focus the eyes of the nearest person which shows high contrast. In this case it can be configured to set the auto bracket mode and set the number of focus brackets to a larger number. In opposite, with low focus accuracy, the number of focus brackets can be increased to a larger number, for example, 10. Further, the number of focus brackets can be differently set for preceding and succeeding points to the focal point.
- the focus interval is set to 2 steps (step S20),
- the focus interval refers to a width of a step at which the focus is shifted under the pulse motor type focus control, and the general interval is assumed to be 2 steps.
- the interval can be set to an arbitrary value depending on focal length, lens structure, f-number of a lens, required focus precision and so on.
- the current number of focus brackets is set at 1 (step S20) and the focus lens is driven to aim at the determined focal point (step S21).
- step S21 in FIG. 5 upon turning-on of the second release switch (RL2SW) 4, the camera performs shooting operation in accordance with the set number of focus brackets and the current number thereof in steps S23 to S37 after stopping the viewfinder mode (step S22). In step S23, it shoots a still image, and stores it and increases the current number 1 (step S20) to 2.
- step S16 When the number of focus brackets is set at 1 (step S16 in FIG. 5 ), a shot is taken only at the determined focal point and the shooting completes. Specifically, after step S22, a shot is taken at the determined focal point, and the current number is counted up to 2 (step S23), and then a decision is made on whether the number of focus brackets is set at 5 or not (step S24). When it is not, whether it is set to 3 or not is decided (step S25). At the set number being not 3, the shooting completes.
- step S 19 in FIG. 5 When the set number of focus brackets is 3 (step S 19 in FIG. 5 ), a shot is taken three times in order at the focal point, at a point shifted from the focal point by (-1 ⁇ 2) steps and at a point shifted therefrom by the (+1 ⁇ 2) steps. Then, the shooting completes.
- step S22 a shot is taken at the determined focal point, and the current number is counted up to 2 (step S23). Then, a decision is made on whether the number of focus brackets is set at 5 or not (step S24). When it is not, whether it is set to 3 or not is decided (step S25). At the set number being 3, a decision is made on whether the current number is 2 or not (step S26). When it is 2, the focus lens is set at a focus position which is shifted from the focal point by (-1 ⁇ 2) steps, to take a shot (step S27). Then, the current number is counted up to 3 (step S28). After the decisions made in steps S24, 25, 26 again, whether or not the current number is 3 is decided (step S28).
- step S28 When the current number is 3 (step S28), the focus lens is set at a focus position which is shifted from the focal point by (+1 ⁇ 2) steps, to take a shot (step S29). The current number is counted up to 4. After the decisions made in steps S24, 25, 26, 28 again, since the current number is 4, the shooting completes.
- step S 18 in FIG. 5 a shot is taken five times while the focus is shifted from the determined focal point, a point shifted from the focal point by (-2 ⁇ 2) steps, a point shifted therefrom by (-1 ⁇ 2) steps, a point shifted therefrom by (+1 ⁇ 2) steps and a point shifted therefrom by (+2 ⁇ 2) steps. Then, the shooting completes.
- step S22 a shot is taken at the determined focal point, and the current number is counted up to 2 (step S23). Then, a decision is made on whether the number of focus brackets is set at 5 or not (step S24). At the set number being 5, whether the current number is 2 or not is decided next (step S30). When it is 2, the focus lens is set at a focus position which is shifted from the determined focal point by (-2 ⁇ 2) steps, to take a shot (step S31). Then, the current number is counted up to 3. After the decisions made in steps S24, S30 again, whether the current number is 3 or not is decided (step S32).
- the focus lens is set at a focus position which is shifted from the determined focal point by (-1 ⁇ 2) steps, to take a shot (step S33). Then, the current number is counted up to 4 (step S23). After the decisions made in steps S24, S30, S32, whether the current number is 4 or not is decided (step S34).
- the focus lens is set at a focus position which is shifted from the determined focal point by (+1 ⁇ 2) steps, to take a shot (step S35). Then, the current number is counted up to 5 (step S23). After the decisions made in steps S24, S30, S32, S34, whether the current number is 5 or not is decided (step S36).
- the focus lens is set at a focus position which is shifted from the determined focal point by (+2 ⁇ 2) steps, to take a shot (step S37). Then, the current number is counted up to 6. After the decisions made in S24, S30, S32, S34 again, whether the current number is 5 or not is decided (step S36). Since the current number is 6, the shooting completes.
- the evaluation of the focus evaluation value and the setting of the number of focus brackets are done at the three levels in the present embodiment. However, they can be done at a larger number of levels.
- the imaging apparatus is configured to have an effective autofocus mechanism and automatically change the setting of the number of focus brackets according to focus accuracy.
- the number of shots is decreased to prevent unnecessary shooting while with low accuracy, it is increased to increase the probability of achieving the focus.
- the imaging apparatus is configured that the controller can handle all the focus bracket settings, therefore, provision of a new dedicated device with additional costs incurred is unnecessary.
- the focus evaluation value is acquired for focus detection by moving a focus lens by a predetermined interval (step S43) after stoppage of the viewfinder mode (step S41) and auto exposure processing (photometry, photometric calculation, etc) (step S42).
- Magnitude of the maximal value of the focus evaluation value is evaluated (step S44) to determine the focal point of the camera by a predetermined algorithm.
- the focus evaluation value being over a predetermined value and obtained at a shortest focal length is set for the focal point by the predetermined algorithm.
- Various algorithms can be used therefor, and the focal point can be set at the maximal value of the highest focus evaluation value, for example.
- step S45 magnitude of the focus evaluation value at the determined focal point is evaluated using first and second predetermined values.
- the initial focus interval (2 steps) is changed automatically according to a pre-stored program in the focus interval memory in the memories 12, as follows.
- step S45 the accuracy of the focal point is determined to be very high (step S45), so that the focus interval is decreased to 1 step, and a shot is taken only in the vicinity of the determined focal point (step S46).
- step S48 the accuracy of the focal point is determined to be low, so that the focus interval is increased to 3 steps, automatically increasing probability of achieving focus.
- the focus interval is settable to an arbitrary value. With a high focus accuracy obtained, there may be a case where taking the set number of shots with a small interval is not sufficient, such as when for portrait shooting a photographer wants to focus the eyes of the nearest person which shows high contrast. In this case it can be configured to set the auto bracket mode and increase the numbers of focus brackets to be shot at points preceding and succeeding the focal point concurrently (with a fixed interval).
- the focus bracket number is set to 5 (step S50).
- the focus bracket number can be set to an arbitrary value depending on focal length, lens structure, f-number of a lens, required focus precision and so on.
- the current number of focus brackets is set at 1 (step S50) and the focus lens is driven to aim at the determined focal point (step S51).
- step S51 in FIG. 7 upon turning-on of the second release switch (RL2SW) 4, the camera performs shooting operation in accordance with the set number of focus brackets and the current number thereof in steps S53 to S61 after stopping the viewfinder mode (step S52).
- the operation in step S53 is the same as that in step S23 in FIG.6 .
- step S49 in FIG. 7 shots are continuously taken while the focus position is shifted in order, at the focal point, at a point shifted from the focal point by (-2 ⁇ 2) steps, at a point shifted therefrom by (-1 ⁇ 2) steps, at a point shifted therefrom by (+1 ⁇ 2) steps, and at a point shifted therefrom by (+2 ⁇ 2) steps. Then, the shooting completes.
- step S52 a shot is taken at the determined focal point, and the current number is counted up to 2 (step S53).
- step S54 A decision is made on whether the current number is 2 or not (step S54). When it is 2, the focus lens is set at a focus position which is shifted from the focal point (-2 ⁇ 2) steps (step S55), to take a shot. Then, the current number is counted up to 3 (step S53). After the decision made in step S54 again, whether the current number is 3 or not is decided (step S56).
- the focus lens is set at a focus position which is shifted from the focal point (-1 ⁇ 2) steps (step S57), to take a shot. Then, the current number is counted up to 4 (step S53). After the decision made in steps S54, S56 again, whether the current number is 4 or not is decided (step S58).
- the focus lens is set at a focus position which is shifted from the focal point (-2 ⁇ 2) steps (step S59), to take a shot. Then, the current number is counted up to 5 (step S53). After the decisions made in steps S54, S56, S58 again, whether the current number is 5 or not is decided (step S60).
- step S61 the focus lens is set at a focus position which is shifted from the focal point (+2 ⁇ 2) steps (step S61), to take a shot. Then, the current number is counted up to 6 (step S53). After the decisions made in steps S54, S56, S58 again, whether the current number is 5 or not is decided (step S58). Since the current number is 6, the shooting completes (step S60).
- the number of focus brackets to be shot and the focus interval can be set to arbitrary values. Even with an accurate focal point obtained, the number of focus brackets can be increased to over 5, for example, for the purpose of precisely focusing the point where the operator aims. Increase in reading speed of the image capturing device and image process speed also contributes to the focus bracket function. Further, the evaluation of the focus evaluation value and the setting of the focus interval are done at the three levels in the present embodiment. However, they can be done at a larger number of levels.
- the imaging apparatus is configured to have an effective autofocus mechanism and automatically change the setting of the focus interval according to focus accuracy.
- high accuracy it is possible to shoot an image shifting the focal point in the vicinity thereof with a small interval.
- low accuracy the interval is increased to a larger value in order to increase the probability of achieving the focus.
- the imaging apparatus is configured that the controller can handle all the focus interval settings, therefore, provision of another dedicated device with additional costs incurred is unnecessary.
- the focal point or focus area is generally designated by using a touch panel on a viewfinder to select an arbitrary area, subject, or edge from a shooting area, or by selecting them from focusable areas displayed in advance on the viewfinder through switch or menu manipulation.
- it can be designated by selecting the face of a person from a plurality of faces on the viewfinder found by facial recognition via switch manipulation or a touch panel, or by displaying automatically divided subject areas to select the one to be focused via switch manipulation or a touch panel.
- the focus evaluation value is acquired for focus detection by moving a focus lens by a predetermined interval (steps S73a to 73c) after stoppage of the viewfinder mode (step S71) and auto exposure processing (photometry, photometric calculation, etc) (step S72).
- step S73a after the auto exposure in step S72, whether or not an autofocus area is designated in advance is determined in step S73a, Then, according to the determined result, the auto focus is performed only for the designated area (step S73c) or for the entire area (step S73b). That is, unlike the first and second embodiments in which the entire area is a subject of the autofocus, the focus evaluation value can be obtained from the designated area alone to decide the focal point in the designated area.
- steps S74 to S81 are the same as those in steps S14 to S21 in FIG. 5 , so that a description thereon will be omitted. Also, operation after step S81 is the same as that in FIG. 6 , so that a description thereon will be omitted.
- the imaging apparatus is configured to have an effective autofocus mechanism and automatically change the setting of the number of focus brackets according to focus accuracy.
- the number of shots is decreased to prevent unnecessary shooting while with low accuracy, it is increased to increase the probability of achieving the focus.
- the imaging apparatus is configured that the controller can handle all the focus bracket settings, therefore, provision of a new dedicated device with additional costs incurred is unnecessary.
- the third embodiment bases on the first embodiment in which the number of focus brackets is changed, the present embodiment is not limited thereto. It can be combined with the second embodiment in which the focus interval is changed. For example, operation in steps S74 to 81 is replaced by steps S44 to S51 in FIG. 7 and operation in FIG. 8 is executed after S81.
- FIG. 17 The relation between the focus evaluation curve and focus bracket setting according to the present invention is shown in FIG. 17 .
- the fourth embodiment will be described with reference to FIGs. 10 , 11 . It bases on the first embodiment with addition of a step to display newly set number of focus brackets and focus interval on the display unit 7 ( FIG. 1 ).
- steps S91 to S101 after the first release switch (RL1SW) 3 turns on is the same as that in steps S11 to S21 in FIG. 5 of the first embodiment, therefore, a description thereon will be omitted.
- step S102 After the focus lens is set at the determined focal point in step S101, newly set number of focus brackets and focus interval are displayed on the display unit (step S102).
- This display allows the operator to know the accuracy of the focus evaluation value and the number of remaining shots, and to thereby improve shooting conditions as camera holding or stop shooting when the operator is not satisfied with the focus settings.
- steps S112 to S127 after the second release switch (RL2SW) 4 turns on is the same as that in steps S22 to S37 of FIG. 6 in the first embodiment, therefore, a description thereon will be omitted.
- the display of the number of focus brackets and focus interval is turned off on the display unit 7 (step S 128 in FIG. 11 ).
- the imaging apparatus is configured to have an effective autofocus mechanism and automatically change the setting of the number of focus brackets according to focus accuracy.
- the number of shots is decreased to prevent unnecessary shooting while with low accuracy, it is increased to increase the probability of achieving the focus.
- the imaging apparatus is configured that the controller can handle all the focus bracket settings, therefore, provision of a new dedicated device with additional costs incurred is unnecessary.
- the display unit 7 can be realized without additional costs by using various monitors such as LCD, LED, or organic EL generally provided in the camera.
- the fourth embodiment has been described on the basis of the first embodiment. However, it is feasible in combination with the second or third embodiment.
- the items on the display unit can be either the number of focus brackets or focus interval, or other various items.
- the display unit can be configured to display either or both of the values only when the initial value is changed.
- Various messages can be also displayed thereon, for example, to recommend for the operator use of a tripod during the turning-on of the first release switch 3 or tell the operator to securely hold the camera during the turning-on of the second release switch 4.
- the number of focus brackets and the focus interval can be notified to the operator using audio from an audio generator in replace of the display unit or using both of them.
- the above first to fourth embodiments have described the examples where the number of focus brackets or the focus interval is changed in accordance with the focus evaluation value.
- the fifth to eighth embodiments will describe examples where the number of focus brackets or the focus interval is changed in accordance with peak steepness of a curve (focus evaluation curve) representing a relation between the focus position and the focus evaluation value.
- the initial number of focus brackets is set at a general number, 3.
- the focus evaluation value is acquired for focus detection by moving a focus lens by a predetermined interval (step S133) after stoppage of the viewfinder mode (step S131) and auto exposure processing (photometry, photometric calculation, etc) (step S132).
- Magnitude of the maximal value of the focus evaluation value and lens position when the value is obtained are evaluated to determine the focal point of the camera by a predetermined algorithm (step S134).
- the focus evaluation value being over a predetermined value and obtained at a shortest focal length is set for the focal point.
- Various algorithms can be used therefor, and the focal point can be set at the maximal value of the highest focus evaluation value, for example.
- Peak steepness of the curve of the focus evaluation value for the determined focal point is evaluated (step S135) in such a manner that inclination of the curve around the focal point is found by calculating the focus evaluation values at the focal point and focus positions preceding and succeeding the focal point.
- the numbers of steps of focus interval preceding and succeeding the focal point are set to the same value, and in autofocus shifting the focus with equal interval, inclinations of the curve of the right and left side of the focal point are substantially the same.
- the focus evaluation values are divided by an arbitrary value for evaluation. The inclination can be obtained for either or both sides of the peak of the focus evaluation curve.
- the range of the focus evaluation values is assumed to be from zero to 1,200 and they are divided by 300 to evaluate the peak steepness in three levels 1 to 3.
- these values can be set to arbitrary values.
- FIG. 12 shows pattern diagrams of the peaks of the curves used for the focus evaluation shown in FIG. 4 .
- peak steepness 3 shows a steep and narrow inclination, signifying that the determined focal point shows an extremely high evaluation value so that it is easily detectable and accurate.
- Peak steepness 1 shows a gentle and wide inclination, signifying that the determined focal point shows a low evaluation value so that the accuracy thereof may be low.
- Peak steepness 2 shows a general level of inclination, signifying that the accuracy of the determined focal point is at a general level.
- the peak steepness is evaluated in the above three levels, and then the initial number of focus brackets is automatically changed according to a pre-stored program in the focus bracket number memory in the memories 12, as follows.
- the number of focus brackets is set to 1 and a shot is taken only at the focal point.
- the numbers of focus brackets are settable to arbitrary numbers. Even with the high focus accuracy, there may be a case where taking a shot only at the focal point is not sufficient, such as when for portrait shooting a photographer wants to focus the eyes of the nearest person which shows high contrast. In this case it can be configured to set the auto bracket mode, set the number of focus brackets to a larger number (for example, 10) and decrease the focus interval. Further, the number of focus brackets can be differently set for preceding and succeeding points to the focal point.
- step S136 in FIG. 13 the current number of focus brackets is set to 1. Note that setting of the current number can be done in the following step S137.
- step S 137 the focus interval is set to 2 steps.
- the focus interval refers to a width of a step at which the focus is shifted under the pulse motor type focus control, and the initial interval is assumed to be 2 steps.
- the interval can be set to an arbitrary value depending on focal length, lens structure, f-number of a lens, required focus precision and so on.
- step S138 the focus lens is driven to aim at the determined focal point.
- step S138 in FIG. 13 operation after turning-on of the second release switch (RL2SW) 4 is the same as that in FIG. 6 ; therefore, a description thereof will be omitted.
- the focus evaluation value and the number of focus brackets are set at the three levels in the present embodiment. However, they can be set in a larger number of levels.
- the imaging apparatus is configured to have an effective autofocus mechanism and automatically change the setting of the number of focus brackets according to focus accuracy.
- the number of shots is decreased to prevent unnecessary shooting while with low accuracy, it is increased to increase the probability of achieving the focus.
- the imaging apparatus is configured that the controller can handle all the focus bracket settings, therefore, provision of a new dedicated device with additional costs incurred is unnecessary.
- the focus evaluation value is acquired for focus detection by moving a focus lens by a predetermined interval (step S143) after stoppage of the viewfinder mode (step S141) and auto exposure processing (photometry, photometric calculation, etc) (step S142).
- Magnitude of the maximal value of the focus evaluation value and lens position when the value is obtained are evaluated to determine the focal point of the camera by a predetermined algorithm (step S144).
- the focus evaluation value being over a predetermined value and obtained at a shortest focal length is set for the focal point by the predetermined algorithm.
- Various algorithms can be used therefor, and the focal point can be set at the maximal value of the highest focus evaluation value, for example.
- Peak steepness of the focus evaluation curve for the determined focal point is evaluated (step S145) in such a manner that inclination of the curve around the focal point is found by calculating the focus evaluation values at the focal point and at focus positions preceding and succeeding the focal point.
- the numbers of steps of focus interval preceding and succeeding the focal point are set to the same value, and in autofocus shifting the focus with equal interval, inclinations of the curve of the right and left side of the focal point are substantially the same.
- the focus evaluation values are divided by an arbitrary value for evaluation. The inclination can be obtained for either or both sides of the peak of the focus evaluation curve (refer to FIG.12 ).
- the range of the focus evaluation values is assumed to be from zero to 1,200 and they are divided by 300 to evaluate the peak steepness in three levels. However, these values can be set to arbitrary values.
- the peak steepness is calculated in the same manner as in the fifth embodiment.
- Peak steepness 1 shows a gentle and wide inclination, signifying that the determined focal point shows a low evaluation value so that the accuracy thereof may be low.
- Peak steepness 2 shows a general level of inclination, signifying that the accuracy of the determined focal point is at a general level.
- the peak steepness is evaluated in the above three levels, and then the initial focus interval (2 steps) is automatically changed according to a pre-stored program in the focus bracket number memory in the memories 12, as follows.
- the focus interval is decreased to 1 step and a shot is taken only at and around the focal point.
- the focus interval is increased to 3 steps, automatically increasing probability for achieving the focus.
- the focus interval is settable to an arbitrary value.
- the high focus accuracy there may be a case where taking the set number of shots with a small interval is not sufficient, such as when for portrait shooting the operator wants to focus the eyes of the nearest person which shows high contrast.
- it can be configured to set the auto bracket mode, increase the number of focus brackets to be shot at points preceding and succeeding the focal point concurrently (with a fixed interval).
- step S147 in FIG. 14 the number of focus brackets is set to 5.
- the number can be an arbitrary number depending on focal length, lens structure, f-number of a lens, required focus precision and so on.
- the current number of focus brackets is set to 1 (step S147) and the focus lens is driven to aim at the determined focal point (step S148).
- step S148 in FIG. 14 operation after turning-on of the second release switch (RL2SW) 4 is the same as that in FIG. 8 ; therefore, a description thereof will be omitted.
- focus evaluation value and the number of focus brackets are set at the three levels in the present embodiment. However, they can be set in a larger number of levels.
- the imaging apparatus is configured to have an effective autofocus mechanism and automatically change the setting of the focus interval according to focus accuracy.
- the interval is decreased to obtain an image only at and in the vicinity of the focal point while with low accuracy, it is increased to increase the probability of achieving the focus.
- the imaging apparatus is configured that the controller can handle all the focus bracket settings, therefore, provision of a new dedicated device with additional costs incurred is unnecessary.
- the seventh embodiment will be described with reference to FIG. 15 .
- the present embodiment concerns a case where a focal point or a focus area is designated in advance.
- the focus evaluation value is acquired for focus detection by moving a focus lens by a predetermined interval (steps S153a to 153c) after stoppage of the viewfinder mode (step S151) and auto exposure processing (photometry, photometric calculation, etc) (step S 152).
- step S153a after the auto exposure in step S152, whether or not an autofocus area is designated in advance is determined in step S153a. Then, according to the determined result, the auto focus is performed only for the designated area (step S153c) or for the entire shooting area (step S153b). That is, unlike the fifth and sixth embodiments in which the entire shooting area is a subject of the autofocus, the focus evaluation values can be obtained from the designated area alone to decide the focal point.
- steps S 154 to S158 are the same as those in steps S144 to S148 in FIG. 14 , so that a description thereon will be omitted. Also, operation after the second release switch (RL2SW) 4 turns on is the same as that in FIG. 8 , so that a description thereon will be omitted.
- the imaging apparatus is configured to have an effective autofocus mechanism and automatically change the setting of the focus interval according to focus accuracy.
- the focus interval is decreased to obtain an image only at and around the focal point while with low accuracy, it is increased to increase the probability of achieving the focus.
- the imaging apparatus is configured that the controller can handle all the focus bracket settings, therefore, provision of a new dedicated device with additional costs incurred is unnecessary.
- the seventh embodiment bases on the sixth embodiment in which the focus interval is changed, the present embodiment is not limited thereto. It can be combined with the fifth embodiment in which the number of focus brackets is changed. For example, operation in steps S154 to 158 is replaced by steps S134 to S138 in FIG. 13 and operation in FIG. 8 is executed after S158.
- the eighth embodiment will be described with reference to FIG. 16 and it bases on the fifth embodiment with addition of a step to display newly set number of focus brackets and focus interval on the display unit 7 ( FIG. 1 ).
- Steps S 161 to S168 after the turning-on of the first release switch (RL1SW) 3 are the same as steps S131 to 138 in FIG. 13 in the fifth embodiment. Therefore, a description thereon will be omitted.
- step S168 After the focus lens is set at the focal point in step S168, newly set number of focus brackets and focus interval are displayed on the display unit 7 in step S169. This allows the operator to know the accuracy of the focus evaluation value and the number of remaining shots, and to thereby improve shooting conditions as camera holding or stop shooting when he/she is not satisfied with the focus settings.
- the imaging apparatus is configured to have an effective autofocus mechanism and automatically change the setting of the number of focus brackets according to focus accuracy.
- the number of shots is decreased to prevent unnecessary shooting while with low accuracy, it is increased to increase the probability of achieving the focus.
- the imaging apparatus is configured that the controller can handle all the focus bracket settings, therefore, provision of a new dedicated device with additional costs incurred is unnecessary.
- the display unit 7 can be realized without additional costs by using various monitors such as LCD, LED, or organic EL generally provided in the camera.
- the eighth embodiment has been described on the basis of the fifth embodiment. However, it can be configured to base on the sixth or seventh embodiment. Also, the items on the display unit can be either the number of focus brackets or focus interval, or other various items. Further, the display unit can be configured to display either or both of the values only when the initial value is changed. Various messages can be also displayed thereon, for example, to recommend for the operator use of a tripod during the turning-on of the first release switch 3 or tell the operator to securely hold the camera during the turning-on of the second release switch 4.
- the number of focus brackets and focus interval can be notified to the operator using audio from an audio generator in replace of the display unit or using both of the display unit and audio generator.
- the number of focus brackets or/and the focus interval is changed in accordance with the focus evaluation value or peak steepness.
- the present invention is not limited thereto.
- the present invention can be configured that they are changed in accordance with both the focus evaluation value and peak steepness.
- the focal point can be determined by the peak steepness of the focus evaluation curve.
- the number of focus brackets or the focus interval can be changed in accordance with shooting distance. For example, with a short shooting distance and a small depth of field, a small change in the focus interval will greatly change the focus. In this case, the focus interval is decreased to a smaller value. In opposite, with a large shooting distance and a large depth of field, a small change in the focus interval will not change the focus. In this case, the focus interval is increased to a larger value.
- the number of focus brackets or the focus interval can be changed in accordance with the focal length and f-number of a photographic lens. For example, with a long focal length and a small f-number (telescopic lens), a small change in the focus interval will greatly change the focus. In this case, the focus interval is decreased to a smaller value. In opposite, with a short focal length and a large f-number (pantoscopic lens), a small change in the focus interval will not change the focus. In this case, the focus interval is increased to a larger value.
- the parameters to be changed can be an f-number in addition to the number of focus brackets and focus interval, or a combination thereof.
- it can be configured that with a small focus evaluation value, the f-number is increased while with a large focus evaluation value, it is decreased.
- the above embodiments have been described using the examples; however, the present invention should not be limited to the examples.
- Various modification and/or addition can be made to the imaging apparatus without departing from the field and scope of the present invention.
- the imaging apparatus according to the present invention performs the focus bracket function by changing the number of shots, focus interval, or f-number in accordance with the magnitude of the focus evaluation value and the peak steepness of the focus evaluation curve.
- the present invention is feasible at a minimum cost and contributes to power saving and resource saving.
- the peak steepness besides the one as described above to obtain it from inclinations of the focus evaluation curve in the vicinity of peak.
- it can be obtained by calculating a reference value from step width of the focus lens per the evaluation value or by a relation between lens step data or data relative to approximate shooting distance obtained from the lens step data and the focus evaluation value.
- it can be obtained from pattern matching using template or from vector data around the peak of the focus evaluation curve.
- control of the imaging apparatus can be performed by hardware, software or a combination of the both.
- software it can be configured to allow a computer incorporated in dedicated hardware or a general-purpose computer feasible of various processing to execute a program in which operation sequence is stored.
- the program is storable in advance on storage medium as a hard disc, ROM or the like, or temporarily or eternally storable on a removable medium such as a floppy ® disc, CD-ROM, a magnet optical disc, DVD, a magnet disc or a semiconductor memory.
- a removable storage medium can be offered as so-called package software.
- the program in addition to the installment of the program on a computer from the removable storage medium, the program can be transferred wirelessly from Internet sites, transferred via a network as LAN or the internet to the computer which stores the program on a built-in hard disc or the like.
- the imaging apparatus can advantageously achieve not only automatic focus bracket number/interval setting according to accuracy of the focal points but also prevention of unnecessary shooting and recording of unintended images, resulting in power saving.
- the imaging apparatus extracts an area with the highest contrast from plural areas in a shooting area while moving focus at a minute interval, so that it can choose the best focal point for each subject. Also, it is able to change the number of shots to be taken and shooting interval in accordance with magnitude of the focus evaluation value and the peak steepness, to thereby reasonably reduce the number of shots.
- the imaging apparatus determines a major subject based on the maximal value of the focus evaluation curve as in the state of the art, or based on that of the focus evaluation curve in the vicinity of the major subject which has been selected in advance through a touch panel or the like. Accordingly, it is made possible to focus the major subject as the operator intends to do.
- the imaging apparatus displays results of automatic setting so that an operator can re-perform release operation or mode setting if he/she is not satisfied with the automatic setting. This can further prevent unnecessary shooting and storing of unintended images, resulting in the power saving.
- the imaging apparatus has good operability and can perform theoretically-supported automatic decision making/setting/shooting/storing irrespective of the skills of an operator.
- the present invention is applicable to a focus mechanism of an imaging apparatus as well as to that of a mobile device with a camera function.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Automatic Focus Adjustment (AREA)
- Studio Devices (AREA)
- Focusing (AREA)
Description
- The present invention relates to an imaging apparatus which electronically captures an image of a subject, particularly to one with autofocus system.
- In the state of the art, there are known autofocus systems for imaging apparatuses such as an active autofocus system using an infrared floodlight LED which has been used since the time silver salt cameras were popular, a passive autofocus system using a phase difference type sensor integrated with an optical lens, or TTL autofocus system for single lens reflex cameras in which light transmitted through a photographic lens is guided into the phase difference type sensor. However, current compact type digital cameras have mostly adopted a contrast autofocus system (also called as hill-climbing type) which has been a known autofocus for video cameras. The principle of the contrast autofocus system is to capture images of a subject while changing the position of a focus lens at a minute interval, extract high frequency components of captured image data to calculate a focus evaluation value, and determine a focus position from a curve representing a distribution of the focus evaluation value.
- The most general operation thereof is to sequentially image a subject while moving a focus lens (imaging means) at a minute step (interval) before actual shooting, extract high frequency components of image data to calculate the focus evaluation value, and select and store a largest maximal value as a focal point from a portion of the curve of the focus evaluation value having maximal values. Further, upon completion of the minute-step drive operation, the focus lens is moved again to the focal point for actual shooting. This operation has been widely used owing to its accurate focus positioning without an additional sensor although it takes time to decide the focal point.
- However, it has a problem that since variation of lenses (difference between a position with highest lens resolution and a position with highest evaluation value), camera shake at shooting, contrast or frequency components of a subject, mechanical electrical repeatability of stored focus positions (backlash or the like), or purpose of an operator are not automation-possible factors, decided focal points are not always accurate positions at which an operator aims.
- In order to solve the above problem, a focus bracket function has been developed based on the auto bracket function for auto exposure. The focus bracketing is a known technique to continuously shoot a predetermined number of images at points shifted with a predetermined interval precedingly and succeedingly to the focal point a camera has decided, store all the shot images, and then allow an operator to select a desired image. However, the focus bracketing has a problem that the number of images to be shot (generally, 3) and the focus interval arc pre-fixed, resulting in capturing and storing unnecessary images when the focal point is accurate and consuming extraneous power therefor as well as not dealing with a change in photographic condition with the fixed interval. Japanese Laid-open Patent Application Publication No.
2004-333924 - This technique is intended for adjusting the aperture diaphragm to have a subject within the depth of field or reducing the number of shots to be taken when the subject is within the depth of field. However, the depth of field is an impractical calculation from a measured distance and an f-number so that it is not certain that this technique achieves capturing of images in accordance with the operator's intention.
- Further, various techniques have been proposed for taking shots and storing them within the entire shooting distance while changing a focus position at a predetermined interval, to thereby satisfy any operator's purpose after shooting. For example,
Japanese Laid-open Patent Application Publication No. 2003-333411 -
US 2003/0169363 discloses an image pick up apparatus in which when a plurality of objects are present at different distances in the field of view, a plurality of photographs are taken with focus set for each of the different objects. - In view of solving the above-identifed problems, the present invention aims to provide an imaging apparatus which can increase/decrease the number of focus brackets and the focus interval according to accuracy of a focal point which the apparatus has decided, thereby increasing possibility to capture images in accordance with an operator's intention and reasonably reducing the number of shots to be taken.
- According to the present invention, there is provided an imaging apparatus and an imaging method as defined in the appended claims.
- In an embodiment, the imaging apparatus further comprises a major subject designating unit which designates on the subject image in advance an area or a point which is to be focused on.
- In an embodiment of the imaging apparatus when the focus evaluation value calculated by the focus evaluation value calculation unit is larger than a first predetermined value, the number of focus brackets to be shot is set to be smaller than a predetermined number; and when it is smaller than a second predetermined value smaller than the first predetermined value, the number of focus brackets to be shot is set to be larger than the predetermined number.
- In an embodiment of the imaging apparatus when the focus evaluation value calculated by the focus evaluation value calculation unit is larger than a first predetermined value, the focus interval is set to be smaller than a predetermined interval; and when it is smaller than a second predetermined value smaller than the first predetermined value, the focus interval is set to be larger than the predetermined interval.
- In an embodiment of the imaging apparatus when the peak steepness of the curve of the focus evaluation value calculated by the focus evaluation value calculation unit is larger than a first predetermined value, the number of focus brackets to be shot is set to be smaller than a predetermined number; and when it is smaller than a second predetermined value smaller than the first predetermined value, the number of focus brackets to be shot is set to be larger than the predetermined number.
- In an embodiment of the imaging apparatus when the peak steepness of the curve of the focus evaluation value calculated by the focus evaluation value calculation unit is larger than a first predetermined value, the focus interval is set to be smaller than a predetermined interval; and when it is smaller than a second predetermined value smaller than the first predetermined value, the focus interval is set to be larger than the predetermined interval.
- According to the present invention, it is made possible to reduce the number of shots to be taken while improving a rate at which the operator can capture desired images as well as to achieve power saving through shortening of the shooting time and storage time and effective usage of storage medium
- The present invention will be described below with reference to an exemplary embodiment and the accompanying drawings, in which:
-
FIG. 1 shows the general configuration of an imaging apparatus according to one embodiment of the present invention; -
FIG. 2 is a flowchart describing the general operation of the imaging apparatus according to one embodiment of the present invention; -
FIG. 3 shows an example of a positional relation of subjects; -
FIG. 4 is a graph showing curves of focus evaluation values obtained at autofocus positions; -
FIG. 5 is a flowchart describing operation after a half press to a release switch according to a first embodiment of the present invention; -
FIG. 6 is a flowchart describing operation after a full press to a release switch according to the first embodiment of the present invention; -
FIG. 7 is a flowchart describing operation after a half press to a release switch according to a second embodiment of the present invention; -
FIG. 8 is a flowchart describing operation after a full press to a release switch according to the second embodiment of the present invention; -
FIG. 9 is a flowchart describing operation after a half press to a release switch according to a third embodiment of the present invention; -
FIG. 10 is a flowchart describing operation after a half press to a release switch according to a fourth embodiment of the present invention; -
FIG. 11 is a flowchart describing operation after a full press to a release switch according to the fourth embodiment of the present invention; -
FIG. 12 shows peak steepness of a focus evaluation curve according to a fifth embodiment of the present invention; -
FIG. 13 is a flowchart describing operation after a half press to a release switch according to the fifth embodiment of the present invention; -
FIG. 14 is a flowchart describing operation after a half press to a release switch according to a sixth embodiment of the present invention; -
FIG. 15 is a flowchart describing operation after a half press to a release switch according to a seventh embodiment of the present invention; -
FIG. 16 is a flowchart describing operation after a half press to a release switch according to an eighth embodiment of the present invention; and -
FIG. 17 is a graph showing focus bracket setting and focus evaluation curves according to the present invention. - Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.
- The configuration of an imaging apparatus (camera) according to a preferable embodiment of the present invention will be described with reference to
FIG. 1 . - The imaging apparatus comprises a controller (CPU) 1 controlling all operations of the imaging apparatus, a
photometric sensor 2, first andsecond release switches focus drive unit 5, a shutter drive unit (including aperture diaphragm) 6, a display unit 7, an image capturing device (electric imaging unit) 8, and astorage unit 9. The controller incorporates acalculation unit 10 to perform various calculations and decisions, atimer unit 11 to count time, volatile or nonvolatile memories 12 (focus interval memory and focus bracket number memory) storing various set values therein, anoptical imaging system 13 obtaining an image of a subject, and so on. It does not have to be structured on a single chip, and it can be structured as composite element including image processing chip or as a control unit including plural elements. - According to the imaging apparatus of the present invention, the
controller 1 functions as a focus evaluation value calculation unit which calculates, by use of an output signal from thephotometric sensor 2, a focus evaluation value at a plurality of points on a subject image in accordance with a contrast component. Alternatively, it functions as a major subject designating unit which designates on a subject image in advance an area or a point which is to be focused on (fourth embodiment), and a processing unit which performs image processing for the subject image in accordance with at least one of the number of focus brackets to be shot and the focus interval. - The
photometric sensor 2 detects brightness of a subject and is driven and controlled by thecontroller 1. It detects electric signals (image signals) relative to brightness of the subject at plural points of a shooting area (frame) and input them to thecontroller 1. Note that it can be configured without a dedicated photometric sensor that brightness in plural areas is calculated according to image data from the image capturingdevice 8. - A first release switch (RL1SW) 3 turns on by half press thereto while a second release switch (RL2SW) 4 turns on by full press thereto. Although they are illustrated as separate switches in
FIG. 1 , they are actually one switch which operates by being halfway pressed and fully pressed. - The
focus drive unit 5 andshutter drive unit 6 drive a focus lens and a shutter mechanism inclusive of an aperture diaphragm for shooting, respectively. Thefocus drive unit 5 also obtains captured image data (for autofocus) from the image capturingdevice 8 and scans a focus area (generally from a photographable shortest distance (point-blank range) to infinity) to find a focusable point. Further, note that the aperture diaphragm and the shatter mechanism can be provided separately and controlled separately. - The display device 7 can be a liquid crystal device (LCD), an organic EL element, LED, or the like to display an operation menu for viewfinder display at prc-shooting, reproduced images, or pre-setting.
- The
storage unit 9 such as built-in flash memory, external memory card, or HDD stores captured image data converted in a predetermined format by thecontroller 1. The image capturingdevice 8 is an element such as CCD, CMOS to convert an image of a subject into an electric signal to output it to thecontroller 1. - It should be understood that the
respective units 2 to 9 inFIG. 1 include drivers or necessary devices to drive. - Operation in a shooting mode of an imaging apparatus according to one embodiment of the present invention will be described with reference to
FIG. 2 . - Upon power-on of a main switch, the camera is generally in a viewfinder mode in which captured images are displayed on an LCD display or other display devices, and stands by to receive an instruction through operation switches.
- At step S1, in the viewfinder mode, the camera decides which one of the switches is manipulated (step S3). When not in the viewfinder mode, it starts the viewfinder mode (step S2) and then decides the manipulation to the switch. Having Decided that the first release switch 3 (RL1SW) is ON, it stops the viewfinder mode (step S4), performs auto exposure (step S5), autofocus (step S6), and focus drive (step S7) and then returns to the viewfinder mode. When the second release switch 4 (RL2SW) is ON, it stops the viewfinder mode (step S8), performs still-image recording (step S9) and then returns to the viewfinder mode. When any of other switches than the first and second release switches 3, 4 is ON, it performs associated operation with the switch (step S10) and returns to the viewfinder mode. Having decided that the manipulation is invalid, it remains in the viewfinder mode.
- Next, with reference to
FIGs. 3, 4 , general focus operation of the camera will be described. -
FIG. 3 shows a positional relation of subjects in a shooting area. It is assumed that there are a rock (area C) on the right front side, a person (area B) behind the rock, and a blackboard obliquely placed on the back side on which characters A (near point, area D) and Z (far point, area E)) are written. -
FIG. 4 shows curves (focus evaluation curves) indicating distribution of focus evaluation values when the subjects ofFIG. 3 are focused in autofocus. The focus evaluation value represents contrast of an image and is calculated by use of high-frequency components of light from a subject. - As shown in
FIG. 4 , the focus evaluation value is smallest at the area E as the far point on the blackboard. The focus evaluation values of the area D (near point on the blackboard) and area C (rock) are larger than that of the area E. The focus evaluation value is largest at the area B (person). Further, the focus evaluation curve of the area E is a gentlest curve and the peak thereof is unrecognizable; therefore, an error in deciding a focus position is likely to occur. The focus evaluation curves of the area C and area D are steeper than that of the area E and the peak thereof have a general steepness, and that of the area B is steepest so that focus decision can be easily made. Here, all the focus evaluation values are assumed to be over a predetermined threshold for the focus decision. - In this case, which one of the areas B to E is to be the focal point of the camera depends on the specification of the camera. For example, the focal point can be the point with the largest focus evaluation value or the point with the focus evaluation value over and closest to a later-described second predetermined value (maximal value of the right curve in
FIG. 4 ). Alternatively, the focal point can be limited within a certain distance or it can be set so that all maximal values fall within depth of field. - Hereinafter, embodiments of the imaging apparatus according to the present invention will be described with reference to the flowcharts in the drawings. Note that operations described in the flowcharts are executed by the respective units (
FIG. 1 ) controlled by thecontroller 1 according to a program. - In the first embodiment operation for setting a number of focus brackets to be shot will be described with reference to
FIGs. 5 ,6 . In auto bracket mode, the initial number of focus brackets is set at a general number, 3. - Upon turning-on of the first release switch 3 (RL1SW), the focus evaluation value is acquired for focus detection by moving a focus lens by a predetermined interval (step S13) after stoppage of the viewfinder mode (step S11) and auto exposure processing (photometry, photometric calculation, etc) (step S12). The focus evaluation value is data relative to high-frequency components of an image signal at each focal point.
- Magnitude of the maximal value of the focus evaluation value is evaluated to determine the focal point of the camera by a predetermined algorithm. The focus evaluation value being over a predetermined value and obtained at a shortest focal length is set for the focal point by the predetermined algorithm. Various algorithms can be used therefor, and the focal point can be set at the maximal value of the highest focus evaluation value, for example.
- At step S15, magnitude of the focus evaluation value at the determined focal point is evaluated using first and second predetermined values.
- (1) The first predetermined value is an upper limit value. When the focus evaluation value at the determined focal point is larger than the first predetermined value (step S15), the image obtained at this focal point has high frequency components with very high contrast; therefore, accuracy of the focal point is high.
- (2) The second predetermined value is a lower limit value. When the focus evaluation value at the determined focal point is smaller than the second predetermined value (step S 17), the image obtained at this focal point has high frequency components with low contrast; therefore, accuracy of the focal point is low.
- (3) When it is between the first and second predetermined values, the image obtained at this focal point has high frequency components with general level contrast; therefore, accuracy of the focal point is general.
- In the present embodiment, upon the evaluation of the focus evaluation value, the initial number of focus brackets is changed automatically according to a pre-stored program in the focus bracket number memory in the
memories 12, as follows. - In case of the above (1), the accuracy of the focal point is determined to be very high, so that the number of focus brackets is deceased to 1, and a shot is taken only at the determined focal point (step S16).
- In contrast, in case of the above (2), the accuracy of the focal point is determined to be low, so that the number of focus brackets is increased by 2 to 5, automatically increasing probability of achieving focus (step S 18).
- In case of the above (3), the initial number of focus brackets remains unchanged at 3 (step S 19).
- Note that the number of focus brackets is settable to an arbitrary number, Even with high focus accuracy, there may be a case where shooting only at the focal point is not sufficient, such as when for portrait shooting a photographer wants to focus the eyes of the nearest person which shows high contrast. In this case it can be configured to set the auto bracket mode and set the number of focus brackets to a larger number. In opposite, with low focus accuracy, the number of focus brackets can be increased to a larger number, for example, 10. Further, the number of focus brackets can be differently set for preceding and succeeding points to the focal point.
- Upon completion of setting the focus evaluation value, the focus interval is set to 2 steps (step S20), Here, the focus interval refers to a width of a step at which the focus is shifted under the pulse motor type focus control, and the general interval is assumed to be 2 steps. The interval can be set to an arbitrary value depending on focal length, lens structure, f-number of a lens, required focus precision and so on.
- Then, the current number of focus brackets is set at 1 (step S20) and the focus lens is driven to aim at the determined focal point (step S21).
- Next, operation after the full press to the release switch will be described with reference to
FIG. 6 . - Following the step S21 in
FIG. 5 , upon turning-on of the second release switch (RL2SW) 4, the camera performs shooting operation in accordance with the set number of focus brackets and the current number thereof in steps S23 to S37 after stopping the viewfinder mode (step S22). In step S23, it shoots a still image, and stores it and increases the current number 1 (step S20) to 2. - When the number of focus brackets is set at 1 (step S16 in
FIG. 5 ), a shot is taken only at the determined focal point and the shooting completes. Specifically, after step S22, a shot is taken at the determined focal point, and the current number is counted up to 2 (step S23), and then a decision is made on whether the number of focus brackets is set at 5 or not (step S24). When it is not, whether it is set to 3 or not is decided (step S25). At the set number being not 3, the shooting completes. - When the set number of focus brackets is 3 (step S 19 in
FIG. 5 ), a shot is taken three times in order at the focal point, at a point shifted from the focal point by (-1×2) steps and at a point shifted therefrom by the (+1×2) steps. Then, the shooting completes. - In detail, after step S22, a shot is taken at the determined focal point, and the current number is counted up to 2 (step S23). Then, a decision is made on whether the number of focus brackets is set at 5 or not (step S24). When it is not, whether it is set to 3 or not is decided (step S25). At the set number being 3, a decision is made on whether the current number is 2 or not (step S26). When it is 2, the focus lens is set at a focus position which is shifted from the focal point by (-1×2) steps, to take a shot (step S27). Then, the current number is counted up to 3 (step S28). After the decisions made in steps S24, 25, 26 again, whether or not the current number is 3 is decided (step S28).
- When the current number is 3 (step S28), the focus lens is set at a focus position which is shifted from the focal point by (+1×2) steps, to take a shot (step S29). The current number is counted up to 4. After the decisions made in steps S24, 25, 26, 28 again, since the current number is 4, the shooting completes.
- Further, when the set number of focus brackets is 5 (step S 18 in
FIG. 5 ), a shot is taken five times while the focus is shifted from the determined focal point, a point shifted from the focal point by (-2×2) steps, a point shifted therefrom by (-1×2) steps, a point shifted therefrom by (+1×2) steps and a point shifted therefrom by (+2×2) steps. Then, the shooting completes. - In detail, after step S22, a shot is taken at the determined focal point, and the current number is counted up to 2 (step S23). Then, a decision is made on whether the number of focus brackets is set at 5 or not (step S24). At the set number being 5, whether the current number is 2 or not is decided next (step S30). When it is 2, the focus lens is set at a focus position which is shifted from the determined focal point by (-2×2) steps, to take a shot (step S31). Then, the current number is counted up to 3. After the decisions made in steps S24, S30 again, whether the current number is 3 or not is decided (step S32).
- At the set number being 3, the focus lens is set at a focus position which is shifted from the determined focal point by (-1×2) steps, to take a shot (step S33). Then, the current number is counted up to 4 (step S23). After the decisions made in steps S24, S30, S32, whether the current number is 4 or not is decided (step S34).
- At the set number being 4, the focus lens is set at a focus position which is shifted from the determined focal point by (+1×2) steps, to take a shot (step S35). Then, the current number is counted up to 5 (step S23). After the decisions made in steps S24, S30, S32, S34, whether the current number is 5 or not is decided (step S36).
- At the set number being 5, the focus lens is set at a focus position which is shifted from the determined focal point by (+2×2) steps, to take a shot (step S37). Then, the current number is counted up to 6. After the decisions made in S24, S30, S32, S34 again, whether the current number is 5 or not is decided (step S36). Since the current number is 6, the shooting completes.
- Note that the evaluation of the focus evaluation value and the setting of the number of focus brackets are done at the three levels in the present embodiment. However, they can be done at a larger number of levels.
- As described above, the imaging apparatus according to the present embodiment is configured to have an effective autofocus mechanism and automatically change the setting of the number of focus brackets according to focus accuracy. With high accuracy, the number of shots is decreased to prevent unnecessary shooting while with low accuracy, it is increased to increase the probability of achieving the focus.
- Additionally, the imaging apparatus according to the present embodiment is configured that the controller can handle all the focus bracket settings, therefore, provision of a new dedicated device with additional costs incurred is unnecessary.
- In the second embodiment, operation for setting an interval of focus bracket will be described with reference to
FIGs. 7 ,8 . In auto bracket mode, the initial number of focus brackets is set at 5 and the initial focus interval is set to 2 steps. - Upon turning-on of the first release switch 3 (RL1SW), the focus evaluation value is acquired for focus detection by moving a focus lens by a predetermined interval (step S43) after stoppage of the viewfinder mode (step S41) and auto exposure processing (photometry, photometric calculation, etc) (step S42).
- Magnitude of the maximal value of the focus evaluation value is evaluated (step S44) to determine the focal point of the camera by a predetermined algorithm. The focus evaluation value being over a predetermined value and obtained at a shortest focal length is set for the focal point by the predetermined algorithm. Various algorithms can be used therefor, and the focal point can be set at the maximal value of the highest focus evaluation value, for example.
- At step S45, magnitude of the focus evaluation value at the determined focal point is evaluated using first and second predetermined values.
- (1) The first predetermined value is an upper limit value. When the focus evaluation value at the determined focal point is larger than the first predetermined value (step S45), the image at this focal point has high frequency components with very high contrast; therefore, accuracy of the focal point is high.
- (2) The second predetermined value is a lower limit value. When the focus evaluation value at the determined focal point is smaller than the second predetermined value (step S47), the image at this focal point has high frequency components with low contrast; therefore, accuracy of the focal point is low.
- (3) When it is between the first and second predetermined values, the image at this focal point has high frequency components with general level contrast; therefore, accuracy of the focal point is general.
- In the present embodiment, upon the evaluation of the focus evaluation value, the initial focus interval (2 steps) is changed automatically according to a pre-stored program in the focus interval memory in the
memories 12, as follows. - In case of the above (1), the accuracy of the focal point is determined to be very high (step S45), so that the focus interval is decreased to 1 step, and a shot is taken only in the vicinity of the determined focal point (step S46).
- In contrast, in case of the above (2), the accuracy of the focal point is determined to be low, so that the focus interval is increased to 3 steps, automatically increasing probability of achieving focus (step S48).
- In case of the above (3), the initial focus interval remains unchanged at 2 steps (step S 49).
- Note that the focus interval is settable to an arbitrary value. With a high focus accuracy obtained, there may be a case where taking the set number of shots with a small interval is not sufficient, such as when for portrait shooting a photographer wants to focus the eyes of the nearest person which shows high contrast. In this case it can be configured to set the auto bracket mode and increase the numbers of focus brackets to be shot at points preceding and succeeding the focal point concurrently (with a fixed interval).
- Thereafter, the focus bracket number is set to 5 (step S50). The focus bracket number can be set to an arbitrary value depending on focal length, lens structure, f-number of a lens, required focus precision and so on.
- Then, the current number of focus brackets is set at 1 (step S50) and the focus lens is driven to aim at the determined focal point (step S51).
- Next, operation after the full press to the release switch will be described with reference to
FIG. 8 . - Following the step S51 in
FIG. 7 , upon turning-on of the second release switch (RL2SW) 4, the camera performs shooting operation in accordance with the set number of focus brackets and the current number thereof in steps S53 to S61 after stopping the viewfinder mode (step S52). The operation in step S53 is the same as that in step S23 inFIG.6 . - When the focus interval is set at 2 steps (step S49 in
FIG. 7 ), shots are continuously taken while the focus position is shifted in order, at the focal point, at a point shifted from the focal point by (-2×2) steps, at a point shifted therefrom by (-1×2) steps, at a point shifted therefrom by (+1×2) steps, and at a point shifted therefrom by (+2×2) steps. Then, the shooting completes. - Specifically, after step S52, a shot is taken at the determined focal point, and the current number is counted up to 2 (step S53). A decision is made on whether the current number is 2 or not (step S54). When it is 2, the focus lens is set at a focus position which is shifted from the focal point (-2×2) steps (step S55), to take a shot. Then, the current number is counted up to 3 (step S53). After the decision made in step S54 again, whether the current number is 3 or not is decided (step S56).
- When it is 3, the focus lens is set at a focus position which is shifted from the focal point (-1×2) steps (step S57), to take a shot. Then, the current number is counted up to 4 (step S53). After the decision made in steps S54, S56 again, whether the current number is 4 or not is decided (step S58).
- When it is 4, the focus lens is set at a focus position which is shifted from the focal point (-2×2) steps (step S59), to take a shot. Then, the current number is counted up to 5 (step S53). After the decisions made in steps S54, S56, S58 again, whether the current number is 5 or not is decided (step S60).
- When it is 5, the focus lens is set at a focus position which is shifted from the focal point (+2×2) steps (step S61), to take a shot. Then, the current number is counted up to 6 (step S53). After the decisions made in steps S54, S56, S58 again, whether the current number is 5 or not is decided (step S58). Since the current number is 6, the shooting completes (step S60).
- Note that the number of focus brackets to be shot and the focus interval can be set to arbitrary values. Even with an accurate focal point obtained, the number of focus brackets can be increased to over 5, for example, for the purpose of precisely focusing the point where the operator aims. Increase in reading speed of the image capturing device and image process speed also contributes to the focus bracket function. Further, the evaluation of the focus evaluation value and the setting of the focus interval are done at the three levels in the present embodiment. However, they can be done at a larger number of levels.
- As described above, the imaging apparatus according to the present embodiment is configured to have an effective autofocus mechanism and automatically change the setting of the focus interval according to focus accuracy. With high accuracy, it is possible to shoot an image shifting the focal point in the vicinity thereof with a small interval. With low accuracy, the interval is increased to a larger value in order to increase the probability of achieving the focus.
- Additionally, the imaging apparatus according to the present embodiment is configured that the controller can handle all the focus interval settings, therefore, provision of another dedicated device with additional costs incurred is unnecessary.
- The third embodiment will be described with reference to
FIG. 9 . The present embodiment concerns a case where a focal point or a focus area is designated in advance. The focal point or focus area is generally designated by using a touch panel on a viewfinder to select an arbitrary area, subject, or edge from a shooting area, or by selecting them from focusable areas displayed in advance on the viewfinder through switch or menu manipulation. Alternatively, it can be designated by selecting the face of a person from a plurality of faces on the viewfinder found by facial recognition via switch manipulation or a touch panel, or by displaying automatically divided subject areas to select the one to be focused via switch manipulation or a touch panel. - In
FIG. 9 , upon turning-on of the first release switch 3 (RL1SW), the focus evaluation value is acquired for focus detection by moving a focus lens by a predetermined interval (steps S73a to 73c) after stoppage of the viewfinder mode (step S71) and auto exposure processing (photometry, photometric calculation, etc) (step S72). - In the present embodiment, after the auto exposure in step S72, whether or not an autofocus area is designated in advance is determined in step S73a, Then, according to the determined result, the auto focus is performed only for the designated area (step S73c) or for the entire area (step S73b). That is, unlike the first and second embodiments in which the entire area is a subject of the autofocus, the focus evaluation value can be obtained from the designated area alone to decide the focal point in the designated area.
- The following steps S74 to S81 are the same as those in steps S14 to S21 in
FIG. 5 , so that a description thereon will be omitted. Also, operation after step S81 is the same as that inFIG. 6 , so that a description thereon will be omitted. - As described above, the imaging apparatus according to the present embodiment is configured to have an effective autofocus mechanism and automatically change the setting of the number of focus brackets according to focus accuracy. With high accuracy, the number of shots is decreased to prevent unnecessary shooting while with low accuracy, it is increased to increase the probability of achieving the focus.
- Additionally, the imaging apparatus according to the present embodiment is configured that the controller can handle all the focus bracket settings, therefore, provision of a new dedicated device with additional costs incurred is unnecessary.
- Note that although the third embodiment bases on the first embodiment in which the number of focus brackets is changed, the present embodiment is not limited thereto. It can be combined with the second embodiment in which the focus interval is changed. For example, operation in steps S74 to 81 is replaced by steps S44 to S51 in
FIG. 7 and operation inFIG. 8 is executed after S81. - The relation between the focus evaluation curve and focus bracket setting according to the present invention is shown in
FIG. 17 . - The fourth embodiment will be described with reference to
FIGs. 10 ,11 . It bases on the first embodiment with addition of a step to display newly set number of focus brackets and focus interval on the display unit 7 (FIG. 1 ). - In
FIG. 10 , operation in steps S91 to S101 after the first release switch (RL1SW) 3 turns on is the same as that in steps S11 to S21 inFIG. 5 of the first embodiment, therefore, a description thereon will be omitted. - After the focus lens is set at the determined focal point in step S101, newly set number of focus brackets and focus interval are displayed on the display unit (step S102). This display allows the operator to know the accuracy of the focus evaluation value and the number of remaining shots, and to thereby improve shooting conditions as camera holding or stop shooting when the operator is not satisfied with the focus settings.
- Further, in
FIG. 10 , operation in steps S112 to S127 after the second release switch (RL2SW) 4 turns on is the same as that in steps S22 to S37 ofFIG. 6 in the first embodiment, therefore, a description thereon will be omitted. - Upon deciding completion of the shooting, the display of the number of focus brackets and focus interval is turned off on the display unit 7 (step S 128 in
FIG. 11 ). - As described above, the imaging apparatus according to the present embodiment is configured to have an effective autofocus mechanism and automatically change the setting of the number of focus brackets according to focus accuracy. With high accuracy, the number of shots is decreased to prevent unnecessary shooting while with low accuracy, it is increased to increase the probability of achieving the focus.
- Additionally, the imaging apparatus according to the present embodiment is configured that the controller can handle all the focus bracket settings, therefore, provision of a new dedicated device with additional costs incurred is unnecessary.
- Further, the display unit 7 can be realized without additional costs by using various monitors such as LCD, LED, or organic EL generally provided in the camera.
- The fourth embodiment has been described on the basis of the first embodiment. However, it is feasible in combination with the second or third embodiment. Also, the items on the display unit can be either the number of focus brackets or focus interval, or other various items. Further, the display unit can be configured to display either or both of the values only when the initial value is changed. Various messages can be also displayed thereon, for example, to recommend for the operator use of a tripod during the turning-on of the
first release switch 3 or tell the operator to securely hold the camera during the turning-on of thesecond release switch 4. - Moreover, the number of focus brackets and the focus interval can be notified to the operator using audio from an audio generator in replace of the display unit or using both of them.
- The above first to fourth embodiments have described the examples where the number of focus brackets or the focus interval is changed in accordance with the focus evaluation value. Hereinafter, the fifth to eighth embodiments will describe examples where the number of focus brackets or the focus interval is changed in accordance with peak steepness of a curve (focus evaluation curve) representing a relation between the focus position and the focus evaluation value.
- In the fifth embodiment operation for setting the number of focus brackets will be described with reference to
FIG. 13 . In auto bracket mode, the initial number of focus brackets is set at a general number, 3. - Upon turning-on of the first release switch 3 (RL1SW), the focus evaluation value is acquired for focus detection by moving a focus lens by a predetermined interval (step S133) after stoppage of the viewfinder mode (step S131) and auto exposure processing (photometry, photometric calculation, etc) (step S132).
- Magnitude of the maximal value of the focus evaluation value and lens position when the value is obtained are evaluated to determine the focal point of the camera by a predetermined algorithm (step S134). The focus evaluation value being over a predetermined value and obtained at a shortest focal length is set for the focal point. Various algorithms can be used therefor, and the focal point can be set at the maximal value of the highest focus evaluation value, for example.
- Peak steepness of the curve of the focus evaluation value for the determined focal point is evaluated (step S135) in such a manner that inclination of the curve around the focal point is found by calculating the focus evaluation values at the focal point and focus positions preceding and succeeding the focal point. In the present embodiment, the numbers of steps of focus interval preceding and succeeding the focal point are set to the same value, and in autofocus shifting the focus with equal interval, inclinations of the curve of the right and left side of the focal point are substantially the same. The focus evaluation values are divided by an arbitrary value for evaluation. The inclination can be obtained for either or both sides of the peak of the focus evaluation curve.
- In the present embodiment, the range of the focus evaluation values is assumed to be from zero to 1,200 and they are divided by 300 to evaluate the peak steepness in three
levels 1 to 3. However, these values can be set to arbitrary values. Specifically, the peak steepness P is calculated by a following expression:
where EV0 is a focus evaluation value at a focal point, EV+2 is a focus evaluation value at a point shifted therefrom by + 2 steps and EV-2 is a focus evaluation value at a point shifted therefrom by -2 steps. -
FIG. 12 shows pattern diagrams of the peaks of the curves used for the focus evaluation shown inFIG. 4 . - (1) In the drawing,
peak steepness 3 shows a steep and narrow inclination, signifying that the determined focal point shows an extremely high evaluation value so that it is easily detectable and accurate. - (2)
Peak steepness 1 shows a gentle and wide inclination, signifying that the determined focal point shows a low evaluation value so that the accuracy thereof may be low. - (3)
Peak steepness 2 shows a general level of inclination, signifying that the accuracy of the determined focal point is at a general level. - In the present embodiment, the peak steepness is evaluated in the above three levels, and then the initial number of focus brackets is automatically changed according to a pre-stored program in the focus bracket number memory in the
memories 12, as follows. - With the high accuracy in the above (1) (when peak steepness > first predetermined value, for example, 3), the number of focus brackets is set to 1 and a shot is taken only at the focal point.
- In opposite, with the low accuracy in the above (2) (when peak steepness < second predetermined value, for example, 1), the number of focus brackets is increased by 2 to 5, automatically increasing probability for achieving the focus.
- With the general accuracy in the above (3), the initial number of focus brackets remains unchanged at 3.
- Note that the numbers of focus brackets are settable to arbitrary numbers. Even with the high focus accuracy, there may be a case where taking a shot only at the focal point is not sufficient, such as when for portrait shooting a photographer wants to focus the eyes of the nearest person which shows high contrast. In this case it can be configured to set the auto bracket mode, set the number of focus brackets to a larger number (for example, 10) and decrease the focus interval. Further, the number of focus brackets can be differently set for preceding and succeeding points to the focal point.
- In step S136 in
FIG. 13 , the current number of focus brackets is set to 1.
Note that setting of the current number can be done in the following step S137. - In step S 137 the focus interval is set to 2 steps. Here, the focus interval refers to a width of a step at which the focus is shifted under the pulse motor type focus control, and the initial interval is assumed to be 2 steps. The interval can be set to an arbitrary value depending on focal length, lens structure, f-number of a lens, required focus precision and so on.
- In step S138, the focus lens is driven to aim at the determined focal point.
- Following step S138 in
FIG. 13 , operation after turning-on of the second release switch (RL2SW) 4 is the same as that inFIG. 6 ; therefore, a description thereof will be omitted. Note that the focus evaluation value and the number of focus brackets are set at the three levels in the present embodiment. However, they can be set in a larger number of levels. - As described above, the imaging apparatus according to the present embodiment is configured to have an effective autofocus mechanism and automatically change the setting of the number of focus brackets according to focus accuracy. With high accuracy, the number of shots is decreased to prevent unnecessary shooting while with low accuracy, it is increased to increase the probability of achieving the focus.
- Additionally, the imaging apparatus according to the present embodiment is configured that the controller can handle all the focus bracket settings, therefore, provision of a new dedicated device with additional costs incurred is unnecessary.
- In the sixth embodiment, operation for setting the focus interval will be described with reference to
FIG. 14 . In the auto bracket mode the initial focus interval is set to 2 steps. - Upon turning-on of the first release switch 3 (RL1SW), the focus evaluation value is acquired for focus detection by moving a focus lens by a predetermined interval (step S143) after stoppage of the viewfinder mode (step S141) and auto exposure processing (photometry, photometric calculation, etc) (step S142).
- Magnitude of the maximal value of the focus evaluation value and lens position when the value is obtained are evaluated to determine the focal point of the camera by a predetermined algorithm (step S144). The focus evaluation value being over a predetermined value and obtained at a shortest focal length is set for the focal point by the predetermined algorithm. Various algorithms can be used therefor, and the focal point can be set at the maximal value of the highest focus evaluation value, for example.
- Peak steepness of the focus evaluation curve for the determined focal point is evaluated (step S145) in such a manner that inclination of the curve around the focal point is found by calculating the focus evaluation values at the focal point and at focus positions preceding and succeeding the focal point. In the present embodiment, the numbers of steps of focus interval preceding and succeeding the focal point are set to the same value, and in autofocus shifting the focus with equal interval, inclinations of the curve of the right and left side of the focal point are substantially the same. The focus evaluation values are divided by an arbitrary value for evaluation. The inclination can be obtained for either or both sides of the peak of the focus evaluation curve (refer to
FIG.12 ). - In the present embodiment, the range of the focus evaluation values is assumed to be from zero to 1,200 and they are divided by 300 to evaluate the peak steepness in three levels. However, these values can be set to arbitrary values. The peak steepness is calculated in the same manner as in the fifth embodiment.
- (1) In
FIG. 12 ,peak steepness 3 shows a steep and narrow inclination, signifying that the determined focal point shows an extremely high evaluation value so that it is easily detectable and accurate. - (2)
Peak steepness 1 shows a gentle and wide inclination, signifying that the determined focal point shows a low evaluation value so that the accuracy thereof may be low. - (3)
Peak steepness 2 shows a general level of inclination, signifying that the accuracy of the determined focal point is at a general level. - In the present embodiment, the peak steepness is evaluated in the above three levels, and then the initial focus interval (2 steps) is automatically changed according to a pre-stored program in the focus bracket number memory in the
memories 12, as follows. - With the high accuracy in the above (1) (when peak steepness > first predetermined value, for example, 3), the focus interval is decreased to 1 step and a shot is taken only at and around the focal point.
- In opposite, with the low accuracy in the above (2) (when peak steepness < second predetermined value, for example, 1), the focus interval is increased to 3 steps, automatically increasing probability for achieving the focus.
- With the general accuracy in the above (3), the initial focus interval remains unchanged at 2 steps.
- Note that the focus interval is settable to an arbitrary value. With the high focus accuracy, there may be a case where taking the set number of shots with a small interval is not sufficient, such as when for portrait shooting the operator wants to focus the eyes of the nearest person which shows high contrast. In this case it can be configured to set the auto bracket mode, increase the number of focus brackets to be shot at points preceding and succeeding the focal point concurrently (with a fixed interval).
- In step S147 in
FIG. 14 , the number of focus brackets is set to 5. The number can be an arbitrary number depending on focal length, lens structure, f-number of a lens, required focus precision and so on. - Then, the current number of focus brackets is set to 1 (step S147) and the focus lens is driven to aim at the determined focal point (step S148).
- Following the step S148 in
FIG. 14 , operation after turning-on of the second release switch (RL2SW) 4 is the same as that inFIG. 8 ; therefore, a description thereof will be omitted. - Note that the focus evaluation value and the number of focus brackets are set at the three levels in the present embodiment. However, they can be set in a larger number of levels.
- As described above, the imaging apparatus according to the present embodiment is configured to have an effective autofocus mechanism and automatically change the setting of the focus interval according to focus accuracy. With high accuracy, the interval is decreased to obtain an image only at and in the vicinity of the focal point while with low accuracy, it is increased to increase the probability of achieving the focus.
- Additionally, the imaging apparatus according to the present embodiment is configured that the controller can handle all the focus bracket settings, therefore, provision of a new dedicated device with additional costs incurred is unnecessary. [Seventh Embodiment]
- The seventh embodiment will be described with reference to
FIG. 15 . Similarly to the third embodiment, the present embodiment concerns a case where a focal point or a focus area is designated in advance. - In
FIG. 15 , upon turning-on of the first release switch 3 (RL1SW), the focus evaluation value is acquired for focus detection by moving a focus lens by a predetermined interval (steps S153a to 153c) after stoppage of the viewfinder mode (step S151) and auto exposure processing (photometry, photometric calculation, etc) (step S 152). - In the present embodiment, after the auto exposure in step S152, whether or not an autofocus area is designated in advance is determined in step S153a. Then, according to the determined result, the auto focus is performed only for the designated area (step S153c) or for the entire shooting area (step S153b). That is, unlike the fifth and sixth embodiments in which the entire shooting area is a subject of the autofocus, the focus evaluation values can be obtained from the designated area alone to decide the focal point.
- The following steps S 154 to S158 are the same as those in steps S144 to S148 in
FIG. 14 , so that a description thereon will be omitted. Also, operation after the second release switch (RL2SW) 4 turns on is the same as that inFIG. 8 , so that a description thereon will be omitted. - As described above, the imaging apparatus according to the present embodiment is configured to have an effective autofocus mechanism and automatically change the setting of the focus interval according to focus accuracy. With high accuracy, the focus interval is decreased to obtain an image only at and around the focal point while with low accuracy, it is increased to increase the probability of achieving the focus.
- Additionally, the imaging apparatus according to the present embodiment is configured that the controller can handle all the focus bracket settings, therefore, provision of a new dedicated device with additional costs incurred is unnecessary.
- Note that although the seventh embodiment bases on the sixth embodiment in which the focus interval is changed, the present embodiment is not limited thereto. It can be combined with the fifth embodiment in which the number of focus brackets is changed. For example, operation in steps S154 to 158 is replaced by steps S134 to S138 in
FIG. 13 and operation inFIG. 8 is executed after S158. - The eighth embodiment will be described with reference to
FIG. 16 and it bases on the fifth embodiment with addition of a step to display newly set number of focus brackets and focus interval on the display unit 7 (FIG. 1 ). - Steps S 161 to S168 after the turning-on of the first release switch (RL1SW) 3 are the same as steps S131 to 138 in
FIG. 13 in the fifth embodiment. Therefore, a description thereon will be omitted. - After the focus lens is set at the focal point in step S168, newly set number of focus brackets and focus interval are displayed on the display unit 7 in step S169. This allows the operator to know the accuracy of the focus evaluation value and the number of remaining shots, and to thereby improve shooting conditions as camera holding or stop shooting when he/she is not satisfied with the focus settings.
- Further, operation after S169 in
FIG. 16 , which is after the second release switch (RL2SW) 4 turns on, is the same as that inFIG. 11 , therefore, a description thereon will be omitted. - As described above, the imaging apparatus according to the present embodiment is configured to have an effective autofocus mechanism and automatically change the setting of the number of focus brackets according to focus accuracy. With high accuracy, the number of shots is decreased to prevent unnecessary shooting while with low accuracy, it is increased to increase the probability of achieving the focus.
- Additionally, the imaging apparatus according to the present embodiment is configured that the controller can handle all the focus bracket settings, therefore, provision of a new dedicated device with additional costs incurred is unnecessary.
- Further, the display unit 7 can be realized without additional costs by using various monitors such as LCD, LED, or organic EL generally provided in the camera.
- Note that the eighth embodiment has been described on the basis of the fifth embodiment. However, it can be configured to base on the sixth or seventh embodiment. Also, the items on the display unit can be either the number of focus brackets or focus interval, or other various items. Further, the display unit can be configured to display either or both of the values only when the initial value is changed. Various messages can be also displayed thereon, for example, to recommend for the operator use of a tripod during the turning-on of the
first release switch 3 or tell the operator to securely hold the camera during the turning-on of thesecond release switch 4. - Moreover, the number of focus brackets and focus interval can be notified to the operator using audio from an audio generator in replace of the display unit or using both of the display unit and audio generator.
- According to the above first to eighth embodiments, the number of focus brackets or/and the focus interval is changed in accordance with the focus evaluation value or peak steepness. However, the present invention is not limited thereto. The present invention can be configured that they are changed in accordance with both the focus evaluation value and peak steepness. For example, when two or more focus evaluation values are equivalent to each other, the focal point can be determined by the peak steepness of the focus evaluation curve.
- Furthermore, the number of focus brackets or the focus interval can be changed in accordance with shooting distance. For example, with a short shooting distance and a small depth of field, a small change in the focus interval will greatly change the focus. In this case, the focus interval is decreased to a smaller value. In opposite, with a large shooting distance and a large depth of field, a small change in the focus interval will not change the focus. In this case, the focus interval is increased to a larger value.
- Further, the number of focus brackets or the focus interval can be changed in accordance with the focal length and f-number of a photographic lens. For example, with a long focal length and a small f-number (telescopic lens), a small change in the focus interval will greatly change the focus. In this case, the focus interval is decreased to a smaller value. In opposite, with a short focal length and a large f-number (pantoscopic lens), a small change in the focus interval will not change the focus. In this case, the focus interval is increased to a larger value.
- Further, the parameters to be changed can be an f-number in addition to the number of focus brackets and focus interval, or a combination thereof. For example, it can be configured that with a small focus evaluation value, the f-number is increased while with a large focus evaluation value, it is decreased.
- The above embodiments have been described using the examples; however, the present invention should not be limited to the examples. Various modification and/or addition can be made to the imaging apparatus without departing from the field and scope of the present invention. The imaging apparatus according to the present invention performs the focus bracket function by changing the number of shots, focus interval, or f-number in accordance with the magnitude of the focus evaluation value and the peak steepness of the focus evaluation curve. The present invention is feasible at a minimum cost and contributes to power saving and resource saving.
- There are various methods to obtain the peak steepness besides the one as described above to obtain it from inclinations of the focus evaluation curve in the vicinity of peak. For example, it can be obtained by calculating a reference value from step width of the focus lens per the evaluation value or by a relation between lens step data or data relative to approximate shooting distance obtained from the lens step data and the focus evaluation value. Further, it can be obtained from pattern matching using template or from vector data around the peak of the focus evaluation curve.
- Further, the control of the imaging apparatus according to the above embodiments can be performed by hardware, software or a combination of the both. With use of software, it can be configured to allow a computer incorporated in dedicated hardware or a general-purpose computer feasible of various processing to execute a program in which operation sequence is stored. For example, the program is storable in advance on storage medium as a hard disc, ROM or the like, or temporarily or eternally storable on a removable medium such as a floppy ® disc, CD-ROM, a magnet optical disc, DVD, a magnet disc or a semiconductor memory. Such a removable storage medium can be offered as so-called package software. Further, in addition to the installment of the program on a computer from the removable storage medium, the program can be transferred wirelessly from Internet sites, transferred via a network as LAN or the internet to the computer which stores the program on a built-in hard disc or the like.
- Further, the operations described above can be performed in time order or in parallel or individually when necessary or according to processing capacity of a device executing the operations.
- As described in the first to eighth embodiments, the imaging apparatus according to the present invention can advantageously achieve not only automatic focus bracket number/interval setting according to accuracy of the focal points but also prevention of unnecessary shooting and recording of unintended images, resulting in power saving.
- Further, the imaging apparatus according to the present invention extracts an area with the highest contrast from plural areas in a shooting area while moving focus at a minute interval, so that it can choose the best focal point for each subject. Also, it is able to change the number of shots to be taken and shooting interval in accordance with magnitude of the focus evaluation value and the peak steepness, to thereby reasonably reduce the number of shots.
- Furthermore, the imaging apparatus according to the present invention determines a major subject based on the maximal value of the focus evaluation curve as in the state of the art, or based on that of the focus evaluation curve in the vicinity of the major subject which has been selected in advance through a touch panel or the like. Accordingly, it is made possible to focus the major subject as the operator intends to do.
- The imaging apparatus according to the present invention displays results of automatic setting so that an operator can re-perform release operation or mode setting if he/she is not satisfied with the automatic setting. This can further prevent unnecessary shooting and storing of unintended images, resulting in the power saving.
- The imaging apparatus according to the present invention has good operability and can perform theoretically-supported automatic decision making/setting/shooting/storing irrespective of the skills of an operator.
- The present invention is applicable to a focus mechanism of an imaging apparatus as well as to that of a mobile device with a camera function.
- The present invention has been described above in relation to exemplary embodiments, however these embodiments are not to be regarded as limiting the scope of the invention, which is rather defined by the appended claims.
Claims (7)
- An imaging apparatus comprising:an optical imaging system (13) for obtaining an image of a subject;an electric imaging unit (8) for converting the subject image obtained by the optical imaging system (13) into an electric signal;a focus evaluation value calculation unit (1) for calculating, by use of an output signal from the electric imaging unit (8), a focus evaluation value at a plurality of points on the subject image in accordance with a contrast component;a focus bracket setting unit (1) for automatically setting a number shots to be taken in a focus bracket and/or a focus interval in accordance with at least one of magnitude of the focus evaluation value and a peak steepness of a curve of the focus evaluation value calculated by the focus evaluation value calculation unit (1), the curve representing a relation between the focus evaluation value and a focus position; anda processing unit (1) for performing image processing for the subject image in accordance with the number of shots to be taken and/or the focus interval set by the focus bracket setting unit (1); characterised by further comprising at least one of a display unit (7) and an audio generator which notifies at least one of a numeric value, a text, a graphic and audio data relating to the number of shots to be taken or the focus interval.
- An imaging apparatus according to claim 1, further comprising a major subject designating unit (1) for designating on the subject image in advance an area or a point which is to be focused on.
- An imaging apparatus according to either claim 1 or claim 2, wherein:when the focus evaluation value calculated by the focus evaluation value calculation unit (1) is larger than a first predetermined value, the number of shots to be taken is set to be smaller than a predetermined number; andwhen it is smaller than a second predetermined value smaller than the first predetermined value, the number of shots to be taken is set to be larger than the predetermined number.
- An imaging apparatus according to either claim 1 or claim 2, wherein:when the focus evaluation value calculated by the focus evaluation value calculation unit (1) is larger than a first predetermined value, the focus interval is set to be smaller than a predetermined interval; andwhen it is smaller than a second predetermined value smaller than the first predetermined value, the focus interval is set to be larger than the predetermined interval.
- An imaging apparatus according to either claim 1 or claim 2, wherein:when the peak steepness of the curve of the focus evaluation value calculated by the focus evaluation value calculation unit (1) is larger than a first predetermined value, the number of shots to be taken is set to be smaller than a predetermined number; andwhen it is smaller than a second predetermined value smaller than the first predetermined value, the number of shots to be taken is set to be larger than the predetermined number.
- An imaging apparatus according to either claim 1 or claim 2, wherein:when the peak steepness of the curve of the focus evaluation value calculated by the focus evaluation value calculation unit (1) is larger than a first predetermined value, the focus interval is set to be smaller than a predetermined interval; andwhen it is smaller than a second predetermined value smaller than the first predetermined value, the focus interval is set to be larger than the predetermined interval.
- An imaging method comprising the steps of:obtaining an image of a subject;converting the image of the subject into an electrical signal;calculating from the electrical signal a focus evaluation value at a plurality of points on the image of the subject in accordance with a contrast component (S92, S93; S163, S164);setting a number of shots to be taken in a focus bracket and/or a focus interval in accordance with at least one of the magnitude of the focus evaluation value and a peak steepness of a curve representing a relation between the focus evaluation value and a focus position (S95, S97; S165, S166); andprocessing the image of the subject in accordance with at least one of the number of focus brackets to be shot or the focus interval as set in the setting step; characterized bynotifying at least one of a numeric value, a text, a graphic and audio data relating to the number of shots to be taken or the focus interval by at least one of a display unit or an audio generator (S102; S169).
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2007162469 | 2007-06-20 | ||
JP2007182147A JP4890370B2 (en) | 2007-06-20 | 2007-07-11 | Imaging device |
Publications (3)
Publication Number | Publication Date |
---|---|
EP2007135A2 EP2007135A2 (en) | 2008-12-24 |
EP2007135A3 EP2007135A3 (en) | 2010-12-08 |
EP2007135B1 true EP2007135B1 (en) | 2012-05-23 |
Family
ID=39773056
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP08252097A Ceased EP2007135B1 (en) | 2007-06-20 | 2008-06-18 | Imaging apparatus |
Country Status (1)
Country | Link |
---|---|
EP (1) | EP2007135B1 (en) |
Families Citing this family (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5005570B2 (en) * | 2008-02-04 | 2012-08-22 | 株式会社リコー | Image processing apparatus and program |
KR20100080704A (en) * | 2009-01-02 | 2010-07-12 | 삼성전자주식회사 | Method and apparatus for obtaining image data |
JP5206494B2 (en) | 2009-02-27 | 2013-06-12 | 株式会社リコー | Imaging device, image display device, imaging method, image display method, and focus area frame position correction method |
JP5387949B2 (en) * | 2009-03-03 | 2014-01-15 | 株式会社リコー | Imaging apparatus, reproduction display apparatus, imaging recording method, and reproduction display method |
CN105190392B (en) | 2013-02-14 | 2018-02-13 | 富士胶片株式会社 | Camera device and focusing control method |
JP5662511B2 (en) | 2013-04-10 | 2015-01-28 | シャープ株式会社 | Imaging device |
CN104102069B (en) * | 2013-04-11 | 2017-03-15 | 展讯通信(上海)有限公司 | A kind of focusing method of imaging system and device, imaging system |
CN107872614A (en) * | 2016-09-27 | 2018-04-03 | 中兴通讯股份有限公司 | A kind of image pickup method and filming apparatus |
US20190297270A1 (en) * | 2016-09-29 | 2019-09-26 | Nikon Corporation | Image - capturing apparatus |
JP6582153B2 (en) | 2017-03-15 | 2019-09-25 | 富士フイルム株式会社 | Imaging apparatus, imaging method, and imaging program |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2003114378A (en) * | 2001-10-05 | 2003-04-18 | Nikon Gijutsu Kobo:Kk | Camera |
JP2003121731A (en) * | 2001-10-18 | 2003-04-23 | Minolta Co Ltd | Digital camera |
US7391461B2 (en) * | 2002-03-06 | 2008-06-24 | Canon Kabushiki Kaisha | Apparatus, method and control computer program for imaging a plurality of objects at different distances |
JP4125104B2 (en) * | 2002-12-10 | 2008-07-30 | キヤノン株式会社 | Automatic focusing device, program, and computer-readable storage medium |
JP2004333924A (en) | 2003-05-08 | 2004-11-25 | Fuji Photo Film Co Ltd | Camera |
JP2004333411A (en) | 2003-05-12 | 2004-11-25 | Kajima Corp | Water leak detection device and method of water supply system |
-
2008
- 2008-06-18 EP EP08252097A patent/EP2007135B1/en not_active Ceased
Also Published As
Publication number | Publication date |
---|---|
EP2007135A2 (en) | 2008-12-24 |
EP2007135A3 (en) | 2010-12-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2007135B1 (en) | Imaging apparatus | |
JP5961929B2 (en) | camera | |
JP4907740B2 (en) | Imaging device | |
US20140198244A1 (en) | Focus aid system | |
JP2005215040A (en) | Autofocus system | |
JP2007086596A (en) | Camera | |
JP5896763B2 (en) | Optical instrument and method for autofocusing | |
JP4893334B2 (en) | Image tracking device and imaging device | |
JP2006091915A (en) | Imaging apparatus | |
JP2004151609A (en) | Autofocus system | |
JP2007133301A (en) | Autofocus camera | |
JP2008129371A (en) | Imaging apparatus | |
JP5124929B2 (en) | Focus adjustment device and digital camera | |
JP2013205675A (en) | Imaging apparatus | |
JP6834988B2 (en) | Control device | |
JP2011118021A (en) | Imaging device and method for controlling the same | |
JP5063249B2 (en) | Focus control device and method | |
JP5871196B2 (en) | Focus adjustment device and imaging device | |
JP6164978B2 (en) | FOCUS ADJUSTMENT DEVICE, ITS CONTROL METHOD, CONTROL PROGRAM, AND IMAGING DEVICE | |
JP2016065998A (en) | Imaging device and imaging program | |
JP2010190913A (en) | Imaging device with automatic focus function | |
JP4535462B2 (en) | Subject image acquisition device | |
JP2004264635A (en) | Camera | |
JP2008052022A (en) | Imaging apparatus and imaging method | |
JP2007249238A (en) | Imaging apparatus, automatic focusing method, and recording medium with recorded focusing procedure |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA MK RS |
|
PUAL | Search report despatched |
Free format text: ORIGINAL CODE: 0009013 |
|
AK | Designated contracting states |
Kind code of ref document: A3 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA MK RS |
|
17P | Request for examination filed |
Effective date: 20110208 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04N 5/232 20060101AFI20110621BHEP |
|
AKX | Designation fees paid |
Designated state(s): DE FR GB |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): DE FR GB |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602008015829 Country of ref document: DE Effective date: 20120802 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20130226 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602008015829 Country of ref document: DE Effective date: 20130226 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 9 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 10 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20180625 Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20180620 Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20180620 Year of fee payment: 11 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602008015829 Country of ref document: DE |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20190618 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200101 Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190618 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190630 |