JP5069076B2 - Imaging apparatus and continuous imaging method - Google Patents

Description

  The present invention relates to an imaging apparatus such as a so-called digital camera, and more particularly to an imaging apparatus having a function of performing continuous imaging while automatically changing a focus position.

In a conventional imaging apparatus such as a digital camera, the focus is photographed at a focus position automatically determined by an autofocus function inside the apparatus. In many cases, there are few problems within the depth of field of a lens that can be accepted as visually in focus, but it is most difficult for the user to achieve the most appropriate focus on the subject or subject part that the user wants to focus on. In some cases, in a deep scene or close-up shooting with a narrow depth of field, the subject to be matched and the subject portion may be unfocused.
Conventionally, for example, Patent Document 1 (Japanese Patent Application Laid-Open No. 2005-202064) proposes a method for efficiently focusing by specifying a focusing range. However, this method requires time and effort such as range designation.
On the other hand, for example, Patent Document 2 (Japanese Patent Laid-Open No. 2005-140851) discloses that continuous shooting is performed while micro-extending a lens. However, in this case, the number of shots increases. There's a problem.
For example, Patent Document 3 (Japanese Patent Laid-Open No. 2003-44853) discloses a method for detecting a characteristic subject portion such as a face from image data of an object scene. Japanese Patent No. 3500147) shows a compression method between frames by a so-called previous value prediction method.

Japanese Patent Laid-Open No. 2005-202064 JP 2005-140851 A JP 2003-44853 A Japanese Patent No. 3500137

As described above, the method of previously limiting the automatic focusing operation range disclosed in Patent Document 1 (Japanese Patent Laid-Open No. 2005-202064) is a range in which the automatic focusing operation range is specified by an interactive operation with the user. A special operation for designation is required, and the imaging operation becomes complicated, or a complicated configuration is required for range designation.
In addition, in the method of performing continuous imaging while minutely extending the imaging lens disclosed in Patent Document 2 (Japanese Patent Application Laid-Open No. 2005-140851), the number of captured images increases, and the system automatically selects an optimal one. Even so, if another captured image is to be selected, an operation of selecting an optimal captured image from a large number of captured images by the user is further required.
The present invention has been made in view of the above-described circumstances, and by sequentially changing the focus position and performing a plurality of imaging operations, image data that the user may need is automatically selected according to the scene situation. It is another object of the present invention to provide an imaging device and a continuous imaging method that can be obtained efficiently and efficiently.
The purpose of claim 1 of the present invention is to prevent wasted imaging operation and the imaging data recording, a sufficient imaging data for the required, depending on the focusing status, automatically and allows extremely efficient obtain good and,
In particular, at the time of the first operation of the release operation unit, the user can determine whether or not the desired focus imaging has been performed, and if it is an obvious failure such as the subject moving, It is an object of the present invention to provide an image pickup apparatus that can retake an image by canceling the first operation state and redoing the first operation again, thereby eliminating time-consuming useless recording and storage. .
The object of the second aspect of the present invention is to provide an image pickup apparatus that can effectively prevent useless image pickup operation and recording of image pickup data.
An object of claim 3 of the present invention is to provide an image pickup apparatus capable of appropriately recording image pickup data onto a recording medium.
The object of claim 4 of the present invention is to provide an image pickup apparatus that can obtain required and sufficient image data automatically and extremely efficiently depending on the in-focus state. It is in.
The object of claim 5 of the present invention is to effectively prevent wasteful imaging operation and imaging data recording, and to obtain required imaging data automatically and efficiently according to the subject distance. It is to provide an image pickup apparatus.
The object of claim 6 of the present invention is to effectively prevent wasteful imaging operation and imaging data recording, and to obtain required imaging data automatically and efficiently according to the focus situation. It is to provide an image pickup apparatus.

The object of claim 7 of the present invention is to effectively prevent wasteful imaging operation and imaging data recording, and to obtain required imaging data automatically and efficiently corresponding to the main subject. An imaging apparatus is provided.
The object of claim 8 of the present invention is to effectively prevent wasteful imaging operation and imaging data recording, and to obtain required imaging data automatically and efficiently according to the imaging mode. It is to provide an image pickup apparatus .
An object of claim 9 of the present invention is to provide an imaging apparatus that can record and save a plurality of captured images as a common file or a file associated with each other with a small amount of data.

The object of the tenth aspect of the present invention is to enable the user to recognize that appropriate imaging of the main area is performed as necessary, particularly by display within the imaging screen. Is to provide.
The object of the eleventh aspect of the present invention is to provide an imaging apparatus capable of appropriately warning at least one of the restrictions of at least one of the built-in memory and the removable memory and the communication means. There is .

The object of the twelfth aspect of the present invention is to prevent unnecessary image capturing operation and image data recording, and to obtain sufficient required image data automatically and extremely efficiently depending on the in-focus state. In particular, at the time of the first operation of the release operation unit, the user can determine whether or not the desired focus imaging has been performed, and at the time of an obvious failure such as the subject moving If this is the case, a continuous imaging method capable of re-imaging by canceling the first operation state and performing the first operation again, which can eliminate time-consuming wasteful recording and storage. It is to provide.
An object of the thirteenth aspect of the present invention is to provide a continuous imaging method capable of effectively preventing useless imaging operations and recording of imaging data.
An object of a fourteenth aspect of the present invention is to provide a continuous imaging method capable of appropriately recording imaging data on a recording medium.
The object of the fifteenth aspect of the present invention is to provide a continuous imaging method that makes it possible to obtain required and adequate imaging data automatically and extremely efficiently depending on the in-focus state. There is.
The object of the sixteenth aspect of the present invention is to effectively prevent wasteful imaging operation and imaging data recording, and to obtain required imaging data automatically and efficiently according to the subject distance. It is to provide a continuous imaging method.

The object of the seventeenth aspect of the present invention is to effectively prevent wasteful imaging operation and imaging data recording, and to obtain required imaging data automatically and efficiently according to the focus situation. It is to provide a continuous imaging method.
The object of claim 18 of the present invention is to effectively prevent wasteful imaging operation and imaging data recording, and to obtain required imaging data automatically and efficiently corresponding to the main subject. And providing a continuous imaging method.
The object of the nineteenth aspect of the present invention is to effectively prevent wasteful imaging operation and imaging data recording, and to obtain required imaging data automatically and efficiently according to the imaging mode. It is to provide a continuous imaging method .

In order to achieve the above-described object, an imaging apparatus according to the present invention described in claim 1
An image sensor that has a plurality of pixels that convert light into an electrical signal, converts an optical image into image data using the plurality of pixels, and outputs the image data;
An imaging optical system including a focus adjustment function for forming an object scene image on a light receiving surface of the image sensor and changing a focus position of the imaged object image;
Imaging control means for capturing imaging data via the imaging element at a predetermined focus position while changing a focus position of the imaging optical system;
The imaging control means changes the focus position of the imaging optical system from a part of the pixels in a predetermined imaging region of the imaging element by changing the focus position of the imaging optical system at predetermined intervals within a predetermined movement range. An imaging range determining means for capturing a plurality of one imaging data and determining a focus movement range narrower than the predetermined movement range based on a focus evaluation value obtained from the plurality of first imaging data;
While changing the previous SL in focus movement range focus position of the imaging optical system, by the imaging control means, at least a portion at and said first imaging data of the pixels of the predetermined imaging area of the imaging device Imaging data storage means for capturing and storing a plurality of second imaging data from pixels in a region having a larger number of pixels than
Based on a focus evaluation value obtained from the plurality of second imaging data stored in the imaging data storage unit, at least a part of the second imaging data of the plurality of second imaging data is obtained. A recorded image selection means to select;
Image recording means for recording the second imaging data selected by the recorded image selection means on a recording medium,
In the first operation state of the release operation unit, determination of the focus movement range by the imaging range determination unit and storage of the second imaging data by the imaging data storage unit are both performed.
An imaging device according to the present invention described in claim 2 is the imaging device according to claim 1,
The imaging range determination means determines a range in which the focus evaluation value is equal to or greater than a predetermined threshold as the focus movement range,
The imaging data storage means stores the second imaging data when the focus evaluation value becomes a predetermined threshold value or more.
An imaging apparatus according to a third aspect of the present invention is the imaging apparatus according to the first aspect,
When the second operation is performed in the first operation state of the release operation unit, the second imaging data is recorded on a recording medium by the image recording unit.

An imaging apparatus according to a fourth aspect of the present invention is the imaging apparatus according to the first aspect,
The recorded image selection unit determines one or more focus positions based on the focus evaluation values of the plurality of second imaging data stored in the imaging data storage unit, and a plurality of in the vicinity of the focus position The second imaging data is selected and used for recording on a recording medium by the image recording unit.
An imaging device according to the present invention described in claim 5 is the imaging device according to claim 1 ,
At least one of the imaging range determining means and the recorded image selecting means is
At least one of an imaging range and selected imaging data is determined based on at least distance information obtained from corresponding imaging data.
The imaging device according to the present invention described in claim 6 is the imaging device according to claim 1 ,
At least one of the imaging range determining means and the recorded image selecting means is
At least phase difference information corresponding to the focus shift of the imaging data is obtained, and at least one of an imaging range and selected imaging data is determined based on at least the phase difference information.

An imaging device according to the present invention described in claim 7 is the imaging device according to claim 1 ,
At least one of the imaging range determining means and the recorded image selecting means is
At least the main subject position is analyzed from the imaging data, and at least one of the imaging range and the selected imaging data is determined corresponding to the main subject position information based on at least the analysis result.
An imaging device according to the present invention described in claim 8 is the imaging device according to claim 1 ,
At least one of the imaging range determining means and the recorded image selecting means is
According to the imaging mode, the determination content of at least one of the imaging range and selected imaging data is limited .

Imaging device according to the present invention described in 請 Motomeko 9 is an imaging device according to claim 1,
When there are a plurality of captured images determined by the recorded image selection unit, the recording unit determines one or more main images among the plurality of captured images and a main area in the main image. Then, the compressed data between captured images of the captured data having different focus positions with respect to the main area is stored as one of a file common to the main image and a file associated with the main image.

An imaging apparatus according to a tenth aspect of the present invention is the imaging apparatus according to the first aspect,
It further comprises display means capable of displaying area information relating to at least one of imaging range determination by the imaging range determination means and imaging selection by the recorded image selection means in a form in which the imaging screen is divided into a plurality of areas. Yes.
An imaging device according to the present invention described in claim 11 is the imaging device according to claim 1 ,
An imaging device capable of continuously capturing an object scene image at different focus positions, at least one of a memory built in the imaging device and a memory detachably loaded in the imaging device, and a communication unit With respect to at least one of the restrictions, a means for warning the user is further included.

In order to achieve the above-described object, a continuous imaging method according to the present invention described in claim 12 is provided.
An image sensor that has a plurality of pixels that convert light into an electrical signal, converts an optical image into image data using the plurality of pixels, and outputs the image data;
An imaging optical system including a focus adjustment function for forming an object scene image on a light receiving surface of the image sensor and changing a focus position of the imaged object field image;
Imaging control means for capturing imaging data via the image sensor at a predetermined focus position while changing the focus position of the imaging optical system, and recording means for storing the imaging data captured by the imaging control means in a recording medium ,
In a continuous imaging method for automatically acquiring a plurality of continuous field images in an imaging device comprising:
For the range of movement the focus position of Jo Tokoro of the imaging optical system, while changing at predetermined intervals, by the imaging control means, first from some of the pixels of the pixels in a predetermined imaging area of the imaging device A first imaging data acquisition step for capturing a plurality of one imaging data;
A focus evaluation value is obtained from the plurality of first imaging data captured in the first imaging data acquisition step, and a focus movement range narrower than the predetermined movement range is obtained based on the focus evaluation value. An imaging range determination step to be determined;
Within the focus movement range, the imaging control means changes at least a part of the pixels in the predetermined imaging area of the imaging element and the first imaging data while changing the focus position of the imaging optical system. A second imaging data storage step for capturing and storing a plurality of second imaging data from pixels in a region having a larger number of pixels than,
Based on the focus evaluation value obtained from the plurality of second imaging data stored in the second imaging data storage step, at least a part of the second imaging data is the second imaging data. A recorded image selection step for selecting imaging data;
An image recording step of recording the second imaging data selected in the recording image selection step on a recording medium by the recording means;
In the first operation state of the release operation unit, determination of the focus movement range by the imaging range determination step and storage of the second imaging data by the second imaging data storage step are both performed.
The continuous imaging method according to the present invention described in claim 13 is the continuous imaging method according to claim 12,
The imaging range determination step determines a range in which the focus evaluation value is equal to or greater than a predetermined threshold as the focus movement range,
The second imaging data storage step is characterized in that the second imaging data is stored when the focus evaluation value becomes a predetermined threshold value or more.
The continuous imaging method according to the present invention described in claim 14 is the continuous imaging method of claim 12,
When the second operation is performed in the first operation state of the release operation unit, the second imaging data is recorded on a recording medium by the image recording step.

The continuous imaging method according to the present invention described in claim 15 is the continuous imaging method of claim 12 ,
The recorded image selection step includes a step of determining one or more in-focus positions based on a focus evaluation value of the plurality of second image data stored in the second image data storage step; Selecting a plurality of the second imaging data in the vicinity of the focal position and providing them to recording on a recording medium in the image recording step.
A continuous imaging method according to the present invention described in claim 16 is the continuous imaging method of claim 12 ,
At least one of the imaging range determination step and the recorded image selection step includes
At least one of an imaging range and selected imaging data is determined based on at least distance information obtained from corresponding imaging data.
A continuous imaging method according to the present invention described in claim 17 is the continuous imaging method according to claim 12 ,
At least one of the imaging range determination step and the recorded image selection step includes
At least phase difference information corresponding to the focus shift of the imaging data is obtained, and at least one of an imaging range and selected imaging data is determined based on at least the phase difference information.

The continuous imaging method according to the present invention described in claim 18 is the continuous imaging method according to claim 12 ,
The imaging range determining steps are
Analyzing the main subject position from this imaging data, corresponding to the main subject position information based on at least the analysis result is characterized by determining the focus movement range.
The continuous imaging method according to the present invention described in claim 19 is the continuous imaging method according to claim 12 ,
At least one of the imaging range determination step and the recorded image selection step includes
According to the imaging mode, the determination content of at least one of the imaging range and selected imaging data is limited .

According to the present invention, it is possible to perform a plurality of images sequentially by changing the focus position, and to automatically and efficiently obtain image data that the user may need according to the scene condition. An imaging device and a continuous imaging method can be provided.
That is, according to the imaging device of claim 1 of the present invention,
An image sensor that has a plurality of pixels that convert light into an electrical signal, converts an optical image into image data using the plurality of pixels, and outputs the image data;
An imaging optical system including a focus adjustment function for forming an object scene image on a light receiving surface of the image sensor and changing a focus position of the imaged object image;
Imaging control means for capturing imaging data via the imaging element at a predetermined focus position while changing a focus position of the imaging optical system;
The imaging control means changes the focus position of the imaging optical system from a part of the pixels in a predetermined imaging region of the imaging element by changing the focus position of the imaging optical system at predetermined intervals within a predetermined movement range. An imaging range determining means for capturing a plurality of one imaging data and determining a focus movement range narrower than the predetermined movement range based on a focus evaluation value obtained from the plurality of first imaging data;
While changing the previous SL in focus movement range focus position of the imaging optical system, by the imaging control means, at least a portion at and said first imaging data of the pixels of the predetermined imaging area of the imaging device Imaging data storage means for capturing and storing a plurality of second imaging data from pixels in a region having a larger number of pixels than
Based on a focus evaluation value obtained from the plurality of second imaging data stored in the imaging data storage unit, at least a part of the second imaging data of the plurality of second imaging data is obtained. A recorded image selection means to select;
Image recording means for recording the second imaging data selected by the recorded image selection means on a recording medium,
In the first operation state of the release operation unit, the focus movement range is determined by the imaging range determination unit and the second imaging data is stored by the imaging data storage unit.
It is possible to prevent useless imaging operations and imaging data recording, and to obtain sufficient required imaging data automatically and extremely efficiently depending on the in-focus state. At the time of the operation, the user can determine whether or not the desired focus imaging has been performed. If there is an obvious failure such as the subject moving, the first operation state can be canceled. By redoing the first operation again, imaging can be performed again, and time-consuming useless recording and storage can be avoided.
According to the imaging device of claim 2 of the present invention, in the imaging device of claim 1,
The imaging range determination means determines a range in which the focus evaluation value is equal to or greater than a predetermined threshold as the focus movement range,
The imaging data storage means effectively prevents useless imaging operations and recording of imaging data by storing second imaging data when the focus evaluation value is equal to or greater than a predetermined threshold. It becomes possible.
According to the imaging device of claim 3 of the present invention, in the imaging device of claim 1 or 2,
When the second operation is performed in the first operation state of the release operation unit, the image recording unit records the second imaged data on the recording medium, whereby the imaged data recording medium is recorded. It becomes possible to record properly.

According to the imaging device of claim 4 of the present invention, in the imaging device of claim 1,
The recorded image selection unit determines one or more focus positions based on the focus evaluation values of the plurality of second imaging data stored in the imaging data storage unit, and a plurality of in the vicinity of the focus position By selecting the second imaging data and being used for recording on a recording medium by the image recording unit,
In particular, sufficient and appropriate imaging data required can be obtained automatically and extremely efficiently depending on the in-focus state.
According to the imaging device of claim 5 of the present invention, in the imaging device of claim 1 ,
At least one of the imaging range determining means and the recorded image selecting means is
By determining at least one of the imaging range and the selected imaging data based on at least distance information obtained from the corresponding imaging data,
In particular, useless imaging operations and imaging data recording can be effectively prevented, and required imaging data can be obtained automatically and efficiently according to the subject distance.

According to the imaging device of claim 6 of the present invention, in the imaging device of claim 1 ,
At least one of the imaging range determining means and the recorded image selecting means is
By obtaining phase difference information corresponding to at least the focus shift of the imaging data and determining at least one of the imaging range and the selected imaging data based on at least the phase difference information,
In particular, useless imaging operations and imaging data recording can be effectively prevented, and required imaging data can be obtained automatically and efficiently according to the focus situation.
According to the imaging device of claim 7 of the present invention, in the imaging device of claim 1 ,
At least one of the imaging range determining means and the recorded image selecting means is
At least by analyzing the main subject position from the imaging data, and determining at least one of the imaging range and the selected imaging data corresponding to at least main subject position information based on the analysis result,
In particular, useless imaging operations and imaging data recording can be effectively prevented, and required imaging data can be obtained automatically and efficiently corresponding to the main subject.

According to the imaging device of claim 8 of the present invention, in the imaging device of claim 1 ,
At least one of the imaging range determining means and the recorded image selecting means is
By restricting the determination content of at least one of the imaging range and selected imaging data according to the imaging mode,
In particular, useless imaging operations and imaging data recording can be effectively prevented, and required imaging data can be obtained automatically and efficiently according to the imaging mode.

According to the imaging device of claim 9 of the present invention, in the imaging device of claim 1 ,
When there are a plurality of captured images determined by the recorded image selection unit, the recording unit determines one or more main images among the plurality of captured images and a main area in the main image. Then, by storing the compressed data between the captured images of the captured data having different focus positions with respect to the main area as a file common to the main image and a file associated with the main image,
In particular, a plurality of captured images can be recorded and saved with a small amount of data as a common file or a file associated with each other.

According to the imaging device of claim 10 of the present invention, in the imaging device of claim 1,
By further including display means capable of displaying area information related to at least one of imaging range determination by the imaging range determination means and imaging selection by the recorded image selection means in a form in which the imaging screen is divided into a plurality of areas,
In particular, the display in the imaging screen allows the user to recognize that appropriate imaging of the main area is performed as necessary.
According to the imaging device of claim 11 of the present invention, in the imaging device of claim 1 ,
An imaging device capable of continuously capturing an object scene image at different focus positions, at least one of a memory built in the imaging device and a memory detachably loaded in the imaging device, and a communication unit Further including means for alerting the user regarding at least one of the constraints of
In particular, it is possible to appropriately warn of the restriction of at least one of the built-in memory and the removable memory and the communication means.

And according to the continuous imaging method of claim 12 of the present invention,
An image sensor that has a plurality of pixels that convert light into an electrical signal, converts an optical image into image data using the plurality of pixels, and outputs the image data;
An imaging optical system including a focus adjustment function for forming an object scene image on a light receiving surface of the image sensor and changing a focus position of the imaged object field image;
Imaging control means for capturing imaging data via the image sensor at a predetermined focus position while changing the focus position of the imaging optical system, and recording means for storing the imaging data captured by the imaging control means in a recording medium ,
In a continuous imaging method for automatically acquiring a plurality of continuous field images in an imaging device comprising:
For the range of movement the focus position of Jo Tokoro of the imaging optical system, while changing at predetermined intervals, by the imaging control means, first from some of the pixels of the pixels in a predetermined imaging area of the imaging device A first imaging data acquisition step for capturing a plurality of one imaging data;
A focus evaluation value is obtained from the plurality of first imaging data captured in the first imaging data acquisition step, and a focus movement range narrower than the predetermined movement range is obtained based on the focus evaluation value. An imaging range determination step to be determined;
Within the focus movement range, the imaging control means changes at least a part of the pixels in the predetermined imaging area of the imaging element and the first imaging data while changing the focus position of the imaging optical system. A second imaging data storage step for capturing and storing a plurality of second imaging data from pixels in a region having a larger number of pixels than,
Based on the focus evaluation value obtained from the plurality of second imaging data stored in the second imaging data storage step, at least a part of the second imaging data is the second imaging data. A recorded image selection step for selecting imaging data;
An image recording step of recording the second imaging data selected in the recording image selection step on a recording medium by the recording means;
In the first operation state of the release operation unit, by performing both determination of the focus movement range by the imaging range determination step and storage of the second imaging data by the second imaging data storage step,
It is possible to prevent useless imaging operations and imaging data recording, and to obtain sufficient required imaging data automatically and extremely efficiently depending on the in-focus state. At the time of the operation, the user can determine whether or not the desired focus imaging has been performed. If there is an obvious failure such as the subject moving, the first operation state can be canceled. By redoing the first operation again, imaging can be performed again, and time-consuming useless recording and storage can be avoided.
According to the continuous imaging method of claim 13 of the present invention, in the continuous imaging method of claim 12,
The imaging range determination step determines a range in which the focus evaluation value is equal to or greater than a predetermined threshold as the focus movement range,
The imaging data storage step stores the second imaging data when the focus evaluation value is equal to or greater than a predetermined threshold,
It is possible to effectively prevent useless imaging operations and recording of imaging data.
According to the continuous imaging method of claim 14 of the present invention, in the continuous imaging method of claim 12 or 13,
When the second operation is performed in the first operation state of the release operation unit, by recording the second imaging data on the recording medium by the image recording step,
It is possible to appropriately record the second imaging data on the recording medium.

According to the continuous imaging method of claim 15 of the present invention, in the continuous imaging method of claim 12 ,
The recorded image selection step includes a step of determining one or more in-focus positions based on a focus evaluation value of the plurality of second image data stored in the second image data storage step; Selecting a plurality of the second imaging data in the vicinity of the focal position, and providing for recording on a recording medium in the image recording step,
In particular, sufficient and appropriate imaging data required can be obtained automatically and extremely efficiently depending on the in-focus state.
According to the continuous imaging method of claim 16 of the present invention, in the continuous imaging of claim 12 ,
At least one of the imaging range determination step and the recorded image selection step includes
By determining at least one of the imaging range and the selected imaging data based on at least distance information obtained from the corresponding imaging data,
In particular, useless imaging operations and imaging data recording can be effectively prevented, and required imaging data can be obtained automatically and efficiently according to the subject distance.

According to the continuous imaging method of claim 17 of the present invention, in the continuous imaging method of claim 12 ,
At least one of the imaging range determination step and the recorded image selection step includes
By obtaining phase difference information corresponding to at least the focus shift of the imaging data and determining at least one of the imaging range and the selected imaging data based on at least the phase difference information,
In particular, useless imaging operations and imaging data recording can be effectively prevented, and required imaging data can be obtained automatically and efficiently according to the focus situation.
According to the continuous imaging method of claim 18 of the present invention, in the continuous imaging method of claim 12 ,
The imaging range determining steps are
Analyzing the main subject position from this imaging data, corresponding to the main subject position information based on at least the result of the analysis, by determining the focus movement range,
In particular, useless imaging operations and imaging data recording can be effectively prevented, and required imaging data can be obtained automatically and efficiently corresponding to the main subject.

According to the continuous imaging method of claim 19 of the present invention, in the continuous imaging method of claim 12 ,
At least one of the imaging range determination step and the recorded image selection step includes
By restricting the determination content of at least one of the imaging range and selected imaging data according to the imaging mode,
In particular, useless imaging operations and imaging data recording can be effectively prevented, and required imaging data can be obtained automatically and efficiently according to the imaging mode .

Hereinafter, based on an embodiment of the present invention, an imaging device and a continuous imaging method of the present invention will be described in detail with reference to the drawings.
1 and 2 show the configuration of a digital camera as an imaging apparatus according to an embodiment of the present invention. FIG. 1 shows a system configuration of the digital camera, and FIG. 2 shows a main process for performing control at the time of image recording in the digital camera of FIG.
The digital camera shown in FIG. 1 includes an imaging lens 1, an aperture-shutter unit 2, an imaging device 3, a CDS (correlated double sampling) -AD (A / D (analog-digital) conversion) unit 4, a DSP (digital signal processing). ) Unit 5, mechanical driver unit 6, image sensor drive circuit 7, CPU (central processing unit) 8, memory unit 9, communication driver 10, memory card 11, display unit 12, operation unit 13, AF (automatic focus control) A processing unit 14, a strobe light emitting unit 15, a strobe power supply unit 16 and a strobe light receiving unit 17 are provided.

In the configuration of FIG. 1, an imaging lens 1 as an imaging optical system is an imaging lens system using, for example, a zoom lens, and forms an object scene image as an optical image. The aperture-shutter unit 2 includes a mechanical aperture and a shutter. The imaging device 3 is configured by using a solid-state imaging device such as a CMOS (complementary metal oxide semiconductor) imaging device or a CCD (charge-coupled device) imaging device, and is imaged by the imaging lens 1. The field image is converted into an electronic image signal.
The CDS-AD unit 4 performs correlated double sampling on the image signal obtained from the image sensor 3 and further A / D converts it into digital data. The DSP unit 5 is a digital signal processing unit that processes an A / D-converted digital signal. For example, luminance R, color difference U and V are obtained from RGB data of R (red), G (green), and B (blue). Digital signal processing such as conversion to YUV data of the image data, or compression of the YUV data by, for example, a JPEG (Joint Photographic Experts Group) method.
The mechanical driver unit 6 is configured as a drive control circuit that drives the mechanical operation unit, and includes a lens drive unit that drives the imaging lens 1 during focusing and zooming, a shutter drive unit that performs a shutter opening / closing operation of the aperture-shutter unit 2, and the like. Contains. The lens driving unit also includes a lens position detecting unit that detects a lens position in order to accurately drive and control the lens.

The image pickup device driving circuit 7 operates the image pickup device 3 and takes out the object scene image formed on the light receiving surface of the image pickup device 3 by the image pickup lens 1 as an image signal. The CPU (central processing unit) 8 includes the DSP unit 5, the mechanical driver unit 6, the image sensor driving circuit 7, the memory unit 9, the communication driver 10, the memory card 11, the operation unit 13, the strobe light emitting unit 15, and the strobe power supply. Signals are exchanged between the unit 16 and the strobe light receiving unit 17 and the like, thereby controlling the entire digital camera system.
The memory unit 9 is a memory that temporarily stores captured image data and image data read from a file, for example, and is used as a work memory in association with the operation of the DSP unit 5 and the CPU 8. The communication driver 10 is a communication driving unit for causing communication with the outside of the digital camera. The memory card 11 is a memory card that is detachably attached to the digital camera and records image data obtained by an image sensor or the like. The display unit 12 includes a display device such as an LCD (liquid crystal display), and a display controller that converts a video output signal from the DSP unit 5 into a signal that can be displayed on a display device using an LCD or the like. The video output signal from the unit 5 is converted into a signal that can be displayed on the display, and the image is displayed. The operation unit 13 includes various switches that can be operated by the user, and inputs information corresponding to each operation state. The AF processing unit 14 performs AF processing by, for example, a triangulation method.

The strobe light emitting unit 15 can control the start / stop of strobe light emission from the CPU 8. The strobe power supply unit 16 is a power supply for strobe emission including, for example, a main capacitor for strobe emission, and the charge voltage can be detected from the CPU 8. The strobe light receiving unit 17 includes a light receiving optical system and an optical sensor. Upon receiving a light reception start instruction from the CPU 8, the strobe light emitting unit 15 starts light emission, and the subsequent light reception integration amount is preset by the CPU 8. When the set value is reached, a flash stop signal is given to the flash unit 15 to stop the flash.
Next, the operation of each unit in the digital camera according to the first embodiment of the present invention configured as described above will be described with reference to the flowchart shown in FIG.
FIG. 2 shows main processing for performing control at the time of imaging and recording in the digital camera of FIG. Although not shown clearly, monitoring processing described later and reading of the state of the operation unit 13 are processed by parallel processing performed in parallel with the main processing while the main processing is being performed. . This parallel processing is started and processed by, for example, a periodic timer interrupt regardless of the state of the main processing. Here, the case where a still image is recorded will be described in detail as an example.

In the imaging / recording mode, when the power of the camera is turned on, although not shown, initialization of hardware inside the camera, creation of file information in the memory card 11 in the memory unit 9, etc. Perform initial processing. Thereafter, the main process of imaging recording in FIG. 2 is started.
In the main process, the monitoring state is first checked (step S1), and if the monitoring is stopped, the monitoring start process is performed (step S2). Further, depending on whether or not an imaging mode that requires strobe light emission is selected and whether or not the main capacitor of the strobe power supply unit 16 is sufficiently charged, the main capacitor of the strobe power supply unit 16 needs to be charged. Whether or not there is an image pickup mode that requires strobe light emission is selected, the main capacitor of the strobe power supply unit 16 is not sufficiently charged, and the strobe power supply unit 16 needs to be charged. If so, the charging process is started (step S4). In step S3, when an imaging mode that requires strobe light emission is not selected, or when an imaging mode that requires strobe light emission is selected and the main capacitor of the strobe power supply unit 16 is sufficiently charged. Does not need to charge the strobe power supply unit 16, so does nothing (proceeds to the next step S5).

In the monitoring start procedure in step S2, the imaging element driving circuit 7 starts driving the imaging element 3, and starts a monitoring process as a parallel process that is processed in parallel with the main process. Even when the main process is entered for the first time, the monitoring start process of step S2 described above is executed.
The monitoring processing in the parallel processing described above is to execute tracking processing of AE (automatic exposure) and AWB (automatic white balance) when displaying a through image as an electronic viewfinder display of the camera. By doing so, the through image displayed on the display unit 12 of the camera can always be kept at appropriate brightness and natural color.

  Specifically, the CPU 8 acquires evaluation values for the AE and the AWB in the DSP unit 5 from the image data as the imaging data obtained from the image sensor 3 via the CDS-AD unit 4, and the value becomes a predetermined value. As described above, the electronic shutter speed or aperture is set in the image sensor driving circuit 7. The electronic shutter of the image sensor 3 has limits of the longest seconds and shortest times that can be set, and if there is underexposure or overexposure exceeding the limit depending on the luminance of the subject, the CPU 8 determines the aperture-shutter unit. 2 aperture aperture diameter, that is, the F value, or the amplification factor of the imaging signal in the imaging device 3 portion is changed. Further, feedback control for adjusting color parameters of image processing in the DSP unit 5 is also performed.

The above-described monitoring processing and parallel processing such as the above-described reading processing of the state of the operation unit 13 are executed by, for example, a 20 ms periodic timer interrupt.
If it is determined in step S1 in the main process that the monitoring state is on, if it is determined in step S3 that charging is not required, and if charging is started in step S4, the switch of the operation unit 13 An operation determination process for determining the operation state is performed (step S5).
In the operation determination process in step S5 of the main process, the operation information such as a switch input by the above-described periodic timer interruption process every 20 ms is determined, and the process proceeds to a process corresponding to the operated switch.
If valid operation information is not detected in step S5, the process returns to step S1 without doing anything, and the loop returning to the operation determination process in step S5 is repeated.
As described above, in this example, a still image is described, and the main processing operation corresponding to the operation information in FIG. 2 will be described with reference to FIG.

In the configuration shown in FIG. 1, the operation unit 13 includes a shutter button for performing a shutter release operation.
When a still image is captured, monitoring is stopped (step S7) and the AE process is performed (step S7) when the shutter button is pressed halfway, that is, when the first switch that is activated when the first stage is pressed is turned on. . In the AE process of step S7, the imaging data is evaluated by the DSP unit 5, the exposure time value of the imaging device 3 and the amplification factor of the imaging device 3 are determined and set in the imaging device driving circuit 7 corresponding to the time of shooting exposure. .
Next, AF processing is performed (step S8). Here, a case where, for example, a general hill climbing method is used for the AF operation will be described.
The CPU 8 and the DSP unit 5 obtain the imaging data as the field image data obtained by the imaging element 3 while moving the focus of the imaging lens 1 by the mechanical driver unit 6, and sharpen the imaging data as the focus evaluation value. AF operation is performed by a hill-climbing method in which the degree is detected, the imaging lens 1 is moved to a focus position where the detected amount reaches a peak and the lens is stopped (step S9), and the process returns to step S1.

Then, when the first switch is turned on, the second switch is turned on when the shutter button is fully pressed, that is, pressed down to the second stage. When the second switch is turned on and it is determined in the operation determination process in step S5, monitoring is stopped (step S10), and a still image recording process is performed (step S11). In the still image recording process in step S11, the captured image data is taken into the memory unit 9, and the DSP unit 5 performs necessary video signal processing such as conversion to luminance and color difference signals, or processing such as JPEG compression processing. The image data subjected to such processing is written to the memory card 11 as a file. Thereafter, the process returns to step S1.
Note that when other operations are performed in the operation unit 13 and detected in step S5, processing corresponding to the operations is appropriately performed, and the process returns to step S1.
Here, the characteristics of the digital camera according to the embodiment of the present invention having the above-described configuration will be described in detail.
In this case, an area for calculating a value for evaluating the degree of focus, for example, a focus evaluation value such as a contrast value or sharpness, is divided into a plurality of screens as shown in FIG. Arranged in a shape. During the AF operation, the first imaging data is acquired while moving the focus position by moving at least a part of the imaging lens 1, and the focus evaluation values of all the divided areas are acquired, and the focus evaluation is highest in each area. The focus position of the lens whose value is large is stored.

For example, as shown in FIG. 3, it is assumed that a person's face portion exists in the object scene corresponding to the area b, and a foreground object located in front of the person corresponding to the area c exists. And there is a building from the front of the person to the back, area d corresponds to the rear part of this building, area e corresponds to the front part of this building, and the rear part of the building corresponding to area d is a person The front part of the building corresponding to the area e is located in front of the person.
A graph of the focus evaluation value while moving the imaging lens 1 in such a positional relationship is as shown in FIG. 4, for example. That is, for the focus position, the focus position fp point C corresponding to the area c is the closest position, the next is the focus position fp point E corresponding to the area e, and the next is the focus position fp point B corresponding to the area b. The focus position fp point D corresponding to the area d is the farthest position. As for the peak value of the focus evaluation value, the focus position fp point C corresponding to the area c is the highest, the focus position fp point B corresponding to the area b is next, and the focus position fp point E corresponding to the area e is. Next, the focus position fp point D corresponding to the area d shows the lowest peak value.

Here, it is assumed that a threshold value of the peak value of the focus evaluation value is determined in advance, and for example, a peak value equal to or higher than the threshold value A shown in FIG. As a result, the CPU 8 and the DSP unit 5 assume that the main subject is at the focus position fp point B and the focus position fp point C as the imaging range determination means, and include the focus position fp point B and the focus position fp point C before and after that. The near focus position range is determined as the imaging range, and the CPU 8 together with the DSP unit 5 as the imaging selection means changes the focus position of the imaging lens 1 for the determined focus position of the imaging range while performing the second imaging. Data is sequentially acquired, and the captured second imaging data is selectively recorded and stored.
In this case, the imaging range in the vicinity before and after the focus position fp point B and the focus position fp point C may be a predetermined range of ± Δfp ((focus position−Δfp) to (focus position + Δfp)). Alternatively, the focus evaluation value may be the entire focus range having a predetermined threshold value A or more.
Furthermore, the imaging range may be from the fp value (focus position) −Δfp of the focus position fp point B that is equal to or greater than the threshold value A to the closest focus position fp. Further, the focus determination of the main subject may be determined based on whether the inclination component of the focus evaluation value is not less than a predetermined value, instead of the threshold value A.

Further, this digital camera is provided with an AF processing unit 14 that performs AF processing by, for example, triangulation method, and is used for rough adjustment of AF processing, and is combined with the above-described AF processing by focusing evaluation value. You may do it.
In the following, the operation of sequentially capturing the second imaging data while changing the focus position of the imaging lens 1 will be referred to as “defocus imaging” for convenience.
In addition to the first embodiment of the present invention that employs the method of determining the imaging range for defocus imaging based on the focus evaluation value as described above, the camera is illustrated in FIG. A distance measurement sensor such as a triangulation method such as the AF processing unit 14 is provided, and distance measurement data for a plurality of locations in the screen is obtained in substantially the same manner as the matrix-like screen division shown in FIG. It is also possible to determine the focus position fp point B and the focus position fp point C of the lens based on the focal length of the lens, and to determine the imaging range based on that. A digital camera as an imaging apparatus according to the second embodiment of the present invention employs such a method for determining an imaging range for defocus imaging.

The principle of distance measurement by the triangulation method and the outline of determination of the imaging range for defocus imaging based thereon will be described with reference to FIG.
As shown in FIG. 5A, the subject images of the same subject Q are formed on the left sensor SA1 and the right sensor SA2, respectively, each composed of a light receiving sensor array via the left and right optical systems OL1 and OL2. As shown in FIG. 5B, a deviation D of the imaging position between the subject image QJ1 in the left sensor SA1 and the subject image QJ2 in the right sensor SA2 is obtained, and the subject distance is obtained by calculation.
Ranging sensors that measure a plurality of areas using this triangulation method have been commercialized. If such a distance measuring sensor is used, the focus position of the subject can be determined without actually moving the imaging lens.
The distance measurement data obtained by such a triangulation type distance measurement sensor is a focus corresponding to the focal length of the imaging lens with respect to 1 / L (reciprocal of distance) stored in the apparatus as shown in FIG. Based on the data of the position fp characteristic, the focus position fp value can be converted. Even when the focus position fp point B and the focus position fp point C are used, the defocus imaging range can be determined as in the case of the focus evaluation value described above. In this case as well, a range from (fp point C−Δfp) to infinity may be set as an imaging range for defocus imaging based on the closest fp point C among the focus positions based on the detected distance.

7, 8, and 9 schematically illustrate the principle of focus detection by the phase difference method generally used in single-lens reflex (single-lens reflex) cameras and the determination of the imaging range for defocus imaging based on the principle. The description will be given with reference. A digital camera as an imaging apparatus according to the third embodiment of the present invention employs such a method for determining an imaging range for defocus imaging.
As shown in FIG. 7A, at the time of focusing, two light fluxes passing through the left peripheral portion and the right peripheral portion of the imaging lens (represented as a main lens) TL are imaged on the imaging position equivalent plane TS. Then, it branches again behind it, enters the separator lenses SL1 and SL2 through the condenser lens CL, and these separator lenses SL1 and SL2 respectively make sensors SB1 and SB2 comprising line sensors using CCDs or CMOSs for AF. Are imaged as images QK1 and QK2.
That is, at the time of focusing, as shown in FIG. 7 (a), two images QK1 and QK2 are formed at regular intervals and are detected at the reference positions of the sensors by the sensors SB1 and SB2, respectively. When the so-called front focus is in front of the subject, as shown in FIG. 7 (b), two images are present with a narrower interval than that in FIG. 7 (a). QK1 and QK2 are imaged and detected by the sensors SB1 and SB2, respectively, at positions that are biased toward the other sensor.

Then, when the so-called rear focus is focused behind the target subject, as shown in FIG. 7 (c), two images are present with a wider interval than in the in-focus state of FIG. 7 (a). QK1 and QK2 are imaged and detected by the sensors SB1 and SB2, respectively, at positions biased away from the other sensor. Therefore, it is possible to detect the direction and amount of defocusing from the difference between the two images QK1 and QK2 detected by the sensors SB1 and SB2 and the image positions in FIG.
The focus position of each subject can also be determined by providing a plurality of such focus detection systems using the phase difference method in the same manner as in the case of the matrix screen division in FIG. Therefore, as shown in FIG. 8, while moving the focus, the difference between the image detection data strings of the sensors SB1 and SB2 is taken, and the focused sensor position as shown in FIG. As shown in FIG. 8B and FIG. 8C, the image detection data strings of the sensors SB1 and SB2 are relatively shifted to obtain the most consistent shift amount K. Since the shift amount K corresponds to the image interval between the images QK1 and QK2, if the shift amount K is zero in the difference from the image interval at the time of focusing, the position can be referred to as the in-focus fp point.
When this phase difference method is realized in an imaging apparatus such as a digital camera, an imaging element for image generation configured using a CMOS, a CCD, or the like is provided on the imaging position equivalent plane, that is, the imaging plane. Therefore, the AF light beam is branched and deflected from the imaging light beam by using a deflecting unit such as a reflection mirror and is incident on the condenser lens CL.

FIG. 9 shows an example of the relationship between the focus position fp and the shift amount, that is, the difference value corresponding to the image interval, K.
In FIG. 3, when the image interval difference value K between the area b and the area c changes from plus to minus, the point that intersects with the base line, that is, the point at which the image interval difference value K becomes zero, is the focus of the area b and the area c, respectively. This is the focus position fp point. Thus, the focus position fp point B and the focus position fp point C are detected, and the defocus imaging range can be determined based on these positions as in the case of the focus evaluation value described above. In such a case, instead of determining the defocus imaging range strictly on the basis of the focus position fp point B and the focus position fp point C, the closest focus position fp determined based on the image interval difference value K (that is, the focus position fp) is determined. A range from the position −Δfp to infinity, which is closer to the position fp point C) by a predetermined amount Δfp, may be determined as an imaging range for defocus imaging.
In the above, an example in which an imaging range for defocus imaging is basically determined based only on information related to focus has been described. However, an imaging range for defocus imaging is related to focus. In addition to the information to be performed, it is also possible to determine the imaging range for defocus imaging using subject information obtained from the imaging signal being monitored. A digital camera as an imaging apparatus according to the fourth embodiment of the present invention employs such a method for determining an imaging range for defocus imaging.

For example, the face of the area b in FIG. 3 is detected in advance from the imaging signal being monitored, and the focus position fp point B is based on the focus position fp point B at which the focus evaluation value of the area b in FIG. 4 peaks. ± Δfp can also be determined as an imaging range for defocus imaging. As described above, as a method for detecting a face from image data of an object scene, for example, a known method disclosed in Patent Document 3 (Japanese Patent Laid-Open No. 2003-44853) can be used.
Further, a focus is sandwiched between the peaks of the focus evaluation values of the area d and the area e including the rear end portion and the front end portion of the rectangular frame-like building having a depth in FIG. 3 obtained by edge detection or the like. A range from the position fp point D to the focus position fp point E may be set as the defocus imaging range.
In this way, not only depth information but also an imaging range for defocus imaging can be determined more accurately and effectively for a subject that the user desires to shoot, and appropriate defocus imaging can be performed. it can.
In the above, several embodiments have been specifically described with respect to a method for determining a focus position corresponding to an imaging range in which a subject is defocused. However, each of these embodiments may be used independently. However, they may be used in combination as appropriate.

Next, FIG. 10 (FIG. 10 (a) and FIG. 10 (b)) regarding the selection and recording of an image captured by defocus imaging in the digital camera according to the first to fourth embodiments of the present invention. The description will be given with reference.
FIG. 10A is a flowchart showing processing when the first switch that is activated when the shutter button is half-pressed, that is, when the first step of the two-step shutter button is pressed, is turned on. 10 (b) is a process when the second switch that is activated when the shutter button is fully pressed, that is, when the first switch is pressed down to the second stage in the state where the first switch is on, is turned on. Is shown in a flowchart.
FIG. 10A shows a process performed in place of Step S6 to Step S9 in FIG. 2 when it is determined that the first switch is turned on. If it is determined that the first switch is turned on, the monitoring operation is stopped (corresponding to step S6 in step S21 to FIG. 2), and AE processing is performed (corresponding to step S22 to step S7 in FIG. 2). Next, the operation unit 13 determines whether or not a defocus imaging mode in which continuous imaging is performed by defocus imaging is set (step S23). If the defocus imaging mode is not selected, AF operation processing is performed. (Step S24), the process ends, and the process returns to Step S1 in FIG. In this case, the AF operation process in step S24 substantially includes both the AF process in step S8 and the focus drive process in step S9 in FIG.

If it is determined in step S23 that the mode is the defocus imaging mode, in addition to the AF process corresponding to step S8 in FIG. 2, the imaging range determination process for defocus imaging (see the timing chart in FIG. 11) is performed (step S23). S25), the process ends, and the process returns to step S1 in FIG. At this time, if the amount of data to be imaged is larger than the remaining amount of internal memory, it is desirable to issue a warning that imaging is not possible.
FIG. 10B shows processing performed instead of steps S10 to S11 in FIG. 2 when it is determined that the first switch is on and the second switch is on. When it is determined that the second switch is turned on, the monitoring operation is stopped (corresponding to step S10 in step S31 to FIG. 2), and a defocus imaging mode in which continuous imaging is performed by defocus imaging is performed by the operation unit 13. It is determined whether or not the selection is set (step S32). If it is determined in step S32 that the mode is not the defocus imaging mode, still image recording corresponding to step S11 in FIG. 2 is performed (step S33), and the process ends, and the process returns to step S1 in FIG.
If it is determined in step S32 that the mode is the defocus imaging mode, defocus imaging is performed for the imaging range that has already been determined, and a required image to be recorded and saved is selected from the captured images (timing chart in FIG. 11). (See), the selected image is recorded and saved (step S34), the process is terminated, and the process returns to step S1 in FIG.

That is, when the first switch is turned on, the AF operation as described above is performed, and the imaging range of the defocus imaging including, for example, the focus position fp point B and the focus position fp point C of the subject is determined. When the second switch is turned on, defocus imaging is performed for the imaging range determined at that time, and imaging data is taken into the memory. That is, when the second switch is turned on, the DSP unit 5 (see FIG. 1) selects data to be recorded and saved by the image selection function in the defocus imaging from the image data sequentially captured by the defocus imaging. To do. In other words, the imaging data in the memory can be selected again using the defocus recording function by selecting only the imaging data necessary for storage by the determination method used for determining the imaging range, or by using a method with more strict criteria. save.
In the above description, the imaging range of the defocus imaging is determined when the first switch is turned on, but the imaging data in the through display by the monitoring operation is compared with the full image size recorded and stored. In general, images are thinned out. This is because during the through display, the main purpose is to display on a low-resolution display device with a low resolution, and thus the data amount is simply reduced and processed. Also, the calculated evaluation value is often simplified by thinning out pixels for high-speed processing. For this reason, the determination is made based on the threshold value in the imaging range of the defocus imaging. However, the full image size that has been captured is re-selected again with the same threshold value, a stricter threshold value, or a more accurate evaluation value calculation method. You may do it.

Further, when the first switch is on, it is better to complete the AF operation in as short a time as possible, so that it is a general technique to move the focus position roughly. Based on the thinned focus position movement, the imaging range is roughly determined by determining the imaging range, and when the second switch is turned on, the captured image data is sequentially moved with a finer movement than the moving resolution of the focus position. Thus, image data to be recorded and saved may be selected from these data.
A specific example of such a method will be described with reference to the timing charts of FIGS.
As shown in FIG. 11, even when the first switch is on, imaging is performed for each vertical synchronization signal VD, and first imaging data used as preliminary imaging data is captured. At this time, the focus position is simultaneously driven by 3 steps within 1 VD (one vertical synchronization period corresponding to one vertical synchronization signal VD to the next vertical synchronization signal VD). The exposure data in the vertical synchronization period corresponding to each vertical synchronization signal VD is transferred to the DSP unit 5 by the next vertical synchronization signal VD, but the evaluation value is calculated simultaneously. Here, for example, a method using a focus evaluation value is described as an example, but other methods, for example, a phase difference method using a K value, can be implemented in the same way. Here, for convenience, the number of each vertical synchronization signal VD is represented as the focus position at the center during the vertical synchronization period as a representative position of the focus position.

When determining the imaging range, the CPU 8 and the DSP unit 5 detect a decrease in the evaluation value at the VD number 17 and determine that the focus position fp point 11 is a peak equal to or greater than the threshold. As a result, the CPU 8 and the DSP unit 5 as the imaging range determination means, if Δfp is 2, the focus position fp point 9, the focus position fp point 10, the focus position fp point 11, and the focus position fp point 12. And the focus position fp point 13 is determined.
When the second switch is turned on in this state, as shown in FIG. 12, the focus is moved step by step finer than in the case of FIG. 11 described above, and the focus position fp point 9, the focus position fp point 10, the focus is moved. The second image data is sequentially acquired at the position fp point 11, the focus position fp point 12, and the focus position fp point 13, and the CPU 8 and the DSP unit 5 select which focus position fp point as the imaging selection unit or the recorded image selection unit. Decide whether to use for recording.
In this example, since the focus position fp point 10 has the highest evaluation value, the CPU 8 and the DSP unit 5 as the imaging selection means have three focus positions fp point 9, focus position fp point 10, and focus position fp point 11. Record and save data. Note that as the imaging selection in the defocus imaging, all the captured data may be simply recorded and saved.

As described above, the imaging selection method in the defocus imaging is the same as that in determining the imaging range in the defocus imaging, and all data captured in the determined imaging range is selected and recorded and saved. Alternatively, it may be possible to select and appropriately select a desired data out of all data captured in the determined imaging range using a stricter criterion. Further, when determining the imaging range in the defocus imaging, the imaging range is determined based on the distance measurement information, and regarding the imaging selection of the image captured in this imaging range, it is selected using the focus evaluation value and is used for recording and saving. In this way, different methods may be used for determining the imaging range for defocus imaging and for imaging selection.
In the above description, the method of performing sequential imaging and imaging selection in defocus imaging when the second switch is turned on has been described. However, in this method, a plurality of images and images after the second switch is turned on are described. Processing takes a lot of time. On the other hand, as shown in FIG. 13 (FIGS. 13A and 13B), when the first switch is turned on, the imaging range is determined and the defocus imaging is sequentially performed. When the second switch is turned on, the second imaging data that has been captured in the memory by sequential imaging may be recorded. This is adopted in the fifth embodiment of the digital camera as the imaging apparatus according to the present invention. In this case, it is assumed that the selection of the second imaging data sequentially captured by the defocus imaging and captured in the memory is performed at the end of the process by turning on the first switch, for example.

FIG. 13A is a flowchart showing a process when the first switch that is operated when the shutter button is half-pressed, that is, when the first stage is pressed, and FIG. The flowchart shows the processing when the second switch that is activated when the shutter button is fully pressed, that is, when the second stage is pressed down, with the first switch turned on, is shown in the flowchart.
FIG. 13A shows a process performed when it is determined that the first switch is turned on, instead of the process shown in steps S6 to S9 in FIG. 10A or FIG. If it is determined that the first switch is turned on, the monitoring operation is stopped (step S41), and AE processing is performed (step S42). Next, the operation unit 13 determines whether or not a defocus imaging mode in which continuous imaging is performed by defocus imaging is selected (step S43). If the defocus imaging mode is not selected, AF operation processing is performed. (Step S44), the process ends, and the process returns to Step S1 in FIG. In this case, the AF operation process in step S44 substantially includes both the AF process in step S8 and the focus drive process in step S9 in FIG.

If it is determined in step S43 that the camera is in the defocus imaging mode, in addition to the AF processing corresponding to step S8 in FIG. 2, the imaging range determination processing for defocus imaging, sequential imaging processing, and second imaging that is sequentially captured Each data selection process (see the timing chart in FIG. 14) is performed (step S45), the process is terminated, and the process returns to step S1 in FIG. At this time, if the amount of data to be imaged is larger than the remaining amount of internal memory, it is desirable to issue a warning that imaging is not possible.
FIG. 13B shows a process performed in place of steps S10 to S11 in FIG. 2 when it is determined that the first switch is on and the second switch is on. If it is determined that the second switch is turned on, the monitoring operation is stopped (step S51), and it is determined whether or not the defocus imaging mode for performing continuous imaging by defocus imaging is selected and set by the operation unit 13. (Step S52). If it is determined in step S52 that the mode is not the defocus imaging mode, still image recording corresponding to step S11 in FIG. 2 is performed (step S53), and the process ends, and the process returns to step S1 in FIG.

If it is determined in step S52 that the mode is the defocus imaging mode, the imaging data already selected from the imaging data sequentially captured by the defocus imaging is recorded and saved (step S54), and the processing is terminated. Return to step S1.
In FIG. 13 described above, the selection of the second imaging data sequentially captured by the defocus imaging and captured in the memory has been described as being performed at the end of the process when the first switch is turned on, for example. You may make it perform selection of 2nd imaging data in the process by ON operation of a 2nd switch. As described above, when selecting imaging data in the process by turning on the second switch, in addition to the AF process corresponding to step S8 in FIG. 2 instead of step S45 in FIG. The imaging range determination process and the sequential imaging process of the focus imaging are performed, and the selection process of the imaging data captured sequentially is not performed. Then, instead of step S54 in FIG. 13B, the selection processing of the second imaging data sequentially captured by the defocus imaging is performed, and the imaging data already selected from the second imaging data sequentially captured The process of recording and saving is performed.

During the AF operation in step S45 of FIG. 13A described above, the focus position fp is used to determine the imaging range in the defocus imaging of the DPS unit 5 while temporarily storing the first imaging data in the memory unit 9 once. A point B, a focus position fp point C, and the like are detected. Then, only the imaging data at the necessary focus position fp point B, the focus position fp point C, and the focus position deviation Δfp in the vicinity thereof are left in the memory unit 9. Specifically, when the focus position fp point B is detected from the focus evaluation value, the focus position deviation that includes the imaging data from the point before the focus position deviation Δfp and the focus position fp point B and is imaged thereafter. Imaging data up to a position after Δfp is left in the memory unit 9. The focus position fp point C is the same as the focus position fp point B.
In this case, as a memory configuration of the memory unit 9, it is desirable to use a configuration including a primary memory and a secondary memory, which will be described below. Such an example will be described with reference to the timing chart of FIG.

An AF operation is performed while moving the focus position. During the AF operation, an evaluation value for each vertical synchronization period corresponding to the period of the vertical synchronization signal VD is calculated. The CPU 8 and the DSP unit 5 foresee the focus position fp point and start imaging. In FIG. 14, the evaluation value exceeds the threshold in the vertical synchronization period corresponding to the vertical synchronization signal VD of the VD number n, and imaging starts from the vertical synchronization signal VD of the VD number n + 1. Captured in memory. The primary memory is composed of, for example, seven blocks, and has a capacity capable of writing up to seven pieces of imaging data in a circulating manner. That is, the primary memory is controlled by a circular writing method in which, after writing up to the seventh block, the block 1 is overwritten sequentially.
When it is determined that the data 9 corresponding to the VD number n + 4 has the focus position fp point, and the VD number n + 6 includes the focus position fp point and includes up to Δfp, the imaging range determination unit including the CPU 8 and the DSP unit 5 determines Then, the imaging data at the focus position fp point ± Δfp (in FIG. 14, the focus positions 7 to 11 in the figure) accumulated in the primary memory is moved to the secondary memory. If a valid focus position fp point cannot be detected in the primary memory, the cyclic overwriting to the primary memory is continued. Further, if the evaluation value becomes smaller than the threshold value, the imaging itself may be stopped.

Further, although the focus moving portion shown by hatching in FIG. 14 is always driven step by step, if the evaluation value is smaller than the threshold value, the focus moving speed is increased to shorten the AF time. It can also be done. In addition, although the shaded portion of the primary memory is provided, imaging to the primary memory corresponding to this period may be performed.
After the imaging data is accumulated and the AF operation is performed as described above, the imaging data in the secondary memory is selected by the CPU 8 and the DSP unit 5 as the imaging selection means or the recorded image selection means.
The data picked up and selected as described above is recorded and saved by the DSP unit 5 in response to the ON operation of the second switch. Such imaging recording of defocus imaging according to the present invention results in failure imaging if the subject moves during defocus imaging.
When the range determined by the imaging range determining means is imaged by turning on the first switch, the user determines whether or not desired defocus imaging has been performed at the time of the on operation of the first switch. In the case of a clear failure such as the subject moving, the image can be re-taken by re-operating the first switch, and time-consuming useless recording and storage can be avoided.

In such defocus imaging, the determination of the imaging range and the selection and storage of imaging data can limit the contents related to the focus position used for the final storage data depending on the imaging mode, and suppress unnecessary operations. For example, at the time of flash photography, it is possible to limit the imaging range for defocus imaging and the focus position for selective storage of imaging data within the range where the flash light reaches.
Next, recording and storage of imaging data in defocus imaging will be described.
When recording and saving imaging data from defocus imaging, all imaging data at the selected focus position is saved as is to the external recording device when determining the imaging range in defocus imaging and selecting imaging data by defocus imaging. It can be done, but the amount of data becomes very large.
On the other hand, since data captured by defocus imaging are captured by changing only the focus position, the correlation between the data is very strong. In addition, there is little problem even if the screen area that is not in focus is ignored.
Therefore, the image data such as the focus position fp point B and the focus position fp point C described above is automatically determined as the main image from the image data captured by the defocus imaging. Of the images to be recorded and stored, an image whose focus position is farthest to the plus side is a plus sub-image, and an image that is furthest to the minus side is a minus sub-image.

The screen is divided into a plurality of areas, and an in-screen area having a difference larger than a predetermined value between the main image and the plus sub image and the minus sub image is determined. For this in-screen area, inter-screen difference data that can restore or almost restore each other's area is created by the difference between images recorded by defocus imaging. Such a compression method between frames includes, for example, a forward prediction method proposed in Patent Document 4 (Japanese Patent No. 3500347).
The main image and the inter-screen difference data are recorded in the external storage device as the same file or a file group associated with each other.
At the time of image reproduction, by first reproducing the main image and applying the inter-screen difference data to the main image by the user's operation, the image captured by the defocus imaging can be almost reproduced. The user can obtain an image that is slightly out of focus.
With respect to the present invention, it is also important to inform the user whether or not imaging of a plurality of pieces of image data by defocus imaging can be completed as desired.
In addition, when the focus areas b and c are determined by determining the imaging range or imaging selection on the screen during defocus imaging, the user can determine at a glance whether or not the user can capture the desired area. It is possible and very beneficial.
In addition, since the number of captured images is often known when determining the imaging range, it depends on the limitation of the capacity that can be stored in the primary memory and secondary memory in the imaging device as described above and in the external memory that can be attached to and detached from the imaging device. It is also useful to notify the user of the warning by displaying the LCD or sound (sound display, sound display).

It is a block diagram which shows typically the structure of the principal part of the digital camera as an imaging device which concerns on embodiment of this invention. 3 is a schematic flowchart for explaining a basic imaging / recording processing operation in the digital camera of FIG. 1. The state of the object scene image for determining the imaging range of defocus imaging in the digital camera of FIG. 1 as the imaging apparatus according to the first embodiment of the present invention and the focus evaluation value obtained by dividing the screen into a plurality of divisions. It is a schematic diagram of the screen which shows a calculation area. 4 is a schematic graph showing a change in focus evaluation value with respect to a distance for each area in the object scene as shown in FIG. 3 in the digital camera of FIG. FIG. 6 is a schematic diagram for explaining the principle of distance measurement by a triangulation method used for determining an imaging range of defocus imaging in the digital camera of FIG. 1 as an imaging apparatus according to a second embodiment of the present invention. is there. According to the focal length of the imaging lens with respect to 1 / L (reciprocal of distance) for converting ranging data by the triangulation method used to determine the imaging range of defocus imaging in the digital camera of FIG. FIG. 5 is a schematic diagram showing a focus position fp characteristic. 1 is a diagram for explaining the principle of focus detection by a phase difference method used to determine the imaging range of defocus imaging in the digital camera of FIG. 1 as an imaging device according to a third embodiment of the present invention. It is a schematic diagram about an in-focus state, (b) front pin state, and (c) back pin state. The schematic diagram of the image detection data in the sensor of FIG. 7 and the characteristics of the sensor difference value with respect to the shift amount corresponding to the image interval difference are shown for (a) in-focus state, (b) front pin state, and (c) rear pin state, respectively. This is shown schematically. FIG. 8 is a schematic diagram showing an example of a relationship between a focus position fp in the sensor of FIG. 7 and a shift amount, that is, a difference value corresponding to an image interval, K. In the digital camera of FIG. 1 as an imaging device according to the fourth embodiment of the present invention, (a) a process when the first switch is turned on by half-pressing the shutter, and (b) a process when the shutter is fully pressed. It is a typical flowchart for demonstrating a process when two switches are also set to ON. 6 is a schematic timing chart for explaining an operation when the first switch is turned on by half-pressing a shutter in the digital camera of FIG. 1 as an imaging apparatus according to a fourth embodiment of the present invention. . 12 is a schematic timing chart for explaining an operation when the second switch is turned on by fully pressing the shutter in the digital camera of FIG. 1 as the imaging device according to the embodiment of FIG. In the digital camera of FIG. 1 as an imaging device according to the fifth embodiment of the present invention, (a) a process when the first switch is turned on by half-pressing the shutter, and (b) a process when the shutter is fully pressed. It is a typical flowchart for demonstrating a process when two switches are also set to ON. FIG. 14 is a schematic timing chart for explaining an operation when a configuration including a primary memory and a secondary memory is used as a memory configuration in the digital camera of FIG. 1 as the imaging apparatus according to the embodiment of FIG. .

Explanation of symbols

1 Imaging lens (imaging optical system)
2 Aperture-Shutter Unit 3 Image Sensor 4 CDS (Correlated Double Sampling) -AD (A / D Conversion) Unit 5 DSP (Digital Signal Processing) Unit 6 Mechanical Driver Unit 7 Image Sensor Drive Circuit 8 CPU (Central Processing Unit)
DESCRIPTION OF SYMBOLS 9 Memory part 10 Communication driver 11 Memory card 12 Display part 13 Operation part 14 AF (automatic focus control) process part 15 Strobe light emission part 16 Strobe power supply part 17 Strobe light-receiving part OL1, OL2 Optical system SA1, SA2, SB1, SB2 sensor CL condenser lens SL1, SL2 Separator lens

Claims (19)

An image sensor that has a plurality of pixels that convert light into an electrical signal, converts an optical image into image data using the plurality of pixels, and outputs the image data;
An imaging optical system including a focus adjustment function for forming an object scene image on a light receiving surface of the image sensor and changing a focus position of the imaged object image;
Imaging control means for capturing imaging data via the imaging element at a predetermined focus position while changing a focus position of the imaging optical system;
The imaging control means changes the focus position of the imaging optical system from a part of the pixels in a predetermined imaging region of the imaging element by changing the focus position of the imaging optical system at predetermined intervals within a predetermined movement range. An imaging range determining means for capturing a plurality of one imaging data and determining a focus movement range narrower than the predetermined movement range based on a focus evaluation value obtained from the plurality of first imaging data;
While changing the previous SL in focus movement range focus position of the imaging optical system, by the imaging control means, at least a portion at and said first imaging data of the pixels of the predetermined imaging area of the imaging device Imaging data storage means for capturing and storing a plurality of second imaging data from pixels in a region having a larger number of pixels than
Based on a focus evaluation value obtained from the plurality of second imaging data stored in the imaging data storage unit, at least a part of the second imaging data of the plurality of second imaging data is obtained. A recorded image selection means to select;
Image recording means for recording the second imaging data selected by the recorded image selection means on a recording medium,
An imaging apparatus characterized by performing both determination of a focus movement range by the imaging range determination unit and storage of the second imaging data by the imaging data storage unit in a first operation state of the release operation unit. The imaging range determination means determines a range in which the focus evaluation value is equal to or greater than a predetermined threshold as the focus movement range,
The imaging apparatus according to claim 1, wherein the imaging data storage unit stores the second imaging data when the focus evaluation value is equal to or greater than a predetermined threshold.   2. The recording of the second imaging data to a recording medium by the image recording unit when the second operation is performed in the first operation state of the release operation unit. Or the imaging device of 2.   The recorded image selection unit determines one or more focus positions based on the focus evaluation values of the plurality of second imaging data stored in the imaging data storage unit, and a plurality of in the vicinity of the focus position 2. The image pickup apparatus according to claim 1, wherein the image pickup apparatus is a unit that selects the second image pickup data and uses the image recording unit for recording on a recording medium. At least one of the imaging range determining means and the recorded image selecting means is
The imaging apparatus according to claim 1, wherein at least one of an imaging range and selected imaging data is determined based on at least distance information obtained from corresponding imaging data. At least one of the imaging range determining means and the recorded image selecting means is
The phase difference information corresponding to at least the focus shift of the imaging data is obtained, and at least one of the imaging range and the selected imaging data is determined based on at least the phase difference information. Imaging device.   2. The imaging range determining unit analyzes a main subject position from the imaging data, and determines the focus movement range corresponding to at least main subject position information based on the analysis result. Imaging device. At least one of the imaging range determining means and the recorded image selecting means is
The imaging apparatus according to claim 1, wherein the determination content of at least one of the imaging range and the selected imaging data is limited according to an imaging mode.   When there are a plurality of captured images determined by the recorded image selection unit, the recording unit determines one or more main images among the plurality of captured images and a main area in the main image. The compressed data between the captured images of the captured data having different focus positions with respect to the main area is stored as one of a file common to the main image and a file associated with the main image. The imaging apparatus according to 1.   It further comprises display means capable of displaying area information relating to at least one of imaging range determination by the imaging range determination means and imaging selection by the recorded image selection means in a form in which the imaging screen is divided into a plurality of areas. The imaging device according to claim 1.   An imaging device capable of continuously capturing an object scene image at different focus positions, at least one of a memory built in the imaging device and a memory detachably loaded in the imaging device, and a communication unit The imaging apparatus according to claim 1, further comprising means for warning a user regarding at least one of the restrictions. An image sensor that has a plurality of pixels that convert light into an electrical signal, converts an optical image into image data using the plurality of pixels, and outputs the image data;
An imaging optical system including a focus adjustment function for forming an object scene image on a light receiving surface of the image sensor and changing a focus position of the imaged object field image;
Imaging control means for capturing imaging data via the image sensor at a predetermined focus position while changing the focus position of the imaging optical system, and recording means for storing the imaging data captured by the imaging control means in a recording medium ,
In a continuous imaging method for automatically acquiring a plurality of continuous field images in an imaging device comprising:
For the range of movement the focus position of Jo Tokoro of the imaging optical system, while changing at predetermined intervals, by the imaging control means, first from some of the pixels of the pixels in a predetermined imaging area of the imaging device A first imaging data acquisition step for capturing a plurality of one imaging data;
A focus evaluation value is obtained from the plurality of first imaging data captured in the first imaging data acquisition step, and a focus movement range narrower than the predetermined movement range is obtained based on the focus evaluation value. An imaging range determination step to be determined;
Within the focus movement range, the imaging control means changes at least a part of the pixels in the predetermined imaging area of the imaging element and the first imaging data while changing the focus position of the imaging optical system. A second imaging data storage step for capturing and storing a plurality of second imaging data from pixels in a region having a larger number of pixels than,
Based on the focus evaluation value obtained from the plurality of second imaging data stored in the second imaging data storage step, at least a part of the second imaging data is the second imaging data. A recorded image selection step for selecting imaging data;
An image recording step of recording the second imaging data selected in the recording image selection step on a recording medium by the recording means;
Continuous imaging, wherein in the first operation state of the release operation unit, determination of a focus movement range by the imaging range determination step and storage of the second imaging data by the second imaging data storage step are performed together Method. The imaging range determination step determines a range in which the focus evaluation value is equal to or greater than a predetermined threshold as the focus movement range,
The continuous imaging method according to claim 12, wherein the second imaging data storage step stores the second imaging data when the focus evaluation value is equal to or greater than a predetermined threshold.   13. The second imaging data is recorded on a recording medium by the image recording step when a second operation is performed in the first operation state of the release operation unit. Or the continuous imaging method of 13.   The recorded image selection step includes a step of determining one or more in-focus positions based on a focus evaluation value of the plurality of second image data stored in the second image data storage step; The continuous imaging method according to claim 12, further comprising: selecting a plurality of the second imaging data in the vicinity of a focal position and using the second imaging data for recording on a recording medium in the image recording step. At least one of the imaging range determination step and the recorded image selection step includes
The continuous imaging method according to claim 12, wherein at least one of an imaging range and selected imaging data is determined based on at least distance information obtained from corresponding imaging data. At least one of the imaging range determination step and the recorded image selection step includes
The phase difference information corresponding to at least the focus shift of the imaging data is obtained, and at least one of the imaging range and the selected imaging data is determined based on at least the phase difference information. Continuous imaging method. The imaging range determination step includes
13. The continuous imaging method according to claim 12, wherein a main subject position is analyzed from the imaging data, and the focus movement range is determined corresponding to at least main subject position information based on the analysis result. At least one of the imaging range determination step and the recorded image selection step includes
The continuous imaging method according to claim 12, wherein the determination content of at least one of the imaging range and the selected imaging data is limited according to the imaging mode.

Images