JP2011172115A - Imaging device, imaging process method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To properly detect a face image and reliably achieve the best focus adjustment and exposure control at the detection of the face image. <P>SOLUTION: An imaging device 100 includes: a search time determination unit 62 which determines a search time for searching for the face image with a rotation angle from the pickup image obtained later according to the rotation angle centering a reference axis of this face image when it is determined by a detection determination unit 61 that the face image is included in the imaged image output from an electronic imaging unit 2; and an imaging interval setting unit 43 which sets a continuous imaging interval at which the electronic imaging unit is driven according to the determined search time. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an imaging apparatus, an imaging processing method, and a program for imaging a subject.

In recent years, an imaging apparatus such as a digital camera is generally used to detect a face image from sequentially captured images and perform focus adjustment and exposure control using the face image as an AF area or an AE area.
Also, assuming that the subject with a face image is always moving, assuming that the face image has disappeared from the captured image due to a change in the face orientation, etc., Technology to control exposure has also been developed. For example, when a face image is no longer detected from the captured image, the amount of change in the distance of the subject person having the face image is taken into account. There is a technique for changing to adjustment according to (see, for example, Patent Document 1).

JP 2010-8936 A

  However, in the technique of the above-mentioned Patent Document 1, the efficiency of the control is merely improved so that the focus adjustment and the exposure control are optimized for the captured image, and the face image is obtained from the captured image. If it is no longer detected, the focus adjustment and exposure control using the face image cannot be performed.

  The present invention has been made in view of such problems, can detect a face image properly, and more reliably perform optimum focus adjustment and exposure control due to the detection of the face image. The purpose is to be able to make things.

In order to solve the above problem, an imaging apparatus according to claim 1 is provided.
Imaging control means for continuously driving the imaging means at predetermined intervals to output an image from the imaging means, each of a plurality of rotation angles around the reference axis of the subject, and detection for detecting the subject Information storage means for storing information in association with each other and whether or not the subject is included in the image output from the imaging means based on the detection information stored in the information storage means A first judging means for judging, and when the first judging means judges that the subject is included, the subject at the rotational angle is imaged according to the rotational angle about the reference axis of the subject. A determination unit that determines a search time for searching from an image output from the unit, and a period during which the imaging unit is driven by the imaging control unit in accordance with the search time determined by the determination unit It is characterized by comprising a setting means for setting a.

The invention according to claim 2 is the invention according to claim 1,
After the setting by the setting means, the determination means further comprises second determination means for determining whether or not the rotation angle of the subject newly specified by the determination means has changed from the rotation angle of the subject specified last time. When the second determination unit determines that the rotation angle of the subject has changed, the unit re-searches a search time for searching for an object having the changed rotation angle from the image output from the imaging unit. It is characterized by deciding.

The invention according to claim 3 is the invention according to claim 1 or 2,
After the setting by the setting means, the image forming apparatus further includes third determination means for determining whether or not the subject is no longer included in the image output from the imaging means, and the determination means determines whether the subject is detected by the third determination means. When it is determined that it is no longer included, the detection time for detecting the subject is determined from the image output from the imaging means.

The invention according to claim 4 is the invention according to any one of claims 1 to 3,
The image recording device further includes image recording means for recording the image output from the imaging means.

The imaging processing method of the invention according to claim 5 is:
Imaging control means for continuously driving the imaging means at predetermined intervals to output an image from the imaging means, each of a plurality of rotation angles around the reference axis of the subject, and detection for detecting the subject An information processing unit that stores information in association with each other, and an imaging processing method using the imaging device, wherein the imaging unit is based on the detection information stored in the information storage unit. The process of determining whether or not the subject is included in the output image, and if it is determined that the subject is included, according to the rotation angle about the reference axis of the subject, the rotation angle A process for determining a search time for searching for the subject from the image output from the imaging unit, and an interval for driving the imaging unit by the imaging control unit is set according to the determined search time It is characterized by executing processing and that, a.

The program of the invention described in claim 6 is:
Imaging control means for continuously driving the imaging means at predetermined intervals to output an image from the imaging means, each of a plurality of rotation angles around the reference axis of the subject, and detection for detecting the subject And an information storage unit that stores information in association with each other, based on the detection information stored in the information storage unit, an image output from the imaging unit First determination means for determining whether or not a subject is included, and when the first determination means determines that the subject is included, the rotation is performed according to a rotation angle about the reference axis of the subject. Determination means for determining a search time for searching for a subject having a moving angle from an image output from the imaging means, and the imaging control means according to the search time determined by the determination means Ri setting means for setting an interval for driving the image pickup means, it is characterized in that to function as a.

  According to the present invention, it is possible to appropriately detect a face image, and thereby it is possible to make sure the optimum focus adjustment and exposure control executed based on the detection of the face image.

It is a block diagram which shows schematic structure of the imaging device of Embodiment 1 to which this invention is applied. 3 is a flowchart illustrating an example of an operation related to continuous imaging processing by the imaging apparatus of FIG. 1. It is a figure which shows typically an example of the information for face detection which concerns on the continuous imaging process of FIG. It is a figure which shows typically an example of the image which concerns on the continuous imaging process of FIG. It is a block diagram which shows schematic structure of the imaging device of Embodiment 2 to which this invention is applied. 6 is a flowchart illustrating an example of an operation related to continuous imaging processing by the imaging apparatus of FIG. 5. It is a block diagram which shows schematic structure of the imaging device of Embodiment 3 to which this invention is applied. It is a flowchart which shows an example of the operation | movement which concerns on the continuous imaging process by the imaging device of FIG. 10 is a flowchart illustrating an example of an operation related to continuous imaging processing by the imaging apparatus according to the first modification.

  Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. However, the scope of the invention is not limited to the illustrated examples.

[Embodiment 1]
When it is determined that the face image S is included in the captured image output from the electronic imaging unit 2, the imaging apparatus 100 according to the first embodiment follows the rotation angle of the face image S. A search time for searching for the image S from a captured image acquired thereafter is determined, and a continuous imaging interval for driving the electronic imaging unit 2 is set according to the determined search time.

FIG. 1 is a block diagram illustrating a schematic configuration of an imaging apparatus 100 according to the first embodiment to which the present invention is applied.
As shown in FIG. 1, the imaging apparatus 100 includes a lens unit 1, an electronic imaging unit 2, a unit circuit unit 3, an imaging control unit 4, an image processing unit 5, a face detection processing unit 6, and a display unit. 7, an image recording unit 8, a buffer memory 9, a program memory 10, an operation input unit 11, and a central control unit 12.
The imaging control unit 4, the image processing unit 5, the face detection processing unit 6, the display unit 7, the image recording unit 8, the buffer memory 9, the program memory 10, and the central control unit 12 are connected via a bus line 13. Yes.

  For example, although not shown, the lens unit 1 includes a zoom lens, a focus lens, a diaphragm, and the like, and forms an optical image of a subject that has passed through these lenses.

The electronic imaging unit 2 includes, for example, an image sensor such as a charge coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS), and an optical image that has passed through various lenses of the lens unit 1 is transmitted by the electronic imaging unit 2. It is converted into a two-dimensional image signal (RGB image data) and output to the unit circuit unit 3.
Here, the electronic imaging unit 2 constitutes an imaging unit that images a subject.

  The unit circuit unit 3 is, for example, omitted from the drawing, but includes a CDS (Correlated Double Sampling), an AGC (Auto Gain Control), and an ADC (Analog to Digital Converter). ) Etc. Then, the unit circuit unit 3 holds an analog image signal corresponding to the optical image of the subject output from the electronic image pickup unit 2 and inputted by the CDS, amplifies the image signal by the AGC, and then the amplified image. The signal is converted into a digital image signal by the ADC.

  The imaging control unit 4 controls operations of the lens unit 1, the electronic imaging unit 2, the unit circuit unit 3, and the like when imaging a subject based on a command from the central control unit 12. Specifically, the imaging control unit 4 includes a lens unit driving unit 41, an electronic imaging unit driving unit 42, and an imaging interval setting unit 43.

The lens unit driving unit 41 controls driving of a lens motor (not shown) for moving the zoom lens, the focus lens, and the like of the lens unit 1 on the optical axis.
Specifically, the lens unit drive unit 41 generates a lens motor drive signal based on a command from the central control unit 12, and drives the lens motor in accordance with the drive signal, such as a zoom lens and a focus lens. Adjust the position on the optical axis. In addition, when the face detection processing unit 6 detects the face image S, the lens unit driving unit 41 generates a lens motor driving signal necessary for focusing on the face image S, and the lens according to the driving signal. The focus position of the focus lens is adjusted by driving the motor.

The electronic imaging unit drive unit 42 controls the operation timing for scanning and driving the electronic imaging unit 2 according to the continuous imaging interval set by the imaging interval setting unit 43 (details will be described later).
Specifically, the electronic imaging unit driving unit 42 includes, for example, a timing generator, a driver (none of which is not shown) that drives the electronic imaging unit 2, and the like, and captures live view images and recorded images. At this time, the electronic imaging unit 2 is driven to scan through a timing generator and a driver. That is, the electronic image pickup unit driving unit 42 sets the charge accumulation time corresponding to the shutter speed to the shutter speed by setting the continuous image pickup interval set by the image pickup interval setting unit 43 based on the command from the central control unit 12. It outputs to a driver as a pulse, operates the electronic imaging part 2 according to the drive pulse signal from a driver, and controls charge accumulation time (exposure time). The electronic imaging unit driving unit 42 performs such operation control continuously until the number of continuously recorded sheets (for example, 60) or the memory capacity is full, and the two-dimensional image signal converted by the electronic imaging unit 2. Are read out from the imaging region of the electronic imaging unit 2 by one screen at a continuous imaging interval (with a predetermined period) and output to the unit circuit unit 3.
Here, the electronic imaging unit driving unit 42 constitutes an imaging control unit that continuously drives the electronic imaging unit 2 at a predetermined interval to output an image from the electronic imaging unit 2.

The imaging interval setting unit 43 sets a continuous imaging interval for driving the electronic imaging unit 2 by the electronic imaging unit driving unit 42.
Specifically, the imaging interval setting unit 43 is controlled by the electronic imaging unit driving unit 42 according to the imaging frame rate (for example, 30 fps) specified by the central control unit 12 based on a predetermined operation of the operation input unit 11 by the user. A continuous imaging interval (for example, 1/30 s) for driving the electronic imaging unit 2 continuously is set.

In addition, when the search time of the face image S is determined by the search time determination unit 62 of the face detection processing unit 6 described later, the imaging interval setting unit 43 performs continuous imaging of the electronic imaging unit 2 so as to be equal to the search time. Set the interval. That is, the search time for the face image S is determined according to each of a plurality of rotation angles around the reference axis of the face image S (described later), and the imaging interval setting unit 43 determines In accordance with the search time (for example, 1/6 s) of the face image S, the search time and the continuous imaging interval (for example, 1/6 s) of the electronic imaging unit 2 are set to be equal.
Here, the imaging interval setting unit 43 sets a continuous imaging interval for driving the electronic imaging unit 2 by the electronic imaging unit driving unit 42 according to the search time determined by the search time determining unit 62 of the face detection processing unit 6. The setting means is configured.

The image processing unit 5 performs RGB interpolation processing for generating R, G, and B color component data (RGB data) for each pixel on the image signal after A / D conversion, and luminance signal (Y) from the RGB data. YUV conversion processing for generating YUV data composed of color difference signals (U, V) for each pixel, and digital signal processing for improving image quality such as automatic white balance and edge enhancement are performed. Then, the image processing unit 5 sequentially outputs the YUV data of each converted image frame to the buffer memory 9 and stores it in the buffer memory 9.
In addition, the image processing unit 5 performs a reduction process on the YUV data at a predetermined magnification both horizontally and vertically to generate image data for low-resolution live view display. Further, the image processing unit 5 may reduce YUV data at a predetermined magnification both horizontally and vertically to generate low-resolution YUV data for face detection processing during continuous imaging of recording images.

  The face detection processing unit 6 includes a detection determination unit 61 and a search time determination unit 62.

The detection determination unit 61 acquires YUV data of each image frame generated by the image processing unit 5 from the buffer memory 9 based on a command from the central control unit 12, and the human face image S from the image frame. A face detection process is performed to detect.
Here, the face detection process is performed using the face detection information d (see FIG. 3) for detecting the face image S.

The face detection information d is stored in the face detection processing unit 6. For example, the shape and size of a plurality of parts of the face (for example, eyes, nose, mouth, etc.), the face outline, and the substantially frontal direction are used. In this case, the position of each part is registered as feature amount information divided by age, type of person, etc.
A plurality of pieces of feature amount information are registered in association with each of a plurality of rotation angles about the reference axis of the face (see FIG. 3). That is, as shown in FIG. 3, for example, the plurality of pieces of feature amount information are rotated by a predetermined angle in the left-right direction with the front-rear axis (reference axis) passing through the center C of the face in the front-rear direction as the central axis. Is. For example, on the basis of feature amount information when viewed from a substantially front direction (rotation angle: 0 °), a predetermined angle (for example, + θ1 °, + θ2 °,. + Θn ° etc.) rotated feature amount information, and feature amount information rotated leftward by a predetermined angle (for example, −θ1 °, −θ2 °,..., −θn ° etc.).
Note that an axis extending through the center C of the face F0 and extending in the vertical direction is represented as a vertical axis L0, and an axis after rotation of the vertical axis L0 is represented as an axis La (FIGS. 3 and 4 ( a) and FIG. 4B). Further, the rotation angle formed with the axis La after rotating in the right direction with respect to the vertical axis L0 is represented by a positive sign (+), and the axis after rotation in the left direction with respect to the vertical axis L0. The rotation angle formed with La is expressed with a negative sign (−) (see FIG. 3).
In addition, the feature amount information rotated in the left-right direction described above is an example, and is not limited to this. For example, the feature amount information includes the left-right axis passing through the center C of the face in the left-right direction as a reference axis. It may be rotated by a predetermined angle in the vertical direction with respect to the left and right axis (not shown).
As described above, the face detection processing unit 6 has each of a plurality of rotation angles around the reference axis of the face image (subject) S and the feature amount information of the face detection information d for detecting the face image S. Are stored in association with each other.

Then, the detection determination unit 61 sequentially reads out an image area of a predetermined area for the YUV data of each image frame for live view display and recording acquired from the buffer memory 9, and performs edge extraction and the like on this image area. To calculate the feature amount. Here, instead of each image frame for recording, low-resolution YUV data of the image frame for recording generated by the image processing unit 5 may be processed.
Then, the detection determining unit 61 calculates the evaluation value by evaluating the degree of coincidence between the calculated feature amount and the feature amount information of each of the plurality of rotation angles of the face detection information d. Subsequently, the detection determination unit 61 determines that the highest evaluation value corresponding to a plurality of image areas having a predetermined area that is equal to or higher than a predetermined threshold and includes the face area. In this way, the detection determination unit 61 determines whether or not the face image S is included in each image frame according to the result of the face detection process.
Here, the detection determination unit 61 constitutes a first determination unit that determines whether the image output from the electronic imaging unit 2 includes a face image (subject) S based on the face detection information d. ing.

The search time determination unit 62 determines a search time for searching for a human face image S from each image frame generated by the image processing unit 5. Specifically, the search time determination unit 62 centers on the reference axis when the detection determination unit 61 determines that the face image S is included in one image frame acquired from the buffer memory 9. According to the rotation angle of the face image S, a search time required for the detection determination unit 61 to search for the face image S is determined in an image frame acquired from the buffer memory 9 after the one image frame. .
Here, the search time is defined in consideration of the minimum time required to detect the human face image S in each image frame, but the face in the feature amount information used for the face detection process The rotation angle varies depending on the rotation angle. That is, the search time when using the feature amount information of the face F0 (rotation angle: 0 °) viewed from substantially the front direction is the shortest, and in a predetermined direction (for example, the left direction toward the left) about the reference axis. When the rotated angle increases (for example, the state of FIG. 4B in which the rotation angle is larger than the state of FIG. 4A), the search time also becomes longer. Specifically, for example, face feature amount information whose rotation angle formed by the vertical axis L0 and the rotated axis La is 90 ° (for example, face feature amount information corresponding to ± θn ° in FIG. 3). When using the feature amount information of the face F0 (rotation angle: 0 °) viewed from substantially the front direction, the search time is about five times.

Therefore, when the detection determination unit 61 determines that the face image S is included in one image frame, the search time determination unit 62 first refers to the face detection information d to determine the face image. A rotation angle in a predetermined direction (for example, the right direction toward the right) about the reference axis of the face of the feature amount information used for detecting S is specified, and the rotation is performed according to the specified rotation angle. A search time required for searching the face image S at the moving angle in the image frame acquired from the buffer memory 9 is determined.
The determination of the search time for the face image S is performed by, for example, a predetermined calculation. However, the determination is not limited to this, and the predetermined search time is associated with the face rotation angle of the feature amount information and the search time. You may carry out using a table.
Here, when the detection determination unit 61 determines that the face image S is included, the search time determination unit 62 determines the rotation angle according to the rotation angle about the reference axis of the face image S. A determining unit that determines a search time for searching the face image S from the image output from the electronic imaging unit 2 is configured.

  The display unit 7 converts the YUV data for one frame stored in the buffer memory 9 into a video signal, and then displays it as a live view image on the display screen. Specifically, the display unit 7 displays a live view image at a predetermined display frame rate based on a plurality of image frames generated by imaging a subject, or displays a REC view image captured as a main captured image. To do.

The image recording unit 8 is configured by, for example, a nonvolatile memory (flash memory). The image recording unit 8 is output from the electronic imaging unit 2 and is compressed and encoded by a coding unit (not shown) of the image processing unit 5 by a predetermined coding method (for example, JPEG method, MPEG method, etc.). Records still image data and moving image data.
Here, the image recording unit 8 constitutes an image recording unit that records the image output from the electronic imaging unit 2.

  The buffer memory 9 is a buffer for temporarily recording image data and the like, and is also used as a working memory for the central control unit 12 and the like.

  The program memory 10 stores various programs and data related to the functions of the imaging apparatus 100. Further, the program memory 10 stores, for example, an aperture value (F) corresponding to an appropriate exposure value (EV) and a shutter speed at each imaging such as still image imaging, continuous imaging, and live view image imaging. The program AE data constituting the program diagram showing the combination and the EV value table (both not shown) are also stored.

  The operation input unit 11 is for performing a predetermined operation of the imaging apparatus 100. Specifically, the operation input unit 11 includes, for example, a shutter button related to a subject shooting instruction, a selection determination button related to a selection instruction of an imaging mode, a function, and the like, a zoom button related to a zoom amount adjustment instruction, and the like ( Neither is shown), and a predetermined operation signal is output to the central control unit 12 in response to a user operation of these buttons.

The central control unit 12 includes, for example, a one-chip microcomputer that includes a CPU that controls each unit of the imaging apparatus 100.
The central control unit 12 controls each unit of the imaging apparatus 100 based on the operation signal output from the operation input unit 11 and input. Specifically, when a recording instruction signal output according to a predetermined operation of the shutter button of the operation input unit 11 is input, the central control unit 12 performs an imaging control unit according to a predetermined program stored in the program memory 10. 4, the drive timing of the electronic imaging unit 2 and the unit circuit unit 3 is controlled to execute a process of capturing a still image. One frame of YUV data stored in the buffer memory 9 by shooting this still image is compressed and encoded by the image processing unit 5 by the JPEG method or the like, and recorded as still image data in the image recording unit 8. .

Next, a continuous imaging process executed when the subject is imaged by the imaging apparatus 100 will be described with reference to FIG.
FIG. 2 is a flowchart illustrating an example of an operation related to continuous continuous imaging processing.

In the continuous continuous imaging process, for example, a continuous imaging mode for still images is selected and designated from among a plurality of modes in the menu screen displayed on the display unit 7 based on a predetermined operation of the operation input unit 11 by the user. It is a process executed in this case.
In the following continuous imaging process, when the shutter button of the operation input unit 11 is operated once by the user, the imaging control unit 4 is set in advance based on a command from the central control unit 12. Recorded images corresponding to a predetermined continuous recording number (for example, 60) are continuously captured by the electronic imaging unit 2.

As shown in FIG. 2, first, when an optical image of a subject that has passed through various lenses of the lens unit 1 is captured by the electronic imaging unit 2 under the control of the imaging control unit 4, detection by the face detection processing unit 6 is performed. The determination unit 61 performs face detection processing for detecting a human face image S using the face detection information d for each image frame for live view display generated by the image processing unit 5. Then, the detection determination unit 61 determines whether or not the face image S is detected from the image frame to be processed according to the result of the face detection process (step S1).
When it is determined that the face image S is detected (step S1; YES), the search time determination unit 62 refers to the face detection information d and focuses on the reference axis of the detected face image S. A rotation angle in a predetermined direction (for example, -θ1 °, etc .: see FIG. 4A) is specified (step S2). When the face image S is detected, the display unit 7 displays a face detection frame W (see FIG. 4A, etc.) surrounding the face image S in the displayed live view image. To do.

Subsequently, based on the specified rotation angle, the search time determination unit 62 causes the detection determination unit 61 to search for a face image S at the rotation angle in an image frame acquired from the buffer memory 9 thereafter. The search time (for example, 1/30 s) required for the face image S is determined and set in the detection determination unit 61 (step S3).
Next, the imaging interval setting unit 43 of the imaging control unit 4 determines the face image S by the electronic imaging unit 2 to be equal to the search time according to the search time of the face image S determined by the search time determination unit 62. Are set (for example, 1/30 s) (step S4).
Accordingly, the number of times the subject is imaged by the electronic imaging unit 2 in the unit period can be made equal to the number of times the face image S is searched by the detection determination unit 61, and each time an image for recording is taken, The search for the face image S can be executed.

Subsequently, the central control unit 12 determines whether or not an instruction to start recording of continuously captured images of the subject has been detected based on a predetermined operation of the shutter button of the operation input unit 11 by the user (step S5).
If it is determined that the recording start instruction has not been detected (step S5; NO), the central control unit 12 returns the process to step S1, and the detection determination unit 61, as described above, performs the image processing unit. For each image frame for live view display generated by 5, face detection processing for detecting a human face image S is performed using the face detection information d, and the face image S is detected from the processing target image frame. It is determined whether or not it has been done (step S1).

On the other hand, when it is determined in step S5 that a recording start instruction has been detected (step S5; YES), the imaging control unit 4 has already been detected according to the continuous imaging interval of the subject set by the imaging interval setting unit 43. Subject imaging conditions such as automatic focusing processing (AF) and automatic exposure processing (AE) in which the face image S (face detection frame W; see FIG. 4A, etc.) is used as an AF area or AE area (measurement target). By performing adjustment control, the image processing unit 5 sequentially records YUV data of image frames (captured images) sequentially generated based on continuous imaging by the electronic imaging unit 2 in the buffer memory 9 (step S6).
Specifically, the detection determination unit 61 converts the image data of the face image S (face detection frame W) into a contrast value acquisition area (AF area) for each set search time (= continuous imaging interval) of the face image S. ) And an exposure measurement area (AE area), and the imaging control unit 4 executes an automatic focusing process so that the face image S is focused by the lens unit driving unit 41, a shutter speed, an aperture value, and the like. Auto exposure processing is performed to adjust the exposure conditions. Further, the imaging control unit 4 drives the electronic imaging unit 2 at the continuous imaging interval (= search time of the face image S) of the subject set by the imaging interval setting unit 43 so as to be synchronized with these processes. A recording image is output from the electronic imaging unit 2.
Note that the imaging control unit 4 may perform automatic white balance (AWB) using the measurement target as adjustment control of the imaging condition of the subject.

Next, the central control unit 12 ends the recording of the continuously captured images of the subject depending on whether or not the number of recorded images recorded in the buffer memory 9 has reached a predetermined continuous recording number (for example, 60). It is determined whether or not an instruction has been detected (step S7).
Here, if it is determined that the recording end instruction has not been detected (step S7; NO), the central control unit 12 returns the process to step S6, and the number of recorded images is a predetermined continuous recording number (for example, 60). Subsequent processing is performed until the number of sheets reaches.
When it is determined in step S7 that a recording end instruction has been detected (step S7; YES), the central controller 12 determines a predetermined continuous recording number (for example, temporarily recorded in the buffer memory 9). 60 sheets) of recorded images are recorded in the image recording unit 8, and the continuous imaging process is terminated.

On the other hand, when it is determined in step S1 that the face image S is not detected from the live view image (step S1; NO), the central control unit 12 performs a predetermined operation of the shutter button of the operation input unit 11 by the user. Based on this, it is determined whether or not an instruction to start recording of continuously captured images of the subject has been detected (step S8).
If it is determined that the recording start instruction has not been detected (step S8; NO), the central control unit 12 returns the process to step S1, and the detection determination unit 61, as described above, performs the image processing unit. For each image frame for live view display generated by 5, face detection processing for detecting a human face image S is performed using the face detection information d, and the face image S is detected from the processing target image frame. It is determined whether or not it has been done (step S1).

On the other hand, if it is determined in step S8 that a recording start instruction has been detected (step S8; YES), the imaging control unit 4 is set in advance according to a predetermined continuous imaging interval (fixed value) set in advance. The image processing unit 5 performs electronic image processing condition adjustment control such as automatic focusing processing (AF) and automatic exposure processing (AE) based on a predetermined AF area and AE area (measurement target). The YUV data of the image frames sequentially generated based on the continuous imaging by the imaging unit 2 is sequentially recorded in the buffer memory 9 (step S9).
Note that the automatic focusing process and automatic exposure process in step S9 are substantially the same as the process in step S6 except that the AF area and the AE area are different, and detailed description thereof is omitted.

Next, the central control unit 12 ends the recording of the continuously captured images of the subject depending on whether or not the number of recorded images recorded in the buffer memory 9 has reached a predetermined continuous recording number (for example, 60). It is determined whether or not an instruction has been detected (step S10).
Here, if it is determined that the recording end instruction has not been detected (step S10; NO), the central control unit 12 returns the process to step S9, and the number of recorded images is a predetermined continuous recording number (for example, 60). Subsequent processing is performed until the number of sheets reaches.
When it is determined in step S10 that a recording end instruction has been detected (step S10; YES), the central controller 12 determines a predetermined continuous recording number (for example, temporarily recorded in the buffer memory 9). 60 sheets) of recorded images are recorded in the image recording unit 8, and the continuous imaging process is terminated.

As described above, according to the imaging apparatus 100 of the first embodiment, the face image S having the rotation angle is subsequently acquired from the buffer memory 9 according to the rotation angle of the face image S detected by the face detection process. The search time of the face image S for searching from the recorded image to be recorded is determined, and the search time and the continuous imaging interval for driving the electronic imaging unit 2 are equal according to the determined search time of the face image S. Therefore, the number of times the subject is imaged and the number of times the face image S is searched from the captured image in the unit period during continuous imaging of the recording image can be made equal, and a predetermined continuous recording number (for example, , 60 images), the face image S for the image can be searched every time a recording image is captured.
Therefore, even if the continuous imaging interval of the subject, that is, the number of times of imaging of the subject in the unit period is set once, the non-detection state of the face image S is made by changing the continuous imaging interval of the subject according to the search time of the facial image S. Therefore, the face image S can be detected properly. As a result, the optimum focus adjustment and exposure control executed based on the detection of the face image S can be made more reliable.

[Embodiment 2]
Hereinafter, an imaging apparatus 200 according to the second embodiment to which the present invention is applied will be described with reference to FIGS. 5 and 6.
FIG. 5 is a block diagram illustrating a schematic configuration of the imaging apparatus 200 according to the second embodiment.
In the imaging apparatus 200 according to the second embodiment, the rotation angle of the face image S in the image is changed from the previous rotation angle of the face image S for each recording image continuously captured in the continuous imaging process. If it is determined whether or not the rotation angle of the face image S has changed, the search time for searching the face image S having the changed rotation angle from the captured image is determined again.
Note that the imaging apparatus 200 according to the second embodiment has substantially the same configuration as the imaging apparatus 100 according to the first embodiment except for the points described below, and the description thereof is omitted.

In addition to the detection determination unit 61 and the search time determination unit 62, the face detection processing unit 6 includes an angle change determination unit 63 that determines a change in the rotation angle of the face image S in the continuous imaging process.
After the continuous imaging interval is set by the imaging interval setting unit 43, the angle change determination unit 63 determines the rotation angle of the face image S detected from the image frame generated by the image processing unit 5 in the continuous imaging process. Then, it is determined whether or not the rotation angle of the face image S used when setting the continuous imaging interval is changed. That is, the detection determination unit 61 detects the face image S from each image frame every time the image processing unit 5 sequentially generates image frames, and the search time determination unit 62 determines the reference axis of the detected face image S. A rotation angle in a predetermined direction centered on is specified. Then, the angle change determination unit 63 determines whether the rotation angle of the face image S newly specified by the search time determination unit 62 has changed from the rotation angle of the face image S specified last time.
As described above, the angle change determination unit 63 sets the continuous imaging interval by the imaging interval setting unit 43, and then the face image S in which the rotation angle of the face image S newly specified by the search time determination unit 62 is previously specified. The second determination means for determining whether or not the rotation angle has changed is configured.

  When the angle change determination unit 63 determines that the rotation angle of the face image S has changed, the search time determination unit 62 subsequently selects the face image S having the rotation angle according to the changed rotation angle. The search time required for the detection determination unit 61 to search for the image frame acquired from the buffer memory 9 is determined again.

  When the search time of the face image S is redetermined by the search time determination unit 62, the imaging interval setting unit 43 resets the continuous imaging interval of the electronic imaging unit 2 to be equal to the search time after the redetermination. .

Next, continuous imaging processing by the imaging apparatus 200 will be described with reference to FIG.
FIG. 6 is a flowchart illustrating an example of an operation related to continuous imaging processing.
Note that the processing other than the processing related to the resetting of the search time of the face image S and the continuous imaging interval based on the change in the rotation angle of the face image S is substantially the same as the continuous imaging processing of the first embodiment, and details thereof The detailed explanation is omitted.

As shown in FIG. 6, first, similarly to the continuous imaging process of the first embodiment, the detection determination unit 61 of the face detection processing unit 6 performs for each image frame for live view display generated by the image processing unit 5. Face detection processing for detecting a human face image S using the face detection information d is performed, and whether or not the face image S is detected from the image frame that is the processing target according to the result of the face detection processing. Judgment is made (step S1).
Here, if it is determined that the face image S has been detected (step S1; YES), the search time determination unit 62 refers to the face detection information d and detects it as in the continuous imaging process of the first embodiment. A rotation angle in a predetermined direction around the reference axis of the face image S (for example, −θ1 °, etc .: see FIG. 4A) is specified (step S2).
If it is determined in step S1 that the face image S has not been detected (step S1; NO), the central control unit 12 proceeds to step S8, but the processes after step S2 are performed. Since it is the same as the continuous imaging process of the said Embodiment 1, the detailed description is abbreviate | omitted.

Subsequently, as in the continuous imaging process of the first embodiment, the search time determination unit 62 determines that the detection determination unit 61 subsequently displays the face image S at the rotation angle based on the specified rotation angle. The search time (for example, 1/30 s) of the face image S necessary for searching in the image frame acquired from is determined and set in the detection determination unit 61 (step S3).
Next, similarly to the continuous imaging process of the first embodiment, the imaging interval setting unit 43 of the imaging control unit 4 is equal to the search time according to the search time of the face image S determined by the search time determination unit 62. Thus, the continuous imaging interval (for example, 1/30 s) of the face image S by the electronic imaging unit 2 is set (step S4).

Subsequently, as in the continuous imaging process of the first embodiment, the central control unit 12 determines whether or not an instruction to start recording of continuously captured images of the subject is detected based on a predetermined operation of the shutter button of the operation input unit 11 by the user. Is determined (step S5).
If it is determined that the recording start instruction has not been detected (step S5; NO), the central control unit 12 returns the process to step S1.

  On the other hand, when it is determined in step S5 that a recording start instruction has been detected (step S5; YES), the imaging control unit 4 is set by the imaging interval setting unit 43 as in the continuous imaging process of the first embodiment. In accordance with the continuous imaging interval of the subject, automatic focus processing (AF) or automatic exposure with the detected face image S (face detection frame W; see FIG. 4A, etc.) as the AF area or AE area (measurement target) The image processing unit 5 performs adjustment control of subject imaging conditions such as processing (AE), and the image processing unit 5 stores, in the buffer memory 9, YUV data of image frames (captured images) sequentially generated based on continuous imaging by the electronic imaging unit 2. Recording is performed sequentially (step S6).

  Next, the face detection processing unit 6 determines whether or not the rotation angle of the face image S of the captured image related to continuous imaging by the electronic imaging unit 2 has changed from the rotation angle of the face image S specified last time. The change is determined by the change determining unit 63 (step S17). Specifically, the detection determination unit 61 of the face detection processing unit 6 acquires, from the buffer memory 9, YUV data of an image frame (captured image) newly generated by the image processing unit 5 by continuous imaging by the electronic imaging unit 2. Then, face detection processing for detecting the face image S from the image frame is performed. Then, after the search time determination unit 62 specifies the rotation angle in a predetermined direction around the reference axis of the detected face image S, the angle change determination unit 63 is newly specified by the search time determination unit 62. It is determined whether the rotation angle of the face image S has changed from the rotation angle of the face image S specified last time.

If it is determined in step S17 that the rotation angle of the face image S has not changed (step S17; NO), the central control unit 12 returns the process to step S6 and performs the subsequent processes.
On the other hand, if it is determined that the rotation angle of the face image S has changed (step S17; YES), the search time determination unit 62 determines the rotation angle after the change (for example, −θ2 °, etc .: FIG. 4B). The search time (for example, 1/15 s) required to search for the face image S at the rotation angle in the image frame acquired from the buffer memory 9 is detected again according to the reference). In addition to resetting the determination unit 61, the imaging interval setting unit 43 resets the continuous imaging interval (for example, 1 / 15s) of the electronic imaging unit 2 to be equal to the search time after resetting (step S18). ).
Thereby, after the change of the rotation angle of the face image S, the number of times the subject is imaged by the electronic imaging unit 2 and the number of searches of the face image S by the detection determination unit 61 in the unit period can be made equal. Each time an image is captured, the face image S can be searched for the image.

  Next, the imaging control unit 4 displays the detected face image S (face detection frame W; refer to FIG. 4A, etc.) in the AF area or in accordance with the continuous imaging interval of the subject reset by the imaging interval setting unit 43. The image processing unit 5 performs adjustment control of subject imaging conditions such as automatic focusing processing (AF) and automatic exposure processing (AE) as an AE area (measurement target), and the image processing unit 5 is based on continuous imaging by the electronic imaging unit 2. The YUV data of the image frames (captured images) that are sequentially generated are sequentially recorded in the buffer memory 9 (step S19).

Next, as in the continuous imaging process of the first embodiment, the central control unit 12 determines whether or not the number of recorded images recorded in the buffer memory 9 has reached a predetermined continuous recording number (for example, 60). In response, it is determined whether or not an instruction to end recording of continuously captured images of the subject is detected (step S7).
Here, if it is determined that the recording end instruction has not been detected (step S7; NO), the central control unit 12 returns the process to step S6, and the number of recorded images is a predetermined continuous recording number (for example, 60). Subsequent processing is performed until the number of sheets reaches.
When it is determined in step S7 that a recording end instruction has been detected (step S7; YES), the central controller 12 determines a predetermined continuous recording number (for example, temporarily recorded in the buffer memory 9). 60 sheets) of recorded images are recorded in the image recording unit 8, and the continuous imaging process is terminated.

As described above, according to the imaging apparatus 200 of the second embodiment, when the rotation angle of the face image S newly detected in the face detection process in the continuous imaging process is changed, the rotation angle after the change is changed. The search time for searching for the face image S from the captured image for recording acquired from the buffer memory 9 can be determined again, and the search time and the search time according to the search time of the re-determined face image S are determined. It can be reset so that the continuous imaging interval for driving the electronic imaging unit 2 becomes equal.
Therefore, even after the search time of the face image S and the continuous imaging interval of the subject are once set according to the rotation angle of the face image S, even if the rotation angle of the detected face image S changes, the rotation angle The search time of the face image S after the change can be reset, and the non-detection state of the face image S is made difficult to occur by changing the continuous imaging interval of the subject according to the search time of the face image S. The face image S can be detected properly.

[Embodiment 3]
Hereinafter, an imaging apparatus 300 according to the third embodiment to which the present invention is applied will be described with reference to FIGS. 7 and 8.
FIG. 7 is a block diagram illustrating a schematic configuration of the imaging apparatus 300 according to the third embodiment.
The imaging apparatus 300 according to the third embodiment determines whether or not the face image S is no longer detected from the images for recording that are continuously captured in the continuous imaging process, and it is determined that the face image S is no longer detected. Then, the search time for searching the face image S from the captured image is determined again.
Note that the imaging apparatus 300 according to the third embodiment has substantially the same configuration as the imaging apparatus 100 according to the first embodiment except for the points described below, and a description thereof will be omitted.

The face detection processing unit 6, in addition to the detection determination unit 61 and the search time determination unit 62, determines whether or not the face image S is no longer detected from the recording image in the continuous imaging process. 64.
The face presence / absence determination unit 64 detects the face image S from the captured image according to the detection result of the face detection by the detection determination unit 61 after the continuous imaging interval is set by the imaging interval setting unit 43 in the continuous imaging process. Judge whether or not. Specifically, the detection determination unit 61 performs a process of detecting the face image S from each image frame each time image frames are sequentially generated by the image processing unit 5, and the face presence / absence determination unit 64 When the face image S is not detected in 61, it is determined that the face image S is no longer detected from the continuously captured images.
As described above, the face presence / absence determination unit 64 determines whether the face image (subject) S is not included in the image output from the electronic imaging unit 2 after the continuous imaging interval is set by the imaging interval setting unit 43. The third determination means is configured.

  When it is determined by the face presence / absence determination unit 64 that the face image S is no longer detected, the search time determination unit 62 searches for the face image S in the image frame acquired from the buffer memory 9 thereafter. Re-determine the search time required for Specifically, in the search time determination unit 62, the detection determination unit 61 performs face detection processing using facial feature amount information having a rotation angle of 90 ° between the vertical axis L0 and the rotated axis La. In other words, the search time is determined again so as to be longer than the longest search time associated with the rotation angle of the face image S.

  When the search time of the face image S is redetermined by the search time determination unit 62, the imaging interval setting unit 43 resets the continuous imaging interval of the electronic imaging unit 2 to be equal to the search time after the redetermination. .

Next, continuous imaging processing by the imaging apparatus 300 will be described with reference to FIG.
FIG. 8 is a flowchart illustrating an example of an operation related to continuous imaging processing.
In addition, when the face image S is no longer detected, the processing other than the processing related to resetting the search time of the face image S and the continuous imaging interval is substantially the same as the continuous imaging processing of the first embodiment. Description is omitted.

As shown in FIG. 8, first, similarly to the continuous imaging process of the first embodiment, the detection determination unit 61 of the face detection processing unit 6 performs for each image frame for live view display generated by the image processing unit 5. Face detection processing for detecting a human face image S using the face detection information d is performed, and whether or not the face image S is detected from the image frame that is the processing target according to the result of the face detection processing. Judgment is made (step S1).
Here, if it is determined that the face image S has been detected (step S1; YES), the search time determination unit 62 refers to the face detection information d and detects it as in the continuous imaging process of the first embodiment. A rotation angle in a predetermined direction around the reference axis of the face image S (for example, −θ1 °, etc .: see FIG. 4A) is specified (step S2).
If it is determined in step S1 that the face image S has not been detected (step S1; NO), the central control unit 12 proceeds to step S8, but the processes after step S2 are performed. Since it is the same as the continuous imaging process of the said Embodiment 1, the detailed description is abbreviate | omitted.

Subsequently, as in the continuous imaging process of the first embodiment, the search time determination unit 62 determines that the detection determination unit 61 subsequently displays the face image S at the rotation angle based on the specified rotation angle. The search time (for example, 1/30 s) of the face image S necessary for searching in the image frame acquired from is determined and set in the detection determination unit 61 (step S3).
Next, similarly to the continuous imaging process of the first embodiment, the imaging interval setting unit 43 of the imaging control unit 4 is equal to the search time according to the search time of the face image S determined by the search time determination unit 62. Thus, the continuous imaging interval (for example, 1/30 s) of the face image S by the electronic imaging unit 2 is set (step S4).

Subsequently, as in the continuous imaging process of the first embodiment, the central control unit 12 determines whether or not an instruction to start recording of continuously captured images of the subject is detected based on a predetermined operation of the shutter button of the operation input unit 11 by the user. Is determined (step S5).
If it is determined that the recording start instruction has not been detected (step S5; NO), the central control unit 12 returns the process to step S1.

  On the other hand, when it is determined in step S5 that a recording start instruction has been detected (step S5; YES), the imaging control unit 4 is set by the imaging interval setting unit 43 as in the continuous imaging process of the first embodiment. In accordance with the continuous imaging interval of the subject, automatic focus processing (AF) or automatic exposure with the detected face image S (face detection frame W; see FIG. 4A, etc.) as the AF area or AE area (measurement target) The image processing unit 5 performs adjustment control of subject imaging conditions such as processing (AE), and the image processing unit 5 stores, in the buffer memory 9, YUV data of image frames (captured images) sequentially generated based on continuous imaging by the electronic imaging unit 2. Recording is performed sequentially (step S6).

  Next, the face detection processing unit 6 determines whether or not the face image S is no longer detected from the captured images related to the continuous imaging by the electronic imaging unit 2 (step S27). Specifically, the detection determination unit 61 of the face detection processing unit 6 acquires, from the buffer memory 9, YUV data of an image frame (captured image) newly generated by the image processing unit 5 by continuous imaging by the electronic imaging unit 2. Then, face detection processing for detecting the face image S from the image frame is performed. Then, the face presence / absence determination unit 64 determines whether the face image S is no longer detected from the captured image in accordance with the detection result of the face detection by the detection determination unit 61.

If it is determined in step S27 that the face image S is not detected (step S27; NO), the central control unit 12 returns the process to step S6 and performs the subsequent processes.
On the other hand, when it is determined that the face image S is no longer detected (step S27; YES), the search time determination unit 62 detects the face image S in the image frame acquired from the buffer memory 9 thereafter. Re-decision so as to increase the search time required for the search (for example, 1/5 s) and reset the detection determination unit 61, and the imaging interval setting unit 43 is equal to the search time after the reset. Then, the continuous imaging interval (for example, 1/5 s) of the electronic imaging unit 2 is reset (step S28).
As a result, even when the face image S is no longer detected and the search time of the face image S is reset longer, the number of times the subject is imaged by the electronic imaging unit 2 in the unit period and the face image S by the detection determination unit 61 The search number of the face image S can be executed every time a recording image is captured.

  Next, the imaging control unit 4 applies the face image S (face detection frame W) set in a state where the face image S is detected according to the continuous imaging interval of the subject reset by the imaging interval setting unit 43. Adjustment control of subject imaging conditions such as automatic focusing processing (AF) and automatic exposure processing (AE) is performed based on the corresponding region or a predetermined AF area or AE area (measurement target) set in advance. Then, the image processing unit 5 sequentially records the YUV data of the image frames sequentially generated based on the continuous imaging by the electronic imaging unit 2 in the buffer memory 9 (Step S29).

Next, as in the continuous imaging process of the first embodiment, the central control unit 12 determines whether or not the number of recorded images recorded in the buffer memory 9 has reached a predetermined continuous recording number (for example, 60). In response, it is determined whether or not an instruction to end recording of continuously captured images of the subject is detected (step S7).
Here, if it is determined that the recording end instruction has not been detected (step S7; NO), the central control unit 12 returns the process to step S6, and the number of recorded images is a predetermined continuous recording number (for example, 60). Subsequent processing is performed until the number of sheets reaches.
When it is determined in step S7 that a recording end instruction has been detected (step S7; YES), the central controller 12 determines a predetermined continuous recording number (for example, temporarily recorded in the buffer memory 9). 60 sheets) of recorded images are recorded in the image recording unit 8, and the continuous imaging process is terminated.

As described above, according to the imaging apparatus 300 of the third embodiment, when the face image S is not detected from the recording images continuously captured in the face detection process in the continuous imaging process, the captured image is displayed. Since the search time for searching the face image S from the image is redetermined for a long time, it is possible to secure a longer time for detecting the face image S from the captured image, and to easily detect the face image S. Can do.
Furthermore, according to the re-determined search time for the face image S, the search time can be reset so that the continuous imaging interval for driving the electronic imaging unit 2 is equal, and the search time for the face image S can be set. Accordingly, it is possible to vary the continuous imaging interval of the subject.
Accordingly, even when the detection state of the face image S is changed to the non-detection state, the face image S can be easily detected again, and the face image S can be easily returned to the detection state.

The present invention is not limited to the above-described embodiment, and various improvements and design changes may be made without departing from the spirit of the present invention.
For example, even when the recording of the continuously captured image of the subject is started based on a predetermined operation of the shutter button of the operation input unit 11 by the user in a state where the face image S is not detected from the live view image, Face detection processing is performed during continuous imaging of recording images, and the search time of the face image S by the detection determination unit 61 and the continuous imaging interval by the electronic imaging unit 2 are determined according to the detected rotation angle of the face image S. May be reset (see FIG. 9).

<Modification 1>
Below, with reference to FIG. 9, the modification of a continuous imaging process is demonstrated.
Note that the processing other than the processing related to the resetting of the search time of the face image S and the continuous imaging interval after the face image S is detected is substantially the same as the continuous imaging processing of the first embodiment, and the detailed description thereof Is omitted.

As shown in FIG. 9, first, similarly to the continuous imaging process of the first embodiment, the detection determination unit 61 of the face detection processing unit 6 performs for each image frame for live view display generated by the image processing unit 5. Face detection processing for detecting a human face image S using the face detection information d is performed, and whether or not the face image S is detected from the image frame that is the processing target according to the result of the face detection processing. Judgment is made (step S1).
Here, if it is determined that the face image S is not detected (step S1; NO), the central control unit 12 uses the shutter button of the operation input unit 11 by the user as in the continuous imaging process of the first embodiment. Based on the predetermined operation, it is determined whether or not an instruction to start recording of continuously captured images of the subject has been detected (step S8).
If it is determined in step S1 that the face image S has been detected (step S1; YES), the central control unit 12 proceeds to step S2, but the processes after step S2 are performed as described above. Since it is the same as the continuous imaging process of Form 1, detailed description thereof is omitted.

If it is determined in step S8 that the recording start instruction has not been detected (step S8; NO), the central control unit 12 returns the process to step S1 as in the continuous imaging process of the first embodiment.
On the other hand, when it is determined in step S8 that a recording start instruction has been detected (step S8; YES), the imaging control unit 4 performs a predetermined continuous setting that is set in advance as in the continuous imaging process of the first embodiment. According to the imaging interval (fixed value), adjustment control of the imaging conditions of the subject such as automatic focusing processing (AF) and automatic exposure processing (AE) based on a predetermined AF area and AE area (measurement target) set in advance The image processing unit 5 sequentially records the YUV data of the image frames sequentially generated based on the continuous imaging by the electronic imaging unit 2 in the buffer memory 9 (step S9).

Next, the detection determination unit 61 performs face detection processing for detecting a human face image S using the face detection information d for each recording image frame generated by the image processing unit 5, and performs the face detection. It is determined whether or not the face image S is detected from the image frame to be processed according to the processing result (step S31).
Here, if it is determined that the face image S is not detected from the image frame for recording (step S31; NO), the central control unit 12 stores the buffer memory 9 in the same manner as the continuous imaging process of the first embodiment. It is determined whether or not an instruction to end recording of continuously captured images of the subject has been detected, depending on whether or not the number of recorded images has reached a predetermined continuous recording number (for example, 60) (step S10). ).

  If it is determined in step S10 that the recording end instruction has not been detected (step S10; NO), the central control unit 12 returns the process to step S9 and performs the subsequent processes. Thereafter, when it is determined in step S10 that a recording end instruction has been detected (step S10; YES), the central controller 12 determines a predetermined continuous recording number (for example, temporarily recorded in the buffer memory 9). 60 sheets) of recorded images are recorded in the image recording unit 8, and the continuous imaging process is terminated.

On the other hand, if it is determined in step S31 that the face image S has been detected (step S31; YES), the search time determination unit 62 refers to the face detection information d and uses the detected face image S as a reference. A rotation angle in a predetermined direction about the axis (for example, -θ1 °, etc .: see FIG. 4A) is specified (step S32).
Subsequently, based on the specified rotation angle, the search time determination unit 62 causes the detection determination unit 61 to search for a face image S at the rotation angle in an image frame acquired from the buffer memory 9 thereafter. After determining the search time (for example, 1/30 s) of the face image S necessary for the detection and setting it in the detection determination unit 61, the imaging interval setting unit 43 of the imaging control unit 4 is determined by the search time determination unit 62. In accordance with the search time of the face image S, the continuous imaging interval (for example, 1/30 s) of the face image S by the electronic imaging unit 2 is set to be equal to the search time (step S33).
Accordingly, the number of times the subject is imaged by the electronic imaging unit 2 in the unit period can be made equal to the number of times the face image S is searched by the detection determination unit 61, and each time an image for recording is taken, The search for the face image S can be executed.

  Thereafter, the imaging controller 4 detects the detected face image S (face detection frame W; see FIG. 4A, etc.) according to the continuous imaging interval of the subject set by the imaging interval setting unit 43, as in step S6. The image processing unit 5 is controlled by the electronic imaging unit 2 by performing adjustment control of subject imaging conditions such as automatic focusing processing (AF) and automatic exposure processing (AE) in which AF is an AF area or AE area (measurement target). YUV data of image frames (captured images) sequentially generated based on continuous imaging is sequentially recorded in the buffer memory 9 (step S34).

Next, the central control unit 12 ends the recording of the continuously captured images of the subject depending on whether or not the number of recorded images recorded in the buffer memory 9 has reached a predetermined continuous recording number (for example, 60). It is determined whether or not an instruction has been detected (step S35).
Here, if it is determined that the recording end instruction has not been detected (step S35; NO), the central control unit 12 returns the process to step S34, and the number of recorded images is a predetermined continuous recording number (for example, 60). Subsequent processing is performed until the number of sheets reaches.
When it is determined in step S35 that a recording end instruction has been detected (step S35; YES), the central control unit 12 determines a predetermined continuous recording number (for example, temporarily recorded in the buffer memory 9). 60 sheets) of recorded images are recorded in the image recording unit 8, and the continuous imaging process is terminated.

  Therefore, even when the recording of the continuously captured image of the subject is started in the non-detected state of the face image S, the detected face image is obtained by performing the face detection process during the continuous imaging of the recording image. In accordance with the rotation angle of S, the search time of the face image S for searching for the face image S at the rotation angle from the captured image for recording acquired from the buffer memory 9 is determined. Depending on the search time of the face image S, the search time and the continuous imaging interval for driving the electronic imaging unit 2 can be set to be equal. As a result, even when the face image S is returned from the non-detected state to the detected state, the number of times the subject is imaged and the number of times the face image S is searched from the captured image in the unit period during the continuous imaging of the recording image. And the search for the face image S for the image is performed every time the image for recording is imaged by imaging for a predetermined continuous recording number (for example, 60). it can.

In Embodiments 1 to 3 and Modification 1, the specific continuous imaging process is executed. However, the present invention is not limited to this, and at least two of these continuous imaging processes are performed. You may make it perform combining a process suitably.
That is, for example, by combining each of the continuous imaging processes of Embodiments 2 and 3 and the continuous imaging process of Modification Example 1, recording of a continuously captured image of a subject is started in a non-detected state of the face image S from the live view image. Even when the image is recorded, the face detection process is performed during continuous imaging of the recording image, and the search time of the face image S by the detection determination unit 61 is determined according to the rotation angle of the detected face image S. The continuous imaging interval by the electronic imaging unit 2 may be reset. Further, for example, when it is determined that the rotation angle of the newly detected face image S is changed in the continuous imaging process by combining the continuous imaging processes of Embodiments 2 and 3, the rotation after the change is performed. The search time for searching the face image S at an angle from the captured image is redetermined, and if it is determined that the face image S is no longer detected, the search time for searching the face image S from the captured image is redetermined. You may make it do. Further, for example, the combination of the continuous imaging processes of Embodiments 2 and 3 may be combined with the continuous imaging process of Modification 1.

In addition, the configurations of the imaging apparatuses 100, 200, and 300 are merely examples, and are not limited to those illustrated in the above embodiment.
Furthermore, the human face image S is exemplified as the subject. However, the human face image S is an example, and the present invention is not limited to this. For example, face images of various animals such as pets can be arbitrarily changed.
Further, in the determination of the search time for the face image S, the rotation angle around the reference axis of the face image is taken into account, but in addition to this, for example, the rotation direction of the face image is also taken into account. Also good.

In addition, in the above embodiment, the functions as the first determination unit, the determination unit, and the setting unit are controlled by the detection determination unit 61 of the face detection processing unit 6 and the search time determination under the control of the central control unit 12. However, the present invention is not limited to this, and a predetermined program or the like is executed by the CPU of the central control unit 12. It is good also as a structure implement | achieved by.
That is, a program including a first determination processing routine, a determination processing routine, and a setting processing routine is stored in the program memory 10 that stores the program of the imaging apparatus 100. Then, based on the detection information stored in the information storage means in association with each of a plurality of rotation angles about the reference axis of the subject, the CPU of the central control unit 12 is stored in the information storage means by the first determination processing routine. You may make it function as a 1st judgment means to judge whether a to-be-photographed object is included in the image output from the imaging means. Further, when the CPU of the central control unit 12 determines that the subject is included by the first determination unit by the determination processing routine, the rotation angle of the subject is determined according to the rotation angle about the reference axis of the subject. You may make it function as a determination means to determine the search time for searching a to-be-photographed object from the image output from the imaging means. Further, the CPU of the central control unit 12 may function as a setting unit that sets an interval for driving the imaging unit by the imaging control unit in accordance with the search time determined by the determination unit by the setting process routine.

  Similarly, the second determination unit and the third determination unit may be realized by executing a predetermined program or the like by the CPU of the central control unit 12.

  Furthermore, as a computer-readable medium storing a program for executing each of the above processes, a non-volatile memory such as a flash memory or a portable recording medium such as a CD-ROM is applied in addition to a ROM or a hard disk. Is also possible. A carrier wave is also used as a medium for providing program data via a predetermined communication line.

DESCRIPTION OF SYMBOLS 100 Imaging device 1 Lens part 2 Electronic imaging part 4 Imaging control part 42 Electronic imaging part drive part 43 Imaging interval setting part 6 Face detection process part 61 Detection judgment part 62 Search time determination part 63 Angle change judgment part 64 Face presence judgment part 8 Image recording unit 12 Central control unit d Face detection information

Claims (6)

An imaging control unit that continuously drives the imaging unit at a predetermined interval to output an image from the imaging unit;
Information storage means for storing each of a plurality of rotation angles around the reference axis of the subject in association with detection information for detecting the subject;
First determination means for determining whether or not the subject is included in an image output from the imaging means based on the detection information stored in the information storage means;
When it is determined by the first determination means that the subject is included, a subject at the rotation angle is searched from the image output from the imaging means according to the rotation angle about the reference axis of the subject. Determining means for determining a search time for
Setting means for setting an interval for driving the imaging means by the imaging control means according to the search time determined by the determining means;
An imaging apparatus comprising: After setting by the setting means, further comprising second determination means for determining whether or not the rotation angle of the subject newly specified by the determination means has changed from the rotation angle of the subject specified last time;
The determining means includes
When it is determined by the second determination means that the rotation angle of the subject has changed, a search time for searching for an object having the changed rotation angle from the image output from the imaging means is re-determined. The imaging apparatus according to claim 1. After setting by the setting means, further comprising third determination means for determining whether or not the subject is no longer included in the image output from the imaging means;
The determining means includes
The detection time for detecting a subject from the image output from the imaging unit is determined when the third determination unit determines that the subject is no longer included. Imaging device.   The imaging apparatus according to claim 1, further comprising an image recording unit that records an image output from the imaging unit. Imaging control means for continuously driving the imaging means at predetermined intervals to output an image from the imaging means, each of a plurality of rotation angles around the reference axis of the subject, and detection for detecting the subject An information processing unit that stores information in association with each other, and an imaging processing method using an imaging device comprising:
A process of determining whether or not the subject is included in an image output from the imaging unit based on the detection information stored in the information storage unit;
When it is determined that the subject is included, a search time for searching the subject at the rotation angle from the image output from the imaging unit is determined according to the rotation angle about the reference axis of the subject. Process to determine,
A process of setting an interval for driving the imaging means by the imaging control means according to the determined search time;
The imaging processing method characterized by performing. Imaging control means for continuously driving the imaging means at predetermined intervals to output an image from the imaging means, each of a plurality of rotation angles around the reference axis of the subject, and detection for detecting the subject A computer of an imaging apparatus comprising: information storage means for storing information in association with each other,
First determination means for determining whether or not the subject is included in the image output from the imaging means based on the detection information stored in the information storage means;
When it is determined by the first determination means that the subject is included, a subject at the rotation angle is searched from the image output from the imaging means according to the rotation angle about the reference axis of the subject. A determining means for determining a search time for
Setting means for setting an interval for driving the imaging means by the imaging control means in accordance with the search time determined by the determining means;
A program characterized by functioning as

Images