JP6366001B2 - Imaging apparatus, imaging method, and program - Google Patents

Description

  The present invention relates to an imaging apparatus, an imaging method, and a program for imaging the same subject a plurality of times.

  2. Description of the Related Art Conventionally, an imaging apparatus such as a digital still camera obtains a shot image of the best shot under conditions such as a smile and good face orientation as an image to be recorded from among continuously shot images. Therefore, instead of continuously shooting in the dark clouds, the feature point is extracted from the face portion in the image, and the best image is extracted from the images taken when the amount of change exceeds a predetermined threshold. The technique (refer patent document 1) made like this is disclosed.

JP 2009-89077 A

  However, the technique of the above-mentioned patent document is a technique for extracting the best shot image from each of the continuously shot images, but it is not always the shot that only a smile wants to shoot, It was not a technology that could meet the desire to photograph various desired facial expressions (for example, changes in facial expressions).

  An object of the present invention is to make it possible to capture the same subject evenly in various desired states.

In order to solve the above-described problems, an imaging apparatus of the present invention
Evaluation means for evaluating the state of the subject imaged by the imaging means at a plurality of types of evaluation points;
First discriminating means for discriminating whether each of the evaluation points of the plurality of types of evaluation points evaluated by the evaluation unit satisfies a first condition;
A first imaging control unit that instructs the imaging unit to record the captured image every time it is determined by the first determination unit that the first condition is satisfied;
An evaluation history storage means for temporarily storing, as an evaluation history, that the first condition is satisfied each time the first determination means determines that the first condition is satisfied;
A second discriminating unit that discriminates whether or not all of the plurality of types of evaluation points of interest are stored as the evaluation history by the evaluation history storage unit;
When the second discriminating unit discriminates that all the points of interest of the plurality of types of evaluation are stored as the evaluation history , the image recording end to the first imaging control unit is terminated. Second imaging control means for instructing;
An image pickup apparatus comprising:

In order to solve the above-described problem, the imaging method of the present invention includes:
Evaluating the state of the subject being imaged by the imaging means at a plurality of points of interest for evaluation;
A step of evaluation of each of the target points of the evaluation of the estimated said plurality of types it is determined whether the first condition is satisfied,
Instructing the imaging means to record the captured image every time it is determined that the first condition is satisfied;
Each time it is determined that the first condition is satisfied, temporarily storing that the first condition is satisfied as an evaluation history;
Determining whether all of the plurality of types of evaluation points of interest are stored as the evaluation history ;
Instructing the end of image recording when it is determined that all the points of interest of the plurality of types of evaluation are stored as the evaluation history ;
The imaging method characterized by including.

In order to solve the above-described problems, the program of the present invention
Against the computer,
A function of evaluating the state of the subject being imaged by the imaging means at a plurality of points of interest for evaluation;
A function of the evaluation of each of the target points of the evaluation of the estimated said plurality of types it is determined whether the first condition is satisfied,
A function of instructing the image capturing unit to record the captured image every time it is determined that the first condition is satisfied;
A function of temporarily storing, as an evaluation history, that the first condition is satisfied each time it is determined that the first condition is satisfied;
A function of determining whether or not all the points of interest of the plurality of types of evaluation are stored as the evaluation history ;
A function of instructing the end of image recording when it is determined that all the points of interest of the plurality of types of evaluation are stored as the evaluation history ;
It is a program for realizing.

  According to the present invention, the same subject can be captured evenly in various desired states.

The block diagram which showed the basic component of the digital camera applied as an imaging device. The figure for demonstrating the evaluation table 3D of 1st Embodiment. 6 is a flowchart for explaining a shooting operation that is started when the diversified shooting function is turned on in the first embodiment. The flowchart which showed the operation | movement following FIG. The figure which showed the example of a display of a photography continuation confirmation screen in 1st Embodiment. The figure which showed the reproduction | regeneration screen which displayed each image | photographed image of the various expression changes of a to-be-photographed object's face in 1st Embodiment. (1) is a diagram for explaining the evaluation table 3D of the second embodiment, and (2) is for explaining a setting screen when the first condition of the second embodiment is arbitrarily set by a user operation. Illustration. 9 is a flowchart for explaining a shooting operation that is started when a diversified shooting function is turned on in the second embodiment. (1) is a diagram illustrating an imaging guide screen for identifying and displaying evaluation results during imaging in the second embodiment, and (2) is a diagram illustrating a display example of an imaging continuation confirmation screen in the second embodiment. . The flowchart for demonstrating the 1st modification of 2nd Embodiment. The flowchart for demonstrating the 2nd modification of 2nd Embodiment. In the 2nd modification of 2nd Embodiment, the figure which illustrated the imaging | photography guidance screen which identifies and displays an evaluation result during imaging.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
(First embodiment)
First, a first embodiment of the present invention will be described with reference to FIGS.
FIG. 1 is a block diagram showing basic components of a digital camera applied as an imaging apparatus.
This digital camera has a high-definition imaging function, a timekeeping function that measures the current date and time and timer time, an image playback function that arbitrarily reads and plays recorded and saved images (stored images), etc. In addition, the present embodiment includes a diversified shooting function (described in detail later) that uniformly shoots changes in various states of the subject (for example, changes in facial expression). The control unit 1 operates by supplying power from the power source unit (secondary battery) 2 and controls the overall operation of the digital camera according to various programs stored in the storage unit 3. The unit 1 is provided with a CPU (Central Processing Unit) and a memory (not shown).

  The storage unit 3 includes, for example, a ROM, a flash memory, and the like, and stores a program and various applications for realizing the present embodiment in accordance with an operation procedure illustrated in FIGS. 3 and 4 to be described later. A program memory 3A, a work memory 3B that temporarily stores flags, an image memory 3C that compresses and records captured images, and an evaluation table 3D described later. The storage unit 3 may include a removable portable memory (recording medium) such as an SD card or an IC card, and is connected to a network via a communication function (not shown). The state may include a storage area on a predetermined server device side.

  Although not shown, the operation unit 4 switches between an operation mode (shooting mode) in which shooting can be performed and an operation mode (playback mode) in which a captured image (saved image) is played back. In addition to a mode change button for switching to a shooting mode and a release button for instructing the start of shooting, various push button type operations for setting shooting conditions such as exposure and shutter speed, and selecting an image to select a playback target The control unit 1 performs, for example, a mode change process, a shooting process, setting of shooting conditions, an image selection process, and the like as a process according to the input operation signal from the operation unit 4.

  Although not shown, the imaging unit 5 is capable of photographing a subject with high definition by forming a subject image from an optical lens on an imaging element (CCD, CMOS, etc.). , Strobe, various sensors, analog processing unit, digital processing unit. The image captured by the imaging unit 5 is subjected to an image compression process in which the image is compressed by the control unit 1, and then recorded and stored in the image memory 3C. The touch display unit 6 has a transparent touch panel laminated on a display screen such as a high-definition liquid crystal, and assigns and arranges various software keys (touch keys) to display the function name or touch with a finger or the like. An operation signal corresponding to the touch operation is input by sensing the operation. The display screen of the touch display unit 6 is a monitor screen (live view screen) that displays captured images (live view images) in real time, or a playback screen that plays back captured images.

  The face detection unit 7 constitutes a function for recognizing a subject (for example, a person) included in a captured image (live view image). The face detection unit 7 captures an image from the imaging unit 6 and performs image analysis for each frame. Detects the face part of the subject from within the image, and comprehensively determines the shape, position, size, etc. of each baht (eyes, mouth, nose, forehead, etc.) that the face forms to detect face changes Like to do. The function of the face detection unit 7 is a technique that is generally used in a camera, and in the present embodiment, the well-known technique is used. And

FIG. 2 is a diagram for explaining the evaluation table 3D.
The evaluation table 3D is used for evaluating the state of the subject, for example, the state of facial expression, based on an image (live view image) obtained by imaging the subject (for example, a person) when the diversified shooting function described above is activated. It is a table to be referenced. The control unit 1 obtains a live view image of the subject imaged by the imaging unit 5 and refers to the evaluation table 3D, whereby a plurality of types of attention points (parts (face, mouth, The combination of one or more of eyes etc.) and one or more of viewpoints (size, orientation, etc.) for evaluating the part).

  The evaluation table 3D is configured to have items of “evaluation point of interest”, “evaluation value”, and “weighting”. In the example shown in FIG. As a point of interest, “face size”, “mouth size”, and “eye openness” are stored. The “evaluation point of interest” is not limited to “face size”, “mouth size”, and “openness”. The evaluation table 3D may be a general-purpose table generated from a standard face. For example, the evaluation table 3D is set to the maximum and minimum values for each point of interest for evaluation such as the mouth being most widely opened or closed. A table generated by photographing the corresponding image in advance for each subject may be used, thereby enabling highly accurate evaluation.

  Further, in the item of “evaluation value”, “1”, “2”, “3”, “4” are provided in order to evaluate the state at the point of interest of the evaluation in a plurality of levels (for example, five levels). Evaluation values of “,” “5” are stored. In this case, the “evaluation value” of the “face size” is “1 (small)” <,..., <5 (large), and the “evaluation value” of the “mouth size” is , "1 (small)" <, ..., <"5 (large)" relationship, "evaluation value" corresponding to "eye openness" is "1 (closed)" <, ..., < The relationship is “5 (clearly open)”. The control unit 1 evaluates the states at a plurality of points of interest for each evaluation at predetermined timings (for example, 30 ms), and the amount of change for each point of interest of each evaluation (the current evaluation value) from the evaluation results of the previous and next timings. And the difference between the previous evaluation value) and the amount of change for each point of interest in each evaluation is summed.

  “Weighting” indicates weighting when summing the amount of change for each point of interest in each evaluation. In the example shown in the figure, “weighting” of “face size” is “x”, “mouth size”. In this example, “weight” is “y” and “weight” of “eye size” is “z”. Note that the value of “weighting” is a value selected from “1” to “5”, and can be arbitrarily set by a user operation.

  The control unit 1 follows the following calculation formula when evaluating the state of the subject in the image captured by the imaging unit 5 at every predetermined evaluation timing (for example, 30 ms) when the diversified shooting function is activated. Calculation is executed to determine whether or not the evaluation result satisfies the first condition. That is, the control unit 1 evaluates the state of each of the plurality of evaluation points of interest for each predetermined evaluation timing, and the amount of change for each point of interest of each evaluation (the current evaluation value and the previous time) from the evaluation results of the previous and subsequent timings. (Difference from evaluation value) is determined, and it is determined whether or not the first condition is satisfied based on whether or not the sum of the amount of change (absolute value) for each point of interest in each evaluation exceeds a predetermined threshold. I am doing so.

First condition: x * | A (a) −B (a) | + y * | A (b) −B (b) | + z * | A (c) −B (c) |> predetermined threshold parameter “ “A (a)” and “B (a)” indicate the current evaluation value and the previous evaluation value with “face size” as the focus of evaluation. The parameters “A (b)” and “B (b)” indicate the current evaluation value and the previous evaluation value with “mouth size” as a focus of evaluation. The parameters “A (c)” and “B (c)” indicate the current evaluation value and the previous evaluation value with “eye openness” as a point of interest for evaluation. Further, the parameters “x, y, z” indicate weight values to be multiplied by the amount of change for each point of interest in each evaluation (difference between the current evaluation value and the previous evaluation value).

  When the control unit 1 determines that the total amount of change for each point of interest in each evaluation exceeds a predetermined threshold, that is, when it is determined that the first condition is satisfied, the control unit 1 An instruction to shoot (instruct to record an image) is obtained, and an image taken at that time (when the condition is satisfied) is acquired as a storage target and recorded and saved. That is, every time the face state (expression) changes momentarily so as to satisfy the first condition, an image obtained by capturing the state (expression) at that time is recorded and saved. Here, in the present embodiment, it is possible to arbitrarily set an evaluation value for each point of interest of a plurality of evaluations desired depending on what kind of image the subject is photographed and when it is desired. The evaluation value for each target point of gray evaluation given in 3D indicates the evaluation value for each target point of evaluation set arbitrarily by the user operation. In the illustrated example, evaluation values “3” to “5” for “face size”, evaluation values “1” to “5” for “face size”, and evaluation value “1” for “eye openness”. “,” “3,” and “5” indicate evaluation values for each point of interest of evaluation set by the user.

  Such diversified photographing is automatically terminated when photographing satisfying the second condition is performed. That is, every time shooting is performed while satisfying the first condition, the control unit 1 temporarily stores an evaluation value for each target point of evaluation at that time as an evaluation history, and is arbitrarily selected in advance by a user operation. Based on whether or not all of the set evaluation values for each point of interest of the plurality of evaluation points are stored as the evaluation history (based on whether or not the second condition is satisfied), the diversification shooting is terminated. Whether or not to control.

  The second condition is that when an evaluation value for each point of interest of a plurality of evaluations (the above-described gray evaluation value) is set, all the gray evaluation values are stored as an evaluation history (gray The condition is that shooting has been performed for all of the evaluation values, that is, the shooting has been performed with various expressions corresponding to the gray evaluation value). When shooting that satisfies the above condition is performed, diversified shooting is automatically terminated (recording of the image is terminated). If any one of the gray evaluation values is included in the first condition when the first condition is satisfied, shooting is performed with a facial expression corresponding to the gray evaluation value. It is assumed. That is, when the evaluation value of “face size” is 5, the evaluation value of “mouth size” is 4, and the evaluation value of “eye openness” is 2, the gray evaluation value In this case, the evaluation of “face size” corresponding to “5” and the evaluation value of “mouth size” of 4 are performed.

  As described above, in the first embodiment, the imaging apparatus (digital camera) evaluates the state of the subject imaged by the imaging unit (imaging unit 5) at the point of interest for evaluation (the control unit 1, the program memory 3A, Face detection unit 7, evaluation table 3D) and first determination unit (control unit 1, program memory) for determining whether or not the evaluation of the point of interest of the evaluation evaluated by the evaluation unit satisfies a first condition 3A) and first imaging control means (control unit 1, program memory for instructing the imaging means to record an image captured each time it is determined by the first determination means that the first condition is satisfied. 3A, evaluation table 3D) and a second discriminating means for discriminating whether or not the evaluation by the evaluation means when the image recording instruction is given by the first imaging control means satisfies the second condition. (The control unit 1, the program memory 3A, the evaluation table 3D) and when the second discriminating means discriminates that the second condition is satisfied, the image recording control unit records an image. Second imaging control means (control unit 1, program memory 3A) for instructing termination.

  Next, the operation concept of the imaging apparatus (digital camera) in the first embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in this flowchart is stored in the form of a readable program code, and operations according to the program code are sequentially executed. Further, it is possible to sequentially execute the operation according to the above-described program code transmitted via a transmission medium such as a network. The same applies to other embodiments described later. In addition to the recording medium, an operation peculiar to the present embodiment can be executed using a program / data supplied externally via a transmission medium. FIGS. 3 and 4 are flowcharts showing an outline of the operation of the characteristic part of the present embodiment in the overall operation of the digital camera. When leaving the flowchart of FIG. 3, the main flow of the overall operation is shown. Return to (not shown).

3 and 4 are flowcharts for explaining a photographing operation that is started when the diversified photographing function is turned on.
First, the control unit 1 sets a shooting condition such as exposure, sets a first condition, and sets a second condition as conditions related to shooting (step A1 in FIG. 3). In this case, “weighting” of the evaluation table 3D is set as the first condition, and the gray evaluation value of the above-described evaluation table 3D is set as the second condition. Here, when a shutter operation for instructing the start of diversified shooting is performed (step A2), after the timer measurement operation is started (step A3), it is checked whether the evaluation timing (for example, every 30 ms from the start of shooting). (Step A4). If it is not the evaluation timing (NO in step A4), it is checked whether a predetermined time (for example, 10 minutes) has elapsed from the start of photographing based on the timer measurement time (step A5). If the predetermined time has not elapsed. (NO in step A5), the process returns to step A4 described above.

  If it is now the evaluation timing (YES in step A4), the process proceeds to the flowchart of FIG. 4 to acquire the image captured by the imaging unit 5 (step A8) and operate the face detection unit 7 to be included in the image. The state of the subject (person) being detected is detected for each point of interest in each evaluation (step A9). In this case, the face part of the subject is detected from the image, and the face is recognized by comprehensively judging the shape, position, size, etc. of each baht (eyes, mouth, etc.) formed by the face, A state for each point of interest (“face size”, “mouth size”, “eye openness”) is detected. Then, the evaluation table 3D is referred to based on the detected state for each evaluation point of interest, and each state is evaluated in five stages to obtain an evaluation value for each of the evaluation points of interest (step A10). For example, the evaluation value of “face size” is “2”, the evaluation value of “mouth size” is “4”, and the evaluation value of “openness of eyes” is “3”. Obtain point-by-point evaluation values.

Then, the evaluation values B (a), B (b), and B (c) for each target point of the evaluation obtained at the previous evaluation timing are read from the work memory 3B (step A11). Here, the evaluation values A (a), A (b), A (c) for each evaluation point obtained at the current evaluation timing and the evaluation values for each evaluation point obtained at the previous evaluation timing. Using B (a), B (b), and B (c), evaluation calculation is performed according to the following equation (step A12).
x * | A (a) -B (a) | + y * | A (b) -B (b) | + z * | A (c) -B (c) |
It is checked whether or not the first condition is satisfied based on whether the calculation result (total value) exceeds a predetermined threshold (step A13).
In the first shooting, there is no evaluation value for each point of interest of the evaluation obtained at the previous evaluation timing, so that processing is skipped.

Here, if the first condition is not satisfied (NO in step A13), the imaging unit 5 is not instructed to perform imaging, and the process proceeds to step A5 where it is checked whether a predetermined time has elapsed from the start of imaging. When the above condition is satisfied (YES in step A13), a shooting instruction is given to the imaging unit 5, the shot image at that time is acquired as a storage target, compressed, and stored in the image memory 3C (step S13). A14). Then, the evaluation value for each point of interest of the evaluation obtained at the current evaluation timing is temporarily stored in the work memory 3B as an evaluation history of photographing (step A15), and the evaluation value for each point of interest of the evaluation Is stored in the image memory 3C in association with the photographed image (step A16).
Even when the first condition is not satisfied and a shooting instruction is given to the imaging unit 5, the evaluation value for each target point of evaluation obtained at the current evaluation timing is determined by the target point of the previous evaluation. The evaluation value may be temporarily stored in the work memory 3B.

  Next, with reference to the evaluation history in which shooting is temporarily stored in the work memory 3B (step A17), it is determined whether or not the second condition is satisfied (step A18). As described above, the second condition is that the shooting with the gray evaluation value given in the evaluation table 3D is all performed, and when the second condition is satisfied (YES in step A18). After instructing the imaging unit 5 to end the diversified shooting and performing the shooting end process (step A19), the process goes out of the flow of FIGS. 3 and 4, but the second condition is not satisfied (step A18). NO), the process proceeds to step A5 where it is checked whether a predetermined time has elapsed, and the above-described operation is repeated.

Here, when a predetermined time has elapsed from the start of shooting before satisfying the second condition (YES in step A5), the second condition is not satisfied (evaluation for each set evaluation point of interest). A non-photographing guidance message is displayed that guides that photographing with a value has not been completed (step A6). FIG. 5 is a diagram showing a display example of a shooting continuation confirmation screen including an unshooting guidance message indicating that shooting is not performed as set, and a shooting continuation confirmation message inquiring whether to continue shooting.
In the example shown in the figure, as an unphotographed guidance message, 10 minutes have passed since the start of photography, and evaluation values “mouth size 5” and “eye openness 3” for each point of interest for evaluation have not yet been photographed. And a case where a button [SET] instructing “continue” and a button [MENU] instructing “not continue” are displayed as confirmation messages for inquiring whether to continue shooting. Show.

  Here, it is checked whether or not an instruction to continue shooting is instructed in response to an operation of the instruction button [SET] or [MENU] on the operation unit 4 by the user (step A7). Sometimes (YES in step A7), the measurement time is reset, and the process returns to step A4 to check whether it is the evaluation timing, but when it is instructed not to continue by the operation of the button [MENU] (NO in step A7), shooting is performed. After the termination process (step A19) is performed, the process exits from the flowcharts of FIGS.

FIG. 6 is a view showing a reproduction screen displaying a list of each photographed image of various facial expression changes of the subject's face obtained by diversified photography.
In a state where each captured image captured during diversified imaging is recorded and stored together with the evaluation result, the control unit 1 reads out each captured image when an instruction to reproduce the captured image is given by a user operation. The list is rearranged based on the evaluation result. In this case, that is, each image is displayed as a list on a multi-dimensional screen (a two-dimensional screen in the example shown in the figure) having a plurality of target points for evaluation arbitrarily selected and set in advance by a user operation. .

  That is, in addition to an operation for instructing the reproduction of an image, when an operation for selecting any two kinds of evaluation focus points, for example, “mouth size” and “eye openness”, is performed. Each captured image to be reproduced is read out from 3C, and a 5 × 5 matrix reproduction screen (two-dimensional screen) is displayed on the touch display unit 6. Now, since “mouth size” and “eye openness” are selected by a user operation, evaluation of “mouth size” as a focus of evaluation in the horizontal direction of the playback screen (matrix screen) Values “1” to “5” are assigned, and evaluation values “1” to “5” of “eye openness” are assigned as evaluation points of interest in the vertical direction of the screen.

  Then, the control unit 1 generates a thumbnail of each captured image to be reproduced, and displays the thumbnail at the corresponding position in the matrix. In this case, since each photographed image is associated with an evaluation value for each point of interest for evaluation, the control unit 1 refers to the evaluation value for each point of interest for evaluation and displays it at a corresponding position. . In the figure, in the cell (cell), a symbol surrounded by a circle indicates a thumbnail display of the photographed image, and the evaluation value for each point of interest for evaluation of the position of the cell, that is, “mouth size” In addition, it is shown that the image was taken when “eye openness” is in the corresponding state (evaluation value). In such a matrix-like playback screen, the squares (blanks) without the thumbnail display described above indicate that shooting has not been performed in the corresponding state (evaluation value).

  When an image selection operation for tapping an arbitrary square is performed in a state where such a reproduction screen (thumbnail list screen) is displayed on the touch display unit 6, the control unit 1 corresponds to the tapped square. The number of shot images to be detected is determined. If there is one shot image, the thumbnail list screen is switched to a screen in which the image is enlarged, but if a plurality of images corresponding to one square are shot, For example, the thumbnail of the next image is switched and displayed on the corresponding square. In this case, when the thumbnail display is double-tapped, the screen is switched to an enlarged display of the image.

  As described above, in the first embodiment, the control unit 1 detects the state of the subject imaged by the imaging unit 5 using a plurality of evaluation points of interest, and refers to the evaluation table 3D to thereby determine the points of interest of the plurality of evaluations. Is evaluated individually, and whether or not the first condition is satisfied is determined based on the evaluation value for each point of interest of the evaluation, and imaging is instructed to the imaging unit 5 every time the first condition is satisfied ( Since the recording of the image is instructed), and when the photographing satisfying the second condition is performed, the photographing unit 5 is instructed to end the photographing (the instruction to end the recording of the image). In addition to the best state of the subject, various changes in the state can be captured evenly. In this case, a shutter for instructing the start of diversified shooting is used. However, captured images in various states can be obtained by operating this shutter once.

  The control unit 1 evaluates each state at the point of interest of the evaluation for each predetermined timing, obtains a change amount for each point of interest of each evaluation from the evaluation result of the preceding and following timings, and determines the amount of each evaluation for each point of interest. Since it is determined whether or not the first condition is satisfied based on the amount of change, depending on the interval of the evaluation timing, even subtle changes in each state can be accurately grasped and evaluated. You can shoot the state.

  Since the first condition is a conditional expression that uses the amount of change for each point of interest in each evaluation as a parameter, it is possible to perform an evaluation that accurately captures the change in each state (overall change).

  Since the first condition is information on the condition that the total value of the amount of change for each point of interest in each evaluation exceeds a predetermined threshold value, it is possible to evaluate the entire large change accurately.

  Since the first condition is condition information that can be set by associating weights for calculating the total amount of change amount for each point of interest in each evaluation with each state, changes in each state (overall change) When evaluating by capturing, it is possible to set which state change should be evaluated and to further increase the degree of freedom.

  Since the control unit 1 refers to the evaluation table 3D and determines whether or not the first condition is satisfied based on the evaluation value for each target point of the evaluation that has been evaluated in stages as the evaluation result, for example, different Each type of state can be evaluated in the same five stages, and evaluation without variations for each state is possible.

  The control unit 1 temporarily stores an evaluation value for each point of interest of the evaluation when the first condition is satisfied as an evaluation history, and variously based on whether or not photographing satisfying the second condition has been performed. Since it is controlled whether or not to instruct the end of the digitized shooting, the diversified shooting can be continued until the shooting as set by the user is performed, and when the shooting set by the user is completed, Diversified shooting can be terminated.

If the second condition is not satisfied even after a predetermined time has elapsed since the start of diversified shooting, the control unit 1 guides and displays unshooted images that have not been shot as set. Therefore, the photographer can notify the subject of the unphotographed state and request a facial expression, or can forcibly terminate diversified photography after confirming the non-photographing.
In the above-described embodiment, the guide for displaying non-photographing is displayed according to the time since the start of diversified shooting. However, the number of shots since the start of diversified shooting exceeds a predetermined number. However, if the second condition is not satisfied, the unphotographed guidance may be displayed.

  When the reproduction of the captured image is instructed in a state where each captured image captured by the imaging instruction is stored in association with the evaluation result, the control unit 1 arranges the captured images based on the evaluation result. Since the list is displayed instead, it is possible for the user to easily check how the states change in one screen.

  Since the control unit 1 performs multi-dimensional list display with a plurality of states as dimensions, it becomes a display screen that is easy to see, and it is easy to check the change of the state.

  Since the subject is a person and the state is a facial expression, it is possible to obtain a plurality of images that accurately capture the change (expression) of the person's face.

  Note that, in the first embodiment described above, when each captured image is reproduced and rearranged based on the evaluation result and displayed as a list, two images arbitrarily selected and set by a user operation in advance as shown in FIG. Although the list is displayed on the two-dimensional screen with the state as a dimension, when there are three or more states, the information may be identified and displayed on a three-dimensional or more multi-dimensional screen.

(Second Embodiment)
A second embodiment of the present invention will be described below with reference to FIGS.
In the above-described first embodiment, the first condition is exemplified as “whether or not the total amount of change in the evaluation value for each evaluation point of interest exceeds a predetermined threshold”. In the second embodiment, the first condition is “a combination of evaluation values for each point of interest for evaluation”. Here, in both the embodiments, the same or the same names are denoted by the same reference numerals, the description thereof will be omitted, and the following description will focus on the features of the second embodiment. .

FIG. 7A is a diagram for explaining the evaluation table 3D of the second embodiment.
Similar to the first embodiment of FIG. 2, the evaluation table 3D of the second embodiment is a table that is referred to when evaluating the state of a subject based on an image obtained by capturing the subject. Has the items of “evaluation point of interest” and “evaluation value”, and does not have the item of “weighting”. In the example shown in the figure, the contents of “evaluation point of interest” and “evaluation value” are the same as those in the first embodiment of FIG. 2, and “face size”, “mouth size”, and “eye openness”. "1" to "5" are stored in correspondence with "".

FIG. 7B is a diagram for explaining a combination setting screen when the first condition of the second embodiment (a combination of evaluation values for each evaluation point of interest) is arbitrarily set by a user operation.
The first condition of the second embodiment indicates a combination of evaluation values for each point of interest of evaluation, and the combination can be arbitrarily set by a user operation, and the setting screen is arbitrarily selected and set. It is a multidimensional screen with multiple states as dimensions. The illustrated example shows a 5 × 5 matrix-like screen (two-dimensional screen), and evaluation values “1” to “5” of “mouth size” are assigned to the horizontal direction as evaluation points of interest. This is a case where evaluation values “1” to “5” of “eye openness” are assigned as evaluation points of interest in the vertical direction.

  In each square of the setting screen (matrix screen), numerical strings “1-1”, “1-2”, to “5-5” indicating combinations of evaluation values for each target point of evaluation are displayed. ing. The numerical value in the first half of this display indicates an evaluation value of “the degree of eye opening”, and the numerical value in the second half indicates an evaluation value of “size of mouth”. In a state where such a setting screen is displayed on the touch display unit 6, when an arbitrary combination is set by a user operation, a desired square is tapped. In the figure, combinations of evaluation values for each point of interest for evaluation in which gray evaluation values are arbitrarily set are shown, and “1-1”, “1-5”, “2-2”, “3-3” are shown. ,..., “5-5” indicates a case where the first condition is set. Note that the combination of evaluation values for each point of interest for evaluation is not limited to being displayed as a numerical string, and for example, an illustration or an image that shows the difference in the combination of evaluation values as a sample may be displayed.

  The second condition of the second embodiment is that when a plurality of combinations of evaluation values (first conditions) for each evaluation point of interest are set, the first condition (an evaluation value for each evaluation point of evaluation) is set. ), That is, on the condition that shooting has been performed with various facial expressions corresponding to the combination, and the control unit 1 performs shooting that satisfies the second condition. When this is done, diversified shooting is automatically terminated. In the illustrated example, for all of the evaluation value combinations “1-1”, “1-5”, “2-2”, “3-3”,. When shooting is completed, diversification shooting is terminated.

FIG. 8 is a flowchart for explaining a shooting operation that is started when the diversified shooting function is turned on in the second embodiment.
First, the control unit 1 performs a condition setting process (step B1) basically in the same manner as steps A1 to A5 in FIG. 3, and then performs a shutter operation instructing the start of diversified shooting (step S1). B2) The timer measurement operation is started (step B3). If the evaluation timing is not (e.g., every 30 ms has elapsed since the start of shooting) (NO in step B4), a predetermined time (e.g., 10 minutes) has elapsed since the start of shooting. Whether or not the predetermined time has elapsed (NO in step B5), the process returns to the above-described step B4.

  Here, if it is the evaluation timing (YES in step B4), the state (“face size”, the face size) of the face of the subject (person) included in the image captured by the imaging unit 5 is evaluated. "Mouth size", "Eye openness") is detected for each point of interest of evaluation, and the evaluation value for each point of interest of each evaluation is obtained by referring to the evaluation table 3D based on each detected state. Obtained (step B8), and the evaluation result is identified and displayed (step B9).

FIG. 9A is a diagram illustrating an imaging guide screen for identifying and displaying evaluation results during imaging.
The shooting guide screen is a 5 × 5 matrix-like screen configured in the same manner as the setting screen (matrix screen) shown in FIG. 7B, and the evaluation for each point of interest of the evaluation set as the first condition. A combination of values (displayed in gray), a combination that has been shot, and a corresponding combination that is being imaged are identified and displayed. In the figure, a symbol in which X is surrounded by a circle is an identification display indicating a first condition (a combination of evaluation values for each evaluation point of interest) on which an image is taken, and an image taken when the condition is satisfied Are identified as thumbnails. In the figure, “2-4” surrounded by a black frame is an identification display indicating a combination corresponding to an evaluation value for each point of interest of evaluation during imaging.

  Next, the combination of evaluation values for each point of interest of the evaluation obtained at the current evaluation timing satisfies the first condition, that is, among the combinations of evaluation values for each point of interest set in advance. If any one of them is checked (step B10), and if the first condition is not satisfied (NO in step B10), the imaging unit 5 is not instructed to perform imaging and a predetermined time from the start of imaging. The process proceeds to step B5 for checking whether or not the time elapses. If the first condition is satisfied (YES in step B10), the imaging unit 5 is instructed to capture an image, and the captured image is stored in the image memory 3C (step B11). Then, the evaluation value for each target point of evaluation obtained at the current evaluation timing is identified and displayed on the shooting guide screen in FIG. 9A as a combination of evaluation values for each target point of evaluation that has already been taken (a thumbnail of the captured image). (Display) (step B12), and temporarily stored in the work memory 3B as an evaluation history of shooting (step B13). Next, with reference to this evaluation history (step B14), it is determined whether or not the second condition is satisfied (step B15).

  Here, when the second condition is satisfied, that is, when photographing for all set evaluation value combinations for each point of interest has been completed (YES in step B15), photographing end processing (step B16). 8), the process exits the flowchart of FIG. 8. However, if the second condition is not satisfied, that is, if shooting for all combinations of evaluation values is not completed (NO in step B15), the shooting starts. The process proceeds to step B5 for checking whether a predetermined time has elapsed. Here, when a predetermined time has elapsed before satisfying the second condition (YES in step B5), an unphotographed guidance message is displayed (step B6).

  FIG. 9 (2) is a view showing a display example of a shooting continuation confirmation screen including an unphotographed guidance message and a shooting continuation confirmation message, which is basically the same as FIG. In the example shown in the figure, all of the set combinations are displayed when a shooting continuation confirmation message is displayed indicating that shooting has not been performed yet. Here, when an instruction to continue shooting is instructed (YES in step B7), the time measurement is reset and the process returns to the above-described step B4. However, if instruction to continue shooting is not instructed (NO in step B7), After performing step B16), the process exits the flowchart of FIG.

  As described above, in the second embodiment, the first condition is information indicating a combination of evaluation values for each point of interest in each evaluation. Therefore, as in the first embodiment, the first condition is not limited to the best state of the subject. It is possible to capture the change of various states evenly.

  Since the first condition is a combination of evaluation values arbitrarily set by user operation among the evaluation values for each point of interest in each evaluation, it is possible to easily set the photographing of the facial expression (state) desired by the user. it can.

  The control unit 1 displays on a shooting guide screen (matrix screen) corresponding to a combination of evaluation values for each point of interest evaluated when shooting is instructed every time shooting is performed during diversified shooting. Since the position is identified and displayed, it is possible to easily confirm in what state the subject was photographed during photographing.

  The control unit 1 temporarily stores an evaluation value for each point of interest for evaluation when the first condition is satisfied as an evaluation history, and ends diversification shooting based on whether or not the second condition is satisfied. Therefore, diversified shooting can be continued until shooting as set by the user is performed, and when shooting set by the user is completed, diversified shooting is performed. Can be terminated.

  In the second embodiment described above, shooting is instructed every time the first condition is satisfied. However, the present invention is not limited to this, and even if the first condition is satisfied, If they match, then shooting under that condition may be prohibited. That is, if shooting is performed with a combination of evaluation values for each point of interest of the same evaluation (for example, “1-3”), shooting under the same combination thereafter may be prohibited.

  FIG. 10 is a flowchart for explaining a first modification of the second embodiment, which is basically the same as the flowchart of FIG. 8, except that step C11 is added to FIG. That is, Steps C1 to C10 and Steps C12 to C17 in FIG. 10 are similar steps corresponding to Steps B1 to B10 and Steps B11 to B16 in FIG. 8, but in FIG. 10, YES is determined in Step C10. To step C11.

That is, when the first condition is satisfied (YES in step C10), it is further determined whether or not the combination has already been photographed, that is, whether or not the photograph has been photographed with a combination of evaluation values for each point of interest of the same evaluation. It discriminate | determines (step C11). As a result, if it matches the combination already photographed, the same combination has already been photographed (YES in step C11). The process proceeds to step C5 where it is checked whether or not the time has elapsed. If the combination does not match the photographed combination (NO in step C11), the imaging unit 5 is instructed to capture and the captured image is stored in the image memory 3C. (Step C12).
Even when the first condition is satisfied in this way, when the combination matches the combination that has already been shot, it is possible to avoid duplicate shooting with the same combination by prohibiting shooting with that combination thereafter. It becomes.

  In the second embodiment described above, the first condition having the same content is used during diversified shooting. However, the first condition is changed every time it is determined that the first condition is satisfied. You may make it do. That is, the point of setting an arbitrary combination by a user operation on the setting screen is common, but when there are a plurality of combinations, not all combinations are set as the first condition every time, but a predetermined one of a plurality of combinations is set. If only a specific combination based on the condition is set as the first condition and shooting is performed that satisfies the first condition, the next first condition is that the other specific combination excluding the previously shot combination The process of changing to the above may be repeated every time shooting is performed, and diversified shooting may be terminated when shooting is performed for all arbitrary combinations set by the user.

  FIG. 11 is a flowchart for explaining a second modified example of the second embodiment, which is basically the same as the flowchart of FIG. 8 except that steps D17 and D18 are added in FIG. That is, steps D1 to D17 in FIG. 11 are the same steps corresponding to steps B1 to B17 in FIG. 8, but if NO is determined in step D16 in FIG. 11, the process proceeds to steps D17 and D18. Yes.

  That is, when the second condition is not satisfied (NO in step D16), the process proceeds to a process for changing the first condition (step D18). For example, first, only “1-1” is set as the first condition, and when the first condition is satisfied, the first condition is changed to “2-2”, followed by “3-3”, “4-4”, “5-5”, and so on are changed. In this case, among the combinations in which the evaluation values at the points of interest of the respective evaluations are the same value, for example, “1-1”, “2-2”, “3-3”, "4-4" and "5-5" are prioritized. Note that the priority method is not limited to this, and a point of interest for specific evaluation may be given priority. When the first condition is changed in this way, the first condition after the change is identified and displayed on the above-described shooting guide screen (step D19), and then the process proceeds to step D5 for checking whether a predetermined time has elapsed from the start of shooting.

FIG. 12 is a diagram illustrating an imaging guide screen for identifying and displaying evaluation results during imaging, as in FIG. 9 (1). In a 5 × 5 matrix-shaped guide screen, symbols surrounded by ○ are , Identification display (thumbnail display of photographed image) indicating the first condition (combination of evaluation values for each evaluation point of interest) under which photographing was performed, and “2-4” surrounded by a black frame is imaging It is the identification display which showed the combination of the evaluation value according to the attention point of applicable evaluation in the inside. Here, the squares in the gray area indicate the next first condition “3-3” changed according to the above-described priority criteria.
If the first condition is changed each time it is determined that the first condition is satisfied in this way, it becomes clear what expression the user can shoot next, and the same expression can be obtained. It is possible to take an image efficiently without performing it again and again.

  In the second embodiment described above, the first condition (a combination of evaluation values for each evaluation point of interest) is a one-to-one combination such as “1-1”, “1-2”,. Although shown, it is not limited to this, and may be a combination of ranges such as “(1-3)-(3-3). In this case, combinations of evaluation values for each point of interest of evaluation are within this range. In this case, the control unit 1 issues a shooting instruction to the imaging unit 5. Furthermore, a combination of three states such as “1-2-3” may be used. In this case, the shooting guide screen shown in FIG. 9A may be a multi-dimensional screen having three or more dimensions. When it is difficult to display a matrix in four dimensions or more, combinations such as (1-1-1-1) and (1-1-1-2) may be displayed in a list.

  Further, in each of the above-described embodiments, as a focus point for evaluation, the state from one viewpoint is individually determined for each of various types of focus portions such as “face size”, “mouth size”, and “eye openness”. However, it may be individually evaluated from a plurality of viewpoints for each region of interest. For example, “face orientation” as another aspect of the face, “mouth shape”, “circularity of the mouth openness”, “mouth width”, “width of the entire mouth” as another aspect of the mouth “Difference”, “Gaze angle” as another viewpoint of eyes, “Difference between left and right eye opening”, “Brow angle”, “Difference between right and left eyebrows”, cheek viewpoint For example, “how the cheeks bulge” and “the difference in the degree of bulges on the left and right of the cheeks” may be used.

  In each of the embodiments described above, the “state at the point of interest of evaluation” is evaluated in five stages. However, the number of stages is not limited to five, and the number of stages is arbitrary for each point of interest of evaluation. May be evaluated differently. Further, the target number of shots may be set in advance, and the number of steps may be automatically set according to the target number of shots. For example, the number of steps may be increased when the target number of shots is large.

  In each of the embodiments described above, “face size”, “mouth size”, and “eye openness” are illustrated as “evaluation points of interest”, but the face angle (horizontal, vertical, light Angle with respect to each of the axial directions). Unlike such detection by image analysis, the direction (angle) of the digital camera may be detected by an acceleration sensor, and the detected direction (angle) of the digital camera may be detected as the state of the subject. Good.

  In each of the embodiments described above, the start of diversified shooting is instructed by a shutter operation. However, the start of diversified shooting may be automatically instructed when a person's face is recognized.

  In each of the embodiments described above, “weighting” can be set for each “target point of evaluation”, but “change direction” may be set. In other words, when summing the amount of change for each point of interest in each evaluation, the way of summation varies depending on whether the value of the amount of change is positive or negative (the direction of change is positive or negative). In the “change direction” item, any of “both directions”, “only positive direction”, and “only negative direction” may be stored.

  In the second embodiment described above, an arbitrary combination is set by a user operation on the setting screen in advance as the first condition. However, the previous evaluation value is not set in advance as the first condition. The first condition may be changed as appropriate. That is, first, the first shooting is performed unconditionally, and the state of the shooting timing is detected and evaluated at a plurality of evaluation points. As this evaluation, for example, the smile level is calculated by using a predetermined calculation formula for evaluation values at a plurality of points of interest in the evaluation. Next, the change of the first condition is repeated by changing the smile degree calculated by multiplying the calculated smile degree by a value such as + α% or −β% as the next first condition. The shooting is continued, and the shooting is ended when the second condition is satisfied. Here, as the second condition, the predetermined number may be set, the number may be changed in accordance with the first smile degree, and the smile degree increasing by multiplying by + α% becomes 100%. Alternatively, the degree of smile that decreases by β% may be 0%. Further, the first condition and the second condition may be a crying face degree other than the smile degree.

In each of the above-described embodiments, the state of the target point of evaluation is detected for a part of a person's face, but the target part is not limited to a face, but includes an arm, a hand, a leg, and the like. As a viewpoint, it may be bent, opened, or the like. Furthermore, the subject is not limited to a person but may be a pet or the like.
Further, in each of the above-described embodiments, the state of a plurality of points of interest for evaluation is detected and evaluated. However, only the state of a point of interest for one evaluation may be detected and evaluated. .
Furthermore, the photographing of the subject may be self-taking with the photographer as the subject. In this case, the start of photographing may be instructed by operating the self-timer function. Thus, even if it is self-portrait, it has the same effect as each embodiment.

  Further, in each of the above-described embodiments, the case where the present invention is applied to a digital camera as an imaging device has been described. However, the present invention is not limited to this, and a personal computer with a camera function, a personal digital assistant (PDA), a music player, a smartphone Other mobile phones and electronic games may be used.

  Further, the “apparatus” and “unit” shown in each of the above-described embodiments may be separated into a plurality of cases by function, and are not limited to a single case. In addition, each step described in the above-described flowchart is not limited to time-series processing, and a plurality of steps may be processed in parallel or separately.

The embodiment of the present invention has been described above. However, the present invention is not limited to this, and includes the invention described in the claims and the equivalent scope thereof.
Hereinafter, the invention described in the claims of the present application will be appended.
(Appendix)
(Claim 1)
The invention described in claim 1
Evaluation means for evaluating the state of the subject imaged by the imaging means at a point of interest for evaluation;
First discriminating means for discriminating whether or not the evaluation of the point of interest of the evaluation evaluated by the evaluation means satisfies a first condition;
A first imaging control unit that instructs the imaging unit to record the captured image every time it is determined by the first determination unit that the first condition is satisfied;
Second discriminating means for discriminating whether or not the evaluation by the evaluation means when the instruction to record an image is given by the first imaging control means satisfies a second condition;
A second imaging control means for instructing the first imaging control means to end image recording when it is determined by the second determination means that the second condition is satisfied;
An image pickup apparatus comprising:
(Claim 2)
The invention according to claim 2 is the imaging apparatus according to claim 1,
The point of interest for the evaluation is a combination of one or more of a plurality of parts constituting the subject and one or more viewpoints for evaluating the part.
An imaging apparatus characterized by the above.
(Claim 3)
The invention according to claim 3 is the imaging apparatus according to claim 1 or 2,
The evaluation means evaluates the state of the subject at a predetermined timing at the plurality of types of evaluation points of interest,
The first discriminating unit obtains a change amount for each target point of each evaluation from the current evaluation result and the previous evaluation result by the evaluation unit, and based on the change amount for each target point of each evaluation. Determine whether the condition of 1 is satisfied,
An imaging apparatus characterized by the above.
(Claim 4)
The invention according to claim 4 is the imaging apparatus according to claim 3,
The first condition is information indicating a conditional expression in which a change amount for each point of interest in each evaluation is a parameter.
An imaging apparatus characterized by the above.
(Claim 5)
The invention according to claim 5 is the imaging apparatus according to claim 3 or 4,
The first condition is information on the condition that the total value of the amount of change for each point of interest of each evaluation exceeds a predetermined threshold value.
An imaging apparatus characterized by the above.
(Claim 6)
The invention according to claim 6 is the imaging apparatus according to any one of claims 3 to 5,
The first condition is information that can be set by associating a weight for calculating the total value of the amount of change for each point of interest of each evaluation with the point of interest of each evaluation
An imaging apparatus characterized by the above.
(Claim 7)
The invention according to claim 7 is the imaging apparatus according to any one of claims 1 to 6,
The evaluation means evaluates which of the evaluation values divided into a plurality of stages corresponds to the state for each of the plurality of types of evaluation focus points,
The first determination means determines whether or not the first condition is satisfied based on an evaluation value for each point of interest of each evaluation evaluated by the evaluation means.
An imaging apparatus characterized by the above.
(Claim 8)
The invention according to claim 8 is the imaging apparatus according to claim 7,
A first setting means for setting a plurality of arbitrary evaluation values of a target point of arbitrary evaluation in advance by a user operation from among the evaluation values for each target point of each evaluation;
An evaluation history that temporarily stores, as an evaluation history, an evaluation value for each point of interest for evaluation when the first condition is satisfied, whenever it is determined by the first determination means that the first condition is satisfied. Storage means;
Further comprising
The second condition is information on the condition that all the evaluation values for each point of interest of the plurality of evaluations set by the first setting means are stored as the evaluation history.
An imaging apparatus characterized by the above.
(Claim 9)
The invention according to claim 9 is the imaging apparatus according to claim 8,
A measuring means for measuring a predetermined time from the start of shooting or the number of shots;
If the second condition is not satisfied even if a predetermined time has passed or the number of shots has been exceeded by the measuring unit, guidance that outputs that the shooting has not been performed according to the content set by the setting unit Means,
Further comprising
An imaging apparatus characterized by the above.
(Claim 10)
The invention according to claim 10 is the imaging apparatus according to claim 1,
The evaluation means evaluates the state of the subject at predetermined timings at the plurality of types of evaluation points of interest,
The first condition is information indicating a combination of evaluation values for each point of interest of the evaluation.
An imaging apparatus characterized by the above.
(Claim 11)
The invention according to claim 11 is the imaging apparatus according to claim 10,
A second setting means for setting an evaluation value for each target point of any evaluation among the evaluation values for each target point of each evaluation;
The first condition is information indicating a combination of evaluation values arbitrarily set by the second setting unit among the evaluation values for each point of interest in each evaluation.
An imaging apparatus characterized by the above.
(Claim 12)
The invention according to claim 12 is the imaging apparatus according to claim 11,
The first photographing control means prohibits photographing with the same combination of evaluation values thereafter if the photographing with the same combination of evaluation values has been performed even if the first condition is satisfied.
An imaging apparatus characterized by the above.
(Claim 13)
The invention according to claim 13 is the imaging apparatus according to claim 11,
Each time it is determined that the first condition is satisfied by the first determining means, the apparatus further comprises a changing means for changing the next first condition so as to exclude the previous first condition.
An imaging apparatus characterized by the above.
(Claim 14)
According to a fourteenth aspect of the present invention, in the imaging apparatus according to the eleventh aspect,
Further comprising display control means for performing a multidimensional list display with the plurality of states as dimensions,
The display control means on the list display corresponding to a combination of evaluation values for each point of interest evaluated when the shooting is instructed every time a shooting instruction is given by the first imaging control means. To identify the position,
An imaging apparatus characterized by the above.
(Claim 15)
The invention according to claim 15 is the imaging apparatus according to claim 10,
A second setting means for setting in advance a plurality of combinations of arbitrary evaluation values from the evaluation values for each point of interest of each evaluation;
A shooting history storage unit that temporarily stores, as a shooting history, a combination of evaluation values for each point of interest evaluated when the shooting instruction is given by the first shooting control unit;
Further comprising
The second condition is information on the condition that all combinations of evaluation values for each point of interest of the plurality of evaluations set by the second setting unit are stored as the shooting history.
An imaging apparatus characterized by the above.
(Claim 16)
The invention according to claim 16 is the imaging apparatus according to claim 1,
The evaluation means evaluates the state of the subject at predetermined timings at the plurality of types of evaluation points of interest,
The first condition is information calculated from an evaluation value for each point of interest of the evaluation,
According to the previous first condition, further comprising a changing means for changing the next first condition.
An imaging apparatus characterized by the above.
(Claim 17)
The invention described in claim 17 is the imaging apparatus according to claim 1,
Image storage means for storing each captured image captured in accordance with an imaging instruction from the first imaging control means in association with an evaluation result by the evaluation means;
When reproducing each captured image stored by the image storage unit, a reproducing unit that rearranges each captured image based on the evaluation result and displays a list.
Further comprising
An imaging apparatus characterized by the above.
(Claim 18)
The invention according to claim 18 is the imaging apparatus according to claim 17,
The reproduction means performs a multidimensional list display with the plurality of points of interest of the evaluation as dimensions.
An imaging apparatus characterized by the above.
(Claim 19)
The invention according to claim 19 is the imaging apparatus according to claim 1,
The subject is a person, and the state is a facial expression.
An imaging apparatus characterized by the above.
(Claim 20)
The invention according to claim 20 is the imaging apparatus according to claim 19,
The photographing of the subject is a self-taking with the photographer as the subject.
An imaging apparatus characterized by the above.
(Claim 21)
The invention according to claim 21
Evaluating the state of the subject being imaged by the imaging means at a point of interest for evaluation;
Determining whether the evaluation of the evaluated point of interest of the evaluation satisfies a first condition;
Instructing the imaging means to record the captured image every time it is determined that the first condition is satisfied;
Determining whether or not the evaluation when the instruction to record the image is performed satisfies a second condition;
Instructing the end of image recording when it is determined that the second condition is satisfied;
The imaging method characterized by including.
(Claim 22)
The invention described in claim 22
Against the computer,
A function for evaluating the state of the subject imaged by the imaging means at the point of interest of the evaluation;
A function of determining whether the evaluation of the evaluated point of interest of the evaluation satisfies a first condition;
A function of instructing the image capturing unit to record the captured image every time it is determined that the first condition is satisfied;
A function of determining whether or not the evaluation at the time when the image recording instruction is performed satisfies a second condition;
A function for instructing the end of image recording when it is determined that the second condition is satisfied;
It is a program for realizing.

DESCRIPTION OF SYMBOLS 1 Control part 3 Memory | storage part 3A Program memory 3D Evaluation table 4 Operation part 5 Imaging part 6 Touch display part 7 Face detection part

Claims (25)

Evaluation means for evaluating the state of the subject imaged by the imaging means at a plurality of types of evaluation points;
First discriminating means for discriminating whether each of the evaluation points of the plurality of types of evaluation points evaluated by the evaluation unit satisfies a first condition;
A first imaging control unit that instructs the imaging unit to record the captured image every time it is determined by the first determination unit that the first condition is satisfied;
An evaluation history storage means for temporarily storing, as an evaluation history, that the first condition is satisfied each time the first determination means determines that the first condition is satisfied;
A second discriminating unit that discriminates whether or not all of the plurality of types of evaluation points of interest are stored as the evaluation history by the evaluation history storage unit;
When the second discriminating unit discriminates that all the points of interest of the plurality of types of evaluation are stored as the evaluation history, the image recording end to the first imaging control unit is terminated. Second imaging control means for instructing;
An imaging apparatus comprising: Evaluation means for evaluating the state of the subject imaged by the imaging means at a point of interest for evaluation;
First discriminating means for discriminating whether or not the evaluation of the point of interest of the evaluation evaluated by the evaluation unit satisfies any of a plurality of first conditions;
A first imaging control unit that instructs the imaging unit to record an image captured each time it is determined by the first determination unit that any one of the first conditions is satisfied;
Every time when the first determination means determines that any one of the first conditions is satisfied,
Evaluation history storage means for temporarily storing as an evaluation history that any one of the first conditions is satisfied;
A second discriminating unit that discriminates whether or not all the points of interest of the evaluation are stored as the evaluation history by the evaluation history storage unit;
When the second discriminating unit discriminates that all the points of interest of the evaluation are stored as the evaluation history, the second discriminating unit instructs the first imaging control unit to end image recording. 2 shooting control means;
An imaging apparatus comprising: The point of interest for the evaluation is one or more of a plurality of parts constituting the subject, or a combination of one or more viewpoints for evaluating the part.
The imaging apparatus according to claim 1 or 2, wherein The evaluation means evaluates the state of the subject at a predetermined timing at a point of interest of the evaluation,
The first discriminating unit obtains a change amount of a focus point of each evaluation from a current evaluation result and a previous evaluation result by the evaluation unit, and based on the change amount of the focus point of each evaluation. Determine whether the condition is met,
The imaging device according to any one of claims 1 to 3, wherein The first condition is information indicating a conditional expression in which a change amount of a point of interest of each evaluation is a parameter.
The imaging apparatus according to claim 4. The first condition is information on the condition that the total value of the amount of change of the point of interest of each evaluation exceeds a predetermined threshold value.
The imaging apparatus according to claim 4 or 5, wherein The first condition is information that can be set by associating a weight when calculating the total amount of change in the point of interest of each evaluation with the point of interest of each evaluation,
The imaging apparatus according to any one of claims 4 to 6, wherein the imaging apparatus is configured as described above. The evaluation means evaluates which of the evaluation values divided into a plurality of stages corresponds to the point of interest of the plurality of types of evaluation,
The first determination unit determines whether or not the first condition is satisfied based on an evaluation value of a point of interest of each evaluation evaluated by the evaluation unit;
The imaging apparatus according to claim 1 . First setting means for setting a plurality of arbitrary evaluation values of arbitrary points of interest by user operation in advance from among the evaluation values of the points of interest of each evaluation;
Further comprising
The second discriminating means is information on condition that all of the evaluation values of the target points of the plurality of evaluations set by the first setting means are stored as the evaluation history.
The imaging apparatus according to claim 8. A measuring means for measuring a predetermined time from the start of shooting or the number of shots;
Even if a predetermined time elapses or the number of shots is exceeded by the measuring means, if the second determining means is not satisfied, the photographing according to the content set by the first setting means is not performed. Guidance means for outputting guidance;
Further comprising
The imaging apparatus according to claim 9. Evaluation means for evaluating the state of the subject imaged by the imaging means at a point of interest for evaluation;
First discriminating means for discriminating whether or not the evaluation of the point of interest of the evaluation evaluated by the evaluation means satisfies a first condition;
A first imaging control unit that instructs the imaging unit to record the captured image every time it is determined by the first determination unit that the first condition is satisfied;
Second discriminating means for discriminating whether or not the evaluation by the evaluation means when the instruction to record an image is given by the first imaging control means satisfies a second condition;
A second imaging control means for instructing the first imaging control means to end image recording when it is determined by the second determination means that the second condition is satisfied;
With
The evaluation means evaluates the state of the subject at a predetermined timing at a plurality of types of evaluation focus points,
The first condition is information indicating a combination of evaluation values for each point of interest of the evaluation.
An imaging apparatus characterized by that. A second setting means for setting an evaluation value for each target point of any evaluation among the evaluation values for each target point of each evaluation;
The first condition is information indicating a combination of evaluation values arbitrarily set by the second setting unit among the evaluation values for each point of interest in each evaluation.
The imaging apparatus according to claim 11. The first photographing control means prohibits photographing with the same combination of evaluation values thereafter if the photographing with the same combination of evaluation values has been performed even if the first condition is satisfied.
The imaging apparatus according to claim 12. Each time it is determined that the first condition is satisfied by the first determining means, the apparatus further comprises a changing means for changing the next first condition so as to exclude the previous first condition.
The imaging apparatus according to claim 12. Further comprising display control means for performing a multidimensional list display with the plurality of states as dimensions,
The display control means on the list display corresponding to a combination of evaluation values for each point of interest evaluated when the shooting is instructed every time a shooting instruction is given by the first imaging control means. To identify the position,
The imaging apparatus according to claim 12. A second setting means for setting in advance a plurality of combinations of arbitrary evaluation values from the evaluation values for each point of interest of each evaluation;
A shooting history storage unit that temporarily stores, as a shooting history, a combination of evaluation values for each point of interest evaluated when the shooting instruction is given by the first shooting control unit;
Further comprising
The second condition is information on the condition that all combinations of evaluation values for each point of interest of the plurality of evaluations set by the second setting unit are stored as the shooting history.
The imaging apparatus according to claim 11. Evaluation means for evaluating the state of the subject imaged by the imaging means at a point of interest for evaluation;
First discriminating means for discriminating whether or not the evaluation of the point of interest of the evaluation evaluated by the evaluation means satisfies a first condition;
A first imaging control unit that instructs the imaging unit to record the captured image every time it is determined by the first determination unit that the first condition is satisfied;
Second discriminating means for discriminating whether or not the evaluation by the evaluation means when the instruction to record an image is given by the first imaging control means satisfies a second condition;
A second imaging control means for instructing the first imaging control means to end image recording when it is determined by the second determination means that the second condition is satisfied;
With
The evaluation means evaluates the state of the subject at a predetermined timing at a plurality of types of evaluation focus points,
The first condition is information calculated from an evaluation value for each point of interest of the evaluation,
According to the previous first condition, further comprising a changing means for changing the next first condition.
An imaging apparatus characterized by that. Image storage means for storing each captured image captured in accordance with an imaging instruction from the first imaging control means in association with an evaluation result by the evaluation means;
When reproducing each captured image stored by the image storage unit, a reproducing unit that rearranges each captured image based on the evaluation result and displays a list.
Further comprising
The imaging apparatus according to claim 1 or 2, wherein The reproduction means performs a multidimensional list display with the plurality of points of interest of the evaluation as dimensions.
The imaging apparatus according to claim 18. The subject is a person, and the state is a facial expression.
The imaging apparatus according to claim 1 or 2, wherein The photographing of the subject is a self-taking with the photographer as the subject.
The imaging apparatus according to claim 20. Evaluating the state of the subject being imaged by the imaging means at a plurality of points of interest for evaluation;
Determining whether each of the evaluated points of interest of the plurality of evaluations satisfies a first condition;
Instructing the imaging means to record the captured image every time it is determined that the first condition is satisfied;
Each time it is determined that the first condition is satisfied, temporarily storing that the first condition is satisfied as an evaluation history;
Determining whether all of the plurality of types of evaluation points of interest are stored as the evaluation history;
Instructing the end of image recording when it is determined that all the points of interest of the plurality of types of evaluation are stored as the evaluation history;
An imaging method comprising: Against the computer,
A function of evaluating the state of the subject being imaged by the imaging means at a plurality of points of interest for evaluation;
A function of discriminating whether each of the evaluated points of interest of the plurality of evaluations satisfies a first condition;
A function of instructing the image capturing unit to record the captured image every time it is determined that the first condition is satisfied;
A function of temporarily storing, as an evaluation history, that the first condition is satisfied each time it is determined that the first condition is satisfied;
A function of determining whether or not all the points of interest of the plurality of types of evaluation are stored as the evaluation history;
A function of instructing the end of image recording when it is determined that all the points of interest of the plurality of types of evaluation are stored as the evaluation history;
A program to realize Evaluating the state of the subject being imaged by the imaging means at a point of interest for evaluation;
Determining whether the evaluation of the point of interest of the evaluation satisfies any of a plurality of first conditions;
Instructing the imaging means to record the captured image every time it is determined that any one of the first conditions is satisfied;
Each time it is determined that any one of the first conditions is satisfied, temporarily storing as an evaluation history that any one of the first conditions is satisfied;
Determining whether all of the points of interest of the evaluation are stored as the evaluation history;
Instructing the end of image recording when it is determined that all the points of interest of the evaluation are stored as the evaluation history;
An imaging method comprising: Against the computer,
A function for evaluating the state of the subject imaged by the imaging means at the point of interest of the evaluation;
A function of determining whether the evaluation of the point of interest of the evaluation satisfies any of a plurality of first conditions;
A function of instructing the imaging unit to record the captured image every time it is determined that any one of the first conditions is satisfied;
Each time it is determined that any one of the first conditions is satisfied, a function of temporarily storing as an evaluation history that any one of the first conditions is satisfied;
A function of determining whether or not all the points of interest of the evaluation are stored as the evaluation history;
A function for instructing the end of image recording when it is determined that all the points of interest of the evaluation are stored as the evaluation history;
A program to realize

Images