JP2014216658A - Imaging apparatus and imaging assist program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To count the number of imaged images in consideration of the imaging state of a subject.SOLUTION: An imaging apparatus comprises: discrimination means which recognizes a subject in an input image and discriminates the imaging state of the subject; and control means which counts the number of imaged images of the subject corresponding to the imaging state and causes a display apparatus to display information for assisting imaging of the subject in accordance with the number of the imaged images corresponding to the imaging state.

Description

  The present invention relates to a photographing apparatus and a photographing assistance program.

  There is known a method of automatically counting the number of photographs of a person when a face registered in advance in a photograph is detected using face recognition technology (see, for example, Patent Document 1).

JP 2007-020104 A

  However, the number of shots has not been counted in consideration of the shooting state of the subject.

  In view of the above problems, an object of the present invention is to provide a photographing apparatus and a photographing assistance program for counting the number of photographing according to the photographing state of a subject.

  A photographing apparatus according to the present invention recognizes a subject in an input image, discriminates a photographing state of the subject, counts the number of photographed subjects with respect to the photographing state, and determines the number of photographed images with respect to the photographing state. And a control unit that displays information for assisting photographing of the subject on a display device.

  The shooting assistance program according to the present invention recognizes a subject in an input image, determines a shooting state of the subject, counts the number of shots of the subject for the shooting state, and counts the number of shots for the shooting state. And a control step of displaying information for assisting photographing of the subject on a display device by a computer.

  The photographing apparatus and the photographing assistance program according to the present invention can count the number of photographing according to the photographing state of the subject.

It is a figure which shows the structural example of the imaging device 101 which concerns on this embodiment. 3 is a diagram illustrating a configuration example of a control unit 104. FIG. It is a figure which shows an example of the attendance number and the setting screen of the photograph to take. It is a figure which shows the registration place of face data. It is a flowchart which shows the process at the time of imaging | photography. It is a figure which shows an example of the setting screen of personal data. It is a figure which shows an example of an attendee's setting screen. It is a figure which shows the example of a screen when an unregistered person is detected by the through image. It is a figure which shows an example of an advice display screen. It is a flowchart which shows the process at the time of imaging | photography. It is a figure which shows an example of a name display. It is a figure which shows an example of automatic imaging | photography. It is a figure which shows an example of automatic trimming. It is a figure which shows an example of smile automatic imaging | photography.

Hereinafter, embodiments of a photographing apparatus and a photographing assistance program according to the present invention will be described in detail with reference to the drawings.
(First embodiment)
FIG. 1 is a block diagram illustrating an example of an imaging apparatus 101 according to the present embodiment. The photographing apparatus 101 according to the present embodiment is a camera that can be easily photographed even by a beginner so that there is no bias in the number of photographs of each person in a venue where many attendees participate. For example, when taking a photograph at an event such as a wedding reception, a party, or a group trip, it is possible to shoot so that there is no excess or deficiency in the number of attendees or group members. In the photographing apparatus 101 according to the present embodiment, such a function is referred to as a party mode for easy understanding, but other names may be used as long as the functions are similar.

  In particular, the photographing apparatus 101 according to the present embodiment has a photographing state notification function and an advice function for taking necessary pictures, and can be used easily even by a beginner who is not familiar with photographing. For example, if a facial expression is not detected and a smile is not detected, or a failed photo (a photo with part of the face cut off, eyes closed, camera shake or overexposure, etc.) is not counted Like that. In addition, it has a function of counting the number of shots for each shooting state such as a smile (also referred to as a photographic scene) and notifying the photographer of the contents of the shooting state that is insufficient. For example, the size of the face is determined, and if it is less than a preset size, it is determined that there are few up images, and the photographer is advised that the up images of the person are insufficient.

  Furthermore, the registration of attendees 'faces does not require registration of all attendees' face photos in advance, and attendee registration can be increased while shooting. For example, if only the number of attendees is set, and if the number of registrants is less than the number of attendees, whether unregistered people are detected and registered is confirmed, and the number of registrants reaches the number of attendees End registration for all attendees. Registration can also be made from photographs taken in the past (for example, photographs taken with cameras of other companies). Furthermore, the registered face data and personal data corresponding to the face data can be recorded in an independent memory or file to form a database. The face data stored in the history of the database is always automatically updated to the latest face image with a good shooting state (a face image with a good smile state as well as a focus state and exposure state) and face data. Is done.

  As described above, the photographing apparatus 101 according to the present embodiment counts the number of shots according to the shooting state of the subject, and the number of shots is insufficient for each desired shooting state such as a person who has a shortage of shots, particularly a smile. Therefore, even an unskilled photographer can easily shoot without unevenness in the number of shots for each attendee.

  In FIG. 1, an imaging apparatus 101 includes an imaging lens 102, an imaging unit 103, a control unit 104, a display unit 105, an operation unit 106, a lens control unit 107, and a memory card interface (I / F) 108. The nonvolatile memory 109 and the buffer memory 110 are included.

  The photographic lens 102 includes a zoom lens 102a that changes the photographic angle of view, an aperture 102b that changes exposure, a shutter 102c, a focus lens 102d that focuses, and the like, and is controlled by the lens control unit 107.

  The imaging unit 103 includes an imaging element 201, a video circuit 202, and an imaging control circuit 203. The imaging element 201 uses a CMOS sensor or the like, and converts a subject image formed on the light receiving surface by the photographing lens 102 into an electric signal corresponding to the amount of light. The video circuit 202 amplifies the electrical signal read from the image sensor 201 in accordance with the timing signal output from the imaging control circuit 203, converts it into digital image data, and outputs the digital image data to the control unit 104. The imaging control circuit 203 also controls the timing at which the imaging element 201 operates, and in particular controls the exposure time of the electronic shutter at the time of through image shooting.

  The control unit 104 is configured by a CPU, controls the operation of the entire photographing apparatus 101 according to a program stored in advance in the nonvolatile memory 109, detects a face of a photographed image or a photographed image, personal authentication processing, and a face image Evaluation processing, image and information display processing on the display unit 105, image data recording processing, and face data and personal data recording processing. In addition, the control unit 104 responds to the operation of the operation button 207 of the operation unit 106, performs power ON / OFF, zooming, focusing, exposure control, and the like, and has been recorded in the nonvolatile memory 109 or the memory card 108a. Or an image captured by the image capturing unit 103 is displayed on the monitor 204, or a through image captured by the image capturing unit 103 is displayed on the monitor 204 at the capturing preparation stage.

  Here, when a through image is captured, the shutter 102c is opened, and the subject image formed on the image sensor 201 is periodically subjected to image processing by the control unit 104 and is displayed on the monitor 204 as a moving image. At the same time, the control unit 104 detects the contrast of the image, moves the focus lens 102d, searches for the focus lens position with the highest contrast, and moves the focus lens 102d to that position (autofocus by contrast method). Further, the control unit 104 detects the brightness level of the image, and controls the aperture 102b and the opening / closing speed of the shutter 102c based on the detected brightness level to perform automatic exposure control during still image shooting. The processing performed by the control unit 104 will be described in detail later.

  The display unit 105 includes a monitor 204 and a monitor control circuit 205. The monitor 204 is composed of a liquid crystal display or the like. The monitor control circuit 205 performs turning on / off of the monitor 204, display control, and the like, and displays information such as images, graphics, and characters output from the control unit 104 on the monitor 204.

  The operation unit 106 includes an operation detection circuit 206 and operation buttons 207. The operation detection circuit 206 detects operation buttons 207 such as a release button (half press) 207a, a release button (full press) 207b, and a power button 207c, and indicates operation information indicating which button is pressed on the control unit 104. Is output. Here, the release button (half-pressed) 207a and the release button (full-pressed) 207b are composed of switches that detect the pressed state in two stages. The release button (half-pressed) 207a is half-pressed, and the release button (full-pressed) ) 207b detects the fully pressed state. Although not shown in FIG. 1, the operation unit 106 is not limited to the release button (half press) 207a, the release button (full press) 207b, and the power button 207c. Left and right cursor buttons and a Set button). Further, a touch panel may be arranged on the monitor 204 so that an operation using the touch panel can be performed.

  The lens control unit 107 includes a focus control circuit 208, a shutter control circuit 209, an aperture control circuit 210, and a zoom control circuit 211, and operates according to a command from the control unit 104. The focus control circuit 208 drives the focus lens 102d to adjust the focus. The aperture control circuit 210 adjusts the amount of light passing through the taking lens 102 by driving the aperture 102b. The shutter control circuit 209 controls the exposure time by driving the shutter 102c. The lens control unit 107 controls the exposure time with the electronic shutter while the shutter 102c is in an open state at the time of shooting a through image in the shooting preparation stage. The zoom control circuit 211 drives the zoom lens 102a in accordance with the operation of the zoom button on the operation unit 106 to change the shooting angle of view.

  The memory card I / F 108 is an interface for reading and writing data with the memory card 108a attached.

  The non-volatile memory 109 is configured by a flash memory or the like, and stores a program for operating the control unit 104, parameters necessary for the operation of the photographing apparatus 101, image data, and the like. In particular, in the image capturing apparatus 101 according to the present embodiment, face data (such as a face image and face feature amount) extracted from an image captured by the image capturing unit 103 and personal data (for example, corresponding to face data) (for example, (Personal information such as name) is stored in association with each other. Thereby, personal authentication can be performed from a newly captured face image. Further, attendee information such as the number of attendees and the number of shots taken per attendee are recorded in association with personal data for each event (such as a party). The number of shots is the total number of shots for each person (for each personal data) or the number of shots for each desired shooting state (smiling face, up image, etc.). In addition, the number of subjects to be photographed (for example, the number of attendees at the party) set by the photographer is also stored.

  The buffer memory 110 is composed of a high-speed RAM or the like, temporarily stores image data at the time of shooting, and when the control unit 104 performs processing such as image processing data, image processed data, and image compressed data. Used as a processing buffer. Further, face image detection, extraction processing, and the like are also performed on the buffer memory 110. The buffer memory 110 is also used when face detection processing is performed from a captured image stored in the nonvolatile memory 109 or the memory card 108a. Alternatively, it is used as a display memory when displaying a through image or a captured image on the display unit 105.

  Next, a configuration example of the control unit 104 will be described with reference to FIG. In FIG. 2, the same reference numerals as those in FIG.

  In the example of FIG. 2, the control unit 104 includes a photographing processing unit 301, a display processing unit 302, a face recognition processing unit 303, an evaluation processing unit 304, a registration processing unit 305, a setting processing unit 306, and a recording process. Part 307. Note that basic processing other than the above, such as processing for transferring data between the above processing or operation processing, is not specifically described as a processing unit, but is executed as the control unit 104. In FIG. 2, image data is stored in the image storage area 402 of the nonvolatile memory 109 and the image storage area 403 of the memory card 108 a, and data such as face data, personal data, and the number of shots is independent of the data storage area 401. Stored in a file. The data storage area 401 may be stored in a separate memory card to create a database.

  The photographing processing unit 301 performs processing for displaying an image photographed by the imaging unit 103 in real time on the monitor 204 with the shutter 102c of the photographing lens 102 opened in photographing (through image display). Then, the photographer views the through image displayed on the monitor 204, confirms the subject and the composition, and presses the release button (full press) 207b to perform still image shooting. When the release button (half press) 207a of the operation unit 106 is pressed, the photographing processing unit 301 controls the image pickup unit 103 and the lens control unit 107 to perform focus control and exposure control, and then release button (full press). When 207b is pressed, the shutter 102c is opened and closed, and the still image captured by the imaging unit 103 is loaded into the buffer memory 110.

  The display processing unit 302 outputs images, graphics, characters, and the like to the monitor 204 of the display unit 105. For example, a captured image captured in the buffer memory 110 is displayed on the monitor 204, and a graphic such as a message or an illustration is overlaid on the image and displayed. Alternatively, processing for displaying a menu screen on the monitor 204 is performed. In particular, the photographing apparatus 101 according to the present embodiment performs processing for displaying, as advice to the photographer, a person name, a photographing state in which the number of photographed images is insufficient, and the number of photographed images around the face detected by the face recognition processing unit 303. .

  The face recognition processing unit 303 performs face detection from an image captured in the buffer memory 110, and performs processing for recognizing an individual from the facial feature amount of personal data registered in the nonvolatile memory 109 (personal authentication). This makes it possible to determine who's face is shown in the through image or the captured image. Here, when the extracted facial feature quantity does not match the feature quantity of the personal data registered in the nonvolatile memory 109, the face recognition processing unit 303 determines that the face image is an unregistered person.

  The evaluation processing unit 304 evaluates the shooting state of the image (particularly the face portion). Here, the evaluation content includes, for example, the size of the face (degree of up, etc.), facial expression (no blinking, smile, good expression, etc.), image quality (low blur, high resolution, proper exposure, White balance is good, shade is low, etc.), placement (facing front, line of sight facing the lens, part of face, center of screen), etc.

  The registration processing unit 305 stores the face data (face image, face feature amount, etc.) detected from the photographed image or the photographed image and the personal data such as the inputted name in the data storage area 401 of the nonvolatile memory 109. The process to memorize is performed. The registration processing unit 305 also performs processing for changing face data or personal data already registered in the data storage area 401 or updating to the latest data. In addition, the number of shots is recorded in association with face data and personal data. The number of shots is the total number of shots for each person (for each personal data) or the number of shots for each desired shooting state (smiling face, up image, etc.).

  The setting processing unit 306 performs processing for setting conditions for the number of attendees, the target number of shots, and a desired shooting state (such as a smiling face, an up image). For example, when setting the number of attendees at a party, a menu screen as shown in FIG. 3A is displayed on the monitor 204, and the upper cursor button 207d or the lower cursor button 207e of the operation unit 106 is operated to display the number of people. And press the Set button 207f. In the example of FIG. 3A, the number of attendees is set to three. Similarly, if the number of attendees in FIG. 3A is used as a target shooting number setting menu, the target shooting number can be set. FIG. 3B is a diagram showing an example of a menu screen for setting a photograph to be taken. In the example of FIG. 3B, a list of “smile” and “up image” is displayed on the screen of the monitor 204 with a check box. Then, the list to be set is selected by operating the upper cursor button 207d or the lower cursor button 207e of the operation unit 106, and the Set button 207f is pressed. In the example of FIG. 3B, the item “smile” with a frame is selected, and when the Set button 207f is pressed in this state, a selection mark is displayed in the check box. When the next “up image” item is selected, the down cursor button 207e is pressed, and the set button 207f is pressed while a frame is displayed on the “up image” item. A plurality of items can also be selected. Also, a new item can be added by selecting the item addition button and pressing the Set button 207f.

  The recording processing unit 307 performs a process of adding a file name or the like to the image data captured in the buffer memory 110 and storing the image data in the nonvolatile memory 109 or the memory card 108a. In this embodiment, for easy understanding, the registration processing unit 305 stores face data and personal data in the nonvolatile memory 109, but the recording processing unit 307 may store the face data and personal data. The recording processing unit 307 and the registration processing unit 305 may be combined into one.

  Here, in the photographing apparatus 101 according to the present embodiment, when setting the target number of shots, an absolute number of shots and a relative number of shots can be set.

  As for the absolute number of shots, for example, when the target number of shots for smile is set to 2, if the number of smiles for Mr. A is 1, it is determined that the number of shots for Mr. A is insufficient.

  On the other hand, in the relative number of shots, instead of the number of shots, for example, the ratio of the target number of shots for smile to the total number of shots (20% or the like) is set. In this case, for example, when Mr. A's total number of shots at a certain point in time is 10 and the number of shots of smiling face is 1, the ratio of the relative number of shots of Mr. A's smile is 10%. Judge that the number of shots is insufficient. In addition, when the total number of shots of Mr. A is 5, even if the number of shots of smiling face is one, the ratio of the relative number of shots of Mr. A's smile is 20%. Judge that there is no shortage. Alternatively, the average number of shots obtained by dividing the total number of shots of smiles of all attendees by the number of attendees may be used as a reference. For example, at a certain point in time, when the total number of smiling faces (40) of all attendees (20 people) is taken, the average number of smiling faces is 2 / person, and the smile number of Mr. A is 2 If it is a sheet, there is no shortage. In this case, when the number of shots of smiles of people other than Mr. A increases and the total number of shots increases to 60, it is determined that if the number of shots of Mr. A's smile is two, it is insufficient.

  As described above, the setting of the number of shots corresponding to a desired shooting state may be an absolute number or a relative number. In particular, by setting the relative number of shots corresponding to the desired shooting state, the reference number automatically follows the number of shots of the entire attendee, so there is an effect of always shooting without bias to each person. It is done.

  The photographer can arbitrarily select the number of subjects to be photographed for each desired photographing state on the menu screen or the like. For example, on the menu screen, first select the desired shooting state, then select and set the absolute number of shots, the average number of shots for all attendees, the ratio of each attendee to the number of shots, etc. for each shooting state can do.

  Furthermore, in the above example, the desired shooting state has been described as a smile, but an up image or the like may be used. The determination of the up image can be made as an up image when, for example, the area ratio of the face portion to the entire screen is equal to or greater than a preset threshold value. The desired shooting state refers to the conditions of the photograph that the photographer wants to take, such as a smile or a close-up image. For example, the appearance of the face (face size (up image etc.), facial expression (smile etc.), image quality, etc. The photographer can arbitrarily select a shooting state such as (focus state, brightness, etc.), face position (center of screen, etc.) on the menu screen or the like, and set a desired shooting state.

  Then, for each attendee, it is determined whether or not the number of shots of the subject for each desired shooting state is insufficient, and if it is insufficient, a message (advice) indicating that it is insufficient is displayed on the display unit 105. For example, when the number of shots of Mr. A's smile is insufficient, advice such as “insufficient smile”, “shooting smile” is displayed near the face of Mr. A displayed on the display unit 105. Here, the advice may be highlighted so that the photographer can easily notice the advice displayed on the display unit 105. The highlighting is, for example, blinking advice, changing color, changing size, adding motion by animation, and the like. Alternatively, the face itself may be blinked or surrounded by a frame.

  Furthermore, the face portion in the shooting state that is insufficient is automatically set to the AF (autofocus) position, and the photographer simply presses the release button to focus on the face in the shooting state that is insufficient. It is possible to take a matching image.

  In this way, it is possible to photograph the face of the attendee who matches the lacking shooting state, and to count up the number of subjects to be shot for the lacking shooting state of the attendee. Here, when the photographed face is evaluated and the evaluation criteria set in advance are not satisfied, the number of photographed images is not counted up.

  In addition, when there are a plurality of insufficiently photographed subjects with the same attendee, information for assisting photographing is displayed on the screen of the display unit 105 with respect to the smallest number of subjects (the shortest number). May be displayed. In this case, for example, when the number of smiles of Mr. A is 1 (the target number of smiles is 5) and the number of up images is 2 (the target number of up images is 5), the display unit 105 In the vicinity of the face of Mr. A displayed on the screen, only “Lack of smile” (or “Smile” alone) may be displayed. As a result, it is possible to preferentially capture the image in the most insufficient shooting state. Of course, the contents of all the shooting states that are insufficient may be displayed, or the display size may be changed according to the degree of lack. For example, in the above example, “Insufficient smile” and “Insufficient up image” are displayed near the face of Mr. A displayed on the screen of the display unit 105. By displaying the image larger than the characters “insufficient”, the photographer can recognize that it is necessary to shoot a smile with priority over the up image.

  Next, a case where face data is registered from an image taken by another camera will be described. FIG. 4A is a diagram illustrating a data flow when storing image data obtained from an image photographed by the photographing apparatus 101, face data, and personal data. In this case, face data and personal data are stored in the non-volatile memory 109 in which the program (firmware) of the control unit 104 is stored, and image data is stored in the memory card 108a. Note that the image data may be stored in the nonvolatile memory 109. On the other hand, FIG. 4B shows the flow of data when registering face data and personal data by connecting a memory card 108a storing image data taken by another camera to the memory card I / F 108. FIG. In FIG. 4B, when the memory card 108a is connected, a message “Do you want to register face data on the memory card?” And a screen for selecting “Register / Do not register” are displayed on the screen of the monitor 204. As in FIG. 3, any one is selected and the Set button 207f is pressed. In the example of FIG. 4B, since “register” is selected, the image data stored in the memory card 108a is read out by the control unit 104, and the face recognition processing unit 303 and the registration processing unit 305 are read out. A registration process of face data is performed. In this manner, face data and personal data can be stored in the nonvolatile memory 109 as a database even from an image taken with a camera of another company.

  Next, an operation at the time of photographing of the photographing apparatus 101 according to the present embodiment will be described using the flowchart of FIG. Note that the flowchart of FIG. 5 shows the flow of processing executed according to the program of the control unit 104.

  (Step S <b> 101) When the photographer presses the power button 207 c of the operation unit 106, the control unit 104 starts activation of the photographing apparatus 101.

  (Step S102) The control unit 104 initializes the system with reference to setting information (for example, a shooting mode and a reproduction mode) stored in the nonvolatile memory 109. Here, it is assumed that the shooting mode is set.

  (Step S103) The control unit 104 displays a moving image periodically shot by the imaging unit 103 on the monitor 204 as a through image with the shutter 102c opened.

  (Step S <b> 104) The control unit 104 performs white balance adjustment of an image captured by the imaging unit 103.

  (Step S <b> 105) The control unit 104 performs contrast-type autofocus control (AF) from the image captured by the imaging unit 103.

  (Step S106) The control unit 104 performs automatic exposure control (AE) from the image captured by the imaging unit 103.

  (Step S107) As described with reference to FIG. 4B, the control unit 104 executes processing for registering face data when the memory card 108a is inserted. If it has already been registered in the data storage area 401 of the nonvolatile memory 109, “Do not register” is selected in FIG. 4B, and the process proceeds to the next step S108, and “Register” is displayed in FIG. 4B. If selected, registration processing is performed. The registration process is performed on a registration screen as shown in FIG. 6, for example. In the example of FIG. 6, the control unit 104 extracts a face from the image stored in the memory card 108 a and displays the extracted face image on the monitor 204. Then, the user selects a face image to be registered with the left cursor button 207g or the right cursor button 207h (in FIG. 6, a face image with a dotted frame image selected). Then, when the name input field is selected with the down cursor button 207e, for example, a keyboard interface screen is displayed. Therefore, personal data for the selected face image is input (in the example of FIG. 6, the name “Taro Nihon” is input). ) Here, when the Set button 207f is pressed, the face data (face image and face feature amount) corresponding to the selected face image and personal data (name) are associated with each other and the data storage area 401 of the nonvolatile memory 109 is stored. Is remembered.

  (Step S108) The control unit 104 determines whether the shooting mode is the normal mode or the party mode. If it is the normal mode, the process proceeds to step S122, and if it is the party mode, the process proceeds to step S109. The normal mode and the party mode are selected using a shooting mode selection dial or a menu screen of the operation unit 106.

  (Step S109) The control unit 104 permits an interrupt when the release button (half press) 207a is pressed. This is because when the release button (half-pressed) 207a is pressed in the normal shooting mode, focus lock, exposure confirmation, etc. are performed, and waiting for the release button (full-pressed) 207b to be pressed. Then, an interrupt is generated by the release button (half-press) 207a, and the mode shifts to the attendee input mode. Here, the release button (half-pressed) 207a is set to the attendee input mode, but a menu button or a dedicated button may be provided.

  (Step S110) As described above, the control unit 104 determines whether the mode is the attendee input mode or the shooting mode based on the state of the release button (half-pressed) 207a. If the mode is the attendee input mode, the process proceeds to step S111. If the mode is the shooting mode, the process proceeds to step S114.

  (Step S111) As described with reference to FIG. 3A, the control unit 104 inputs the number of attendees.

  (Step S112) The control unit 104 reads the face image registered in the data storage area 401 of the nonvolatile memory 109 and displays it on the monitor 204 (FIG. 7). Then, by operating the up / down / left / right cursor buttons (up cursor button 207d, down cursor button 207e, left cursor button 207g, right cursor button 207h), the faces of the attendees of this party are selected. At this time, for example, a dotted frame is displayed on the face image selected by the cursor button, and if there is personal data (name: Saburo Tokyo) corresponding to the face image, it is displayed in the lower column. Further, the total number of attendees and the number of attendees set as attendees at that time are displayed. In the example of FIG. 7, the total number of attendees is 3, and the set number is 1. Thereby, the photographer can recognize that two attendees are not set.

  (Step S113) The control unit 104 sets attendees from the face image displayed on the monitor 204 in step S112. For example, when the selected face image is registered as an attendee on the screen of FIG. 7, the Set button 207f is pressed.

  (Step S114) The control unit 104 determines whether or not all attendees have been set. If all attendees have been set, the process proceeds to step S121. If all attendees have not been set (if there are unset attendees), the process proceeds to step S115. In other words, if there are no unset attendees (when all attendees have been set), the registration confirmation process will not proceed even if there are unregistered persons. Even if entered, it is automatically excluded without moving to the setting screen.

  (Step S115) The control unit 104 determines whether or not there is an unregistered person in the through image displayed on the monitor 204. If there is an unregistered person, the process proceeds to step S116. If there is no unregistered person, the process proceeds to step S121.

  (Step S116) The control unit 104 performs automatic photographing.

  (Step S117) As shown in FIG. 8, the control unit 104 displays an automatically captured image on the monitor 204 and confirms whether or not to register an unregistered person. In the example of FIG. 8, an automatically shot image is displayed, the face of an unregistered person is highlighted with a frame, and a message “Do you want to register an unregistered person?” Is displayed. At this time, the current number of registered persons and the number of attendees can be displayed to confirm how many are missing. In the example of FIG. 8, since the number of attendees is 4 and the number of registrants is 3, it can be seen that one person is unregistered. If a registered person is shown on the same screen, personal data (name: Taro in the figure) is displayed near the registered face.

  (Step S <b> 118) The control unit 104 confirms the selection of whether to register or not to be registered by the user. If registration is to be performed, the process proceeds to step S119; otherwise, the process proceeds to step S120. For example, in the case of FIG. 8, the user selects the “Yes” or “No” item displayed on the screen with the left cursor button 207g or the right cursor button 207h, and the Set button If a plurality of unregistered persons are shown on the same screen, for example, the face displayed as an unregistered person is selected with the up cursor button 207d or the down cursor button 207e (for example, the selected face is displayed). A frame is displayed on the screen) and registration / non-registration is selected for each unregistered person.

  (Step S119) The control unit 104 automatically captures the face data (face image or face feature amount) of the face for which “Register” is selected in Step S118 and “Register” is selected in Step S118. And the face data is set as one of the attendees of this party. Here, as described in FIG. 6, when registering face data, a screen for inputting a name corresponding to the face data is displayed. The input information is stored in the data storage area 401 as personal data of the face data. Note that the image of FIG. 8 automatically captured in step S116 may be discarded after being used for registration of only the face image portion, or may be discarded as a captured image, or the image storage area 402 or the memory card 108a of the nonvolatile memory 109. May be stored in the image storage area 403. Further, when saving as a photographed image, it may be counted as the number of photographed images or excluded.

  (Step S120) The control unit 104 registers the face data (face image and face feature amount) of the face for which “not registered” is selected in step S118 in the data storage area 401 of the nonvolatile memory 109 as an unregistered person. Keep it. Thereby, even if the face image is included in the images automatically captured thereafter, the registration screen as shown in FIG. 8 can be prevented from being displayed many times as an unregistered person.

  (Step S121) The control unit 104 displays shooting advice that is a feature of the party mode. For example, as shown in FIG. 9, when the face in the through image displayed on the monitor 204 is a face set as an attendee, personal data such as a name is displayed in the vicinity of the face. In the example of FIG. 9, it can be seen that “Taro”, “Ichiro”, “Jiro”, and “Hanako” are from the left of the screen. In particular, in the photographing apparatus 101 according to the present embodiment, when each person has a photographing state in which the number of photographed items is insufficient (such as a smile or an up image), the content (including a shortage of the total number of photographed items) is displayed. In the example of FIG. 9, it can be seen that “Hanako” is an up image, “Ichiro” is a smiling image, and “Jiro” is lacking the total number of shots. In addition, “Taro” has no shortage, so only the name is displayed. Here, the data storage area 401 of the nonvolatile memory 109 stores the number of shots for each personal data set as an attendee and the number of shots for each desired shooting state. In the example of FIG. 9, in the data storage area 401, the total number of shots, the number of shots of smiley images, and the shot of up images for four people “Taro”, “Ichiro”, “Jiro” and “Hanako” are shot. The number of images is stored. For example, “Taro” has 3 smiles, 2 up images, and 5 total shots. Similarly, “Ichiro” has a smile: 1 image, 5 up-images, and a total of 6 images. “Jiro” has 1 smile, 1 up image, and 2 total shots. Furthermore, “Hanako” has 4 smiles, 1 up image, and 5 total shots. Thus, the total number of shots and the number of shots for each desired shooting state are managed for each individual.

  Here, a list display button may be provided, and a table as shown in FIG. 9 may be displayed on the monitor 204 so that the current number of shots can be confirmed. Alternatively, “x” marks may be displayed for items that are insufficient, and “◯” marks may be displayed for items that are not insufficient. For example, in FIG. 9, when the target number of the total number of shots is set to 5, the target number of smiling images: 2 and the target number of up images: 2, each of “Taro” is the target. Since the number of images has been reached, “○” and “Ichiro” are “○” because the total number of shots and the number of up shot images have reached the target number, but the number of smiley images is insufficient. X ”. Similarly, “Hanako” is “x” because only the number of up images taken is insufficient. In addition, since “Jiro” has not reached the target number, “×” is obtained.

  In this way, the contents of the shooting state (including the shortage of the total number of shots) that are insufficient near the faces of “Hanako”, “Ichiro”, “Jiro”, and “Taro” displayed on the through image of the monitor 204 are advised Therefore, the photographer can easily know what kind of shooting state the photograph is lacking. Here, in order to make it easy to understand a face image in which the number of shots is insufficient, in FIG. 9, the name is highlighted in a dotted frame. Instead of displaying the dotted frame, the character color may be changed or blinked. Alternatively, a caution mark or a crying face illustration may be displayed on a face image for which the number of shots is insufficient. Conversely, a smiling illustration may be displayed on a face image for which the number of shots is sufficient.

  (Step S122) When the party mode setting process ends, the control unit 104 prohibits the interrupt process by the release button (half-press) 207a. Thereby, in the subsequent operation of the release button (half-press) 207a, focus lock and exposure determination processing are executed as in normal shooting. Then, after executing the process of step S122, the process proceeds to step S123. The continuation of the flowchart of FIG. 5 is shown in the flowchart of FIG. Also, (A) and (B) in the flowchart in FIG. 5 are connected to (A) and (B) in the flowchart in FIG. 10, respectively.

  (Step S123) The control unit 104 determines whether or not the release button (half press) 207a has been pressed. If the release button (half press) 207a is pressed, the process proceeds to step S124. If the release button (half press) 207a is not pressed, the process proceeds to step S137.

  (Step S <b> 124) The control unit 104 performs automatic exposure control (AE) from the image captured by the imaging unit 103.

  (Step S <b> 125) The control unit 104 performs white balance adjustment of an image captured by the imaging unit 103.

  (Step S <b> 126) The control unit 104 performs contrast-type automatic focus control (AF) from the image captured by the imaging unit 103.

  (Step S127) The control unit 104 determines whether or not the release button (full press) 207b has been pressed. If the release button (full press) 207b is pressed, the process proceeds to step S129. If the release button (full press) 207b is not pressed, the process proceeds to step S128.

  (Step S128) The control unit 104 determines whether or not the release button (half press) 207a is pressed. If the release button (half press) 207a is pressed, the process returns to step S127. If the release button (half press) 207a is not pressed, the process returns to step S104 in FIG.

  (Step S129) The control unit 104 opens and closes the shutter 102c, captures a still image with the image capturing unit 103, and captures the captured image into the buffer memory 110.

  (Step S130) As in step S108, the control unit 104 determines whether the selected shooting mode is the normal mode or the party mode. If it is the normal mode, the process proceeds to step S135, and if it is the party mode, the process proceeds to step S131.

  (Step S <b> 131) The control unit 104 detects a face included in the captured image captured in the buffer memory 110, and the detected face feature amount is stored in the data storage area 401 of the nonvolatile memory 109. The personal authentication is performed by determining whether or not the feature quantity matches. For example, in the case of FIG. 11, “Ichiro” and “Taro” are authenticated. Note that faces not set as attendees are excluded.

  (Step S132) As described above, the control unit 104 evaluates the shooting state of the recognized face image. As described above, the evaluation contents are face size (up degree, etc.), facial expression (no blinking, smile, good facial expression, etc.), image quality (less blur, high resolution, exposure) (Appropriate, white balance is good, shade is small, etc.), arrangement (facing front, line of sight is facing the lens, part of face is cut, shading is small, center of screen), etc.

  (Step S133) The control unit 104 determines whether or not the photograph is a failed photograph based on the evaluation result of the shooting state. If it is not a failed photograph (in the case of OK), the process proceeds to step S134, and if it is a failed photograph (in the case of failure), the process proceeds to step S135. Here, the failure photo includes blinking, large blurring, overexposure, partial cut of the face, and the like.

  (Step S134) The control unit 104 updates the face data authenticated in step S131 as the latest face data. Specifically, the face data (face image, face feature amount, etc.) corresponding to the personal data registered in the data storage area 401 of the nonvolatile memory 109 is replaced with the latest face data. Here, the recording date of the face data before update stored in the data storage area 401 of the non-volatile memory 109 may be confirmed, and the face data may be updated if it is older than a preset period. If the evaluation result is better than before, it may be updated. In this case, for example, when the evaluation is higher than before, such as high resolution, good expression, good exposure, good white balance, little shade, looking in front, or looking at the lens. Update face data. The face data before update stored in the data storage area 401 of the non-volatile memory 109 may be overwritten with the newly authenticated face data, or may be retained as it is. As a result, even if there is a problem with the new face data, it can be immediately restored to the original face data.

  (Step S135) The control unit 104 adds a file name to the captured image captured in the buffer memory 110 and records it in the nonvolatile memory 109 or the memory card 108a.

  (Step S136) The control unit 104 performs face authentication data update processing. Specifically, the number of shots stored in the data storage area 401 of the nonvolatile memory 109 is counted up and updated corresponding to the personal data authenticated in step S131. Here, when counting the number of shots for each shooting state, it is determined from the evaluation result of step S132 whether the face of the shot image is a smile or an up image, and each shot number is counted up. . If it is a failed photo, it may be counted as the total number of shots of the person or may not be counted. Alternatively, a failed photo item of the person may be provided and counted as the number of failed photos taken.

  If the personal data is not input or is blank, a personal data input request screen may be displayed to prompt the input. Here, the reason why the personal data is not input or is blank is, for example, when inputting personal data in step S107 or step S119, etc., if it is omitted because it is rushed or other reasons, or if it is omitted. This is a case where the name is not remembered even if it is known but the name cannot be remembered.

  Further, when personal data is not input, on the advice display screen shown in FIG. 9 or the like described above, “unentered attendee” may be displayed instead of the name. Alternatively, a message such as “Do you want to enter a name?” May be displayed. Furthermore, when personal data is not input at the time of image reproduction, a personal data input request screen may be displayed and input. This eliminates the need for troublesome operations such as entering names at a party venue. Even if no name is entered, attendees can be set and face data is registered, so the number of shots can be managed with a temporary name (for example, attendee A) corresponding to the face data. Can do.

  (Step S137) The control unit 104 determines whether or not the power button 207c has been pressed. If the power button 207c is pressed (OFF), the process proceeds to step S138. If the power button 207c is not pressed (ON), the process returns to step S104 in the flowchart of FIG.

  (Step S138) The control unit 104 ends all the operations and turns off the power of the photographing apparatus 101.

  As described above, the photographing apparatus 101 according to the present embodiment counts the number of shots according to the shooting state of the subject, and the number of shots is insufficient for each desired shooting state such as a person who has a shortage of shots, particularly a smile. Therefore, even an unskilled photographer can easily shoot with no deviation in the number of shots. In addition, registration of the faces of the persons to be photographed is not required to register the face photos of all attendees in advance, just register the number of attendees and register attendees while shooting. Can do.

  Here, in the shooting advice display processing in the party mode described in step S121, not only the advice is displayed, but the face is evaluated on the through image, and if there is no problem, automatic shooting may be performed. . For example, as illustrated in FIG. 12A, when the number of images of “Jiro” is insufficient and the face of “Jiro” is captured in the through image, as described above, “Jiro” And a character of “insufficient” are displayed near the face to encourage the photographer to shoot and automatically shoot. In this case, automatic shooting may be performed when shooting is not performed even after a preset time has elapsed. At this time, a message indicating that “automatic photographing” is being performed may be displayed on the screen.

  Further, as shown in FIG. 12B, the zoom lens 102a is controlled to optically zoom up so that the face to be photographed has an appropriate size, or automatically shot after being zoomed up by electronic zoom. You may make it do. Alternatively, as shown in FIG. 13A, when a plurality of faces are shown in the through image, automatic trimming may be performed to automatically photograph an up image of the face (FIG. 13B).

  Further, as shown in FIG. 14, a smile may be detected and automatic shooting may be performed. It should be noted that smile detection may be combined with the automatic trimming of FIG. 13 so that a smiling image is automatically trimmed and automatically shot.

  As described above, as described with various examples, the photographing apparatus 101 according to the present embodiment counts the number of photographs according to the photographing state of the subject when photographing the attendee at an event such as a party. , The number of shots can be taken without being biased toward a specific attendee. In particular, you can set the shooting status you want to take and count the number of shots of the subject for each shooting status you want to take. Can also be reduced.

  In addition, the photographer is advised by displaying information that assists the shooting of the subject in the shooting state that is insufficient in the through image so that it can be understood which person is in shortage in what shooting state. Therefore, even a beginner can easily shoot a subject in a shooting state that is lacking. Furthermore, since the shooting state of a subject for which the number of shots is insufficient is clarified, even a beginner can forget to take a picture by automatically detecting and automatically shooting a subject for which the number of shots is insufficient.

  Also, since the face is evaluated and the number of sheets is counted, it is possible to prevent a mistake that there are only a number of failed pictures but no good pictures.

  Also, even if all attendees are not registered in advance, face data can be registered from a photograph taken in the past or a photograph taken by a camera of another company, so that the setting becomes easy. In particular, since the face data is automatically added sequentially while photographing, troublesome preparation work becomes unnecessary.

  In particular, since face data is automatically updated sequentially, face data extracted from the latest photograph with good facial expression can be used, and the accuracy of face authentication can be improved.

  In the above description, it is assumed that a human face is detected and authenticated as a specific subject and a human face is photographed. However, when a pet companion event is held, a pet photograph or an animal in a zoo The present invention can be applied to any subject that can be individually authenticated, such as when shooting without forgetting to shoot, or shooting sports cars in a circuit field without bias.

  As mentioned above, although the imaging device and the imaging assistance program according to the present invention have been described with examples in each embodiment, the imaging device and the imaging assistance program can be implemented in various other forms without departing from the spirit or the main features thereof. . Therefore, the above-described embodiment is merely an example in all respects and should not be interpreted in a limited manner. The present invention is defined by the claims, and the present invention is not limited to the text of the specification. Further, all modifications and changes belonging to the equivalent scope of the claims are within the scope of the present invention.

DESCRIPTION OF SYMBOLS 101 ... Imaging device; 102 ... Shooting lens; 102a ... Zoom lens; 102b ... Aperture; 102c ... Shutter; 102d ... Focus lens; 103 ... Imaging part; Control unit; 105 ... Display unit; 106 ... Operation unit; 107 ... Lens control unit; 108 ... Memory card I / F; 108a ... Memory card; 109 ... Non-volatile memory 110: buffer memory; 201: imaging device; 202 ... video circuit; 203 ... imaging control circuit; 204 ... monitor; 205 ... monitor control circuit; 207 ... Operation button; 207a ... Release button (half press); 207b ... Release button (full press); 207c ... Power button; 20 d ... Up cursor button; 207e ... Down cursor button; 207h ... Right cursor button; 207g ... Left cursor button; 207f ... Set button; 208 ... Focus control circuit; Shutter control circuit; 210 ... Aperture control circuit; 211 ... Zoom control circuit; 301 ... Shooting processing unit; 302 ... Display processing unit; 303 ... Face recognition processing unit; Evaluation processing unit; 305, registration processing unit, 306, setting processing unit, 307, recording processing unit, 401, data storage area, 402, 403, image storage area

Claims (11)

Discriminating means for recognizing a subject in an input image and discriminating a shooting state of the subject;
And a control unit that counts the number of shots of the subject with respect to the shooting state and displays information for assisting shooting of the subject in accordance with the number of shots with respect to the shooting state. The imaging device according to claim 1,
The control means causes the display device to display information indicating that the number of shots of the subject in the shooting state is insufficient when the number of shots for the shooting state is less than a preset target number. An imaging device characterized by the above. In the imaging device according to claim 1 or 2,
Setting means for setting at least the type of the shooting state and the target number for the type of shooting state;
The imaging device according to claim 1, wherein the control unit counts the number of images of the subject corresponding to the type of the imaging state determined by the determination unit. In the imaging device according to any one of claims 1 to 3,
Storage means for storing identification information for individual identification of the subject,
The discrimination means extracts the identification information of the subject,
The control means determines whether or not the identification information extracted by the determination means is registered in the storage means. If the identification information is not registered, the identification information corresponding to the subject is stored in the storage means. An imaging device characterized by registration. In the imaging device according to claim 4,
The imaging apparatus according to claim 1, wherein the control unit performs a registration process until the number of registered subjects stored in the storage unit reaches a preset number. In the imaging device according to any one of claims 1 to 5,
The control means emphasizes information indicating that the number of photographed subjects in the photographing state is insufficient when the number of photographed subjects in the photographing state is less than the target number. An imaging device characterized by displaying. In the imaging device according to any one of claims 1 to 6,
When there are a plurality of shooting states in which the number of shots of the subject is insufficient, the control means causes the display device to display information indicating the shooting state in which the number of shots is insufficient. Shooting device. In the imaging device according to any one of claims 4 to 7,
The storage means stores personal information of the subject in association with the identification information for individually identifying the subject,
The discrimination means recognizes the subject using the identification information from a through image that displays an input image on the display device in real time,
When the subject is recognized by the determination unit, the control unit includes information for assisting photographing of the subject including the personal information of the subject corresponding to the subject recognized by the determination unit. An imaging device characterized by displaying inside. In the imaging device according to claim 8,
The imaging device, wherein the control unit photographs the subject of the through image when the subject of the through image matches the preset photographing state. In the imaging device according to claim 8 or 9,
Auto focus means for focusing on a preset position on the screen,
The said control means sets the said position for focusing on the said subject when there exists the said subject that the number of imaging | photography is insufficient in the said through image. The imaging device characterized by the above-mentioned. A determination step of recognizing a subject in the input image and determining a shooting state of the subject;
A control step of counting on the subject the number of shots of the subject with respect to the shooting state and displaying information for assisting shooting of the subject on a display device according to the number of shots with respect to the shooting state is executed by a computer Auxiliary program.

Images