JP5024433B2 - Imaging apparatus, control program, and display control method - Google Patents

Description

  The present invention relates to an imaging device that registers a subject in advance and performs imaging, a display control program and a display control method used in the imaging device.

  Conventionally, a camera described in Patent Document 1 is known. This camera drives the photographic lens over the entire area, detects a plurality of focus evaluation value peaks by the contrast method, and shoots at each corresponding lens position. Therefore, even in the case of shooting a scene where a plurality of people are present at different positions from the camera, such as in a snapshot or group photo at a party, each person's position is captured by shooting at each lens position. It is possible to take a photograph in which the face is in focus (for example, see Patent Document 1).

JP 2003-114378 A

  As described above, when the above-described conventional camera is used, it is possible to take a photograph in which each person's face is in focus in a snap photo or a group photo at a party. However, whether or not all the members who participated in the party have taken pictures depends on the memory of the photographer. For this reason, a shooting omission occurs in which there is a participant who is not shown in any of the taken photos, and the problem of this omission has not been solved.

  The present invention has been made in view of such conventional problems, and an object of the present invention is to provide an imaging apparatus, a display control program, and a display control method that can capture a subject without omission.

In order to solve the above-described problem, in the imaging apparatus according to the first aspect of the present invention, a subject storage unit that stores a subject, an imaging unit that sequentially captures an image, an image recording unit that records an image, and the image recording unit in a first determining means for image including an object stored in the object storage means determines whether it is stored, the image in sequentially captured by the imaging means, before Symbol object storage means A second determination unit that determines whether or not a stored subject exists, and a case in which the second determination unit determines that the subject exists; A recording control unit that acquires an image captured by the imaging unit and records the image in the recording unit when it is determined that an image including the subject is not stored in the recording unit; And features.

In the image pickup apparatus according to the second aspect of the invention, the subject storage unit stores a plurality of subjects individually.

In the image pickup apparatus according to the third aspect of the invention, the recording control means includes a form determination means for determining whether or not the subject in the image picked up by the image pickup means is in a predetermined form. And when the form determining means determines that the image is in the predetermined form, the image picked up by the image pickup means is acquired and recorded in the image recording means.

In the imaging device according to the fourth aspect of the invention, in response to an operation, an acquisition unit that acquires an image captured by the imaging unit, and the subject from the image acquired by the acquisition unit Storage control means for extracting and storing in the subject storage means.

Further, in the imaging apparatus according to the fifth aspect of the present invention, characterized in that it comprises display means for displaying a list of object stored before Symbol object storage means.

According to a sixth aspect of the present invention, there is provided a display control program for controlling an image pickup apparatus comprising: a subject storage means for storing a subject; an image pickup means for sequentially taking an image; and an image recording means for recording an image. In addition, a first determination function for determining whether or not an image including the subject stored in the subject storage unit is stored in the image recording unit, and the subject in the images sequentially captured by the imaging unit A second determination function for determining whether or not the subject stored in the storage means exists, and the second determination function determines that the subject is present, and the first determination function When it is determined that the image including the subject is not stored in the image recording unit, the image captured by the imaging unit is acquired and recorded in the image recording unit To realize the recording control function.

In the display control method according to the seventh aspect of the present invention, the display control method in an imaging apparatus comprising: a subject storage unit that stores a subject; an imaging unit that sequentially captures an image; and an image recording unit that records an image. A first determination step for determining whether or not an image including the subject stored in the subject storage unit is stored in the image recording unit; and in the images sequentially captured by the imaging unit. A second determination step for determining whether or not there is a subject stored in the subject storage means, and a case where it is determined that the subject exists by the second determination step, wherein the first determination step If it is determined in the determining step that an image including the subject is not stored in the image recording unit, an image captured by the imaging unit is acquired, and the image recording is performed. Characterized in that it comprises a recording control step for recording the unit.

  According to the present invention, a planned subject can be photographed and recorded without omission.

It is a block diagram of a digital camera common to each embodiment of the present invention. It is a display transition diagram in face registration mode processing. It is a flowchart which shows the process sequence of face registration mode. It is a flowchart which shows the process sequence of the imaging | photography mode in the 1st Embodiment of this invention. It is a display transition diagram in the imaging mode. It is a conceptual diagram which shows the face image registration table in the 2nd Embodiment of this invention. It is a flowchart which shows the process sequence of imaging | photography mode in the embodiment. It is a flowchart which shows the process sequence of the imaging | photography mode in the 3rd Embodiment of this invention. It is a display transition diagram in the imaging mode. It is a flowchart which shows the process sequence of the imaging | photography mode in the 4th Embodiment of this invention. It is a display transition diagram in the imaging mode. It is a figure which shows the memory structure in the 5th Embodiment of this invention. It is a flowchart which shows the process sequence of imaging | photography mode in the embodiment. It is a flowchart which shows the process sequence of the imaging | photography mode in the 6th Embodiment of this invention. It is explanatory drawing which shows the state at the time of the automatic imaging | photography of the embodiment.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
(First embodiment)
FIG. 1 is a block diagram of a digital camera 1 common to the embodiments of the present invention. The digital camera 1 has an AF function (autofocus function), and includes a focus lens 2, a zoom lens 3, a CCD 4, a CDS / AD block 5, a TG (Timing Generator) 6, a CCD data preprocessing block 7, A color processing (CP) block 8, a JPEG encoder 9, a DRAM 10, a built-in flash memory 11, a RAM 12, a CPU 13, a display unit 14, a key block 15, a card interface 16, and a motor drive block 17 are provided. The interface 16 is connected to a memory card 18 that is detachably attached to a card slot of a camera body (not shown).

  The focus lens 2 and the zoom lens 3 are each composed of a lens group (not shown). The motor drive block 17 includes a focus motor 170a that drives the focus lens 2 in the optical axis direction, a zoom motor 170b that drives the zoom lens 3 in the optical axis direction, and a focus motor 170a and a zoom motor 170b according to control signals sent from the CPU 13. Are configured by motor drivers 171a and 171b, respectively. Both the focus motor 170a and the zoom motor 170b are stepping motors.

  The CCD 4 photoelectrically converts the subject image projected through the focus lens 2 and the zoom lens 3 and outputs it as an imaging signal. The TG 6 generates a timing signal with a predetermined frequency and drives the CCD 4. The CDS / AD block 5 samples the output signal from the CCD 4 to remove noise and convert it into a digital signal. The CCD data preprocessing block 7 performs data processing such as luminance signal processing on the imaging signal converted into a digital signal. The color processing (CP) block 8 performs color processing such as color separation on the image signal that has been subjected to luminance signal processing and the like, and generates Y, Cb, and Cr image data. The DRAM 10 sequentially stores Y, Cb, and Cr image data after color processing.

  The display unit 14 is composed of a color LCD and a drive circuit for driving the color LCD, and in a shooting standby state in which the shutter key is not pressed in a state where the shooting mode is set, the 1 captured from the CCD 4 and stored in the DRAM 10. A through image based on image data for a frame (screen) is displayed, and in a state where the reproduction mode is set, a recorded image based on the image data read from the memory card 18 and expanded is displayed.

  The JPEG encoder 9 JPEG-compresses the image data input from the color processing (CP) block 8 during image recording (during imaging processing). The memory card 18 records the compressed image data sent via the card interface 16. The recorded image data is read when the recorded image is reproduced, decompressed by the JPEG encoder 9, and then displayed on the display unit 14. The key block 15 includes a switching key used for switching various modes such as a shooting mode, a reproduction mode, and a face image registration mode, a SET key, a shutter key, a setting key for setting an aperture and a shutter speed, zoom Various operation keys such as a zoom key used for changing the magnification are included, and an operation signal corresponding to the key operation is sent to the CPU 13. Further, the shutter key has a so-called half shutter function, and is configured such that a half-pressing operation for shooting preview and a full-pressing operation for shooting instruction can be performed.

  The flash memory 11 stores a program and various data necessary for the control of the digital camera 1 by the CPU 13, that is, AF control, AE control, AWB control, etc., a control program for executing the control shown in the flowchart described later, and the like. The CPU 13 operates using the RAM 12 as a working memory in accordance with an operation signal from the key block 15 and the program.

  Further, the flash memory 11 is provided with a face image registration table 111 shown in FIG. The face image registration table 111 is provided with a plurality of registration areas for storing face images, and a captured flag F is provided for each registration area. The photographed flag F indicates that a photographed image including a registered face image stored in the area in an OFF state is not recorded on the memory card 18, and a photographed image including the registered face image in an ON state. Is recorded in the memory card 18.

  Next, an operation according to the present invention of the digital camera 1 having the above configuration will be described. When the mode switching key provided in the key block 15 is operated after the power is turned on, the menu screen shown in FIG. When “Face registration” is selected on this menu screen and the SET key is operated, the face registration mode is set. Then, the CPU 13 performs processing as shown in the flowchart of FIG. 3 by operating according to the program. That is, a through image based on one frame (screen) of image data captured from the CCD 4 and accumulated in the DRAM 10 is displayed on the display unit 14 (step S1). Therefore, at this time, when the user points the digital camera 1 toward the face of the person to be photographed without omission, the face image P1 of the person is displayed on the display unit 14 as shown in FIG. .

  Next, it is determined whether or not the shutter key has been operated (step S2). If the user operates the shutter key in this state, the determination in step S2 is YES. Accordingly, the process proceeds from step S2 to step S3 to execute face image extraction processing.

  In the process in step S3, a face area, which is a human face part, is extracted from the captured image stored in the DRAM 10 in accordance with the operation of the shutter key. When extracting the face area, the human face area is detected based on the RGB value or HSV value (hue: Hue, saturation: Saturation, brightness: Value of Brightness) of the skin color area in the photographed image. . For example, if the distribution data of skin color hue (Hue) and saturation (Saturation) is taken, most of the skin color image data has a wide range of saturation, but in the hue (Hue) ring, about 6 ° to It is known that many distributions are in the range of 38 °. By using these, it is possible to detect the face area of the subject, such as the skin color of a human face whose hue (Hue) is in the range of about 6 ° to 38 °, from the HSV value. If the face area is detected in this way, the entire face area and the entire head including the head are extracted as a face image.

  Note that the face image extraction processing in step S103 may use another partial image extraction method without using the above-described method.

  Next, it is determined whether or not a face image has been extracted by the extraction process in step S3 (step S4), and if not extracted, the process proceeds to step S7. If it is extracted, face image registration processing is executed, and the face image extracted in step S3 is stored in the empty registration area of the face image registration table 111 (step S5). Therefore, by the processing in step S5, as shown in FIG. 2C, the face image P1 of the person photographed this time is registered in the empty registration area of the face image registration table 111.

  Subsequently, a message display process is executed (step S6), and a message such as “a face image has been registered” as shown in FIG. Further, it is determined whether or not the mode has been switched from this face registration mode to another mode (step S7), and the loop of step S1 to step S7 is repeated until the mode is switched. Therefore, when the user performs photographing in the face registration mode, for example, seven face images P1 to P7 can be registered in the face image registration table 111 as shown in FIG.

  Therefore, the face image can be easily registered by operating the shutter key as in the case of performing normal shooting.

  In this way, when the registration of the face images P1 to P7 of the person to be photographed without omissions such as family and friends is completed, the mode from the face registration mode to another mode is operated by the operation of the key block 15. Switch. Thereby, determination of step S7 becomes YES, and it progresses to step S8 from step S7, and after performing a face image list display process, the process according to this flow is complete | finished.

  At this time, in the face image list display process in step S8, the face images registered in the face image registration table 111 are displayed as a list on the display unit 14, as shown in FIG. Therefore, the user can confirm whether or not all the face images of the person to be photographed have been registered by looking at the face images displayed as a list on the display unit 14. As a result of the confirmation, if there is still a face image to be registered, the face image registration mode is set again and the shutter operation may be performed in the same manner as described above.

  In the present embodiment, the face image registration is performed by photographing a person's face, but the playback mode is set and the image recorded on the memory card 18 is displayed on the display unit 14. The face image included in this image may be designated as an area and registered in the face image registration table 111. Thereby, it is possible to register a face image without taking a photographing process.

  In the present embodiment, the face image shot in the face image registration mode is recorded only in the face image registration table 111. However, the face image may be recorded in the memory card 18 in the same manner as in normal shooting. Good. As a result, the face image taken at the time of registering the face image can be reproduced and displayed in the same manner as a normal photographed image.

  On the other hand, when the shooting omission prevention shooting mode or the normal shooting mode is set, the CPU 13 performs processing as shown in the flowchart of FIG. 4 by operating according to the program. That is, a through image based on image data for one frame (screen) taken in from the CCD 4 and accumulated in the DRAM 10 is displayed on the display unit 14 (step S101). Next, it is determined whether or not the shutter key has been operated (step S102). When the shutter key is operated, shooting processing is executed (step S103), and JPEG compressed image data is recorded in the memory card 18. To do.

  Next, a face image is extracted from the captured image that is the image data recorded in the memory card 18 by executing the face image extraction process described above (step S104). Further, it is determined whether or not a face image can be extracted by the process in step S104 (step S105). If the face image cannot be extracted, the process proceeds to step S109. If it can be extracted, it is determined whether or not the extracted face image is a face image registered in the face image registration table 111 (step S106).

  In the determination in step S106, matching between the face area extracted from the captured image recorded in the memory card 18 this time and each face image recorded in the face image registration table 111 to be compared with this, or the correlation degree, Calculation of similarity, similarity distance, and difference is performed. That is, the feature data of each face image recorded in the face image registration table 111 to be a template is calculated, and template matching with the photographed image, or each feature data is compared, and the degree of correlation, similarity, similarity Calculate distance, etc. If these calculated values are equal to or larger than the predetermined value, the registered face image is included in the captured image, that is, step S106 is determined to be YES, and if it is less than the predetermined value, the captured image is determined. Does not contain a registered face image, that is, NO is determined in step S106.

  Note that the registered face determination process in step S106 may use another determination processing method without using the above-described method.

  If the registered face image is not included in the captured image recorded in the memory card 18 this time (step S106; NO), the process proceeds to step S110 without performing the processes of steps S107 to S109. If the registered face image is included in the captured image recorded in the memory card 18 this time, the captured flag F of the registered face image determined to be included in the face image registration table 111 is turned ON. (Step S107).

  At this time, when a plurality of registered face images are included in the photographed image, the photographed flag F of each registered face image is turned ON. On the contrary, even when a plurality of registered face images are included in the photographed image, only the photographed flag F of any one registered face image may be turned on.

  Subsequently, an unphotographed face image, which is a registered face image whose photographed flag F is OFF in the face image registration table 111, is detected (step S108), and the detected unphotographed face image is displayed on the display unit 14 (step S108). Step S109). As a result of the processing in step S109, for example, as shown in FIG. 5A, an unphotographed registered face image whose photographed flag F is OFF is displayed as it is, and the photographed flag F is turned ON. “OK” is superimposed on the photographed registered face image. Alternatively, as shown in FIG. 5B, an unphotographed registered face image whose photographed flag F is OFF is displayed as it is, and a photographed registered face image whose photographed flag F is ON is displayed. Blur display.

  Therefore, in the present embodiment, every time an image including a registered face image is captured, the unphotographed registered face image is displayed on the display unit 14. Therefore, the user can confirm the unphotographed person every time the person who has been registered in advance is photographed. Therefore, the user is strongly impressed by the non-photographer, and after that, the user is aware that the non-photographer is preferentially photographed, and as a result, the preregistered person can be photographed without omission.

  Then, in step S110 following step S109, it is determined whether or not there has been an instruction to end shooting due to, for example, switching from the shooting mode to another mode. The processing from step S101 is repeated until a photographing end instruction is issued, and the processing according to this flowchart is terminated when the photographing end instruction is issued.

  In the present embodiment, after performing the photographing process in step S103 and recording the photographed image on the memory card 18, it is determined whether or not the registered face image is included in the photographed image recorded in step S106. I made it. However, when the shutter key is operated, the photographed image is stored in the DRAM 10, and when it is determined that the registered face image is included in the photographed image, the photographed image is recorded in the memory card 18 and photographed. If it is determined that the registered face image is not included in the image, the captured image stored in the DRAM 10 may be deleted without being recorded in the memory card 18.

  As a result, only the captured image including the registered face image can be recorded in the memory card 18.

  In the present embodiment, when the determination in step S106 is NO, the process proceeds to step S110. However, the process may proceed to step S108. In this case, even if the registered face image is not included in the photographed image, the unphotographed registered face image is displayed every time the photograph is taken. As a result, it is possible to prompt the user to take an image of a person who has been registered in advance.

  Furthermore, the time point when the unphotographed information display in step S109 is executed is not limited to immediately after the photographing process, but when the power is turned on, when the photographing mode is set for the first time, when the shutter key is operated for the first time, etc. It may be. Further, the display of unphotographed information in step S109 is not limited to the display form shown in FIG. 5, and other photographed and unphotographed images are identified and displayed, or only registered face images that have been photographed are displayed. It may be.

(Second Embodiment)
FIG. 6A is a diagram showing a face image registration table 111 in the second embodiment of the present invention. The face image registration table 111 is provided with a plurality of registration areas for storing face images, and a counter C is provided for each registration area. The counter C is incremented every time an image having an initial value “0” and containing a registered face image stored in the area is captured.

  In each of the following embodiments, the face registration mode process is performed in the same procedure as in the first embodiment shown in the flowchart of FIG.

  FIG. 7 is a flowchart showing a processing procedure of shooting mode processing in the present embodiment. When the shooting omission prevention shooting mode or the normal shooting mode is set, the CPU 13 performs processing as shown in this flowchart by operating according to the program. That is, a through image based on one frame (screen) of image data captured from the CCD 4 and accumulated in the DRAM 10 is displayed on the display unit 14 (step S201). Next, it is determined whether or not the shutter key has been operated (step S202). When the shutter key is operated, shooting processing is executed (step S203), and JPEG-compressed image data is recorded in the memory card 18. To do.

  Next, a face image is extracted from the captured image that is the image data recorded in the memory card 18 by executing the face image extraction process described above (step S204). Further, it is determined whether or not a face image can be extracted by the process in step S204 (step S205). If the face image cannot be extracted, the process proceeds to step S209. If it can be extracted, it is determined whether the extracted face image is any face image registered in the face image registration table 111 (step S206). If the registered face image is not included in the photographed image recorded on the memory card 18 this time (step S206; NO), the process proceeds to step S209 without performing the processes of steps S207 and S208. Further, when a registered face image is included in the photographed image recorded in the memory card 18 this time, the counter C of the registered face image determined to be included in the face image registration table 111 is counted up. (Step S207).

  At this time, if a plurality of registered face images are included in the captured image, the counter C of each registered face image is incremented. In contrast to this, even when a plurality of registered face images are included in the captured image, only the counter C of any one registered face image may be counted up.

  Subsequently, the number of shots display process is executed (step S208). As shown in FIG. 6B, the face image registered in the face image registration table 111 is displayed on the display unit 14 and the value of the counter C corresponding to each face image is obtained by the processing in step S208. Is superimposed.

  Therefore, in the present embodiment, each time an image including a registered face image is captured, the display unit 14 displays the number of captured images including the registered face image for each registered face image. The Therefore, the user can check the number of images taken by each registered person each time a person registered in advance is photographed. Therefore, the user is strongly impressed by the number of shots taken by each registrant, and is conscious of trying to give priority to those who have not been shot or those who have taken a few shots, and who have registered in advance with no omissions. Can be taken.

  In step S209 following step S208, it is determined whether or not there has been an instruction to end shooting due to, for example, mode switching from the shooting mode to another mode. The processing from step S201 is repeated until a photographing end instruction is issued, and the processing according to this flowchart is terminated when the photographing end instruction is issued.

  In the present embodiment, when the determination in step S206 is NO, the process proceeds to step S209. However, the process may proceed to step S208. In this case, even if the registered face image is not included in the captured image, the number of images taken by the registrant is displayed every time the image is captured. As a result, it is possible to prompt the user to take an image of a person who has been registered in advance.

  In addition, the time point when the unphotographed number display in step S208 is executed is not limited to immediately after the photographing process, but at other time points such as when the power is turned on, when the photographing mode is set for the first time, when the shutter key is operated for the first time, etc. It may be. Further, the number display in step S208 is not limited to the superimposed display shown in FIG. 6B, but may be another display form such as displaying on the side.

(Third embodiment)
FIG. 8 is a flowchart showing a processing procedure of shooting mode processing according to the third embodiment of the present invention. The face image registration table 111 in this embodiment is the same as that of the first embodiment shown in FIG. 2C, and a captured flag F is provided for each registration area. In the flowchart of FIG. 8, the processes in steps S307 to S315 are the same as the processes in steps S102 to S110 in the flowchart of the first embodiment shown in FIG. Therefore, if the registered face image is included in the captured image recorded in the memory card 18 by the process of S312 which is the same process as step S107, it is determined that it is included in the face image registration table 111. The registered flag F of the registered face image is set to ON.

  Thus, in the present embodiment, a through image is displayed on the display unit 14 (step S301), and a face image is extracted from the through image displayed on the display unit 14 (step S302). This face image extraction may be performed by the extraction processing described in step S104.

  Further, it is determined whether or not a face image is extracted by this extraction process (step S303). If not extracted, the process proceeds to step S307. When a face image is extracted, whether or not the extracted face image is a registered face image by comparing the extracted face image with the face image registered in the face image registration table 111. Is determined (step S304). If the extracted face image is a registered face image, a photographed and unphotographed display process is executed (step S305).

  That is, as described above, when the registered face image is included in the captured image recorded in the memory card 18, the registered face image determined to be included in the face image registration table 111 has been captured. The flag F is turned on. Therefore, by referring to the photographed flag F in the face image registration table 111, it is possible to identify whether the face image (registered face image) extracted from the through image has been photographed or not photographed.

  If the image has been photographed, as shown in FIG. 9A, a frame surrounding the face image extracted in step S302 is displayed on the through image displayed on the display unit 14 and “photographed. "Is displayed. If the image has not been photographed, as shown in FIG. 9B, a frame surrounding the face image extracted in step S302 and a character “unphotographed” are displayed. Thereafter, it is determined whether or not the shutter key has been operated (step S307), and the processing from step S301 is repeated until the shutter key is operated.

  Therefore, by repeating the processing from step S301, a plurality of face images are extracted from the through image, and if these extracted face images are registered face images, step S305 is performed for each face image. Will be executed. Therefore, when a plurality of face images are extracted from the through image and the extracted face images are registered face images, as shown in FIG. The frame to be displayed and the characters “photographed” or “unphotographed” are displayed.

  Therefore, a user who has visually recognized the through images in FIGS. 9A, 9B, 9C, etc. can distinguish between an unphotographed person and a photographed person before operating the shutter key. Therefore, it is possible to shoot a person who has been registered in advance without any omission.

  On the other hand, if the determination in step S304 is NO and the extracted face image is not a registered face image, unregistered display is executed (step S306). As shown in FIG. 9D, the unregistered display is performed by displaying a frame surrounding the face image extracted in step S302 and characters “unregistered”.

  Therefore, if the user who visually recognizes this unregistered display is an unregistered person and decides that it is not necessary to shoot, the user can change the angle of view and shoot an image excluding the unregistered person. it can. Further, by changing the setting to the face image registration mode, it is possible to newly register a face image of an unregistered person in the face image registration table 111.

  It is preferable to display the frame and the character that surrounds each face image in different colors according to “photographed”, “unphotographed”, and “unregistered” in order to ensure identification.

(Fourth embodiment)
FIG. 10 is a flowchart showing a processing procedure of shooting mode processing according to the fourth embodiment of the present invention. The face image registration table 111 in this embodiment is the same as that in the second embodiment shown in FIG. 6A, and a counter C is provided for each registration area. Further, in the flowchart of FIG. 10, the processes of steps S406 to S413 are the same as the processes of steps S202 to S209 in the flowchart of the second embodiment shown in FIG. Therefore, when the registered face image is included in the captured image recorded in the memory card 18 by the process of S411, which is the same process as step S207, it is determined that it is included in the face image registration table 111. The registered face image counter C is incremented. Therefore, the counter C of each registered face image indicates the number of captured images including the registered face image.

  Accordingly, in the present embodiment, a through image is displayed on the display unit 14 (step S401), and a face image is extracted from the through image displayed on the display unit 14 by extraction processing (step S402). Also, it is determined whether or not a face image has been extracted by this extraction process (step S403). If not extracted, the process proceeds to step S406. When a face image is extracted, whether or not the extracted face image is a registered face image by comparing the extracted face image with the face image registered in the face image registration table 111. Is determined (step S404). If the extracted face image is a registered face image, the number-of-shots coloring display process is executed (step S405).

  That is, as described above, the counter C of each registered face image indicates the number of captured images including the registered face image. Therefore, by referring to the counter C of each registered face image, the number of photographed face images (registered face images) extracted from the through image is detected. Then, as shown in FIGS. 11A and 11B, a frame surrounding the face image extracted in step S402 is displayed, and characters indicating the number of shots are displayed in a color corresponding to the number of shots. Thereafter, it is determined whether or not the shutter key has been operated (step S406), and the processing from step S401 is repeated until the shutter key is operated.

  Therefore, by repeating the processing from step S401, a plurality of face images are extracted from the through image, and if these extracted face images are registered face images, step S405 is performed for each face image. Will be executed. Therefore, when a plurality of face images are extracted from the through image and the extracted face images are registered face images, as shown in FIGS. 11A and 11B, each face image is extracted. In addition, a frame surrounding the frame and characters indicating the number of shots colored in a color corresponding to the number of shots are displayed.

Characters indicating the number of shots colored with a color corresponding to the number of shots are, for example,
0: Not photographed-Red display 1-2: Photographed, but the number is small-Yellow display 3 or more: Sufficient number photographed-Blue display.

  Therefore, the user who has visually recognized these colored photographing number displays can recognize the photographing priority by the color and the numerical value. As a result, it is possible to perform photographing of a person who has been registered in advance without any omission.

  Therefore, according to the first and second embodiments, it is possible to shoot a person who has been registered in advance without performing omission while performing post-confirmation that is confirmation after shooting, and the third and fourth embodiments. According to the embodiment, it is possible to perform shooting of a person who has been registered in advance without performing omission of shooting while performing prior confirmation that is confirmation before shooting.

(Fifth embodiment)
FIG. 12 is a diagram showing a memory configuration in the fifth embodiment of the present invention. In the present embodiment, the flash memory 11 is provided with a single number memory 112 shown in (A) and a combined number memory 113 shown in (B). The single number memory 112 is a memory for storing the face image and the number of shots when only one face image stored in the face image registration table 111 exists in the shot image. The combination number memory 113 is a memory for storing the combination of face images and the number of shots in the combination when there are any plurality of face images stored in the face image registration table 111 in the photographed image. .

  FIG. 13 is a flowchart showing a processing procedure of shooting mode processing in the present embodiment. When the shooting omission prevention shooting mode or the normal shooting mode is set, the CPU 13 performs processing as shown in this flowchart by operating according to the program. That is, a through image based on image data for one frame (screen) captured from the CCD 4 and accumulated in the DRAM 10 is displayed on the display unit 14 (step S501). Next, it is determined whether or not the shutter key has been operated (step S502). When the shutter key is operated, shooting processing is executed (step S503), and JPEG-compressed image data is recorded in the memory card 18. To do.

  Next, a face image is extracted from the captured image that is the image data recorded in the memory card 18 by executing the face image extraction process described above (step S504). At this time, if there are a plurality of face images, all face images are extracted. In addition, it is determined whether or not at least one face image has been extracted by the processing in step S504 (step S505). If extraction has failed, the process proceeds to step S512. If it can be extracted, it is determined whether or not the extracted face image is included in the registered face image registered in the face image registration table 111 (step S506).

  If the registered face image is not included in the captured image recorded in the memory card 18 this time (step S506; NO), the process proceeds to step S512 without performing the processes of steps S507 to S511. In addition, when the registered face image is included in the captured image recorded in the memory card 18 this time, whether or not there are a plurality of registered face images, that is, the captured image captures a plurality of registrants. It is determined whether or not it has been (step S507). If the photographed image is not a photograph of a plurality of registrants but a photographer of a single registrant, the single sheet memory 112 is updated (step S508).

  That is, when this registrant is photographed for the first time and the face image is not yet stored in the single number memory 112, the face image of the registrant read from the face image registration table 111 and the number of photographs “1” are recorded. Are written in the single sheet memory 112 and updated. Therefore, as shown in FIG. 12C, when a single registrant is photographed and the face image has not yet been stored in the single number memory 112, the single number as shown in FIG. In the memory 112, the face image of the registrant and the number of shots “1” are written. Further, when the registrant is photographed again and the face image is already stored in the single number memory 112, the number of photographed images corresponding to the face image is incremented.

  Next, a memory content display process is executed to display the content stored in the single sheet memory 112 on the display unit 14 (step S509). Thereby, as shown in FIG. 12A, the number of shots is displayed on the display unit 14 corresponding to the face image.

  Therefore, the user who has recognized this can recognize the shooting priority in the single shooting based on the number of shots corresponding to the face image, and can perform the single shooting of the person who has been registered in advance without any omission. .

  If the result of determination in step S507 is that the photographed image is a photograph of a plurality of registrants, the combination number memory 113 is updated (step S508). That is, when this combination of registrants is photographed for the first time and the combination face image is not yet stored in the combination number memory 113, the face images of the plurality of registrants read from the face image registration table 111 are photographed. The number “1” is written in the combination number memory 113 and updated. Therefore, as shown in FIGS. 12D, 12E, and 12F, when a registrant is photographed in combination and the combined face image has not yet been stored in the combination number memory 113, FIG. In the combination number memory 113, the face image of the combination of the registrant and the number of shots “1” are written in the combination number memory 113 as shown in FIG. In addition, as shown in FIG. 12G, when the registered person of the combination is photographed again and the face image is already stored in the single number memory 112, the number of photographed images corresponding to the face image is incremented. Is done.

  Next, a memory content display process is executed to display the contents stored in the combination number memory 113 on the display unit 14 (step S511). As a result, as shown in FIG. 12B, the number of shots is displayed on the display unit 14 corresponding to the combined face image.

  Therefore, the user who has recognized this can recognize the shooting priority in combination shooting based on the number of shots corresponding to the combined face image, and can perform combined shooting of a person who has been registered in advance without any omission. it can.

  In the memory contents display processing in steps S509 and S511, only the contents of the single sheet memory 112 and the combination sheet memory 113 are displayed, respectively. However, the contents of the single sheet memory 112 and the combination sheet memory 113 are the same. It may be displayed on the screen or displayed in time division.

  Further, in the description of the present embodiment, a case where only one or a plurality of registrants are present in the captured image is shown, but even if a non-registered person is included in the captured image, This can be handled by processing according to the flowchart.

(Sixth embodiment)
FIG. 14 is a flowchart illustrating a processing procedure of the shooting mode processing according to the sixth embodiment of the present invention. The face image registration table 111 in this embodiment is the same as that of the first embodiment shown in FIG. 2C, and a captured flag F is provided for each registration area.

  Therefore, in the present embodiment, a through image is displayed on the display unit 14 (step S601), and a face image is extracted from the through image displayed on the display unit 14 (step S602). This face image extraction may be performed by the extraction processing described in step S104.

  Further, it is determined whether or not a face image has been extracted by this extraction process (step S603), and if not extracted, the process proceeds to step S612. When a face image is extracted, whether or not the extracted face image is a registered face image by comparing the extracted face image with the face image registered in the face image registration table 111. Is determined (step S604). If the extracted face image is not a registered face image, the process proceeds to step S612. If the extracted face image is a registered face image, it is determined whether or not the image has been taken depending on whether or not the corresponding taken flag F is ON (step S605). If the corresponding captured flag F is ON and the captured image has been captured, the process proceeds to step S612.

  Also, if the corresponding captured flag F is OFF and the image has not been captured, whether or not the face in the through image that is the registered face image is facing the front (step S606), Whether or not the face exceeds a certain size (step S607), whether or not the face exists in the center area in the through image (step S608), and whether or not the movement of the subject having the face stops (step S609) ).

  In the determination in step S609, attention is paid to, for example, a block composed of a plurality of pixels in the subject having the face, and a movement vector in a frame image before and after the focused block is calculated. It is determined that the movement has stopped when the distance becomes almost “0”.

  If any one of these steps S606 to S609 is YES, automatic shooting is executed (step S610), and the JPEG-compressed image data is recorded in the memory card 18. Therefore, as shown in FIG. 15, (A) when the face is facing the front, (B) when the face size exceeds a certain size, (C) when the face is in the center area of the screen (D) Automatic shooting is performed in any case when the movement of the subject stops. As a result, it is possible to record a captured image that is clearly captured by the registrant.

  In addition, since automatic shooting is executed only for registrants who have not been shot because the photographed flag F is OFF, there is no increase in the number of shots of a specific person, and each registrant is photographed. Images can be recorded. Therefore, it is possible to record an image in which each registrant is clearly photographed without omission of photographing.

  If automatic shooting has been executed, the shooting completion flag is set to ON, and the process proceeds to step S614. On the other hand, if the determination in steps S603, S604, and S609 is NO, and in step S612 following the determination in S605 is YES, it is determined whether or not the shutter key has been operated. If so, shooting processing is executed (step S613). Therefore, manual shooting can also be performed by operating the shutter key.

  If step S612 is NO and the shutter key is not operated, and in step S614 following step S611 and step S613, whether or not there has been an instruction to end shooting due to, for example, switching from the shooting mode to another mode. Determine whether. The processing from step S601 is repeated until a photographing end instruction is issued, and the processing according to this flowchart is terminated when the photographing end instruction is issued.

  In this embodiment, it is determined in step S605 whether or not shooting has been performed based on the shooting completed flag, and automatic shooting is performed when shooting has not been performed. However, in step S605, based on the value of the counter C, it may be determined whether or not the number of shots is equal to or less than a predetermined number. If the number is equal to or less than the predetermined number, automatic shooting may be performed.

  Thereby, it is possible to record an even number of images clearly captured by each registrant without omission of shooting.

  In this embodiment, the through image is displayed in step S601. However, only the processes in steps S602 to S611 and step S614 may be performed without displaying the through image.

  In each of the embodiments, the case where a person's face image is used as a registered image has been described. However, the registered image is not limited to a face image and may be any subject.

  The photographed flag F and the counter C used in each embodiment may be reset at the start of processing in the photographing mode or at the end of photographing in the photographing mode.

1 Digital Camera 9 JPEG Encoder 10 RAM
11 Flash memory 12 RAM
13 CPU
14 Display Unit 15 Key Block 18 Memory Card 111 Face Image Registration Table 112 Single Number Memory 113 Combination Number Memory

Claims (7)

Subject storage means for storing the subject;
Imaging means for sequentially imaging;
Image recording means for recording an image;
First determination means for determining whether or not an image including a subject stored in the subject storage means is stored in the image recording means;
The image in sequentially captured by the imaging means, a second determination means for object stored before Symbol object storage means determines whether there,
If it is determined by the second determination means that the subject exists, and if it is determined by the first determination means that an image including the subject is not stored in the image recording means, the imaging An imaging apparatus comprising: a recording control unit that acquires an image captured by the unit and causes the image recording unit to record the acquired image. The object storage means, the image pickup apparatus according to claim 1, wherein the individually store a plurality of subjects. The recording control means includes form determining means for determining whether or not the subject in the image picked up by the image pickup means is in a predetermined form,
3. The image recording unit according to claim 1, wherein an image captured by the image capturing unit is acquired and recorded by the image recording unit when the form determining unit determines that the image is in the predetermined form. Imaging device. An acquisition means for acquiring an image captured by the imaging means in response to an operation;
The imaging apparatus according to any one of claims 1 to 3, characterized in that from the image acquired by the acquiring unit and a storage control means for storing in said object storage means to extract the subject. 5. The imaging apparatus according to claim 4, further comprising display means for displaying a list of subjects stored in the subject storage means. A computer that controls an imaging apparatus including a subject storage unit that stores a subject, an imaging unit that sequentially captures an image, and an image recording unit that records an image;
A first determination function for determining whether or not an image including a subject stored in the subject storage unit is stored in the image recording unit;
A second determination function for determining whether or not a subject stored in the subject storage means exists in images sequentially captured by the imaging means;
When it is determined by the second determination function that the subject exists, and when it is determined by the first determination function that an image including the subject is not stored in the image recording unit, the imaging Recording control function for acquiring an image captured by the means and recording the image on the image recording means
Display control program for realizing. A display control method in an imaging apparatus comprising: a subject storage unit that stores a subject; an imaging unit that sequentially captures an image; and an image recording unit that records an image,
A first determination step of determining whether or not an image including a subject stored in the subject storage unit is stored in the image recording unit;
A second determination step of determining whether or not a subject stored in the subject storage means exists in images sequentially captured by the imaging means;
If it is determined in the second determination step that the subject exists, and if it is determined in the first determination step that an image including the subject is not stored in the image recording unit, the imaging A recording control step of acquiring an image captured by the means and recording the image on the image recording means;
A display control method comprising:

Images