JP5182507B2 - Imaging apparatus, imaging guide method, and program - Google Patents

Description

The present invention relates to a photographing apparatus, a photographing guidance method, and a program that have a face recognition function and output guidance for a subject.

  Conventionally, a photographing device such as a digital camera or a mobile phone has a function of automatically photographing using face detection / face recognition technology, for example, autofocusing on a human face in a photographing frame as a subject. There are known techniques for taking a picture and automatically taking a picture of a smiling face. Furthermore, before shooting, feature points are extracted and registered from face data from still images, and determined by the degree of matching with feature points at the time of face detection. For example, when all specified persons are recognized, In the case where the designated person is not included, a technique for guiding the camera direction, the moving direction of the subject, the standing position, and the like with LEDs, operation sounds, voices, and the like is known (for example, patents). Reference 1, Patent Document 2, Patent Document 3, and Patent Document 4).

JP-A-2005-341016 JP 2005-269562 A JP 2006-74368 A JP 2004-349959 A

  However, in the above prior art, when a designated person is not included or when it is not in a best state (such as being within a shooting frame), a guidance function such as a warning is insufficient. For example, in the prior art, when the designated person is not included or when the person is not in the best state (e.g., within the shooting frame), the LED emits light or the operation sound or voice guides. In particular, there is a problem that there is no way of knowing who is not included and who is not within the shooting frame, so that proper guidance cannot be performed.

SUMMARY OF THE INVENTION An object of the present invention is to provide a photographing apparatus capable of providing appropriate guidance to a specific person during photographing.

In order to achieve the above object, the imaging apparatus of the present invention includes an imaging means for imaging a subject, personal information storage means for preliminarily storing the face recognition data characterizing the face portion of the person and the personal information of the person in association with each other. And a face recognition unit for recognizing a face part of a person from an image obtained by imaging by the imaging unit, and a person corresponding to the face part recognized by the face recognition unit are stored in the personal information storage unit. A person specifying means for specifying based on the face recognition data, a state specifying means for specifying a person who has not been imaged in a predetermined state among the persons specified by the person specifying means, and the state specifying means personal information of the person that is identified that is not captured by the predetermined state, the personal information and personal information reading means for reading from the storage means, the individual is recognized by the face recognition unit And personal information read by the multi-address reading means, based on the state of the person identified that are not captured by the predetermined state by said state specifying means, specified that not captured said in a predetermined state a guidance information instructing to be the person is captured in the predetermined state, a person that is not captured by the predetermined state, create guide information to create an identifiable guidance information by the personal information of the person And guidance information output means for outputting the guidance information created by the guidance information creation means.

Further, as a preferred aspect , the guide information creating means is further configured so that the person is in the predetermined state based on the personal information read by the personal information reading means and the state of the person specified by the state specifying means. A guidance sentence for instructing that an image is taken in, which can identify the corresponding person, is created.
Further, as a preferred aspect, the guide information output means synthesizes and outputs a guide voice based on the guide sentence created by the guide information creation means.

Further, as a preferred aspect , the state specifying unit determines whether or not the image is captured in the predetermined state by a plurality of items, and the guide information generating unit is configured to capture the person in the predetermined state. Guidance information that is instructed and capable of specifying an item that has not been imaged in the predetermined state is created.

Further, as a preferred aspect , the state specifying means includes a plurality of items for determining whether or not an image is picked up in the predetermined state, and the person falls within a predetermined image pickup area picked up by the image pickup means. It includes at least one determination item among a determination item of whether or not, a determination item of whether or not laughing, and a determination item of whether or not eyes are closed.
Further, as a preferred aspect, the guide information creating means further includes: guide information for prompting the person to enter the shooting area, guide information for prompting the person to laugh, guide information for prompting the person not to blink. Of these, at least one guide information is created.

Further, as a preferred aspect , the state specifying means specifies in which direction the person is deviating from a predetermined imaging area imaged by the imaging means, and the guidance information creating means Guidance information indicating a direction to move in order to enter a predetermined imaging region is created.

Further, as a preferred aspect, the personal information includes a name of a person, and the guide information creating means creates the guidance text including the name of the person.
Further, as a preferred aspect , the guide information creating means creates a guide sentence in a form suitable for the person based on the personal information read by the personal information reading means.

Further, as a preferred aspect , the personal information includes a person's age, and the guide information creating means creates the guide sentence according to the person's age.

Further, as a preferred aspect, the guide information output means further includes a guide in a form suitable for the person based on the personal information read by the personal information read means and the guide text created by the guide information creation means. It is characterized by synthesizing and outputting speech.
Moreover, as a preferable aspect , the personal information further includes music preferred by a person,
The guidance information output means synthesizes and outputs the guidance voice including the music.

Further, as a preferred aspect , the personal information further includes a character preferred by a person or a voice color of a celebrity, and the guidance information output means synthesizes and outputs the guidance voice with the voice color.

In a preferred aspect , the personal information includes a language used by a person, and the guidance information output means creates the guidance text in the language.

In addition, as a preferred aspect, it further includes basic guide sentence storage means for storing a plurality of basic guide sentences, and the guide information creating means is a plurality of guide sentences stored in the basic guide sentence storage means. Basic guidance sentence selecting means for selecting at least one basic guidance sentence corresponding to the personal information specified by the personal information specifying means, and at least one basic guidance sentence selected by the basic guidance sentence selecting means. And guidance information synthesizing means for creating the guidance text by synthesizing the personal information read by the personal information reading means.

Further, as a preferred aspect, the information processing device further includes a designation unit that designates at least one person to be identified by the person identification unit, and the personal information storage unit indicates whether or not the designation unit has designated The flag is stored in association with the personal information of the person, and the person specifying means corresponds to at least one person for which the designation flag is set to be effective corresponding to the face portion recognized by the face recognition means. The person is identified based on the face recognition data stored in the personal information storage means.

Further, in order to achieve the above object, the photographing guide method of the present invention provides a personal information storage means that associates the step of imaging a subject, the face recognition data characterizing the face portion of the person and the personal information of the person in advance. a step of storing in a recognizing a face portion of a person from the captured image, the person corresponding to the recognized face portion, and identifying based on the face recognition data that is the storage The step of identifying a person who has not been imaged in a predetermined state among the identified persons, and personal information of the person who has been identified as not being imaged in the predetermined state, from the personal information storage means a step of reading, and personal information by the recognition of the face portion is read from the personal information storage unit, that not being captured by said predetermined state by said state specifying means Based on the state of the constant is the person, a guidance information which the predetermined person may not captured in the state identified is instructed to be imaged at the predetermined state, captured the in a predetermined state It includes a step of creating guidance information that can identify a person who has not been identified by the personal information of the person , and a step of outputting the created guidance information.

In order to achieve the above object, the program of the present invention is a program for controlling the operation of an imaging apparatus including an imaging unit for imaging a subject, and has an imaging function for imaging an object by the imaging unit on a computer, Personal information storage function for storing in advance the face recognition data characterizing the face part and personal information of the person in association with each other, face recognition for recognizing the face part of the person from the image captured by the imaging unit Function, a person identification function that identifies a person corresponding to the face portion recognized by the face recognition function based on the face recognition data stored by the personal information storage function, and a person identified by the person identification function of, the condition specifying function of specifying a person which is not captured in a predetermined state, it is identified that is not captured by the predetermined state by said state specific function Personal information of the object, the personal information reading function to read from the personal information storage function, the personal information read by the personal information reading function is recognized by the face recognition function, by the condition specifying function of said predetermined condition in based on the state of a person specified to be not captured, the predetermined state person identified that is not captured by that a guidance information instructing to be imaged at the predetermined state, Guidance information creation function for creating guidance information that can identify a person who has not been imaged in the predetermined state based on personal information of the person , and guidance information output function for outputting guidance information created by the guidance information creation function It is characterized by realizing.

According to the present invention, guidance for instructing a person who is not in a predetermined state to be imaged in a predetermined state is guided to anyone by guiding the guidance in a form that can identify a person who is not in the predetermined state. This makes it possible to obtain an advantage that more effective guidance can be given to this person.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

A. Configuration of Embodiment FIG. 1 is a block diagram showing a configuration of a digital camera according to an embodiment of the present invention. In the figure, the input device 1 includes a plurality of button switches such as a shutter button, a cross key, and a function selection button. The internal storage device 2 includes a ROM, a RAM, and the like, and stores a predetermined program, data, and the like. In particular, in the present embodiment, a guidance sentence for guiding a person who is not in the photographing frame at the time of photographing to enter the photographing frame and personal information used to create the guidance sentence are stored. The camera device 3 includes an optical lens, an image sensor, a driver, and the like, and captures captured images. The display device 4 includes a liquid crystal display and displays a through image at the time of shooting, a captured image after shooting, various menus, shooting parameters, and the like.

  The voice input / output device 5 includes a microphone, a speaker, a voice processing unit, and the like. The voice input / output device 5 inputs external voice from the microphone and DA-converts voice data and outputs it from the speaker. In particular, the present embodiment has a function for synthesizing a guidance sentence (such as movement into a shooting frame) for a specific person during shooting. The external storage device 6 includes an interface for mounting an external storage medium such as an SD slot, and exchanges data with the external storage medium. The external storage medium stores captured images and the like in a predetermined format. Note that the above-described personal information and guidance text may be stored in the external recording medium. The strobe light emitting device 7 is a light emitting means for compensating for underexposure.

  The CPU 8 executes a predetermined program and controls the operation of each unit described above. In particular, in the present embodiment, registration of personal information, personal recognition by face recognition, determination of whether or not a recognized individual is imaged in a predetermined state, and a specific individual is imaged in a predetermined state in a shooting frame When there is not, guidance by voice output is performed. In the following, according to the present invention, registration of personal information as described above, personal recognition by face recognition, determination of whether or not a recognized individual is imaged in a predetermined state, and a specific individual is imaged in a predetermined state within a shooting frame Guidance by voice output when not performed will be described in detail.

  FIG. 2 is a conceptual diagram showing an example of personal information registered in the digital camera according to the present embodiment. In the present embodiment, the user registers a target person who performs voice guidance during shooting. As shown in FIG. 2, registered contents include name nickname, age, favorite character, favorite music, language, country, face image, face feature point data, designated ON / OFF flag, and the like. First, the name nickname is a name used when calling a person who is a target for guidance during voice guidance. The age is the age of the person, and is referred to in order to select a title to be given to the name at the time of voice guidance or a sentence at the end of the sentence (~. ~. ~~ .. etc.).

  Like the age, favorite characters and music are referred to in order to select a voice color (popular idol, entertainer, anime character, etc.) at the time of voice guidance. The music is referred to in order to select music that is output together with the voice guidance during voice guidance. The language and the country are referred to select a language (Japanese, English, Chinese, etc.) at the time of creating the guide sentence. The face image is the face image of the person taken at the time of registration, or used for extraction of face feature point data that characterizes the face (which enables individual identification) and is specified at the time of voice guidance setting. Used as a thumbnail when specifying a person. The face feature point data is extracted and registered when the face image is registered, and is used for specifying a person at the time of photographing. The designated ON / OFF flag is a flag for setting whether to specify as a person to be imaged.

  FIGS. 3A and 3B are schematic diagrams illustrating examples of screens when personal information is set or setting contents are changed in the digital camera according to the present embodiment. When the user performs a predetermined operation to set personal information, a setting screen as shown in FIG. 3A is displayed. On the setting screen, the user sets a face image, name nickname, age, favorite character, favorite music, and the like. Further, when the cursor is moved to a person whose setting content is to be changed on the setting screen, personal information set for the person is displayed as shown in FIG. 3B, and correction is possible. In the setting screen, a designation ON / OFF flag for designating a person to be guided can also be set, and a person whose designation ON / OFF flag is ON is designated as a person to be photographed. In the example shown in FIGS. 3A and 3B, four persons “Dad”, “Mama”, “Ken”, and “Yu” are designated as persons to be photographed.

B. Operation of Embodiment Next, the operation of the above-described embodiment will be described.

  FIG. 4 is a flowchart for explaining the operation (photographing by voice guidance) of the digital camera according to the present embodiment. First, the user designates a person to be photographed on the setting screen shown in FIGS. Next, the user grasps the digital camera and looks at the through image displayed on the display device, and determines the composition including the background so that the subject (single or plural) fits within the shooting frame.

  In the digital camera, first, a face position of a person is detected from an image within a shooting frame of the image sensor, thereby maintaining a shooting start waiting state (through image display) while following the person who is the subject (step S10). . In this state, it is determined whether or not the cancel key has been operated (step S12). If the cancel key has been operated, the process ends.

  On the other hand, when the cancel key is not operated, the feature point of the person's face is analyzed from the image in the photographing frame photographed by the image sensor (step S14), and designated as the photographing target, that is, designated ON / OFF. Faces corresponding to the number of persons whose OFF flag is set to ON are analyzed (step S16), and it is determined whether or not all the members whose specified ON / OFF flag is set to ON are within the shooting frame (step S16). S18). At this time, if everyone is not within the shooting frame, the person outside the shooting frame (a person who is designated as a shooting target but not within the shooting frame) A guidance sentence is created according to the information (step S20).

  In the present embodiment, basic sentences as guidance sentences are stored, for example, in phrase units, and a guidance sentence that can identify a person is created by combining them with personal information in various ways. Details of the creation of the guidance text will be described later. Next, the created guidance sentence is synthesized by voice and output from the speaker of the voice input / output device 5 (step S22). Then, it returns to step S10 and repeats the process mentioned above.

  Then, when all the members are within the shooting frame, the user is instructed to automatically shoot or be able to shoot (by voice or text), and when the shutter button is pressed according to the guidance. The image is taken or automatically taken several seconds after the guidance (step S24). The captured image is stored in the external storage device 6 as image data in a predetermined format (JPEG or the like).

  FIG. 5 is a flowchart for explaining the operation (guide text creation) of the digital camera according to the present embodiment. First, the language of the guidance sentence is set in accordance with the language of the personal information of the person (a person who is designated as a subject of photography but is not within the photographing frame) (step S60). In other words, if “Japanese” is set for the language, set it to “Japanese” to create the guide text in Japanese, and if “English” is set for the language, create the guide text in English Set to "English" as much as possible.

  Next, the name nickname of the personal information of the person is set as the name of the guidance text (step S62). That is, for example, if the name nickname of the person is “Daddy”, the sentence of the guidance sentence to be called to the person is “Dad”, and if the name nickname of the person is “Yu”, the sentence head of the guidance sentence is “Yu”. Next, an instruction is selected according to the shooting state of the person (step S64). The shooting state is a case where it is not within the shooting frame.

  If the shooting state does not fit in the shooting frame, you can use “more” + “move right” or “move more” + “move left” as a directive based on the direction and amount of deviation of the person. If the shooting state is not a smile, “laughing” or the like is selected as an instruction.

  Next, according to the age of the person concerned, a title and a sentence end word are selected (step S66). That is, “Chan” is selected when the corresponding person is young and a child, and “San” is selected when the corresponding person is older and an adult. Furthermore, “Please”, “Ne”, etc. are selected as the end of the guidance sentence according to the age.

  Finally, the words set and selected in each step described above are combined to create a final guide sentence (step S68). For example, if the father is not in the shooting frame, the name nickname is “Daddy”, the age is “38”, and the language is “Japanese”, so “Dad” + “San” + “Enter the shooting frame” ”+“ Please ”, and finally“ Daddy, please enter the shooting frame ”. Also, if the child's Yu is slightly off, the name nickname is “Yu”, the age is “5”, and the language is “Japanese”, so “Yu” + “Chan” + “A little more” + “ “Move to the right” + “Ne”, and finally “Yu-chan, move right a little more”. Thereafter, the process returns to the main routine of FIG. 4 or FIG.

  Here, FIG. 6 is a schematic diagram showing a photographing situation with the digital camera according to the present embodiment. FIG. 5 shows a situation in which a commemorative photo is taken with four family members (designated persons) against a landscape. A thick frame is the photographing frame 101, which is an image captured within the effective range of the image sensor. The small frames are the face detection frames 102, 102,. A tracking frame 103 including the face detection frame is set around the face detection frame 102. The user holds the camera so that the desired scenery falls within the shooting frame. In this state, the person stands in front of the camera, but naturally not all the designated persons enter the photographing frame 101. In the illustrated example, the person (child) on the right side of the front row is out of the shooting frame 101.

  In this embodiment, since a plurality of persons to be photographed are designated and registered in advance, for example, among the four persons designated as the objects to be photographed, three persons are within the photographing frame, so that an individual is specified. However, even when one person is outside the shooting frame and cannot identify an individual, it is possible to specify who is outside the shooting frame.

  In the present embodiment, the entire effective range of the image sensor is defined as the imaging frame 101. However, the entire image 100 actually captured by the image sensor is defined as the entire effective range of the image sensor, and a part of the region is included therein. You may make it set as the imaging | photography frame 101 used as the object of recording.

  In this case, a recognition process for a person not included in the shooting frame 101 may be performed using an effective imaging area outside the shooting frame 101. In this way, it is possible to provide guidance specifying a person who is not included in the shooting frame 101 without having previously designated and registered a plurality of persons to be shot.

  In this case, the position and size of the shooting frame 101 to be recorded may be changed manually or automatically within the entire effective range of the image sensor.

  In the example shown in FIG. 5, since the person (child) on the right side of the front row is out of the shooting frame 101, the individual cannot be directly identified from the face recognition, but in this case, as described above, it is designated as the shooting target. Since the other three of the four persons are identified, the person who is out of the shooting frame 101 has the name nickname “Yu”, the age “5”, and the language “Japanese”. It turns out that it is. Also, since the positional relationship between the tracking frame 103 and the shooting frame 101 shows that it is shifted to the left side, for example, a guidance sentence such as “Yu-chan, move a little more to the right” is created, and if necessary The voice of the favorite character is synthesized with the voice of the favorite character and output from the speaker.

  Also, as shown in FIG. 6, there is a person (Ken) in the shooting frame 101 on the right side of the person (Yu) who is out of the shooting frame 101. Or the like may be created. Also, if you are completely out of the shooting frame, for example, “Yu, you are not in the shooting frame” or “Yu, you are not in the shooting frame” It is created, and the guidance text is synthesized by speech and output.

  According to the above-described embodiment, a person who is out of the shooting frame among the persons specified as shooting targets is identified, and the person who is out of the shooting frame is identified according to the personal information of the person. Create a guidance sentence that can recognize the voice, and voice-synchronize it with the voice of the character or idol according to the person's age or favorite character, etc. By outputting, it is possible to clarify who the guidance is, and it is possible to reliably guide to an appropriate shooting state. In particular, when a person who is out of the shooting frame is young, the favorite character, idol's voice, or music can be output together to draw the attention of the person in question and provide guidance. It becomes possible.

  In the above-described embodiment, a smile recognition function (a well-known technique) that detects a smile of a person is further provided. Such a guidance sentence may be output by speech synthesis.

  Also, by providing a blink recognition function (a well-known technology) that recognizes that a person has closed his eyes, when the person to be photographed detects his closed eyes, he says, "Do not blink." Such a guidance sentence may be output by speech synthesis.

  In addition, a state in which only one person is separated from a plurality of persons designated as shooting targets may be detected and guided to be close to other persons.

It is a block diagram which shows the structure of the digital camera by embodiment of this invention. It is a conceptual diagram which shows an example of the personal information registered in the digital camera by this embodiment. It is a schematic diagram which shows an example of the screen at the time of setting personal information with the digital camera by this embodiment, or changing a setting content. It is a flowchart for demonstrating operation | movement (photographing by voice guidance) of the digital camera by this embodiment. It is a flowchart for demonstrating operation | movement (guide sentence preparation) of the digital camera by this embodiment. It is a schematic diagram which shows the imaging | photography condition with a digital camera by this embodiment.

Explanation of symbols

1 Input Device 2 Internal Storage Device 3 Camera Device 4 Display Device 5 Audio Input / Output Device 6 External Storage Device 7 Strobe Light Emitting Device

Claims (18)

Imaging means for imaging a subject;
Personal information storage means for previously storing the face recognition data characterizing the face portion of the person and the personal information of the person in association with each other;
Face recognition means for recognizing a face portion of a person from an image obtained by imaging by the imaging means;
Person identifying means for identifying a person corresponding to the face portion recognized by the face recognizing means based on face recognition data stored in the personal information storage means;
Among the persons specified by the person specifying means, state specifying means for specifying a person who has not been imaged in a predetermined state;
And personal information reading means for reading the personal information of a person that is not captured by the predetermined state has been identified, from the personal information storage unit by said state specifying means,
And personal information read by the personal information reading means is recognized by the face recognition unit, based on a state of a person that has not been captured at the predetermined condition specified by the condition specifying means, the predetermined a guidance information person that it is not captured by the state identified is instructed to be imaged at the predetermined state, a person that is not captured by the predetermined state, identified by the personal information of the person Guide information creating means for creating possible guide information;
An imaging apparatus comprising: guide information output means for outputting the guide information created by the guide information creating means.   The guidance information creating unit instructs the person to be imaged in the predetermined state based on the personal information read by the personal information reading unit and the state of the person specified by the state specifying unit. The photographing apparatus according to claim 1, wherein a guide sentence capable of specifying the person is created.   3. The photographing apparatus according to claim 2, wherein the guidance information output unit synthesizes and outputs a guidance voice based on the guidance sentence created by the guidance information creation unit. The state specifying means determines whether or not an image is captured in the predetermined state by a plurality of items,
The guidance information creating means creates guidance information for instructing the person to be imaged in the predetermined state and capable of specifying an item that has not been imaged in the predetermined state. The photographing apparatus according to any one of claims 1 to 3.   The state specifying means determines whether or not the person is within a predetermined imaging area imaged by the imaging means, as a plurality of items for determining whether or not the imaging is performed in the predetermined state, The imaging apparatus according to claim 4, comprising at least one determination item among a determination item for whether or not laughing and a determination item for whether or not eyes are closed.   The guidance information creating means includes at least one guidance information among guidance information that prompts the person to enter the shooting area, guidance information that prompts the person to laugh, and guidance information that prompts the person not to blink. 6. The photographing apparatus according to claim 5, wherein the photographing apparatus is created. The state specifying unit specifies in which direction the person is deviating from a predetermined imaging region imaged by the imaging unit,
The photographing apparatus according to claim 1, wherein the guide information creating unit creates guide information indicating a direction to move in order to enter the predetermined photographing region. The personal information includes a name of a person,
The photographing apparatus according to claim 2, wherein the guide information creating unit creates the guide sentence including the name of the person.   The photographing apparatus according to claim 2 or 3, wherein the guide information creating means creates a guide sentence in a form suitable for the person based on the personal information read by the personal information reading means. . The personal information includes the age of the person,
The photographing apparatus according to claim 9, wherein the guide information creating unit creates the guide sentence according to the age of the person.   The guidance information output means synthesizes and outputs a guidance voice in a form suitable for the person based on the personal information read by the personal information reading means and the guidance text created by the guidance information creation means. The photographing apparatus according to claim 3. The personal information includes music preferred by a person,
The photographing apparatus according to claim 11, wherein the guidance information output unit synthesizes and outputs the guidance voice including the music. The personal information includes a character preferred by a person or a voice of a celebrity,
The photographing apparatus according to claim 11, wherein the guidance information output unit synthesizes and outputs the guidance voice with the voice color. The personal information includes a language used by a person,
The photographing apparatus according to claim 11, wherein the guide information output unit creates the guide sentence in the language. It further comprises basic guide sentence storage means for storing a plurality of basic guide sentences,
The guidance information creating means
Basic guidance sentence selecting means for selecting at least one or more basic guidance sentences according to the personal information specified by the personal information specifying means from a plurality of guidance sentences stored in the basic guidance sentence storage means; ,
A guidance sentence synthesizing unit that creates the guidance sentence by synthesizing at least one basic guidance sentence selected by the basic guidance sentence selecting unit and the personal information read by the personal information reading unit; The photographing apparatus according to claim 1, wherein Further comprising designation means for designating at least one person to be identified by the person identification means;
The personal information storage means stores a designation flag indicating whether or not designation is made by the designation means in association with personal information of a person;
The person specifying means stores at least one person with the designation flag being effectively set from the persons corresponding to the face portion recognized by the face recognition means in the personal information storage means. Based on the face recognition data
The photographing apparatus according to claim 1, wherein Imaging a subject;
Storing in advance in the personal information storage means the face recognition data characterizing the face portion of the person and the personal information of the person in association with each other;
Recognizing a human face portion from the captured image;
Identifying a person corresponding to the recognized face portion based on the stored face recognition data;
Identifying a person who has not been imaged in a predetermined state among the identified persons;
Reading the personal information of the person identified as not being imaged in the predetermined state from the personal information storage means;
The predetermined state based on the personal information read from the personal information storage unit by the recognition of the face part and the state of the person identified by the state specifying unit as not being imaged in the predetermined state in a guidance information instructing the person identified that is not captured is captured at the predetermined state, a person that is not captured by the predetermined state, which can be identified by the personal information of the corresponding person Creating guidance information;
And a step of outputting the created guidance information. A program for controlling the operation of an imaging device including an imaging unit for imaging a subject,
On the computer,
An imaging function for imaging a subject by the imaging unit;
A personal information storage function for preliminarily storing the face recognition data characterizing the face portion of the person and the personal information of the person in association with each other;
A face recognition function for recognizing a human face from an image obtained by imaging by the imaging unit;
A person specifying function for specifying a person corresponding to the face portion recognized by the face recognition function based on the face recognition data stored by the personal information storage function;
A state specifying function for specifying a person who has not been captured in a predetermined state among the persons specified by the person specifying function;
A personal information reading function for reading out personal information of a person who is identified as not being imaged in the predetermined state by the state specifying function from the personal information storage function;
And personal information read by the personal information reading function is recognized by the face recognition function, based on the state of the person identified that are not captured by the predetermined state by said state specific function, the predetermined a guidance information person that it is not captured by the state identified is instructed to be imaged at the predetermined state, a person that is not captured by the predetermined state, identified by the personal information of the person Guide information creation function to create possible guide information,
Guidance information output function for outputting the guidance information created by the guidance information creation function;
A program characterized by realizing.

Images