JP2010278624A - Photographing device, photographing method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To photograph a subject when the subject is located in a more suitable position. <P>SOLUTION: A photographing part 31 photographs an image. A face detecting part 53 detects a subject in the image photographed by the photographing part 31. When the position of the subject detected by the face detecting part 53 is located in a prescribed position in the image, a recording control part 57 controls the record of the image. When the position of the subject detected by the face detecting part 53 is not located in the prescribed position in the image, a display control part 58 or a sound output control part 59 presents an instruction for moving the position of the subject so as to be located in the prescribed position. The photographing device, the photographing method, and the program are applicable, for example, to electronic equipment having a photographing function. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an imaging device, method, and program, and more particularly, to an imaging device, method, and program that enable imaging when a subject is in a more optimal position.

  2. Description of the Related Art Conventionally, various techniques have been proposed for correcting an image shot by a shooting device such as a digital camera so that the subject is in an optimal position after shooting.

  For example, there is an image editing apparatus that reads captured original image data from a built-in memory, detects a subject of the original image, and performs trimming so that the subject is arranged at four intersections in a three-division method (see Patent Document 1). .

JP 2007-295203 A

  However, in the above-described configuration, the photographer does not shoot with the subject in the optimum position at the time of shooting.

  The present invention has been made in view of such a situation. In particular, the present invention is intended to capture an image when the subject is at a more optimal position.

  An imaging apparatus according to an aspect of the present invention includes an imaging unit that captures an image, a subject detection unit that detects a subject in the image captured by the imaging unit, and a position of the subject detected by the subject detection unit. However, when the position of the subject detected by the subject detection means is not at the predetermined position in the image, the recording control means for controlling the recording of the image when the image is at the predetermined position. Presenting means for presenting an instruction to move so that the position becomes the predetermined position.

  When the subject detection unit detects the face of a person as the subject, and the recording control unit has the position of the face detected by the subject detection unit at the predetermined position in the image, The recording of the image is controlled, and when the face position detected by the subject detection means is not at the predetermined position in the image, the presentation means moves so that the face position becomes the predetermined position. Instructions can be presented.

  The recording control means controls the recording of the image when the positions of the plurality of faces detected by the subject detection means are at the plurality of predetermined positions corresponding to the number of faces, and the presentation means If the positions of the plurality of faces detected by the subject detection means are not at the plurality of predetermined positions according to the number of faces, the positions of the plurality of faces are the respective predetermined positions. An instruction to move can be presented.

  The plurality of predetermined positions may be determined by a template corresponding to the number of faces.

  The photographing apparatus is further provided with age detection means for detecting the age of the subject based on the face detected by the subject detection means, and the recording control means includes the age detection means detected by the age detection means. When the age of the subject is in a predetermined age range and the position of the face is in the predetermined location, the recording of the image is controlled, and the presenting means detects the subject detected by the age detecting means If the age is within a predetermined age range and the face position is not in the predetermined position, an instruction to move the face position to the predetermined position can be presented.

  The photographing apparatus further includes gender detection means for detecting gender of the subject corresponding to the plurality of faces based on the plurality of faces detected by the subject detection means, and the recording control means includes Among the faces of the subject whose sex is detected by the sex detection means, when the positions of the faces of the opposite sex subjects are closer than a predetermined distance, the recording of the image is controlled, and the presentation means Among the faces of the subject whose gender has been detected by the detecting means, when the positions of the faces of the opposite subject are farther than a predetermined distance, the positions of the faces of the opposite subject are closer to the predetermined distance An instruction to move can be presented.

  The photographing apparatus further includes facial expression detection means for detecting the facial expression based on the face detected by the subject detection means, and the recording control means includes the facial expression detection means detected by the subject detection means. When the face position is at the predetermined position in the image and the facial expression detected by the facial expression detection means is a smile, the recording of the image can be controlled.

  When the face position detected by the subject detection means is not in the predetermined position in the image, the presenting means is instructed to move the face position to the predetermined position. Can be presented.

  When the face position detected by the subject detection means is not at the predetermined position in the image, the presenting means is instructed to move the face position to the predetermined position to the photographer. Can be presented.

  The presenting means controls display of an instruction to move the face position to the predetermined position when the face position detected by the subject detecting means is not at the predetermined position in the image. be able to.

  Causing the presenting means to control the output by voice of an instruction to move the face position to the predetermined position when the position of the face detected by the subject detecting means is not in the predetermined position in the image; Can do.

  An imaging method according to one aspect of the present invention is detected by a shooting step of shooting an image, a subject detection step of detecting a subject in the image shot by the processing of the shooting step, and a processing of the subject detection step. When the position of the subject is at a predetermined position in the image, the position of the subject detected by the processing of the recording control step for controlling recording of the image and the processing of the subject detection step is at the predetermined position in the image. If not, a presenting step of presenting an instruction to move the subject to the predetermined position is included.

  A program according to an aspect of the present invention includes a shooting control step for controlling shooting of an image, a subject detection step for detecting a subject in the image shot by the processing of the shooting control step, and a processing of the subject detection step. When the detected position of the subject is at a predetermined position in the image, the recording control step for controlling the recording of the image, and the position of the subject detected by the processing of the subject detection step in the image If it is not at the predetermined position, the computer is caused to execute processing including a presentation control step for controlling the presentation of an instruction to move the subject to the predetermined position.

  In one aspect of the present invention, an image is photographed, a subject is detected in the photographed image, and when the detected subject position is at a predetermined position in the image, recording of the image is controlled and detected. When the position of the subject is not in the predetermined position in the image, an instruction to move so that the position of the subject becomes the predetermined position is presented.

  According to one aspect of the present invention, it is possible to capture an image when the subject is at a more optimal position.

It is a block diagram which shows the structural example of one Embodiment of the imaging device to which this invention is applied. It is a flowchart explaining the imaging | photography process by an imaging device. It is a figure explaining the image | photographed subject's image. It is a figure explaining a template. It is a figure explaining a template. It is a figure explaining a template. It is a figure explaining the image | photographed subject image and a template. It is a figure explaining the image | photographed subject image and a template. It is a figure explaining the image | photographed subject image and a template. It is a flowchart explaining the other imaging | photography process by an imaging device. It is a figure explaining the image | photographed subject image and a template. It is a figure explaining the image | photographed subject image and a template. It is a figure explaining the image | photographed subject image and a template. It is a flowchart explaining the other imaging | photography process by an imaging device. It is a figure explaining the position of the subject in the image of the photographed subject. It is a figure explaining the position of the subject in the image of the photographed subject. It is a figure explaining the position of the subject in the image of the photographed subject. It is a flowchart explaining the other imaging | photography process by an imaging device. It is a figure explaining the image | photographed subject image and a template. It is a figure explaining the image | photographed subject image and a template. It is a figure explaining the image | photographed subject image and a template. It is a figure explaining the image | photographed subject image and a template.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[Configuration example of the shooting device]
FIG. 1 shows a configuration example of an embodiment of a photographing apparatus to which the present invention is applied. The imaging device 11 in FIG. 1 is an electronic device having an imaging function, such as a digital camera or a mobile phone.

  The imaging apparatus 11 of FIG. 1 includes an imaging unit 31, an input unit 32, a recording unit 33, a display unit 34, an audio output unit 35, a control unit 36, a drive 37, and a removable medium 38.

  The imaging unit 31 includes a photoelectric conversion element that converts an optical image such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal-Oxide Semiconductor) sensor into an electrical signal, and an optical image of a subject on the photoelectric conversion element. It consists of an optical system that forms an image. The imaging unit 31 converts the image of the subject into an image signal that is an electrical signal based on the control of the control unit 36, that is, images the subject and supplies the obtained image signal to the control unit 36.

  The input unit 32 is operated by the user in order to input an instruction to the photographing apparatus 11. The input unit 32 includes, for example, various operation buttons, a keyboard, a mouse, a remote controller, a touch panel, a microphone, and the like, receives an operation from the user, and supplies a signal (information) indicating the operation content to the control unit 36.

  The recording unit 33 includes a hard disk drive, an optical disk such as a DVD (Digital Versatile Disk) driven by a predetermined drive, and a drive thereof, or a semiconductor memory such as a memory card. The recording unit 33 records, for example, an image of the subject photographed by the photographing unit 31.

  The display unit 34 includes a display device such as an LCD (Liquid Crystal Display) or an organic EL (Electro Luminescence), and displays various images based on the control of the control unit 36.

  The audio output unit 35 includes a so-called speaker, and outputs various types of audio based on the control of the control unit 36.

  The control unit 36 includes, for example, a microprocessor and controls the entire photographing apparatus 11. For example, the control unit 36 performs a predetermined process on the image signal from the photographing unit 31 and supplies the obtained image data to the recording unit 33 based on a predetermined condition so as to be recorded.

  The control unit 36 executes the computer program, thereby causing the imaging control unit 51, the image processing unit 52, the face detection unit 53, the attribute detection unit 54, the input control unit 55, the condition determination unit 56, the recording control unit 57, and the display control. The unit 58 and the audio output control unit 59 are realized.

  The shooting control unit 51 controls shooting of a subject by the shooting unit 31 based on a signal (information) from the input control unit 55. The imaging control unit 51 generates image data from the image signal supplied from the imaging unit 31 and supplies the generated image data to the image processing unit 52.

  The image processing unit 52 appropriately performs predetermined processing on image data (hereinafter also simply referred to as an image) from the imaging control unit 51, and if necessary, a face detection unit 53, a recording control unit 57, and This is supplied to the display control unit 58.

  The face detection unit 53 detects a face from the image supplied from the image processing unit 52, extracts a face image based on the position and size of the face detection region that is a region for detecting the face, Along with information representing the position, the information is supplied to the attribute detection unit 54. Further, the face detection unit 53 supplies information representing the position of the face detection area to the condition determination unit 56.

  The attribute detection unit 54 detects subject attributes (expression, age, sex) from the face image from the face detection unit 53 and supplies information about the subject attributes to the condition determination unit 56. The attribute detection unit 54 includes a facial expression detection unit 54a, an age detection unit 54b, and a gender detection unit 54c. The facial expression detection unit 54 a detects the facial expression of the subject from the face image from the face detection unit 53. The age detection unit 54 b detects the age of the subject from the face image from the face detection unit 53. The sex detector 54 c detects the sex of the subject from the face image from the face detector 53.

  The face detection by the face detection unit and the attribute detection by the attribute detection unit 54 are performed by, for example, learning face images and their attributes in advance for various face images, and storing the obtained learning data in the recording unit This is realized by recording the data in the recording control unit 57 and recording it in the recording control unit 57.

  The input control unit 55 controls the input unit 32, acquires a signal indicating the user operation from the input unit 32 according to the user operation, and supplies the signal to the imaging control unit 51 and the condition determination unit 56.

  In accordance with a signal from the input control unit 55, the condition determination unit 56 is based on information indicating the position of the face detection area from the face detection unit 53 and information on the face attribute of the subject from the attribute detection unit 54. Then, it is determined whether or not the position of the face detection region and the face attribute of the subject satisfy a predetermined condition. The condition determination unit 56 instructs the recording control unit 57 to record an image, instructs the display control unit 58 to display to satisfy a predetermined condition, or outputs sound according to the determination result. The control unit 59 is instructed to output sound for satisfying a predetermined condition.

  The recording control unit 57 causes the recording unit 33 to record the image from the image processing unit 52 based on an instruction from the condition determination unit 56.

  In addition to displaying the image from the image processing unit 52 on the display unit 34, the display control unit 58 causes the display unit 34 to perform display for satisfying a predetermined condition based on an instruction from the condition determination unit 56.

  The sound output control unit 59 causes the sound output unit 35 to output sound for satisfying a predetermined condition based on an instruction from the condition determination unit 56.

  A removable medium 38 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory is appropriately attached to the drive 37. The drive 37 is controlled by the control unit 36 to install or store the computer program and data read from the mounted removable medium 38 in the recording unit 33 as necessary.

[Shooting process of the shooting device]
Next, imaging processing by the imaging device 11 will be described with reference to the flowchart of FIG.

  For example, when the input unit 32 is operated and the input control unit 55 acquires an instruction to select a group photo shooting mode among the shooting modes and supplies the instruction to the condition determination unit 56, the photographing apparatus 11 starts processing.

  In step S11, the photographing unit 31 converts the image of the subject into an image signal that is an electric signal based on the control of the photographing control unit 51, that is, the subject is photographed, and the obtained image signal is converted into the photographing control unit. 51. The imaging control unit 51 generates image data from the image signal from the imaging unit 31 and supplies the image data to the image processing unit 52. The image processing unit 52 supplies the image data from the imaging control unit 51 to the face detection unit 53 and the display control unit 58. At this time, the display control unit 58 causes the display unit 34 to display an image of the subject being photographed (so-called through image) based on the image data from the image processing unit 52.

  In step S 12, the face detection unit 53 detects a face in the subject image from the image processing unit 52, extracts a face image based on the position and size of the face detection area, and supplies the face image to the attribute detection unit 54. To do. Further, the face detection unit 53 supplies information representing the position of the face detection region to the attribute detection unit 54 and the condition determination unit 56.

  For example, when the image from the image processing unit 52 is an image in which subjects A1 to A3, which are persons, are photographed as shown in FIG. 3, the face detection unit 53 has three subjects A1 to A3, respectively. Are detected, and each face image is supplied to the attribute detection unit 54. In addition, the face detection unit 53 supplies information representing the position of the face detection area for each of the three faces of the subjects A1 to A3 to the attribute detection unit 54 and the condition determination unit 56.

  In step S <b> 13, the condition determination unit 56 obtains the number of detected faces based on the information indicating the position of the face detection area from the face detection unit 53, and uses the recording control unit 57 for a template corresponding to the number. Via the recording unit 33.

  The template read by the condition determination unit 56 is data for determining a position (hereinafter referred to as a designated position) where the arrangement of the subject's face is optimal in the group photo according to the number of subjects. For example, as illustrated in FIG. 3, when there are three subjects, the condition determination unit 56 reads a template as illustrated in FIG. 4 from the recording unit 33. In the template of FIG. 4, designated positions P1 to P3 of the subjects A1 to A3 are determined for the group photo of three subjects. By supplying the template read by the condition determination unit 56 to the display control unit 58, the display unit 34 displays a template as shown in FIG.

  For example, when there are five subjects, the condition determination unit 56 reads a template as illustrated in FIG. 5 from the recording unit 33. In FIG. 5, designated positions P1 to P5 are determined for a group photo of five subjects. For example, when there are 11 subjects, the condition determination unit 56 reads a template as shown in FIG. 6 from the recording unit 33. In FIG. 6, designated positions P1 to P11 are determined for a group photo of 11 subjects.

  Returning to the flowchart of FIG. 2, in step S14, the condition determination unit 56 compares the position of the face of the subject in the captured image with the designated position in the template. More specifically, the condition determination unit 56 obtains the coordinates of the center of the face detection area from the information representing the position of the face detection area from the face detection unit 53, and calculates the distance from the coordinates of the center of the designated position in the template. calculate.

  In step S15, the condition determination unit 56 determines whether or not the position of the face of the subject in the captured image is at a specified position in the template. More specifically, the condition determination unit 56 determines whether the distance between the coordinates of the center of the face detection area calculated in step S14 and the coordinates of the center of the designated position in the template is shorter than a predetermined distance. .

  If it is determined in step S15 that the face position of the subject is at the specified position, that is, if the distance between the coordinates of the center of the face detection area and the coordinates of the center of the specified position is closer than a predetermined distance, Proceed to step S16. That is, for example, as shown in FIG. 7, the face position of the subject A1 is at the designated position P1, the face position of the subject A2 is at the designated position P2, and the face position of the subject A3 is at the designated position P3. If so, the process proceeds to step S16.

  In step S16, the condition determination unit 56 determines whether the facial expression of the subject is a smile. More specifically, the expression detection unit 54a of the attribute detection unit 54 detects the facial expression of the subject based on the face image supplied from the face detection unit 53 in step S12, and represents the facial expression of the subject. Information is supplied to the condition determination unit 56 together with the position representing the face detection area. The condition determining unit 56 determines whether or not the facial expression of the subject at the corresponding position is a smile based on the information representing the facial expression of the subject from the facial expression detection unit 54a.

  If it is determined in step S16 that the facial expression of the subject is not a smile, the process returns to step S15, and the processes of steps S15 and S16 are repeated until the facial expression of the subject becomes a smile.

  On the other hand, if it is determined in step S16 that the facial expression of the subject is a smile, the condition determination unit 56 supplies a recording instruction to the recording control unit 57, and the process proceeds to step S17.

  In step S <b> 17, the recording control unit 57 causes the recording unit 33 to record the image from the image processing unit 52 based on an instruction from the condition determination unit 56. That is, when the face of the subject is at the designated position and the face of the subject is smiling, the subject image is recorded in the same manner as when a so-called shutter button is pressed.

  By the way, if it is determined in step S15 that the face position of the subject is not at the specified position, that is, if the distance between the center coordinates of the face detection area and the center coordinates of the specified position is greater than a predetermined distance, Advances to step S18. That is, for example, as shown in FIG. 8, the face position of the subject A1 is shifted to the left of the specified position P1, the face position of the subject A2 is shifted to the left of the specified position P2, and the face of the subject A3 Is shifted to the right side of the designated position P3, the process proceeds to step S18.

  In step S18, the display control unit 58 presents to the subject an instruction to move so that the face position of each subject becomes the designated position. More specifically, the condition determination unit 56 causes the display control unit 58 to set the position of the subject's face to the designated position (the distance between the coordinates of the center of the face detection region and the coordinates of the center of the designated position). The display is instructed to be close to a predetermined distance. Based on the instruction from the condition determination unit 56, the display control unit 58 causes the display unit 34 to display so that the position of the subject's face becomes the specified position. For example, as described with reference to FIG. 8, when the position of the subject's face is not at the designated position, the display control unit 58 displays the subject A1 on the right side in the drawing and the subject A2 as shown in FIG. Is displayed on the right side in the figure and the subject A3 is displayed on the left side in the figure so as to move, thereby presenting an instruction to move the subject through the photographer.

  In addition, the instruction to move to the subject may be a direct instruction to the subject by sound, not via the photographer by display. Specifically, the condition determination unit 56 instructs the audio output control unit 59 to output audio so that the face position of the subject becomes the designated position. The sound output control unit 59 causes the sound output unit 35 to output sound for causing the face position of the subject to be the designated position based on an instruction from the condition determination unit 56. For example, as described in FIG. 8, when the face position of the subject is not in the designated position, the audio output control unit 59 will say “Look at the person on the left side and approach the left hand a little to the subject A1. “For the subject A2,“ middle person, please come to the left hand a little more ”, and for the subject A3, say“ the person on the right side, please go a little more to the right hand, ”and so on. By outputting, an instruction to move the subject is presented.

  After step S18, the process returns to step S15, and the processes of steps S15 and S18 are repeated until it is determined that the face position of the subject is at the designated position.

  According to the above processing, when taking a group photo, a template corresponding to the number of subjects is read out, and an image is recorded when the face position of each subject is at the designated position of the template. It is possible to take a picture when the subject is at a more optimal position.

  In the above description, the processing for photographing when the subject's face is located at the designated position corresponding to the number of the subject's faces has been described. However, it is also possible to photograph when the subject's age, for example, the subject is a baby. it can.

[Other shooting processes for shooting device]
Next, with reference to the flowchart of FIG. 10, the imaging process of the imaging device 11 in the baby imaging mode when imaging a baby will be described.

  For example, when the input unit 32 is operated and the input control unit 55 acquires an instruction to select a baby shooting mode among the shooting modes and supplies the instruction to the condition determination unit 56, the imaging device 11 starts processing.

  In the flowchart of FIG. 10, the processes of steps S31 and S32 are the same as the processes of steps S11 and S12 of the flowchart of FIG.

  In step S <b> 33, the age detection unit 54 b of the attribute detection unit 54 detects the age of the subject from the face image from the face detection unit 53 and supplies information representing the age of the subject to the condition determination unit 56.

  In step S34, the condition determination unit 56 determines whether or not the baby's face exists based on the information representing the age of the subject from the age detection unit 54b. More specifically, the condition determination unit 56 includes a subject whose age is included in a predetermined age range (for example, 0 to 3 years old) based on the information indicating the age of the subject from the age detection unit 54b. It is determined whether or not to do.

  If it is determined in step S34 that a baby face is present, the process proceeds to step S35, and the condition determination unit 56 sends a template corresponding to the baby shooting mode from the recording unit 33 via the recording control unit 57. read out. The template read out here is data for arranging the position of the baby's face in the center of the image. In an image of a scene in which a baby is photographed, the baby is often reflected in the center, and in the template used in the baby photographing mode, the designated position is determined at the center of the image.

  In step S36, the condition determination unit 56 compares the position of the face of the subject (baby) in the photographed image with the designated position in the template. More specifically, the condition determination unit 56 obtains the coordinates of the center of the face detection area from the information representing the position of the face detection area from the face detection unit 53, and calculates the distance from the coordinates of the center of the designated position in the template. calculate.

  In step S37, the condition determination unit 56 determines whether or not the position of the face of the subject (baby) in the photographed image is at a specified position in the template. More specifically, the condition determination unit 56 determines whether the distance between the coordinates of the center of the face detection area calculated in step S36 and the coordinates of the center of the designated position in the template is shorter than a predetermined distance. .

  If it is determined in step S37 that the face position of the subject is at the designated position, that is, if the distance between the coordinates of the center of the face detection area and the coordinates of the center of the designated position is closer than a predetermined distance, the processing is as follows: Proceed to step S38. That is, for example, as illustrated in FIG. 11, in an image in which a scene in which the subject A4 is held by the subject M is captured and the subject A4 is determined to be a baby, If the face position is at the designated position P4, the process proceeds to step S38.

  In step S38, the condition determination unit 56 determines whether the facial expression of the subject is a smile. More specifically, the expression detection unit 54a of the attribute detection unit 54 detects the facial expression of the subject based on the face image supplied from the face detection unit 53 in step S32, and represents the facial expression of the subject. The information is supplied to the condition determination unit 56 together with information indicating the position of the face detection area. The condition determining unit 56 determines whether or not the facial expression of the subject at the corresponding position is a smile based on the information representing the facial expression of the subject from the facial expression detection unit 54a.

  If it is determined in step S38 that the facial expression of the subject is not a smile, the process returns to step S37, and the processes of steps S37 and S38 are repeated until the facial expression of the subject becomes a smile.

  On the other hand, if it is determined in step S38 that the facial expression of the subject is a smile, the condition determination unit 56 supplies a recording instruction to the recording control unit 57, and the process proceeds to step S39.

  In step S 39, the recording control unit 57 causes the recording unit 33 to record the image from the image processing unit 52 based on the instruction from the condition determination unit 56. That is, when the face position of the subject that is a baby is at the designated position and the face of the subject is smiling, the image of the subject is recorded in the same manner as when a so-called shutter button is pressed.

  By the way, if it is determined in step S37 that the position of the subject's face is not at the specified position, that is, if the distance between the coordinates of the center of the face detection area and the coordinates of the center of the specified position is greater than a predetermined distance, processing is performed. Advances to step S40. That is, for example, as shown in FIG. 12, when the position of the face of the subject A4 is shifted to the left side of the designated position P4, the process proceeds to step S40.

  In step S40, the display control unit 58 presents an instruction to the subject to move so that the position of the subject's face becomes the specified position. More specifically, the condition determination unit 56 causes the display control unit 58 to set the position of the subject's face to the designated position (the distance between the coordinates of the center of the face detection region and the coordinates of the center of the designated position). The display is instructed to be close to a predetermined distance. Based on the instruction from the condition determination unit 56, the display control unit 58 causes the display unit 34 to display so that the position of the subject's face becomes the specified position. For example, as described with reference to FIG. 12, when the face position of the subject is not at the designated position, the display control unit 58 causes the subject M holding the subject A4 to be the subject A4 as shown in FIG. Is displayed so as to move to the right side in the figure, and an instruction to move the subject is presented via the photographer.

  In addition, the instruction to move to the subject may be a direct instruction to the subject by sound, not via the photographer by display. Specifically, the condition determination unit 56 instructs the audio output control unit 59 to output audio so that the face position of the subject becomes the designated position. The sound output control unit 59 causes the sound output unit 35 to output sound for causing the face position of the subject to be the designated position based on an instruction from the condition determination unit 56. For example, as described with reference to FIG. 12, when the position of the subject's face is not at the specified position, the audio output control unit 59 instructs the subject M holding the subject A4 to “hold the baby a little more to the left. "Please bring it" to output the voice and present the instruction to move the subject.

  After step S40, the process returns to step S37, and the processes of steps S37 and S40 are repeated until it is determined that the position of the subject's face is at the designated position.

  If it is determined in step S34 that the baby's face does not exist, the condition determination unit 56 instructs the display control unit 58 to instruct the display unit 34 to display, for example, “no baby”. Then, the process ends.

  In the description with reference to FIG. 11 to FIG. 13, it is assumed that there is only one subject that is a baby. However, a plurality of subjects may be used, and imaging is performed using a template that determines a designated position according to the number of babies. You can also do it.

  According to the above processing, when the baby is photographed, the template corresponding to the baby's photographing is read, and the image is recorded when the face position of the subject (baby) is at the designated position of the template. It is possible to take a picture when the subject is at a more optimal position.

  In the above description, the processing for capturing an image when the subject's face is at a specified position determined by the template has been described. However, it is also possible to perform imaging when the subjects are in a predetermined positional relationship.

[Further shooting process of the shooting device]
Next, with reference to the flowchart of FIG. 14, the photographing process of the photographing apparatus 11 in the couple photographing mode when photographing a couple of men and women will be described.

  For example, when the input unit 32 is operated and the input control unit 55 acquires an instruction to select a couple shooting mode among the shooting modes and supplies the instruction to the condition determination unit 56, the imaging device 11 starts processing.

  In the flowchart of FIG. 14, the processing of steps S51 and S52 is the same as the processing of steps S11 and S12 of the flowchart of FIG.

  In step S <b> 53, the gender detection unit 54 c of the attribute detection unit 54 detects the gender of the subject from the face image from the face detection unit 53, and supplies information representing the gender of the subject to the condition determination unit 56.

  In step S54, the condition determination unit 56 determines whether each of the male face and the female face exists based on the information representing the sex of the subject from the sex detection unit 54c.

  If it is determined in step S54 that both a male face and a female face exist, the process proceeds to step S55, and the condition determination unit 56 determines the position of the male face and the position of the female face in the captured image. And compare. More specifically, the condition determination unit 56 obtains the coordinates of the center of each face detection region from the information indicating the position of the face detection region from the face detection unit 53, and determines the center of the face detection region of the male face. The distance between the coordinates and the coordinates of the center of the face detection area of the female face is calculated. For example, in an image in which a total of four men and women are photographed, the distance between the coordinates of the center of the face detection area of the face of one man and the coordinates of the center of the face detection area of the face of each of two women Is calculated. Similarly, the distance between the coordinates of the center of the face detection area of the face of one female and the coordinates of the center of the face detection area of each of the two men is calculated.

  In step S56, the condition determination unit 56 determines whether the positions of the faces of the men and women in the captured image are closer than a predetermined distance. More specifically, for example, when a total of four people are photographed for each two men and women, the condition determination unit 56 calculates more of the distance between the coordinates of the center of the face detection area of each man and woman calculated in step S55. It is determined whether or not the distance between the coordinates of the center of the face detection area between the male and female pairs (couples) that are close to each other is closer than a predetermined distance.

  If it is determined in step S56 that the face positions of the men and women are closer than the predetermined distance, the process proceeds to step S57. That is, for example, as shown in FIG. 15, in an image in which subjects B1 to B4 are captured and it is determined that subjects B1 and B3 are men and subjects B2 and B4 are women, subject B1 The distance between the coordinates of the center of the face detection area Q1 and the coordinates of the center of the face detection area Q2 of the subject B2, and the coordinates of the center of the face detection area Q3 of the subject B3 and the coordinates of the center of the face detection area Q4 of the subject B4 If the distances are closer than the predetermined distance, the process proceeds to step S57.

  In step S57, the condition determination unit 56 determines whether the facial expression of the subject is a smile. More specifically, the expression detection unit 54a of the attribute detection unit 54 detects the facial expression of the subject based on the face image supplied from the face detection unit 53 in step S52, and represents the facial expression of the subject. Information is supplied to the condition determination unit 56. The condition determination unit 56 determines whether or not the facial expression of the subject is a smile based on information representing the facial expression of the subject from the facial expression detection unit 54a.

  If it is determined in step S57 that the facial expression of the subject is not a smile, the process returns to step S56, and the processes of steps S56 and S57 are repeated until the facial expression of the subject becomes a smile.

  On the other hand, if it is determined in step S57 that the facial expression of the subject is a smile, the condition determination unit 56 supplies a recording instruction to the recording control unit 57, and the process proceeds to step S58.

  In step S <b> 58, the recording control unit 57 causes the recording unit 33 to record the image from the image processing unit 52 based on an instruction from the condition determination unit 56. That is, when the faces of the subjects of a couple of men and women are close to each other and the faces of the subjects are smiling, the subject image is the same as when the so-called shutter button is pressed. Is recorded.

  By the way, when it is determined in step S56 that the face positions of the men and women are not closer than the predetermined distance, the process proceeds to step S59. That is, for example, as shown in FIG. 16, although the distance between the center coordinate of the face detection area Q1 of the subject B1 and the center coordinate of the face detection area Q2 of the subject B2 is closer than a predetermined distance, the face of the subject B3 When the distance between the coordinates of the center of the detection area Q3 and the coordinates of the center of the face detection area Q4 of the subject B4 is longer than a predetermined distance, the process proceeds to step S59.

  In step S59, the display control unit 58 presents to the subject an instruction to move so that the positions of the faces of the men and women are closer than a predetermined distance. More specifically, the condition determination unit 56 causes the display control unit 58 to make the positions of the faces of each man and woman closer than a predetermined distance (distance between the coordinates of the center of each face detection area for each man and woman). Is displayed). Based on the instruction from the condition determination unit 56, the display control unit 58 causes the display unit 34 to display so that the positions of the faces of the men and women are closer than a predetermined distance. For example, as described in FIG. 16, when the distance between the coordinates of the center of the face detection area Q3 of the subject B3 and the coordinates of the center of the face detection area Q4 of the subject B4 is not closer than a predetermined distance, the display is performed. As shown in FIG. 17, the control unit 58 displays an arrow for each of the subjects B3 and B4 so as to approach each other, thereby presenting an instruction to move the subject via the photographer.

  In addition, the instruction to move to the subject may be a direct instruction to the subject by sound, not via the photographer by display. Specifically, the condition determination unit 56 instructs the audio output control unit 59 to output audio so that the positions of the faces of both men and women are closer than a predetermined distance. The audio output control unit 59 causes the audio output unit 35 to output audio for making the positions of the faces of each man and woman closer than a predetermined distance based on an instruction from the condition determination unit 56. For example, as described with reference to FIG. 16, when the positions of the faces of both men and women are not closer than a predetermined distance, the audio output control unit 59 sets “ "Couple, please get closer."

  After step S59, the process returns to step S56, and the processes of steps S56 and S59 are repeated until it is determined that the positions of the faces of the men and women are closer than the predetermined distance.

  If it is determined in step S54 that neither the male face nor the female face exists, the condition determining unit 56 instructs the display unit 34 to display, for example, “no couple”. Then, the data is supplied to the display control unit 58, and the process ends.

  In the description with reference to FIGS. 15 to 17, it is assumed that the subject is four men and two men and two couples are photographed. For example, in the case of one man and two women, , A couple of men and women closer to each other may be photographed, and one couple and one woman may be photographed. If there is one man between two women as a positional relationship, two women each You may make it image | photograph by moving to approach one man.

  According to the above processing, when a couple is photographed, an image is recorded when the positions of the faces of men and women are closer than a predetermined distance. Therefore, the image is photographed when the subject is at a more optimal position. It becomes possible.

  In the above description, the processing for presenting an instruction to move the face of the subject to the predetermined position to the subject (via the photographer) has been described. However, the position of the subject's face is determined to be the predetermined position. The photographer himself / herself can be instructed to move in such a manner.

[Further shooting process of the shooting device]
Next, with reference to the flowchart of FIG. 18, a photographing process of the photographing apparatus 11 that presents the photographer with an instruction to move the position of the subject's face to a predetermined position will be described.

  In the flowchart of FIG. 18, the processing of steps S71 to S77 is the same as the processing of steps S11 to S17 of the flowchart of FIG.

  That is, in step S78, the display control unit 58 presents the photographer with an instruction to move so that the positions of the faces of the subjects become the designated positions.

  More specifically, the condition determination unit 56, for example, a horizontal component (horizontal direction) of a vector from the coordinates of the center of each face detection area to the coordinates of the center of the corresponding designated position in the image obtained by photographing the subject. Vector). When the orientations of the horizontal vectors are the same, that is, when the position of the face of each subject is shifted in the same direction in the horizontal direction from the corresponding designated position, the condition determination unit 56 The display control unit 58 is instructed to obtain an average vector of the direction vectors and display the average vector to be zero. Based on an instruction from the condition determination unit 56, the display control unit 58 performs a display for setting the average vector to 0 (that is, a display for setting the face position of the subject to the designated position). The display unit 34 is caused to perform this. For example, as shown in FIG. 19, when the position of the face of the subject A11 is shifted to the left side of the designated position P11, and similarly, the position of the face of the subject A12 is shifted to the left side of the designated position P12, display control is performed. As shown in FIG. 20, the unit 58 displays an arrow with a comment “Please move to the left” for the photographer, thereby presenting a move instruction to the photographer.

  In addition, the condition determination unit 56 determines that when the orientations of the obtained horizontal vectors are different, that is, when the position of the face of each subject is shifted from the corresponding designated position in a different orientation in the horizontal direction, The display control unit 58 is instructed to display to instruct the photographer to move according to whether there are many horizontal vectors toward the center of the image or many horizontal vectors toward the outside of the image. Based on the instruction from the condition determination unit 56, the display control unit 58 causes the display unit 34 to display so that the position of the subject's face becomes the specified position. For example, as shown in FIG. 21, when the face position of the subject A11 is shifted to the left side of the designated position P11, and the face position of the subject A12 is shifted to the right side of the designated position P12, the direction is toward the center of the image. As shown in FIG. 22, the horizontal direction vector increases, and the display control unit 58 displays an arrow with a comment “Please move backward” to the photographer, thereby instructing the photographer to move. Present. Further, although not shown, when there are many horizontal vectors that go to the outside of the image, the display control unit 58 displays an arrow with a comment “Please move forward” to the photographer.

  In step S78, the instruction to move to the photographer may be an instruction to the photographer by voice instead of display. For example, in the case described with reference to FIG. 19, the audio output control unit 59 instructs the photographer to “Please move the photographer to the left”, and in the case described with reference to FIG. An instruction to move is presented to the photographer by causing the photographer to output a voice saying “Please move the photographer backward”.

  As described above, the photographing apparatus 11 presents a movement instruction to the photographer based on the positional relationship of the subject so that the face position of the subject is relatively moved to the designated position of the template. it can.

  According to the above processing, when photographing a subject, a template corresponding to the number of subjects is read, and an image is recorded when the face position of each subject is at a designated position of the template. It is possible to take a picture when is at a more optimal position.

  In the processing described with reference to FIGS. 18 to 22, there are two subjects. However, when there are three or more subjects, a movement instruction for the subject is presented in addition to the movement instruction for the photographer. By doing so, the position of the face of the subject can be moved to the designated position of the template.

  In addition, even when the shooting mode is a baby shooting mode or a couple shooting mode, a presentation of a movement instruction for the photographer or a presentation of a movement instruction for the photographer and the subject is applied as necessary. be able to.

  The series of processes described above can be executed by hardware or can be executed by software. When a series of processing is executed by software, a program constituting the software may execute various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a program recording medium in a general-purpose personal computer or the like.

  As shown in FIG. 1, a program recording medium for storing a program that is installed in a computer and can be executed by the computer is a magnetic disk (including a flexible disk), an optical disk (CD-ROM (Compact Disc-Read Only). Memory), DVD (Digital Versatile Disc) (including magneto-optical disk), or removable media 38, which is a package medium made of semiconductor memory, or a recording unit 33 in which a program is temporarily or permanently stored It is comprised by the hard disk etc. which comprise ROM and RAM. The program is stored in the program storage medium via a wired or wireless communication medium such as a network, a local area network, the Internet, or digital sanitary broadcasting via a communication unit (not shown) that is an interface such as a router or a modem. It is done using.

  The program executed by the computer may be a program that is processed in time series in the order described in this specification, or in parallel or at a necessary timing such as when a call is made. It may be a program for processing.

  The embodiment of the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the gist of the present invention.

  DESCRIPTION OF SYMBOLS 11 imaging | photography apparatus, 31 imaging | photography part, 33 recording part, 34 display part, 35 audio | voice output part, 36 control part, 51 imaging | photography control part, 53 face detection part, 54 attribute detection part, 54a facial expression detection part, 54b age detection part, 54c Gender detection unit, 56 Condition determination unit, 57 Recording control unit, 58 Display control unit, 59 Audio output control unit

Claims (13)

Photographing means for photographing an image;
Subject detection means for detecting a subject in the image photographed by the photographing means;
Recording control means for controlling recording of the image when the position of the subject detected by the subject detection means is at a predetermined position in the image;
An imaging device comprising: a presentation unit that presents an instruction to move the subject position to the predetermined position when the subject position detected by the subject detection unit is not in the predetermined position in the image. The subject detection means detects a human face as the subject,
The recording control unit controls recording of the image when the position of the face detected by the subject detection unit is at the predetermined position in the image;
The presenting means presents an instruction to move the face position to the predetermined position when the face position detected by the subject detection means is not at the predetermined position in the image. The imaging device described in 1. The recording control means controls the recording of the image when the positions of the plurality of faces detected by the subject detection means are at a plurality of the predetermined positions corresponding to the number of faces.
The presenting means, when the positions of the plurality of faces detected by the subject detection means are not in the plurality of the predetermined positions according to the number of faces, the positions of the plurality of faces are the respective predetermined positions. The imaging device according to claim 2, wherein an instruction to move to a position is presented. The imaging device according to claim 3, wherein the plurality of predetermined positions are determined by a template corresponding to the number of the faces. Further comprising age detection means for detecting the age of the subject based on the face detected by the subject detection means;
The recording control means controls the recording of the image when the age of the subject detected by the age detection means is in a predetermined age range and the face position is in the predetermined position;
In the presenting means, when the age of the subject detected by the age detecting means is within a predetermined age range, and the face position is not in the predetermined position, the face position becomes the predetermined position. The imaging device according to claim 2, wherein an instruction to move is presented. Gender detection means for detecting gender of the subject corresponding to the plurality of faces based on the plurality of faces detected by the subject detection means;
The recording control means controls the recording of the image when the positions of the faces of the opposite sex subjects are closer than a predetermined distance among the faces of the subject whose sex is detected by the sex detection means,
The presenting means, when the positions of the faces of the opposite sex subjects are farther than a predetermined distance among the faces of the subject whose sex is detected by the sex detection means, the positions of the faces of the opposite sex subjects are The imaging device according to claim 2, wherein an instruction to move to a position closer than a predetermined distance is presented. Further comprising facial expression detection means for detecting facial expression based on the face detected by the subject detection means;
When the face position detected by the subject detection means is at the predetermined position in the image and the facial expression detected by the facial expression detection means is a smile, The imaging device according to claim 2, wherein image recording is controlled. The presenting means presents to the subject an instruction to move the face position to the predetermined position when the face position detected by the subject detecting means is not at the predetermined position in the image. The photographing apparatus according to claim 2. The presenting means presents a photographer with an instruction to move the face position to the predetermined position when the position of the face detected by the subject detecting means is not at the predetermined position in the image. The photographing apparatus according to claim 2. The presenting means controls display of an instruction to move the face position to the predetermined position when the face position detected by the subject detecting means is not in the predetermined position in the image. Item 3. The photographing apparatus according to Item 2. The presenting means controls output by voice of an instruction to move the face position to the predetermined position when the face position detected by the subject detecting means is not in the predetermined position in the image. The photographing apparatus according to claim 2. A shooting step for shooting an image;
A subject detection step of detecting a subject in the image taken by the processing of the shooting step;
A recording control step for controlling recording of the image when the position of the subject detected by the processing of the subject detection step is at a predetermined position in the image;
And a presenting step for presenting an instruction to move the subject position to the predetermined position when the subject position detected by the subject detection step is not at the predetermined position in the image. Method. A shooting control step for controlling image shooting;
A subject detection step of detecting a subject in the image taken by the shooting control step;
A recording control step for controlling recording of the image when the position of the subject detected by the processing of the subject detection step is at a predetermined position in the image;
A presentation control step for controlling the presentation of an instruction to move the subject position to the predetermined position when the subject position detected by the subject detection step processing is not at the predetermined position in the image; A program that causes a computer to execute processing including

Images