JP2006268248A - Photographing device, and face direction determining method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a photographing device capable of obtaining a facial photograph of a proper direction by determining a face direction of a person to be photographed at photographing, and transmitting correction contents to the person to be photographed when it is determined that photographing is not possible. <P>SOLUTION: The photographing device has an image input means for photographing the face of the person to be photographed, an eye detecting means for analyzing an acquired image signal and detecting an eye, a pupil detecting means for detecting a pupil, an eye position parameter calculating means for calculating a parameter indicating a position of the detected eye, a pupil position parameter calculating means for calculating a parameter indicating a position of the pupil, and a determining means for comparing a desired value with a difference of the calculated eye position parameter and pupil position parameter, determining the direction of the face. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a photographing apparatus, and more particularly, to a photographing apparatus that can correct a face direction and determine a face image in an appropriate direction by determining a face direction of a subject.

  An example of a photographing apparatus that can automatically take a picture without using a photographer is a self-type ID photo photographing apparatus. In such a photographing device, a user who is to be photographed pays a fee, and then proceeds to photograph according to a predetermined instruction. The photographed face image is output on a recording medium, and a face photograph can be obtained in a short time. Has the advantage of being

  In addition, since the obtained photos are often used as ID photos in resumes, student ID cards, etc., various measures are taken in these photographing apparatuses so that a face image is arranged at the center of the print. For example, a mark is provided near the camera so that the line of sight goes to the camera. In addition, various apparatuses have been studied that deal with face images arranged at the center of the print and avoid problems such as blinking during photographing.

  For example, there is a technique in which an image of a subject is automatically placed at the center of a print by detecting the vertical direction and the horizontal position of the subject during a framing operation for setting a range of image information to be output on a recording medium (for example, Patent Documents). 1). In addition, the size of the face shown in the photo is specified in the passport application photo, etc., and a face photo of a predetermined size can be obtained depending on the user's body shape, seating position and posture at the time of shooting. It may not be possible. To solve this problem, a technique for reducing and enlarging the face image stored in the frame memory after imaging to obtain a face image of an appropriate size (for example, see Patent Document 2), There is also a photographing apparatus that can display a moving image displayed on display means such as a liquid crystal panel so that the user can take a picture with a correct posture by viewing the displayed moving image (see, for example, Patent Document 3).

  In addition, the user sometimes closes his eyes by blinking at the moment of shooting, but the photograph with his eyes closed cannot often be used as an ID photo. Therefore, in order to solve the problem of blinking at the time of shooting, an image processing device technology that continuously inputs images, determines the state of a specific part of the face such as the pupil, and automatically selects the optimum face image. (See Patent Document 4).

In this way, a photographing device that outputs a face image in an appropriate size in the center of the print, and provides an ID photo of a finish that satisfies the user even if there is an unexpected situation such as blinking Has appeared. Furthermore, recently, a technique has also been introduced in which a face image is captured in a three-dimensional shape, and this is converted into a database so that face matching can be performed with high accuracy (see, for example, Patent Document 5).
Japanese Patent Laid-Open No. 5-268513 (see FIG. 14) Japanese Patent Laid-Open No. 11-844481 (see paragraph 0022, etc.) JP 2000-23034 A (see paragraph 0021 etc.) Japanese Unexamined Patent Publication No. 2000-259883 (see paragraph 0006 etc.) JP 2001-283224 A (see paragraph 0007 and the like)

  However, although a technique for optimizing the size and framing of the face is an effective technique for obtaining an appropriate face photograph, an improvement effect cannot be expected when the orientation of the face at the time of photographing is inappropriate. Even in the matching technique using the three-dimensional shape data of the face, even if the face matching rate is improved, the orientation of the face at the time of photographing is not corrected, and as a result, the obtained face photograph is not optimized. Further, the technique of correcting the posture while watching a moving image is effective for optimizing the posture at the time of shooting, but increases the cost of the device because a display for displaying moving images and a plurality of shooting devices are required.

  In view of the above problems, the present invention detects and determines the orientation of the face of the subject at the time of photographing in the face photography device, thereby appropriately correcting the orientation of the face at the time of photographing, and It is an object of the present invention to provide a photographing apparatus capable of obtaining a face photograph.

  It is another object of the present invention to provide an imaging apparatus that can appropriately correct the orientation of the face of the subject without using a plurality of imaging apparatuses at low cost.

  The said subject is achieved by the structure of any one of Claims 1-3.

(Claim 1)
Image input means for photographing the face of the subject,
Analyzing the image signal obtained by the image input means, eye detection means for detecting eyes, pupil detection means for detecting pupils,
Eye position parameter calculating means for calculating a parameter representing the detected eye position;
Pupil position parameter calculating means for calculating a parameter representing the position of the detected pupil;
A determination means for determining the orientation of the face by comparing the difference between the calculated eye position parameter and the pupil position parameter with a target value;
A photographing apparatus comprising:

(Claim 2)
Image input means for photographing the face of the subject,
Analyzing the image signal obtained by the image input means, eye detection means for detecting eyes, pupil detection means for detecting pupils,
Eye position parameter calculating means for calculating a parameter representing the detected eye position;
Pupil position parameter calculating means for calculating a parameter representing the position of the detected pupil;
A determination means for determining a face orientation by comparing a difference between the calculated eye position parameter and the pupil position parameter with a target value;
A transmission means for transmitting a message to the subject by voice or display,
According to the determination result of the determination means, whether or not shooting is possible is determined. If shooting is not possible, a message prompting correction of the face orientation prepared in advance is transmitted to the subject by the transmission means, thereby correcting the face direction. An imaging apparatus characterized by:

(Claim 3)
An image input process for photographing the face of the subject,
Analyzing the image signal obtained by the image input means to detect an eye, a pupil detecting step of detecting a pupil,
An eye position parameter calculating step for calculating a parameter representing the detected eye position;
A pupil position parameter calculating step for calculating a parameter representing the position of the detected pupil;
A determination step of determining a face orientation by comparing a difference between each calculated eye position parameter and pupil position parameter with a target value,
According to the determination result of the determination means, whether or not shooting is possible is determined. If shooting is not possible, a message prompting correction of the face orientation prepared in advance is transmitted to the subject, thereby correcting the face direction during shooting. A method for determining the orientation of a face.

  By using the photographing apparatus according to the present invention, a photographed person can easily take a photograph with an appropriate face orientation, and can obtain a suitable face photograph. In addition, the photographing apparatus according to the present invention can obtain the above-described effect with an inexpensive apparatus even without a plurality of cameras and a display for moving image display.

  The present invention relates to an imaging apparatus that enables a subject to take an image with an appropriate face orientation with respect to a camera. That is, in the present invention, the position of the subject's eyes and pupils is detected from the captured image signal, the difference is obtained from each position information, and the calculated difference is compared with the reference value to determine the proper orientation. I was able to get a photo of my face.

  Hereinafter, the present invention will be described in detail.

  First, a photographing apparatus capable of implementing the present invention will be described. FIG. 1 is an external perspective view of an example of a photographing apparatus capable of implementing the present invention. The external appearance of the photographing apparatus 1 is a box 11 and is usually installed outdoors in an unattended state. In front of the box 11, there are provided a box entrance 12 where a person to be photographed enters and a print outlet 40 a for taking out a printed photograph of the photographed face image.

  Inside the box 11, a chair 13, a photographing display window 50b, an operation panel 20a, a fee payment port 30a, and the like are provided. The user who is the photographed person puts the fee into the fee payment port 30a, and then sits by adjusting the height of the chair 13 based on the instruction displayed on the photographing display window 50b, and inputs the photographing condition on the operation panel 20a. Then, the photograph is taken to obtain various ID photo photographs.

  The configuration of the photographing apparatus 1 will be further described. FIG. 2 is a front sectional view of the photographing apparatus 1. In the box 11 of the photographing apparatus 1, an operation panel 20a is arranged in front of the position where the photographed person P is sitting.

  When the operation panel 20a is providing a photography service to the user who is the subject, the operation panel 20a performs reception of the subject, the type such as the size of the ID photo, photographing, and image processing on the captured face image information. It functions as a reception / information input means for inputting presence / absence and the like.

  The fee payment unit 30 is a unit that, when the photographed person P inputs a fee from the fee payment port 30a, sends an imaging permission signal to the control unit 71 described later and collects a preset fee. If the input amount is large, change is taken out. Some of the fee payment means 30 can issue a receipt.

  The image input means for photographing the face of the person to be photographed includes a photographing means 35 composed of a photographing camera. The image input means also includes a photographic display window 50b configured also as an illuminating means and a display means including a main illumination part 36a and an auxiliary illumination part 36b for enabling the photographing camera 35 to perform optimum photographing. It is. That is, the person to be photographed is illuminated by the main lighting unit 36a and the auxiliary lighting unit 36b, the face of the person to be photographed P is photographed by the photographing camera 35 through the photographing display window 50b, and the optimal face image information is electrically used as an image signal. I am trying to capture it. A specific example of the photographing camera 35 is a digital camera having a CCD, and the digital camera has a focusing lens and a filter having a dimming function arranged on the front side of the CCD. In the present invention, only the photographing camera 35 may be referred to as image input means.

  The printing unit 40 performs printing based on the image signal of the face image obtained by the photographing unit 35 which is an image information acquisition unit under the control of the control unit 71 which will be described later, and the created print photograph is taken out from the print outlet 40a. The means to be provided to the subject P. Specific examples of the printing means 40 include a melt transfer recording method and a color which form an image by transferring the recording layer of the recording medium to the image receiving layer of the image receiving material by applying heat by superimposing the recording medium and the image receiving material. There is a thermal transfer recording method in which a material is sublimated and transferred to form an image.

  The display means 50 is a means for displaying a face image of the person to be photographed captured by the photographing camera 35, photographing and print procedure guidance such as confirmation display of the photographing position, or information provided from the area. Specific examples of display means include a CRT monitor and a liquid crystal monitor. FIG. 2 shows that the information displayed on the display means 50 is bent by the half mirror 50a and displayed on the photographing display window 50b. In the present invention, it is also possible to display a message for correcting the orientation of the face of the subject based on the positions of the eyes and pupils of the subject detected at the time of shooting.

  The sound means 55 is means for transmitting operation procedures, precautions, and the like from the speaker 55a to the person to be photographed P by sound. In the present invention, it is also used as a transmission means for transmitting information to the person to be photographed P so as to correct the orientation of the face when the determination means determines that photographing is not possible.

  Next, the control unit 70 of the photographing apparatus 1 will be described with reference to the block diagram of FIG. FIG. 4 is a block diagram of the photographing apparatus according to the present invention.

  The control unit 70 sequentially controls the operation of the photographing apparatus 1. For example, each operation of the photographing apparatus 1 is performed in a preset order according to the operation program of the photographing apparatus 1 stored in the storage unit 60 in advance. Is to control. Specifically, the operation of the imaging apparatus 1 is controlled by controlling the operation of each component such as the input unit 20, the fee payment unit 30, the imaging unit 35, the illumination unit 36, the printing unit 40, and the display unit 50. That is, the control unit 70 controls input information from the input unit 20 and the fee payment unit 30 and output information to the illumination unit 36, and processes image data captured by the imaging unit 35 into image data for print output. Do.

  The control unit 70 includes software that is a control program of the photographing apparatus 1 and hardware that operates based on the program in the software. As a specific example, the control unit 70 includes software that is the control program. And a computer capable of performing the control function.

  The storage means 60 connected to the control unit 70 stores and stores information used in the operation program of the photographing apparatus 1 described above and a threshold value setting unit 83 and a correction message setting unit 85 described later. Examples thereof include a built-in memory built in 70, an external DVD, MO, HDD, and the like.

  The control unit 70 exchanges information between the control unit 70 and each component such as the printing unit 40 through an interface (not shown). As a specific example of the interface, for example, there is a SCSI interface or the like for connecting a computer as the control unit 70 and a printer as the printing means 40. Although not shown in the figure, the control means 70 communicates information between the control unit 70 and various components including the input means 20 via an I / O port and I / O control. .

  In the present invention, when the face direction evaluation means 80 connected to the control unit 70 determines whether or not the face direction of the person P to be photographed is taken at the time of shooting, and the determination result determines that the face direction needs to be corrected It is controlled to provide a message for correcting the orientation of the face to the subject P. Hereinafter, each part which comprises the face direction evaluation means 80 which corrects the face direction of the to-be-photographed person P is demonstrated.

  The image part detector 81 detects a signal of a specific part such as an eye or a pupil on the face of the person P to be photographed from the image signal input from the photographing unit 35. The image part detection unit 81 includes parts for detecting specific parts of the face, such as an eye detection part 81A for detecting the eye of the subject P and a pupil detection part 81B for detecting the pupil.

  Methods for detecting eyes and pupils from captured face images include, for example, skin color region extraction, brightness change detection, average face dictionary, eye dictionary, and pupil prepared in advance using images of a plurality of subjects. Examples of the detection method include determination based on similarity to data for face state recognition processing such as a dictionary, and comparison with a geometric arrangement constraint condition. Specifically, it is detected by a method disclosed in Japanese Patent Application Laid-Open Nos. 2001-67459 and 2004-318205.

  The position parameter calculator 82 calculates the position of the specific part detected by the image part detector, and corresponds to the eye position parameter calculator and the pupil position parameter calculator in the present invention. In the position parameter calculation unit 82, the image signal detected by the eye detection unit and the pupil detection unit is processed by the eye position parameter calculation unit 82A and the pupil position parameter calculation unit 82B, and the difference between the two parameters is calculated.

  The face orientation determination unit 84 determines whether or not the subject P is facing the face, and corresponds to the determination means in the present invention. Specifically, the difference between the eye position parameter calculated by the position parameter calculation unit and the pupil position parameter is compared with a reference value preset by the threshold setting unit 83 to determine the current face direction of the subject P. To do. Then, the message signal corresponding to the determination result is selected from the correction message setting unit 85, and the selected message signal is supplied to the correction message output unit 86 that transmits the message signal to the display unit 50 and the voice unit 55.

  The threshold value setting unit 83 uses the reference value for comparing the difference between the eye and pupil position parameters in the face direction determination unit 84 as a threshold value, and sets this value in the face direction evaluation means 80. To do. As a method of setting a threshold value to the threshold value setting unit 83, for example, a method of setting the photographing apparatus 1 according to the present invention at the time of shipment, or recording a plurality of threshold values in the storage means 60 in advance. In addition, there is a method of selecting an appropriate threshold value according to the installation environment of the photographing apparatus 1 and inputting and setting the threshold value via the input means 20.

  The correction message setting unit 85 sets various messages for correction to be provided to the photographed person P in the face direction evaluation unit 80, and various message signals corresponding to the results determined by the face direction determination unit 84. Is set. The correction message transmitted to the subject P is compared with the difference calculated by the position parameter calculation unit 82 in the face orientation determination unit 84 and the threshold set by the threshold setting unit 83, and according to the result. The selected message signal is selected. The correction message setting method includes, for example, storing various correction messages in advance in the storage means 60, and taking out messages necessary for installing the photographing apparatus 1 from the storage means 60 via the input means 20. Then, there is a method of inputting to the correction message setting unit 85.

  FIG. 4 is an example of a transmission message for correcting the orientation of the face to the subject performed in the present invention. In the present invention, according to the direction and magnitude of the difference with respect to the direction of the subject determined by the face direction determination unit, a message for instructing to correct the face direction to the left, right, up, or down as illustrated. Is transmitted to the subject by voice or screen display. In addition, the symbols (D1) to (D9) attached to the respective items indicate the differences displayed on the coordinate axes in FIG.

  In the present invention, an image signal obtained by the image input unit 35 is input to the face direction evaluation unit 80 via the control unit 70 to evaluate and determine the face direction of the subject P. That is, the face direction evaluation means 80 detects the eye part from the face image obtained by photographing the subject with the video camera 35, and obtains the eye position parameter from the detected eye part image. Further, the pupil part is detected, and the position parameter of the pupil is obtained from the image of the detected pupil part.

  The eye position parameters include, for example, a quadrangle surrounded by four battles: the center of gravity of the area of the eye, the perpendicular line that touches the left edge of the eye, the perpendicular line that touches the right edge, the horizontal line that touches the top of the eye, and the horizontal line that touches the bottom. Center (intersection of diagonal lines), etc. The pupil parameters include, for example, the area center of gravity of the detected pupil portion, the midpoint of a straight line connecting the contact point on the perpendicular line that contacts the left end of the pupil and the contact point on the perpendicular line that contacts the right end. Here, the right-eye position parameter and the right-eye pupil position parameter are preferably represented on a common coordinate having the same reference point, and the left-eye position parameter and the left-eye pupil position parameter are also the same reference point. It is preferably represented on a common coordinate having

  A difference D between the obtained eye position parameter and pupil position parameter is calculated and compared with the threshold set by the threshold setting unit. If the difference D is within the threshold value, the process proceeds to normal photography. If the difference D is exceeded, the image is displayed by voice or screen display so that the face orientation is corrected according to the direction and size of the difference D. Tell the photographer P a message.

  The face orientation evaluation unit 80 is controlled to operate based on a program provided in software that is a control program of the photographing apparatus 1 built in the control unit 70. Moreover, as a specific form of the face orientation evaluation means 80, for example, it is built in a computer that houses the control unit 70.

  Next, the procedure for determining the face orientation of the person P to be photographed performed by the photographing apparatus according to the present invention will be described with reference to the flowchart of FIG.

  First, a threshold value serving as a reference for face orientation determination is input to the photographing apparatus 1 (step S01), and a correction message to be transmitted to the user P, who is the user, is input in advance (step S02). ). These are input via the input unit 20 to the threshold value setting unit 83 and the correction message setting unit 85 provided in the control unit 70 described above.

  When the person to be photographed P comes to the photographing apparatus 1, it goes into a standby state through a predetermined procedure such as charging (step S03).

  Next, the photographing means 35 is aligned, and the photographing means 35 is moved to an appropriate position with respect to the subject P (step S04). When an appropriate position is obtained, the photographing means 35 is operated to photograph the subject P and obtain a face image (step S05).

  The obtained image signal is input to the control unit 70 (step S06). First, an image signal is transmitted to the image part detection unit 81 to detect an eye image signal (step S07), and an eye position parameter (A) is calculated by the position parameter calculation unit 82 based on the detection result (step S08). ). Similarly, the image part detection unit 81 detects the pupil image signal (step S09), and the position parameter calculation unit 82 calculates the pupil position parameter (B) (step S10). Further, the position parameter calculation unit 82 calculates the difference D from both position parameters obtained in steps S08 and S10 (step S11).

  Next, the face orientation determination unit 84 determines the comparison by comparing the difference D described above with the threshold value input in step S01 (step S12). When the difference D is within the threshold value (step S12; Yes), the control unit 70 determines that the subject P is facing the appropriate direction for photographing, and uses the image signal obtained in step S06 for print output. To generate a print photograph (step S13), and the photographing is finished.

  On the other hand, if the difference exceeds the threshold value (step S12; No), it is determined that the subject is not facing the proper direction, and the control unit 70 corrects the correction message corresponding to the difference D. Selection is made from the message setting unit 85 (step S14). Then, the selected correction message is transmitted to the photographed person P via the correction message output unit 86 and the voice means 55 and the display means 50 (step S15). When the correction message is transmitted, the subject P corrects the orientation of the face according to the message (step S16), and imaging is performed again (step S05). Then, new image information after correction is input from the photographing unit 35 into the face orientation evaluation unit 80 via the control unit 70 (step S06), and the flow after step S07 is repeated.

  According to the above flow, in the present invention, the photographed person can obtain a face photograph that is oriented in an appropriate direction during photographing.

  For example, the threshold value is determined to be a value Dg of the difference D calculated from a face photograph that is determined to be sufficiently facing the front, and it is better to re-correct the face orientation in each orientation. The value Db of the difference D calculated from the limit face photograph can be compared and set to, for example, an intermediate point between Dg and Db.

  FIG. 6 is a schematic diagram showing the difference D between the eye position parameter and the pupil position parameter obtained by the position parameter calculation unit 82 on the coordinate axis. FIG. 6 shows that the person P to be photographed turns to the left as the coordinate of the difference D goes in the plus direction of the X axis, and turns to the right as the coordinate of the difference D goes in the minus direction. In addition, it is assumed that the person P to be photographed is in a state of depression as it goes in the positive direction of the Y-axis, and faces upward as it goes in the negative direction. In this case, since the difference is within the threshold value at D1, an image determined to be in the proper direction is obtained, and the message shown in FIG. The Further, in any of D2 to D9, it is determined that the subject P has an incorrect face orientation, and each message in FIG. 4 corresponding to each state is transmitted to the subject P.

  In this way, in the present invention, the eye and pupil portions are detected from the face image of the subject obtained by photographing with the video camera, and the position parameters of the eyes and pupils represented by, for example, barycentric coordinates are detected therefrom. And the difference is calculated from these parameters. Then, the obtained difference is compared with the threshold value set by the threshold value setting unit, and when the difference is within the threshold value, it is determined that the obtained face image is oriented in an appropriate direction. Create a print photo with this image. On the other hand, when the threshold value is exceeded, a message is transmitted so that the person to be photographed faces the camera based on the difference.

  As a result, according to the present invention, the orientation of the subject's face is detected during shooting to determine whether the subject is facing the front of the camera, and the subject is not facing the proper orientation. At times, specific instructions were given to correct the face in the correct direction so that a face photo with the correct orientation could be obtained.

It is an external appearance perspective view of the example of an imaging device which can implement this invention. It is front sectional drawing of the imaging device of FIG. It is a block diagram of the imaging device concerning the present invention. It is a schematic diagram which shows the example of the transmission message for face direction correction to a to-be-photographed person. It is a flowchart which shows the procedure of the face orientation determination performed with the imaging device which concerns on this invention. It is the schematic diagram which represented the difference of the positional parameter of eyes and pupils on the coordinate axis.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image pick-up device 20 Input means 30 Fee payment means 35 Imaging means (image input means)
40 Print Unit 50 Display Unit 55 Audio Unit 60 Storage Unit 70 Control Unit (Computer)
80 Face orientation evaluation means 81 Image region detection section 81A Eye detection section (eye detection means)
81B pupil detection unit (pupil detection means)
82 position parameter calculation unit 82A eye position parameter calculation unit (eye position parameter calculation means)
82B Pupil position parameter calculation unit (pupil position parameter calculation means)
83 Threshold setting unit 84 Face orientation determination unit (determination means)
85 Correction message setting section P Subject

Claims (3)

Image input means for photographing the face of the subject,
Analyzing the image signal obtained by the image input means, eye detection means for detecting eyes, pupil detection means for detecting pupils,
Eye position parameter calculating means for calculating a parameter representing the detected eye position;
Pupil position parameter calculating means for calculating a parameter representing the position of the detected pupil;
A determination means for determining the orientation of the face by comparing the difference between the calculated eye position parameter and the pupil position parameter with a target value;
A photographing apparatus comprising: Image input means for photographing the face of the subject,
Analyzing the image signal obtained by the image input means, eye detection means for detecting eyes, pupil detection means for detecting pupils,
Eye position parameter calculating means for calculating a parameter representing the detected eye position;
Pupil position parameter calculating means for calculating a parameter representing the position of the detected pupil;
A determination means for determining a face orientation by comparing a difference between the calculated eye position parameter and the pupil position parameter with a target value;
A transmission means for transmitting a message to the subject by voice or display,
According to the determination result of the determination means, whether or not shooting is possible is determined. If shooting is not possible, a message prompting correction of the face orientation prepared in advance is transmitted to the subject by the transmission means, thereby correcting the face direction. An imaging apparatus characterized by: An image input process for photographing the face of the subject,
Analyzing the image signal obtained by the image input means to detect an eye, a pupil detecting step of detecting a pupil,
An eye position parameter calculating step for calculating a parameter representing the detected eye position;
A pupil position parameter calculating step for calculating a parameter representing the position of the detected pupil;
A determination step of determining the orientation of the face by comparing the difference between each calculated eye position parameter and pupil position parameter with a target value,
According to the determination result of the determination means, whether or not shooting is possible is determined. If shooting is not possible, a message prompting the correction of the face orientation prepared in advance is transmitted to the subject, thereby correcting the face direction during shooting. A method for determining the orientation of a face.

Images