JP4357951B2 - Image photographing system and certification medium issuing system - Google Patents

Description

  The present invention, for example, is an image that captures a face image to be printed on a certification medium with a face image, such as an automobile driver's license (hereinafter simply referred to as a license) or various certificates (including card type and booklet type). The present invention relates to a photographing system and a certification medium issuing system for issuing a certification medium with a face image using the image photographing system.

In general, in this type of image shooting system, the face image taken for printing on a certification medium such as a license can be checked for quality after printing on the certification medium, or the face image at the time of shooting in advance. Can be confirmed by displaying the image, the photographed person occupies the photographing apparatus on the spot after photographing and confirms the quality of the photographed face image.
JP 2000-258832 A JP 2000-292934 A

However, in the conventional image shooting system, if the quality of the face image is not good as a result of checking the quality of the face image after printing the face image on the certification medium, the image is taken again and printed on the certification medium again. Therefore, there is a problem that the certification medium is wasted.
In addition, if the face image at the time of shooting can be displayed and confirmed in advance, the person to be photographed will occupy the photographing device for the time including the confirmation of the quality of the face image in addition to the photographing. However, there is a problem that a subject who is waiting to shoot gets congested.

  Therefore, an object of the present invention is to provide an image photographing system that can smoothly photograph a face image of a subject.

  It is another object of the present invention to provide a proof medium issuing system that can smoothly print a face image of a person who issues a proof medium to a proof medium.

The image photographing system of the present invention includes a photographing device for photographing at least a face image of a subject and a confirmation device for confirming the subject's face image photographed by the photographing device. The imaging apparatus is configured to temporarily capture at least a plurality of face images of the subject and one or more face images selected by the operator among the plurality of face images photographed by the photographing means. In response to receiving a captured image access request signal transmitted from the confirmation device and a temporary storage means for storing, a first one for transmitting one or more face images stored in the temporary storage means to the confirmation device The confirmation device includes a second transmission unit that transmits a captured image access request signal to the imaging device, and a transmission of the captured image access request signal by the second transmission unit. The first one or more face images transmitted by the transmitting means of the photographing apparatus receives a display means for displaying the received one or more facial images, in response to the photographer's selection operation on a selecting means for selecting a predetermined face image from the displayed one or more face images by the display means, and third transmitting means for transmitting the selection result of the face image by the selection unit to the imaging device The photographing apparatus further receives a selection result of the face image transmitted by the third transmission unit of the confirmation apparatus, and 1 stored in the temporary storage unit based on the received selection result Alternatively, an output means for outputting a face image corresponding to the selection result from a plurality of face images is provided.
Further, the image photographing system of the present invention has a photographing device for photographing at least a face image of the subject and a confirmation device for confirming the face image of the subject taken by the photographing device. The photographing apparatus is configured to temporarily capture at least a plurality of face images of the subject and a plurality of face images selected by the operator among the plurality of face images photographed by the photographing unit. Temporary storage means for storing and first transmission for transmitting a plurality of face images stored in the temporary storage means to the confirmation device in response to reception of the captured image access request signal transmitted from the confirmation device And the confirmation apparatus transmits a captured image access request signal to the imaging apparatus, and the imaging apparatus responds to transmission of the captured image access request signal by the second transmission means. A plurality of face images transmitted by the first transmission means of the apparatus, and a display means for displaying the received plurality of face images; and the display means displayed in response to the selection operation of the subject. A selection unit that selects a predetermined face image from a plurality of face images; and a third transmission unit that transmits a selection result of the face image by the selection unit to the imaging device. , Receiving the selection result of the face image transmitted by the third transmission means of the confirmation device, and based on the received selection result, the selection result is selected from the plurality of face images stored in the temporary storage means. Output means for outputting a corresponding face image is provided.

Further, the certification medium issuing system of the present invention is a personal information acquisition means for acquiring personal information necessary for issuing a person's certification medium, a photographing device for photographing at least a face image of the person, and photographing by this photographing device. A confirmation device for confirming the person's face image by the person, and a printing device for printing the face image confirmed by the confirmation device and the personal information acquired by the personal information acquisition means on the surface of the certification medium. The photographing apparatus includes photographing means for photographing at least a plurality of face images of a person, and one or a plurality of face images selected by an operator among the plurality of face images photographed by the photographing means. a temporary storage means for temporarily storing, in response to receiving the photographed image access request signal transmitted from the checking device, one or more stored in said temporary storage means A first transmission unit that transmits a face image to the confirmation device, and the confirmation device includes a second transmission unit that transmits a captured image access request signal to the photographing device, and the second transmission unit. display means for receiving a first one or more face image transmitted by the transmitting means of the imaging apparatus to the transmission of the photographed image access request signal, and displays the one or more face images this received, to be photographed In response to a user's selection operation, a selection unit that selects a predetermined face image from one or a plurality of face images displayed by the display unit, and a selection result of the face image by the selection unit is transmitted to the photographing apparatus. And a third transmission unit configured to receive the face image selection result transmitted by the third transmission unit of the confirmation device, and based on the received selection result, Record And an outputting means for outputting a face image corresponding to the selection result from among one or a plurality of face images stored in means to the printing apparatus.

  According to the present invention, it is possible to provide an image photographing system capable of smoothly photographing a face image of a subject.

  Further, according to the present invention, it is possible to provide a proof medium issuing system capable of smoothly printing from a face image of a person who issues a proof medium to a proof medium.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 schematically shows a configuration of a certification medium issuing system that issues a certification medium with a face image such as a license (hereinafter abbreviated as an ID card) to which the image photographing system according to the present embodiment is applied. It is shown as an example. In FIG. 1, this certification medium issuance system is connected to a host computer 101 composed of a general-purpose computer for overall control, and is connected to at least a card issuance applicant (hereinafter referred to as a subject or person). Say) Database 102 as storage means for storing personal information including various information described in one ID card in correspondence with personal number (ID number) as unique identification information possessed by card issuing applicant 1 The photographing device 103 for photographing the face image of the card issuance applicant 1 and the card issuance applicant 1 before the face image of the card issuance applicant (photographer) 1 photographed by the photographing device 103 is printed on the ID card. In response to a command from a plurality of (three in this example) confirmation devices 104, 104, 104, and the photographing device 103. As printing means for creating the ID card 105 by printing the face image of the card issuing applicant 1 confirmed by the confirmation device 104 and personal information such as personal number, name, age, and address on an unissued ID card Printing device 106, filing device 107 for filing personal information such as face image, personal number, name, age, address, etc., host computer 101, photographing device 103, confirmation device 104, printing device 106, and filing It consists of a network 108 that interconnects the devices 107.

  For example, a magnetic card or an IC card is used as the ID card 105 as a certification medium, and a face image 109 and personal information 110 such as a personal number, name, age, and address are printed on the surface. .

  FIG. 2 schematically shows an external configuration of the photographing apparatus 103. This photographing apparatus 103 includes an illuminator 2 that illuminates a photographed person (person) 1 who is a card issuing applicant, and a CCD type video camera as an image input means for photographing and inputting at least a face image of the photographed person 1. 3. A display (monitor display) 4 for guiding and displaying the shooting state and guidance for the photographed person 1, a speaker 5 for guiding the photographed person 1 by voice, and an operation instruction by the operator. A control table (control unit) 6 that processes an input image from the camera 3 and outputs it to the display unit 4 and a built-in storage unit, a chair 7 on which the subject 1 is seated at the time of shooting, a shooting In order to forcibly extend or stop shooting from the side of the person to be photographed 1 while photographing the background plate 8 serving as the background of the person to be photographed 1 and the face image of the person to be photographed 1 Switch to indicate Shooting stop as stage switch and a (push button switch) 9.

  The speaker 5 is attached to a portion corresponding to the person to be imaged 1 on the back side of the background plate 8 so that sound is emitted from a sound emission hole provided in the background plate 8. Further, the color of the background plate 8 is set to a color (for example, blue) suitable for the background of the certification photograph.

  FIG. 3 is a block diagram illustrating an overall configuration of the imaging apparatus 103 illustrated in FIG. That is, an analog signal (input image) from the camera 3 is converted into a digital signal in real time and transferred to a video memory, a main memory or the like, and image data of the video capture unit 11 and other drawing processes are performed. And a video accelerator 12 for controlling display on the display 4, a sound controller 13 for controlling voice for guidance to the speaker 5, and a CPU for performing various arithmetic processes and various controls on image data and others. (Central processing unit), main memory for temporarily storing image data and calculation results, CPU unit 14 having an interface with various peripheral devices, and an external bus (for example, SCSI) for connecting various peripheral devices External bus control unit 15 and photographing stop switch 9 I / O control unit 16 equipped with various interfaces, various OSs and applications, large-capacity storage device 17 such as a hard disk device as storage means for storing control data, image data, etc., output data of control table 6, etc. A reader / writer unit 19 for reading / writing data from / to a portable storage medium (for example, a magneto-optical disk), and a personal number that is identification information unique to the card issuer optically from the card issue application form. An optical reader (OCR) 20 as an identification information input means for reading and inputting, a keyboard 21 and a mouse 22 as input means operated by an operator, and other various devices on the network 108 (host computer 101, confirmation Device 104, printing device 106, filing device 107, etc.) It is constituted by such as a network adapter (LAN card) 23 for performing communication.

  FIG. 4 is a block diagram showing an overall configuration of the confirmation device 104 shown in FIG. That is, the image data and other drawing processing are performed, the video accelerator 42 for controlling the display on the display (monitor display) 41, the sound controller 44 for controlling the voice for guidance to the speaker 43, the image data and CPU (Central Processing Unit) for performing various arithmetic processing and various control to others, main memory for temporarily storing image data and arithmetic results, CPU section 45 having interfaces with various peripheral devices, various OSs , A large-capacity storage device 46 such as a hard disk device as storage means for storing application, control data, image data, etc., a keyboard 47 and mouse 48 as input means operated by an operator, and other on the network 108 Various devices (host computer 101, confirmation unit 104, the printing device 106, such as a network adapter (LAN card for performing mutual communication with such filing apparatus 107)) is constituted by such 48.

  In such a configuration, the main processing of the photographing apparatus 103 will be described with reference to the flowcharts shown in FIGS. Note that the processing described below is mainly executed under the control of the CPU in the CPU unit 14.

  First, in step S1, the card issuance application brought by the card issuance applicant 1 who creates the ID card is set in the optical reader 20, and the personal number, which is identification information unique to the card issuance applicant, is set to the card. Read from the application form and enter it. The personal number read from the card issuance application is sent to the CPU unit 14 and stored in the main memory.

  Next, in step S2, the personal information of the card issuer 1 is retrieved from the database 102 using the personal number read from the card issue application form as a key, and stored in the main memory. In this case, the personal information can be expressed by character data such as the name and address of a card issuer registered in advance. Here, the process of step S2 corresponds to the personal information acquisition means in the present invention.

Next, in step S <b> 3, the operator gives an instruction to start photographing processing using the keyboard 21 or the mouse 22. When an instruction to start shooting processing is given, shooting preparation processing (details will be described later) is performed in step S4. Next, in step S5, it is determined whether or not the shooting preparation process in step S4 is NG timeout, and if it is NG timeout, the process returns to step S3 again to return to the shooting instruction waiting state.
If the shooting preparation process in step S4 is OK time-out, a first face image shooting process (details will be described later) is performed on the card issuing applicant 1 in step S6.

  Thereafter, the same process as in steps S4, S5, and S6 is repeated twice (steps S7 to S12), and the face image of the card issuing applicant 1 is continuously photographed three times.

  Next, in step S13, it is determined whether or not the photographing processes in steps S6, S9, and S12 have been completed normally. If there is an error as a result of this determination, the display 4 or the speaker 5 is determined in step S14. Thus, predetermined guidance is given to the operator and the card issuing applicant 1, and the process returns to step S3 to return to the state of waiting for the shooting instruction.

  As a result of the determination in step S13, when the photographing processes in steps S6, S9, and S12 are normally completed, the face image for three photographing processes for the card issuer 1 is displayed on the display 4 in step S15. .

  Next, in step S <b> 16, the operator determines that it is not appropriate to print out the ID card in all the captured face images (in this case, three face images) displayed on the display device 4. If there is something, delete it.

  Next, in step S17, it is determined whether there is a remaining face image as a result of step S16. If there is no remaining face image, the process returns to step S3 to return to the shooting instruction waiting state. The image will be taken again.

  If the result of determination in step S17 is that there is a remaining facial image, the facial image (photographed) together with the personal information acquired in step S2 is stored in a waiting queue database (not shown) built in the large-capacity storage device 17. Three face images) are temporarily stored (registered). Then, it returns to step S1 and prepares for the next photography preparation. Here, the processing in step S18 corresponds to the temporary storage means in the present invention.

  Hereinafter, with reference to the flowchart shown in FIG. 7, the photographing preparation processing in steps S4, S7, and S10 in FIGS. 5 and 6 will be described. Note that the processing described below is mainly executed under the control of the CPU in the CPU unit 14.

  First, in step S21, as a guidance for the person to be photographed (card issuing applicant) 1, the speaker 5 is notified that photographing is to be performed. Next, in step S22, a shooting timer (not shown) for waiting for a time until actual shooting processing is performed is reset. Next, in step S23, a stop switch timer (not shown) for determining the length of depression of the photographing stop switch 9 that is operated because the subject 1 is not ready is reset.

  Next, in step S24, the operation of the photographing timer is started. The time of the photographing timer is not specifically defined, but is set to about 1 to 2 seconds, for example. Next, in step S25, it is determined whether or not the shooting timer has timed out. If timed out, an OK time-out return is performed in step S26.

  If the shooting timer is not timed out in step S25, it is checked in step S27 whether the shooting stop switch 9 has been pressed. If the photographing stop switch 9 has been pressed as a result of the confirmation, the photographing timer being counted is temporarily stopped in step S28, and the stop switch timer is started in step S29. The time of the stop switch timer is not specifically defined, but is set to about 3 to 4 seconds, for example.

  Next, in steps S30 to S32, it waits for the photographing stop switch 9 to be in the non-depressed state again, and starts the photographing timer again. Meanwhile, in step S33, it is determined whether or not the stop switch timer has timed out. If timed out, an NG time-out return is performed.

  In other words, this shooting preparation process prompts the person to be photographed 1 to prepare for photographing, and if the person to be photographed 1 is not ready until the actual photographing, the photographing stop switch 9 is used until photographing. If the time is extended and the time is long to some extent, it is to realize that the photographing is performed again from the beginning.

  FIG. 8 shows an input image (face image) 31 from the camera 3 and an approximate region 33 of the eye that is a relative position from the face outline region 32 in the input image 31, and positions of both eyes from the approximate region 33. 34 and 35 are respectively detected, and a state in which a cutout area of the output image is determined is shown.

  Hereinafter, the photographing process in steps S6, S9, and S12 in FIGS. 5 and 6 will be described with reference to the flowchart shown in FIG. 9 and FIG. Note that the processing described below is mainly executed under the control of the CPU in the CPU unit 14.

  First, in step S101, the number of retries counted by a counter (not shown) and other data are initialized, and the process proceeds to step S102. In step S102, the input image 31 (see FIG. 8) from the camera 3 is captured via the video capture unit 11, temporarily stored in the main memory in the CPU unit 14, and the process proceeds to step S103.

  In step S103, the face contour of the subject 1 is searched by searching for a region (photographer 1) having a pixel different from the background color in the input image 31 by face contour position detection processing, which will be described in detail later. The position of the area 32 is detected. Next, in step S104, it is determined whether or not the position of the face outline region 32 detected in step S103 is within an appropriate range.

  As a result of this determination, when the position of the detected face contour region 32 is not within the proper range (for example, when there is no subject 1 in front of the camera 3 or when the position of the face contour region 32 is vertically and horizontally) If it is far off), the process returns to step S102, and the input image 31 is captured again.

  As a result of the determination in step S104, if the detected position of the face contour region 32 is within an appropriate range, the process proceeds to step S105. In step S105, the face outline region 32 detected in step S103 is statistically obtained and narrowed down to the pupil position approximate region 33 where the pupil will surely exist. The parts 34 and 35 having a round shape are extracted.

  Next, in step S106, it is determined whether or not the number of parts having the same round shape as the pupil extracted in step S105 is a prescribed number. If it is determined that the number is less than the specified number, it is determined that the pupil is not open, a specified time (for example, about 0.1 second) is waited in step S107, and the process proceeds to step S108. In step S108, it is checked whether or not the number of retries is within a specified value set in advance. If it is within the specified value, the process proceeds to step S109. In step S109, the number of retries is incremented, the process returns to step S102, and the process from step S102 is performed again as a retry process.

  As a result of the determination in step S106, if the number of extractions satisfies the specified number, the process proceeds to step S110. In step S110, the extracted shape around each part is compared with the sample data of the left and right pupils, and the extracted part having the highest degree of similarity is extracted for the left and right pupils. Next, in step S111, it is determined whether or not the degree of similarity is greater than or equal to a preset threshold value. If the degree of similarity is greater than or equal to the threshold value, the pupil position is determined to be normally open. Proceeding to S107, a retry process similar to that described above is performed.

Since there are two pupils, the left and right pupils are prepared, and the above determination is made by comparing the left and right pupils to recognize the state of both the left and right pupils.
Next, in step S112, an output image is generated by an output image generation process that will be described in detail later, and the process returns.

  If the number of retries is not within the specified value as a result of the check in step S108 (when the number of retries exceeds the specified number), the shooting process is abandoned, error processing is performed in step S113, and the process returns.

  In summary, the shooting process is summarized as follows. When the subject 1 is shot, if it is blinking or blinking, it is determined in step S110, and the retry process is performed while waiting for the eyes to open. Do. If the subject 1 is not a normally open eye with his eyes open but not looking away or otherwise facing forward, determination is made in the processing of steps S110 to S111, and the subject is opened normally. Wait for eyes. In addition, the processes in steps S110 to S111 also operate as a correction process for those erroneously determined in the process in step S1105. Furthermore, the processing in steps S110 to S111 also works on abnormally open eyes (surprised eyes) that cannot be determined in the processing in step S105, and performs retry processing.

FIG. 10 shows areas, coordinate values, and numerical names used in face contour position detection processing described later. In FIG.
XSTILLSIZE: Number of pixels in the horizontal direction of the image input from the camera 3
YSTILLSIZE: Number of pixels in the vertical direction of the image input from the camera 3
XFMGSIZE: Horizontal image when output to printing device 106 or filing device 107
Number of pixels in length
YFMGSIZE: Image portrait when output to the printing device 106 or filing device 107
Number of pixels in length
FACESIZE: The average face length pixel of the subject when shooting at a fixed shooting distance
number
OVERHEAD: FACESIZE's face is XFMGSIZE × YFMGSIZE
To improve the balance of the face position when it fits in the output image size
Number of pixels in the vertical direction where the background plate 8 is necessary
It is.

  In FIG. 10, a search area (measurement area) FE is an area in which the upper left vertex is (XSTART, YTOP) and the lower right vertex is (XST0P, YTOP + measurement height). The values of XSTART and XST0P are the left end x-coordinate and the right end x-coordinate of a preset range that will surely enter the input image when the subject 1 sits on the chair 7. The measurement height is a value that is set in advance as a range that will not be affected by a region that is greatly expanded from side to side in the lower part of the face of the subject 1 such as the shoulder or long hair person.

  Hereinafter, the face contour position detection processing in step S103 in FIG. 9 will be described with reference to the flowchart shown in FIG. 11 and FIG. Note that the processing described below is mainly executed under the control of the CPU in the CPU unit 14.

  First, in step S121, the color component of the background board 8 is measured in the upper right region RE and upper left region LE of the input image 31 stored in the main memory in the CPU unit 14, and the process proceeds to step S122. In step S122, it is determined whether or not the result measured in step S121 is a color component (blue component) that is likely to be the background board 8, and the process proceeds to step S123. At this time, the non-blue background (that is not the blue component) is determined as the face image portion of the subject 1.

  In step S123, the parietal height position detection process described later is performed to obtain the vertical parietal vertical line number headtop, and the process proceeds to step S124. In step S124, it is confirmed whether or not the top position is within the specified range, and the process proceeds to step S125. In step S125, left and right face center position detection processing described later is performed to obtain a face center position lateral line number center, and the process proceeds to step S126.

  In step S126, it is confirmed whether the face center position is within a specified range, and the process proceeds to step S127. In step S127, the position where the horizontal line number center and the vertical line number headtop intersect is set as the face contour reference position, and the process proceeds to step S128. In step S128, the processing result is set to “within the face contour position regulation range”, and the process returns. If NO in step S122, step S124, or step S126, the process proceeds to step S129. In step S129, the processing result is set to “out of face contour position regulation range”, and the process returns.

Next, the top height position detection process in step S123 in FIG. 11 will be described with reference to the flowchart shown in FIG. 12 and FIG.
First, in step S131, it is confirmed that there is a top of the subject 1 within a specified range (OVERHEAD + 1 line to YRANGE line) in which at least the top of the photographer 1 may exist. Here, YRANGE = (YSTILLSIZE−YFMGSIZE + OVERHEAD).
Further, among the pixels constituting the horizontal line of the vertical line number OVERHEAD in the input image, the number of pixels different from the color component of the background plate 8 (that is, the face portion of the subject 1) is counted, and the number is equal to or greater than a predetermined value. Check if it exists.

  Further, similarly, it is confirmed whether or not a pixel different from the color component of the background plate 8 among the pixels constituting the YRANGE horizontal line exceeds a specified value, and the pixel different from the color component of the background plate 8 on the OVERHEAD line. Is less than the specified value, and it is confirmed that pixels different from the color components of the background plate 8 on the YRANGE line are equal to or more than the specified value. This specified value is a numerical value for ignoring the portion of the subject 1 when the hair of the subject 1 is fluffing sideways or a foreign object different from the color is attached to the background plate 8.

  In step S132, the vertical line number OVERHEAD of the input image is set to i and YRANGE is set to j, and the process proceeds to step S133. In step S133, after confirming that there are more lines than 0 lines between the i line and the j line, the process proceeds to step S134. In step S134, the center line ((i + j) / 2) of the i line and the j line is set to k, and the process proceeds to step S135.

  In step S135, pixels that are different from the color components of the background plate 8 among the pixels constituting the horizontal line of k are counted, and it is determined whether the number is equal to or greater than a specified value. This prescribed value is a numerical value for ignoring the portion of the subject 1 when the hair of the subject 1 is fluffing sideways or when a minute foreign substance different from the color is attached to the background plate 8.

  If the determination result in step S135 is greater than or equal to the specified value, k is set to j in step S136, and the process returns to step S133. If the determination result in step S135 is not greater than the specified value, k is determined in step S137. Is set to i, the process returns to step S133, and the same operation as described above is repeated.

  In this way, from the search area from OVERHEAD to YRANGE of the input image, the search area is halved for each processing loop, and j-i is less than 1 (0 lines when there is no difference in the number of lines). In other words, if the determination result in step S133 is less than 0 line, the process proceeds to step S138.

  In step S138, i of the parietal portion Y line is set to the parietal position headtop, and the process proceeds to step S139. In step S139, the processing result is set to “within the top position prescribed range”, and the process returns.

  If the result of determination in step S131 is that there is no face image data in YRENGE and there is face image data in OVERHEAD, if it is determined that the face image is not within the specified range, processing proceeds to step S140. In step S140, the processing result is set to “out of the top position prescribed range”, and the process returns.

  Next, the left-right direction face center position detection processing in step S125 in FIG. 11 will be described with reference to the flowchart shown in FIG. 13 and FIG. Note that the processing described below is mainly executed under the control of the CPU in the CPU unit 14.

  First, in step S151, the leftmost vertical line number 0 of the input image 31 is set to i, the center vertical line number (XSTILLSIZE / 2) of the input image 31 is set to j, and the process proceeds to step S152. In step S152, it is confirmed whether or not there are more lines than 0 lines between the i line and the j line. If there are more lines, the process proceeds to step S153.

  In step S153, the central vertical line ((i + j) / 2) between the i line and the j line is set to k, and the process proceeds to step S154. In step S154, out of the pixels constituting the vertical line of k, pixels having a color different from the color component of the background plate 8 measured in step S121 are counted, and it is determined whether or not the number is equal to or greater than a specified value. This prescribed value is a numerical value for ignoring the portion of the subject 1 when the hair of the subject 1 is fluffing sideways or when a minute foreign substance different from the color is attached to the background plate 8.

  If the determination result in step S154 is greater than or equal to the specified value, k is set to j in step S155, and the process returns to step S152. If the determination result in step S154 is not greater than the specified value, k is set in step S156. i is set, the process returns to step S152, and the same operation is repeated.

  In this way, the search area is halved for each processing loop from the search area on the left half of the input image 31, and when j-i becomes less than 1, that is, the determination result in step S152 is 0. If it is less than the line, the process proceeds to step S157.

  In step S157, when j-i becomes less than 1 in step S152, i is set to the face left edge vertical line headleft, and the process proceeds to step S158. In step S158, the center vertical line number (XSTART + XSTOP / 2) of the input image 31 is set to i, the right end vertical line number (XSTOP) of the input image 31 is set to j, and the process proceeds to step S159. In step S159, it is confirmed whether or not there are more lines than 0 lines between the i line and the j line. If there are more lines, the process proceeds to step S160.

  In step S160, the central vertical line ((i + j) / 2) between the i line and the j line is set to k, and the process proceeds to step S161. In step S161, pixels having a color different from the color component of the background plate 8 measured in step S121 among the pixels constituting the vertical line of k are counted, and it is determined whether the number is equal to or greater than a specified value. This prescribed value is a numerical value for ignoring the portion of the subject 1 when the hair of the subject 1 is fluffing sideways or when a minute foreign substance different from the color is attached to the background plate 8.

  If the determination result in step S161 is greater than or equal to the specified value, k is set to j in step S162, and the process returns to step S159. If the determination result in step S161 is not greater than the specified value, k is set in step S163. i is set, and the process returns to step S159 to repeat the same operation as described above.

  In this way, the search area is halved for each processing loop from the search area on the right half of the input image 31, and when j-i becomes less than 1, that is, the determination result in step S159 is 0. If it is less than the line, the process proceeds to step S164.

  In step S164, when j-i becomes less than 1 in step S159, i is set to the face right edge vertical line headright, and the process proceeds to step S165. In step S165, the center position is calculated based on the face left end vertical line headleft set in step S157 and the face right end vertical line headright set in step S164, and the calculated value is returned as the value of the center.

9, 11, 12, and 13 described above, the determination in step S <b> 104 is performed by determining the value of the face reference position (center, headtop), and the printing device 106 is determined from this reference position. Whether or not the photo size (trimming size) for output to the filing device 107 can be acquired is determined by the following equation. If the equation is satisfied, the determination in step S104 is that the position of the face contour region 32 is in an appropriate range. If it does not hold, the determination in step S104 indicates that the position of the face outline region 32 is not within the proper range.
XFMGSIZE / 2 <center <(XSTILLSIZE
-XFMGSIZE / 2)
OVERHEAD <headtop <YRANGE

  FIG. 14 is a flowchart showing details of the output image generation processing in step S112 in FIG. 9, which will be described below with reference to FIG. Note that the processing described below is mainly executed under the control of the CPU in the CPU unit 14.

  First, in step S171, the center position 36 of the left and right pupil positions 34 and 35 detected in step S110 is calculated. Next, in step S172, the face trimming position is calculated as a relative position from the center position 36 of both the left and right pupils. The relative positional relationship between the left and right pupils and the trimming position is determined so that the face image after trimming comes to a position where the center of both the left and right pupils is suitable as an ID photo.

  Next, in step S173, a trimmed image 37 is generated according to the determined trimming position. Next, in step S174, the trimmed image 37 is subjected to data compression processing for print data to generate a compressed image 38, which is stored in the main memory of the CPU unit 14. In this compression process, after this, when printing is instructed to the printing apparatus 106, restrictions on communication time due to the throughput of the system when data is transmitted and the printing quality on the card surface in the printing apparatus 106 are set. It is necessary to carry out with the compression rate calculated | required from the restrictions for maintaining.

  The output image generation processing in step S112 is summarized as described above. Trimming is performed from the input face image, and compressed image data that takes into account both throughput and image quality is generated for printing.

  Next, a face image selection process in which the person to be photographed (card issuing applicant) 1 confirms his / her face image photographed by the photographing apparatus 103 using the confirmation apparatus 104 will be described with reference to the flowchart shown in FIG. To do.

  The to-be-photographed person 1 who has finished the photographing process with the photographing apparatus 103 passes the photographing apparatus 103 to the next photographed person, moves to a place where a plurality of confirmation apparatuses 104 are installed, and follows the guidance of the confirmation apparatus 104. Manipulate.

  First, in step S181, the CPU unit 45 of the confirmation apparatus 104 transmits a captured image access request signal to a confirmation wait queue database (not shown) built in the mass storage device 17 of the imaging apparatus 103. Here, the processing in step S181 corresponds to the second transmission means in the present invention.

  Next, in step S <b> 182, if there is no access request from another confirmation device 104 at present, the CPU unit 14 of the imaging device 103 replies access permission to the confirmation device 104. If there is an access request to the confirmation waiting queue database by another confirmation device 104, a response indicating that access is impossible is made. If access is impossible, the process returns to step S181.

  Next, in step S183, the CPU unit 14 performs a process for occupying the confirmation waiting queue database access as an exclusive control. Next, in step S184, the CPU unit 14 confirms the presence or absence of data in the confirmation waiting queue database. If there is no data, in step S185, the exclusive waiting state of the confirmation waiting queue database is released as exclusive control, and the confirmation waiting is performed again. Return to queue database access request.

  If there is data in step S184, the process proceeds to step S186. In step S186, the CPU unit 14 obtains the top data of the confirmation waiting queue database, that is, the oldest photographed face image data (up to three images) and personal information in the processing of the photographing apparatus 103 in FIG. 5 and FIG. These are transmitted to the confirmation device 104. Here, the process of step S186 corresponds to the first transmission means in the present invention.

  Next, in step S187, the CPU unit 45 displays the personal number and name on the display device 41 from the personal information transmitted from the photographing apparatus 103, or announces similar information from the speaker 43. Call the subject 1 waiting for confirmation.

  Next, in step S188, the CPU unit 45 displays all the face image data acquired in step S186 on the display 41 in addition to the display in step S187. The display image of the display device 41 in the state up to this point is shown in FIG. In FIG. 16, 51 is a guidance sentence, 52, 53 and 54 are taken face images, 55, 56 and 57 are image selection buttons for selecting the displayed face images 52, 53 and 54, and 58 is a displayed face. A cancel button for canceling all images. Here, the process of step S188 corresponds to the display means in the present invention.

  Next, in step S189, the person to be photographed 1 who has been called up to the confirmation apparatus 104 by the guidance in step S187 likes the most among the displayed face images 52, 53, and 54 in accordance with the display on the display device 41. A face image is selected by image selection buttons 55, 56, and 57 on the screen. If there is no favorite face image in the displayed face images 52, 53, 54, the cancel button 58 is pressed. Here, the process of step S189 corresponds to the selection means in the present invention.

  Next, the CPU unit 45 determines whether or not the cancel button 58 has been pressed in step S190. If the cancel button 58 is pressed, the CPU 45 erases the display content on the display 41 in step S191, and stores it in the photographing apparatus 103. An image cancel request signal is transmitted.

  Receiving this image cancel request signal, the CPU unit 14 of the photographing apparatus 103 deletes the corresponding queue data (face image) in the confirmation waiting queue database in step S192, and returns to step S181 via step S185.

  If the cancel button 58 is not pressed in step S190, the CPU unit 45 transmits the face image selection result to the photographing apparatus 103 in step S193. Here, the processing in step S193 corresponds to the third transmission means in the present invention.

  In step S194, the CPU unit 14 of the photographing apparatus 103 that has received the face image selection result transmitted from the confirmation device 104 selects the face selected in the corresponding queue data in the confirmation wait queue database based on the selection result. Erase face images other than images.

Next, in step S195, the CPU unit 14 releases the occupied state of the waiting queue database for confirmation as an exclusive control.
Next, in step S196, the CPU unit 14 performs an output process (details will be described later) of the selected face image.

  In the above embodiment, three confirmation devices 104 are installed for one photographing device 103. Here, for example, when the photographing apparatus 103 is used and photographing processing + face image selection is performed, the processing cycle of the photographing apparatus 103 becomes long. In particular, in the case of a large-scale ID card issuing system, the number of ID card issuing applicants to be photographed is large, and such an imaging apparatus 103 has a long waiting time.

  Therefore, it is necessary to separately arrange the photographing device 103 and the confirmation device 104 that selects the photographed face image. Further, the selection time of the face image by the subject person is longer than the shooting time in the shooting device 103. From this, if there is one confirmation device 104 for one photographing device 103, the waiting time in the confirmation device 104 becomes a bottleneck, and the overall processing flow becomes worse. Therefore, a plurality of confirmation devices 104 are installed for one photographing device 103 so as to balance the overall processing time.

  FIG. 13 is a flowchart showing details of the output processing in step S196 in FIG. 15, which will be described below. Note that the processing described below is mainly executed under the control of the CPU in the CPU unit 14.

  First, in step S201, output data is generated from the face image selected by the confirmation device 104 and the personal information corresponding thereto, printed on the ID card 105 by the printing device 106, or to the filing device 107. The data conversion corresponding to the registration is performed and transferred to the printing apparatus 106 and the filing apparatus 107.

Next, in step S <b> 202, the printing apparatus 106 prints the print data transferred from the photographing apparatus 103 on the surface of the ID card 105.
Next, in step S <b> 203, the filing device 107 registers the registration data transferred from the photographing device 103.

  As described above, according to the above embodiment, the following operational effects can be expected.

  (1) When a face image to be printed on a certification medium is photographed, when the photographed person confirms the quality of the face image photographed as a prior confirmation before printing on the certification medium, a plurality of images are taken separately from the photographing device. By using the confirmation device provided, it is possible to smoothly perform shooting → printing of the certification medium.

  (2) When taking multiple consecutive shots for the purpose of allowing the subject to select from multiple shot face images, forcibly extend or stop shooting from the subject during the continuous shot. Therefore, unnecessary shooting can be prevented.

  (3) Before the subject confirms and selects the photographed face image, the operator checks in advance whether the face image is suitable as a proof face image. Can be prevented.

  (4) When a shooting process is operated from the subject side during continuous shooting, the operation is facilitated by determining whether the shooting is to be extended or to be stopped according to the length of time the button is pressed.

1 is a block diagram schematically showing a configuration of a certification medium issuing system to which an image photographing system according to an embodiment of the present invention is applied. The block diagram which shows schematically the external appearance structure of an imaging device. FIG. 3 is a block diagram schematically showing an overall configuration of the photographing apparatus shown in FIG. 2. The block diagram which shows the whole structure of the confirmation apparatus shown in FIG. The flowchart for demonstrating the main process of an imaging device. The flowchart for demonstrating the main process of an imaging device. The flowchart for demonstrating the imaging | photography preparation process of an imaging device. Identifying the input image from the camera and the approximate region of the eye relative to the face contour region in the input image, detecting the positions of both eyes from the approximate region, and determining the cutout region of the output image FIG. The flowchart for demonstrating the imaging | photography process of an imaging device. The figure for demonstrating the area | region and coordinate value, and numerical value name which are used at the time of face outline position detection processing. The flowchart for demonstrating a face outline position detection process. The flowchart for demonstrating a head height position detection process. The flowchart for demonstrating the left-right direction face center position detection process. The flowchart for demonstrating an output image generation process. The flowchart for demonstrating the face image selection process by a confirmation apparatus. The schematic diagram which shows the display image of the face image in a confirmation apparatus. The flowchart for demonstrating an output process.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Subject to be photographed (person, card issuing applicant), 101 ... Host computer, 102 ... Personal information database, 103 ... Imaging device, 104 ... Confirmation device, 105 ... ID card (certification medium), 106 ... Printing device, DESCRIPTION OF SYMBOLS 107 ... Filing apparatus 108 ... Network 3 ... Video camera (photographing means) 4,41 ... Display (display means), 6 ... Control stand (control part), 9 ... Shooting stop switch (switch means), 14 ... CPU unit, 17 ... mass storage device (temporary storage means), 45 ... CPU unit.

Claims (7)

A photographing device for photographing at least a face image of the subject and a confirmation device for confirming the face image of the subject photographed by the photographing device;
The imaging device
Photographing means for photographing at least a plurality of face images of the subject;
Temporary storage means for temporarily storing one or more face images selected by the operator from among the plurality of face images photographed by the photographing means;
First transmission means for transmitting one or a plurality of face images stored in the temporary storage means to the confirmation apparatus in response to reception of the captured image access request signal transmitted from the confirmation apparatus. ,
The confirmation device is
Second transmission means for transmitting a photographed image access request signal to the photographing device;
In response to the transmission of the captured image access request signal by the second transmission means, one or more face images transmitted by the first transmission means of the photographing apparatus are received, and the received one or more face images are displayed. Display means to
A selecting means for selecting a predetermined face image from one or a plurality of face images displayed by the display means in response to a selection operation of the subject ;
A third transmission means for transmitting the selection result of the face image by the selection means to the photographing device;
The imaging device further includes:
The selection result of the face image transmitted by the third transmission means of the confirmation device is received, and the selection result is selected from one or a plurality of face images stored in the temporary storage means based on the received selection result. An image photographing system comprising output means for outputting a face image corresponding to the above . A photographing device for photographing at least a face image of the subject and a confirmation device for confirming the face image of the subject photographed by the photographing device;
  The imaging device
  Photographing means for photographing at least a plurality of face images of the subject;
  Temporary storage means for temporarily storing a plurality of face images selected by the operator among the plurality of face images photographed by the photographing means;
  In response to receiving a captured image access request signal transmitted from the confirmation device, a first transmission means for transmitting a plurality of face images stored in the temporary storage means to the confirmation device;
  The confirmation device is
  Second transmission means for transmitting a photographed image access request signal to the photographing device;
  Display means for receiving a plurality of face images transmitted by the first transmission means of the photographing apparatus in response to transmission of the photographed image access request signal by the second transmission means, and displaying the received plurality of face images; ,
  A selection means for selecting a predetermined face image from a plurality of face images displayed by the display means in response to the selection operation of the subject;
  A third transmission means for transmitting the selection result of the face image by the selection means to the photographing device;
  The imaging device further includes:
  The selection result of the face image transmitted by the third transmission unit of the confirmation device is received, and the selection result is selected from the plurality of face images stored in the temporary storage unit based on the received selection result. An image photographing system comprising output means for outputting the face image. The imaging device further includes:
Switch means for giving an instruction to forcibly extend or stop shooting from the side of the subject while photographing the face image of the subject by the photographing device;
3. An image photographing system according to claim 1, further comprising a control means for forcibly extending the photographing for a predetermined time when the switch means is operated or stopping the photographing. 4. The image photographing system according to claim 3 , wherein the control means determines whether the photographing is extended or the photographing is stopped based on a length of time during which the switch means is operated. Personal information acquisition means for acquiring personal information necessary for issuing a person's certification medium, a photographing device for photographing at least a face image of the person, and the person confirms the facial image of the person photographed by the photographing device. A confirmation device and a printing device that prints the face image confirmed by the confirmation device and the personal information acquired by the personal information acquisition means on the surface of the certification medium,
The imaging device
Photographing means for photographing at least a plurality of face images of a person;
Temporary storage means for temporarily storing one or more face images selected by the operator from among the plurality of face images photographed by the photographing means;
First transmission means for transmitting one or a plurality of face images stored in the temporary storage means to the confirmation apparatus in response to reception of the captured image access request signal transmitted from the confirmation apparatus. ,
The confirmation device is
Second transmission means for transmitting a photographed image access request signal to the photographing device;
In response to the transmission of the captured image access request signal by the second transmission means, one or more face images transmitted by the first transmission means of the photographing apparatus are received, and the received one or more face images are displayed. Display means to
A selecting means for selecting a predetermined face image from one or a plurality of face images displayed by the display means in response to a selection operation of the subject ;
A third transmission means for transmitting the selection result of the face image by the selection means to the photographing device;
The imaging device further includes:
The selection result of the face image transmitted by the third transmission means of the confirmation device is received, and the selection result is selected from one or a plurality of face images stored in the temporary storage means based on the received selection result. Output means for outputting a face image corresponding to the above to the printing apparatus. The imaging device further includes:
Switch means for giving an instruction to forcibly extend or stop shooting from the person side while shooting the face image of the person with the shooting device;
6. The certification medium issuing system according to claim 5, further comprising a control means for forcibly extending the photographing for a predetermined time when the switch means is operated or stopping the photographing. 7. The certification medium issuing system according to claim 6 , wherein the control unit determines whether the shooting is extended or the shooting is stopped based on a length of time during which the switch unit is operated.

Images