JP2009199217A - Simultaneous face authentication device for a plurality of persons and entrance control system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To permit entrance of a plurality of persons at a time, and to strictly restrict entrance of an unpermitted person. <P>SOLUTION: A face image of a plurality of entrance applicants is simultaneously imaged by a CCD camera 1E. Face images of all the applicants included in the imaged image are extracted from the image, and each extracted face image (extraction face image) is collated with a previously registered face image (a registration face image) of an entrance permittee. By the collation, it is decided that authentication succeeds only when accordance of all the extraction face images with the registration face images is confirmed. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a multiple-person simultaneous face authentication apparatus that simultaneously authenticates a plurality of persons who want to enter a room and a room-entry management system using the multiple-person simultaneous face authentication apparatus.

  Conventionally, in an entrance management system provided in a building or the like, an individual's physical characteristics, for example, the iris of the face or eyes are read to confirm the identity of the person, and only when the person is a pre-registered admitted person Is allowed to enter. In this room management system, when a plurality of people enter the room at a time, the physical characteristics are read one by one to confirm the identity of the person. There is a problem.

  On the other hand, it is conceivable to allow a plurality of people to enter the room at the same time only by confirming one person. However, if multiple persons are allowed to enter the room at the same time only by confirming one person's identity, there is a possibility that a suspicious person will be mixed into the plurality of persons. Therefore, for example, in the entrance management system disclosed in Patent Document 1, an input means for inputting the number of people entering the room and a counting means for counting the number of people actually entering the room are provided, and after the identity of one person is confirmed, the room is entered. The door is unlocked, and then the entrance door is locked when the number of persons counted by the counting means reaches the number of persons input from the input means.

JP 2001-40963 A Japanese Patent Laid-Open No. 10-134188 JP 2007-164668 A

  However, in the entrance management system disclosed in Patent Document 1 described above, one person is confirmed, but the other person is not confirmed, and only the number of persons entering the room is checked. There is a risk of allowing unintended people to enter the room.

  The present invention has been made to solve such a problem, and the object of the present invention is to strictly limit the entry of unauthorized persons when allowing the entry of a plurality of persons at once. The object is to provide a multiple face recognition device and an entrance management system.

  In order to achieve such an object, the multiple-person simultaneous face authentication device of the present invention includes an image pickup unit that simultaneously picks up face images of a plurality of people who want to enter a room, and an image captured by the image pickup unit. Face image extracting means for extracting the face images of all included members, face image comparing means for comparing each face image extracted by the face image extracting means with a face image of a person permitted to enter the room, and a face image Authentication means for determining that the authentication is successful only when the face image collation means confirms the match with the face image of the person permitted to enter the room for all face images extracted by the extraction means.

  According to the present invention, the face images of a plurality of people who want to enter the room are simultaneously captured, the face images of all members included in the image are extracted from the captured images, and the extracted face images are registered in advance. It is determined that the authentication has succeeded only when all the extracted face images are compared with the face images of the person permitted to enter the room, and the face images of the person permitted to enter the room are confirmed. As a result, it is determined that the authentication is successful only when the extracted face images of all the members match the face image of the person permitted to enter the room, and at least one of the extracted face images of all the members matches the face image of the person permitted to enter the room. If there is something that is not allowed, it is determined that the authentication is unsuccessful, and when allowing a plurality of people to enter the room at one time, it becomes possible to strictly restrict the entry of unauthorized persons.

  In the multiple-person simultaneous face authentication device of the present invention, the face images of all persons included in the image are extracted from the captured image. This face image may be a two-dimensional face image, or a three-dimensional face image. It may be. In the case of a two-dimensional face image, for example, there is a possibility that the face of a person image in a poster pasted on a wall is erroneously extracted as a face image. On the other hand, when a three-dimensional face image is used, only an actual human face having irregularities is extracted, and there is no possibility that the face of the person image in the poster is erroneously extracted as a face image.

  When the face image to be extracted is a three-dimensional face image, as the imaging unit, a first imaging unit that simultaneously images the face images of a plurality of people who want to enter the room from one direction, and a direction different from the first imaging unit Second imaging means for simultaneously capturing the face images of a plurality of people who want to enter the room, and as the face image extracting means, a three-dimensional image is obtained from the image captured by the first imaging means and the image captured by the second imaging means. 3D image creating means for creating an image, and 3D face image for extracting all 3D face images included in the image from the 3D image created by the 3D image creating means as face images of all members An extraction means may be provided.

  The room entrance management system according to the present invention includes the above-described multiple-person simultaneous face authentication device and a control device that unlocks the entrance door only when the multiple-person simultaneous face authentication device determines that the authentication is successful. . According to the present invention, when it is determined that the authentication is successful by the multiple face authentication device, that is, when the face images of all the members extracted from the captured image coincide with the face image of the person permitted to enter, the entrance door is unlocked. Is done.

  In the room entrance management system of the present invention, an actual number detection means for detecting the actual number of persons who want to enter the room located in a predetermined area in front of the entrance door is provided. If the number of face images of all the members extracted from the number does not match the actual number of people who want to enter the room detected by the actual number detection means, it may be determined that the authentication is unsuccessful. In this way, when taking multiple facial images of people who want to enter the room at the same time, for example, if there is a person who hides in the shadow of a person or crouches so that it does not appear on purpose, The number of face images and the actual number of people who wish to enter the room do not match, so even if the face images extracted from the captured images match the face image of the person permitted to enter the room, it is determined that the authentication has been successful. There is no.

  According to the present invention, face images of a plurality of people who want to enter a room are simultaneously picked up, face images of all members included in the picked-up image are extracted, and the extracted face images are registered in advance. Matching with the face image of the person permitted to enter the room, and it was judged that the authentication was successful only when all the extracted face images were confirmed to match the face image of the person permitted to enter the room. Is determined to be successful only if the face image matches the face image of the person permitted to enter the room, and if any one of the extracted face images does not match the face image of the person permitted to enter the room, authentication fails. When it is determined that the entry is successful, it is possible to strictly limit the entry of unauthorized persons when allowing multiple persons to enter the room at the same time.

  Hereinafter, the present invention will be described in detail with reference to the drawings.

[Embodiment 1]
FIG. 1 is a diagram showing a main part of an embodiment (embodiment 1) of an entrance management system using a simultaneous face authentication apparatus for plural persons according to the present invention. In the figure, 1 is a multiple face recognition device, 2 is a control device, 3 is an entrance door, and 4 is an electric lock provided for the entrance door. The multi-person simultaneous face authentication device 1 and the electric lock 3 are connected via the control device 2.

  In this room entry management system, the multiple-person simultaneous face authentication device 1 includes a CPU 1A, a RAM 1B, a ROM 1C, a storage device 1D, a CCD camera 1E, a display device 1F, and interfaces 1G to 1I.

  The CPU 1A operates according to a program stored in the ROM 1C while accessing the RAM 1B. The ROM 1C stores a multiple face authentication program as a program unique to the present embodiment. In addition, a face image of a person who is permitted to enter the room is stored in the storage device 1D. In this example, the number of registered entry permitters is N, and one two-dimensional face image is stored for each of the N entry permitters.

  FIG. 7 shows a functional block diagram of a main part of the multiple-person simultaneous face authentication device 1 in the room entrance management system according to the first embodiment. In this entrance management system, the multiple-person simultaneous face authentication device 1 includes an imaging unit 1-1 including a camera that simultaneously captures face images of a plurality of people who wish to enter the room, and an image captured by the imaging unit 1 A face image extraction unit 1-2 that extracts the face images of all members included in the image, a storage unit 1-3 that stores a two-dimensional face image of a person who has been registered in advance, and a face image extraction unit 1- Face image collation unit 1-4 that collates each face image (extracted face image) extracted by step 2 with the face image (registered face image) of the person permitted to enter the room stored in the storage unit 1-3, and all extraction Only when it is confirmed that the face image matches the registered face image, the authentication is determined to be successful, and when any one of the extracted face images does not match the registered face image, the authentication is unsuccessful. And an authentication unit 1-5 for judging. In this multiple-person simultaneous face authentication device 1, the face image extraction unit 1-2, the face image collation unit 1-4, and the authentication unit 1-5 are realized as processing functions of the CPU 1A.

  Hereinafter, with reference to the flowchart shown in FIG. 2, the processing operation executed by the CPU 1A in accordance with the multiple face authentication program will be described.

  Now, it is assumed that a plurality of people who wish to enter the room stand in front of the CCD camera 1E and perform an operation to the effect that they want to enter the multiple-face simultaneous face authentication device 1. In response to this, the CPU 1A sends an imaging command to the CCD camera 1E, and simultaneously captures the face images of a plurality of people who want to enter the room standing in front of the CCD camera 1E (step S101).

  The CPU 1A captures an image captured by the CCD camera 1E, and extracts the face images of all members included in the image from the captured image (step S102). In this example, for example, using the technique disclosed in Patent Document 2, a two-dimensional face image included in the image is extracted. At this time, the number of extracted two-dimensional face images (hereinafter referred to as extracted face images) is t.

  Next, the CPU 1A sets n = 1 (step S103), and reads the face images (two-dimensional face images (hereinafter referred to as registered face images)) of N room-permitted persons stored in the storage device 1D. (Step S104). Then, after confirming that n> t is not satisfied (NO in step S105), the collation (1: N collation) between the n = 1 extracted face image and the N registered face images is performed (step S106).

  In the collation between the n = 1 extracted face image and the N registered face images, if the collation score exceeds the threshold th (YES in step S107), n of the N registered face images = Assuming that a face image matching the first extracted face image has been confirmed, n = n + 1 = 2 is set (step S108), and the process returns to step S105, where n = 2nd extracted face image and N registered faces The image is collated (step S106).

  In the collation between the n = 2nd extracted face image and the N registered face images, if the collation score exceeds the threshold th (YES in step S107), n of the N registered face images = Assuming that a face image matching the second extracted face image has been confirmed, n = n + 1 = 3 is set (step S108), and the process returns to step S105.

  Here, for example, if the number t of extracted face images is two, n> t (YES in step S105), the CPU 1A confirms that all the extracted face images match the registered face images, and authenticates. And “authentication OK” is displayed on the screen of the display device 1F (step S110). Further, a predetermined signal is transmitted to the control device 2 to notify that the authentication is successful (step S111). Upon receiving the notification of successful authentication, the control device 2 sends an unlocking command to the electric lock 4 and unlocks the entrance door 3.

  In this example, the number t of extracted face images is two. Similarly, when t ≧ 3, if all the extracted face images are confirmed to match the registered face images, it is determined that the authentication is successful. Is done. On the other hand, if any one of the extracted face images does not match the registered face image (NO in step S107), the CPU 1A determines that the authentication is unsuccessful and displays “authentication NG” on the display device 1F. It is displayed on the screen (step S109).

  As described above, in this embodiment, it is determined that the authentication is successful only when all the extracted face images match the registered face image, and even one of the extracted face images does not match the registered face image. In such a case, it is determined that the authentication is unsuccessful, and when allowing a plurality of people to enter the room at one time, it is possible to severely restrict the entry of unauthorized persons.

  In the flowchart shown in FIG. 2, a two-dimensional face image is extracted from the image captured by the CCD camera 1E in step S102. However, a three-dimensional face image is not a two-dimensional face image. You may make it extract. In the case of a two-dimensional face image, for example, there is a possibility that the face of a person image in a poster pasted on a wall is erroneously extracted as a face image. On the other hand, if the face image to be extracted is a three-dimensional face image, only the actual human face with unevenness is extracted, and the face of the person image in the poster may be erroneously extracted as a face image. This disappears.

[Embodiment 2]
FIG. 3 shows a main part of the entrance management system when a three-dimensional face image is extracted as a second embodiment. In the case of extracting a three-dimensional face image, two CCD cameras 1E1 and 1E2 are provided. The CCD camera 1E1 simultaneously captures face images of a plurality of people who want to enter the room from one direction, and the CCD camera 1E2 and the CCD camera 1E1. Takes images of the faces of a plurality of applicants from different directions at the same time.

  Further, in the process according to the simultaneous face authentication program of the CPU 1A, a three-dimensional image is created from an image captured by the CCD camera 1E1 and an image captured by the CCD camera 1E2, for example, using the technique disclosed in Patent Document 3. Then, all the three-dimensional face images included in the created three-dimensional image are extracted as the face images of all members. Further, the storage device 1D stores a three-dimensional face image as a registered face image. In the second embodiment, as in the first embodiment, the authentication success / failure is determined according to the flowchart shown in FIG.

  FIG. 8 shows a functional block diagram of a main part of the multiple-person simultaneous face authentication apparatus 1 in the room entrance management system according to the second embodiment. In this entrance management system, the multiple-person simultaneous face authentication device 1 includes a first imaging unit 1-6 including a camera that simultaneously captures face images of a plurality of people who want to enter the room from one direction, and the first imaging unit 1 The second imaging unit 1-7 including a camera that simultaneously captures face images of a plurality of people who want to enter the room from a direction different from -6, the image captured by the first imaging unit 1-6, and the second imaging unit 1 A three-dimensional image creation unit 1-8 that creates a three-dimensional image from the image captured by -7, and all three included in the image from the three-dimensional image created by the three-dimensional image creation unit 1-8 3D face image extraction unit 1-9 that extracts a 3D face image as a face image of all members, a storage unit 1-10 that stores a 3D face image of a person who has been registered in advance, and a 3D face Each face image (extracted face image) extracted by the image extraction unit 1-9 is stored in the storage unit 1- Authentication is successful only when the face image matching unit 1-11 that matches the face image (registered face image) of the person permitted to be stored stored in 0 and the registered face image for all the extracted face images are confirmed to match. And an authentication unit 1-12 that determines that the authentication is unsuccessful if any one of the extracted face images does not match the registered face image. In this multiple-person simultaneous face authentication device 1, the 3D image creation unit 1-8, the 3D face image extraction unit 1-9, the face image collation unit 1-11, and the authentication unit 1-12 are realized as processing functions of the CPU 1A. The Further, the three-dimensional image creation unit 1-8 and the three-dimensional face image extraction unit 1-9 constitute the face image extraction means referred to in the present invention.

  In the first and second embodiments described above, when simultaneously capturing the face images of a plurality of people who want to enter the room, for example, there is a person who is hidden in the shadow of a person or crouched so as not to be intentionally captured , It may be determined that the authentication is successful. On the other hand, as shown in FIG. 4, the real number detection means 5 for detecting the real number tR of the person who wants to enter the room located in the predetermined area AR1 in front of the entrance door 3 is provided, and a multiple person simultaneous face authentication apparatus 1, the number t of all face images extracted from the captured face image is compared with the actual number tR of the person who wants to enter the room detected by the real number detection means 5, and authentication is performed when the two do not match. If it is determined as unsuccessful, it is possible to prevent the authentication from being determined as successful.

  For example, as the real number detection means 5, a CCD camera is provided on the upper surface of the area AR1. An image of the head of the person who wants to enter the room is extracted from the image captured by the CCD camera, and the actual number tR of persons who wish to enter the room located in the area AR1 is counted from the extracted image of the head. In the multiple-person simultaneous face authentication device 1, in the process according to the multiple-person simultaneous face authentication program of the CPU 1A, for example, as shown in FIG. 5, step S112 is provided between step S105 and step S110, and the number t of extracted face images The actual number tR of the person who wants to enter the room is compared. If the number t of the extracted face images and the actual number tR of the person who wants to enter the room do not match (NO in step S112), it is determined that the authentication is unsuccessful (step S109). . As a result, even if the extracted face images of all coincide with the registered face images, it is not determined that the authentication is successful, and the suspicious person can be prevented from entering the room.

  In FIG. 5, step S112 is provided between step S105 and step S110. However, as shown in FIG. 6, step S112 may be provided between step S102 and step S103. In this way, after the face image is extracted from the image captured by the CCD camera 1E, if the number t of the extracted face images does not match the actual number tR of people who want to enter the room, it is immediately determined that the authentication has failed. Will be.

It is a figure which shows the principal part of 1st Embodiment (Embodiment 1) of the room entrance management system using the simultaneous authentication apparatus for multiple persons according to the present invention. It is a flowchart which shows the processing operation according to the multiple person simultaneous face authentication program which CPU of the multiple person simultaneous face authentication apparatus in this room entrance management system performs. It is a figure which shows the principal part of the entrance management system (Embodiment 2) at the time of making it extract a three-dimensional face image. It is a figure which shows the example which provided the real number detection means which detects the real number of persons who wish to enter the room located in the predetermined area in front of the entrance door. It is a flowchart which shows an example of the processing operation according to the multiple person simultaneous face authentication program which CPU of a multiple person simultaneous face authentication apparatus at the time of providing a real number detection means. It is a flowchart which shows another example of the processing operation according to the multiple person simultaneous face authentication program which CPU of a multiple person simultaneous face authentication apparatus at the time of providing a real number detection means. FIG. 3 is a functional block diagram of a main part of the multiple-person simultaneous face authentication device in the room entrance management system according to the first embodiment. FIG. 10 is a functional block diagram of a main part of a multiple-person simultaneous face authentication device in an entrance management system according to a second embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Multiple-person simultaneous face authentication apparatus, 1A ... CPU, 1B ... ROM, 1C ... RAM, 1D ... Storage device, 1E, 1E1,1E2 ... CCD camera, 1F ... Display device, 1G-1J ... Interface, 2 ... Control device DESCRIPTION OF SYMBOLS 3 ... Entrance door, 4 ... Electric lock, 5 ... Real number detection means, AR1 ... Predetermined area, 1-1 ... Imaging part, 1-2 ... Face image extraction part, 1-3 ... Memory | storage part, 1-4 ... face image matching unit, 1-5 ... authentication unit, 1-6 ... first imaging unit, 1-7 ... second imaging unit, 1-8 ... 3D image creation unit, 1-9 ... 3D face image extraction Unit, 1-10... Storage unit, 1-11... Face image matching unit, 1-12.

Claims (4)

Imaging means for simultaneously capturing facial images of a plurality of people entering the room;
A face image extracting means for extracting all face images included in the image captured by the image capturing means;
Face image collating means for collating each face image extracted by the face image extracting means with a face image of a person allowed to enter the room,
Authentication means for determining that the authentication is successful only when the face image collation means confirms that all face images extracted by the face image extraction means match the face image of the person permitted to enter the room. Multi-person simultaneous face recognition device. In the multiple-person simultaneous face authentication device according to claim 1,
The imaging means includes
First imaging means for simultaneously imaging the face images of the plurality of people who want to enter the room from one direction;
A second imaging unit that simultaneously captures the face images of the plurality of people who want to enter the room from a direction different from the first imaging unit;
The face image extraction means includes
3D image creation means for creating a 3D image from the image captured by the first imaging means and the image captured by the second imaging means;
3D face image extracting means for extracting all 3D face images included in the 3D image created by the 3D image creating means as the face images of all the members. Multiple person face recognition device. A multiple-person simultaneous face authentication device according to claim 1 or 2,
A room entrance management system comprising: a control device that unlocks the entrance door only when it is determined that the authentication is successful by the multiple face authentication device. In the entrance management system according to claim 3,
Real number detection means for detecting the actual number of people who want to enter the room located in a predetermined area in front of the entrance door,
The multiple-person simultaneous face authentication device
A means for determining that the authentication is unsuccessful if the number of face images of all persons extracted by the face image extraction means and the actual number of people who want to enter the room detected by the real number detection means do not match; A special entrance management system.

Images