JP2021140795A - Face authentication method, face authentication system, program and recording medium - Google Patents

Abstract

To provide a face authentication method, face authentication system, program and recording medium having high convenience by utilizing face authentication and allowing a visitor to enter an occupied space even when an owner is absent on the occupied space, and also having high security.SOLUTION: In a face authentication method implemented by a face authentication system 10, upon receiving information relating to a face image of a visitor captured by an imaging device 42 of a locking system 40 installed at an entrance of an occupied space, authentication of a visitor is performed by comparing the information relating to the face image of the visitor captured by the imaging device 42, with information relating to a recorded face image of the visitor, and comparing a time/date when the face image of the visitor is captured by the imaging device 42, with preregistered visit time/date information. When the visitor is authenticated, an unlocking instruction is transmitted to a locking device 44 of the locking system 40 and an unlocking completion notification is transmitted to a user terminal 20 of an owner.SELECTED DRAWING: Figure 1

Description

The present invention relates to face recognition methods, face recognition systems, programs and recording media.

Conventionally, as a face recognition system that authenticates based on face data, a face recognition system that authenticates a person by collating the input input face data with the registered face data registered in advance is known (for example,). See Patent Documents 1 and 2).

In the face recognition system described in Patent Document 1, the target person is authenticated using the image of the face portion in the captured image captured by the camera. Further, in the face recognition system described in Patent Document 2, for example, when four face images are registered, two are used as a face pattern for guaranteeing accuracy, one is used as a face pattern for absorbing disturbance components, and one is used. Is the face pattern for the update target. Then, when a new face pattern is registered, among the four face patterns registered in advance, the face pattern for the update target having the second lowest degree of similarity to the newly registered face pattern is deleted. That is, by leaving the face pattern for absorbing disturbance components having the lowest degree of similarity to the newly registered face pattern, face recognition is performed in accordance with the variation in the environment.

JP-A-2019-197426 Japanese Unexamined Patent Publication No. 2006-72540

When a visitor who is related to the owner who owns the occupied space visits the occupied space, the visitor can enter the occupied space even if the occupied space does not have an owner by performing the face authentication of the visitor. It would be convenient to do so, but in the past such a system did not exist.

The present invention has been made in consideration of such a point, and is highly convenient because a visitor can enter the occupied space even if there is no owner in the occupied space by utilizing face recognition. An object of the present invention is to provide a highly secure face recognition method, face recognition system, program and recording medium.

The face recognition method of the present invention
It is a face recognition method performed by the face recognition system.
When the visitor information is registered in advance before the visitor visits the owner's occupied space for the first time, when the face authentication system accepts the additional registration application information from the owner's user terminal, the registration required information is newly allocated. , The process of the face authentication system transmitting the allocated registration required information to the owner's user terminal, and
When the face recognition system receives the visitor's registration information including the information about the visitor's face image, the face recognition system records the received visitor's registration information in the face recognition system, and the face recognition system owns the registration completion information. The process of sending to the user terminal of the person
After the face recognition system sends the registration completion information to the owner's user terminal, when the visit date and time information regarding the date and time when the visitor visits the occupied space is received, the received visit date and time information is recorded in the face recognition system. When,
When the face recognition system receives information about the visitor's face image captured by the image pickup device of the locking system installed at the entrance of the occupied space, the face recognition system receives the visitor's face imaged by the image pickup device. By comparing the information about the image with the recorded information about the face image of the visitor, and comparing the date and time when the face image of the visitor was captured by the imaging device with the visit date and time information registered in advance. The process of authenticating a visitor and
When the visitor is authenticated in the face recognition system, the face recognition system sends an unlocking command to the locking device of the locking system and an unlocking completion notification to the owner's user terminal.
It has.

The face recognition system of the present invention
When the visitor registers the visitor information in advance before visiting the owner's occupied space for the first time, the additional registration application information receiving means for receiving the additional registration application information from the owner's user terminal, and the additional registration application information receiving means.
A registration information transmitting means for transmitting the newly allocated registration required information to the owner's user terminal by receiving the additional registration application information by the additional registration application information receiving means.
Visitor registration information receiving means that accepts visitor registration information, including information about the visitor's face image,
A face recognition cloud that records visitor registration information received by the visitor registration information reception means, and
When the visitor's registration information is recorded in the face recognition cloud, the registration completion information transmission means for transmitting the registration completion information to the owner's user terminal and the registration completion information transmission means.
When the information on the visitor's face image captured by the image pickup device of the locking system installed at the entrance of the occupied space is received, the information on the visitor's face image captured by the image pickup device and the information on the face recognition cloud are recorded. The visitor is authenticated by comparing the information on the face image of the visitor with the information on the face image of the visitor and comparing the date and time when the face image of the visitor was captured by the imaging device with the visit date and time information registered in advance. Authentication means and
When the visitor is authenticated by the authentication means, the unlocking instruction transmitting means for transmitting the unlocking command to the locking device of the locking system and the unlocking instruction transmitting means.
When the visitor is authenticated by the authentication means, the unlocking completion information transmitting means for transmitting the unlocking completion notification to the owner's user terminal and the unlocking completion information transmitting means.
It has.

The program of the present invention
A program executed by the processor of the face recognition system
When the processor executes the program,
When the visitor information is registered in advance before the visitor visits the owner's occupied space for the first time, when the face authentication system receives the additional registration application information from the owner's user terminal, the registration required information is newly allocated. , The process of the face authentication system transmitting the allocated registration required information to the owner's user terminal, and
When the face recognition system receives the visitor's registration information including the information about the visitor's face image, the face recognition system records the received visitor's registration information in the face recognition system, and the face recognition system owns the registration completion information. The process of sending to the user terminal of the person
After the face recognition system sends the registration completion information to the owner's user terminal, when the visit date and time information regarding the date and time when the visitor visits the occupied space is received, the received visit date and time information is recorded in the face recognition system. When,
When the face recognition system receives information about the visitor's face image captured by the image pickup device of the locking system installed at the entrance of the occupied space, the face recognition system receives the visitor's face imaged by the image pickup device. By comparing the information about the image with the recorded information about the face image of the visitor, and comparing the date and time when the face image of the visitor was captured by the imaging device with the visit date and time information registered in advance. The process of authenticating a visitor and
When the visitor is authenticated in the face recognition system, the face recognition system sends an unlocking command to the locking device of the locking system and an unlocking completion notification to the owner's user terminal.
Is done.

The recording medium of the present invention is
A recording medium on which a program executed by the processor of a face recognition system is recorded.
When the processor executes the program,
When the visitor information is registered in advance before the visitor visits the owner's occupied space for the first time, when the face authentication system accepts the additional registration application information from the owner's user terminal, the registration required information is newly allocated. , The process of the face authentication system transmitting the allocated registration required information to the owner's user terminal, and
When the face recognition system receives the visitor's registration information including the information about the visitor's face image, the face recognition system records the received visitor's registration information in the face recognition system, and the face recognition system owns the registration completion information. The process of sending to the user terminal of the person
After the face recognition system sends the registration completion information to the owner's user terminal, when the visit date and time information regarding the date and time when the visitor visits the occupied space is received, the received visit date and time information is recorded in the face recognition system. When,
When the face recognition system receives information about the visitor's face image captured by the image pickup device of the locking system installed at the entrance of the occupied space, the face recognition system receives the visitor's face imaged by the image pickup device. By comparing the information about the image with the recorded information about the face image of the visitor, and comparing the date and time when the face image of the visitor was captured by the imaging device with the visit date and time information registered in advance. The process of authenticating a visitor and
When the visitor is authenticated in the face recognition system, the face recognition system sends an unlocking command to the locking device of the locking system and an unlocking completion notification to the owner's user terminal.
Is done.

According to the face recognition method, program, recording medium and face recognition system of the present invention, the face recognition can be utilized to enhance convenience because a visitor can enter the occupied space even if there is no owner in the occupied space. And can improve security.

It is a figure which shows schematicly the face recognition system by embodiment of this invention. It is explanatory drawing which shows the exchange of information when the visitor information is registered in advance before the visitor visits the occupied space for the first time in the face recognition system shown in FIG. It is explanatory drawing which shows the exchange of information when a visitor visits the occupied space for the first time in the face recognition system shown in FIG. It is explanatory drawing which shows the exchange of information when a visitor visits the occupied space for the second time and after in the face recognition system shown in FIG.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. 1 to 4 are diagrams showing a face recognition system according to the present embodiment and a face recognition method using such a face recognition system.

The face authentication system 10 and the face authentication method according to the present embodiment are owned by the occupied space by performing face authentication of the visitor when the visitor who is related to the owner who owns the occupied space visits the occupied space. It allows visitors to enter the occupied space without anyone. In the present invention, the occupied space refers to the interior space of a room in a condominium or a detached house. Further, the occupied space may be a rental conference room or a common area of an apartment. Further, the owner may own the occupied space or have the authority to manage the occupied space, and the owner is not limited to the person who lives in the occupied space. For example, the present invention can be applied to a private lodging in which a traveler pays a consideration to the owner of the occupied space to allow the traveler to stay in the occupied space of the owner. That is, in this case, the traveler is the visitor. If the occupied space is a room for rent in the condominium, the owner may be the renter who rents this room.

As shown in FIG. 1, the face recognition system 10 according to the present embodiment has a visitor reception system 12 and a face recognition cloud 14. A locking system 40 is installed at the entrance of the occupied space. For example, when the occupied space is the internal space of the detached house, the locking system 40 is installed near the entrance door on the outer wall of the detached house. If the occupied space is a room or a common area of the condominium, the locking system 40 is installed near the entrance door of each house on the outer wall of the condominium or at the entrance, elevator, etc. where the auto-lock system of the condominium itself is introduced. ing. In addition, the locking system 40 is installed in multiple layers in order to further improve security, for example, the locking system 40 is installed in a plurality of entrances, elevators, and entrance doors of each house in one condominium. May be good. The locking system 40 includes an imaging device 42 and a locking device 44. The image pickup device 42 and the locking device 44 are connected to each other by wiring such as a LAN cable. The image pickup device 42 can capture a face image of a visitor who has visited the space occupied by the owner. Further, the image pickup device 42 is communicably connected to a network such as an Internet line. In addition, the locking device 44 can lock and unlock the entrance door of a detached house or condominium. Further, when the locking device 44 is installed at the entrance where the auto-lock system of the condominium itself is installed, the entrance door at the entrance can be locked and unlocked. Further, when the locking device 44 is installed in the elevator, the elevator may be able to move up and down or stop on a predetermined floor when the locking device 44 unlocks. The visitor reception system 12 is adapted to unlock the entrance door by the locking device 44 by performing authentication using the face image of the visitor captured by the imaging device 42 of the locking system 40. In addition, the face recognition cloud 14 stores visitor registration information including information related to the feature amount of the visitor's face image registered in advance. The face recognition system 10 and the locking system 40 are communicably connected via a network such as an internet line. Further, the user terminal 30 such as a smartphone owned by the visitor and the user terminal 20 such as a smartphone owned by the owner are each communicably connected to the face recognition system 10 via a network such as an Internet line.

The visitor reception system 12 of the face recognition system 10 is composed of, for example, a computer or the like, and the visitor reception system 12 has a processor 12a such as a CPU and a memory 12b (recording medium) for storing a program. .. Then, the processor 12a executes various processes described later by executing the program stored in the memory 12b. The program executed by the processor 12a is not limited to the one stored in the memory 12b. When the processor 12a executes a program transmitted from an external device to the face recognition system 10 or a program stored in a recording medium detachably attached to the face recognition system 10, various processes described later are performed. You may.

Next, the processing contents when the visitor is authenticated by the face recognition system 10 having such a configuration will be described with reference to FIGS. 2 to 4.

First, in the face recognition system 10 according to the present embodiment, the processing content when the visitor information is registered in advance before the visitor visits the occupied space of the owner for the first time will be described with reference to FIG. The owner of the occupied space installs the visitor reception service application on the user terminal 20 in advance. Such an application allows the owner to register a visitor. Specifically, when the date and time when the visitor visits the occupied space is determined between the owner and the visitor by telephone, mail, chat, conversation application, etc., the owner accepts the visitor on his / her user terminal 20. Execute the service application and press the "Additional registration application button". When the "additional registration application button" is pressed by the owner, the additional registration application information is transmitted from the user terminal 20 to the visitor reception system 12 of the face authentication system 10 ((1) in FIG. 2).

The processor 12a of the visitor reception system 12 receives the additional registration application information from the user terminal 20 by the additional registration application information receiving means 50. Then, when the processor 12a of the visitor reception system 12 receives the additional registration application information by the additional registration application information receiving means 50, the registration necessary information is newly allocated, and the allocated registration necessary information is distributed by the registration necessary information transmitting means 52. It is automatically transmitted to the owner's user terminal 20 ((2) in FIG. 2). Here, the registration required information means, for example, a URL for downloading a face recognition application. The registration required information transmitted to the owner's user terminal 20 is displayed in an application of the visitor reception service executed on the owner's user terminal 20 or the like.

The owner transmits the registration required information displayed in the application of the visitor reception service executed on the user terminal 20 to the visitor's user terminal 30 ((3) in FIG. 2). Specifically, the owner copies the registration required information displayed in the visitor reception service application or the like, and sends the copied registration required information to the visitor's user terminal 30 by e-mail, chat, conversation application, or the like. do.

When the visitor receives the registration required information transmitted from the owner's user terminal 20 by the user terminal 30, the visitor installs the face authentication application on the user terminal 30 using the registration required information received by the user terminal 30. For example, when the registration required information is a URL for downloading the face recognition application, the visitor downloads the face recognition application by accessing this URL on the user terminal 20. When such a face recognition application is installed on the user terminal 30, the visitor can input the registration information with the face recognition application. Specifically, it is possible to set to use the visitor reception service by using the face recognition application. When setting the use of the visitor reception service, the visitor inputs his / her name, date of birth, gender, e-mail address, telephone number, password, etc. as registration information by the user terminal 30. Also, when setting the visitor to use the visitor reception service, enter the information that the visitor agrees to the terms of use of the visitor reception service. The setting for using the visitor reception service described above may be set by the face authentication application, or may be performed separately from the face authentication application. In addition, the visitor captures his / her face with the camera of the user terminal 30 by the face recognition application. As a result, the visitor's face image data can be obtained by the user terminal 30.

When the visitor registers the visitor reception service using the user terminal 30, the registration information input by the visitor is transmitted from the user terminal 30 to the face authentication cloud 14 of the face authentication system 10 ((4) in FIG. 2). ). Specifically, the information related to the name, date of birth, gender, e-mail address, telephone number, password, and face image data of the visitor entered by the visitor is transmitted from the user terminal 30 to the face authentication system 10 face authentication. It is transmitted to the cloud 14. The face authentication cloud 14 extracts a hash value by a predetermined hash function based on the face image data transmitted from the user terminal 30. Such a hash value is used as a feature amount of the visitor's face image. In addition, the face recognition cloud 14 assigns visitor identification information (for example, identification number). Then, information such as the visitor's name, date of birth, gender, e-mail address, telephone number, password, and information related to the feature amount of the visitor's face image are associated with the visitor's identification information for face recognition. Recorded in cloud 14.

In addition, the visitor identification information and the information related to the visitor's name assigned by the face recognition cloud 14 are sent to the visitor reception system 12 ((5) in FIG. 2). In the memory 12b of the visitor reception system 12, the name of the visitor is associated with the identification information of the visitor and recorded by the recording means 56. After that, the registration completion information including the information related to the visitor's name is transmitted from the visitor reception system 12 to the owner's user terminal 20 by the registration completion information transmitting means 58 ((6) in FIG. 2). As a result, the owner's user terminal 20 is notified by push of information that the visitor's face registration is completed.

After that, when the owner executes the application of the visitor reception service on the user terminal 20 and taps the visitor's name included in the registration completion information transmitted by the registration completion information transmitting means 58, the visitor occupies the occupied space. Information related to the date and time of the visit can be input by the user terminal 20. Then, when the owner inputs information related to the date and time when the visitor visits the occupied space by the user terminal 20, the visitor's name and the visit date and time information are transmitted from the owner's user terminal 20 to the visitor reception system 12. ((7) in FIG. 2). The processor 12a of the visitor reception system 12 receives the visitor's name and the visit date / time information from the owner's user terminal 20 by the visit date / time information reception means 60. Then, the processor 12a records the visitor's name and the visit date / time information in the memory 12b in association with the visitor's identification information. After that, the processor 12a transmits the registration completion notification information to the visitor's user terminal 30 by the registration completion notification information transmitting means 62 ((8) in FIG. 2). As a result, the visitor's user terminal 30 is pushed to notify the registration completion message and the visit date / time information.

After that, when the visitor executes the visitor reception service application on the user terminal 30 and presses the receipt notification button, the receipt notification information is transmitted from the visitor's user terminal 30 to the processor 12a of the visitor reception system 12 ( (9) of FIG. When the processor 12a receives the receipt notification information, the processor 12a push-notifies the owner's user terminal 20 that the visitor has received the registration completion message ((10) in FIG. 2). In the present embodiment, the owner receives the visitor registration completion notification from the visitor reception system 12 of the face authentication system 10, and then further receives the receipt notification information from the visitor reception system 12, thereby achieving security. Can be improved. More specifically, the face recognition system 10 according to the present invention is required to have strict security because it allows a visitor to enter the occupied space when the owner is absent. That is, it is necessary to prevent a visitor who is not registered by the owner from entering the occupied space by accidentally registering another visitor when the owner registers the visitor. .. Regarding this point, in the present embodiment, the owner not only receives the visitor registration completion notification from the visitor reception system 12 of the face recognition system 10, but also further receives the receipt notification information from the visitor reception system 12. .. As a result, if the owner mistakenly registers another visitor when registering the visitor, the other visitor will notify you that he / she has been notified of the registration that he / she does not remember. Or by receiving receipt notification information about another visitor, the owner will be able to notice the registration error. Further, even if the visitor information input by the owner using the user terminal 20 is hacked by a third party, it is possible to prevent the third party from entering the occupied space when the owner is absent. ..

Next, in the face recognition system 10 according to the present embodiment, the processing content when the visitor visits the occupied space for the first time will be described with reference to FIG. When the visitor reaches the entrance of the occupied space, the visitor taps the face recognition button on the screen of the image pickup device 42 of the locking system 40 provided at this entrance. Then, when the face is held over the image pickup device 42, the face of the visitor is imaged by the camera of the image pickup device 42. It should be noted that the visitor may be able to image the visitor's face by the camera of the image pickup device 42 simply by holding the face over without operating the image pickup device 42. The image pickup device 42 extracts a hash value by a predetermined hash function based on the face image data of the visitor captured by the camera. Such a hash value is used as a feature amount of the visitor's face image.

When the visitor's face is imaged by the camera of the image pickup device 42 as described above, the information related to the feature amount of the visitor's face image is transmitted from the image pickup device 42 to the face recognition cloud 14 of the face recognition system 10. ((1) in FIG. 3). In addition, information on the date and time when the visitor's face image was captured by the imaging device 42 (hereinafter, also referred to as the imaging date and time) is also transmitted from the imaging device 42 to the face authentication cloud 14 of the face authentication system 10.

When the face recognition cloud 14 of the face recognition system 10 receives information related to the feature amount of the visitor's face image from the image pickup device 42, the face recognition cloud 14 receives the feature amount of the visitor's face image received from the image pickup device 42 and the face recognition cloud 14. Compare with the feature amount of the visitor's facial image recorded in. Then, if the feature amount of the visitor's face image received from the image pickup device 42 substantially matches the feature amount of the visitor's face image recorded in the face recognition cloud 14, the name of the visitor and the visitor's name are used. The identification information and the information regarding the imaging date and time are transmitted from the face recognition cloud 14 to the visitor reception system 12 ((2) in FIG. 3). If the feature amount of the visitor's face image received from the image pickup device 42 does not substantially match the feature amount of the visitor's face image recorded in the face authentication cloud 14, no further processing is performed. .. Further, when the feature amount of the visitor's face image does not substantially match the feature amount of the visitor's face image recorded in the face recognition cloud 14 even if the visitor's face image is captured a certain number of times by the image pickup device 42. May be notified to the security company or the like contracted by the owner.

The processor 12a of the visitor reception system 12 includes the visitor's name, the visitor's identification information and the imaging date and time, and the visitor's name and the visitor's identification information recorded in the memory 12b. And compare with the pre-registered visit date and time information. Then, the visitor's name, the visitor's identification information, and the imaging date / time sent from the face authentication cloud 14 substantially match the visitor's name, the visitor's identification information, and the visit date / time information recorded in the memory 12b. In this case, the processor 12a of the visitor reception system 12 authenticates the visitor by the authentication means 64.

When the visitor is authenticated by the authentication means 64, the processor 12a of the visitor reception system 12 transmits the unlock instruction to the lock system 40 by the unlock instruction transmission means 66 ((3) in FIG. 3). When the locking system 40 receives an unlocking instruction from the visitor reception system 12 of the face recognition system 10, the locking device 44 unlocks the entrance door of the occupied space. This allows the visitor to enter the occupied space even if the occupied space does not have an owner. When the visitor is authenticated by the authentication means 64, the processor 12a of the visitor reception system 12 transmits the unlocking completion information to the owner's user terminal 20 by the unlocking completion information transmitting means 68 (FIG. 3). (4)). From this, the owner can know that the entrance door of the occupied space has been unlocked. As another aspect, after the locking device 44 unlocks the entrance door of the occupied space, the unlocking completion information may be transmitted from the locking device 44 to the processor 12a of the visitor reception system 12. In this case, the processor 12a of the visitor reception system 12 receives the unlocking completion information from the locking device 44, and then transmits the unlocking completion information to the owner's user terminal 20 by the unlocking completion information transmitting means 68. In this way, the process when the visitor first visits the occupied space in the face recognition system 10 is completed.

It should be noted that the feature amounts of the visitor's face image substantially match, for example, the feature amount of the visitor's face image received from the image pickup device 42 of the locking system 40 and the visitor's face image recorded in the face recognition cloud 14. This refers to a case where the matching rate with the feature amount of the face image exceeds a predetermined threshold value (for example, 80%). Further, the fact that the image pickup date and time by the image pickup device 42 substantially matches the visit date and time information registered in advance means that the date and time when the visitor's face image is captured by the image pickup device 42 and the memory 12b of the visitor reception system 12 It means that the error from the recorded date and time when the visitor visits the occupied space is within a predetermined time (for example, 3 hours).

Next, in the face recognition system 10 according to the present embodiment, the processing contents when the visitor visits the occupied space from the second time onward will be described with reference to FIG.

When the date and time and the number of people that the visitor visits the occupied space are confirmed by telephone, mail, chat, conversation application, etc. between the owner and the visitor, the owner applies the visitor reception service on his / her user terminal 20. And enter information such as the visitor's name and the date and time when the visitor visits the owner's occupied space.

When the owner inputs information such as the visitor's name and the date and time when the visitor visits the owner's occupied space to the user terminal 20, the entered visitor's name and visit date and time information is input from the user terminal 20. It is transmitted to the visitor reception system 12 of the face recognition system 10 ((1) in FIG. 4). The processor 12a of the visitor reception system 12 receives the visitor's name and the visit date / time information from the user terminal 20 by the visit date / time information reception means 60. The processor 12a records the visitor's name and the visit date / time information in the memory 12b in association with the visitor's identification information. Then, the processor 12a of the visitor reception system 12 transmits the registration completion notification information to the visitor's user terminal 30 by the registration completion notification information transmitting means 62 ((2) in FIG. 4). As a result, the visitor's user terminal 30 is pushed to notify the registration completion message and the visit date / time information.

After that, when the visitor executes the visitor reception service application on the user terminal 30 and presses the receipt notification button, the receipt notification information is transmitted from the visitor's user terminal 30 to the processor 12a of the visitor reception system 12 ( (3) of FIG. When the processor 12a receives the receipt notification information, the processor 12a push-notifies the owner's user terminal 20 that the visitor has received the registration completion message ((4) in FIG. 4). Even if the visitor visits the owner area from the second time onward, the owner receives a notification that the registration completion notification information has been received from the visitor reception system 12 when the visitor presses the receipt notification button. Therefore, the security property can be improved.

After that, when the visitor reaches the entrance of the occupied space, the visitor taps the face recognition button on the screen of the image pickup device 42 of the locking system 40 provided at this entrance. Then, when the face is held over the image pickup device 42, the face of the visitor is imaged by the camera of the image pickup device 42. It should be noted that the visitor may be able to image the visitor's face by the camera of the image pickup device 42 simply by holding the face over without operating the image pickup device 42. The image pickup device 42 extracts a hash value by a predetermined hash function based on the face image data of the visitor captured by the camera. Such a hash value is used as a feature amount of the visitor's face image.

When the visitor's face is imaged by the camera of the image pickup device 42 as described above, the information related to the feature amount of the visitor's face image is transmitted from the image pickup device 42 to the face recognition cloud 14 of the face recognition system 10. ((5) in FIG. 4). Information on the imaging date and time is also transmitted from the imaging device 42 to the face authentication cloud 14 of the face authentication system 10.

When the face recognition cloud 14 of the face recognition system 10 receives information related to the feature amount of the visitor's face image from the image pickup device 42, the face recognition cloud 14 receives the feature amount of the visitor's face image received from the image pickup device 42 and the face recognition cloud 14. Compare with the feature amount of the visitor's facial image recorded in. Then, if the feature amount of the visitor's face image received from the image pickup device 42 substantially matches the feature amount of the visitor's face image recorded in the face recognition cloud 14, the name of the visitor and the visitor's name are used. The identification information and the information regarding the imaging date and time are transmitted from the face recognition cloud 14 to the visitor reception system 12 ((6) in FIG. 4). If the feature amount of the visitor's face image received from the image pickup device 42 does not substantially match the feature amount of the visitor's face image recorded in the face authentication cloud 14, no further processing is performed. ..

The processor 12a of the visitor reception system 12 includes the visitor's name, the visitor's identification information and the imaging date and time, and the visitor's name and the visitor's identification information recorded in the memory 12b. And compare with the pre-registered visit date and time information. Then, the visitor's name, the visitor's identification information, and the imaging date / time sent from the face authentication cloud 14 substantially match the visitor's name, the visitor's identification information, and the visit date / time information recorded in the memory 12b. In this case, the processor 12a of the visitor reception system 12 authenticates the visitor by the authentication means 64.

When the visitor is authenticated by the authentication means 64, the processor 12a of the visitor reception system 12 transmits the unlock instruction to the lock system 40 by the unlock instruction transmission means 66 ((7) in FIG. 4). When the locking system 40 receives an unlocking instruction from the visitor reception system 12 of the face recognition system 10, the locking device 44 unlocks the entrance door of the occupied space. This allows the visitor to enter the occupied space even if the occupied space does not have an owner. When the visitor is authenticated by the authentication means 64, the processor 12a of the visitor reception system 12 transmits the unlocking completion information to the owner's user terminal 20 by the unlocking completion information transmitting means 68 (FIG. 4). (8)). From this, the owner can know that the entrance door of the occupied space has been unlocked. As another aspect, after the locking device 44 unlocks the entrance door of the occupied space, the unlocking completion information may be transmitted from the locking device 44 to the processor 12a of the visitor reception system 12. In this case, the processor 12a of the visitor reception system 12 receives the unlocking completion information from the locking device 44, and then transmits the unlocking completion information to the owner's user terminal 20 by the unlocking completion information transmitting means 68. In this way, in the face recognition system 10, the process when the visitor visits the occupied space from the second time onward is completed.

According to the face recognition method performed by the face recognition system 10 according to the present embodiment having the above configuration, the visitor information is registered in advance before the visitor visits the owner's occupied space for the first time. When the face recognition system 10 receives the additional registration application information from the owner's user terminal 20, the face recognition system 10 newly allocates the registration required information, and the face recognition system 10 assigns the assigned registration required information to the owner's user terminal 20. Send to. When the face recognition system 10 receives the visitor registration information including the information about the visitor's face image, the face recognition system 10 records the received visitor registration information in the face recognition system 10 and the face recognition system 10 records the registration completion information. Is transmitted to the owner's user terminal 20. Further, when the face authentication system 10 receives the visit date / time information regarding the date and time when the visitor visits the occupied space after transmitting the registration completion information to the owner's user terminal 20, the received visit date / time information is transmitted to the face authentication system 10. Record. Further, when the face recognition system 10 receives information on the face image of the visitor captured by the image pickup device 42 of the locking system 40 installed at the entrance of the occupied space, the face recognition system 10 is imaged by the image pickup device 42. The information on the visitor's face image is compared with the recorded information on the visitor's face image, and the date and time when the visitor's face image is captured by the imaging device 42 and the pre-registered visit date and time information are compared. Authenticate visitors by comparing. Then, when the visitor is authenticated by the face recognition system 10, the face recognition system 10 transmits an unlocking command to the locking device 44 of the locking system 40 and an unlocking completion notification to the owner's user terminal 20. .. According to such a face recognition method, when the visitor reaches the occupied space of the owner by utilizing the face recognition, the entrance door is unlocked by the locking device 44 even if there is no owner in the occupied space. Visitors can enter the occupied space. Therefore, convenience can be improved. Further, when the visitor is authenticated, the unlocking completion notification is transmitted to the owner's user terminal 20, so that the owner can know that the visitor has entered the occupied space. Therefore, security can be improved. Further, when the face authentication system 10 accepts the visitor's registration information including the information about the visitor's face image and the accepted visitor's registration information is recorded in the face authentication system 10, the registration completion information is the owner's. Since it is transmitted to the user terminal 20, the owner can know that the visitor has registered the information. Therefore, the security can be further improved.

Further, according to the face recognition method according to the present embodiment, when the visitor registers the visitor information in advance before visiting the owner's occupied space for the first time, the face recognition system 10 owns the registration completion information. When the face authentication system 10 receives the visit date and time information after transmitting the information to the user terminal 20 of the person, the face authentication system 10 transmits the registration completion notification information to the user terminal 30 of the visitor. In this case, by transmitting the registration completion notification information to the visitor's user terminal 30, the visitor can surely recognize that the visit to the occupied space of the owner has been reserved.

Further, according to the face authentication method according to the present embodiment, the registration required information transmitted to the owner's user terminal 20 by the face authentication system 10 is the information necessary for downloading the face authentication application, and the face authentication application. The visitor's registration information including the information about the visitor's face image is sent to the face recognition system 10. In this case, the visitor downloads the face recognition application to the user terminal 30 according to the information necessary for downloading the face recognition application given by the owner, and thereby uses the face recognition application to relate the visitor's face image. The visitor registration information including the information can be transmitted to the face recognition system 10.

Further, according to the face recognition method according to the present embodiment, when the visitor visits the owner's occupied space from the second time onward, the face recognition system 10 accepts at least the visitor's name and the visit date / time information. , The face recognition system 10 transmits the registration completion notification information to the visitor's user terminal 30. In this case, when the visitor visits the occupied space of the owner from the second time onward, the owner can reserve a visit to the occupied space of the visitor by a simple method.

Further, in the face authentication system 10 according to the present embodiment, when the visitor information is registered in advance before the visitor visits the occupied space of the owner for the first time, the additional registration application information is added from the user terminal 20 of the owner. The registration required information receiving means 50 that accepts the additional registration application information, and the registration required information transmitting means 52 that transmits the newly allocated registration required information to the owner's user terminal 20 by receiving the additional registration application information by the face authentication system 10. A visitor registration information receiving means 54 that receives visitor registration information including information on a visitor's face image, a face authentication cloud 14 that records visitor registration information received by the visitor registration information receiving means 54, and a visit. When the person's registration information is recorded in the face authentication cloud 14, the registration completion information transmitting means 58 for transmitting the registration completion information to the owner's user terminal 20 and the imaging device of the locking system 40 installed at the entrance of the occupied space. When the information on the visitor's face image captured by 42 is received, the information on the visitor's face image captured by the image pickup device 42 is compared with the information on the visitor's face image recorded in the face authentication cloud 14. At the same time, the authentication means 64 that authenticates the visitor by comparing the date and time when the visitor's face image was captured by the image pickup device 42 with the visit date and time information registered in advance, and the authentication means 64 of the visitor. When the authentication is performed, the unlocking instruction transmitting means 66 that transmits the unlocking command to the locking device 44 of the locking system 40 and the authentication means 64 are used to authenticate the visitor, and the owner user is notified of the unlocking completion. It is provided with an unlocking completion information transmitting means 68 to be transmitted to the terminal 20. According to such a face recognition system 10, when a visitor reaches the occupied space of the owner by utilizing the face recognition, the entrance door is unlocked by the locking device 44 even if there is no owner in the occupied space. Therefore, visitors can enter the occupied space. Therefore, convenience can be improved. Further, when the visitor is authenticated, the unlocking completion notification is transmitted to the owner's user terminal 20, so that the owner can know that the visitor has entered the occupied space. Therefore, security can be improved. Further, when the face authentication system 10 accepts the visitor's registration information including the information about the visitor's face image and the accepted visitor's registration information is recorded in the face authentication system 10, the registration completion information is the owner's. Since it is transmitted to the user terminal 20, the owner can know that the visitor has registered the information. Therefore, the security can be further improved.

Further, in the present embodiment, a program executed by the processor 12a for performing the face authentication method by the face authentication system 10 and a recording medium on which this program is recorded are used. Here, when the processor 12a executes the program, when the visitor information is registered in advance before the visitor visits the occupied space of the owner for the first time, the additional registration application information is input from the user terminal 20 of the owner. When the face authentication system 10 receives the information, the registration required information is newly allocated, and the face authentication system 10 transmits the allocated registration required information to the owner's user terminal 20. When the face recognition system 10 receives the visitor registration information including the information about the visitor's face image, the face recognition system 10 records the received visitor registration information in the face recognition system 10 and the face recognition system 10 records the registration completion information. Is transmitted to the owner's user terminal 20. Further, when the face authentication system 10 receives the visit date / time information regarding the date and time when the visitor visits the occupied space after transmitting the registration completion information to the owner's user terminal 20, the received visit date / time information is transmitted to the face authentication system 10. Record. Further, when the face recognition system 10 receives information on the face image of the visitor captured by the image pickup device 42 of the locking system 40 installed at the entrance of the occupied space, the face recognition system 10 is imaged by the image pickup device 42. The information on the visitor's face image is compared with the recorded information on the visitor's face image, and the date and time when the visitor's face image is captured by the imaging device 42 and the pre-registered visit date and time information are compared. Authenticate visitors by comparing. Then, when the visitor is authenticated by the face recognition system 10, the face recognition system 10 transmits an unlocking command to the locking device 44 of the locking system 40 and an unlocking completion notification to the owner's user terminal 20. .. According to such a program and recording medium, when the visitor reaches the occupied space of the owner by utilizing face authentication, the entrance door is unlocked by the locking device 44 even if the occupied space is not the owner. Therefore, visitors can enter the occupied space. Therefore, convenience can be improved. Further, when the visitor is authenticated, the unlocking completion notification is transmitted to the owner's user terminal 20, so that the owner can know that the visitor has entered the occupied space. Therefore, security can be improved. Further, when the face authentication system 10 accepts the visitor's registration information including the information about the visitor's face image and the accepted visitor's registration information is recorded in the face authentication system 10, the registration completion information is the owner's. Since it is transmitted to the user terminal 20, the owner can know that the visitor has registered the information. Therefore, the security can be further improved.

The face recognition method and face recognition system according to the present invention are not limited to the above-described aspects, and various changes can be made.

For example, in the above description, the image pickup device 42 of the locking system 40 extracts a hash value by a predetermined hash function based on the face image data of the visitor imaged by the camera, and the visitor uses such a hash value. It is used as a feature amount of the face image of. Then, the feature amount of the visitor's face image is transmitted from the image pickup device 42 to the face authentication cloud 14 of the face authentication system 10. However, in another aspect, the face image data of the visitor captured by the image pickup device 42 may be directly transmitted from the image pickup device 42 to the face recognition cloud 14 of the face recognition system 10. In this case, the face recognition cloud 14 extracts a hash value by a predetermined hash function based on the visitor's face image data transmitted from the image pickup device 42, and uses such a hash value as the visitor's face image. Used as a feature quantity.

As another aspect, the face authentication application used in the visitor's user terminal 30 transmits the visitor's face image data itself captured by the camera of the user terminal 30 to the face authentication cloud 14 of the face authentication system 10. Instead, based on the visitor's face image data captured by the camera of the user terminal 30, the hash value is extracted as a feature amount by a predetermined hash function, and the extracted feature amount of the visitor's face image is used as the face. It may be transmitted to the face recognition cloud 14 of the authentication system 10. In this case, when the face authentication cloud 14 receives the registration information including the feature amount of the visitor's face image from the user terminal 30, the face authentication cloud 14 assigns the visitor's identification information (for example, the identification number). Then, information such as the visitor's name, date of birth, gender, email address, telephone number, password, and information related to the feature amount of the visitor's face image are associated with the visitor's identification information to the face recognition cloud. Recorded at 14.

As yet another aspect, when the face image data of the visitor imaged by the image pickup device 42 of the locking system 40 is directly transmitted from the image pickup device 42 to the face recognition cloud 14, the face recognition cloud 14 is used as the image pickup device. The visitor's face image data transmitted from 42 may be compared with the visitor's face image data recorded in the face recognition cloud 14. In this case, if the face image data of the visitor received from the image pickup device 42 substantially matches the face image data of the visitor recorded in the face recognition cloud 14, the face recognition cloud 14 of the visitor Information regarding the name, visitor identification information, and imaging date / time is transmitted from the face recognition cloud 14 to the visitor reception system 12.

10 Face recognition system 12 Visitor reception system 12a Processor 12b Memory 14 Face recognition cloud 20 User terminal of the owner of the occupied space 30 Visitor user terminal 40 Locking system 42 Imaging device 44 Locking device 50 Additional registration application information reception means 52 Registration Necessary information transmitting means 54 Visitor registration information receiving means 56 Recording means 58 Registration completion information transmitting means 60 Visit date and time information receiving means 62 Registration completion notification information transmitting means 64 Authentication means 66 Unlocking instruction transmitting means 68 Unlocking completion information transmitting means

Claims (9)

It is a face recognition method performed by the face recognition system.
When the visitor information is registered in advance before the visitor visits the owner's occupied space for the first time, when the face authentication system receives the additional registration application information from the owner's user terminal, the registration required information is newly allocated. , The process of the face authentication system transmitting the allocated registration required information to the owner's user terminal, and
When the face recognition system receives the visitor's registration information including the information about the visitor's face image, the face recognition system records the received visitor's registration information in the face recognition system, and the face recognition system owns the registration completion information. The process of sending to the user terminal of the person
After the face recognition system sends the registration completion information to the owner's user terminal, when the visit date and time information regarding the date and time when the visitor visits the occupied space is received, the received visit date and time information is recorded in the face recognition system. When,
When the face recognition system receives information about the visitor's face image captured by the image pickup device of the locking system installed at the entrance of the occupied space, the face recognition system receives the visitor's face imaged by the image pickup device. By comparing the information about the image with the recorded information about the face image of the visitor, and comparing the date and time when the face image of the visitor was captured by the imaging device with the visit date and time information registered in advance. The process of authenticating a visitor and
When the visitor is authenticated in the face recognition system, the face recognition system sends an unlocking command to the locking device of the locking system and an unlocking completion notification to the owner's user terminal.
Face recognition method with. When the visitor information is registered in advance before the visitor visits the owner's occupied space for the first time, the face authentication system sends the registration completion information to the owner's user terminal, and then the visit date and time information is sent to the face. The face authentication method according to claim 1, wherein when the authentication system accepts the information, the face authentication system transmits registration completion notification information to the visitor's user terminal. The registration required information transmitted to the owner's user terminal by the face recognition system is information necessary for downloading the face recognition application, and the visitor registration information including information on the visitor's face image by the face recognition application is included. The face recognition method according to claim 1 or 2, which is sent to the face recognition system. When the visitor visits the owner's occupied space from the second time onward, when the face recognition system accepts at least the visitor's name and visit date / time information, the face recognition system notifies the visitor's user terminal of the completion of registration. The face recognition method according to any one of claims 1 to 3, wherein the information is transmitted. When the visitor registers the visitor information in advance before visiting the owner's occupied space for the first time, the additional registration application information receiving means for receiving the additional registration application information from the owner's user terminal, and the additional registration application information receiving means.
A registration information transmitting means for transmitting the newly allocated registration required information to the owner's user terminal by receiving the additional registration application information by the additional registration application information receiving means.
Visitor registration information receiving means that accepts visitor registration information, including information about the visitor's face image,
A face recognition cloud that records visitor registration information received by the visitor registration information reception means, and
When the visitor's registration information is recorded in the face recognition cloud, the registration completion information transmission means for transmitting the registration completion information to the owner's user terminal and the registration completion information transmission means.
When the information on the visitor's face image captured by the image pickup device of the locking system installed at the entrance of the occupied space is received, the information on the visitor's face image captured by the image pickup device and the information on the face recognition cloud are recorded. The visitor is authenticated by comparing the information on the face image of the visitor with the information on the face image of the visitor and comparing the date and time when the face image of the visitor was captured by the imaging device with the visit date and time information registered in advance. Authentication means and
When the visitor is authenticated by the authentication means, the unlocking instruction transmitting means for transmitting the unlocking command to the locking device of the locking system and the unlocking instruction transmitting means.
When the visitor is authenticated by the authentication means, the unlocking completion information transmitting means for transmitting the unlocking completion notification to the owner's user terminal and the unlocking completion information transmitting means.
Face recognition system with. When the visitor information is registered in advance before the visitor visits the occupied space of the owner for the first time, the visit date and time information is input after the registration completion information transmitting means sends the registration completion information to the owner's user terminal. Visit date and time information to be accepted
When the visit date / time information is received by the visit date / time information receiving means, the registration completion notification information transmitting means for transmitting the registration completion notification information to the visitor's user terminal and the registration completion notification information transmitting means.
The face recognition system according to claim 5, further comprising. When the visitor visits the occupied space of the owner from the second time onward, if at least the visitor's name and the visit date / time information are received by the visit date / time information receiving means, the registration completion notification information transmitting means is the visitor's user. The face recognition system according to claim 6, which sends registration completion notification information to a terminal. A program executed by the processor of the face recognition system
When the processor executes the program,
When the visitor information is registered in advance before the visitor visits the owner's occupied space for the first time, when the face authentication system receives the additional registration application information from the owner's user terminal, the registration required information is newly allocated. , The process of the face authentication system transmitting the allocated registration required information to the owner's user terminal, and
When the face recognition system receives the visitor's registration information including the information about the visitor's face image, the face recognition system records the received visitor's registration information in the face recognition system, and the face recognition system owns the registration completion information. The process of sending to the user terminal of the person
After the face recognition system sends the registration completion information to the owner's user terminal, when the visit date and time information regarding the date and time when the visitor visits the occupied space is received, the received visit date and time information is recorded in the face recognition system. When,
When the face recognition system receives information about the visitor's face image captured by the image pickup device of the locking system installed at the entrance of the occupied space, the face recognition system receives the visitor's face imaged by the image pickup device. By comparing the information about the image with the recorded information about the face image of the visitor, and comparing the date and time when the face image of the visitor was captured by the imaging device with the visit date and time information registered in advance. The process of authenticating a visitor and
When the visitor is authenticated in the face recognition system, the face recognition system sends an unlocking command to the locking device of the locking system and an unlocking completion notification to the owner's user terminal.
Is done, the program. A recording medium on which a program executed by the processor of a face recognition system is recorded.
When the processor executes the program,
When the visitor information is registered in advance before the visitor visits the owner's occupied space for the first time, when the face authentication system receives the additional registration application information from the owner's user terminal, the registration required information is newly allocated. , The process of the face authentication system transmitting the allocated registration required information to the owner's user terminal, and
When the face recognition system receives the visitor's registration information including the information about the visitor's face image, the face recognition system records the received visitor's registration information in the face recognition system, and the face recognition system owns the registration completion information. The process of sending to the user terminal of the person
After the face recognition system sends the registration completion information to the owner's user terminal, when the visit date and time information regarding the date and time when the visitor visits the occupied space is received, the received visit date and time information is recorded in the face recognition system. When,
When the face recognition system receives information about the visitor's face image captured by the image pickup device of the locking system installed at the entrance of the occupied space, the face recognition system receives the visitor's face imaged by the image pickup device. By comparing the information about the image with the recorded information about the face image of the visitor, and comparing the date and time when the face image of the visitor was captured by the imaging device with the visit date and time information registered in advance. The process of authenticating a visitor and
When the visitor is authenticated in the face recognition system, the face recognition system sends an unlocking command to the locking device of the locking system and an unlocking completion notification to the owner's user terminal.
Recording medium.

Images