JP2019137972A - Information processing unit - Google Patents

Abstract

To provide an information processing unit which can change quickly and easily, and promotes further improvement of security.SOLUTION: An information processing unit of this invention comprises: user authentication information acquisition means which obtains user authentication information; object feature amount acquisition means which obtains object feature amount extracted from an object photograph image; storage processing means which stores in a storage device the user authentication information and the object feature amount in association with each other; and judgement means which performs judgement processing for judging whether or not newly obtained information coincides with the user authentication information and the object feature amount stored in the storage device in association with each other.SELECTED DRAWING: Figure 11

Description

  The present invention relates to an information processing apparatus, an information processing system, a program, and an information processing method.

  Locking management using keys and locks requires robustness that is difficult to duplicate and disguise. In particular, when an electronic key is leaked, it takes time to be detected. Therefore, in order to reduce the risk as much as possible, it is desirable that the administrator can change the key quickly and easily.

  However, it is difficult for a user to set a uniform strong password in a key authentication method represented by a general password. For this reason, the problem that security is low arises. On the other hand, with a security card, when skimming or duplication occurs, troubles such as rewriting or reissuing an IC (Integrated Circuit) card occur. For this reason, there is a problem that the key cannot be changed quickly and easily when necessary, and security is still low. Furthermore, there is a remote lock management method using a smartphone and a public key, but there is a risk that the smartphone may be lost or the public key is leaked, and security is still low.

  Here, in order to further increase the security in the lock management, a system that requires authentication of a plurality of keys is also considered. For example, in the technique of Patent Document 1, authentication is performed using biometric information such as a user's face image while performing authentication using an IC card.

JP 2017-0911129 A

  However, although the technology of Patent Document 1 uses two authentication methods and security is increased, two authentication objects must be registered in advance, and the key can be changed quickly and easily. difficult. For this reason, the problem that the further improvement of security cannot be aimed at arises. Further, such a problem can occur not only in lock management but also in all authentication situations.

  Therefore, an object of the present invention is to provide an information processing apparatus, an information processing system, a program, and an information processing method that can be changed quickly and easily and can further improve security.

An information processing apparatus according to one aspect of the present invention
User authentication information acquisition means for acquiring user authentication information;
Object feature amount acquisition means for acquiring an object feature amount extracted from an object photographed image;
Storage processing means for associating the user authentication information with the object feature quantity and storing them in a storage device;
A determination unit that performs a determination process as to whether or not newly acquired information matches the associated user authentication information stored in the storage device and the object feature amount;
With
The configuration is as follows.

An information processing system according to another embodiment of the present invention
An input means for inputting user authentication information;
An imaging means for imaging an object photographed image;
User authentication information acquisition means for acquiring the user authentication information input from the input means;
Object feature quantity acquisition means for acquiring an object feature quantity extracted from the object photographed image captured by the imaging means;
Storage processing means for associating the user authentication information with the object feature quantity and storing them in a storage device;
A determination unit that performs a determination process as to whether or not newly acquired information matches the associated user authentication information stored in the storage device and the object feature amount;
With
The configuration is as follows.

In addition, an information processing method according to another aspect of the present invention includes
Get user authentication information,
Get the object features extracted from the object image,
Storing the user authentication information and the object feature amount in association with each other in a storage device;
A process of determining whether or not newly input information matches the associated user authentication information stored in the storage device and the object feature amount,
The configuration is as follows.

Moreover, the program which is the other form of this invention is:
In the information processing device,
User authentication information acquisition means for acquiring user authentication information;
Object feature amount acquisition means for acquiring an object feature amount extracted from an object photographed image;
Storage processing means for associating the user authentication information with the object feature quantity and storing them in a storage device;
A determination unit that performs a determination process as to whether or not newly acquired information matches the associated user authentication information stored in the storage device and the object feature amount;
To realize,
The configuration is as follows.

  By being configured as described above, the present invention can provide an information processing apparatus, an information processing system, and an information processing method that can be changed quickly and easily and can improve security.

It is the schematic which shows the structure of the security system in Embodiment 1 of this invention. It is a block diagram which shows the structure of the locking management server disclosed in FIG. It is a flowchart which shows the processing operation of the locking management system disclosed in FIG. It is a flowchart which shows the processing operation of the locking management system disclosed in FIG. It is the schematic which shows the structure of the security system in Embodiment 2 of this invention. It is the schematic which shows the structure of the security system in Embodiment 3 of this invention. It is a block diagram which shows the structure of the locking management server disclosed in FIG. It is a flowchart which shows the processing operation of the locking management system disclosed in FIG. It is a flowchart which shows the processing operation of the locking management system disclosed in FIG. It is a flowchart which shows the processing operation of the locking management system disclosed in FIG. It is a block diagram which shows the structure of the information processing apparatus in Embodiment 4 of this invention. It is a block diagram which shows the structure of the information processing system in Embodiment 4 of this invention.

<Embodiment 1>
A first embodiment of the present invention will be described with reference to FIGS. 1 and 2 are diagrams showing the configuration of the security system. 3 to 4 are diagrams for explaining the processing operation of the security system.

[Constitution]
The security system according to the present invention is an information processing system for locking and unlocking a door of a room set at a high security level in a company and a door of a front door of a home. Specifically, as shown in FIG. 1, the security system according to the present invention includes a lock management server 10, a lock device L that locks and unlocks a predetermined door D, a user U, and an object O owned by the user U. A first camera 21 and a second camera 22 for capturing the image. Then, the user U locks / unlocks the lock device L of the door D while holding the object O. Each configuration will be specifically described below.

  The lock device L is attached to the door D and includes a mechanism for locking and unlocking the door D. The lock device L is connected to the lock management server 10 via a network, and is configured to perform locking / unlocking according to a control signal instructing locking / unlocking from the locking management server 10. Yes.

  In the present embodiment, the first camera 21 and the second camera 22 are outside the door D and are installed near the door D. In particular, the first camera 21 (input means) is installed so as to be able to capture the face image of the user U standing in front of the door D. The second camera 22 (imaging means) is installed so that the user U standing in front of the outside of the door D can take an image of the surface of the object O possessed by the hand. The first camera 21 and the second camera 22 are connected to the locking management server 10 via a network, and in response to an imaging command from the locking management server 10, the face image of the user U and the object image of the object O ( The object photographing image) is captured, and the image is transmitted to the lock management server 10.

  Here, the object O possessed by the user U is, for example, a wristwatch, clothing, a wallet, a mobile phone, or the like that the user U always wears, but may be any object.

  Note that the installation positions of the first camera 21 and the second camera 22 are not necessarily limited to the positions described above, and may be installed at positions where at least the face image of the user U and the object image of the object O can be captured. That's fine. Further, the first camera and the second camera may be configured by one camera, and it is only necessary that the face of the user U and the object O can be captured by such one camera.

  The lock management server 10 is a server device (information processing device) having an arithmetic device and a storage device. Then, as shown in FIG. 2, the lock management server 10 includes a user information processing unit 11, an object information processing unit 12, a lock processing unit 13, and an unlock processing unit 14 that are constructed by executing a program by the arithmetic device. It is equipped with. The locking management server 10 includes a user information storage unit 16, an object information storage unit 17, and a locking information storage unit 18 formed in a storage device.

  The user information processing unit 11 (user authentication information acquisition means) acquires a face feature value extracted from the user U's face image or face image in advance as user authentication information of the user U, and a user information storage unit 16 is stored and registered. At this time, the user information processing unit 11 may receive the face image of the user U taken by the first camera 21 and extract and register the face feature amount from the face image. The face image or face feature amount of the user U acquired from the information processing apparatus may be registered.

  Further, when the user information processing unit 11 receives a request for locking the door D from the user U, the user information processing unit 11 sends an imaging command to the first camera 21, and the user photographed by the first camera 21 according to the imaging command. U's image is acquired. Then, the user information processing unit 11 extracts a face image of the user U from the acquired image of the user U, and extracts a face feature amount as user authentication information of the user U from the face image. Further, the user information processing unit 11 authenticates whether or not the extracted face feature value matches the face feature value registered in the user information storage unit 16 in advance. As a result of authentication, the object information processing unit 12 and the lock processing unit 13 are notified that the authentication is successful if they match, and that the authentication fails if they do not match. The locking request from the user U is input to the user information processing unit 11 when the user U operates an operation device (such as an operation panel) installed near the lock device L of the door D, for example.

  Here, the authentication processing of the facial feature amount by the user information processing unit 11 is performed as follows, for example. First, an authentication score such as the similarity between the extracted feature quantity and the face feature quantity stored in advance in the user information storage unit 16 is calculated, and it is determined whether or not the authentication score is higher than a threshold value. If the authentication score is higher than the threshold value, it is determined that the authentication is successful. However, the authentication process may be performed by any method.

  Upon receiving a request for locking the door D from the user U, the object information processing unit 12 (object feature amount acquisition unit) sends an imaging command to the second camera 22, and the second camera 22 according to the imaging command. The image of the object O possessed by the user U photographed at is acquired. When the object information processing unit 12 receives a notification of successful authentication of the facial feature amount of the user U from the user information processing unit 11, the object information processing unit 12 forms an object formed on the surface of the object O from the acquired object image. An object pattern (object feature amount) that is a unique feature amount is extracted and acquired. Further, the object information processing unit 12 stores and registers the extracted object pattern in the object information storage unit 17, and notifies the lock processing unit 13 to that effect.

  As described above, when the user U requests locking, the first camera 21 captures the face image of the user U, and at the same time, the second camera 22 captures the object image of the object O. Then, the user information processing unit 11 acquires a face feature amount as user authentication information of the user U, and the object information processing unit 12 acquires an object pattern as the object feature amount of the object O.

  When the lock processing unit 13 (storage processing unit) receives a notification of successful authentication of the user U from the user information processing unit 11 and a notification of successful registration of the object pattern from the object information processing unit 12, the user information processing unit The face feature amount of the user U acquired in 11 and the object pattern acquired in the object information processing unit 12 are associated with each other and stored in the locking information storage unit 18. At the same time, a lock command is sent to the lock device L so as to lock the lock device L of the door D requested to be locked. Thereby, the lock apparatus L of the door D will be in a locked state. The locking information storage unit 18 stores information for identifying the lock device L of the locked door D in association with the association information between the face feature quantity and the object pattern.

  Further, the user information processing unit 11 (user authentication information acquisition unit) described above captures an image of the first camera 21 when receiving a request for unlocking the door D from the user U, as in the case of the locking request. A command is sent, and an image of the user U captured by the first camera 21 is acquired according to the imaging command. Then, the user information processing unit 11 extracts a face image of the user U from the acquired image of the user U, and extracts a face feature amount as new user authentication information of the user U from the face image. Further, the user information processing unit 11 authenticates whether or not the extracted face feature value matches the face feature value registered in the user information storage unit 16 in advance. As a result of authentication, the object information processing unit 12 and the unlocking processing unit 14 are notified of authentication success if they match, and authentication failure if they do not match. The unlock request from the user U is input to the user information processing unit 11 when the user U operates an operation device (such as an operation panel) installed near the lock device L of the door D, for example. Here, the facial feature amount authentication processing is performed, for example, in the same manner as described above.

  In addition, the object information processing unit 12 (object feature amount acquisition unit) described above captures an image with respect to the second camera 22 when receiving a request to unlock the door D from the user U, as in the case of the locking request. A command is sent, and an image of the object O possessed by the user U taken by the second camera 22 in accordance with the imaging command is acquired. When the object information processing unit 12 receives a notification of successful authentication of the facial feature amount of the user U from the user information processing unit 11, the object information processing unit 12 creates a new image formed on the surface of the object O from the acquired object image. An object pattern (object feature amount) that is a characteristic amount unique to an object is extracted and acquired. Further, the object information processing unit 12 authenticates whether or not the extracted object pattern matches the object pattern registered in the object information storage unit 17 in advance. If the authentication results match, the unlock processing unit 14 is notified of the authentication success, and if the authentication does not match, the authentication failure is notified.

  Here, the object pattern authentication process by the object information processing unit 12 is performed as follows, for example. First, an authentication score such as the similarity between the extracted object pattern and the object pattern stored in the object information storage unit 17 at the time of locking is calculated, and it is determined whether the authentication score is higher than a threshold value. If the authentication score is higher than the threshold value, it is determined that the authentication is successful. However, the object pattern authentication process may be performed by any method.

  As described above, even when unlocking is requested from the user U, the first camera 21 captures the face image of the user U, and at the same time, the second camera 22 captures the object image of the object O. Then, the face information is acquired as new user authentication information of the user U for unlocking by the user information processing unit 11, and the object as the new object feature of the object O for unlocking is acquired by the object information processing unit 12. A pattern is acquired.

  When the unlocking processing unit 14 (determination means) receives a request for unlocking the door D from the user U, the unlocking processing unit 14 notifies the user U of authentication success from the user information processing unit 11 and the object information processing unit 12. Upon receiving the notification of successful authentication of the object pattern, the new face feature amount of the user U acquired by the user information processing unit 11 and the new object pattern acquired by the object information processing unit 12 are locked information. It is determined whether it is stored in association with the storage unit 18. That is, determination processing for determining whether or not the association information between the face feature amount and the object pattern acquired at the time of unlocking request matches the association information between the face feature amount and the object pattern stored in the locking information storage unit 18. I do. When the unlocking processing unit 14 determines that they match in the determination processing, the unlocking processing unit 14 is associated with the association information between the face feature amount and the object pattern stored in the matching locking information storage unit 18. An unlocking command is sent to the lock device L of the door D. As a result, the lock device L of the door D is unlocked.

  In addition, when the unlocking device L of the door D is unlocked as described above, the unlocking processing unit 14 is associated with the unlocking device L and stored in the locking information storage unit 18. Cancel the association between the object pattern and the object pattern. That is, the association information between the face feature quantity and the object pattern associated with the unlocking device L that has been unlocked is deleted from the locking information storage unit 18. At the same time, the object pattern that is the same as the object pattern of the association information and is stored in the object information storage unit 17 is also deleted.

  Note that the deletion of the association information and the object pattern by the unlocking processing unit 14 described above may be performed after several unlocking processes are executed. In other words, the association information between the facial feature quantity and the object pattern once stored in the locking information storage unit 18 may be used for a plurality of unlocking processes. For this reason, the unlocking processing unit 14 determines that the facial feature amount and the object pattern input at the time of the unlocking request match the association information stored in the locking information storage unit 18 a preset number of times. In such a case, the association information may be deleted from the locking information storage unit 18 and the corresponding object pattern may be deleted.

  In addition, the locking processing unit 13 (storage processing unit) stores one facial feature amount of one user U and one object pattern in association with each other in the locking information storage unit 18 at the time of locking. The user group information including the face feature amount (user authentication information) of the user U and one object pattern (object feature amount) may be associated with each other and stored in the lock information storage unit 18 and locked. Accordingly, the unlocking processing unit 14 (determination means), when unlocked, the newly input face feature amount of the user U matches any of the user group information and is newly input. When the object pattern matches the object pattern associated with the user group information, the object pattern may be unlocked. Thereby, a plurality of users who form a user group can deliver the same object O and use it for locking and unlocking. As a result, it can also be used for group authentication.

[Operation]
Next, the operation of the security system described above will be described with reference to the flowcharts of FIGS. 3 shows the operation of the locking management server 10 when the door D is locked, and FIG. 4 shows the operation of the locking management server 10 when the door D is unlocked.

(Locking procedure)
The user U registers user information in the lock management server 10 in advance. For example, the user U registers the face image and the facial feature amount extracted from the face image in the user information storage unit 16 of the lock management server 10 via the network (step S1).

  Thereafter, the user D operates the operating device installed in the vicinity of the door U and requests the door D to be locked. The locking management server 10 that has received the locking request (step S2) takes an image with the first camera 21 and the second camera 22 (step S3). Thereby, the lock management server 10 acquires the face image of the user U from the first camera 21 and acquires the object image of the object O from the second camera 22.

  Subsequently, the locking management server 10 extracts the face image of the user U from the image of the user U acquired from the first camera 21, and extracts the face feature amount as the user authentication information of the user U from the face image (step). S4). Then, the lock management server 10 authenticates whether or not the extracted facial feature quantity matches the facial feature quantity registered in the user information storage unit 16 in advance (step S5). If they do not match as a result of authentication, authentication is failed and locking is canceled (step S10). If they match as a result of authentication, authentication is successful (step SY5: Yes).

  If the facial feature amount authentication is successful, the lock management server 10 extracts an object pattern that is an object-specific feature amount formed on the surface of the object O from the acquired object image (step S6). Then, the lock management server 10 stores the extracted object pattern in the object information storage unit 17 (step S7). At the same time, the locking management server 10 associates the acquired facial feature amount of the user U with the acquired object pattern and stores them in the locking information storage unit 18 (step S8). At the same time, the lock management server 10 controls to lock the lock device L of the door D requested to be locked (step S9). As a result, the lock device L of the door D is locked, and the door D opens from the inside, but is automatically locked without registration information from the outside.

(Unlocking procedure)
The user U requests an unlocking of the door D by operating an operating device installed near the door D. The locking management server 10 that has received the unlock request (step S21) takes an image with the first camera 21 and the second camera 22 (step S22). Thereby, the locking management server 10 acquires a new face image of the user U from the first camera 21 and acquires a new object image of the object O from the second camera 22.

  Subsequently, the lock management server 10 extracts a new face image of the user U from the new image of the user U acquired from the first camera 21, and uses the face feature amount as the user authentication information of the user U from the face image. Extract (step S23). Then, the lock management server 10 authenticates whether or not the extracted face feature value matches the face feature value registered in advance in the user information storage unit 16 (step S24). If they do not match as a result of authentication, authentication is failed and locking is canceled (step S30). If they match as a result of authentication, authentication is successful (step SY24: Yes).

  If the facial feature amount authentication is successful, the lock management server 10 extracts an object pattern that is an object-specific feature amount formed on the surface of the object O from the acquired new object image (step S25). ). Then, the lock management server 10 authenticates whether or not the extracted object pattern matches the object pattern registered in the object information storage unit 17. If they match as a result of the authentication (step S26: Yes), information obtained by associating the acquired new face feature amount of the user U with the new object pattern is stored in association with the locking information storage unit 18. (Step S27). That is, determination processing for determining whether or not the association information between the face feature amount and the object pattern acquired at the time of unlocking request matches the association information between the face feature amount and the object pattern stored in the locking information storage unit 18. I do.

  If the lock management server 10 determines that they match in the determination process (step S27: Yes), the lock management server 10 corresponds to the association information between the face feature amount and the object pattern stored in the matching lock information storage unit 18. The lock device L of the attached door D is unlocked (step S28). As a result, the lock device L of the door D is unlocked. In addition, when it determines with it not being in the said determination process (step S27: No), unlocking is canceled (step S30).

  Thereafter, the lock management server 10 deletes the association information between the face feature amount and the object pattern associated with the unlocked device L that has been unlocked (step S29). At the same time, the object pattern that is the same as the object pattern of the association information and is stored in the object information storage unit 17 is also deleted. At this time, the face image of the user registered in the user information storage unit 16 and the facial feature amount extracted from the face image remain registered in the user information storage unit 16 as user information.

  As described above, according to the information processing system according to the present embodiment, the combination of the facial feature amount and the object pattern is set at the time of locking as a key, so the key can be changed quickly and easily by changing the object pattern. It becomes possible to do. In particular, since the object pattern is unique information for various objects, it is difficult to duplicate, the strength of the key is high, and security can be improved.

  Here, the facial feature amount extracted from the face image of the user U is used as the user authentication information that is one of the keys. However, the feature amount of another part that can be extracted from the user U image is also used. Good. Moreover, not only information that can be extracted from the image of the user U, but also fingerprints and irises may be acquired and used as user authentication information. That is, the user authentication information that is one of the keys may be any biological information that represents the physical characteristics of the user U. Furthermore, the user authentication information that is one of the keys is not limited to the biometric information of the user U, and any identification information may be used as described in the second embodiment below.

<Embodiment 2>
Next, a second embodiment of the present invention will be described with reference to FIG. FIG. 5 is a schematic diagram showing the overall configuration of the security system.

  The security system in the present embodiment has the same configuration as that in the first embodiment described above, but uses user identification information stored in an ID (identification card) card as one of the keys instead of the facial feature amount. It is different in use. Hereinafter, the configuration different from the first embodiment will be mainly described in detail.

  As shown in FIG. 5, the security system according to the present embodiment includes a card reader 23 (input means) installed near the door D and capable of reading the ID card C possessed by the user U. Here, the ID card C stores user identification information unique to the user U, such as a my number card or a security card of an organization to which the ID card C belongs. Further, as in the first embodiment, a second camera 22 that captures an object image of the object O owned by the user U is installed near the door D.

  Thereby, the lock management server 10 of this embodiment acquires the user identification information memorize | stored in the ID card C of the user U read from the card reader 23 as user authentication information. Then, the locking management server 10 can use the object pattern extracted from the object image of the object O and the user identification information read from the ID card C as a key as in the first embodiment.

<Embodiment 3>
Next, a third embodiment of the present invention will be described with reference to FIGS. 6 to 7 are diagrams showing the configuration of the security system. 8 to 10 are diagrams for explaining the processing operation of the security system.

  The security system in the present embodiment has substantially the same configuration as that in the first embodiment described above, but instead of the first camera 21 and the second camera 22 that capture the user U's face image and the object O object image. The difference is that the portable terminal P is used. Hereinafter, the configuration different from the first embodiment will be mainly described in detail.

  The portable terminal P is a portable communication terminal such as a smartphone that the user U has and operates. For this reason, the portable terminal P can be connected to the lock management server 10 via a network including wireless communication.

  As shown in FIGS. 6 and 7, the mobile terminal P includes a camera 24. The camera 24 (input means, image pickup means) is used when picking up a face image of the user U or picking up the surface of the object O held by the user U. The mobile terminal P has a function of transmitting the captured face image of the user U and the object image of the object O to the lock management server 10.

  As shown in FIG. 7, the locking management server 10 includes a user information processing unit 11, an object information processing unit 12, and a locking processing unit 13 that are constructed by executing a program by an arithmetic device, as in the first embodiment. And an unlocking processing unit 14, and further, a communication control processing unit 15 constructed by an arithmetic device executing a program. The locking management server 10 includes a user information storage unit 16, an object information storage unit 17, and a locking information storage unit 18 formed in a storage device, as in the first embodiment, and further includes a communication information storage unit. 19 is provided.

  The communication control processing unit 15 (communication control means) receives a connection request from the portable terminal P and performs user registration. Specifically, the communication control processing unit 15 first creates a public key in response to a connection request from the mobile terminal P, notifies the mobile terminal P of the public key, Are stored in the communication information storage unit 19 in association with each other. Thereby, the communication control processing unit 15 performs public key authentication in subsequent communication with the mobile terminal P, and performs encrypted communication with the mobile terminal P that has succeeded in the authentication.

  The user information processing unit 11 (user authentication information acquisition means) acquires a face feature value extracted from the user U's face image or face image in advance as user authentication information of the user U, and a user information storage unit 16 is stored and registered. At this time, the user information processing unit 11 accepts transmission of the face image of the user U photographed by the camera 24 from the portable terminal P that has become communicable by public key authentication. Then, the user information processing unit 11 extracts the facial feature amount from the facial image, and registers the facial feature amount in the user information storage unit 16 in association with the mobile terminal P associated with the public key as described above. . Thereby, the portable terminal P and the user U are associated and registered.

  Note that even when the mobile terminal P uses a face image for unlocking authentication that enables the mobile terminal P to be operated, a user authentication information is sent to the lock management server 10 for a face image different from the face image. Send as. Then, the face image as the user authentication information is only temporarily stored in the memory of the mobile terminal P when taken by the mobile terminal P, and is deleted from the memory after being transmitted to the lock management server 10. The

  When the user information processing unit 11 receives a request for locking the door D designated from the user U via the mobile terminal P, the user information processing unit 11 requests the mobile terminal P for a face image for user authentication. In response to this, an image of the user U taken by the camera 24 is transmitted from the mobile terminal P, so the user information processing unit 11 acquires the image of the user U transmitted from the mobile terminal P. Then, the user information processing unit 11 extracts a face image of the user U from the acquired image of the user U, and extracts a face feature amount as user authentication information of the user U from the face image. Further, the user information processing unit 11 authenticates whether or not the extracted face feature value matches the face feature value registered in the user information storage unit 16 in advance. As a result of authentication, the object information processing unit 12 and the lock processing unit 13 are notified that the authentication is successful if they match, and that the authentication fails if they do not match.

  When the above-described user authentication is successful, the object information processing unit 12 (object feature amount acquisition unit) requests an image of the object O from the portable terminal P. In response to this, since the image of the object O photographed by the camera 24 is transmitted from the portable terminal P, the object information processing unit 12 acquires the image of the object O transmitted from the portable terminal P. Then, the object information processing unit 12 extracts and acquires an object pattern (object feature amount) that is an object-specific feature amount formed on the surface of the object O from the acquired object image. Further, the object information processing unit 12 stores and registers the extracted object pattern in the object information storage unit 17, and notifies the lock processing unit 13 to that effect. The captured object image of the object O is only temporarily stored in the memory of the mobile terminal P when it is captured by the mobile terminal P, and is deleted from the memory after being transmitted to the lock management server 10.

  As described above, when there is a lock request from the user U via the portable terminal P, the face image of the user U is captured and transmitted by the camera 24 of the portable terminal P, and the object is similarly transmitted by the camera 24. An object image of O is captured and transmitted. Then, the user information processing unit 11 acquires a face feature amount as user authentication information of the user U, and the object information processing unit 12 acquires an object pattern as the object feature amount of the object O.

  When the lock processing unit 13 (storage processing unit) receives a notification of successful authentication of the user U from the user information processing unit 11 and a notification of successful registration of the object pattern from the object information processing unit 12, the user information processing unit The face feature amount of the user U acquired in 11 and the object pattern acquired in the object information processing unit 12 are associated with each other and stored in the locking information storage unit 18. At the same time, a lock command is sent to the lock device L so as to lock the lock device L of the door D requested to be locked. Thereby, the lock apparatus L of the door D will be in a locked state. The locking information storage unit 18 stores information for identifying the lock device L of the locked door D in association with the association information between the face feature quantity and the object pattern.

  In addition, when the above-described user information processing unit 11 (user authentication information acquisition unit) receives a request for unlocking the door D designated by the user U via the mobile terminal P, the user information processing unit 11 (user authentication information acquisition unit) is the same as when the locking request is made. The user U is requested for the face image of the user U, and the face image is acquired. Then, the user information processing unit 11 extracts a face image of the user U from the acquired image of the user U, and extracts a face feature amount as new user authentication information of the user U from the face image. Further, the user information processing unit 11 authenticates whether or not the extracted face feature value matches the face feature value registered in the user information storage unit 16 in advance. As a result of authentication, the object information processing unit 12 and the unlocking processing unit 14 are notified of authentication success if they match, and authentication failure if they do not match.

  In addition, the object information processing unit 12 (object feature amount acquisition unit) described above also receives the object O from the portable terminal P when the above-described user authentication is successful at the time of the above-described unlock request as in the case of the lock request. An image is requested and an image of the object O is acquired. Then, the object information processing unit 12 extracts and acquires an object pattern (object feature value) that is a new object-specific feature value formed on the surface of the object O from the acquired object image. Further, the object information processing unit 12 authenticates whether or not the extracted object pattern matches the object pattern registered in the object information storage unit 17 in advance. If the authentication results match, the unlock processing unit 14 is notified of the authentication success, and if the authentication does not match, the authentication failure is notified.

  As described above, the face image of the user U and the object image of the object O are picked up by the camera 24 of the portable terminal P even when the unlocking request is received from the user U. Then, the face information is acquired as new user authentication information of the user U for unlocking by the user information processing unit 11, and the object as the new object feature of the object O for unlocking by the object information processing unit 12 A pattern is acquired. Note that the portable terminal P only temporarily stores the face image of the user U and the image of the object O taken for unlocking on the memory of the portable terminal P when the portable terminal P takes a picture. After transmission to the management server 10, it is deleted from the memory.

  Then, the unlocking processing unit 14 (determination means) locks the new face feature amount of the user U acquired by the user information processing unit 11 and the new object pattern acquired by the object information processing unit 12. It is determined whether the information is stored in association with the information storage unit 18. That is, determination processing for determining whether or not the association information between the face feature amount and the object pattern acquired at the time of unlocking request matches the association information between the face feature amount and the object pattern stored in the locking information storage unit 18. I do. When the unlocking processing unit 14 determines that they match in the determination processing, the unlocking processing unit 14 is associated with the association information between the face feature amount and the object pattern stored in the matching locking information storage unit 18. An unlocking command is sent to the lock device L of the door D. As a result, the lock device L of the door D is unlocked.

  In addition, when the unlocking device L of the door D is unlocked as described above, the unlocking processing unit 14 is associated with the unlocking device L and stored in the locking information storage unit 18. Cancel the association between the object pattern and the object pattern. That is, the association information between the face feature quantity and the object pattern associated with the unlocking device L that has been unlocked is deleted from the locking information storage unit 18. At the same time, the object pattern that is the same as the object pattern of the association information and is stored in the object information storage unit 17 is also deleted.

[Operation]
Next, the operation of the above-described security system will be described with reference to the flowcharts of FIGS. 8 shows the initial setting operation of the portable terminal P, FIG. 9 shows the operation of the lock management server 10 when the door D is locked, and FIG. 10 shows the lock management server when the door D is unlocked. 10 operations are shown.

(Initial setting)
When receiving the connection request from the mobile terminal P (Step S41), the lock management server 10 creates a public key for the mobile terminal P, notifies the mobile terminal P of the public key, The mobile terminal P is associated and stored in the communication information storage unit 19 (step S42).

  Thereafter, the lock management server 10 performs public key authentication at the time of a connection request from the mobile terminal P, and performs encrypted communication with the mobile terminal P that has succeeded in the authentication (step S43: Yes). Then, the user U of the portable terminal P registers user information in the lock management server 10 in advance. For example, the user U captures his / her face image with the mobile terminal P (step S <b> 44), and transmits the face image to the lock management server 10. The lock management server 10 extracts a facial feature amount from the face image received from the mobile terminal P (step S45), and registers it in the user information storage unit 16 of the lock management server 10 in association with the mobile terminal P (step S46: Yes). Step S47). When the lock management server 10 fails to register user information due to failure of public key authentication at the time of a connection request from the mobile terminal P (step S43: No) or failure of extracting a user's face image. (Step S46: No), the registration of user information is canceled (step S48).

(Locking procedure)
When the user U accesses the lock management server 10 with the portable terminal P, the lock management server 10 performs public key authentication (step S51). If public key authentication is successful (step S51: Yes), the user U requests the locking of the door D from the portable terminal P (step S52). Receiving the locking request, the locking management server 10 requests the mobile terminal P for the face image for user authentication and the object information of the object O, and acquires the face image and the object information from the mobile terminal P (step). S53). If the public key authentication fails when a connection request is received from the mobile terminal P (Step S51: No), the lock management server 10 cancels the lock (Step S60).

  Subsequently, the locking management server 10 extracts a face feature amount as user authentication information of the user U from the acquired face image of the user U (step S54). Then, the lock management server 10 authenticates whether or not the extracted face feature value matches the face feature value registered in advance in the user information storage unit 16 (step S55). If they do not match as a result of authentication, authentication is failed (step S55: No), and locking is canceled (step S60). If they match as a result of authentication, authentication is successful (step S55: Yes).

  When the facial feature amount authentication is successful, the lock management server 10 extracts an object pattern that is an object-specific feature amount formed on the surface of the object O from the acquired object image (step S56). Note that the lock management server 10 may request and acquire the object image of the object O from the portable terminal P and extract the object pattern when the facial feature amount authentication is successful. Then, the locking management server 10 stores the extracted object pattern in the object information storage unit 17 (step S57). At the same time, the locking management server 10 associates the acquired facial feature amount of the user U with the acquired object pattern and stores them in the locking information storage unit 18 (step S58). At the same time, the lock management server 10 controls to lock the lock device L of the door D requested to be locked (step S59). As a result, the lock device L of the door D is locked, and the door D opens from the inside, but is automatically locked without registration information from the outside.

(Unlocking procedure)
When the user U accesses the lock management server 10 with the portable terminal P, the lock management server 10 performs public key authentication (step S71). When the public key authentication is successful (step S71: Yes), the user U requests the unlocking of the door D from the portable terminal P (step S72). Receiving the unlock request, the lock management server 10 requests the mobile terminal P for the face image for user authentication and the object information of the object O, and acquires the face image and the object information from the mobile terminal P ( Step S73). If the public key authentication fails when a connection request is received from the mobile terminal P (Step S71: No), the lock management server 10 cancels the lock (Step S81).

  Subsequently, the locking management server 10 extracts a face feature amount as user authentication information of the user U from the acquired face image of the user U (step S74). Then, the lock management server 10 authenticates whether or not the extracted face feature value matches the face feature value registered in advance in the user information storage unit 16 (step S75). If they do not match as a result of authentication, authentication failure is assumed (step S75: No), and unlocking is canceled (step S81). If they match as a result of authentication, authentication is successful (step S75: Yes).

  If the facial feature value authentication is successful, the lock management server 10 extracts an object pattern that is an object-specific feature value formed on the surface of the object O from the acquired object image (step S76). Note that the lock management server 10 may request and acquire the object image of the object O from the portable terminal P and extract the object pattern when the facial feature amount authentication is successful. Then, the lock management server 10 authenticates whether or not the extracted object pattern matches the object pattern registered in the object information storage unit 17 (step S77). If they match as a result of the authentication (step S77: Yes), information obtained by associating the acquired new face feature amount of the user U with the new object pattern is stored in association with the locking information storage unit 18. (Step S78). That is, determination processing for determining whether or not the association information between the face feature amount and the object pattern acquired at the time of unlocking request matches the association information between the face feature amount and the object pattern stored in the locking information storage unit 18. I do.

  If the lock management server 10 determines that they match in the determination process (step S78: Yes), the lock management server 10 corresponds to the association information between the face feature quantity and the object pattern stored in the matched lock information storage unit 18. The lock device L of the attached door D is unlocked (step S79). As a result, the lock device L of the door D is unlocked. In addition, when it determines with not agree | coinciding in the said determination process (step S78: No), unlocking is canceled (step S81).

  Thereafter, the lock management server 10 deletes the association information between the face feature quantity and the object pattern associated with the unlocked device L that has been unlocked (step S80). At the same time, the object pattern that is the same as the object pattern of the association information and is stored in the object information storage unit 17 is also deleted. At this time, the face image of the user registered in the user information storage unit 16 and the facial feature amount extracted from the face image remain registered in the user information storage unit 16 as user information.

  As described above, according to the information processing system according to the present embodiment, the combination of the facial feature amount and the object pattern is set at the time of locking as a key, so the key can be changed quickly and easily by changing the object pattern. It becomes possible to do. In particular, since the object pattern is unique information for various objects, it is difficult to duplicate, the strength of the key is high, and security can be improved. Furthermore, in this embodiment, since the portable terminal P is used, it is not necessary to install a dedicated camera, and the cost can be reduced. In addition, lock management can be performed remotely using the mobile terminal P, and even if the mobile terminal P is lost, the risk of unauthorized unlocking is reduced by biometric authentication and two-step authentication using object fingerprints. Can do. For example, as a special usage scene, it is possible to enter a new user who is not registered by the user U without bringing the user U into a lock-managed facility.

<Embodiment 4>
Next, the 4th Embodiment of this invention is described with reference to FIG.11 and FIG.12. FIG. 11 is a block diagram illustrating a configuration of the information processing apparatus according to the fourth embodiment. FIG. 12 is a block diagram illustrating a configuration of an information processing system according to the fourth embodiment. In the present embodiment, an outline of the configuration of the face authentication system described in the first to third embodiments is shown.

As shown in FIG. 11, the information processing apparatus 100 in the present embodiment is
User authentication information acquisition means 110 for acquiring user authentication information;
Object feature amount acquisition means 120 for acquiring an object feature amount extracted from an object photographed image;
Storage processing means 130 for associating the user authentication information with the object feature quantity and storing them in a storage device;
A determination unit 140 that performs a determination process as to whether or not newly acquired information matches the associated user authentication information stored in the storage device and the object feature amount;
Comprising
The configuration is as follows.

In the present embodiment, an input unit 150 and an imaging unit 160 may be added to the information processing apparatus 100 illustrated in FIG.
That is, the information processing system 200 in the present embodiment is
Input means 150 for inputting user authentication information;
An image pickup means 160 for picking up an object photographed image;
User authentication information acquisition means 110 for acquiring the user authentication information input from the input means;
Object feature quantity acquisition means 120 for acquiring an object feature quantity extracted from the object photographed image captured by the imaging means;
Storage processing means 130 for associating the user authentication information with the object feature quantity and storing them in a storage device;
A determination unit 140 that performs a determination process as to whether or not newly acquired information matches the associated user authentication information stored in the storage device and the object feature amount;
With
The configuration is as follows.

  Note that the user authentication information acquisition unit 110, the object feature amount acquisition unit 120, the storage processing unit 130, and the determination unit 140 described above may be constructed by the arithmetic device executing a program. It may be constructed with an electronic circuit.

The information processing apparatus 100 or the information processing system 200 configured as described above
Get user authentication information,
Get the object features extracted from the object image,
Storing the user authentication information and the object feature amount in association with each other in a storage device;
A process of determining whether or not newly input information matches the associated user authentication information stored in the storage device and the object feature amount,
It operates to perform the process.

  According to the information processing apparatus 100 or the information processing system 200 described above, since the combination of the user authentication information and the object pattern is set as a key at the time of locking, the key can be changed quickly and easily by changing the object pattern. It becomes possible. In particular, since the object pattern is unique information for various objects, it is difficult to duplicate, the strength of the key is high, and security can be improved.

<Appendix>
Part or all of the above-described embodiment can be described as in the following supplementary notes. The outline of the configuration of the information processing apparatus, information processing system, program, and information processing method in the present invention will be described below. However, the present invention is not limited to the following configuration.

(Appendix 1)
User authentication information acquisition means for acquiring user authentication information;
Object feature amount acquisition means for acquiring an object feature amount extracted from an object photographed image;
Storage processing means for associating the user authentication information with the object feature quantity and storing them in a storage device;
A determination unit that performs a determination process as to whether or not newly acquired information matches the associated user authentication information stored in the storage device and the object feature amount;
An information processing apparatus comprising:

(Appendix 2)
An information processing apparatus according to attachment 1, wherein
The user authentication information acquisition means acquires new user authentication information,
The object feature amount acquisition means acquires a new object feature amount extracted from a new object photographed image,
The determination unit determines whether or not the new user authentication information and the new object feature amount match the associated user authentication information and the object feature amount stored in the storage device. Process,
Information processing device.

(Appendix 2.1)
An information processing apparatus according to appendix 1 or 2,
The user authentication information acquisition means acquires a face feature amount from the user's face image as the user authentication information.
Information processing device.

(Appendix 3)
An information processing apparatus according to appendix 1 or 2,
The storage processing means performs a lock process for a lock previously set when storing the user authentication information and the object feature amount in association with each other.
Information processing device.

(Appendix 4)
An information processing apparatus according to attachment 3, wherein
When the determination means determines that they match in the determination process, the unlocking process for the lock is performed.
Information processing device.

(Appendix 5)
An information processing apparatus according to appendix 3 or 4, wherein
The storage processing unit performs the locking process before the lock when the user authentication information matches information registered in advance.
Information processing device.

(Appendix 6)
An information processing apparatus according to appendix 4 or 5, wherein
When the determination means determines that the user authentication information matches information registered in advance, the object feature value matches information registered in advance, and matches in the determination process, the unlocking solution is determined. Lock processing,
Information processing device.

(Appendix 7)
An information processing apparatus according to any one of appendices 1 to 6,
The determination means cancels the association between the associated user authentication information stored in the storage device determined to match in the determination process and the object feature amount;
Information processing device.

(Appendix 7.1)
An information processing apparatus according to any one of appendices 1 to 6,
The determination unit releases the association between the associated user authentication information and the object feature amount stored in the storage device determined to match the number of times set in advance in the determination process.
Information processing device.

(Appendix 7.2)
An information processing apparatus according to any one of appendices 1 to 7,
The storage processing unit stores user group information including a plurality of user authentication information and the object feature amount in association with each other in a storage device,
In the determination unit, the new user authentication information and the new object feature amount coincide with the user authentication information and the object feature amount in the associated user group information stored in the storage device. Determine whether or not to
Information processing device.

(Appendix 8)
An input means for inputting user authentication information;
An imaging means for imaging an object photographed image;
User authentication information acquisition means for acquiring the user authentication information input from the input means;
Object feature quantity acquisition means for acquiring an object feature quantity extracted from the object photographed image captured by the imaging means;
Storage processing means for associating the user authentication information with the object feature quantity and storing them in a storage device;
A determination unit that performs a determination process as to whether or not newly acquired information matches the associated user authentication information stored in the storage device and the object feature amount;
Information processing system with

(Appendix 9)
The information processing system according to appendix 8,
A portable terminal comprising the input means and the imaging means;
A server device connected to the portable terminal via a network, and comprising the user authentication information acquisition means, the object feature amount acquisition means, the storage processing means, and the determination means;
The server device includes communication control means for performing connection so as to communicate with the mobile terminal registered in advance,
The user authentication information acquisition unit and the object feature amount acquisition unit of the server device acquire information via the connected mobile terminal.
Information processing system.

(Appendix 9.1)
The information processing system according to attachment 9, wherein
The imaging means of the mobile terminal deletes the object captured image from within the mobile terminal after transmitting the captured object captured image to the server device.
Information processing system.

(Appendix 10)
Get user authentication information,
Get the object features extracted from the object image,
Storing the user authentication information and the object feature amount in association with each other in a storage device;
A process of determining whether or not newly input information matches the associated user authentication information stored in the storage device and the object feature amount,
Information processing method.

(Appendix 10.1)
An information processing method according to attachment 10, wherein
Get new user authentication information,
Obtain a new object feature extracted from the new object image,
A determination process is performed to determine whether the new user authentication information and the new object feature amount match the associated user authentication information and the object feature amount stored in the storage device;
Information processing method.

(Appendix 10.2)
The information processing method according to appendix 10 or 10.1,
When the user authentication information and the object feature amount are stored in association with each other, a preset lock processing is performed.
Information processing method.

(Appendix 10.3)
An information processing method according to attachment 10.2,
When it is determined that they match in the determination process, the unlocking process of the lock is performed.
Information processing method.

(Appendix 10.4)
An information processing method according to any one of appendices 10 to 10.3,
Canceling the association between the associated user authentication information stored in the storage device determined to match in the determination process and the object feature amount;
Information processing method.

(Appendix 11)
In the information processing device,
User authentication information acquisition means for acquiring user authentication information;
Object feature amount acquisition means for acquiring an object feature amount extracted from an object photographed image;
Storage processing means for associating the user authentication information with the object feature quantity and storing them in a storage device;
A determination unit that performs a determination process as to whether or not newly acquired information matches the associated user authentication information stored in the storage device and the object feature amount;
A program to realize

  Note that the above-described program is stored in a storage device or recorded on a computer-readable recording medium. For example, the recording medium is a portable medium such as a flexible disk, an optical disk, a magneto-optical disk, and a semiconductor memory.

  Although the present invention has been described with reference to the above-described embodiment and the like, the present invention is not limited to the above-described embodiment. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

10 Locking Management Server 11 User Information Processing Unit 12 Object Information Processing Unit 12
13 Locking Processing Unit 14 Unlocking Processing Unit 15 Communication Control Processing Unit 16 User Information Storage Unit 17 Object Information Storage Unit 18 Locking Information Storage Unit 19 Communication Information Storage Unit 21 First Camera 22 Second Camera 23 Card Reader 24 Camera C Card D Door L Lock device O Object P Mobile terminal U User

Claims (10)

User authentication information acquisition means for acquiring user authentication information;
Object feature amount acquisition means for acquiring an object feature amount extracted from an object photographed image;
Storage processing means for associating the user authentication information with the object feature quantity and storing them in a storage device;
A determination unit that performs a determination process as to whether or not newly acquired information matches the associated user authentication information stored in the storage device and the object feature amount;
An information processing apparatus comprising: The information processing apparatus according to claim 1,
The user authentication information acquisition means acquires new user authentication information,
The object feature amount acquisition means acquires a new object feature amount extracted from a new object photographed image,
The determination unit determines whether or not the new user authentication information and the new object feature amount match the associated user authentication information and the object feature amount stored in the storage device. Process,
Information processing device. The information processing apparatus according to claim 1 or 2,
The storage processing means performs a lock process for a lock previously set when storing the user authentication information and the object feature amount in association with each other.
Information processing device. The information processing apparatus according to claim 3,
When the determination means determines that they match in the determination process, the unlocking process for the lock is performed.
Information processing device. An information processing apparatus according to claim 3 or 4,
The storage processing unit performs the locking process before the lock when the user authentication information matches information registered in advance.
Information processing device. An information processing apparatus according to claim 4 or 5,
When the determination means determines that the user authentication information matches information registered in advance, the object feature value matches information registered in advance, and matches in the determination process, the unlocking solution is determined. Lock processing,
Information processing device. An information processing apparatus according to any one of claims 1 to 6,
The determination means cancels the association between the associated user authentication information stored in the storage device determined to match in the determination process and the object feature amount;
Information processing device. An input means for inputting user authentication information;
An imaging means for imaging an object photographed image;
User authentication information acquisition means for acquiring the user authentication information input from the input means;
Object feature quantity acquisition means for acquiring an object feature quantity extracted from the object photographed image captured by the imaging means;
Storage processing means for associating the user authentication information with the object feature quantity and storing them in a storage device;
A determination unit that performs a determination process as to whether or not newly acquired information matches the associated user authentication information stored in the storage device and the object feature amount;
Information processing system with The information processing system according to claim 8,
A portable terminal comprising the input means and the imaging means;
A server device connected to the portable terminal via a network, and comprising the user authentication information acquisition means, the object feature amount acquisition means, the storage processing means, and the determination means;
The server device includes communication control means for performing connection so as to communicate with the mobile terminal registered in advance,
The user authentication information acquisition unit and the object feature amount acquisition unit of the server device acquire information via the connected mobile terminal.
Information processing system. Get user authentication information,
Get the object features extracted from the object image,
Storing the user authentication information and the object feature amount in association with each other in a storage device;
A process of determining whether or not newly input information matches the associated user authentication information stored in the storage device and the object feature amount,
Information processing method.

Images