WO2021193037A1 - Usage management device, system, and method, and non-transitory computer-readable medium - Google Patents

Abstract

A usage management device (1) comprising: an acquisition unit (11) that acquires a captured image of a prospective user of a plurality of facilities having usage restrictions; an authentication control unit (12) that causes an authentication device in which facial feature information of people having permission to use the plurality of facilities is stored to perform face authentication on the captured image; a reception unit (13) that receives a selection of any one of the plurality of facilities from the prospective user; a restriction removal unit (14) that, if face authentication has succeeded, performs restriction removal for the selected facility; and a record registration unit (15) that registers, in a storage unit (16), a removal record (170) associating a facility (171) for which restriction removal was performed and a date and time (172) with a permitted user (173) who is the prospective user for whom face authentication has succeeded.

Description

Usage management devices, systems and methods and non-temporary computer-readable media

The present invention relates to a usage management device, a system, a method and a program, and more particularly to a usage management device, a system, a method and a program for managing the use of a plurality of facilities.

In Patent Document 1, face recognition is performed using a photographed image of the face of the person being watched over by a camera installed at the entrance / exit of the building, and when a face matching the face recognition data is detected, the camera is photographed. A technique for initiating video recording is disclosed.

Patent Document 2 discloses a technique in which a door that can be opened and closed is provided for each mailbox corresponding to each dwelling unit of an apartment house, and the door is opened when the resident of each dwelling unit is successfully authenticated.

Japanese Unexamined Patent Publication No. 2017-111506 Japanese Unexamined Patent Publication No. 2015-089441

In the technologies according to Patent Documents 1 and 2, it is possible to individually control the entrance / exit of a building and the opening / closing control of a mailbox by face recognition, but there is a problem that the comprehensive utilization of these usage histories is insufficient. be.

The present disclosure has been made to solve such problems, and an object of the present disclosure is to provide a usage management device, system, method and program for comprehensively grasping the living conditions of equipment users. do.

The utilization management device according to the first aspect of the present disclosure is
An acquisition unit that acquires captured images taken by those who wish to use multiple facilities with restricted usage,
An authentication control unit that authenticates the face of the photographed image to an authentication device that stores facial feature information of a person who is permitted to use the plurality of facilities.
A reception unit that accepts the selection of any of the plurality of facilities from the applicant, and
When the face recognition is successful, the restriction release unit that releases the restriction of the selected equipment and the restriction release unit
A history registration unit that registers in the storage unit a release history that associates the equipment and date and time for which the restrictions have been released with the licensee who is the user who has succeeded in face recognition.
To be equipped.

The utilization management device according to the second aspect of the present disclosure is
A storage unit that stores facial feature information of people who are permitted to use multiple facilities with restricted usage,
An acquisition unit that acquires captured images taken by those who wish to use the plurality of facilities, and
An authentication control unit that performs face recognition on the captured image using the face feature information,
A reception unit that accepts the selection of any of the plurality of facilities from the applicant, and
When the face recognition is successful, the restriction release unit that releases the restriction of the selected equipment and the restriction release unit
A history registration unit that registers in the storage unit a release history in which the restricted equipment and the date and time are associated with a user who is a user who wants to use the face authentication successfully.
To be equipped.

The usage management system according to the third aspect of the present disclosure is
A usage management device connected to multiple facilities with usage restrictions,
It is equipped with an authentication device that stores facial feature information of a person who is permitted to use the plurality of facilities.
The usage management device is
An acquisition unit that acquires captured images taken by those who wish to use the plurality of facilities, and
An authentication control unit that causes the authentication device to perform face authentication on the captured image,
A reception unit that accepts the selection of any of the plurality of facilities from the applicant, and
When the face recognition is successful, the restriction release unit that releases the restriction of the selected equipment and the restriction release unit
A history registration unit that registers in the storage unit a release history that associates the equipment and date and time for which the restrictions have been released with the licensee who is the user who has succeeded in face recognition.
To be equipped.

The usage management method according to the fourth aspect of the present disclosure is
The computer
Acquire captured images taken by those who wish to use multiple facilities with restricted usage,
The authentication device that stores the facial feature information of the person who is permitted to use the plurality of facilities is made to perform face authentication on the captured image.
Accepting the selection of any of the plurality of facilities from the applicant,
If the face recognition is successful, the restriction on the selected equipment is released and the face recognition is released.
The release history in which the restricted equipment and the date and time are associated with the licensee who is the user who has succeeded in face recognition is registered in the storage unit.

The usage management method according to the fifth aspect of the present disclosure is
A computer equipped with a storage unit that stores facial feature information of a person who is permitted to use multiple facilities with restricted usage
Acquired captured images taken by those who wish to use the plurality of facilities,
Face recognition is performed on the captured image using the face feature information.
Accepting the selection of any of the plurality of facilities from the applicant,
If the face recognition is successful, the restriction on the selected equipment is released and the face recognition is released.
The release history in which the restricted equipment and the date and time are associated with the licensee who is the user who has succeeded in face recognition is registered in the storage unit.

The usage management program according to the sixth aspect of the present disclosure is
Acquisition processing to acquire captured images taken by those who wish to use multiple facilities with usage restrictions,
An authentication control process that causes an authentication device that stores facial feature information of a person who is permitted to use a plurality of facilities to perform face authentication on the captured image.
Reception processing that accepts the selection of any of the plurality of facilities from the applicant, and
If the face recognition is successful, the restriction release process for releasing the restriction on the selected equipment and the restriction release process
A history registration process for registering a release history in the storage unit in which the restricted equipment and the date and time are associated with the user who is the user who wants to use the face authentication successfully.
Let the computer run.

The usage management program according to the seventh aspect of the present disclosure is
A computer equipped with a storage unit that stores facial feature information of a person who is permitted to use multiple facilities with restricted usage.
An acquisition process for acquiring captured images taken by a person who wishes to use the plurality of facilities, and
Authentication control processing that performs face recognition on the captured image using the face feature information, and
Reception processing that accepts the selection of any of the plurality of facilities from the applicant, and
If the face recognition is successful, the restriction release process for releasing the restriction on the selected equipment and the restriction release process
A history registration process for registering a release history in the storage unit in which the restricted equipment and the date and time are associated with a user who is a user who has succeeded in face recognition and is a user who wants to use the face.
To execute.

With this disclosure, it is possible to provide usage management devices, systems, methods and programs for comprehensively grasping the living conditions of equipment users.

It is a block diagram which shows the structure of the utilization management apparatus which concerns on this Embodiment 1. It is a flowchart which shows the flow of the utilization management method which concerns on this Embodiment 1. It is a block diagram which shows the structure of the utilization management apparatus which concerns on this Embodiment 2. It is a flowchart which shows the flow of the utilization management method which concerns on this Embodiment 2. It is a block diagram which shows the whole structure of the utilization management system which concerns on this Embodiment 3. It is a block diagram which shows the structure of the authentication apparatus which concerns on this Embodiment 3. It is a flowchart which shows the flow of the face information registration process which concerns on this Embodiment 3. It is a flowchart which shows the flow of the face recognition processing which concerns on this Embodiment 3. It is a block diagram which shows the structure of the utilization management apparatus which concerns on this Embodiment 3. It is a flowchart which shows the flow of the restriction release processing which concerns on this Embodiment 3. It is a figure which shows the example of the designation screen of the use equipment which concerns on this Embodiment 3. It is a flowchart which shows the flow of the tendency analysis processing which concerns on this Embodiment 3. It is a figure which shows the example of the release history which concerns on this Embodiment 3. It is a block diagram which shows the whole structure of the utilization management system which concerns on this Embodiment 4. It is a block diagram which shows the structure of the use management terminal which concerns on this Embodiment 4. It is a block diagram which shows the structure of the usage management server which concerns on this Embodiment 4.

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are designated by the same reference numerals, and duplicate explanations are omitted as necessary for the sake of clarity of explanation.

<Embodiment 1>
FIG. 1 is a block diagram showing a configuration of a utilization management device 1 according to the first embodiment. The usage management device 1 is an information processing device for managing the use of a plurality of facilities (not shown) for which usage restrictions are applied. The usage management device 1 is connected to a plurality of facilities and an authentication device (not shown). The plurality of facilities include, for example, at least two or more of an entrance control device, a garbage storage, a delivery box, and an electric vehicle charger in an apartment house.

It is assumed that the authentication device stores in advance the facial feature information of a person who is permitted to use multiple facilities. Further, the authentication device receives input of face image or face feature information from the usage management device 1, collates with the face feature information stored in advance, determines a match or a mismatch, and outputs the determination result to the usage management device 1. do. Here, in the case of a match, the determination result is that the face authentication was successful, and in the case of a mismatch, the determination result is that the face authentication was unsuccessful. If the face authentication is successful, the determination result shall include the user ID of the person who succeeded in the face authentication.

The usage management device 1 includes an acquisition unit 11, an authentication control unit 12, a reception unit 13, a restriction release unit 14, a history registration unit 15, and a storage unit 16. The acquisition unit 11 acquires captured images taken by those who wish to use the plurality of facilities. The authentication control unit 12 causes the authentication device to perform face recognition on the captured image. The reception unit 13 accepts the selection of any of a plurality of facilities from the applicant. When the face recognition is successful, the restriction release unit 14 releases the restriction of the selected equipment. The history registration unit 15 registers the release history 170 in the storage unit 16. The storage unit 16 stores the release history 170. The release history 170 is associated with the equipment 171 whose restrictions have been released, the date and time 172, and the licensee 173. Here, the licensee 173 is a user who has succeeded in face recognition.

FIG. 2 is a flowchart showing the flow of the usage management method according to the first embodiment. First, the acquisition unit 11 acquires a photographed image taken by a person who wishes to use a plurality of facilities whose usage is restricted (S11). Next, the authentication control unit 12 causes the authentication device to perform face authentication on the captured image (S12). Then, the reception unit 13 accepts the selection of any of the plurality of facilities from the user who wishes to use the facility (S13). The authentication control unit 12 determines whether or not the face authentication is successful (S14). If the face recognition is successful, the restriction release unit 14 releases the restriction of the selected equipment (S15). Then, the history registration unit 15 registers in the storage unit 16 the release history 170 in which the restricted equipment 171 and the date and time 172 are associated with the licensee 173 who is a user who has succeeded in face recognition (S16). ..

In this way, according to the present embodiment, since the licensee 173 can grasp when and which equipment was used from the cancellation history 170, it is possible to comprehensively grasp the living conditions of the equipment users.

The usage management device 1 includes a processor, a memory, and a storage device as a configuration (not shown). Further, the storage device stores a computer program in which the processing of the electronic payment method according to the present embodiment is implemented. Then, the processor reads the computer program from the storage device into the memory and executes the computer program. As a result, the processor realizes the functions of the acquisition unit 11, the authentication control unit 12, the reception unit 13, the restriction release unit 14, the history registration unit 15, and the storage unit 16.

Alternatively, the acquisition unit 11, the authentication control unit 12, the reception unit 13, the restriction release unit 14, the history registration unit 15, and the storage unit 16 may each be realized by dedicated hardware. Further, a part or all of each component of each device may be realized by a general-purpose or dedicated circuitry, a processor, or a combination thereof. These may be composed of a single chip or may be composed of a plurality of chips connected via a bus. A part or all of each component of each device may be realized by a combination of the above-mentioned circuit or the like and a program. Further, as a processor, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (field-programmable gate array), or the like can be used.

Further, when a part or all of each component of the usage management device 1 is realized by a plurality of information processing devices and circuits, the plurality of information processing devices and circuits may be centrally arranged. It may be distributed. For example, the information processing device, the circuit, and the like may be realized as a form in which each of the client-server system, the cloud computing system, and the like is connected via a communication network. Further, the function of the usage management device 1 may be provided in the SaaS (Software as a Service) format.

<Embodiment 2>
The second embodiment is a modification of the first embodiment described above. The usage management device 1 according to the first embodiment has an external authentication device perform face authentication. On the other hand, the usage management device 1a according to the second embodiment performs face recognition inside the device.

FIG. 3 is a block diagram showing the configuration of the usage management device 1a according to the second embodiment. The usage management device 1a includes an acquisition unit 11, an authentication control unit 12a, a reception unit 13, a restriction release unit 14, a history registration unit 15, and a storage unit 16. Since the functions of the acquisition unit 11, the reception unit 13, the restriction release unit 14, and the history registration unit 15 are the same as those in the first embodiment, the description thereof will be omitted.

The storage unit 16 stores in advance the facial feature information 174 of a person who is permitted to use a plurality of facilities. The authentication control unit 12a uses the face feature information 174 to perform face authentication for the face area of the user who wants to be included in the captured image.

FIG. 4 is a flowchart showing the flow of the usage management method according to the second embodiment. In FIG. 4, step S12 in FIG. 2 is replaced with step S12a, and the other steps are the same as in FIG. In step S12a, the authentication control unit 12a performs face authentication on the captured image using the face feature information 174.

As described above, the same effect as that of the above-described first embodiment can be obtained by the second embodiment as well.

<Embodiment 3>
The third embodiment is a specific example of the first embodiment described above. FIG. 5 is a block diagram showing the overall configuration of the usage management system 1000 according to the third embodiment. The usage management system 1000 includes a usage management device 100, an entrance gate 210, a garbage storage 220, a delivery box 230, and an authentication device 400. The usage management device 100 and the authentication device 400 are connected via the network N. The network N is a wired or wireless communication line.

The entrance gate 210, the garbage storage 220, and the delivery box 230 are, for example, examples of equipment installed in a predetermined apartment house, and their use is restricted by the open / close controllers 211, 221 and 231. Each of the open / close controllers 211, 221 and 231 is connected to the utilization management device 100.

For example, the entrance gate 210 is a door (gate) for restricting the entrance of an apartment house, and includes an open / close controller 211. The open / close controller 211 controls to unlock the door in response to a control release signal from the utilization management device 100. The garbage storage 220 is a disposal site shared by residents of the apartment building, and is provided with an open / close controller 221. The open / close controller 221 controls to unlock the lid of the garbage storage 220 in response to the control release signal from the usage management device 100. The delivery box 230 is a storage box for temporarily storing the delivery items shared by the residents of the apartment building, and includes an open / close controller 231. The open / close controller 231 controls to unlock the lid of the delivery box 230 in response to the control release signal from the usage management device 100. The equipment connected to the usage management device 100 is not limited to these. The equipment connected to the usage management device 100 is, for example, an ordinary (standard charging speed) charger or quick charger for an electric vehicle (EV (Electric Vehicle)), a lock device for a shared bicycle, and a lock for a shared parking lot. Equipment, vending machines that make payments by face authentication, etc.

The authentication device 400 is an information processing device that stores the user ID of a person (for example, a resident of an apartment house) who is permitted to use the entrance gate 210, the garbage storage 220, and the delivery box 230 in association with the facial feature information. Is. Further, the authentication device 400 collates the face image or face feature information included in the request with the face feature information of each user in response to the face recognition request received from the outside, and requests the collation result (authentication result). Reply to the original.

FIG. 6 is a block diagram showing the configuration of the authentication device 400 according to the third embodiment. The authentication device 400 includes a face information DB 410, a face detection unit 420, a feature point extraction unit 430, a registration unit 440, and an authentication unit 450. The face information DB 410 stores the user ID 411 and the face feature information 412 of the user ID in association with each other. The face feature information 412 is a set of feature points extracted from the face image.

The face detection unit 420 detects the face area included in the registered image for registering face information and outputs it to the feature point extraction unit 430. The feature point extraction unit 430 extracts feature points from the face region detected by the face detection unit 420, and outputs face feature information to the registration unit 440. Here, the face feature information is a set of extracted feature points. Further, the feature point extraction unit 430 extracts the feature points included in the face image received from the usage management device 100, and outputs the face feature information to the authentication unit 450.

The registration unit 440 newly issues the user ID 411 when registering the facial feature information. The registration unit 440 registers the issued user ID 411 and the face feature information 412 extracted from the registered image in the face information DB 410 in association with each other. The authentication unit 450 performs face authentication using the face feature information 412. Specifically, the authentication unit 450 collates the face feature information extracted from the face image with the face feature information 412 in the face information DB 410. The authentication unit 450 returns to the usage management device 100 whether or not the facial feature information matches. The presence or absence of matching of facial feature information corresponds to the success or failure of authentication.

FIG. 7 is a flowchart showing the flow of the face information registration process according to the third embodiment. First, the authentication device 400 acquires the registered image included in the face information registration request (S21). For example, the authentication device 400 receives a face information registration request from a user terminal (not shown) or the like via the network N. Next, the face detection unit 420 detects the face region included in the registered image (S22). Next, the feature point extraction unit 430 extracts feature points from the face region detected in step S22, and outputs face feature information to the registration unit 440 (S23). Finally, the registration unit 440 issues the user ID 411, associates the user ID 411 with the face feature information 412, and registers the user ID 411 in the face information DB 410 (S24). The authentication device 400 may receive the face feature information 412 from the usage management device 100 or the like and register it in the face information DB 410 in association with the user ID 411.

FIG. 8 is a flowchart showing the flow of face recognition processing by the authentication device 400. First, the feature point extraction unit 430 acquires a face image for authentication included in the face recognition request (S31). For example, the authentication device 400 receives a face authentication request from the usage management device 100 via the network N, and extracts face feature information from the face image included in the face authentication request as in steps S21 to S23. Alternatively, the authentication device 400 may receive facial feature information from the usage management device 100. Next, the authentication unit 450 collates the acquired face feature information with the face feature information 412 of the face information DB 410 (S32). When the face feature information matches (Yes in S33), the authentication unit 450 identifies the user ID 411 of the user whose face feature information matches (S34), and manages the use of the user ID 411 identified as having succeeded in face recognition. Reply to the device 100 (S35). When there is no matching face feature information (No in S33), the authentication unit 450 returns to the usage management device 100 that the face authentication has failed (S36).

Return to Fig. 5 and continue the explanation. The usage management device 100 is an information terminal installed near the entrance of an apartment house. The usage management device 100 performs face authentication on the face area of the person (user U) included in the image captured by the camera, and unlocks the selected equipment when the face authentication is successful.

FIG. 9 is a block diagram showing the configuration of the usage management device 100 according to the third embodiment. The usage management device 100 includes a storage unit 110, a memory 120, a communication unit 130, a camera 140, a display unit 150, and a control unit 160. The storage unit 110 is a storage device for a hard disk, a flash memory, or the like. The storage unit 110 stores the program 111, the release history 112, and the notification setting 113. The program 111 is a computer program in which the processing of the usage management method according to the present embodiment is implemented.

The release history 112 is an example of the above-mentioned release history 170. The release history 112 is information in which the equipment ID 1121, the date and time 1122, and the user ID 1123 are associated with each other. The equipment ID 1121 is identification information of the equipment whose usage restriction (lock) is released because the user U succeeds in face authentication. The date and time 1122 is the date and time when the usage restrictions are lifted. The user ID 1123 is identification information of the user U who has succeeded in face authentication. The storage unit 110 stores a plurality of release histories 112, and may store two or more release histories per user.

The notification setting 113 is information in which the user ID 1131 and the notification destination 1132 are associated with each other. User ID 1131 is identification information of a resident of an apartment house. The notification destination 1132 is information indicating the contact information of a person who is a family member, a relative, or the like of a resident and who does not live in an apartment house. The notification destination 1132 is a telephone number, an e-mail address, or the like.

The memory 120 is a volatile storage device such as a RAM (Random Access Memory), and is a storage area for temporarily holding information when the control unit 160 operates. The communication unit 130 is a communication interface with the network N.

The camera 140 photographs the user U who wishes to use the equipment such as the entrance gate 210, and outputs the captured image to the control unit 160. The display unit 150 is a touch panel provided with a display device such as a display and an input unit. The display unit 150 displays a selection screen of the equipment (service) desired to be used, accepts the selection operation by the user U, and outputs the ID of the selected equipment to the control unit 160.

The control unit 160 is a processor, that is, a control device that controls each configuration of the usage management device 100. The control unit 160 reads the program 111 from the storage unit 110 into the memory 120 and executes the program 111. As a result, the control unit 160 realizes the functions of the acquisition unit 161, the authentication control unit 162, the reception unit 163, the restriction release unit 164, the history registration unit 165, the analysis unit 166, and the notification unit 167.

The acquisition unit 161 is an example of the acquisition unit 11 described above. The acquisition unit 161 acquires a captured image captured by the camera 140. It is assumed that the captured image includes the user U. Here, the user U is a person who wishes to use equipment such as the entrance gate 210.

The authentication control unit 162 is an example of the above-mentioned authentication control unit 12. The authentication control unit 162 causes the authentication device 400 to perform face recognition on the captured image acquired by the acquisition unit 161. For example, the authentication control unit 162 transmits a face authentication request including the acquired captured image to the authentication device 400 via the network N, and receives the face authentication result from the authentication device 400. The authentication control unit 162 may detect the face region of the user U from the captured image and include the image of the face region in the face authentication request. Alternatively, the authentication control unit 162 may extract the face feature information from the face region and include the face feature information in the face recognition request.

The reception unit 163 is an example of the reception unit 13 described above. When the face recognition is successful, the reception unit 163 causes the display unit 150 to display the selection screen of the equipment to be used. Then, the reception unit 163 receives the selected equipment ID in response to the selection operation on the selection screen by the user U.

The restriction release unit 164 is an example of the restriction release unit 14 described above. The restriction release unit 164 outputs a restriction release signal to the equipment corresponding to the selected equipment ID.

The history registration unit 165 is an example of the history registration unit 15 described above. The history registration unit 165 registers the release history 112 in which the restricted equipment ID 1121 and the date and time 1122 are associated with the user ID 1123 of the user U who has succeeded in face authentication in the storage unit 110.

The analysis unit 166 analyzes the usage tendency of each facility by the licensee from the cancellation history 112 registered in the storage unit 110. For example, when the release history 112 exists for a certain equipment ID 1121 of a certain user ID 1123 in a close time zone on the same day of the week for several months in a row, it can be grasped as the weekly life pattern (usage tendency) of the user.

The notification unit 167 notifies the notification destination corresponding to the licensee according to the cancellation history 112. That is, the notification unit 167 identifies the notification destination 1132 associated with the user ID 1131 and notifies the specified notification destination 1132. In particular, when the usage tendency analyzed by the analysis unit 166 is different from the predetermined tendency, the notification unit 167 may notify the notification destination 1132 to that effect. For example, if a user's usage tendency for the last two weeks is different from the user's normal usage tendency (several months two weeks or more ago), the person concerned can notify the person concerned of the user to that effect. It is possible to grasp changes in the living conditions of the user. Further, the notification unit 167 may determine whether or not the tendency is different from the predetermined tendency based on the combination of two or more devices in the cancellation history of a certain user. For example, the tendency of the user's outing time may be determined by combining the release histories of the two facilities, the “garbage storage” and the “entrance gate”.

FIG. 10 is a flowchart showing the flow of the restriction release process according to the third embodiment. First, the camera 140 takes a picture of the user U standing in front of the usage management device 100. Then, the acquisition unit 161 acquires a captured image including the user U from the camera 140 (S401). Next, the authentication control unit 162 makes a face recognition request to the authentication device 400 (S402). That is, the authentication control unit 162 transmits the face authentication request including the captured image to the authentication device 400 via the network N. Then, the authentication control unit 162 receives the face authentication result from the authentication device 400 via the network N (S403). The face authentication result includes a user ID that has succeeded in face authentication.

Here, the authentication control unit 162 determines whether or not the face authentication was successful from the face authentication result (S404). Specifically, the authentication control unit 162 determines whether or not the received face authentication result includes the fact that the face authentication was successful. When the face recognition is successful, the reception unit 163 outputs the selection screen of the equipment to be used to the display unit 150 and displays it (S405).

FIG. 11 is a diagram showing an example of the selection screen 500 of the equipment to be used according to the third embodiment. Here, it is assumed that there are five facilities connected to the usage management device 100. The five facilities are, for example, an EV charger and a lock device for a shared bicycle, in addition to the above-mentioned entrance gate 210, garbage storage 220, and delivery box 230. Further, it is assumed that the selection button 500 is displayed on the selection screen 500 from the viewpoint of the service provided by each facility. That is, the entrance button 510, the garbage disposal button 520, the home delivery receiving button 530, the EV charging button 540, and the bicycle share button 550 are displayed on the selection screen 500. The equipment ID of the corresponding equipment is associated with each button, and when pressed, the associated equipment ID is notified to the release history 112.

The entrance button 510 is a selection button for releasing the restriction of the open / close controller 211 and entering the apartment house from the entrance gate 210. The garbage disposal button 520 is a selection button for releasing the restriction of the open / close controller 221 and discarding the garbage in the garbage storage 220. The parcel delivery receiving button 530 is a selection button for releasing the restriction of the open / close controller 231 and receiving the parcel delivered to itself from the parcel delivery box 230. The EV charging button 540 is a selection button for unlocking the EV charger and charging the electric vehicle with the EV charger. The bicycle share button 550 is a selection button for unlocking the share bicycle and using the share bicycle.

Return to Fig. 10 and continue the explanation. The user U performs a selection operation on any button of the selection screen 500 displayed on the display unit 150. In response to this, the reception unit 163 accepts the selection of the equipment to be used (S406). Specifically, the reception unit 163 acquires the equipment ID associated with the button selected by the user U with respect to the selection screen 500.

Then, the restriction release unit 164 releases the restriction of the equipment corresponding to the selected equipment ID (S407). For example, when the waste disposal button 520 is pressed by the user U, the restriction release unit 164 accepts the selection of the equipment ID of the waste storage 220 and outputs the restriction release signal to the open / close controller 221.

After that, the history registration unit 165 registers the release history 112 in which the restricted equipment ID 1121 and the date and time 1122 are associated with the user ID 1123 of the user U who has succeeded in face authentication in the storage unit 110 (S408).

When face authentication fails in step S404, the control unit 160 outputs (displays) to the display unit 150 that the face authentication has failed (S409). In this case, the equipment is not unlocked, and the unauthorized use of the equipment by the user U can be prevented.

FIG. 12 is a flowchart showing the flow of the tendency analysis process according to the third embodiment. As a premise, it is assumed that the storage unit 110 stores the release history 112 for a predetermined period (for example, several months) for a specific user. Therefore, the analysis unit 166 analyzes the release history 112 for a specific user (S411). Specifically, the analysis unit 166 reads a plurality of release histories 112 including the specific user ID 1123 from the storage unit 110 when the date and time 1122 is within several months from the current date and time. Then, the analysis unit 166 analyzes the usage tendency of the plurality of read release histories 112. Here, a known technique can be used for the analysis process of the usage tendency. When a certain regularity is found at the date and time when a certain equipment is released, the analysis unit 166 can analyze the tendency that the equipment is used regularly in daily life. For example, if there is a release history of the garbage storage for a user every Monday and Thursday morning, it can be grasped as a life pattern of the user. Further, the analysis unit 166 may store and store the analyzed usage tendency in the storage unit 110 in association with the user. As a result, it can be used for comparison with the usage tendency analyzed at a later date for the same user.

Next, the notification unit 167 determines whether or not the usage tendency is different from the normal tendency (S412). The normal tendency may be a model life pattern. For example, as a normal tendency, the restrictions on the garbage storage may be lifted every Monday and Thursday between 7:00 am and 8:00 am. Alternatively, as a normal tendency, the past usage tendency of the same user may be used.

When it is determined in step S412 that the usage tendency is different from the normal tendency, the notification unit 167 notifies the notification destination that the usage tendency is different (S413). Specifically, the notification unit 167 refers to the notification setting 113, identifies the notification destination 1132 associated with the user ID 1131 to be analyzed, and notifies the specified notification destination 1132 of a predetermined message. The predetermined message may mean, for example, that the user to be analyzed shows a tendency different from the normal usage tendency. As a result, the family relatives and the like of the user to be analyzed can detect the possibility of the user's change at an early stage.

On the other hand, if it is determined in step S412 that the usage tendency is not different from the normal tendency, the notification unit 167 notifies the notification destination that the usage tendency is normal (S414). Specifically, the notification unit 167 refers to the notification setting 113, identifies the notification destination 1132 associated with the user ID 1131 to be analyzed, and notifies the specified notification destination 1132 of a predetermined message. The predetermined message may be, for example, that the user to be analyzed is in accordance with the normal usage tendency. As a result, the family members and relatives of the user to be analyzed can grasp that the user is safe. The notification in step S414 does not necessarily have to be performed.

FIG. 13 is a diagram showing an example of a release history in a specific user A according to the third embodiment. For example, first, it is assumed that the usage tendency is analyzed for the cancellation history from the 1st to the 19th of the X month. In this case, there is a usage tendency 1 that the restriction on the garbage storage is lifted every Monday and Thursday between 7:00 and 8:00, and it can be understood that the garbage is taken out regularly. In addition, there is a usage tendency 2 that the restriction on the entrance gate is lifted every Monday to Friday from 18:20 to 19:00, and it can be understood that the person returns home during this time on weekdays. Also, on Mondays and Thursdays, there is an interval of about 11 hours from the lifting of the restrictions on the garbage storage to the lifting of the restrictions on the entrance gate, so it is considered that they are out during this period. Therefore, it can be said that there is a usage tendency 3 of going out for about 11 hours on weekdays.

Next, it is assumed that the usage tendency is analyzed for the cancellation history from 22nd to 26th of X month. In this case, the restriction on the garbage storage has not been lifted on the 22nd, and it can be said that the tendency is different from the usage tendency 1. In addition, since the time for releasing the restriction on the entrance gate on weekdays is earlier than the usage tendency 2, it can be said that the tendency is different from the usage tendency 2. Furthermore, on the 25th, there is only about five and a half hours from the lifting of the restrictions on the garbage storage to the lifting of the restrictions on the entrance gate, and it can be said that the outing time is different from the usage tendency 3. In other words, it can be said that it was determined that the usage tendency based on the combination of the two facilities of the "garbage storage" and the "entrance gate" is different from the usual one. Therefore, the notification destination of the user A is notified in step S413 described above. As a result, the family member of the user A can detect the possibility of the accident of the user A at an early stage.

Here, the following three patterns have mainly existed in the monitoring service for distant families and relatives to grasp the living conditions of the elderly and the like. However, both patterns have disadvantages.

The first is to attach a sensor to the equipment used on the live activity line. The equipment used on the live activity line is, for example, a door or a toilet seat. In this case, there is an advantage that information can be acquired naturally in daily life. On the other hand, there is a demerit that an individual cannot be identified.

The second method is to attach the sensor to the body. The sensor is built in, for example, a wristwatch or a mobile phone. In this case, there is an advantage that information can be acquired naturally in daily life and an individual can be identified. On the other hand, it is necessary to attach a sensor to the body or carry it, but there is a demerit that information cannot be obtained if the subject does not do this.

The third method is to install surveillance sensors such as home cameras and street cameras. In this case, there is an advantage that information can be acquired naturally in daily life and it is not necessary to attach a sensor to the body. On the other hand, there is a disadvantage that privacy is not protected.

Also, while aging is becoming a social problem, frailty prevention is attracting attention. For that purpose, it is important to find a person who cannot live a normal life such as going out and shopping at an early stage and start treatment early.

Therefore, in the present embodiment, it is possible to realize early detection of frailty by applying a face recognition technology that does not require the installation or mounting of a sensor and can identify an individual to a place that is naturally used in daily life. can. Further, the present embodiment is not limited to early detection of frailty syndrome, and is also effective for grasping the living conditions of a child who lives alone away from his / her parents.

Further, in the present embodiment, it is possible to notify the safety information of the resident by using the history of face recognition by the face recognition terminal installed in a common place, which is naturally used in daily life.

<Embodiment 4>
The fourth embodiment is a modification of the third embodiment described above. In the fourth embodiment, the core processing of the usage management processing is performed on the server side. FIG. 14 is a block diagram showing the overall configuration of the usage management system 2000 according to the fourth embodiment. In the usage management system 2000, as compared with the usage management system 1000 described above, the usage management device 100 is replaced with the usage management terminal 600, and the usage management server 100a is added. The usage management terminal 600 and the usage management server 100a are connected to the network N. Since other configurations of the usage management system according to the fourth embodiment are the same as those of the third embodiment, duplicate description will be omitted below.

FIG. 15 is a block diagram showing the configuration of the usage management terminal 600 according to the fourth embodiment. The usage management terminal 600 is an information terminal installed near the entrance of an apartment house. Further, the usage management terminal 600 is connected to the open / close controllers 211, 221 and 231 in the same manner as the usage management device 100. The usage management terminal 600 includes a storage unit 610, a memory 620, a communication unit 630, a camera 640, a display unit 650, and a control unit 660. The storage unit 610, memory 620, communication unit 630, camera 640, and display unit 650 are equivalent to the storage unit 110, memory 120, communication unit 130, camera 140, and display unit 150 described above. Omit.

The control unit 660 is a processor, that is, a control device that controls each configuration of the usage management terminal 600. The control unit 660 reads the program 611 from the storage unit 610 into the memory 620 and executes the program 611. As a result, the control unit 660 realizes the functions of the photographing unit 661, the restriction release unit 662, and the display control unit 663.

The shooting unit 661 controls the camera 640 to shoot a shot image including the user U who wants to use the equipment such as the entrance gate 210. The photographing unit 661 transmits the photographed image to the usage management server 100a via the network N.

The restriction release unit 662 receives the restriction release instruction for which the equipment ID is specified from the usage management server 100a via the network N, and receives the restriction release instruction for any of the open / close controllers 211, 221 or 231 corresponding to the specified equipment ID. Outputs a restriction release signal.

The display control unit 663 displays various output information received from the usage management server 100a via the network N on the display unit 650.

FIG. 16 is a block diagram showing the configuration of the usage management server 100a according to the fourth embodiment. The usage management server 100a does not require the camera 140 and the display unit 150 as compared with the usage management device 100 described above. Further, the control unit 160 may include at least an acquisition unit 161, an authentication control unit 162, a reception unit 163, a restriction release unit 164, and a history registration unit 165. Further, each configuration of the control unit 160 shall transmit and receive data to and from the usage management terminal 600 via the network N and the communication unit 130. Other functions are the same as the above-described configuration.

As described above, the effect of the above-described third embodiment can be obtained also by the present embodiment.

<Other Embodiments>
In the above-described embodiment, the description is made as a hardware configuration, but the present invention is not limited to this. The present disclosure can also be realized by causing the CPU to execute a computer program.

In the above example, the program can be stored and supplied to a computer using various types of non-transitory computer readable medium. Non-temporary computer-readable media include various types of tangible storage mediums. Examples of non-temporary computer-readable media include magnetic recording media (eg, flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (eg, magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, Includes CD-R / W, DVD (Digital Versatile Disc), semiconductor memory (for example, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory)). The program may also be supplied to the computer by various types of temporary computer readable medium. Examples of temporary computer-readable media include electrical, optical, and electromagnetic waves. The temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.

Note that this disclosure is not limited to the above embodiment, and can be appropriately modified without departing from the spirit. Further, the present disclosure may be carried out by appropriately combining the respective embodiments.

Some or all of the above embodiments may also be described, but not limited to:
(Appendix A1)
An acquisition unit that acquires captured images taken by those who wish to use multiple facilities with restricted usage,
An authentication control unit that authenticates the face of the photographed image to an authentication device that stores facial feature information of a person who is permitted to use the plurality of facilities.
A reception unit that accepts the selection of any of the plurality of facilities from the applicant, and
When the face recognition is successful, the restriction release unit that releases the restriction of the selected equipment and the restriction release unit
A history registration unit that registers in the storage unit a release history that associates the equipment and date and time for which the restrictions have been released with the licensee who is the user who has succeeded in face recognition.
Usage management device equipped with.
(Appendix A2)
The usage management device according to Appendix A1, further comprising a notification unit that notifies a notification destination corresponding to the licensee according to the cancellation history.
(Appendix A3)
Further equipped with an analysis unit that analyzes the usage tendency of each facility by the licensee from the cancellation history.
The usage management device according to Appendix A2, wherein the notification unit notifies the notification destination when the analyzed usage tendency is different from a predetermined tendency.
(Appendix A4)
In the storage unit, the cancellation history of two or more facilities is registered for each licensed user.
The usage management device according to Appendix A3, wherein the notification unit determines whether or not the tendency is different from the predetermined tendency based on the combination of the two or more facilities.
(Appendix A5)
The usage management device according to any one of Supplementary A1 to A4, wherein the plurality of facilities include at least two or more of an entrance control device, a garbage storage, a delivery box, and an electric vehicle charger in an apartment house.
(Appendix B1)
A storage unit that stores facial feature information of people who are permitted to use multiple facilities with restricted usage,
An acquisition unit that acquires captured images taken by those who wish to use the plurality of facilities, and
An authentication control unit that performs face recognition on the captured image using the face feature information,
A reception unit that accepts the selection of any of the plurality of facilities from the applicant, and
When the face recognition is successful, the restriction release unit that releases the restriction of the selected equipment and the restriction release unit
A history registration unit that registers in the storage unit a release history in which the restricted equipment and the date and time are associated with a user who is a user who wants to use the face authentication successfully.
Usage management device equipped with.
(Appendix B2)
The usage management device according to Appendix B1, further comprising a notification unit that notifies a notification destination corresponding to the licensee according to the cancellation history.
(Appendix C1)
A usage management device connected to multiple facilities with usage restrictions,
It is equipped with an authentication device that stores facial feature information of a person who is permitted to use the plurality of facilities.
The usage management device is
An acquisition unit that acquires captured images taken by those who wish to use the plurality of facilities, and
An authentication control unit that causes the authentication device to perform face authentication on the captured image,
A reception unit that accepts the selection of any of the plurality of facilities from the applicant, and
When the face recognition is successful, the restriction release unit that releases the restriction of the selected equipment and the restriction release unit
A history registration unit that registers in the storage unit a release history that associates the equipment and date and time for which the restrictions have been released with the licensee who is the user who has succeeded in face recognition.
Usage management system equipped with.
(Appendix C2)
The usage management device is
The usage management system according to Appendix C1, further including a notification unit that notifies a notification destination corresponding to the usage permitter according to the cancellation history.
(Appendix D1)
The computer
Acquire captured images taken by those who wish to use multiple facilities with restricted usage,
The authentication device that stores the facial feature information of the person who is permitted to use the plurality of facilities is made to perform face authentication on the captured image.
Accepting the selection of any of the plurality of facilities from the applicant,
If the face recognition is successful, the restriction on the selected equipment is released and the face recognition is released.
The release history in which the restricted equipment and the date and time are associated with the licensee who is the user who has succeeded in face recognition is registered in the storage unit.
Usage management method.
(Appendix E1)
A computer equipped with a storage unit that stores facial feature information of a person who is permitted to use multiple facilities with restricted usage
Acquired captured images taken by those who wish to use the plurality of facilities,
Face recognition is performed on the captured image using the face feature information.
Accepting the selection of any of the plurality of facilities from the applicant,
If the face recognition is successful, the restriction on the selected equipment is released and the face recognition is released.
The release history in which the restricted equipment and the date and time are associated with the licensee who is the user who has succeeded in face recognition is registered in the storage unit.
Usage management method.
(Appendix F1)
Acquisition processing to acquire captured images taken by those who wish to use multiple facilities with usage restrictions,
An authentication control process that causes an authentication device that stores facial feature information of a person who is permitted to use a plurality of facilities to perform face authentication on the captured image.
Reception processing that accepts the selection of any of the plurality of facilities from the applicant, and
If the face recognition is successful, the restriction release process for releasing the restriction on the selected equipment and the restriction release process
A history registration process for registering a release history in the storage unit in which the restricted equipment and the date and time are associated with the user who is the user who wants to use the face authentication successfully.
A usage management program that causes a computer to execute.
(Appendix G1)
A computer equipped with a storage unit that stores facial feature information of a person who is permitted to use multiple facilities with restricted usage.
An acquisition process for acquiring captured images taken by a person who wishes to use the plurality of facilities, and
Authentication control processing that performs face recognition on the captured image using the face feature information, and
Reception processing that accepts the selection of any of the plurality of facilities from the applicant, and
If the face recognition is successful, the restriction release process for releasing the restriction on the selected equipment and the restriction release process
A history registration process for registering a release history in the storage unit in which the restricted equipment and the date and time are associated with a user who is a user who has succeeded in face recognition and is a user who wants to use the face.
Usage management program to execute.

Although the invention of the present application has been described above with reference to the embodiments (and examples), the invention of the present application is not limited to the above-described embodiments (and examples). Various changes that can be understood by those skilled in the art can be made within the scope of the present invention in terms of the structure and details of the present invention.

This application claims priority based on Japanese application Japanese Patent Application No. 2020-056490 filed on March 26, 2020, and incorporates all of its disclosures herein.

1 Usage management device 1a Usage management device 11 Acquisition unit 12 Authentication control unit 12a Authentication control unit 13 Reception unit 14 Restriction release unit 15 History registration unit 16 Storage unit 170 Release history 171 Equipment 172 Date and time 173 User permitter 174 Face feature information 1000 Usage Management system 2000 Usage management system 100 Usage management device 100a Usage management server 110 Storage 111 Program 112 Release history 1121 Equipment ID
1122 Date and time 1123 User ID
113 Notification settings 1131 User ID
1132 Notification destination 120 Memory 130 Communication unit 140 Camera 150 Display unit 160 Control unit 161 Acquisition unit 162 Authentication control unit 163 Reception unit 164 Restriction release unit 165 History registration unit 166 Analysis unit 167 Notification unit 210 Entrance gate 211 Open / close controller 220 Garbage storage Storage 221 Open / close controller 230 Delivery box 231 Open / close controller 400 Authentication device 410 Face information DB
411 User ID
412 Face feature information 420 Face detection section 430 Feature point extraction section 440 Registration section 450 Authentication section 500 Selection screen 510 Entrance button 520 Garbage disposal button 530 Home delivery button 540 EV charging button 550 Bicycle share button 600 Usage management terminal 610 Storage section 611 Program 620 Memory 630 Communication unit 640 Camera 650 Display unit 660 Control unit 661 Imaging unit 662 Restriction release unit 663 Display control unit U User N Network

Claims (13)

1. An acquisition method for acquiring captured images taken by those who wish to use multiple facilities with restricted usage,
   An authentication control means that causes an authentication device that stores facial feature information of a person who is permitted to use the plurality of facilities to perform face authentication on the captured image.
   A reception means that accepts the selection of any of the plurality of facilities from the applicant, and
   If the face recognition is successful, the restriction release means for releasing the restriction of the selected equipment and the restriction release means.
   A history registration means for registering a release history in a storage means in which the restricted equipment and the date and time are associated with a user who is a user who wants to use the face authentication successfully.
   Usage management device equipped with.
2. The usage management device according to claim 1, further comprising a notification means for notifying the notification destination corresponding to the licensee according to the cancellation history.
3. Further provided with an analysis means for analyzing the usage tendency of each facility by the licensee from the cancellation history.
   The usage management device according to claim 2, wherein when the analyzed usage tendency is different from a predetermined tendency, the notification means notifies the notification destination to that effect.
4. In the storage means, the cancellation history of two or more facilities is registered for each licensed user.
   The utilization management device according to claim 3, wherein the notification means determines whether or not the tendency is different from the predetermined tendency based on the combination of the two or more facilities.
5. The usage management device according to any one of claims 1 to 4, wherein the plurality of facilities include at least two or more of an entrance control device, a garbage storage, a delivery box, and an electric vehicle charger in an apartment house.
6. A storage means for storing facial feature information of a person who is permitted to use multiple facilities with restricted usage,
   An acquisition means for acquiring captured images taken by a person who wishes to use the plurality of facilities, and
   An authentication control means for performing face recognition on the captured image using the face feature information, and
   A reception means that accepts the selection of any of the plurality of facilities from the applicant, and
   If the face recognition is successful, the restriction release means for releasing the restriction of the selected equipment and the restriction release means.
   A history registration means for registering a release history in which the restriction-released equipment and date and time are associated with a user who is a user who is a user who has succeeded in face recognition and is a user who wants to use the face.
   Usage management device equipped with.
7. The usage management device according to claim 6, further comprising a notification means for notifying the notification destination corresponding to the licensee according to the cancellation history.
8. A usage management device connected to multiple facilities with usage restrictions,
   It is equipped with an authentication device that stores facial feature information of a person who is permitted to use the plurality of facilities.
   The usage management device is
   An acquisition means for acquiring captured images taken by a person who wishes to use the plurality of facilities, and
   An authentication control means for causing the authentication device to perform face recognition on the captured image,
   A reception means that accepts the selection of any of the plurality of facilities from the applicant, and
   If the face recognition is successful, the restriction release means for releasing the restriction of the selected equipment and the restriction release means.
   A history registration means for registering a release history in a storage means in which the restricted equipment and the date and time are associated with a user who is a user who wants to use the face authentication successfully.
   Usage management system equipped with.
9. The usage management device is
   The usage management system according to claim 8, further comprising a notification means for notifying the notification destination corresponding to the licensee according to the cancellation history.
10. The computer
    Acquire captured images taken by those who wish to use multiple facilities with restricted usage,
    The authentication device that stores the facial feature information of the person who is permitted to use the plurality of facilities is made to perform face authentication on the captured image.
    Accepting the selection of any of the plurality of facilities from the applicant,
    If the face recognition is successful, the restriction on the selected equipment is released and the face recognition is released.
    The release history in which the restricted equipment and the date and time are associated with the licensee who is the user who has succeeded in face recognition is registered in the storage means.
    Usage management method.
11. A computer equipped with a storage means for storing facial feature information of a person who is permitted to use multiple facilities with restricted usage
    Acquired captured images taken by those who wish to use the plurality of facilities,
    Face recognition is performed on the captured image using the face feature information.
    Accepting the selection of any of the plurality of facilities from the applicant,
    If the face recognition is successful, the restriction on the selected equipment is released and the face recognition is released.
    The release history in which the restricted equipment and the date and time are associated with the licensee who is the user who has succeeded in face recognition is registered in the storage means.
    Usage management method.
12. Acquisition processing to acquire captured images taken by those who wish to use multiple facilities with usage restrictions,
    An authentication control process that causes an authentication device that stores facial feature information of a person who is permitted to use a plurality of facilities to perform face authentication on the captured image.
    Reception processing that accepts the selection of any of the plurality of facilities from the applicant, and
    If the face recognition is successful, the restriction release process for releasing the restriction on the selected equipment and the restriction release process
    A history registration process for registering a release history in a storage means in which the restricted equipment and the date and time are associated with a user who is a user who has succeeded in face recognition and is a user who wants to use the face.
    A non-temporary computer-readable medium that contains a usage management program that causes a computer to execute.
13. A computer equipped with a storage means for storing facial feature information of a person who is permitted to use a plurality of restricted facilities.
    An acquisition process for acquiring captured images taken by a person who wishes to use the plurality of facilities, and
    Authentication control processing that performs face recognition on the captured image using the face feature information, and
    Reception processing that accepts the selection of any of the plurality of facilities from the applicant, and
    If the face recognition is successful, the restriction release process for releasing the restriction on the selected equipment and the restriction release process
    A history registration process for registering a release history in which the restriction-released equipment and the date and time are associated with a user who is a user who has succeeded in face recognition and is a user who wants to use the face authentication in the storage means.
    A non-temporary computer-readable medium that contains a usage management program that executes.

Images