WO2023176167A1

WO2023176167A1 - Registration device, registration method, and program

Info

Publication number: WO2023176167A1
Application number: PCT/JP2023/002510
Authority: WO
Inventors: 智之加賀屋
Original assignee: パナソニックＩｐマネジメント株式会社
Priority date: 2022-03-17
Filing date: 2023-01-26
Publication date: 2023-09-21
Also published as: JP2023136750A

Abstract

A registration device according one embodiment of the present disclosure comprises: an estimation unit that, on the basis of an image captured by an imaging device, estimates whether or not a first person and a second person are acting together; and a registration unit that, when first biological information for authentication of the first person and a first right are registered and second biological information for authentication of the second person is not registered, registers, for the second person acting together with the first person and on the basis of the result of the estimation, second biological information included in the image and a second right to take a prescribed action on the condition that action is performed together with the person for whom the first right is registered, and updates the second right to the first right in response to the prescribed condition having been met.

Description

Registration device, registration method and program

The present disclosure relates to a registration device, a registration method, and a program.

Personal authentication based on facial image analysis (hereinafter referred to as face authentication) is used in various fields. Face authentication involves registering (memorizing) a facial image (hereinafter also referred to as a face, facial information, or facial information) of a person to be registered in advance, and then using a facial image of the person to be authenticated taken by a camera. This is done by comparing it with a face image that has been registered in advance. If the face image of the person to be authenticated matches a face image registered in advance, the identity of the person is confirmed (authentication is successful).

Regarding registration of facial images, for example, Patent Document 1 discloses an authentication device that additionally registers facial information used for authentication.

This authentication device acquires an image, extracts a face from the acquired image, and compares the extracted face information with the face information registered in the authentication information stored in the storage unit. , determine whether the face information is registered in the authentication information. In addition, this authentication device extracts from the acquired image a face that is determined to be a face whose information is registered in the authentication information and a face that is determined to be a face whose information is not registered in the authentication information. Then, information about a face extracted from the acquired image and determined to be not the face whose information is registered in the authentication information is registered in the authentication information.

Japanese Patent Application Publication No. 2013-114304

In the above conventional technology, in the camera image, a person who appears together with the person (registrant) whose face is registered in the authentication information (a person whose face is determined not to be the face whose information is registered in the authentication information; registrant) with the same authority as the registrant. Therefore, if strong authority is given to registrants, strong authority will also be given to unregistered persons, which poses a risk in offices where visitors must be restricted. Yes, there are security issues.

In addition, in recent years, a solution called gateless entrance, which allows people to verify their identity without having to stop at an entrance gate or security check by a security guard, has been considered and is being realized in offices and other places. In a case where an authentication camera installed near such a gateless entrance captures a wide area and performs facial recognition on many people passing by, applying the above conventional technology will prevent the identification of the wrong person's face. may be registered. In such a case, there is a risk of giving strong authority to the wrong person, which poses a security problem.

On the other hand, if the authority of the additional registrant who is the person to be authenticated remains restricted due to too much emphasis on security, the convenience of the person to be authenticated may be insufficient.

Non-limiting embodiments of the present disclosure contribute to providing a registration device, a registration method, and a program for registering information of a person to be authenticated, which can achieve both security and convenience for the person to be authenticated.

A registration device according to an embodiment of the present disclosure includes an estimation unit that estimates whether a first person and a second person are acting together based on an image photographed by a photographing device; If the first biometric information for authentication of the first person and the first authority are registered, and the second biometric information for authentication of the second person is not registered, the result of the estimation is Based on the second person who is acting together with the first person, the second biometric information included in the image and the person for whom the first authority is registered. a second authority that can perform a predetermined action on the condition that they act together, and in response to the predetermined condition being met, the second authority becomes the first authority. and a registration unit for updating.

A registration method according to an embodiment of the present disclosure estimates whether or not a first person and a second person are acting together based on an image photographed by a photographing device, and If the first biometric information for person authentication and the first authority are registered, and the second biometric information for authentication of the second person is not registered, based on the result of the estimation, , for the second person who is acting together with the first person, the second biometric information included in the image and the person acting together with the person for whom the first authority is registered; A second authority that can perform a predetermined action on the condition that the user performs a predetermined action is registered, and in response to the predetermined condition being met, the second authority is updated to the first authority.

A program according to an embodiment of the present disclosure causes a computer to estimate whether a first person and a second person are acting together based on an image photographed by a photographing device, and to estimate whether a first person and a second person are acting together. If the first biometric information for authentication of the first person and the first authority are registered, and the second biometric information for authentication of the second person is not registered, the result of the estimation Based on the second person acting together with the first person, the second biometric information included in the image and the first authority are the same as the registered person. a second authority that can perform a predetermined action on the condition that the user takes the action, and updates the second authority to the first authority in response to the predetermined condition being met. to perform the steps.

Note that these comprehensive or specific aspects may be realized by a system, an apparatus, a method, an integrated circuit, a computer program, or a recording medium. It may be realized by any combination of the following.

According to an embodiment of the present disclosure, the first biometric information for authentication and the first authority are registered for a second person who is acting together with the first person, and the first biometric information for authentication and the first authority are registered. second biometric information, and a second authority that allows the user to perform a predetermined action on the condition that the person acts together with the person for whom the first authority is registered. Further, the second authority is updated to the first authority for the second person in response to a predetermined condition being satisfied. In this way, the biometric information of an unregistered second person who is acting together with a registered first person can be used to perform a predetermined action on the condition that the second person acts together with the first person, etc. The second authority is registered together with the second authority that can perform the following actions, and the second authority is updated to the first authority so that the restrictions are relaxed depending on the predetermined conditions being met, so security and the second authority are updated. It is possible to achieve both convenience for the person.

Further advantages and effects of an embodiment of the present disclosure will become apparent from the specification and drawings. Such advantages and/or effects may be provided by each of the several embodiments and features described in the specification and drawings, but not necessarily all are provided in order to obtain one or more of the same features. There isn't.

A block diagram showing a configuration example of a face authentication/registration system according to an embodiment of the present disclosure A block diagram showing a configuration example of an authentication/registration device according to an embodiment of the present disclosure Flowchart showing an example of the operation of the authentication/registration device according to the embodiment of the present disclosure Flowchart showing another example of operation of the authentication/registration device according to the embodiment of the present disclosure Flowchart showing yet another example of operation of the authentication/registration device according to the embodiment of the present disclosure A diagram showing an example hardware configuration of a computer according to an embodiment of the present disclosure

Hereinafter, embodiments of the present disclosure will be described in detail with appropriate reference to the drawings. However, more detailed explanation than necessary may be omitted. For example, detailed explanations of well-known matters or redundant explanations of substantially the same configurations may be omitted. This is to avoid unnecessary redundancy in the following description and to facilitate understanding by those skilled in the art.

The accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter recited in the claims.

(Embodiment)
<Configuration of face recognition/registration system>
FIG. 1 is a block diagram showing a configuration example of a face authentication/registration system 1 according to an embodiment of the present disclosure.

As shown in FIG. 1, the face authentication/registration system 1 includes a camera 10 and an authentication/registration device 20. The camera 10 and the authentication/registration device 20 are connected via a wired or wireless network 30.

The camera 10 is installed at various positions within a predetermined area, such as near the entrance of a building or facility, inside a room within the building or facility, on a side wall of a passageway of the building or facility, on the ceiling, or on a columnar structure. The predetermined area may be inside a building, such as an office building, a shopping mall, an underground mall, a station, an airport, or a public facility, or may be outdoors, such as a park, a ball game field, or a zoo. Note that, as an example, the following description assumes a scenario in which the face authentication/registration system 1 is used for gateless face authentication applied at the above-mentioned gateless entrance of an office. The scenarios in which this is used are not limited to the above. The camera 10 transmits a captured image (hereinafter referred to as a "captured image") to the authentication/registration device 20 via the network 30. The photographed image may be a still image or a moving image. The camera 10 only needs to have the ability to generate a photographed image at a resolution that allows the authentication/registration device 20 to recognize the face of a person present in the photographed image. The camera 10 may be referred to as a photographing device, an imaging device, a photographing section, an imaging section, or the like.

The authentication/registration device 20 receives unique identification information of a person (for example, each of all employees working in an office) inputted by a user such as an administrator of the face authentication/registration system 1, and the person. The face of the person and the action authority of the person are registered (stored in the storage unit of the authentication/registration device 20). The authentication/registration device 20 is an example of a registration device, an authentication device, an information processing device, a computer, etc. according to the present disclosure.

Here, a person's action authority is roughly divided into individual action authority and group action authority. Group action authority means the authority to act only when accompanied by a registered person who has solo action authority (one can only act together with a registered person who has solo action authority). On the other hand, the authority to act alone means the authority to act even if the person is not accompanied by a registered person who has the authority to act alone (even by one person). In this disclosure, a person whose identification information and face are registered (memorized) in the authentication/registration device 20 is referred to as a registered person (or simply a registrant), and a person whose identification information and face are registered (memorized) in the authentication/registration device 20 is referred to as a registered person (or simply a registrant). A person who is not registered is called an unregistered person. The solo action authority is an example of the "first authority" according to the present disclosure, and the group action authority is an example of the "second authority more limited than the first authority" and the "first authority" according to the present disclosure. This is an example of "a second authority that allows a person to perform a predetermined action on the condition that the person acts together with the person for whom the person is registered." In addition, "group action authority" means "to act together with (all) registered users who are recorded as planning to act together with visitors (unregistered persons) in the setting information (described later). It may also be expressed as "authority to perform predetermined actions, subject to the following conditions." Note that various actions that require authority include entering and exiting a specific space, operating equipment, and paying expenses.

The authentication/registration device 20 estimates the number of people acting together in a group (group estimation), identifies (detects) the person to be authenticated, and authenticates the person to be authenticated based on the captured image received from the camera 10. , execute. The authentication/registration device 20 further registers (the face, etc.) of the unregistered person to be authenticated, registers the action authority of the person to be authenticated, and updates the action authority (registration and (Updating may also be referred to as granting) and determining violation of the authority to act by the person to be authenticated. Note that estimation may also be referred to as determination, determination, discrimination, estimation, calculation, or the like.

The authentication/registration device 20 estimates whether or not a plurality of people are acting together as a group based on the image taken by the camera 10.

When unregistered persons who have been set in advance to act together and registered persons who have the authority to act alone are acting together as a group, the authentication/registration device 20 uses an image taken by the camera 10 to The faces of the unregistered persons included and the identification information of the unregistered persons are registered in association with each other (corresponding or linked).

At the time of this registration, the authentication/registration device 20 sets the unregistered person's face and unregistered person's action authority as group action authority, which can be updated according to the fulfillment of predetermined conditions, to Register in association with the identification information of.

As described above, an unregistered person who is considered to be reliable to some extent because he or she is acting together with a registered person who has the authority to act alone is automatically registered with the authority to act in a group. As a result, at the time of automatic registration, the action authority of a person who is considered to be reliable to some extent but who is an unregistered person is limited to the group action authority, so security can be ensured. Further, since the action authority granted at the time of automatic registration is limited to group action authority, it is possible to suppress the risk when the wrong person is registered. Furthermore, the action authority of a person who was an unregistered person can be updated, for example, from group action authority to solo action authority, depending on the fulfillment of conditions; For example, even a single person can move around an office or the like, thereby improving the convenience of an unregistered person.

<Configuration of authentication/registration device>
FIG. 2 is a block diagram showing a configuration example of the authentication/registration device 20. As shown in FIG.

The authentication/registration device 20 includes a person visit information registration section 201, a person visit information storage section 202, an image reception section 203, an image storage section 204, a group estimation section 205, an authentication/registration section 206, and a registrant. It has an information storage section 207 and an action authority violation determination section 208.

The person visit information registration unit 201 stores unique identification information of a person visiting the office (an example of a "second person" according to the present disclosure) input and set by the user of the face authentication/registration system 1, and the information of the person visiting the office. The date and time the person visits the office, and the identification of the registered person accompanying the person (an example of a “first person” according to this disclosure; for example, an employee working in the office who attends the person visiting) information and are respectively associated with each other and outputted (stored) to the person visit information storage unit 202 as person visit information (which may be referred to as setting information). This person visit information is set and registered in advance, and indicates that the visiting person and the registered person will act together. Note that the person visit information may or may not include the date and time of the person's visit. Person visit information may be called a visit pattern or pattern. Further, the number of the second persons may be plural. Note that in this embodiment, it is not assumed that the face information of the second person is not registered in advance, so when multiple second persons visit at the same time, the authority of each person is managed. In order to identify the second person, other information is used to identify the second person. In this case, for example, it is conceivable to identify each second person using a technique for estimating the attributes (gender, age, etc.) of the person visiting.

The person visit information registration unit 201 stores person visit information.

The image receiving unit 203 receives captured images from each camera 10 via the network 30. The image receiving unit 203 also receives the captured image and unique identification information of the camera 10 that transmitted the captured image (for example, indicating that the camera 10 is installed at an entrance or the like). The image receiving unit 203 associates the received captured image, the identification information of the captured image, and the identification information of the camera 10 that transmitted the captured image, and outputs them to the image storage unit 204. The photographed image includes the date and time when the photographed image was photographed as metadata.

The image storage unit 204 stores the photographed image together with identification information of the photographed image and identification information of the camera 10 that transmitted the photographed image.

The group estimation unit 205 determines whether the people included in the captured images stored in the image storage unit 204 form a group, based on the captured images stored in the image storage unit 204 and existing group estimation technology. Estimate. For example, the group estimating unit 205 estimates a group using the distance between people in the photographed image and the movement lines. Note that a group refers to a group of people acting together.

More specifically, the group estimation unit 205 may estimate the group based on the movement route of each person in the captured image. For example, the group estimating unit 205 may analyze the movement trajectory of each person and estimate that persons with similar movement trajectories form the (same) group. Furthermore, the group estimating unit 205 calculates mutual relative distances and relative velocities for all combinations of people from the positions of the people in the photographed images at each time, and determines whether the people in each combination form the (same) group. It may also be determined whether the For example, the group estimating unit 205 determines whether the relative distance remains below a certain threshold for a certain period of time or more, or whether the relative distance and relative velocity both have values smaller than a predetermined threshold in a certain time interval. The determination may be made based on whether or not it is maintained. In this case, the group estimating unit 205 determines whether the relative distance remains below a certain threshold for a certain period of time or more, or when the relative distance and relative speed both maintain values smaller than the predetermined threshold in a certain time interval. If so, it may be assumed that the people form a group. Note that the method for estimating groups is not limited to those using movement trajectories, relative distances, relative speeds, etc., and various known methods may be used. For example, the group estimation unit 205 may estimate a group using face orientation information of a person in a photographed image.

Furthermore, the group estimating unit 205 detects and extracts a person's face from the captured image stored in the image storage unit 204. For example, the group estimation unit 205 detects faces using a classifier created in advance to detect faces. As such a classifier, for example, a Haar-Like cascade classifier created in advance for detecting faces in an open source image processing library can be used. Alternatively, the group estimation unit 205 may detect faces by pattern matching. The group estimation unit 205 detects and extracts the faces of both people who form a group and people who do not form a group.

Furthermore, the group estimation unit 205 executes face tracking based on the captured images stored in the image storage unit 204. For example, the group estimation unit 205 determines the identity of a person based on the continuity of the captured images based on the relationship between the captured images of the position of the face obtained as a result of face detection, and tracks the faces of the same person. .

The group estimation unit 205 includes the estimation result (whether a group is formed or not), the identification information of the photographed image from which the estimation is made, the detected and extracted faces, and the identification information of the photographed image from which the face is detected and extracted. , and the tracking results are output to the authentication/registration unit 206 and the action authority violation determination unit 208.

The authentication/registration unit 206 receives unique identification information of a person (for example, an employee working in an office) input by the user of the face authentication/registration system 1, the face of the person, and the action authority of the person ( authority or authority information) are associated with each other and registered as registrant information (stored in the registrant information storage unit 207).

Further, the authentication/registration unit 206 performs identity verification (authentication) by comparing the face input from the group estimation unit 205 with the face of a registered person stored in the registrant information storage unit 207. . If a face that matches the face input from group estimating unit 205 is stored in registrant information storage unit 207 (if authentication is successful), authentication/registration unit 206 does not perform any operation. More specifically, the authentication/registration unit 206 may perform authentication based on the degree of similarity between the face input from the group estimation unit 205 and the face stored in the registrant information storage unit 207. For example, the higher the degree of similarity with the face stored in the registrant information storage unit 207, the higher the information regarding the degree of similarity (hereinafter referred to as "authentication score") may be set. Then, the authentication/registration unit 206 may determine that the face input from the group estimation unit 205 and the face stored in the registrant information storage unit 207 match, for example, when the authentication score is equal to or higher than the threshold value. . On the other hand, if the authentication score is less than the threshold, for example, the authentication/registration unit 206 determines that the face input from the group estimation unit 205 and the face stored in the registrant information storage unit 207 do not match. It's fine.

If the face that matches the face input from the group estimation unit 205 is not stored in the registrant information storage unit 207 (for example, if the authentication score is less than the threshold), the authentication/registration unit 206 first In the image, identify registered users who have independent action authority indicated by the setting information stored in the person visit information storage unit 202 and who form a group obtained from the estimation results input from the group estimation unit 205. do. Next, the authentication/registration unit 206 determines whether the persons whose faces input from the group estimation unit 205 are not stored in the registrant information storage unit 207 form the group, as indicated by the setting information. The identification information of the visitor accompanying the registered person (unregistered person), the person's face, and the group action authority as the person's action authority are associated with each other and registered as registrant information (registrant (stored in the information storage unit 207). At the time of this registration, the authentication/registration unit 206 also registers, as registrant information, the identification information of the already registered person who has the individual action authority indicated by the setting information, in addition to the group action authority. This means that this visitor cannot act unless he or she is with this registered person. In this way, in order to register an unregistered person, setting information indicating that the unregistered person will act together with a registered person is required in advance, so it is possible to confirm that the unregistered person is a reliable person to some extent. can be guaranteed and security can be ensured.

Further, the face that matches the face input from the group estimation unit 205 is not stored in the registrant information storage unit 207, and the person whose face is input from the group estimation unit 205 has the authority to act alone. If a group has not been formed with the already registered user (if authentication has failed), the authentication/registration unit 206 receives the information input from the group estimation unit 205 via the communication interface (not shown) of the authentication/registration device 20. A signal indicating that authentication has failed is sent to the security guard's terminal, etc. along with the facial expression.

Further, the authentication/registration unit 206 determines whether a predetermined condition is satisfied based on the photographed images stored in the image storage unit 204 and which are taken by a camera 10 other than the camera 10 installed near the entrance, for example. Accordingly, the action authority stored in the registrant information storage unit 207 is updated. For example, the authentication/registration unit 206 uses images taken by the camera 10 while moving within the office building, images taken by the camera 10 from entering to leaving a room in the office building, etc. , the condition that ``a certain number (threshold; e.g., 5 people) or more of registered persons who have the authority to act alone have joined the above group and have been acting together for a certain period of time (threshold; e.g., 1 minute).'' The action authority of the person who has the group action authority is updated to the individual action authority in response to the fulfillment of the above criteria. Note that the predetermined conditions are not limited to the above. In this way, a person with group action authority can be trusted because the person with group action authority has been acting together with a registered person who has independent action authority who is considered reliable for at least a certain period of time. As a result, the authority of this person is updated to the authority to act independently, thereby improving the convenience of this person. Furthermore, because a person with group action authority is acting together with a certain number of registered persons who have independent action authority who are considered trustworthy, the person with group action authority may be considered more trustworthy. As a result, the authority of this person is updated to the authority to act independently, thereby improving the convenience of this person. In other words, if the number of people with independent action authority is small, that person can collude with a person who has group action authority to fraudulently update the group action authority to solo action authority; By making it a condition for renewal of authority to be accompanied by a person who has the necessary qualifications, such fraudulent acts can be suppressed.

Note that a registered person according to the present disclosure refers to a person whose face or identification information is stored in the registrant information storage unit 207, and an unregistered person according to the present disclosure refers to a person whose face or identification information is stored in the registrant information storage unit 207. Refers to a person whose information is not memorized.

The action authority violation determination unit 208 uses the estimation results inputted from the group estimation unit 205 and the images stored in the image storage unit 204, for example, images taken by a camera 10 other than the camera 10 installed near the entrance. Based on the image, it is determined whether the person indicated by the registrant information stored in the registrant information storage unit 207 violates the action authority indicated by the registrant information. If the person indicated by the registrant information violates the action authority indicated by the registrant information, the action authority violation determination unit 208 receives the input from the group estimation unit 205 via the communication interface of the authentication/registration device 20. A signal indicating the violation is sent to the security guard's terminal, etc. along with the person's face. For example, if the person indicated by the registrant information has the group action authority indicated by the registrant information, the action authority violation determination unit 208 stores the estimation results input from the group estimation unit 205 and the image storage unit 204. Based on the stored captured image, it is determined whether the person is acting together with a registered person who has the authority to act alone. Then, if the person is not acting together with a registered person who has the authority to act alone (for example, for a predetermined period of time), the action authority violation determination unit 208 uses the communication interface of the authentication/registration device 20 to A signal indicating that the person is violating the group action authority is sent to a terminal owned by the security guard, along with the person's face.

The group estimation unit 205 is an example of an estimation unit according to the present disclosure. The authentication/registration unit 206 is an example of a registration unit according to the present disclosure. The person visit information registration unit 201, the group estimation unit 205, the authentication/registration unit 206, and the action authority violation determination unit 208 may be referred to as a control unit, a processing unit, or the like. That is, the person visit information registration section 201, the group estimation section 205, the authentication/registration section 206, and the action authority violation determination section 208 may constitute a control section, a processing section, or the like. The control unit, processing unit, etc. may be realized by a processor, a controller, etc. The person visit information storage section 202, the image storage section 204, and the registrant information storage section 207 may be referred to as storage sections. That is, the person visit information storage section 202, the image storage section 204, and the registrant information storage section 207 may constitute a storage section. The image receiving unit 203 and the communication interface may be referred to as a communication unit. That is, the image receiving section 203 and the communication interface may constitute a communication section.

The functional units described above may be divided into further functional units, or two or more functional units may be integrated into one functional unit. For example, the authentication/registration unit 206 includes a determination unit that determines whether a predetermined condition for determining whether or not to update the action authority is satisfied, and a functional unit that performs processing other than this determination. It may be divided and this functional unit may be divided into further sub-functional units depending on the functions to be performed. Further, for example, the authentication/registration unit 206 and the action authority violation determination unit 208 may be realized as one functional unit.

The authentication/registration device 20 may be realized as one device having all of the above-mentioned functional units, or may be realized as a plurality of devices in which the above-mentioned functional units are distributed and provided. When the authentication/registration device 20 is realized as a plurality of devices, the functions of the authentication/registration device 20 can be realized by the plurality of devices cooperating via a network.

As described above, since the action authority granted at the time of automatic registration is limited to group action authority, security can be ensured and risks in the case where the wrong person is registered can be suppressed. Furthermore, since the group action authority that a person has can be updated to the individual action authority in accordance with the fulfillment of a condition, convenience for that person can be improved.

<Operation of authentication/registration device>
FIG. 3 is a flowchart illustrating an example of the operation of the authentication/registration device 20 according to the embodiment of the present disclosure. The process shown in FIG. 3 relates to pre-registration of visitors.

In step S301, the person visit information registration unit 201 pre-registers person visit information by storing the person visit information input and set by the user in the person visit information storage unit 202. As mentioned above, the person visit information may be called a visit pattern. After step S301, the flow ends. Note that the process shown in FIG. 3 may be executed every time the user inputs and sets personal visit information.

FIG. 4 is a flowchart showing another example of the operation of the authentication/registration device 20 according to the embodiment of the present disclosure. The process shown in FIG. 4 relates to group estimation, authentication, and automatic registration based on images taken by the camera 10 installed near the entrance.

In step S401, the group estimating unit 205 estimates a group based on the photographed image etc. taken by the camera 10 installed near the entrance. This estimation also includes face detection and face tracking by the group estimation unit 205.

In step S402, the authentication/registration unit 206 executes face authentication processing for the number of faces detected in step S401, based on images taken by the camera 10 installed near the entrance. In this face recognition process, registered visitors, unregistered visitors who accompany a registered person who has the authority to act alone, and unregistered visitors who do not accompany the registered person who has the authority to act alone. be identified.

Next, step S403 is executed at least as many times as there are groups estimated in step S401.

Specifically, in step S403, the authentication/registration unit 206 determines whether the estimated group matches the visit pattern. In addition, at least one, a predetermined number, or all of the photographed images used to estimate the group were taken within a predetermined range including the date and time of the visit (for example, 30 minutes before and after the date and time of the visit). The authentication/registration unit 206 may make this determination with the condition that .

If the estimated group does not match the visitation pattern (No in step S403), the flow returns to step S403 (if unprocessed groups still remain) or ends (if unprocessed groups remain). if not).

On the other hand, if the estimated group matches the visitor pattern (Yes in step S403), in step S404, the authentication/registration unit 206 stores the face etc. of the unregistered person in the registrant information storage unit 207. Register (the face of) an unregistered person. At this time, the authentication/registration unit 206 grants group action authority to the unregistered person by storing the group action authority in association with the unregistered person. The flow then returns to step S403 (if there are still unprocessed groups remaining) or ends (if no unprocessed groups remain).

After at least step S403 is executed for the number of groups estimated in step S401, the flow ends.

Although not shown, during the process shown in FIG. 4, for a person to be authenticated who is not automatically registered (a person to be authenticated who has failed in authentication), the authentication/registration unit 206 performs authentication along with the face of the person to be authenticated. A signal indicating that the security guard has failed is sent to the security guard's terminal, etc.

FIG. 5 is a flowchart illustrating yet another example of the operation of the authentication/registration device 20 according to the embodiment of the present disclosure. The process shown in FIG. 5 relates to group estimation, authentication, and action authority update based on captured images captured by cameras 10 other than the camera 10 installed near the entrance. For example, the process shown in FIG. 5 may be executed subsequent to the process shown in FIG. 4 while an unregistered visitor is moving or in the room after being automatically registered, or while the visitor is It may be executed at a later date while moving or staying in the room after successfully authenticating as a registered user at the entrance.

Step S501 is the same as step S401 described above, except that the camera 10 that took the captured image used for estimation is different.

Step S502 is the same as step S402 described above, except that the camera 10 that took the image used for the face authentication process is different. In this face authentication process, registered persons who have solo action authority and registered persons who have group action authority (in some cases, unregistered persons) are identified.

Next, step S503 is executed at least as many times as there are groups estimated in step S501.

Specifically, in step S503, the authentication/registration unit 206 determines whether a person with group action authority exists in the captured image.

If there is no person with group action authority in the captured image (No in step S503), the flow returns to step S503 (if unprocessed groups still remain) or ends (unprocessed groups remain). (if there are no left).

On the other hand, if there is a person who has group action authority in the photographed image (Yes at step S503), in step S504, the authentication/registration unit 206 determines that the number of people who have solo action authority in the group is equal to or greater than the threshold. Determine whether or not.

If the number of people with independent action authority in the group is not equal to or greater than the threshold (No in step S504), the flow returns to step S503 (if unprocessed groups still remain) or ends (unprocessed (if there are no groups left).

On the other hand, if the number of persons with independent action authority in the group is equal to or greater than the threshold (Yes in step S504), in step S505, the authentication/registration unit 206 performs a Then, it is determined whether the time for which a person who has group action authority has acted in a group together with a person who has independent action authority is equal to or greater than a threshold value.

If the time spent acting as a group is not equal to or greater than the threshold (No in step S505), the flow returns to step S503 (if there are still unprocessed groups remaining) or ends (if there are no unprocessed groups remaining). case).

On the other hand, if the time spent acting in a group is equal to or greater than the threshold (Yes in step S505), in step S506, the authentication/registration unit 206 updates the action authority of the person who has the group action authority to the individual action authority. Grant individual action authority to a person who has group action authority. The flow then returns to step S503 (if there are still unprocessed groups remaining) or ends (if there are no unprocessed groups remaining).

After at least step S503 is executed for the number of groups estimated in step S501, the flow ends.

Although not shown, during the process shown in FIG. 5, for a registered person who violates the action authority, the action authority violation determination unit 208 sends a signal indicating the violation along with the face of the registered person to the security guard. Send it to the device you have. Although not shown, during the process shown in FIG. 5, for an unregistered person, the authentication/registration unit 206 detects that the security guard has a signal indicating that the authentication has failed, along with the person's face. Send to the terminal, etc.

<Modified example>
[Setting information]
In the above, an example has been described in which the advance setting information (person visit information) is registered by being input and set by the user, but the present disclosure is not limited to this example. For example, the setting information may be registered in the face recognition/registration system 1 by copying the corresponding information from another system (for example, an admission management system, etc.), or the personal visitor information registration unit 201 may You may refer to the corresponding information in the system. By doing so, it is possible to reduce or eliminate the need for the user to register (memorize) similar content in the two systems, and the burden on the user can be reduced.

[Action authority]
In the above, an example in which action authority is broadly divided into group action authority and individual action authority has been described, but the present disclosure is not limited to this example, and more detailed action authority may be provided.

In the above, an example has been described in which a person with independent action authority can accompany (act together with) an unregistered person, but the present disclosure is not limited to this example. For example, in addition to the authority to act alone, the authority to act together with an unregistered person may be granted. In other words, the person may not be allowed to accompany an unregistered person unless he/she has the authority to act alone and also has the authority to accompany the unregistered person. Furthermore, there may be a plurality of action authorities that can accompany an unregistered person, depending on the number of unregistered people who can accompany an unregistered person. For example, there may be an action authority that allows the user to accompany one unregistered person, an action authority that allows the user to accompany two to five unregistered persons, an action authority that allows the user to accompany six or more unregistered persons, and the like. The number of unregistered persons who can accompany the user may be set depending on the role and reliability of the person who has the authority to act alone. For example, an employee in charge of sales, the head of an organization, etc. may be allowed to accompany more unregistered persons than other people because it is considered that they have more opportunities to accompany more unregistered persons. Additionally, a person who has been authorized to act alone for a long period of time is considered to be more trustworthy than someone who has just been granted authority to act alone, so allowing more unregistered persons to accompany him or her may be helpful. good.

In the above, an example has been described in which a person who has group action authority can only accompany a person who has solo action authority as indicated by the setting information. In other words, in the above example, even if there are multiple people with solo action authority, a person can only be accompanied by a person with solo action authority who is set as a group with a person who has group action authority according to the setting information. explained. By doing so, in the above description, the person who has been given the group action authority can be controlled to only be allowed to accompany the person who has invited the person and who has the individual action authority. In other words, a person who has authority to act in a group attempts to expand the range of permitted activities by accompanying someone who has authority to act independently but has not invited the person (for example, another employee in the office). Fraud can be prevented.

However, the present disclosure is not limited to this example. For example, the number of people who have the authority to act independently as indicated by the setting information may be one or more. In addition, if the number of people with solo action authority is multiple, it may be possible to control such that the person with group action authority is only allowed to act if he or she is accompanied by all the people with solo action authority. good. By doing so, it is possible to prevent one of the persons who has the authority to act alone and the person who has the authority to act in a group from colluding to perform an illegal act.

Furthermore, if the person is accompanied by one of the people who has the authority to act alone, control may be performed so that the person who has the authority to act in a group is allowed to act. By doing this, for example, a security guard accompanies the user from the entrance to the building, an employee accompanies him from the building to his room, etc., and the number of companions accompanying the person with group action authority can be passed on to multiple people. In addition, in this case, if it is detected that a person with group action authority is not accompanying any of the multiple persons with independent action authority, controls are implemented to reduce the reliability of the person with group action authority. It's okay.

Also, for example, a person who has group action authority may be allowed to accompany any person who has solo action authority. By doing this, if a person with solo action authority is accompanying the person, the person with group action authority is allowed to act, so a certain person with solo action authority can suddenly respond (accompany). Even if it becomes difficult, it is possible to control the actions of the person who has group action authority so as not to restrict them.

Also, for example, a person with group action authority may be accompanied by any person who has solo action authority, but may only be accompanied by multiple people whose number is equal to or higher than the threshold for independent action authority. It's okay. By doing this, it is possible to prevent any person who has the authority to act alone from colluding with a person who has the authority to act in a group to illegally permit the actions of a person who has the authority to act in a group. can.

Also, for example, if the setting information indicates that a person with group action authority has multiple people who have solo action authority to accompany this person, one or more of these people may You may be allowed to accompany anyone if you wish. By doing this, a person who has group action authority will be given the authority to act if he or she is accompanied by one of multiple people, so if the person who has group action authority is accompanying one or more people, the person who has group action authority will be given the authority to act. Even if a person suddenly becomes unable to respond, it is possible to control the actions of the person who has group action authority so as not to restrict them more than necessary. In this case, if it is detected that the user is not accompanying any person indicated by the setting information, control may be performed to lower the reliability of the person who has group action authority.

Although an example has been described above in which a person with group action authority and a person with independent action authority can act without time restrictions, the present disclosure is not limited to this example. For example, a person with group action authority and a person with solo action authority may only be able to act at specific times. For example, the authentication/registration unit 206 may grant independent action authority to a person who frequently visits during the morning hours (such as "from 10 a.m. to 11 a.m.") to be able to act alone only during those hours. May be granted.

In the above description, a gateless entrance has been described as an example, but the same concept may be applied to a gate provided with a door that restricts the movement of people. In this case, opening and closing of the door may be controlled to prevent a person who violates the group action authority from passing through the gate.

In the above, authentication using a person's face was described as an example, but the same idea may be applied to other biometric authentication methods. The above example assumes a situation where multiple users forming a group can be recognized at a gateless entrance, etc., so a non-contact authentication method (for example, iris, voice or It is convenient to use gait-based authentication, etc.). However, if multiple devices that acquire biometric information are installed, it is possible to estimate the group based on the operation time, etc., so other biometric authentication methods that require the user to stop or touch the user for a certain period of time (for example, vein Alternatively, the above idea can also be realized using authentication using fingerprints, etc.).

The above modifications may be arbitrarily combined as long as they do not contradict each other.

[Update action authority]
In the above, the conditions are met if the number of people in the group who have the authority to act alone is at least a fixed number, and the time they have acted in the group is at least the fixed time. Although an example in which group action authority is updated to individual action authority has been described, the present disclosure is not limited to this example, and more detailed conditions may be provided. In one example, the update conditions may be changed depending on the number of people in the group who have the authority to act independently. For example, the authentication/registration unit 206 may grant the authority to act alone in a short time if there are many people in the group who have the authority to act alone. More specifically, for example, if the number of people in the group who have the authority to act alone is five, the authentication/registration unit 206 will permit group action if the time spent in the group is one minute or more. If a person with authority is granted the authority to act alone, and the number of people in the group with authority to act alone is 10, then if the time spent acting in a group is 10 seconds or more, the person will have authority to act in a group. A person may be given the authority to act independently. In other words, the threshold value (predetermined time) described above in relation to the time spent acting in a group may be set shorter as the number of persons with group action authority acts together and the number of persons with independent action authority increases. . In this way, a person with group action authority may be viewed as trustworthy more quickly because the person with group action authority is acting together with more individuals with independent action authority who are considered trustworthy. This allows this person's authority to be updated to independent action authority more quickly, thereby improving convenience for this person. In addition, if there are few people with independent action authority who are acting together, it will take a long time for the individual action authority to be updated, so if a person with independent action authority colludes with a person who has group action authority. This makes it difficult to update permissions.

Although the above describes an example in which the action authority is updated from the group action authority to the individual action authority (updated so that restrictions are relaxed), the present disclosure is not limited to this example; Permissions may be updated to become more restrictive depending on the conditions being met. For example, if a person with the authority to act alone enters or attempts to enter an area where entry is prohibited (prohibited area), or if a person with the authority to act alone causes false authentication or impersonation, etc. When a person takes a predetermined action that reduces trust, the authentication/registration unit 206 may update the action authority of the person from solo action authority to group action authority. In this way, security can be further ensured when a person who has the authority to act independently takes a predetermined action that lowers trust, for example, and the trust level of this person decreases. Furthermore, if the reliability decreases before the group action authority is updated to the individual action authority, the authentication/registration unit 206 may tighten the conditions required for updating from the group action authority to the individual action authority. Specifically, the authentication/registration unit 206 may change the threshold for the number of accompanying persons who have the authority to act alone or the time for group action to a higher threshold than when the reliability level has not decreased. Conceivable. In addition, if the cumulative time spent acting with a person who has solo action authority is used as a condition for updating from group action authority to solo action authority, if the reliability decreases, the accumulated time count will be reset. You can increase or reduce it. Furthermore, since there are cases where a person takes an action without malicious intent that lowers the trust level, it is recommended that the trust level not be lowered until the number of such actions exceeds a predetermined threshold, or that the trust level is The authority may not be updated until the value falls below the value.

In the above, an example has been described in which a person with group action authority can only act in a group, and a person with independent action authority can act alone, without any location restrictions. However, the present disclosure is not limited to this example. It's not something you can do. For example, the authentication/registration device 20 may manage action authority in separate areas. For example, a person who has been granted the authority to act alone may be able to act alone in some areas (for example, an area for visitors), but can only act in groups in other areas (for example, an area reserved for employees). The action authority may be switched between individual action authority and group action authority depending on the area. Furthermore, for example, if a person to whom group action authority has been granted is in an area where he or she has previously acted in a group, the action authority may be updated from group action authority to solo action authority, and the person cannot leave the area. For example, the action authority may be switched between the individual action authority and the group action authority depending on the area, so that the individual action authority is updated again to the group action authority. In this manner, the authentication/registration unit 206 may switch between solo action authority and group action authority for a person, depending on the area where the person exists. In this way, for example, the authority of the second person changes depending on whether or not the area where the person is present is a prohibited area or whether or not the area where the person is acting in a group. , it is possible to achieve a better balance between security and convenience for the second person.

In addition, when updating the action authority, time such as the time of visit and the time of being in the office may be taken into consideration. For example, if a visitor with group action authority or a first-time visitor visits the office after business hours (e.g. 5:00 p.m.), the number of people in the group with solo action authority and/or the number of people acting in a group Regardless of the time, the visitor's action authority does not need to be updated from group action authority to solo action authority, and may remain group action authority. Similarly, if a visitor with group action authority or a first-time visitor arrives before 17:00, but before 17:00, the number of persons with solo action authority in the group and/or If the time spent acting in a group does not exceed the threshold, the visitor's action authority is: The group action authority does not need to be updated to the individual action authority, and may remain the group action authority. By doing this, for example, the action authority of a person who has group action authority will not be updated to solo action authority during night hours, and this person's action authority will be restricted during hours when there are few people. Since it is in a state where it is secure, security can be further ensured. In these cases, instead of controlling the group action authority so as not to update it to the individual action authority, the control may be performed so that it is difficult to update the group action authority. Specifically, group action authority will not be updated to solo action authority unless you act in a group for a longer period of time with more people who have solo action authority than in normal times (for example, before 5 p.m.). You can also do this.

Also, for example, in the case of a person such as a cleaning worker whose time period in which he/she will stay in the office is known in advance, the person's action authority can be set to solo action authority only during that time, and group action authority at other times. You may also do so. By doing so, it is possible to prevent the authority to act alone from being granted during a time period when there is no need to act alone in light of the purpose of the visit, thereby making it possible to further ensure security.

In this way, the authentication/registration unit 206 may decide whether to update the group action authority to the individual action authority depending on the time period, and may decide whether to update the group action authority to the solo action authority or the group action authority depending on the time period. You may switch between. For example, during times when a person is working, this person's action authority is updated to solo action authority, and during times when this person is not working, this person's action authority is updated to group action authority. Therefore, it is possible to achieve a better balance between security and convenience for this person.

Furthermore, in updating the action authority, information regarding the person, such as the position of the person acting together, may be taken into account. For example, if a visitor with group action authority or a first-time visitor comes to a visit and is acting together with a specific person (e.g., a person with a position of manager or higher, a person in charge of an office, etc.), Regardless of the number of people who have the authority to act alone, the visitor's authority to act is granted for a time (second time) that is shorter than the threshold (first time) mentioned above in relation to the time that the visitor acted in a group. The group action authority may be updated to the individual action authority (the first time and the second time are collectively referred to as a "predetermined time"). That is, the predetermined time may vary depending on whether or not the person who acts together with the visitor and who is registered with the authority to act alone is a specific person. In this way, a person with group action authority can be seen as more trustworthy more quickly because the person with group action authority is acting together with more specific people who are considered more trustworthy. This allows this person's authority to be updated to independent action authority more quickly, thereby improving convenience for this person.

Furthermore, in updating the action authority, attributes such as the age of the automatically registered person may be taken into consideration. For example, if the automatically registered person is a minor, the person's action authority does not need to be updated from group action authority to solo action authority, and may remain group action authority. In this manner, the authentication/registration unit 206 may decide whether to update the group action authority to the individual action authority according to the attributes of the automatically registered person.

Furthermore, it may be possible to distinguish between a person (such as a visitor) who has solo action authority updated from group action authority and a person (full-time employee, etc.) who has solo action authority from the beginning. For example, for a person who has solo action authority updated from group action authority, the solo action authority will be updated to group action authority depending on the number of times he or she has taken actions that lower reliability, but the individual action authority will be updated from the beginning to group action authority. The authority may not be updated for a person who has the authority. In addition, as a condition for allowing a person with group action authority to act, or as a condition for updating group action authority to individual action authority, it is necessary to apply not only a person with individual action authority updated from group action authority, but also a person who has been independent from the beginning. It may also be necessary to be accompanied by a person who has authority to act. By doing so, the range of persons who have the authority to act independently can be limited to the range that can be recognized by the person who has the authority to act independently from the beginning. This can prevent the number of people who have independent action authority from expanding to a range that cannot be grasped, such as full-time employees.

Although the above explanation uses an office as an example, the above idea may be applied to other facilities. For example, it can be applied to schools, banks, etc.

The above modifications may be arbitrarily combined as long as they do not contradict each other. Further, a determination block for determining the conditions according to the above-mentioned modification may be incorporated into the loop processing shown in FIG. 5 as appropriate.

Although the embodiments of the present disclosure have been described above in detail with reference to the drawings, the functions of the authentication/registration device 20 described above may be realized by a computer program.

FIG. 6 is a diagram showing the hardware configuration of a computer 1000 that implements the functions of the authentication/registration device 20 by a program. This computer 1000 includes an input device 1001 such as a keyboard, a mouse, and a touch pad, an output device 1002 such as a display and a speaker, a CPU (Central Processing Unit) 1003, a GPU (Graphics Processing Unit) 1004, and a ROM (Registered Memory). ad Only Memory) 1005, RAM (Random Access Memory) 1006, storage devices 1007 such as hard disk devices and SSDs (Solid State Drives), and DVD-ROMs (Digital Versatile Discs). k Read Only Memory), USB (Universal Serial Bus) memory, etc. The device includes a reading device 1008 that reads information from a recording medium, and a transmitting/receiving device 1009 that communicates via a network, and these devices 1001 to 1009 are connected by a bus 1010.

Then, the reading device 1008 reads the program for realizing the functions of the authentication/registration device 20 from the recording medium recording the program, and stores the program in the storage device 1007. Alternatively, the transmitting/receiving device 1009 communicates with a server device connected to the network, and causes the storage device 1007 to store a program downloaded from the server device to implement the functions of the authentication/registration device 20.

The functions of the authentication/registration device 20 are realized by the CPU 1003 copying the program stored in the storage device 1007 to the RAM 1006, and sequentially reading out and executing instructions included in the program from the RAM 1006.

<Effects of the embodiment>
The group estimating unit 205 of the authentication/registration device 20 estimates whether the first person and the second person are acting together based on the captured image captured by the camera 10. The authentication/registration unit 206 of the authentication/registration device 20 registers first biometric information (face, iris, etc.) for authentication of a first person (registered person) and independent action authority, and If the second biometric information (face, iris, etc.) for authentication of a person (unregistered person) is not registered, based on the estimation result by the group estimating unit 205, the user can act together with the registered person. The second biological information included in the photographed image and the group action authority are registered for the unregistered person, and the group action authority is updated to the solo action authority in response to a predetermined condition being satisfied.

With the above configuration, the biometric information of an unregistered person who is acting together with a registered person (belongs to the same group) has a group action authority that is more limited than the independent action authority of a registered person, and It is registered together with group action authority, which allows a person to perform a predetermined action on the condition that the person acts together with the person for whom the authority is registered. Further, in response to a predetermined condition being met, the group action authority is updated to the individual action authority so that the restrictions are relaxed. Therefore, it is possible to achieve both security and convenience for the person to be authenticated.

(Summary of embodiments)
A registration device (authentication/registration device 20) according to an embodiment of the present disclosure identifies whether a first person and a second person are together based on an image (photographed image) taken by a photographing device (camera 10). an estimating unit (group estimating unit 205) that estimates whether or not the person is acting as a person, first biometric information (face, iris, etc.) for authentication of the first person (registered person), and a first authority. (Independent action authority) is registered, and if the second biometric information (face, iris, etc.) for authentication of the second person (unregistered person) is not registered, based on the result of the estimation. and the second person who is acting together with the first person, the second biometric information included in the image and the person for whom the first authority is registered. A second authority (group action authority) that can perform a predetermined action on the condition that the user performs the action is registered, and in response to the fulfillment of the predetermined condition, the second authority is transferred to the first authority. and a registration unit (authentication/registration unit 206) that updates the authority of the user.

With the above configuration, the first biometric information for authentication and the first authority are registered for the second person who is acting together with the first person, and the first biometric information for authentication and the first authority are registered. Information and a second authority that can perform a predetermined action on the condition that the person acts together with the person for whom the first authority is registered are registered. Further, the second authority is updated to the first authority for the second person in response to a predetermined condition being satisfied. In this way, the biometric information of an unregistered second person who is acting together with a registered first person is conditional on the condition that the biometric information of an unregistered second person is acting together with a person such as the first person who is deemed to be trustworthy. The second authority is registered with the second authority that can perform a predetermined action, and the second authority is updated to the first authority so that the restrictions are relaxed in accordance with the fulfillment of the predetermined conditions. It is possible to achieve both security and convenience for the second person.

In this registration device, the second authority is granted on the condition that the second person acts together with the first person whose intention to act together with the second person is recorded in advance setting information. , is the authority to perform predetermined actions.

With the above configuration, in order to grant the second authority, it is necessary to record in the pre-setting information that the second person and the first person act together. It can be guaranteed that the person is a reliable person to some extent, and security can be further ensured.

In this registration device, the pre-setting information records a plurality of the first people who are recorded as planning to act together with the second person, and the second person The authority is to perform a predetermined action on the condition that the first person who is recorded in the setting information as planning to act together with the second person acts together. It is the right to do so.

With the above configuration, it is possible to prevent one of the first persons who has the first authority and the second person who has the second authority from colluding to perform fraudulent actions.

In the present registration device, the predetermined condition includes that the second person acts together with the person for whom the first authority is registered for a predetermined period of time or more.

With the above configuration, since the second person has been acting together with a person who is considered to be trustworthy for a predetermined period of time or more, the second person can be considered to be trustworthy. Since the authority of the second person is updated to the authority to act alone, it is possible to improve the convenience of the second person.

In this registration device, the predetermined condition is that the second person is scheduled to act together with the second person for a predetermined period of time or more, which is recorded in the preset information. including acting together with other people.

With the above configuration, in order to grant the second authority, it is necessary to record in the pre-setting information that the second person and the first person act together, and the second person , the second person can be considered more trustworthy because he or she has been acting together with someone who is considered trustworthy for more than a predetermined amount of time, thereby reducing the second person's authority to act alone. Since the information is updated, convenience for the second person can be improved.

In this registration device, the predetermined time is set to be shorter as the number of people registered with the first authority with whom the second person acts increases.

The above configuration allows the second person to be considered trustworthy sooner since the second person is acting with more people who are considered trustworthy, thereby making it possible for the second person to be considered trustworthy sooner. Since the authority of the second person is updated to the authority to act alone more quickly, the convenience of the second person can be improved.

In the present registration device, the predetermined time differs depending on whether the person who acts together with the second person and who is registered with the first authority is a specific person.

The above configuration allows a second person to be considered trustworthy sooner if, for example, the second person is acting together with a more specific person who is considered more trustworthy, thereby Since the authority of the second person is updated to the authority to act alone more quickly, the convenience of the second person can be improved.

In this registration device, the predetermined condition is such that if the number of persons with whom the second person acts together and for whom the first authority is registered is less than a predetermined number, the second person acts with the second person. This is a condition under which the second authority of the second person is not updated to the first authority, regardless of the time when the person with whom the first authority is registered acts together.

With the above configuration, if the second person is acting together with less than a predetermined number of people who are considered trustworthy, the second person will not be considered trustworthy, thereby increasing security. can be secured.

In this registration device, the predetermined condition is such that the time period during which the second person acted together with the person whose first authority is registered after being updated from the second authority is equal to or longer than the predetermined time. Even if , the second authority of the second person is not updated to the first authority.

With the above configuration, the range of the person who has the first authority can be limited to the range that can be recognized by the person who has the first authority from the beginning. Therefore, it is possible to prevent the person who has the first authority from expanding beyond the necessary range.

In this registration device, the registration unit updates the first authority to the second authority when the second person whose authority has been updated to the first authority takes a predetermined action.

With the above configuration, security can be further ensured when the trust level of the second person decreases, for example, by the second person taking a predetermined action that decreases trust.

In this registration device, if the second person takes a predetermined action before being updated to the first authority, the second authority of the second person is updated to the first authority. The conditions are made stricter than if the second person did not take the predetermined action.

With the above configuration, the conditions for updating the second authority to the first authority when the trust level of the second person decreases, for example, by the second person taking a predetermined action that decreases trust. Since the conditions become stricter, security can be further ensured.

In this registration device, the registration unit switches the first authority and the second authority for the second person depending on the area where the second person exists.

With the above configuration, the authority of the second person is switched depending on whether or not the area where the second person exists is a prohibited area, so it is possible to achieve both security and convenience for the second person. It is possible to achieve better results.

In this registration device, the registration unit determines whether to update the second authority to the first authority depending on the time period.

Due to the above configuration, the second person's authority is not updated to the first authority during the night time, for example, and the second person has limited authority during times when there are few people. Therefore, security can be further ensured.

In this registration device, the registration unit switches the first authority and the second authority for the second person depending on the time period.

With the above configuration, the authority of the second person is switched depending on, for example, the time period in which the second person performs work, so it is possible to achieve both security and convenience for the second person.

A registration method according to an embodiment of the present disclosure determines whether a first person and a second person are acting together based on an image (photographed image) taken by a photographing device (camera 10). is estimated, and the first biometric information (face, iris, etc.) for authentication of the first person (registered person) and the first authority (independent action authority) are registered, and the second person If the second biometric information (face, iris, etc.) for authentication of a person (unregistered person) is not registered, based on the result of the estimation, the A second person who can perform a predetermined action with respect to the second person on the condition that the second biometric information included in the image and the first authority act together with the registered person. authority (group action authority), and updates the second authority to the first authority in response to a predetermined condition being met.

A program according to an embodiment of the present disclosure causes a computer (authentication/registration device 20, computer 1000) to identify a first person and a second person based on an image (photographed image) taken by a photographing device (camera 10). The first person (registered person) is estimated to be acting together with the first biometric information (face, iris, etc.) for authentication and the first authority (authority to act alone). ) is registered, and the second biometric information (face, iris, etc.) for authentication of the second person (unregistered person) is not registered, based on the result of the estimation, The second person who is acting together with the first person is informed of the second biometric information included in the image and the first authority to act together with the registered person. A second authority (group action authority) that can perform a predetermined action is registered as a condition, and the second authority is updated to the first authority in response to the predetermined condition being met. to perform the steps.

In the above-described embodiments, the notation "...unit" used for each component is "...circuitry", "...assembly", "...device", "...・It may be replaced with other expressions such as "unit" or "...module."

Although the embodiments have been described above with reference to the drawings, the present disclosure is not limited to such examples. It is clear that those skilled in the art can come up with various changes or modifications within the scope of the claims. It is understood that such changes or modifications also fall within the technical scope of the present disclosure. Further, each component in the embodiments may be arbitrarily combined without departing from the spirit of the present disclosure.

The present disclosure can be realized by software, hardware, or software in cooperation with hardware. Each functional block used in the description of the above embodiment is partially or entirely realized as an LSI that is an integrated circuit, and each process explained in the above embodiment is partially or entirely realized as an LSI, which is an integrated circuit. It may be controlled by one LSI or a combination of LSIs. An LSI may be composed of individual chips, or may be composed of a single chip that includes some or all of the functional blocks. The LSI may include data input and output. LSIs are sometimes called ICs, system LSIs, super LSIs, and ultra LSIs depending on the degree of integration.

The method of circuit integration is not limited to LSI, and may be realized using a dedicated circuit, a general-purpose processor, or a dedicated processor. Furthermore, an FPGA (Field Programmable Gate Array) that can be programmed after the LSI is manufactured or a reconfigurable processor that can reconfigure the connections and settings of circuit cells inside the LSI may be used. The present disclosure may be implemented as digital or analog processing.

Furthermore, if an integrated circuit technology that replaces LSI emerges due to advancements in semiconductor technology or other derivative technology, it is natural that functional blocks may be integrated using that technology. Possibilities include the application of biotechnology.

The present disclosure can be implemented in all types of devices, devices, and systems (collectively referred to as communication devices) that have communication capabilities. Non-limiting examples of communication devices include telephones (mobile phones, smart phones, etc.), tablets, personal computers (PCs) (laptops, desktops, notebooks, etc.), cameras (digital still/video cameras, etc.) , digital players (e.g. digital audio/video players), wearable devices (e.g. wearable cameras, smartwatches, tracking devices), game consoles, digital book readers, telehealth/telemedicine (remote healthcare)・Medicine prescription) devices, vehicles or mobile transportation facilities (cars, airplanes, ships, etc.) with communication capabilities, and combinations of the various devices described above.

Communication equipment is not limited to portable or movable, but also non-portable or fixed equipment, devices, systems, such as smart home devices (home appliances, lighting equipment, smart meters or It also includes measuring instruments, control panels, etc.), vending machines, and any other "things" that can exist on an Internet of Things (IoT) network.

Communication includes data communication using cellular systems, wireless LAN systems, communication satellite systems, etc., as well as data communication using a combination of these.

Communication devices also include devices such as controllers and sensors that are connected or coupled to communication devices that perform the communication functions described in this disclosure. Examples include controllers and sensors that generate control and data signals used by communication devices to perform communication functions of a communication device.

Communication equipment also includes infrastructure equipment, such as base stations, access points, and any other equipment, devices, or systems that communicate with or control the various equipment described above, without limitation. .

The disclosure contents of the specification, drawings, and abstract included in the Japanese patent application No. 2022-042615 filed on March 17, 2022 are all incorporated into the present application.

An embodiment of the present disclosure is useful for technology for registering faces used for face authentication.

1 Face recognition/registration system 10 Camera 20 Authentication/registration device 30 Network 201 Person visit information registration section 202 Person visit information storage section 203 Image reception section 204 Image storage section 205 Group estimation section 206 Authentication/registration section 207 Registrant information storage section 208 Action Authority Violation Determination Department

Claims

an estimation unit that estimates whether the first person and the second person are acting together based on the image taken by the photographing device;
If the first biometric information for authentication of the first person and the first authority are registered, and the second biometric information for authentication of the second person is not registered, the estimated Based on the results, the second biometric information included in the image and the first authority are registered with respect to the second person who is acting together with the first person. a second authority that can perform a predetermined action on the condition that the person acts together with the person; a registration department that updates to;
A registration device comprising:
The second authority may perform a predetermined action on the condition that the first person acts together with the first person whose plan to act together with the second person is recorded in advance setting information. is the authority to do
The registration device according to claim 1.
In the prior setting information, a plurality of the first persons are recorded as having plans to act together with the second person,
The second authority may perform a predetermined action on the condition that the first person acts together with all of the first persons whose plans to act together with the second person are recorded in the setting information. is the authority to do
The registration device according to claim 2.
The predetermined condition includes that the second person acts together with the person for whom the first authority is registered for a predetermined period of time or more.
The registration device according to claim 1.
The predetermined condition is that the second person is together with the first person for a predetermined period of time or more, where it is recorded in advance setting information that the second person plans to act together with the second person. including taking action;
The registration device according to claim 4.
The predetermined time is set to be shorter as the number of people with whom the second person acts together and who are registered with the first authority increases.
The registration device according to claim 4.
The predetermined time differs depending on whether or not the person who acts together with the second person and for whom the first authority is registered is a specific person.
The registration device according to claim 4.
The predetermined condition is that if the number of people with whom the second person acts together and who is registered with the first authority is less than a predetermined number, then the second person and the first authority act together. is a condition under which the second authority of the second person is not updated to the first authority regardless of the time when the person acts together with the registered person,
The registration device according to claim 4.
The predetermined condition is that even if the second person acts together with the person whose first authority is registered after being updated from the second authority, it is equal to or longer than the predetermined time. , a condition for not updating the second authority of the second person to the first authority,
The registration device according to claim 4.
The registration unit updates the first authority to the second authority when the second person whose authority has been updated to the first authority takes a predetermined action.
The registration device according to claim 1.
The registration unit updates the second authority of the second person to the first authority if the second person takes a predetermined action before the authority is updated to the first authority. making the conditions stricter than if the second person had not taken the predetermined action;
The registration device according to claim 1.
The registration unit switches the first authority and the second authority with respect to the second person according to an area where the second person exists.
The registration device according to claim 1.
The registration unit determines whether to update the second authority to the first authority according to a time period.
The registration device according to claim 1.
The registration unit switches the first authority and the second authority for the second person according to a time period.
The registration device according to claim 1.
Estimating whether the first person and the second person are acting together based on the image taken by the photographing device,
If the first biometric information for authentication of the first person and the first authority are registered, and the second biometric information for authentication of the second person is not registered, the estimated Based on the results, the second biometric information included in the image and the first authority are registered with respect to the second person who is acting together with the first person. A second authority that can perform a predetermined action on the condition that the user acts together with the user,
updating the second authority to the first authority in response to a predetermined condition being met;
How to register.
to the computer,
Estimating whether the first person and the second person are acting together based on the image taken by the photographing device,
If the first biometric information for authentication of the first person and the first authority are registered, and the second biometric information for authentication of the second person is not registered, the estimated Based on the results, the second biometric information included in the image and the first authority are registered with respect to the second person who is acting together with the first person. A second authority that can perform a predetermined action on the condition that the user acts together with the user,
updating the second authority to the first authority in response to a predetermined condition being met;
A program that executes a procedure.