JP2017084025A - Automatic login system for information processing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an automatic login system that solves a problem of being unable to determine that two people are the same person even though they are the same as a result of checking feature quantity data on a face image registered in advance with feature quantity data obtained from a network due to difference of characters of network cameras, installation positions, and lighting environments, or the like.SOLUTION: An automatic login system is formed by connecting a camera, an information processing device, and a server via a network, and allows a user to automatically log into the information processing device by face recognition. The automatic login system recognizes the face of the user in an image transmitted by the camera, performs manual login if it is determined that automatic login is not available, and additionally registers an image of the face of the user as information on the user for face recognition.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an automatic login system based on face authentication to an information processing apparatus. In particular, the present invention relates to an apparatus that uses a network camera to identify a user who has approached an image forming apparatus that is one of information processing apparatuses and realizes automatic login to the image forming apparatus.

In recent years, in an image forming apparatus having functions such as a printer, a copy, and a scanner, a technique for displaying a predetermined operation screen for each user or restricting the use of the function for each user is known. In such an image forming apparatus, various user authentication processes are performed. As user authentication processing,
(1) A password authentication method in which a user ID and password are input through a local UI such as an operation panel of the image forming apparatus,
(2) A card authentication method in which a user logs in by holding a card over a card reading device installed in the image forming apparatus is generally used.
The password authentication method requires a troublesome operation for the user such as input of an ID or password, and the card authentication method has a problem that a user impersonated by lending a card can log in.

  As a technique for solving these problems, the face image information of a user registered in advance using a network camera is collated with the face image information of the user read by the network camera or the like, and a face that is permitted to log in when they match. Authentication methods are known.

JP 2007-304823 A

  In order to perform this face authentication, it is necessary to register user information and facial image feature amount data in advance. However, due to differences in network camera characteristics, installation position, lighting environment, etc., even if the person is the same person, the feature value data of the face image that has been registered in advance and the feature value data obtained from the network are collated. There was a case that could not be judged.

In order to solve this problem, it is necessary to acquire facial image feature amount data from the network camera for each user and register it in advance, and to re-register it by changing the installation position of the network camera or image forming apparatus. was there.
In offices and the like, a plurality of network cameras and a plurality of image forming apparatuses are often installed. In this case, the above-mentioned pre-registration work is required for the number of network cameras, and the burden of the registration work is further increased. It will be a thing.

  Japanese Patent Application Laid-Open No. 2004-151858 discloses a method of acquiring face image data when a specific operation is performed, taking it out, and performing impersonation or illegal access verification. If face image data is automatically registered by such a method, on the contrary, not only spoofing and unauthorized access become possible, but also the load of matching increases due to the increase of registered face image data. There is.

  The present invention is an automatic login system in which a user can automatically log in to an information processing device by face recognition, and the automatic login system is configured by connecting a camera, an information processing device, and a server via a network, The camera includes a transmission unit that transmits a captured image to the server, and the information processing apparatus transmits user identification information input by a user to the server and performs a manual login process according to a response from the server. Manual login means, and automatic login means for performing automatic login in response to an instruction from the server, wherein the server includes first management means for managing correspondence information between the camera and the information processing apparatus, and for face recognition. An automatic login determination means comprising a second management means for managing user information and a face recognition means for executing face recognition; And a manual login determination unit including an acquisition unit that acquires user identification information from the processing device and a third management unit that manages the user identification information. The automatic login determination unit is received from the camera. When the face recognition unit performs face recognition based on the image and the user information managed by the second management unit to determine whether automatic login is possible, and when it is determined that automatic login is not possible, The second management means additionally registers the image of the user who has manually logged into the information processing apparatus in the image as user information for face recognition by identifying the user from the user identification information acquired from the information processing apparatus. It is characterized by.

  According to the face authentication login system for an image forming apparatus using a network camera of the present invention, face authentication is performed using network cameras installed in various environments without pre-registering face image information for each network camera. It can be realized.

System configuration and network configuration for implementing the present invention Hardware configuration diagram of information processing function of image forming apparatus Software configuration and network interconnection diagram of the system of the present invention Sequence diagram of user's automatic login specified by face recognition server Flowchart for explaining the manual login flow to the image forming apparatus Flowchart for explaining registration processing of face image data at the time of manual login The flowchart explaining the registration process including the collation score calculation process in another Example Flowchart for explaining registration processing including registration inquiry processing in another embodiment

Hereinafter, an image forming apparatus as an embodiment for implementing an information processing apparatus of the present invention will be described with reference to the drawings.
FIG. 1 shows an example of a system configuration and a network configuration for implementing the present invention.
Reference numeral 101 denotes a network such as the Internet or an intranet. Reference numeral 102 denotes a network device that connects networks such as a router and a switch. A firewall 103 controls communication permission between networks. Reference numeral 105 denotes a LAN (Local Area Network). The LAN 105 is a terminal network that connects devices such as computers, but is not limited to a wired communication network, and may be a wireless communication network such as a wireless LAN or a mobile phone communication network.
Reference numeral 111 denotes an image forming apparatus. The image forming apparatus 111 includes types such as an SFP that is a single-function printer, an MFP that is a multifunction machine having a plurality of functions of a copy, a scanner, and a printer. Reference numeral 113 denotes a client computer. As the client computer 113, there are types such as a personal computer, a tablet computer, and a smartphone.

  An authentication server 120 holds a user ID and password and manages login to the image forming apparatus 111. A device management server 121 manages device information such as the IP address and device serial ID of the image forming apparatus 111. Reference numeral 130 denotes a face recognition server, which holds user face image information, automatic login settings, and the like, and has a function of identifying a user from an image sent from the network camera 131. There are various types of network cameras 131 such as box-type fixing, pan-tilt, and wide-angle depending on the lens and operating mechanism. In this embodiment, the network camera 131 is connected to the network 101 alone, but may be incorporated as a part of the image forming apparatus 111.

FIG. 2 shows a module configuration diagram of information processing functions of the image forming apparatus 111, the client computer 113, the authentication server 120, the device management server 121, the network camera 131, and the face recognition server 130.
A user interface 201 inputs and outputs information using a display, a keyboard, a mouse, a touch panel, and the like. Computers without these hardware can be connected and operated from other computers by remote desktop or remote shell. Note that the network camera 131 does not necessarily include the user interface 201.
A network interface 202 is connected to a network such as a LAN, and communicates with other computers and network devices. Reference numeral 204 denotes a ROM in which embedded programs and data are recorded. Reference numeral 205 denotes a RAM of a temporary memory area. Reference numeral 206 denotes a secondary storage device represented by an HDD. A CPU 203 executes a program read from the ROM 204, the RAM 205, the secondary storage device 206, and the like. Each unit is connected via an input / output interface 207.

FIG. 3 shows the software configuration of this system and the state of interconnection via the network.
<Device management server 121>
First, the device management server 121 will be described.
A database 331 is provided in the device management server 121 and holds data necessary for each function of the device management server 121. The device management table T400 is shown in Table 1.

  C401 in Table 1 is a column for storing the device serial ID of the image forming apparatus 111. C402 is a column for storing the IP address of the image forming apparatus 111. C403 is a column for storing the manufacturer name. C404 is a column for storing the model name. C405 is a column for storing device types such as MFP / SFP. C406 is a column for storing a color type representing the color printing / monochrome printing capability of the image forming apparatus 111. C407 is a column for storing installation location information of the image forming apparatus.

  The device serial ID is a unique ID for identifying an individual image forming apparatus. When manufacturing an image forming apparatus, a device serial ID is assigned to each individual and recorded in a non-volatile storage area so that the image forming apparatus itself can read the device serial ID later. If the device serial ID is known, necessary information such as the model name of the image forming apparatus can be specified by referring to the device management table T400. When the image forming apparatus 111 is registered as a management target of the device management server 121, the image forming apparatus 111 transmits information on its own devices C401 to C407, and the device management server 121 adds a record to the device management table T400.

  A web application 332 provides a web user interface (hereinafter “WebUI”) 333 and an application programming interface (hereinafter “API”) 334. The Web application 332 processes requests from other devices via the network 101, accesses data in the database 331 as necessary, executes various functions, and returns a response.

<Face recognition server 130>
Next, the face recognition server 130 will be described.
A database 341 is provided in the face recognition server 130 and holds data necessary for each function of the face recognition server 130. Table 2 shows a network camera management table T410 in the database 341 for managing a plurality of network cameras 131.

  C411 in Table 2 is a column for storing the IP address of the network camera 131. C412 is a column for storing the manufacturer name. C413 is a column for storing the model name. C414 is a column for storing camera types such as pan / tilt, wide angle, and box-type fixing. C 415 is a column for storing the camera name set for each individual network camera 131. C416 is a column that stores installation location information for each individual network camera 131.

Further, Table 3 shows an in-image device management table T420 in the database 341 for managing the image forming apparatus 111 in the image of the network camera 131.

  C421 in Table 3 is a column for storing the camera name of the network camera 131. C422 is a column for storing the device serial ID of the image forming apparatus 111. C423 is a column for storing the X coordinate in the image. C424 is a column for storing the Y coordinate in the image. In this embodiment, correspondence information and coordinate information between the image forming apparatus 111 in the image and the network camera 131 that monitors the image forming apparatus 111 are centrally managed by the administrator manually registered by the Web UI 343 described later. However, the coordinates may be automatically identified and registered by object recognition of the image forming apparatus 111.

Further, a user face image feature amount management table T430 in the database 341 for managing user information of the face recognition server 130 is shown in Table 4.

  A user ID 431 in Table 4 is an ID for identifying a user. If the automatic login setting 432 is ON, automatic login is set, and if it is OFF, automatic login is not set. The pre-registered face image data 435 is face image data registered in advance in association with the user ID 431, and the additionally registered face image data 1438 is face image data automatically added and registered according to the present invention. Since the face image data is used when the face image is confirmed by a person, the face image data is not necessary when it is not necessary for the person to confirm the face image data. The pre-registered feature data 433 is binary data obtained by converting the pre-registered face image data 435 into features. The additionally registered feature amount data 1436 is binary data obtained by converting the additionally registered face image data 1438 into a feature amount.

In the present embodiment, the face image data of the user has already been photographed, and the pre-registered feature amount data 433 obtained by combining the pre-registered face image data 435 and the pre-registered face image data 435 with the user ID is registered. To do. The recognition rate 434 of the pre-registered face image feature data and the recognition rate 437 of the additionally registered feature point data 1 are the recognition rates by the face image so far. This indicates that the registered feature value data matches. In order to calculate this recognition rate, if a part of the face image feature data registered in association with this user can be recognized and the user can be recognized, all registered face image feature data It is necessary to reflect the result of data matching.

Further, when the user is not able to recognize and manually logs in, it is necessary to reflect it as NG as a collation result of all face image feature data registered in association with the user. This recognition rate is used to select face image feature amount data to be deleted by the registration number upper limit management. The data 1 acquisition network camera name 439 is the name of the network camera that acquired the additionally registered face image data.

  A web application 342 provides a web UI 343 and an API 344. The Web application 342 processes requests from other devices via the network 101, accesses data in the database 341 as necessary, executes various functions, and returns a response.

<Authentication server 120>
Next, the authentication server 120 will be described.
3 is a database provided in the authentication server 120 and holds data necessary for each function of the authentication server 120. Table 5 shows a user management table T440 for managing users of the authentication server.

C441 in Table 5 is a column for storing a user ID (user identification information). C442 is a column for storing a password for the user to log in. C443 is the user's email address.
A web application 352 in FIG. 3 provides a web UI 353 and an API 354. The Web application 352 processes requests from other devices via the network 101, accesses data in the database 351 as necessary, executes various functions, and returns a response.

<Network camera 131>
Next, the network camera 131 will be described.
Reference numeral 321 in FIG. 3 denotes an image capturing unit of the network camera 131, which acquires an image by controlling a camera lens, an image sensor, and the like. Reference numeral 322 denotes a video processing unit, which processes the original image acquired by the imaging unit 321 and processes it into video data or the like. Also, additional information such as image recognition is performed to obtain additional information from the image or video. A data transmission unit 323 transmits the video data to other devices on the network. A Web UI 324 provides a viewer screen and a management screen for the network camera. On the viewer screen, you can perform operations such as camera orientation, zoom, and focus while checking the video captured by the camera.

On the management screen, preset registration of the imaging position of the camera, designation of processing to be performed by the video processing unit 322, registration of the destination of video data transmitted by the data transmission unit 323, and the like can be performed. Further, the identification information of the image forming apparatus in the image acquired by the imaging unit 321 can be registered, and the set information is transmitted to the face recognition server 130. Reference numeral 325 denotes an API that performs camera operation, setting data registration, and the like in response to a request from another device. A setting data management unit 326 holds setting data for the imaging unit 321, the video processing unit 322, and the data transmission unit 323.

<Image forming apparatus 111>
Next, the image forming apparatus 111 will be described.
311 in FIG. 3 is an application executed by the image forming apparatus 111. The application 311 can install and execute a plurality of applications in the image forming apparatus 111 according to its function and purpose. For example, an application for executing copying, scanning, printing, and the like can be given.
A manual login processing unit 313 notifies the authentication server 120 of the ID and password input by the user on the login screen displayed on the local UI 315 to perform login authentication. Alternatively, login authentication is performed by notifying the authentication server 120 of the user's ID card information read by the card reading device connected to the image forming apparatus 111. If there is a response indicating that login is possible from the authentication server 120, login is permitted.

<Automatic login processing flow>
Next, an automatic login process flow to the image forming apparatus 111 in cooperation with the image forming apparatus 111, the authentication server 120, the face recognition server 130, and the network camera 131 will be described with reference to the sequence diagram of FIG.
In step S401, the network camera 131 intermittently captures images and transmits the images to the face recognition server 130. The face recognition server 130 analyzes the received image.
In step S402, the face recognition server 130 detects a face image approaching the image forming apparatus 111 in the image. Next, the user's feature amount registered in the user face image feature amount management table T430 of all users registered in step S403 is compared with the feature amount of the face image detected in the image, and a certain threshold value or more is compared. The user who matches the feature amount is identified. Further, in step S404, it is confirmed whether or not the automatic login setting 432 is ON with reference to the user face image feature amount management table T430. If it is ON, the process continues to step S405, and if it is OFF, the process ends.

  In step S405, the face recognition server 130 further identifies the image forming apparatus 111 that the user has approached with reference to the in-image device management table T420. In step S406, the face recognition server 130 transmits an automatic login instruction together with the user ID specified by the authentication server 120 and the IP address or device serial ID of the image forming apparatus 111. Upon receiving the user ID and the IP address of the image forming apparatus 111 or the device serial ID in step S407, the authentication server 120 notifies the image forming apparatus 111 of the user ID and instructs automatic login. In step S408, the image forming apparatus 111 that has received the login ID performs automatic login to enable use by the user.

<Manual login process>
Next, the manual login process of the image forming apparatus 111 will be described in detail with reference to the flowchart of FIG. The manual login is performed by inputting the ID and password on the login screen of the local UI 315, or by reading the ID and password from the ID card with a card reader connected to the image forming apparatus 111.
The manual login processing unit 313 acquires the user ID and password (S501), transmits the ID and password to the authentication server 120, and makes an authentication request (S502). Waiting for a response from the authentication server 120 (S503), if a response is returned, it is determined whether the authentication is OK or NG (S504). In the authentication server 120, the acquired user ID and password are collated with data in the user management table T440, and if there is no corresponding user, an authentication error is returned to the manual login processing unit 313. If an authentication error is returned, the authentication error is displayed on the local UI 315 (S505), and the process ends. If there is a corresponding user, authentication OK is returned to the manual login processing unit 313. When authentication OK is responded, the user transitions to the login state and can be used (S506). When the authentication server 120 sends an authentication OK response to the manual login processing unit 313 of the image forming apparatus 111, the face recognition server 130 is notified of the manual login execution together with the user ID and the device serial ID of the image forming apparatus 111.

<Registration process 1 of face image data to the face recognition server at the time of manual login>
Next, the registration processing of face image data to the face recognition server 130 when receiving a notification of manual login execution from the authentication server 120 will be described in detail using the flowchart of FIG.
When a notification of manual login execution is received from the authentication server 120 (S601), automatic login setting is performed with reference to the user face image feature amount management table T430 in Table 4 using the user ID sent together with the notification of manual login execution. Confirm (S602). If the automatic login setting is OFF, the process ends. If ON (S603), the network camera monitoring the image forming apparatus 111 that has been manually logged in with reference to the in-image device management table T420 from the device serial ID that was sent together with the notification of manual login execution 131 is identified (S604). An image from the specified network camera 131 is acquired (S605), and it is confirmed by the face recognition application 345 whether a face image can be extracted (S606). If the extraction has been completed (S607), the additionally registered feature image data obtained by converting the acquired additionally registered face image data and the additionally registered face image data into features are registered in the user face image feature management table T430 (S608). If the face image has not been extracted, the process ends.
The above-described control makes it possible to increase the recognition rate because the additional registered feature amount data added this time at the next automatic login determination is also subject to collation.

In the first embodiment, when a face image can be extracted from an image at the time of manual login, the additional registration face image data is registered in the user face image feature amount management table T430, so that the recognition rate is determined at the next automatic login determination. It became possible to raise.
However, another user may borrow the user's ID card to use the image forming apparatus 111. In such a case, as a result of manual login as this user, it is determined that automatic login has failed, and face image data and face image feature value data of another user are registered in association with this user. Then, there is a problem of logging in as this user without borrowing an ID card from the next time.
In order to cope with the above-described problem, the second embodiment collates the acquired face image data with the pre-registered face image data, and registers the additional face image data based on the collation score, thereby obtaining another user's face image. This prevents data from being linked.
The additional face image registration process of the second embodiment will be described in detail below using the flowchart of FIG.

<Registration process of face image data to face recognition server 130 at the time of manual login 2: avoiding erroneous registration of another user>
When a manual login execution notification is received from the authentication server 120 (S701), the automatic login setting 432 is confirmed with reference to the user face image feature amount management table T430 using the user ID sent together with the manual login execution notification. (S702). If the automatic login setting 432 is OFF, the process ends. If ON (S703), the network camera monitoring the image forming apparatus 111 manually logged in with reference to the in-image device management table T420 from the device serial ID sent together with the manual login execution notification Is identified (S704). An image from the identified network camera is acquired (S705), and it is confirmed by the face recognition application 345 whether a face image can be extracted (S706).

If it has been extracted (S707), the facial image feature quantity data registered in advance and the facial image feature quantity data acquired this time are collated by the face recognition application, and a collation score is calculated (S708). If extraction has not been completed, the process ends. It is determined whether or not the matching score is equal to or greater than a predetermined threshold (S709). Register in the management table T430 (S710). If it is not equal to or greater than the predetermined threshold, the process is terminated.
By adding the control (S708, S709) described above, it is possible to reduce the possibility of registering another person's face image information.

  In Example 2, it was not possible to register as additional face image data unless the matching score was equal to or greater than a predetermined threshold. However, depending on the setting of the threshold value, for example, when wearing glasses, it may be determined that the user is not registered, and in this case, automatic login is not always possible when wearing glasses. On the other hand, lowering the threshold increases the possibility of registering another user. In order to solve this problem, the third embodiment adds a process of inquiring registration confirmation to the user when registering additional face image data at the time of manual login.

<Registration processing of face image data to face recognition server at the time of manual login 3: Inquiry of user for registration confirmation>
Hereinafter, the control for inquiring the user when registering the face image data in the face recognition server 130 at the time of manual login will be described in detail with reference to the flowchart of FIG.
When a notification of manual login execution is received from the authentication server 120 (S801), the automatic login setting 432 is confirmed by referring to the user face image feature amount management table T430 using the user ID sent together with the notification of manual login execution. (S802). If the automatic login setting 432 is OFF, the process ends. If it is ON (S803), the network camera monitoring the image forming apparatus 111 that has been manually logged in with reference to the in-image device management table T420 from the device serial ID sent together with the notification of execution of manual login Is identified (S804). An image from the specified network camera is acquired (S805), and it is confirmed by the face recognition application 345 whether a face image can be extracted (S806). If it has been extracted (S807), the face image feature value data registered in advance and the face image feature value data acquired this time are collated by the face recognition application, and a collation score is calculated (S808). If the extraction is not possible, the process is terminated.

It is determined whether or not the collation score is equal to or greater than a predetermined threshold (S809), and if the collation score is equal to or greater than the predetermined threshold, the registered mail address associated with the user is acquired from the authentication server 120. (S810). If it is not greater than or equal to the threshold value, the process ends. The mail transmission / reception control unit 346 uses the acquired mail address to notify the face image data to be registered and a method for registration (S811). In this embodiment, registration is permitted by replying to an e-mail. Therefore, when an e-mail reply is received (S812), the acquired additional face image data and the additional face image feature data obtained by converting the additional face image data into features are registered in the user face image feature management table T430 (S813). . If no reply is received within a predetermined time (S814), the registration is not performed and the process is terminated. In this embodiment, it is determined that registration is permitted by replying an e-mail. However, other procedure methods may be instructed to determine that registration is permitted when the procedure is performed.
According to the third embodiment, it is possible to register additional face image data by lowering the threshold of the collation score even when the user wears glasses, etc. It is possible to prevent erroneous registration of another user's image.

With the method described above, it is possible to reliably register the additional face image data and the additional face image feature amount data when automatic login fails. This makes it possible to increase the user recognition rate at the time of automatic login without depending on the environment such as the characteristics of the network camera, the installation position, and the lighting.
By the above-described method, face image data and face image feature amount data are added when automatic login fails.

According to the third embodiment, if the user permits registration, any number of additional face image data and additional face image feature amount data can be registered.
However, not only does the holding area such as the HDD be compressed according to the added amount, but the load on the system also increases due to the increase in face image feature amount data to be collated. In order to solve this problem, it is conceivable to set an upper limit number that can be registered for each user. However, if an upper limit is set so that no further registration is permitted, this time, if there is a temporary change such as a hairstyle change or wearing glasses, the registration will not be performed and the subsequent registration will not be performed. Automatic login is not possible.

  In the fourth embodiment, at least the latest face image feature data is held. For this reason, the registration date and time are stored as data together with the face image data so that the latest registered face image feature data is not deleted. Another object of the present invention is to increase the user recognition rate at the time of automatic login without depending on the environment such as the characteristics of the network camera, the installation position, and the lighting. Therefore, the identification information of the network camera that has registered the face image feature value data is also held, and the control for deleting a plurality of face image feature value data registered by the same network camera can be used together.

  In the fourth embodiment, the latest data is left by deleting the oldest registered date and time. In the fifth embodiment, data with a high recognition rate is left.

For this reason, when it is possible to collate with a part of registered face image feature data, automatic login is performed and collation with other registered face image feature data associated with the user is performed and held as a recognition rate. In addition, when automatic login fails, the recognition rate is retained as a matching failure for all registered face image feature data, and the newly registered face image feature data has a recognition rate of 100% (1/1). . Then, when selecting face image feature amount data to be deleted, those having a low recognition rate are selected as deletion targets.
For data deletion, data to be excluded may be selected based on both the new and old registration dates and the recognition rate. Further, it is also possible to select data to be deleted from another viewpoint.

  With the control described above, it is possible to reliably register the additional face image data and the additional face image feature amount data when automatic login fails. In addition, by appropriately managing the upper limit number, it is possible to provide an automatic login system that does not depend on the environment such as the characteristics of the network camera, the installation position, and the lighting without imposing a burden on the system.

(Other examples)
The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.
Note that the configuration and contents of the various data described above are not limited to this, and can be configured with various configurations and contents in accordance with applications and purposes.
Further, the present invention may be applied to a system composed of a plurality of devices, or may be applied to an apparatus composed of one device.

111 Image forming equipment
120 Authentication server
121 Device management server
130 Face recognition server
131 Network camera
113 client computers

Claims (12)

An automatic login system in which a user can automatically log in to an information processing device by face recognition,
The automatic login system is configured by connecting a camera, an information processing device, and a server via a network,
The camera has transmission means for transmitting a captured image to the server,
The information processing apparatus transmits user identification information input by a user to the server, and performs manual login processing according to a response from the server;
Having an automatic login means for performing automatic login in accordance with an instruction from the server;
The server
First management means for managing correspondence information between the camera and the information processing apparatus;
Automatic login determination means comprising second management means for managing user information for face recognition, and face recognition means for executing face recognition;
A determination unit for manual login comprising acquisition means for acquiring user identification information from the information processing apparatus and third management means for managing user identification information;
The automatic login determination means determines whether or not automatic login is possible by the face recognition means performing face recognition based on the image received from the camera and the user information managed by the second management means. ,
If it is determined that automatic login is not possible, a user is identified from the user identification information acquired from the information processing apparatus, and an image of the user who has manually logged into the information processing apparatus is used as user information for face recognition. An automatic log-in system characterized in that additional management means registers. The server includes a determination unit for additional registration of user information for face recognition,
When the automatic login determination means determines that automatic login is not possible, the face recognition means calculates a collation score calculated by collating the image with the user information is greater than or equal to a predetermined threshold 2. The automatic login system according to claim 1, wherein the additional registration determining unit determines to additionally register an image as user information for face recognition. The server has mail transmission / reception means,
When the automatic login determination means determines that automatic login is not possible, the face recognition means compares the image with the user information already registered, and the additional registration determination means determines the user information. If you decide to register as a user, notify the user of the registration method by email,
3. The automatic login system according to claim 2, wherein the second management means additionally registers as user information of additional registration in response to the user performing the registration method.   The second management means manages the upper limit number of face image feature amount data that can be registered for each user. If the face image feature amount data to be registered for the user exceeds a predetermined number, the same network camera The automatic login system according to any one of claims 2 to 3, wherein a plurality of face image feature amount data acquired from a plurality of face image feature data are to be deleted.   The second management means manages the upper limit number of face image feature amount data that can be registered for each user. If the face image feature amount data to be registered for the user exceeds a predetermined number, the data registration is performed. The automatic login system according to any one of claims 2 to 4, wherein an old one is deleted.   The second management means manages the upper limit number of face image feature amount data that can be registered for each user. If the face image feature amount data to be registered for the user exceeds a predetermined number, a new addition is added. The recognition rate of the face image feature value data to be registered is set to 100%, registration is performed in the user face image feature value management table, and registered face image feature value data having the lowest recognition rate is to be deleted. Item 6. The automatic login system according to any one of Items 2 to 5.   The server includes a face recognition server having an automatic login determination means including a face recognition means, an authentication server having a manual login determination means based on user identification information, and a management means for managing correspondence information between the camera and the information processing apparatus. The automatic login system according to claim 1, further comprising a device management server having the device management server. The automatic login system according to claim 1, wherein the information processing apparatus is an image forming apparatus.   The server used for the automatic login system of any one of Claims 1-8. A control method of an automatic login system, in which a camera, an information processing device, and a server are connected via a network, and a user can automatically log in to the information processing device by face recognition,
The camera executes a transmission step of transmitting a captured image to the server,
The information processing apparatus transmits a user identification information input by a user to the server, or a manual login process for performing a manual login process according to a response from the server,
Execute an automatic login step of performing automatic login in accordance with an instruction from the server;
The server
A first management step of managing correspondence information between the camera and the information processing apparatus;
An automatic login determination process comprising a second management process for managing user information for face recognition, and a face recognition process for executing face recognition;
Executing a manual login determination step comprising an acquisition step of acquiring user identification information from the information processing device and a third management step of managing user identification information;
The automatic login determination step determines whether automatic login is possible by executing face recognition in the face recognition step based on the image received from the camera and the user information managed in the second management step. And
If it is determined that automatic login is not possible, a user is identified from the user identification information acquired from the information processing apparatus, and an image of the user who has manually logged into the information processing apparatus is used as user information for face recognition. A method for controlling an automatic login system, wherein additional registration is performed in the management step.   A program for causing a computer to execute the control method of the automatic login system according to claim 10. A control method for automatic login, in which a camera, an information processing device, and a server are connected via a network, and a user can automatically log in to the information processing device by face recognition,
A first transmission step in which the camera transmits an image of a user's face to a server; and the user transmitted from the camera based on user information for face recognition managed by the server. A first determination step of determining whether automatic login is possible by recognizing the face of
If it is determined that automatic login is not possible, a second transmission step in which the user manually logs in to the information processing apparatus and the input user identification information is transmitted to the server;
A second determination step of determining whether the server can perform manual login from the received user identification information and managed user identification information;
A method for controlling automatic login, comprising: a registration step of additionally registering a user's face image manually logged into the information processing apparatus as user information for face recognition when manual login is performed .

Images