JP6870501B2 - Information processing system, image processing device, and user authentication method - Google Patents

Description

The present application relates to an information processing system, an image processing device, and a user authentication method.

As an authentication method for authenticating users, biometric authentication such as face authentication, which does not require operations such as entering a password and can prevent theft of an IC card storing authentication information and spoofing due to password theft, is available. It is widespread.

In addition, in the image forming apparatus that shifts to the power saving state when it is not used for more than a predetermined time, the approach of the user is detected by using the mobile sensor and the face authentication is performed by returning from the power saving state. A technique for reducing the waiting time required for the above is known (see, for example, Patent Document 1).

In the conventional technique, when the image forming apparatus is restored from the power saving state, the activation processing of the image forming apparatus and the face recognition processing are executed in parallel. In this case, both the activation process of the image forming apparatus and the face authentication process (particularly, the extraction process of the facial feature amount) have a heavy processing load, so that there is a problem that the authentication waiting time required for the face authentication process becomes long. is there.

It should be noted that such a problem is not limited to face recognition of the image forming apparatus, and after shifting to the power saving state, it returns from the power saving state according to the approach of the user, and various biometric authentication of the user is performed. Commonly present in information processing systems.

The embodiment of the present invention has been made in view of the above problems, and after shifting to the power saving state, the user returns from the power saving state according to the approach of the user, and biometric authentication of the user is performed. In an information processing system, reduce the authentication waiting time required for biometric authentication.

In order to solve the above problems, the information system according to the embodiment of the present invention is connected to a detection device that detects the approach of a user, an image pickup device that captures an image of the user, and the image pickup device. An information processing system including an information processing device, wherein the information processing device is registered in advance with an extraction unit that extracts characteristic information of the user's living body from the image of the user captured by the imaging device. Based on the bio-authentication unit that performs bio-authentication of the user using the extracted bio-characteristic information and the user's bio-characteristic information extracted by the extraction unit, and the result of the bio-authentication, the said A usage control unit that allows a user to use the information processing device, and the information processing system has a setting management unit that manages whether or not the authentication setting of the information information system is valid. A state control unit that shifts the image pickup apparatus and the information processing apparatus from a normal state in which a predetermined process can be executed to a power saving state in which power consumption is less than that in the normal state according to a predetermined transition condition, and the power saving state. In the state, when the detection device detects the approach of the user, if the authentication setting of the information processing system is valid, the image pickup device and the activation control unit that preferentially activates the extraction unit. Has.

According to the embodiment of the present invention, in an information processing system that returns from the power saving state according to the approach of the user after shifting to the power saving state and performs biometric authentication of the user, waiting for authentication required for biometric authentication. Time can be reduced.

It is a figure which shows the structural example of the information processing system which concerns on one Embodiment. It is a figure which shows the example of the hardware composition of the image forming apparatus which concerns on one Embodiment. It is a figure which shows the example of the functional structure of the image forming apparatus which concerns on one Embodiment. It is a figure which shows the example of the information which the image forming apparatus which concerns on one Embodiment manages. It is a flowchart which shows the example of the activation processing of the operation part which concerns on 1st Embodiment. It is a figure which shows the image of the detection range of each device which concerns on 1st Embodiment. It is a flowchart which shows the example of the face recognition processing which concerns on 1st Embodiment. It is a sequence diagram which shows the example of the transition process to the power saving state which concerns on 1st Embodiment. It is a sequence diagram which shows an example of the authentication process from the power saving state which concerns on 1st Embodiment. It is a sequence diagram which shows another example of the authentication process from the power saving state which concerns on 1st Embodiment. It is a flowchart which shows the example of the two-factor authentication process which concerns on 2nd Embodiment. It is a sequence diagram which shows the example of the authentication process from the power saving state which concerns on 2nd Embodiment. It is a flowchart which shows the example of the activation process of the main body which concerns on 3rd Embodiment. It is a sequence diagram (1) which shows the example of the activation process of the image forming apparatus which concerns on 3rd Embodiment. It is a sequence diagram (2) which shows the example of the activation process of the image forming apparatus which concerns on 3rd Embodiment. It is a figure which shows the example of the display screen which concerns on 3rd Embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

<System configuration>
FIG. 1 is a diagram showing a configuration example of an information processing system according to an embodiment. The information processing system 100 includes an image forming apparatus 101, a human body detection sensor 102 included in the image forming apparatus 101, and a camera 103.

Preferably, the information processing system 100 further includes an IC card reader 106 included in the image forming apparatus 101, an IC card 104 owned by the user 105, and the like.

The image forming apparatus (image processing apparatus) 101 is, for example, an image processing apparatus such as an MFP (Multifunction Peripheral), a copier, or a printer having functions such as a printer, a scanner, a copy, and a facsimile.

Preferably, the image forming apparatus 101 has a main body (execution device) 110 that executes image processing, and an operation unit (operation device) 120 that is connected to the main body 110 and receives the operation of the user 105.

The operation unit (information processing device) 120 has a general computer configuration, and is, for example, an information processing device that operates on a power-saving OS (Operating System) such as Android (registered trademark).

The main body 110 has, for example, an engine unit that executes image processing in addition to a general computer configuration, and, for example, prints, scans, copies, etc., depending on the operation of the operation unit 120 by the user 105. Perform image processing.

The human body detection sensor (detection device) 102 is a detection device that detects a user 105 approaching the image forming device 101 (or the operation unit 120). As the human body detection sensor 102, for example, a pyroelectric sensor or the like is used to detect a human body or the like within a predetermined detection range (for example, within 2 m).

The detection device included in the image forming device 101 may be a detection device other than the human body detection sensor 102 as long as it can detect a user 105 approaching within a predetermined detection range. For example, the image forming apparatus 101 may be a wireless communication device or the like that detects the approach of the user 105 by the radio wave of the wireless terminal possessed by the user 105 instead of the human body detection sensor 102. Here, as an example, the following description will be given assuming that the detection device included in the image forming device 101 is the human body detection sensor 102.

The camera 103 is an imaging device that captures an image used for face recognition of the user 105 who uses the image forming apparatus 101.

The IC card reader 106 is a reader that acquires authentication information (card ID, etc.) used for IC card authentication from the IC card 104 possessed by the user 105. The IC card authentication is an example of the belongings authentication that authenticates the user 105 by the authentication information acquired from the belongings of the user 105. Further, the IC card 104 is an example of the belongings used for the personal belongings authentication of the user 105.

The image forming apparatus 101 may authenticate the user's 105 belongings by using the user's 105 belongings (for example, an information terminal, a wireless tag, etc.) different from the IC card. Here, as an example, the following description will be given assuming that the belongings authentication executed by the image forming apparatus 101 is IC card authentication.

In the above configuration, the image forming apparatus 101 has a power saving function, and for example, when the image forming apparatus 101 is not used for a predetermined time, the image forming apparatus 101 can execute image processing. Shift from the normal state to the power saving state that consumes less power than the normal state. The image forming apparatus 101 causes the image forming apparatus 101 to stop the functions of the camera 103, the IC card reader 106, the operation unit 120, and a part of the main body 110 (engine unit, storage unit, etc.) in the power saving state. Power consumption can be reduced.

On the other hand, even after the image forming apparatus 101 shifts to the power saving state, the human body detection sensor 102 continues to detect the user 105 approaching within the predetermined detection range, and the approach of the user 105 is detected. , The image forming apparatus 101 is gradually returned to the normal state.

For example, in the power saving state, when the approach of the user 105 is detected, the image forming apparatus 101 preferentially activates the function required for face recognition of the user 105, and after performing a predetermined process. Activate other functions.

As an example, the image forming apparatus 101 has a camera 103 that captures an image of the user 105 when the approach of the user 105 is detected in a power saving state, and facial feature information of the user 105 from the captured image. Priority is given to starting the process of extracting. Further, the image forming apparatus 101 activates another processing unit after extracting the facial feature information of the user 105.

This is because both the process of activating the operation unit 120 and the process of extracting facial feature information are heavy, so if they are executed at the same time, the load on the CPU (Central Processing Unit) will increase and the waiting time required for face authentication will increase. Is because it becomes long.

As another example, the image forming apparatus 101 includes a camera 103 that captures an image of the user 105 when the approach of the user 105 is detected in a power saving state, and an application program that executes biometric authentication (hereinafter, an application). ) Is started preferentially. Further, the image forming apparatus 101 activates another processing unit after executing the face recognition processing of the user 105.

As described above, when the approach of the user 105 is detected in the power saving state, the image forming apparatus 101 according to the present embodiment preferentially activates the function required for the face authentication of the user 105 to determine the predetermined value. Invoke other functions after performing the processing of.

As a result, according to the present embodiment, in the information processing system 100 that returns from the power saving state in response to the approach of the user 105 after shifting to the power saving state and performs biometric authentication of the user 105, biometric authentication is performed. The required authentication waiting time can be reduced.

The system configuration shown in FIG. 1 is just an example. For example, the information processing system 100 is a system including other information processing devices such as a PC (Personal Computer), a tablet terminal, a smartphone, a game machine, a video conference device, and an ATM (Automatic Teller Machine). Is also good.

<Hardware configuration>
FIG. 2 is a diagram showing an example of a hardware configuration of an image forming apparatus according to an embodiment. The image forming apparatus 101 includes, for example, a main body 110 that executes various image processes such as a copy function, a scanner function, a fax function, and a printer function, and an operation unit 120 that receives operations of the user 105. The main body 110 and the operation unit 120 are connected to each other so as to be able to communicate with each other via a dedicated communication path 201. As the communication path 201, for example, a USB (Universal Serial Bus) standard can be used, but any standard may be used regardless of whether it is wired or wireless.

The main body 110 can perform an operation according to the operation received by the operation unit 120. Further, the main body 110 can also communicate with an external device such as a client PC via the network 202, and can perform an operation according to an instruction received from the external device.

(Hardware configuration of the main unit)
First, the hardware configuration of the main body 110 will be described. As shown in FIG. 2, the main body 110 includes a CPU 111, a ROM (Read Only Memory) 112, a RAM (Random Access Memory) 113, a storage unit 114, a communication I / F (Interface) 115, a connection I / F 116, and an engine unit 117. , Human body detection sensor 102, external connection I / F 118, system bus 119, and the like.

The CPU 111 is an arithmetic unit that controls the operation of the entire main body 110 by executing a program stored in the ROM 112, the storage unit 114, or the like with the RAM 113 as a work area (work area). For example, the CPU 111 uses the engine unit 117 to realize various functions such as a copy function, a scanner function, a fax function, and a printer function.

The ROM 112 is, for example, a non-volatile memory that stores a BIOS (Basic Input / Output System) executed when the main body 110 is started, various settings, and the like. The RAM 113 is a volatile memory used as a work area or the like of the CPU 111. The storage unit 114 is, for example, a non-volatile storage device that stores an OS, an application program, various data, and the like, and is composed of, for example, an HDD (Hard Disk Drive), an SSD (Solid State Drive), and the like.

The communication I / F 115 is a network interface such as a wireless LAN or a wired LAN for connecting the main body 110 to the network 202 and communicating with an external device connected to the network 202. The connection I / F 116 is an interface for communicating between the main body 110 and the operation unit 120 via the communication path 201.

The engine unit 117 is hardware that performs general-purpose information processing and processing other than communication in order to realize functions such as a copy function, a scanner function, a fax function, and a printer function. The engine unit 117 includes, for example, a scanner (image reading unit) that scans and reads an image of a document, a plotter (image forming unit) that prints on a sheet material such as paper, a fax unit that performs fax communication, and the like. .. Further, the engine unit 117 may include specific options such as a finisher for sorting printed sheet materials and an ADF (automatic document feeder) that automatically feeds documents.

The human body detection sensor 102 corresponds to the human body detection sensor 102 described with reference to FIG. 1 and is a detection device that detects a user 105 approaching the image forming device 101. The main body 110 may have another detection device that detects the approach of the user 105 by a method different from that of the human body detection sensor 102.

The external connection I / F 118 is an interface such as USB for connecting an external device. The IC card reader 106, the human body detection sensor 102, and the like may be connected to the main body 110 via an external connection I / F 118.

The system bus 119 is connected to each of the above components and transmits an address signal, a data signal, various control signals, and the like.

(Hardware configuration of operation unit)
Next, the hardware configuration of the operation unit 120 will be described. As shown in FIG. 2, the operation unit 120 includes a CPU 121, a ROM 122, a RAM 123, a flash memory 124, a communication I / F 125, an operation panel 126, a connection I / F 127, an IC card reader 106, a camera 103, and an external connection I / F 129. And has a system bus 130 and the like.

The CPU 121 is an arithmetic unit that controls the operation of the entire operation unit 120 by executing a program stored in the ROM 122, the flash memory 124, or the like with the RAM 123 as a work area (work area). The ROM 122 is, for example, a non-volatile memory that stores a BIOS executed when the operation unit 120 is started, various settings, and the like. The RAM 123 is a volatile memory used as a work area or the like of the CPU 121. The flash memory 124 is, for example, a non-volatile storage device that stores an OS, an application program, various data, and the like.

The communication I / F 125 is a network interface such as a wireless LAN or a wired LAN for connecting the operation unit 120 to the network 202 and communicating with an external device connected to the network 202.

The operation panel 126 accepts various inputs according to the user's operation and displays various information. The operation panel 126 is composed of, for example, a liquid crystal display (LCD: Liquid Crystal Display) equipped with a touch panel function, but the operation panel 126 is not limited thereto. The operation panel 126 may be composed of, for example, an organic EL (Electro Luminescence) display device equipped with a touch panel function. Further, the operation panel 126 may be provided with an operation unit such as a hardware key or a display unit such as a lamp in addition to or in place of the operation panel 126.

The connection I / F 127 is an interface for communicating between the operation unit 120 and the main body 110 via the communication path 201.

The IC card reader 106 corresponds to the IC card reader 106 described with reference to FIG. 1, and is a reading device that reads authentication information (card ID, etc.) used for IC card authentication from the IC card 104 possessed by the user 105. Is. The operation unit 120 may have a reading device that reads the authentication information used for the personal belongings authentication from the personal belongings of the user 105, which is different from the IC card 104.

The camera 103 corresponds to the camera 103 described with reference to FIG. 1, and is an imaging device that captures an image used for face recognition of the user 105. The operation unit 120 may have an acquisition device for acquiring biometric information used for biometric authentication of the user 105, which is different from face authentication.

The external connection I / F 129 is an interface such as USB for connecting an external device. The IC card reader 106 and the camera 103 may be connected to the operation unit 120 via an external connection I / F129.

The system bus 130 is connected to each of the above components and transmits an address signal, a data signal, various control signals, and the like.

<Functional configuration>
FIG. 3 is a diagram showing an example of the functional configuration of the image forming apparatus according to the embodiment.

(Functional configuration of the main unit)
The main body 110 of the image forming apparatus 101 includes an approach detection unit 321, a state control unit (main body) 322, an image forming unit 323, an authentication control unit 324, a communication unit 325, a storage unit 326, and the like.

The approach detection unit 321 is realized by, for example, a detection device such as the human body detection sensor 102 shown in FIG. 2, or a program executed by a microcomputer (microcomputer) included in the detection device. The approach detection unit 321 detects a user approaching the image forming apparatus 101 (or the operation unit 120). Further, the approach detection unit 321 continues the detection process even after the image forming apparatus 101 shifts to the power saving state, and when it detects the approach of the user 105, it indicates that the approach of the user 105 has been detected. The notification is notified to the state control unit (main body) 322.

The state control unit (main body) 322 is realized by, for example, a program executed by the CPU 111 of FIG. The state control unit (main body) 322 is an example of a state control unit that shifts the image forming apparatus 101 from a normal state capable of executing a predetermined process to a power saving state that consumes less power than the normal state according to a predetermined transition condition. Is.

For example, the state control unit (main body) 322 may use the operation unit 120, the camera 103, the engine unit 117 of the main body 110, the storage unit 114, and the like when the image forming apparatus 101 is not used for a preset time. Move to a power saving state.

Further, when the approach detection unit 321 detects the approach of the user 105 in the power saving state, the state control unit (main body) 322 transmits a start request requesting the start to the operation unit 120 and the main body 110. The engine unit 117, the storage unit 114, and the like are started.

The image forming unit 323 is realized by, for example, a program executed by the CPU 111 of FIG. 2, and for example, image processing such as printing, copying, scanning, and faxing is executed by using the engine unit 117 of FIG.

The authentication control unit 324 is realized by, for example, a program executed by the CPU 111 of FIG. 2, and the function of the main body 110 (for example, printing, copying) by the user 105 who is permitted to use the image forming apparatus 101 by the operation unit 120. Etc.) is permitted.

The communication unit 325 is realized by, for example, a program executed by the CPU 111 of FIG. 2 and a connection I / F 116 or the like, and communicates with the operation unit 120 via the communication path 201.

The storage unit 326 stores, for example, information such as the user information A327, which is realized by the program executed by the CPU 111 of FIG. 2, the RAM 113, the storage unit 114, and the like, and is the user information registered in advance.

(Functional configuration of operation unit)
Subsequently, the functional configuration of the operation unit 120 will be described.

The operation unit 120 includes, for example, a state control unit (operation unit) 301, an imaging unit 302, an extraction unit 303, a biometric authentication unit 304, a usage control unit 305, an authentication information acquisition unit 306, an belongings authentication unit 307, and user information management. It has a unit 308, a display input control unit 309, a setting management unit 310, a communication unit 311 and a storage unit 312.

The state control unit (operation unit) 301 is realized by, for example, a program executed by the CPU 121 of FIG. 2, a process of shifting the operation unit 120 to the power saving state, and returning the operation unit 120 from the power saving state to the normal state. This is an example of a start control unit that performs a process of causing the operation.

For example, when the state control unit (operation unit) 301 receives the power saving transition request requesting the transition from the main body 110 to the power saving state, each processing unit of the operation unit 120 can be stopped and a predetermined process can be executed. The operation unit 120 is shifted to a power saving state in which power consumption is less than that in a normal state.

Further, when the state control unit (operation unit) 301 receives a start request requesting a return from the power saving state to the normal state from the main body 110, for example, each processing unit of the operation unit 120 is started in stages. , The operation unit 120 is returned to the normal state. At this time, the state control unit (operation unit) 301 preferentially activates the processing unit related to face recognition among the processing units of the operation unit 120 over the other processing units.

As an example, when the state control unit (operation unit) 301 returns the operation unit 120 from the power saving state to the normal state, the imaging unit 302 (camera 103) and the extraction unit 302 among the processing units included in the operation unit 120 are extracted. The unit 303 is started with priority over other processing units.

Further, as another example, when the state control unit (operation unit) 301 returns the operation unit 120 from the power saving state to the normal state, the imaging unit 302 and the extraction unit among the processing units included in the operation unit 120 The 303 and the biometric authentication unit 304 are started preferentially over the other processing units.

The image capturing unit 302 captures an image of the user 105, which is realized by, for example, the camera 103 of FIG. 2 or a program executed by the microcomputer included in the camera 103, and is used for face recognition of the user 105.

For example, the camera 103 included in the image forming apparatus 101 is installed so that the user 105 who operates the operation unit 120 of the image forming apparatus 101 fits in the image captured by the imaging unit 302, and the imaging unit 302 is a camera. Images are continuously imaged using 103.

The extraction unit 303 is realized by, for example, a program executed by the CPU 121 in FIG. 2 (a face authentication application that executes face authentication processing, etc.), and the face of the user 105 is taken from the image of the user 105 captured by the image pickup unit 302. Extract facial feature information used for authentication.

For example, the extraction unit 303 detects parts such as the contour, eyes, and nose of the face of the user 105 from the image captured by the image pickup unit 302 by using a known pattern matching technique, and the face of the user 105. The image is detected, and facial feature information is extracted from the detected facial image. Here, the facial feature information is a feature amount used for user verification in face recognition (for example, information representing features common to eyes, nose, mouth, etc.), and various known feature information is applied. Can be done.

In the present embodiment, the type of feature information to be used is not particularly limited, but for example, it can be extracted using a known Haar-Like feature amount or the like. At this time, the extraction unit 303 extracts the feature amount of each part of the face from the detected face image and quantifies it. At the time of extracting this feature amount, for example, the parts on the upper left side of the face image are sequentially quantified, and the quantification is sequentially performed from the edge of the face image.

Therefore, when the operation unit 120 is activated, the imaging unit 302 (camera 103) and the extraction unit 303, which are used for extracting facial feature information, are preferentially activated to suppress activation processing of other processes. desirable.

The biometric authentication unit 304 is realized by, for example, a program executed by the CPU 121 in FIG. 2 (a biometric authentication application that executes a biometric authentication process, etc.), and pre-registered facial feature information and a face extracted by the extraction unit 303. Face recognition of the user 105 is performed using the feature information of.

For example, the biometric authentication unit 304 calculates the similarity between each of the facial feature information registered in advance in the user information and the facial feature information extracted by the extraction unit 303, and the calculated similarity is equal to or greater than the threshold value. If, the face authentication of the user 105 is permitted. Further, the biometric authentication unit 304 rejects the face authentication of the user 105 when the calculated similarity is less than the threshold value.

The biometric authentication unit 304 may perform face authentication of the user 105 by using an arbitrary face authentication method (for example, the technique disclosed in Patent Document 1). Face recognition is an example of biometrics. If the biometric authentication unit 304 performs biometric authentication of the user 105 using the characteristic information of the living body extracted by the extraction unit 303 from the image of the user 105 captured by the imaging unit 302, the biometric authentication unit 304 is other than face authentication. It may perform biometric authentication (for example, iris authentication, pace authentication, etc.).

The authentication information acquisition unit 306 is realized by, for example, the IC card reader 106 of FIG. 2 or a program executed by a microcomputer included in the IC card reader 106, and authentication information such as a card ID used for IC card authentication of the user 105. Is obtained from the IC card 104.

For example, the IC card reader 106 receives a card ID from an IC card 104 that is close to the IC card reader 106 within a predetermined distance (for example, within 5 cm) by short-range wireless communication such as NFC (Near Field Communication). ..

The personal belongings authentication unit 307 is realized by, for example, a program executed by the CPU 121 (a personal belongings authentication application that executes the personal belongings authentication process, etc.), and pre-registered authentication information and authentication acquired by the authentication information acquisition unit 306. The belongings of the user 105 are authenticated using the information.

For example, the personal belongings authentication unit 307 performs card authentication of the user 105 (an example of personal belongings authentication) when the card ID acquired from the IC card 104 possessed by the user 105 is included in the user information registered in advance. Allow. Further, the possession authentication unit 307 refuses the card authentication of the user 105 when the card ID acquired from the IC card 104 possessed by the user 105 is not included in the user information registered in advance.

Card authentication is an example of personal belongings authentication. The possession authentication unit 307 has possession other than card authentication if the authentication information acquisition unit 306 uses the authentication information acquired from the possession of the user 105 to authenticate the possession of the user 105. It may be the one that authenticates the object.

The usage control unit 305 is realized by, for example, a program (system application or the like) executed by the CPU 121 in FIG. 2, and the image forming device 101 (or operation) by the user 105 is based on the result of face authentication by the biometric authentication unit 304. The use of part 120) is permitted.

As an example, in the usage control unit 305, when the user 105 whose face authentication is permitted by the biometric authentication unit 304 and the user 105 whose card authentication is permitted by the belongings authentication unit 307 are the same user 105, The user 105 is permitted to use the image forming apparatus 101.

As another example, the usage control unit 305 may allow the user 105 who is permitted to perform face recognition by the biometric authentication unit 304 to use the image forming apparatus 101.

The user information management unit 308 is realized by, for example, a program (system application or the like) executed by the CPU 121 of FIG. 2, and for example, the user information a313 as shown in FIG. 4A is stored in the storage unit 312. And manage it.

FIG. 4A shows an example of user information a313. The user information a313 stores the user information registered in advance, and the image forming apparatus 101 gives an image to the user registered in the user information a313 and the user information A327 of the main body 110. The use of the forming device 101 is permitted.

The user information a313 of the operation unit 120 may be the same information as the user information A327 of the main body 110, or may be a part of the user information A327 of the main body 110. Here, in order to facilitate the explanation, the following description will be given assuming that the user information a313 of the operation unit 120 stores the same information as the user information A327 of the main body 110.

The user information a313 shown in FIG. 4A includes an "address book number", a "user name", an "email address", a "login ID", a "password", a "card ID", and "face feature information". Information such as is stored.

The "address book number" is an identification number for identifying a plurality of data (data 1, data 2, ..., Data n). The "user name" is, for example, information such as the name of each user. The "email address" is the email address of each user.

The "login ID" is identification information unique to each user, which is used when each user logs in to the image forming apparatus 101 by inputting the login information. The "login password" is a password when each user logs in to the image forming apparatus 101 by inputting login information.

The "card ID" is identification information for identifying the IC card 104 possessed by each user, and is an example of authentication information used in card authentication.

"Face feature information" is face feature information of each user used in face authentication, and is an example of biological feature information used in biometric authentication.

Here, returning to FIG. 3, the description of the functional configuration of the operation unit 120 will be continued.

The display input control unit 309 is realized by, for example, a program executed by the CPU 121 of FIG. 2, and executes control for displaying the display screen on the operation panel 126, control for receiving an input operation on the operation panel 126, and the like.

The setting management unit 310 manages setting information such as priority information 314 and authentication setting information 315 stored in the storage unit 312, for example, which is realized by a program (system application or the like) executed by the CPU 121 of FIG. To do. The priority information 314 and the authentication setting information 315 will be described later.

The communication unit 311 is realized by, for example, a program (system application or the like) executed by the CPU 121 in FIG. 2 and a connection I / F 127, and communicates with the main body 110.

The storage unit 312 is realized by, for example, a program (OS or the like) executed by the CPU 121 of FIG. 2, a flash memory 124, a RAM 123, or the like, and the user information a313, priority information 314, authentication setting information 315, etc. described above are used. Memorize various information of.

The functional configuration of the image forming apparatus 101 shown in FIG. 3 is an example. For example, at least a part of the functional configurations included in the operation unit 120 may be included in the main body 110. Further, at least a part of the functional configurations included in the main body 110 may be included in the operation unit 120. Further, at least a part of each functional configuration shown in FIG. 3 may be realized by hardware.

<Processing flow>
Subsequently, the flow of the authentication method of the user 105 in the information processing system 100 according to the present embodiment will be described.

[First Embodiment]
(Flow of operation unit startup process)
FIG. 5 is a flowchart showing an example of the authentication process of the operation unit according to the first embodiment. This process shows an example of the activation process executed by the operation unit 120 when the approach detection unit 321 (human body detection sensor 102) detects the approach of the user 105 in the power saving state.

When the approach detection unit 321 of the image forming apparatus 101 detects the approach of the user in step S501, the operation unit 120 executes the processes after step S502.

In step S502, the state control unit (operation unit) 301 determines whether or not the authentication setting of the image forming apparatus 101 is valid. For example, the state control unit (operation unit) 301 determines whether or not the authentication setting of the image forming apparatus 101 is valid by referring to the authentication setting information 315 stored in the storage unit 312.

FIG. 4C shows an example of the authentication setting information 315. In the example of FIG. 4C, the authentication setting information 315 includes information such as "authentication setting" and "authentication processing to be executed" as items.

The "authentication setting" is information indicating whether or not the image forming apparatus 101 authenticates the user 105. When the "authentication setting" is "valid", it indicates that the user 105 is authenticated, and when it is "invalid", it indicates that the user 105 is not authenticated.

The "authentication process to be executed" indicates the authentication process to be executed by the image forming apparatus 101 when the "authentication setting" is valid. In the example of FIG. 4C, face authentication and card authentication (IC card) are shown. Authentication) is shown to be performed.

The state control unit (operation unit) 301 can determine whether or not the authentication setting of the image forming apparatus 101 is valid based on the "authentication setting" of the authentication setting information 315.

When the authentication setting of the image forming apparatus 101 is valid, the state control unit (operation unit) 301 shifts the process to step S503 of FIG. On the other hand, when the authentication setting of the image forming apparatus 101 is not valid, the state control unit (operation unit) 301 shifts the process to step S508 of FIG.

When the process proceeds to step S503, the state control unit (operation unit) 301 preferentially activates the imaging unit 302 and the extraction unit 303 among the processing units of the operation unit 120.

In step S504, the imaging unit 302 captures the image of the user 105 with the camera 103.

In step S505, the extraction unit 303 extracts facial feature information from the image captured by the image pickup unit 302.

In step S506, the state control unit (operation unit) 301 activates each processing unit other than the imaging unit 302 and the extraction unit 303 in response to the extraction of facial feature information in step S505. The process of step 506 may be started before the process of step S505 is completed.

Preferably, the state control unit (operation unit) 301 executes the process of step S506 after the extraction unit 303 extracts at least one facial feature information.

In step S507, the operation unit 120 executes the authentication process according to the authentication setting information 315 stored in the storage unit 312.

On the other hand, when the process proceeds from step S502 to step S508, the state control unit (operation unit) 301 stops the process of preferentially activating the imaging unit 302 and the extraction unit 303, and normally, each of the operation units 120 Start the processing unit.

FIG. 6 is a diagram showing an image of the detection range of each device according to the first embodiment. In FIG. 6, the detection range 601 of the human body detection sensor 102 is assumed to be an area having a radius of about 2 m in front of the image forming apparatus 101 (downward in FIG. 6) as an example. Further, the imaging range 602 of the camera 103 is assumed to be a range of about 60 cm in front of the image forming apparatus 101 as an example. Further, the reading range 603 of the IC card reader 106 is assumed to be a range of about 5 cm above the IC card reader 106 as an example.

In this case, the image forming apparatus 101 starts face recognition processing or face feature information extraction processing by the time the user 105 who has entered the detection range 601 of the human body detection sensor 102 reaches the imaging range 602 of the camera 103. It is desirable to start it so that it can be done.

Therefore, the operation unit 120 according to the present embodiment is the imaging unit 302 that executes the face authentication process or the face feature information extraction process when the authentication setting is valid by the activation process shown in FIG. 5, and the extraction. The unit 303 is started preferentially.

Further, the operation unit 120 accelerates the extraction process of the facial feature information by the extraction unit 303 by suspending the activation of the other processing units until the extraction unit 303 extracts at least one facial feature information. be able to.

(Face recognition processing)
FIG. 7 is a flowchart showing an example of face recognition processing according to the first embodiment. This process is an example of the authentication process executed in step S507 of FIG. In the first embodiment, the biometric authentication unit 304 authenticates the face of the user 105 as the authentication process.

In step S701, the biometric authentication unit 304 acquires the face feature information registered in advance. For example, the biometric authentication unit 304 acquires the user information a313 as shown in FIG. 4A from the storage unit 312.

In step S702, the biometric authentication unit 304 acquires the extracted facial feature information of the user 105 from the extraction unit 303. The process of step S702 may be executed before the process of step S701.

In steps S703 to S709, the biometric authentication unit 304 collates each of the face feature information registered in advance with the face feature information extracted by the extraction unit 303, and executes the face authentication process.

For example, in step S703, the variable i is set to "1".

In step S704, the biometric authentication unit 304 calculates the degree of similarity between the i-th facial feature information and the facial feature information extracted by the extraction unit 303 among the pre-registered facial feature information.

In step S705, the biometric authentication unit 304 branches the process depending on whether or not the calculated similarity is equal to or greater than the threshold value.

When the calculated similarity is equal to or greater than the threshold value, the biometric authentication unit 304 shifts the process to step S706 to allow the face authentication of the user 105. On the other hand, if the calculated similarity is not equal to or greater than the threshold value, the biometric authentication unit 304 shifts the process to step S707.

When the process proceeds to step S707, the biometric authentication unit 304 determines whether the value of i has reached iMax, which is the number of feature information (user information) registered in advance.

When the value of i reaches iMax, the biometric authentication unit 304 shifts the process to step S708 and rejects the face authentication of the user 105. On the other hand, when the value of i has not reached iMax, the biometric authentication unit 304 shifts the process to step S709.

When the process proceeds to step S709, the biometric authentication unit 304 adds 1 to the value of i and returns the process to step S704. As a result, the face recognition processing shown in steps S704 to S708 is executed for each of the face feature information registered in advance.

The face recognition process shown in FIG. 7 is an example. The biometric authentication unit 304 can apply any face recognition process as long as it performs face recognition of the user using the facial feature information of the user 105 extracted by the extraction unit 303.

(Transition process to power saving state)
FIG. 8 is a sequence diagram showing an example of the process of moving to the power saving state according to the first embodiment. This process shows an example of a transition process in which the image forming apparatus 101 shifts from a normal state in which a predetermined process can be executed to a power saving state in which power consumption is less than that in the normal state.

In step S801, for example, when the state control unit (main body) 801 detects that the transition condition to the power saving state is satisfied, the image forming apparatus 101 executes the transition processing to the power saving state after step S802. The conditions for shifting to the power saving state include, for example, when the image forming apparatus 101 is not used for more than a preset time, or when the user 105 is instructed to shift to the power saving state. Etc. are included.

In step S802, the state control unit (main body) 801 transmits a power saving transition request requesting the transition to the power saving state to the operation unit 120.

In steps S803 and S804, the state control unit (main body) 801 shifts the main body 110 to the power saving state.

For example, in step S803, the state control unit (main body) 801 shifts the storage unit 114 to the power saving state. As an example, the state control unit (main body) 801 turns off the power to the storage unit 114 after confirming that the writing process of the data being written to the storage unit 114 is completed.

In step S804, the state control unit (main body) 801 shifts the engine unit 117 to the power saving state. As an example, the state control unit (main body) 801 turns off the power to the engine unit 117 after confirming that the image processing being executed by the image forming unit 323 has been completed. The processes of steps S803 and S804 may be executed before the process of step S802, or may be executed in parallel with the process of step S802.

When the state control unit (operation unit) 301 receives the power saving transition request from the main body 110, the state control unit (operation unit) 301 executes the processes after step S805 to shift the operation unit 120 to the power saving state.

For example, in step S805, the state control unit (operation unit) 301 notifies the imaging unit 302 of the power saving transition instruction instructing the transition to the power saving state.

In step S806, when the imaging unit 302 receives the power saving transition request, for example, the power of the camera 103 is turned off to shift the imaging unit 302 to the power saving state.

In step S807, the state control unit (operation unit) 301 notifies the extraction unit 303 of the power saving transition instruction for instructing the transition to the power saving state.

In step S808, when the extraction unit 303 receives the power saving transition request, it shifts to the power saving state (for example, stops the operation).

In step S809, the state control unit (operation unit) 301 notifies the biometric authentication unit 304 of the power saving transition instruction for instructing the transition to the power saving state.

In step S810, when the biometric authentication unit 304 receives the power saving transition request, it shifts to the power saving state (for example, stops the operation).

In step S811, the state control unit (operation unit) 301 notifies the utilization control unit 305 of the power saving transition instruction for instructing the transition to the power saving state.

In step S812, when the utilization control unit 305 receives the power saving transition request, it shifts to the power saving state (for example, stops the operation).

In step S813, the state control unit (operation unit) 301 similarly shifts each of the other blocks (processing unit) to the power saving state.

In step S814, the image forming apparatus 101 is put into a power saving state.

The transition process to the power saving state shown in FIG. 8 is an example, and the order in which the state control unit (operation unit) 301 activates each processing unit may be different from the processing shown in FIG. good.

(Authentication processing from power saving state)
FIG. 9 is a sequence diagram showing an example of the authentication process from the power saving state according to the first embodiment. This process shows an example of the authentication process when the image forming apparatus 101 in the power saving state authenticates the user 105 by the transition process to the power saving state shown in FIG. In FIG. 9, the broken line arrow indicates an operation or operation by the user 105.

In step S901, it is assumed that the user 105 approaches the detection range 601 of the human body detection sensor 102.

In steps S902 and S903, when the approach detection unit 321 of the main body 110 detects the approach of the user 105, the state control unit (main body) 322 is notified of the approach indicating that the approach of the user 105 has been detected.

In step S904, when the state control unit (main body) 322 receives the approach notification from the approach detection unit 321, the state control unit (main body) 322 transmits an activation request requesting activation to the operation unit 120.

In step S905, the state control unit (main body) 322 puts the main body 110 into the normal state by, for example, activating the storage unit 114, the engine unit 117, etc. that were shifted to the power saving state in steps S803 and S804 of FIG. Restore.

In step S906, when the state control unit (operation unit) 301 receives the activation request from the main body 110, for example, referring to the authentication setting information 315 as shown in FIG. 4C, the image forming apparatus 101 is authenticated. Determine if the setting is valid. This process corresponds to the process of step S502 of FIG. Here, it is assumed that the authentication setting is valid, and the following description will be given.

In steps S907 and S908, the state control unit (operation unit) 301 preferentially activates the image pickup unit 302 and the extraction unit 303 as an example.

In step S909, the image pickup unit 302 returns from the power saving state and takes an image of the user 105.

In step S910, the imaging unit 302 notifies the extraction unit 303 of the image of the captured user 105. Alternatively, the image capturing unit 302 may store the captured image of the user 105 in a predetermined area of the storage unit 312.

In step S911, the extraction unit 303 extracts facial feature information from the image of the user 105 captured by the image pickup unit 302.

In step S912, when at least one facial feature information is extracted, the extraction unit 303 notifies the state control unit (operation unit) 301 of an extraction notification indicating that the facial feature information has been extracted.

In step S913, when the state control unit (operation unit) 301 receives the extraction notification from the extraction unit 303, it activates the biometric authentication unit 304 and also activates another processing unit in step S914.

In step S915, the operation unit 120 returns from the power saving state to the normal state and connects to the main body 110.

In steps S916 and S917, the biometric authentication unit 304 acquires the face feature information registered in advance from the user information a313 stored in the storage unit 312, and acquires the facial feature information extracted by the extraction unit 303. get. This process corresponds to, for example, the process of steps S701 and S702 in FIG.

In step S918, the biometric authentication unit 304 performs face authentication of the user 105 using the face feature information registered in advance and the extracted face feature information. This process corresponds to, for example, the process of steps S703 to S709 in FIG. 7.

In step S919, when the face authentication of the user 105 is permitted, the biometric authentication unit 304 transmits an authentication result indicating that the authentication is permitted to the authentication control unit 324 of the main body 110.

In step S920, when the authentication control unit 324 of the main body 110 receives the authentication result indicating that the authentication is permitted, the user 105 is permitted to use the image forming apparatus 101.

By the above processing, the image forming apparatus 101 shifts to the power saving state, then returns from the power saving state in response to the approach of the user 105, and biometric authentication is performed in the information processing system 100 that performs biometric authentication of the user 105. It becomes possible to reduce the authentication waiting time required for.

The process shown in FIG. 9 is an example. In step 906 of FIG. 9, the state control unit (operation unit) 301 gives priority to the biometric authentication unit 304 in addition to the image pickup unit 302 and the extraction unit 303 when the authentication setting of the image forming apparatus 101 is valid. It may be started by.

FIG. 10 is a sequence diagram showing another example of the authentication process from the power saving state according to the first embodiment. In this process, the state control unit (operation unit) 301 preferentially activates the biometric authentication unit 304 in addition to the image pickup unit 302 and the extraction unit 303 when the authentication setting of the image forming apparatus 101 is valid. An example of the process for making the device is shown.

Since the processes shown in steps S901 to S912, S914 to S916, and S918 to S920 in FIG. 10 are the same as the processes shown in FIG. 9, the differences from the processes shown in FIG. 9 will be mainly described here.

When the state control unit (operation unit) 301 determines that the authentication setting is valid in step S906, the state control unit (operation unit) 301 preferentially activates the biometric authentication unit 304 in addition to the imaging unit 302 and the extraction unit 303 in step S1001. ..

As a result, when the facial feature information is extracted in step S911, the extraction unit 303 transfers the extracted facial feature information to the biometric authentication unit 304 without waiting for the biometric authentication unit 304 to start in step S1002. You will be able to notify.

Therefore, the image forming apparatus 101 returns from the power saving state in response to the approach of the user 105 after shifting to the power saving state, and in the information processing system 100 that performs biometric authentication of the user 105, the authentication required for biometric authentication is performed. The waiting time can be further reduced.

(About startup priority)
As a preferred example, when the state control unit (operation unit) 301 activates the operation unit 120, for example, each processing unit is based on the activation priority of the priority information 314 as shown in FIG. 4 (b). Can be started in stages.

In the example of FIG. 4B, the priority information 314 includes information such as "app ID", "app name", and "launch priority".

The "application ID" is identification information for identifying each application (or service) executed by the operation unit 120. The "application name" is the name of each application (or service) executed by the operation unit 120.

The "startup priority" is information indicating the priority when starting each application (or service) executed by the operation unit 120, and the smaller the start priority value is, the higher the priority is. To do. In the example of FIG. 4B, the priority of the face recognition application that realizes the extraction unit 303 of the operation unit 120 and the biometric authentication unit 304 is set to be the highest.

When the operation unit 120 is activated, the state control unit (operation unit) 301, as an example, activates each processing unit step by step in order from the processing having the highest priority based on such priority information 314. Can be done.

[Second Embodiment]
In the second embodiment, an example will be described in which the authentication process executed by the image forming apparatus 101 is a two-factor authentication of face authentication by the biometric authentication unit 304 and IC card authentication by the belongings authentication unit 307.

Two-factor authentication is an authentication method that authenticates a user by combining authentication by two different types of elements. Here, the authentication by different types of elements includes, for example, authentication based on information known to the user 105 (knowledge authentication), authentication based on the belongings of the user 105 (property authentication), and authentication of the living body of the user 105. Includes feature-based authentication (biometric authentication) and the like.

In this embodiment, an example of processing when the user 105 is authenticated by using face authentication, which is an example of biometric authentication, and IC card authentication, which is an example of belongings authentication, will be described.

<Processing flow>
(Two-factor authentication processing)
FIG. 11 is a flowchart showing an example of the two-element verification process according to the second embodiment. This process is an example of the authentication process executed in step S507 of FIG. 5, and is executed, for example, when new facial feature information is extracted by the extraction unit 303.

In step S1101, the biometric authentication unit 304 executes, for example, the face authentication process as shown in FIG. 7.

In step S1102, the biometric authentication unit 304 branches the process depending on whether or not face authentication is permitted.

When face recognition is permitted, the biometric authentication unit 304 shifts the process to step S1103. On the other hand, if face authentication is not permitted, the biometric authentication unit 304 ends the element authentication process.

When the process proceeds to step S1103, the authentication information acquisition unit 306 waits for the IC card 104 to be read by the user 105, and when the reading operation is performed, the authentication information (for example, card ID) is obtained from the IC card 104 of the user 105. get.

In step S1104, the belongings authentication unit 307 determines whether the authentication information acquired by the authentication information acquisition unit 306 is registered in the user information a313 as shown in FIG. 4, for example. Alternatively, the belongings authentication unit 307 determines whether the authentication information acquired by the authentication information acquisition unit 306 is registered in the user information a313 of the operation unit 120 or the user information A327 of the main body 110. Is also good.

If the authentication information acquired by the authentication information acquisition unit 306 is not registered in the user information, the possession authentication unit 307 rejects the possession authentication of the user 105 in step S1105.

On the other hand, when the authentication information acquired by the authentication information acquisition unit 306 is registered in the user information, the possession authentication unit 307 permits the possession authentication of the user 105 in step S1106.

In step S1107, the usage control unit 305 compares the user whose face authentication is permitted in step S1101 with the user whose belongings authentication is permitted in step S1106.

For example, the usage control unit 305 has the identification information of the user 105 (for example, the address book number in FIG. 4) included in the authentication result notified from the biometric authentication unit 304, and the authentication notified from the belongings authentication unit 307. Compare with the identification information of the user 105 included in the result.

In step S1108, the usage control unit 305 branches the process depending on whether the user 105 who is permitted to perform face authentication and the user who is permitted to authenticate belongings are the same user.

If the user 105 who is permitted to perform face authentication and the user who is permitted to authenticate belongings are not the same user, the usage control unit 305 ends the two-factor authentication process. On the other hand, when the user 105 who is permitted to perform face recognition and the user who is permitted to authenticate belongings are the same user, the usage control unit 305 sets the image forming device 101 by the user 105 in step S1109. Allow the use of.

(Authentication processing from power saving state)
FIG. 12 is a diagram showing an example of the authentication process from the power saving state according to the second embodiment. Since the processes of steps S901 to S908 and S1001 of FIG. 12 are the same as the authentication process according to the first embodiment shown in FIG. 10, the differences from the processes shown in FIG. 10 will be mainly described here. ..

In step S1201, the imaging unit 302 and the extraction unit 303 execute, for example, the extraction process of facial feature information as shown in steps S909 to S911 of FIG.

In step S1202, the extraction unit 303 notifies the state control unit (operation unit) 301 of the extraction notification indicating that the facial feature information has been extracted.

In step S1203, when the state control unit (operation unit) 301 receives the extraction notification from the extraction unit 303, the state control unit (operation unit) 301 activates another processing unit.

In step S1204, the operation unit 120 returns from the power saving state to the normal state and connects to the main body 110.

In step S1205, the biometric authentication unit 304 executes, for example, a face authentication process as shown in FIG. 7.

In step S1206, when the face recognition of the user 105 is permitted, the biometric authentication unit 304 notifies the usage control unit 305 of the authentication result indicating that the face recognition of the user 105 is permitted. The authentication result includes identification information (for example, an address book number) that identifies the user 105.

In step S1207, it is assumed that the user 105 performs a reading operation of the IC card 104 with respect to the IC card reader 106.

In step S1208, when the IC card reading operation is performed, the belongings authentication unit 307 executes, for example, the belongings authentication process as shown in steps S1103 to S1106 of FIG.

In step S1209, when the possession authentication of the user 105 is permitted, the possession authentication unit 307 notifies the usage control unit 305 of the authentication result indicating that the possession authentication of the user 105 is permitted. The authentication result includes identification information (for example, an address book number) that identifies the user 105.

In step S1210, the utilization control unit 305 executes, for example, the utilization control process as shown in steps S1107 to S1109 of FIG.

In step S1211, when the user 105 is permitted to use the image forming device 101, the usage control unit 305 provides the main body 110 with usage permission information indicating that the user 105 is permitted to use the image forming device 101. It is transmitted to the authentication control unit 324 of.

In step S1212, when the authentication control unit 324 of the main body receives the usage permission information from the operation unit 120, the authentication control unit 324 of the main body permits the use of the main body 110. As a result, the user 105 can use the image processing functions such as copying, scanning, and printing executed by the main body 110.

By the above processing, it is possible to reduce the authentication waiting time required for biometric authentication in the information processing system 100 that executes two-element authentication by face authentication (an example of biometric authentication) and IC card authentication (an example of belongings authentication). become able to.

[Third Embodiment]
In the first and second embodiments, when the approach detection unit 321 detects the approach of the user 105 in the power saving state, the activation control unit that preferentially activates the processing related to face recognition is the state control unit (operation unit). ) 301 has been described.

In the third embodiment, when the approach detection unit 321 detects the approach of the user 105 in the power saving state, the activation control unit that preferentially activates the processing related to face authentication is the state control unit (main body) 322. An example of a certain case will be described.

<Processing flow>
(Starting process of the main body)
FIG. 13 is a flowchart showing an example of the activation process of the main body according to the third embodiment. This process shows an example of the process on the main body 110 side when the approach detection unit 321 detects the approach of the user 105 in the power saving state.

In step S1301, when the approach detection unit 321 of the image forming apparatus 101 detects the approach of the user 105 in the power saving state, the state control unit (main body) 322 executes the processes after step S1302.

In step S1302, the state control unit (operation unit) 301 activates, for example, the storage unit 114, the engine unit 117, and the like to return the main body 110 from the power saving state to the normal state.

In step S1303, the state control unit (operation unit) 301 acquires the authentication setting information 315 as shown in, for example, FIG. 4C from the operation unit 120.

Here, the communication unit 311 and the storage unit 312 of the operation unit 120 continue the processing even after the operation unit 120 shifts to the power saving state, and stores the authentication setting information in response to the acquisition request from the main body 110. It is assumed that the authentication setting information 315 stored in the unit 312 can be provided.

In step S1304, the state control unit (operation unit) 301 determines whether or not face recognition is effective in the image forming apparatus 101.

For example, in the state control unit (operation unit) 301, the authentication setting is "valid" in the authentication setting information 315 as shown in FIG. 4C, and the authentication process to be executed includes "face recognition". In this case, the image forming apparatus 101 determines that face recognition is effective. Further, the state control unit (operation unit) 301 uses the image forming apparatus 101 when the authentication setting is "invalid" in the authentication setting information 315 or when the authentication process to be executed does not include "face recognition". , Judge that face recognition is not valid.

When face recognition is enabled in the image forming apparatus 101, the state control unit (operation unit) 301 transmits to the operation unit 120 an activation request requesting activation of the operation unit 120 with priority given to face authentication in step S1305. ..

On the other hand, when face recognition is not valid in the image forming apparatus 101, the state control unit (operation unit) 301 transmits an activation request requesting activation of the normal operation unit 120 to the operation unit 120 in step S1306.

(Starting process of image forming device)
FIG. 14 is a sequence diagram (1) showing an example of activation processing of the image forming apparatus according to the third embodiment. This process shows an example of the process of the entire image forming apparatus 101 corresponding to the activation process of the main body 110 shown in FIG.

In step S1401, it is assumed that the user 105 approaches the detection range 601 of the human body detection sensor 102.

In steps S1402 and S1403, when the approach detection unit 321 of the main body 110 detects the approach of the user 105, the state control unit (main body) 322 is notified of the approach indicating that the approach of the user 105 has been detected.

In step S1404, the state control unit (main body) 322 activates, for example, the storage unit 114, the engine unit 117, and the like to return the main body 110 to the normal state.

In step S1405, the state control unit (main body) 322 transmits an authentication setting information acquisition request requesting the acquisition of the authentication setting information 315 to the operation unit 120.

In step S1406, the state control unit (main body) 322 receives the authentication setting information 315 transmitted from the operation unit 120.

In step S1407, the state control unit (main body) 322 confirms whether face recognition is valid in the image forming apparatus 101 based on the authentication setting information 315.

When the face recognition is valid, the image forming apparatus 101 executes the process 1410 when the face recognition shown in steps S141 to S1414 is valid. On the other hand, when the face recognition is not valid, the image forming apparatus 101 executes the process 1420 when the face recognition shown in steps S1421 and S1422 is not valid.

When the process proceeds to step 1411, the state control unit (main body) 322 transmits to the operation unit 120 an activation request (face recognition priority) requesting the activation of the operation unit 120 with face recognition priority.

In step S1411, when the state control unit (operation unit) 301 receives the activation request (face recognition priority) from the main body 110, the state control unit (operation unit) 301 activates the operation unit 120 with face recognition priority. For example, the state control unit (operation unit) 301 activates the imaging unit 302, the extraction unit 303, the biometric authentication unit 304, and the like by the processing of steps S907, S908, and S1001 in FIG.

In step S1413, the imaging unit 302, the extraction unit 303, and the biometric authentication unit 304 execute the face authentication process. For example, the imaging unit 302 captures an image of the user 105, and the extraction unit 303 extracts the facial feature information of the user 105 from the captured image. Further, the biometric authentication unit 304 executes, for example, a face authentication process as shown in FIG. 7.

In step S1414, the state control unit (operation unit) 301 activates the other processing unit among the processing units of the operation unit 120.

On the other hand, when the process proceeds to step S1421, the state control unit (main body) 322 transmits a start request (normal) requesting normal start to the operation unit 120.

When the process proceeds to step S1422, the state control unit (operation unit) 301 stops the process of activating the operation unit 120 with priority on face recognition, and executes a normal activation process of activating each processing unit of the operation unit 120.

As described above, when the approach detection unit 321 detects the approach of the user 105 in the power saving state, the activation control unit that preferentially activates the processing related to face recognition may be the state control unit (main body) 322. good.

(Processing when face recognition fails)
FIG. 15 is a sequence diagram (2) showing an example of activation processing of the image forming apparatus according to the third embodiment. This process shows an example of a suitable process when the image forming apparatus 101 fails to authenticate the face. Since the processes of steps S1501 to S1413 of FIG. 15 are the same as the processes shown in FIG. 14, the description will be given here focusing on the differences from the processes shown in FIG.

If the face recognition fails in step S1501, the operation unit 120 executes the processes after step S1502.

If face recognition fails, for example, if the imaging unit 302 cannot capture an image within a predetermined time, or if the extraction unit 303 cannot extract facial feature information, the biometric authentication unit 304. This includes cases where face recognition is rejected due to.

In step S1502, the state control unit (operation unit) 301 stops the face recognition process by the imaging unit 302, the extraction unit 303, and the biometric authentication unit 304.

In step S1503, the state control unit (operation unit) 301 activates the other processing unit among the processing units of the operation unit 120.

In step S1504, the display input control unit 309 displays, for example, the display screen 1600 as shown in FIG. 16 on the operation panel 126, and notifies the user 105 that face recognition cannot be used.

As shown in FIG. 16, the display screen 1600 for notifying the user 105 that face authentication cannot be used includes a message indicating that face authentication cannot be used, execution of other user authentication, and the like. As a result, the image forming apparatus 101 can prompt the user 105 to perform another user authentication (for example, password authentication) operation.

100 Information processing system 101 Image forming device 102 Human body detection sensor (detection device)
103 camera (imaging device)
110 main unit (execution device)
120 Operation unit (information processing device, operation device)
301 State control unit (operation unit) (example of start control unit)
303 Extraction unit 304 Biometric authentication unit 305 Usage control unit 306 Authentication information acquisition unit 307 Inventory authentication unit 310 Setting management unit 322 State control unit (main unit) (Example of activation control unit)

Japanese Unexamined Patent Publication No. 2016-173831

Claims (10)

An information processing system including a detection device for detecting the approach of a user, an image pickup device for capturing an image of the user, and an information processing device connected to the image pickup device.
The information processing device
An extraction unit that extracts characteristic information of the user's living body from the image of the user captured by the imaging device, and an extraction unit.
A biometric authentication unit that performs biometric authentication of the user using the biometric information of the living body registered in advance and the biometric information of the user extracted by the extraction unit.
A usage control unit that permits the user to use the information processing device based on the result of the biometric authentication.
Have,
The information processing system
A setting management unit that manages whether or not the authentication setting of the information processing system is valid, and
A state control unit that shifts the imaging device and the information processing device from a normal state capable of executing a predetermined process to a power saving state that consumes less power than the normal state according to a predetermined transition condition.
In the power saving state, when the detection device detects the approach of the user, if the authentication setting of the information processing system is valid, the image pickup device and the extraction unit are started preferentially. Control unit and
Information processing system. The activation control unit in accordance with the extraction of the feature information of the living body by prior Symbol extractor to activate the other processing unit of the information processing apparatus, an information processing system according to claim 1. The start control unit
In the power saving state, when the detection device detects the user, if the authentication setting of the information processing system is valid, the biometric authentication unit is added to the image pickup device and the extraction unit. The information processing system according to claim 1, which is preferentially activated. An information processing system including a detection device for detecting the approach of a user, an image pickup device for capturing an image of the user, and an information processing device connected to the image pickup device.
The information processing device
An extraction unit that extracts characteristic information of the user's living body from the image of the user captured by the imaging device, and an extraction unit.
A biometric authentication unit that performs biometric authentication of the user using the biometric information of the living body registered in advance and the biometric information of the user extracted by the extraction unit.
A usage control unit that permits the user to use the information processing device based on the result of the biometric authentication.
Have,
The information processing system
A setting management unit that manages information on one or more authentication processes that are valid in the information processing system, and
A state control unit that shifts the imaging device and the information processing device from a normal state capable of executing a predetermined process to a power saving state that consumes less power than the normal state according to a predetermined transition condition.
When the detection device detects the user in the power saving state and the biometric authentication is included in the one or more authentication processes, the imaging device, the extraction unit, and the biometric authentication unit are prioritized. a start control unit which Ru manner activates,
The having, an information processing system. The start control unit
The information processing system according to claim 3 or 4 , wherein the other processing unit of the information processing apparatus is activated in response to the biometric authentication processing of the user by the biometric authentication unit. The information processing system according to claim 5 , wherein the activation control unit cancels the biometric authentication and activates the other processing unit when the biometric authentication of the user is not permitted. The authentication information acquisition unit that acquires the authentication information used for the user's possession authentication from the possession of the user, and the authentication information acquisition unit.
A property authentication unit that authenticates the user's property using the authentication information registered in advance and the authentication information extracted by the authentication information acquisition unit.
Have,
When the user who is permitted to perform biometric authentication and the user who is permitted to authenticate belongings are the same user, the usage control unit permits the user to use the information processing device. The information processing system according to any one of Items 1 to 6. An operation device that is connected to a detection device that detects the approach of a user, an image pickup device that captures an image of the user, and receives an operation of the user, and an execution device that executes image processing based on the operation. An image processing device that includes
The operating device is
An extraction unit that extracts characteristic information of the user's living body from the image of the user captured by the imaging device, and an extraction unit.
A biometric authentication unit that performs biometric authentication of the user using the biometric information of the living body registered in advance and the biometric information of the user extracted by the extraction unit.
A usage control unit that permits the user to use the image processing device based on the result of the biometric authentication.
A start control unit that preferentially activates the image pickup device and the extraction unit when the detection device detects the approach of the user in a power saving state in which power consumption is less than that in a normal state in which a predetermined process can be executed. When,
Have a,
The image processing device is
A setting management unit that manages whether or not the authentication setting of the image processing device is valid, and
A state control unit that shifts the imaging device and the operating device from a normal state in which a predetermined process can be executed to a power saving state in which power consumption is lower than that in the normal state according to a predetermined transition condition.
In the power saving state, when the detection device detects the approach of the user, if the authentication setting of the image processing device is valid, the image pickup device and the extraction unit are started preferentially. Control unit and
An image processing device. A method for authenticating the user in an information processing system including a detection device for detecting the approach of the user, an image pickup device for capturing an image of the user, and an information processing device connected to the image pickup device. ,
The information processing device
An extraction process of extracting the feature information of a living body of the user from the user's images captured in the previous SL imaging device,
A biometric authentication process for performing biometric authentication of the user using the biometric information of the living body registered in advance and the biometric information of the user extracted by the extraction process.
Based on the result of the biometric authentication process , a usage control process for permitting the user to use the information processing device, and a usage control process.
And
The information processing system
A setting management process that manages whether or not the authentication setting of the information processing system is valid, and
A state control process for shifting the imaging device and the information processing device from a normal state in which a predetermined process can be performed to a power saving state in which power consumption is lower than that in the normal state according to a predetermined transition condition.
In the power saving state, when the detection device detects the approach of the user, if the authentication setting of the information processing system is valid, the imaging device and the extraction process are started preferentially. Control processing and
User authentication method to execute. Authentication of the user in an information processing system including a detection device that detects the approach of the user, an image pickup device that captures an image of the user, and an information processing device connected to the image pickup device.
The information processing device
An extraction process for extracting characteristic information of the user's living body from the image of the user captured by the imaging device, and
A biometric authentication process for performing biometric authentication of the user using the biometric information of the living body registered in advance and the biometric information of the user extracted by the extraction process.
Based on the result of the biometric authentication process, a usage control process for permitting the user to use the information processing device, and a usage control process.
Have,
The information processing system
A setting management process that manages information on one or more authentication processes that are valid in the information processing system, and
A state control process for shifting the imaging device and the information processing device from a normal state in which a predetermined process can be performed to a power saving state in which power consumption is lower than that in the normal state according to a predetermined transition condition.
When the detection device detects the user in the power saving state, if the biometric authentication is included in the one or more authentication processes, the imaging device, the extraction process, and the biometric authentication process are prioritized. Start control process to start
User authentication method to execute.

Images