JP2019010777A - Information processing system, image processing device, and user's authentication method - Google Patents

Abstract

To reduce an authentication waiting time required for biometric authentication in an information processing system which recovers from a power-saving state in accordance with user's approach after shifting to the power-saving state to perform biometric authentication of the user.SOLUTION: An information processing system is an information processing system including a detection device, an imaging device and an information processing device. The information processing device includes: an extraction part for extracting feature information of a living body of a user from an image of the user picked up by an imaging device; a living body authentication part for performing biometric authentication by using preliminarily registered feature information and the feature information of the living body extracted by the extraction part; and a use control part for permitting the use of the information processing device by the user on the basis of a result of the biometric authentication. The information processing system includes: a state control part for shifting the imaging device and the information processing device to a power-saving state; and a start control part for preferentially starting the imaging device and the extraction part when the detection device detects approach of the user in the power-saving state.SELECTED DRAWING: Figure 3

Description

  The present application relates to an information processing system, an image processing apparatus, and a user authentication method.

  As an authentication method for authenticating a user, biometric authentication such as face authentication is possible, which does not require an operation such as input of a password and can prevent the theft of an IC card storing authentication information or the spoofing of a password. It is popular.

  In addition, in an image forming apparatus that shifts to a power saving state when it has not been used for a predetermined time, it detects a user's approach using a mobile sensor and returns from the power saving state, thereby performing face authentication, etc. There is known a technique for reducing the waiting time required for (see, for example, Patent Document 1).

  In the conventional technique, when the image forming apparatus is returned from the power saving state, the activation process of the image forming apparatus and the face authentication process are executed in parallel. In this case, since both the image forming apparatus activation process and the face authentication process (particularly, the facial feature amount extraction process) are heavy, the authentication waiting time required for the face authentication process is increased. is there.

  Note that such a problem is not limited to the face authentication of the image forming apparatus, but after the transition to the power saving state, the user returns from the power saving state according to the approach of the user and performs various types of biometric authentication of the user. Common to information processing systems.

  The embodiment of the present invention has been made in view of the above-described problems. After shifting to the power saving state, the embodiment returns from the power saving state according to the approach of the user and performs biometric authentication of the user. In the information processing system, the authentication waiting time required for biometric authentication is reduced.

  In order to solve the above problems, an information processing system according to an embodiment of the present invention is connected to a detection device that detects the approach of a user, an imaging device that captures an image of the user, and the imaging device. An information processing system including an information processing device, wherein the information processing device is previously registered with an extraction unit that extracts feature information of the user's biological body from an image of the user captured by the imaging device Based on the biometric feature information and the biometric feature information of the user extracted by the extraction unit, the biometric authentication unit that performs biometric authentication of the user, based on the result of the biometric authentication, A usage control unit that allows the user to use the information processing device, and the information processing system can execute predetermined processing on the imaging device and the information processing device in accordance with predetermined transition conditions. Normal state A state control unit that shifts to a power saving state that consumes less power than the normal state, and when the detection device detects the approach of the user in the power saving state, the imaging device and the extraction unit are An activation control unit that activates preferentially.

  According to an embodiment of the present invention, after transitioning to a power saving state, in an information processing system that recovers from a power saving state in response to the approach of a user and performs biometric authentication of the user, waiting for authentication required for biometric authentication. Time can be reduced.

It is a figure showing an example of composition of an information processing system concerning one embodiment. 2 is a diagram illustrating an example of a hardware configuration of an image forming apparatus according to an embodiment. FIG. 1 is a diagram illustrating an example of a functional configuration of an image forming apparatus according to an embodiment. FIG. 6 is a diagram illustrating an example of information managed by an image forming apparatus according to an embodiment. It is a flowchart which shows the example of the starting process of the operation part which concerns on 1st Embodiment. It is a figure which shows the image of the detection range of each device which concerns on 1st Embodiment. It is a flowchart which shows the example of the face authentication process which concerns on 1st Embodiment. It is a sequence diagram which shows the example of the transfer process to the power saving state which concerns on 1st Embodiment. It is a sequence diagram which shows an example of the authentication process from the power saving state which concerns on 1st Embodiment. It is a sequence diagram which shows another example of the authentication process from the power saving state which concerns on 1st Embodiment. It is a flowchart which shows the example of the 2 factor authentication process which concerns on 2nd Embodiment. It is a sequence diagram which shows the example of the authentication process from the power saving state which concerns on 2nd Embodiment. It is a flowchart which shows the example of the starting process of the main body which concerns on 3rd Embodiment. FIG. 10 is a sequence diagram (1) illustrating an example of activation processing of an image forming apparatus according to a third embodiment. FIG. 10 is a sequence diagram (2) illustrating an example of a startup process of an image forming apparatus according to a third embodiment. It is a figure which shows the example of the display screen which concerns on 3rd Embodiment.

  Embodiments of the present invention will be described below with reference to the accompanying drawings.

<System configuration>
FIG. 1 is a diagram illustrating a configuration example of an information processing system according to an embodiment. The information processing system 100 includes an image forming apparatus 101, a human body detection sensor 102 included in the image forming apparatus 101, and a camera 103.

  Preferably, the information processing system 100 further includes an IC card reader 106 provided in the image forming apparatus 101, an IC card 104 possessed by the user 105, and the like.

  The image forming apparatus (image processing apparatus) 101 is an image processing apparatus such as an MFP (Multifunction Peripheral) having functions such as a printer, a scanner, a copy, and a facsimile, a copier, and a printer.

  Preferably, the image forming apparatus 101 includes a main body (execution apparatus) 110 that executes image processing, and an operation unit (operation apparatus) 120 that is connected to the main body 110 and receives an operation of the user 105.

  The operation unit (information processing apparatus) 120 has a general computer configuration, and is an information processing apparatus that operates on a power-saving OS (Operating System) such as Android (registered trademark), for example.

  The main body 110 has, for example, an engine unit that executes image processing in addition to a general computer configuration. For example, printing, scanning, copying, and the like can be performed according to an operation on the operation unit 120 by the user 105. Perform image processing.

  The human body detection sensor (detection device) 102 is a detection device that detects the user 105 approaching the image forming apparatus 101 (or the operation unit 120). For example, a pyroelectric sensor or the like is used as the human body detection sensor 102 to detect a human body or the like within a predetermined detection range (for example, within 2 m).

  The detection device provided in the image forming apparatus 101 may be a detection device other than the human body detection sensor 102 as long as it can detect the user 105 approaching within a predetermined detection range. For example, the image forming apparatus 101 may be a wireless communication device that detects the approach of the user 105 using radio waves of a wireless terminal possessed by the user 105 instead of the human body detection sensor 102. Here, as an example, the following description will be made assuming that the detection device provided in the image forming apparatus 101 is the human body detection sensor 102.

  The camera 103 is an imaging device that captures an image used for face authentication of the user 105 who uses the image forming apparatus 101.

  The IC card reader 106 is a reading device that acquires authentication information (such as a card ID) used for IC card authentication from an IC card 104 possessed by the user 105. The IC card authentication is an example of possession authentication for authenticating the user 105 based on authentication information acquired from the possession of the user 105. Further, the IC card 104 is an example of belongings used for authentication of belongings of the user 105.

  Note that the image forming apparatus 101 may authenticate the possession of the user 105 with the possession of the user 105 (for example, an information terminal, a wireless tag, etc.) different from the IC card. Here, as an example, the following description will be given on the assumption that the belonging authentication executed by the image forming apparatus 101 is IC card authentication.

  In the above configuration, the image forming apparatus 101 has a power saving function. For example, when the image forming apparatus 101 is not used for a predetermined time, the image forming apparatus 101 can execute image processing. The normal state is shifted to a power saving state that consumes less power than the normal state. The image forming apparatus 101 stops the functions of the camera 103, the IC card reader 106, the operation unit 120, and a part of the main body 110 (engine unit, storage unit, etc.) in the power saving state. Power consumption can be reduced.

  On the other hand, even after the image forming apparatus 101 shifts to the power saving state, the human body detection sensor 102 continues to detect the user 105 approaching within a predetermined detection range, and the approach of the user 105 is detected. Then, the image forming apparatus 101 is returned to the normal state step by step.

  For example, when the image forming apparatus 101 detects the approach of the user 105 in the power saving state, the image forming apparatus 101 preferentially activates a function necessary for the face authentication of the user 105 and performs a predetermined process. Activate other functions.

  As an example, when the approach of the user 105 is detected in the power saving state, the image forming apparatus 101 captures the image of the user 105, and the facial feature information of the user 105 from the captured image. Priority is given to starting the process of extracting. The image forming apparatus 101 activates another processing unit after extracting the facial feature information of the user 105.

  This is because both the process of starting the operation unit 120 and the process of extracting facial feature information are heavy, and if executed simultaneously, the load on the CPU (Central Processing Unit) increases and the waiting time required for face authentication This is because it becomes longer.

  As another example, when the approach of the user 105 is detected in the power saving state, the image forming apparatus 101 and the camera 103 that captures an image of the user 105 and an application program (hereinafter referred to as an application) that performs biometric authentication. Called) with priority. The image forming apparatus 101 activates another processing unit after executing the face authentication process of the user 105.

  As described above, when the approach of the user 105 is detected in the power saving state, the image forming apparatus 101 according to the present embodiment preferentially activates a function necessary for the face authentication of the user 105 and performs predetermined processing. After performing the above process, activate other functions.

  Thus, according to the present embodiment, after shifting to the power saving state, the information processing system 100 that returns from the power saving state according to the approach of the user 105 and performs biometric authentication of the user 105 performs biometric authentication. The required authentication waiting time can be reduced.

  Note that the system configuration shown in FIG. 1 is merely an example. For example, the information processing system 100 is a system that includes other information processing devices that authenticate users, such as a PC (Personal Computer), a tablet terminal, a smartphone, a game machine, a video conference device, and an ATM (Automatic Teller Machine). Also good.

<Hardware configuration>
FIG. 2 is a diagram illustrating an example of a hardware configuration of the image forming apparatus according to the embodiment. The image forming apparatus 101 includes, for example, a main body 110 that executes various types of image processing such as a copy function, a scanner function, a fax function, and a printer function, and an operation unit 120 that receives an operation of a user 105. The main body 110 and the operation unit 120 are connected to each other via a dedicated communication path 201 so that they can communicate with each other. The communication path 201 may be, for example, a USB (Universal Serial Bus) standard, but may be of any standard regardless of wired or wireless.

  The main body 110 can perform an operation according to the operation received by the operation unit 120. Further, the main body 110 can communicate with an external device such as a client PC via the network 202, and can also perform an operation according to an instruction received from the external device.

(Hardware configuration of the main unit)
First, the hardware configuration of the main body 110 will be described. As shown in FIG. 2, the main body 110 includes a CPU 111, a ROM (Read Only Memory) 112, a RAM (Random Access Memory) 113, a storage unit 114, a communication I / F (Interface) 115, a connection I / F 116, and an engine unit 117. A human body detection sensor 102, an external connection I / F 118, a system bus 119, and the like.

  The CPU 111 is an arithmetic device that controls the overall operation of the main body 110 by executing a program stored in the ROM 112, the storage unit 114, or the like using the RAM 113 as a work area (work area). For example, the CPU 111 uses the engine unit 117 to realize various functions such as a copy function, a scanner function, a fax function, and a printer function.

  The ROM 112 is, for example, a nonvolatile memory that stores a basic input / output system (BIOS) that is executed when the main body 110 is started up, various settings, and the like. The RAM 113 is a volatile memory used as a work area for the CPU 111. The storage unit 114 is a nonvolatile storage device that stores, for example, an OS, application programs, various data, and the like, and includes, for example, an HDD (Hard Disk Drive), an SSD (Solid State Drive), or the like.

  The communication I / F 115 is a network interface such as a wireless LAN or a wired LAN for connecting the main body 110 to the network 202 and communicating with an external device connected to the network 202. The connection I / F 116 is an interface for communicating between the main body 110 and the operation unit 120 via the communication path 201.

  The engine unit 117 is hardware that performs general-purpose information processing and processing other than communication for realizing functions such as a copy function, a scanner function, a fax function, and a printer function. The engine unit 117 includes, for example, a scanner (image reading unit) that scans and reads an image of a document, a plotter (image forming unit) that performs printing on a sheet material such as paper, and a fax unit that performs fax communication. . Furthermore, the engine unit 117 may include specific options such as a finisher that sorts printed sheet materials and an ADF (automatic document feeder) that automatically feeds documents.

  The human body detection sensor 102 corresponds to the human body detection sensor 102 described with reference to FIG. 1 and is a detection device that detects a user 105 approaching the image forming apparatus 101. Note that the main body 110 may include another detection device that detects the approach of the user 105 by a method different from the human body detection sensor 102.

  The external connection I / F 118 is an interface such as a USB for connecting an external device. The IC card reader 106, the human body detection sensor 102, and the like may be connected to the main body 110 via the external connection I / F 118.

  The system bus 119 is connected to each of the above components, and transmits an address signal, a data signal, various control signals, and the like.

(Hardware configuration of operation unit)
Next, the hardware configuration of the operation unit 120 will be described. 2, the operation unit 120 includes a CPU 121, a ROM 122, a RAM 123, a flash memory 124, a communication I / F 125, an operation panel 126, a connection I / F 127, an IC card reader 106, a camera 103, an external connection I / F 129, And a system bus 130 and the like.

  The CPU 121 is an arithmetic device that controls the operation of the entire operation unit 120 by executing a program stored in the ROM 122, the flash memory 124, or the like using the RAM 123 as a work area (work area). The ROM 122 is, for example, a non-volatile memory that stores a BIOS executed when the operation unit 120 is activated, various settings, and the like. The RAM 123 is a volatile memory used as a work area for the CPU 121. The flash memory 124 is a non-volatile storage device that stores an OS, application programs, various data, and the like, for example.

  The communication I / F 125 is a network interface such as a wireless LAN or a wired LAN for connecting the operation unit 120 to the network 202 and performing communication with an external device connected to the network 202.

  The operation panel 126 accepts various inputs in accordance with user operations and displays various information. The operation panel 126 is constituted by, for example, a liquid crystal display (LCD) having a touch panel function, but is not limited thereto. The operation panel 126 may be composed of, for example, an organic EL (Electro Luminescence) display device equipped with a touch panel function. Furthermore, the operation panel 126 can be provided with an operation unit such as a hardware key or a display unit such as a lamp in addition to or instead of this.

  The connection I / F 127 is an interface for communicating between the operation unit 120 and the main body 110 via the communication path 201.

  The IC card reader 106 corresponds to the IC card reader 106 described with reference to FIG. 1, and reads the authentication information (card ID or the like) used for IC card authentication from the IC card 104 possessed by the user 105. It is. Note that the operation unit 120 may include a reading device that reads authentication information used for belongings authentication from the belongings of the user 105 different from the IC card 104.

  The camera 103 corresponds to the camera 103 described with reference to FIG. 1 and is an imaging device that captures an image used for face authentication of the user 105. Note that the operation unit 120 may include an acquisition device that acquires biometric information used for biometric authentication of the user 105 different from face authentication.

  The external connection I / F 129 is an interface such as a USB for connecting an external device. The IC card reader 106 and the camera 103 may be connected to the operation unit 120 via the external connection I / F 129.

  The system bus 130 is connected to each of the above components, and transmits an address signal, a data signal, various control signals, and the like.

<Functional configuration>
FIG. 3 is a diagram illustrating an example of a functional configuration of the image forming apparatus according to the embodiment.

(Functional structure of the main unit)
The main body 110 of the image forming apparatus 101 includes an approach detection unit 321, a state control unit (main body) 322, an image forming unit 323, an authentication control unit 324, a communication unit 325, a storage unit 326, and the like.

  The approach detection unit 321 is realized, for example, by a detection device such as the human body detection sensor 102 in FIG. 2 or a program executed by a microcomputer (microcomputer) included in the detection device. The approach detection unit 321 detects a user approaching the image forming apparatus 101 (or the operation unit 120). Further, the approach detection unit 321 continues the detection process even after the image forming apparatus 101 shifts to the power saving state, and when the approach of the user 105 is detected, the approach indicating that the approach of the user 105 is detected. Notification is sent to the state control unit (main body) 322.

  The state control unit (main body) 322 is realized by, for example, a program executed by the CPU 111 in FIG. The state control unit (main body) 322 is an example of a state control unit that shifts the image forming apparatus 101 from a normal state in which a predetermined process can be performed to a power saving state that consumes less power than the normal state in accordance with a predetermined transition condition. It is.

  For example, the state control unit (main body) 322 includes the operation unit 120, the camera 103, the engine unit 117 of the main body 110, the storage unit 114, and the like when the image forming apparatus 101 is not used for a preset time. Shift to power saving mode.

  In addition, when the approach detection unit 321 detects the approach of the user 105 in the power saving state, the state control unit (main body) 322 transmits an activation request for requesting activation to the operation unit 120, and The engine unit 117, the storage unit 114, and the like are activated.

  The image forming unit 323 is realized by, for example, a program executed by the CPU 111 in FIG. 2, and executes image processing such as printing, copying, scanning, and faxing using the engine unit 117 in FIG.

  The authentication control unit 324 is realized, for example, by a program executed by the CPU 111 in FIG. 2, and functions of the main body 110 by the user 105 permitted to use the image forming apparatus 101 by the operation unit 120 (for example, printing and copying). Etc.) is permitted.

  The communication unit 325 is realized by, for example, a program executed by the CPU 111 in FIG. 2, the connection I / F 116, and the like, and communicates with the operation unit 120 via the communication path 201.

  The storage unit 326 is realized by, for example, the program executed by the CPU 111 in FIG. 2, the RAM 113, the storage unit 114, and the like, and stores information such as user information A 327 that is user information registered in advance.

(Function configuration of the operation unit)
Next, the functional configuration of the operation unit 120 will be described.

  The operation unit 120 includes, for example, a state control unit (operation unit) 301, an imaging unit 302, an extraction unit 303, a biometric authentication unit 304, a usage control unit 305, an authentication information acquisition unit 306, a belonging authentication unit 307, and user information management. A unit 308, a display input control unit 309, a setting management unit 310, a communication unit 311 and a storage unit 312.

  The state control unit (operation unit) 301 is realized by, for example, a program executed by the CPU 121 in FIG. 2, a process for shifting the operation unit 120 to the power saving state, and the operation unit 120 from the power saving state to the normal state. It is an example of the starting control part which performs the process to make.

  For example, when the state control unit (operation unit) 301 receives a power saving transition request for requesting a transition to the power saving state from the main body 110, the processing unit of the operation unit 120 can be stopped and a predetermined process can be executed. The operation unit 120 is shifted to a power saving state in which the power consumption is lower than the normal state.

  In addition, for example, when the state control unit (operation unit) 301 receives an activation request for requesting a return from the power saving state to the normal state from the main body 110, the state control unit (operation unit) 301 activates each processing unit of the operation unit 120 in stages. The operation unit 120 is returned to the normal state. At this time, the state control unit (operation unit) 301 preferentially activates the processing units related to face authentication among the processing units of the operation unit 120 over other processing units.

  As an example, when returning the operation unit 120 from the power saving state to the normal state, the state control unit (operation unit) 301 extracts the imaging unit 302 (camera 103) and the extraction from among the processing units included in the operation unit 120. The unit 303 is activated with priority over other processing units.

  As another example, when the state control unit (operation unit) 301 returns the operation unit 120 from the power saving state to the normal state, among the processing units included in the operation unit 120, the imaging unit 302, the extraction unit, and the like. 303 and the biometric authentication unit 304 are activated with priority over other processing units.

  The imaging unit 302 is realized by, for example, the camera 103 in FIG. 2 or a program executed by the microcomputer included in the camera 103 and captures an image of the user 105 used for face authentication of the user 105.

  For example, the camera 103 included in the image forming apparatus 101 is installed so that the user 105 who operates the operation unit 120 of the image forming apparatus 101 can be accommodated in an image captured by the imaging unit 302. An image is continuously captured using 103.

  The extraction unit 303 is realized by, for example, a program executed by the CPU 121 in FIG. 2 (such as a face authentication application that performs face authentication processing), and the user 105's face is extracted from the image of the user 105 captured by the imaging unit 302. Extract facial feature information used for authentication.

  For example, the extraction unit 303 detects parts such as a contour of the user's 105 face, eyes, and nose from the image captured by the imaging unit 302 using a known pattern matching technique, and detects the face of the user 105. In addition to detecting an image, facial feature information is extracted from the detected face image. Here, the face feature information is a feature amount (for example, information representing features common to eyes, nose, mouth, etc.) used for user verification in face authentication, and various known feature information is applied. Can do.

  In the present embodiment, the type of feature information to be used is not particularly limited. For example, the feature information can be extracted using a known Haar-Like feature amount or the like. At this time, the extraction unit 303 extracts the feature amount of each part of the face from the detected face image and digitizes it. When extracting the feature amount, for example, the feature information is sequentially digitized from the edge of the face image, such as sequentially digitizing from the upper left part of the face image.

  Therefore, when the operation unit 120 is activated, the imaging unit 302 (camera 103) and the extraction unit 303, which are used for extracting facial feature information, are activated preferentially, and activation processing of other processes can be suppressed. desirable.

  The biometric authentication unit 304 is realized by, for example, a program (such as a biometric authentication application that executes biometric authentication processing) executed by the CPU 121 in FIG. 2, and facial feature information registered in advance and the face extracted by the extraction unit 303 The face authentication of the user 105 is performed using the feature information.

  For example, the biometric authentication unit 304 calculates the similarity between each of the facial feature information registered in advance in the user information and the facial feature information extracted by the extraction unit 303, and the calculated similarity is equal to or greater than a threshold value. If it is, the face authentication of the user 105 is permitted. Also, the biometric authentication unit 304 rejects the face authentication of the user 105 when the calculated similarity is less than the threshold.

  Note that the biometric authentication unit 304 may perform face authentication of the user 105 using an arbitrary face authentication method (for example, the technique disclosed in Patent Document 1). Face authentication is an example of biometric authentication. If the biometric authentication unit 304 performs biometric authentication of the user 105 using the biometric feature information extracted by the extraction unit 303 from the image of the user 105 captured by the imaging unit 302, the biometric authentication unit 304 is not limited to face authentication. Biometric authentication (for example, iris authentication, gait authentication, etc.) may be performed.

  The authentication information acquisition unit 306 is realized by, for example, the IC card reader 106 in FIG. 2 or a program executed by the microcomputer included in the IC card reader 106, and authentication information such as a card ID used for the IC card authentication of the user 105 Is obtained from the IC card 104.

  For example, the IC card reader 106 receives a card ID from the IC card 104 that is close to the IC card reader 106 within a predetermined distance (for example, within 5 cm) by near field communication such as NFC (Near Field Communication). .

  The belongings authenticating unit 307 is realized by, for example, a program executed by the CPU 121 (a belongings authenticating application or the like that executes the belongings authenticating process), and the authentication information registered in advance and the authentication acquired by the authentication information acquiring unit 306. Using the information, the belongings of the user 105 are authenticated.

  For example, when the card ID acquired from the IC card 104 possessed by the user 105 is included in the user information registered in advance, the personal belonging authentication unit 307 performs card authentication of the user 105 (an example of possession authentication). Allow. Also, the possessed item authentication unit 307 rejects the card authentication of the user 105 when the card ID acquired from the IC card 104 possessed by the user 105 is not included in the user information registered in advance.

  Card authentication is an example of belongings authentication. If the authentication information acquisition unit 306 performs authentication of the possession of the user 105 using the authentication information acquired from the possession possessed by the user 105, the possession authentication unit 307 possesses other than card authentication. It may be one that performs object authentication.

  The use control unit 305 is realized by, for example, a program (system application or the like) executed by the CPU 121 in FIG. 2, and based on the result of face authentication by the biometric authentication unit 304, the image forming apparatus 101 (or operation by the user 105). Part 120).

  As an example, the usage control unit 305 is configured such that the user 105 permitted to perform face authentication by the biometric authentication unit 304 and the user 105 permitted to perform card authentication by the belongings authentication unit 307 are the same user 105. The user 105 is permitted to use the image forming apparatus 101.

  As another example, the usage control unit 305 may permit the use of the image forming apparatus 101 by the user 105 permitted to perform face authentication by the biometric authentication unit 304.

  The user information management unit 308 is realized by, for example, a program (system application or the like) executed by the CPU 121 in FIG. 2. For example, user information a 313 as illustrated in FIG. 4A is stored in the storage unit 312. And manage.

  FIG. 4A shows an example of user information a313. The user information a313 stores user information registered in advance, and the image forming apparatus 101 transmits an image to the user information a313 and the user registered in the user information A327 of the main body 110. The use of the forming apparatus 101 is permitted.

  The user information a313 of the operation unit 120 may be the same information as the user information A327 of the main body 110, or may be a part of the user information A327 of the main body 110. Here, for ease of explanation, the following explanation will be given assuming that the same information as the user information A327 of the main body 110 is stored in the user information a313 of the operation unit 120.

  The user information a313 shown in FIG. 4A includes “address book number”, “user name”, “mail address”, “login ID”, “password”, “card ID”, and “face feature information”. Etc. are stored.

  The “address book number” is an identification number for identifying a plurality of data (data 1, data 2,..., Data n). “User name” is information such as the name of each user, for example. “Mail address” is the mail address of each user.

  The “login ID” is identification information unique to each user and used when each user logs in to the image forming apparatus 101 by inputting login information. The “login password” is a password when each user logs in to the image forming apparatus 101 by inputting login information.

  “Card ID” is identification information for identifying the IC card 104 possessed by each user, and is an example of authentication information used in card authentication.

  “Face feature information” is face feature information of each user used in face authentication, and is an example of biometric feature information used in biometric authentication.

  Here, returning to FIG. 3, the description of the functional configuration of the operation unit 120 is continued.

  The display input control unit 309 is realized by, for example, a program executed by the CPU 121 in FIG. 2, and executes control for displaying a display screen on the operation panel 126, control for receiving an input operation on the operation panel 126, and the like.

  The setting management unit 310 is realized by, for example, a program (system application or the like) executed by the CPU 121 in FIG. 2 and manages setting information such as priority information 314 and authentication setting information 315 stored in the storage unit 312, for example. To do. The priority information 314 and the authentication setting information 315 will be described later.

  The communication unit 311 is realized by, for example, a program (system application or the like) executed by the CPU 121 in FIG. 2 and the connection I / F 127, and performs communication with the main body 110.

  The storage unit 312 is realized by, for example, a program (OS or the like) executed by the CPU 121 of FIG. 2, the flash memory 124, the RAM 123, and the like, and the above-described user information a313, priority information 314, authentication setting information 315, and the like. Memorize various information.

  The functional configuration of the image forming apparatus 101 illustrated in FIG. 3 is an example. For example, at least a part of the functional configuration included in the operation unit 120 may be included in the main body 110. Further, at least a part of the functional configuration included in the main body 110 may be included in the operation unit 120. Furthermore, at least a part of each functional configuration shown in FIG. 3 may be realized by hardware.

<Process flow>
Subsequently, a flow of an authentication method for the user 105 in the information processing system 100 according to the present embodiment will be described.

[First Embodiment]
(Operation unit startup process flow)
FIG. 5 is a flowchart illustrating an example of the authentication process of the operation unit according to the first embodiment. This process shows an example of a startup process executed by the operation unit 120 when the approach detection unit 321 (human body detection sensor 102) detects the approach of the user 105 in the power saving state.

  In step S501, when the approach detection unit 321 of the image forming apparatus 101 detects the approach of the user, the operation unit 120 executes the processing after step S502.

  In step S <b> 502, the state control unit (operation unit) 301 determines whether the authentication setting of the image forming apparatus 101 is valid. For example, the state control unit (operation unit) 301 refers to the authentication setting information 315 stored in the storage unit 312 and determines whether the authentication setting of the image forming apparatus 101 is valid.

  FIG. 4C shows an example of the authentication setting information 315. In the example of FIG. 4C, the authentication setting information 315 includes items such as “authentication setting” and “authentication processing to be executed” as items.

  “Authentication setting” is information indicating whether or not the image forming apparatus 101 authenticates the user 105. When the “authentication setting” is “valid”, it indicates that the user 105 is authenticated, and when it is “invalid”, the user 105 is not authenticated.

  “Authentication processing to be executed” indicates authentication processing executed by the image forming apparatus 101 when “authentication setting” is valid. In the example of FIG. 4C, face authentication and card authentication (IC card) are shown. Authentication) is performed.

  The state control unit (operation unit) 301 can determine whether the authentication setting of the image forming apparatus 101 is valid based on “authentication setting” of the authentication setting information 315.

  If the authentication setting of the image forming apparatus 101 is valid, the state control unit (operation unit) 301 shifts the processing to step S503 in FIG. On the other hand, when the authentication setting of the image forming apparatus 101 is not valid, the state control unit (operation unit) 301 shifts the processing to step S508 in FIG.

  In step S503, the state control unit (operation unit) 301 preferentially activates the imaging unit 302 and the extraction unit 303 among the processing units of the operation unit 120.

  In step S <b> 504, the imaging unit 302 captures an image of the user 105 with the camera 103.

  In step S <b> 505, the extraction unit 303 extracts facial feature information from the image captured by the imaging unit 302.

  In step S506, the state control unit (operation unit) 301 activates each processing unit other than the imaging unit 302 and the extraction unit 303 in accordance with the extraction of the facial feature information in step S505. Note that the process of step 506 may be started before the process of step S505 is completed.

  Preferably, the state control unit (operation unit) 301 executes the process of step S506 after the extraction unit 303 extracts at least one facial feature information.

  In step S <b> 507, the operation unit 120 executes an authentication process according to the authentication setting information 315 stored in the storage unit 312.

  On the other hand, when the process proceeds from step S502 to step S508, the state control unit (operation unit) 301 cancels the processing for preferentially starting the imaging unit 302 and the extraction unit 303, and each of the operation units 120 is performed as usual. Start the processing unit.

  FIG. 6 is a diagram illustrating an image of a detection range of each device according to the first embodiment. In FIG. 6, a detection range 601 of the human body detection sensor 102 is, for example, a region having a radius of about 2 m in front of the image forming apparatus 101 (downward in FIG. 6). In addition, the imaging range 602 of the camera 103 is, for example, a range of about 60 cm in front of the image forming apparatus 101. Furthermore, the reading range 603 of the IC card reader 106 is assumed to be a range of about 5 cm above the IC card reader 106 as an example.

  In this case, the image forming apparatus 101 starts face authentication processing or face feature information extraction processing until the user 105 entering the detection range 601 of the human body detection sensor 102 reaches the imaging range 602 of the camera 103. It is desirable to be able to start up.

  Therefore, the operation unit 120 according to the present embodiment includes an imaging unit 302 that executes face authentication processing or facial feature information extraction processing when the authentication setting is valid by the activation processing illustrated in FIG. The unit 303 is activated preferentially.

  Further, the operation unit 120 speeds up the extraction process of facial feature information by the extraction unit 303 by deferring activation of other processing units until the extraction unit 303 extracts at least one facial feature information. be able to.

(Face recognition processing)
FIG. 7 is a flowchart illustrating an example of face authentication processing according to the first embodiment. This process is an example of the authentication process executed in step S507 in FIG. In the first embodiment, it is assumed that the biometric authentication unit 304 performs face authentication of the user 105 as authentication processing.

  In step S701, the biometric authentication unit 304 acquires facial feature information registered in advance. For example, the biometric authentication unit 304 acquires user information a313 as illustrated in FIG.

  In step S <b> 702, the biometric authentication unit 304 acquires the extracted facial feature information of the user 105 from the extraction unit 303. Note that the process of step S702 may be executed before the process of step S701.

  In steps S <b> 703 to S <b> 709, the biometric authentication unit 304 collates each face feature information registered in advance with the face feature information extracted by the extraction unit 303 and executes face authentication processing.

  For example, in step S703, the variable i is set to “1”.

  In step S <b> 704, the biometric authentication unit 304 calculates the degree of similarity between the i-th facial feature information among the facial feature information registered in advance and the facial feature information extracted by the extraction unit 303.

  In step S705, the biometric authentication unit 304 branches the process depending on whether the calculated similarity is equal to or greater than a threshold value.

  If the calculated similarity is greater than or equal to the threshold, the biometric authentication unit 304 shifts the process to step S706 to permit face authentication of the user 105. On the other hand, if the calculated similarity is not greater than or equal to the threshold, the biometric authentication unit 304 causes the process to proceed to step S707.

  In step S707, the biometric authentication unit 304 determines whether the value of i has reached iMax, which is the number of feature information (user information) registered in advance.

  When the value of i reaches iMax, the biometric authentication unit 304 moves the process to step S708 and rejects the face authentication of the user 105. On the other hand, if the value of i has not reached iMax, the biometric authentication unit 304 causes the process to proceed to step S709.

  In step S709, the biometric authentication unit 304 adds 1 to the value of i and returns the process to step S704. As a result, the face authentication process shown in steps S704 to S708 is executed for each of the facial feature information registered in advance.

  Note that the face authentication process shown in FIG. 7 is an example. The biometric authentication unit 304 can apply any face authentication process as long as it performs user face authentication using the facial feature information of the user 105 extracted by the extraction unit 303.

(Transition process to power saving state)
FIG. 8 is a sequence diagram illustrating an example of the movement process to the power saving state according to the first embodiment. This process is an example of a transition process in which the image forming apparatus 101 shifts from a normal state in which a predetermined process can be performed to a power saving state in which the power consumption is lower than that in the normal state.

  In step S801, for example, when the state control unit (main body) 801 detects that the condition for shifting to the power saving state is satisfied, the image forming apparatus 101 executes processing for shifting to the power saving state after step S802. Note that the transition condition to the power saving state includes, for example, when the image forming apparatus 101 is not used for a preset time and when the user 105 is instructed to shift to the power saving state. Etc. are included.

  In step S <b> 802, the state control unit (main body) 801 transmits a power saving shift request for requesting the operation unit 120 to shift to the power saving state.

  In steps S803 and S804, the state control unit (main body) 801 shifts the main body 110 to the power saving state.

  For example, in step S803, the state control unit (main body) 801 shifts the storage unit 114 to the power saving state. As an example, the state control unit (main body) 801 turns off the power supply to the storage unit 114 after confirming that the process of writing data being written to the storage unit 114 is completed.

  In step S804, the state control unit (main body) 801 shifts the engine unit 117 to the power saving state. As an example, the state control unit (main body) 801 turns off the power to the engine unit 117 after confirming that the image processing being executed by the image forming unit 323 is completed. Note that the processing in steps S803 and S804 may be executed before the processing in step S802, or may be executed in parallel with the processing in step S802.

  When the state control unit (operation unit) 301 receives the power saving transition request from the main body 110, the state control unit (operation unit) 301 executes the processing after step S <b> 805 to shift the operation unit 120 to the power saving state.

  For example, in step S805, the state control unit (operation unit) 301 notifies the imaging unit 302 of a power saving transition instruction for instructing a transition to the power saving state.

  In step S806, when the imaging unit 302 receives the power saving transition request, for example, the power of the camera 103 is turned off to cause the imaging unit 302 to transition to the power saving state.

  In step S <b> 807, the state control unit (operation unit) 301 notifies the extraction unit 303 of a power saving transition instruction that instructs to shift to the power saving state.

  In step S808, when the extraction unit 303 receives a power saving transition request, the extraction unit 303 transitions to a power saving state (for example, stops operation).

  In step S809, the state control unit (operation unit) 301 notifies the biometric authentication unit 304 of a power saving transition instruction that instructs to shift to the power saving state.

  In step S810, when the biometric authentication unit 304 receives the power saving transition request, the biometric authentication unit 304 transitions to the power saving state (for example, stops the operation).

  In step S <b> 811, the state control unit (operation unit) 301 notifies the usage control unit 305 of a power saving transition instruction that instructs to shift to the power saving state.

  In step S812, upon receiving a power saving transition request, the usage control unit 305 shifts to a power saving state (for example, stops operation).

  In step S813, the state control unit (operation unit) 301 similarly shifts each other block (processing unit) to the power saving state.

  In step S814, the image forming apparatus 101 enters a power saving state.

  The transition process to the power saving state illustrated in FIG. 8 is an example, and the order in which the state control unit (operation unit) 301 starts each processing unit may be different from the process illustrated in FIG. good.

(Authentication process from power saving state)
FIG. 9 is a sequence diagram illustrating an example of authentication processing from the power saving state according to the first embodiment. This process shows an example of an authentication process when the image forming apparatus 101 in the power saving state authenticates the user 105 by the process of shifting to the power saving state shown in FIG. Note that in FIG. 9, a broken-line arrow indicates an operation or operation by the user 105.

  In step S901, it is assumed that the user 105 approaches the detection range 601 of the human body detection sensor 102.

  In steps S <b> 902 and S <b> 903, when detecting the approach of the user 105, the approach detection unit 321 of the main body 110 notifies the state control unit (main body) 322 of an approach notification indicating that the approach of the user 105 has been detected.

  In step S <b> 904, when the state control unit (main body) 322 receives an approach notification from the approach detection unit 321, the state control unit (main body) 322 transmits an activation request that requests activation to the operation unit 120.

  In step S905, the state control unit (main body) 322, for example, activates the storage unit 114, the engine unit 117, and the like that have been shifted to the power saving state in steps S803 and S804 in FIG. Return.

  In step S906, when the state control unit (operation unit) 301 receives the activation request from the main body 110, for example, the authentication setting information 315 as illustrated in FIG. Determine whether the setting is valid. This process corresponds to the process in step S502 of FIG. Here, the following description will be given on the assumption that the authentication setting is valid.

  In steps S907 and S908, the state control unit (operation unit) 301 preferentially activates the imaging unit 302 and the extraction unit 303, for example.

  In step S909, the imaging unit 302 recovers from the power saving state and captures an image of the user 105.

  In step S <b> 910, the imaging unit 302 notifies the extraction unit 303 of the captured image of the user 105. Alternatively, the imaging unit 302 may store the captured image of the user 105 in a predetermined area of the storage unit 312.

  In step S911, the extraction unit 303 extracts facial feature information from the image of the user 105 captured by the imaging unit 302.

  In step S912, when at least one face feature information is extracted, the extraction unit 303 notifies the state control unit (operation unit) 301 of an extraction notification indicating that the face feature information has been extracted.

  In step S913, when receiving the extraction notification from the extraction unit 303, the state control unit (operation unit) 301 activates the biometric authentication unit 304 and activates another processing unit in step S914.

  In step S <b> 915, the operation unit 120 returns from the power saving state to the normal state and is connected to the main body 110.

  In steps S <b> 916 and S <b> 917, the biometric authentication unit 304 acquires facial feature information registered in advance from the user information a <b> 313 stored in the storage unit 312, and uses the facial feature information extracted by the extraction unit 303. get. This process corresponds to, for example, the processes of steps S701 and S702 in FIG.

  In step S918, the biometric authentication unit 304 performs face authentication of the user 105 using the facial feature information registered in advance and the extracted facial feature information. This process corresponds to, for example, the processes in steps S703 to S709 in FIG.

  In step S919, when the face authentication of the user 105 is permitted, the biometric authentication unit 304 transmits an authentication result indicating that the authentication is permitted to the authentication control unit 324 of the main body 110.

  In step S920, when the authentication control unit 324 of the main body 110 receives an authentication result indicating that authentication is permitted, the authentication control unit 324 permits the user 105 to use the image forming apparatus 101.

  With the above processing, after the image forming apparatus 101 shifts to the power saving state, the image forming apparatus 101 returns from the power saving state according to the approach of the user 105 and performs biometric authentication in the information processing system 100 that performs biometric authentication of the user 105 It is possible to reduce the authentication waiting time required for.

  The process shown in FIG. 9 is an example. When the authentication setting of the image forming apparatus 101 is valid in step 906 of FIG. 9, the state control unit (operation unit) 301 gives priority to the biometric authentication unit 304 in addition to the imaging unit 302 and the extraction unit 303. It may be something that is activated.

  FIG. 10 is a sequence diagram illustrating another example of the authentication process from the power saving state according to the first embodiment. In this process, the state control unit (operation unit) 301 preferentially activates the biometric authentication unit 304 in addition to the imaging unit 302 and the extraction unit 303 when the authentication setting of the image forming apparatus 101 is valid. An example of processing in the case of making it appear is shown.

  Note that the processes shown in steps S901 to S912, S914 to S916, and S918 to S920 in FIG. 10 are the same as the processes shown in FIG. 9, and therefore, the differences from the processes shown in FIG. 9 will be mainly described here.

  When the state control unit (operation unit) 301 determines that the authentication setting is valid in step S906, in addition to the imaging unit 302 and the extraction unit 303, in step S1001, the biometric authentication unit 304 is preferentially activated. .

  Thus, when the facial feature information is extracted in step S911, the extracting unit 303 sends the extracted facial feature information to the biometric authentication unit 304 without waiting for the biometric authentication unit 304 to start in step S1002. You can be notified.

  Therefore, after the image forming apparatus 101 shifts to the power saving state, the image forming apparatus 101 returns from the power saving state in response to the approach of the user 105 and performs authentication required for biometric authentication in the information processing system 100 that performs biometric authentication of the user 105. The waiting time can be further reduced.

(About boot priority)
As a preferred example, when the operation unit 120 is activated, the state control unit (operation unit) 301, based on the activation priority of the priority information 314 as illustrated in FIG. Can be activated in stages.

  In the example of FIG. 4B, the priority information 314 includes information such as “application ID”, “application name”, and “activation priority”.

  The “application ID” is identification information for identifying each application (or service) executed by the operation unit 120. “App name” is the name of each application (or service) executed by the operation unit 120.

  “Activation priority” is information indicating the priority when each application (or service) executed by the operation unit 120 is activated, and the smaller the activation priority value, the higher the priority. To do. In the example of FIG. 4B, the priority of the face authentication application that realizes the extraction unit 303 and the biometric authentication unit 304 of the operation unit 120 is set to be the highest.

  For example, when the operation unit 120 is activated, the state control unit (operation unit) 301 activates each processing unit in a step-by-step manner from the highest priority processing based on such priority information 314. Can do.

[Second Embodiment]
In the second embodiment, an example will be described in which the authentication processing executed by the image forming apparatus 101 is two-factor authentication of face authentication by the biometric authentication unit 304 and IC card authentication by the belonging authentication unit 307.

  Two-factor authentication is an authentication method in which a user is authenticated by combining authentication by two different types of elements. Here, for authentication using different types of elements, for example, authentication based on information known by the user 105 (knowledge authentication), authentication based on what the user 105 possesses (possession authentication), and biometrics of the user 105 Authentication by features (biometric authentication) and the like are included.

  In the present embodiment, an example of processing when the user 105 is authenticated using face authentication, which is an example of biometric authentication, and IC card authentication, which is an example of belongings authentication, will be described.

<Process flow>
(Two-factor authentication processing)
FIG. 11 is a flowchart illustrating an example of a two-factor certificate process according to the second embodiment. This process is an example of the authentication process executed in step S507 in FIG. 5, and is executed, for example, when new facial feature information is extracted by the extraction unit 303.

  In step S1101, the biometric authentication unit 304 executes face authentication processing as shown in FIG. 7, for example.

  In step S1102, the biometric authentication unit 304 branches the process depending on whether or not face authentication is permitted.

  If the face authentication is permitted, the biometric authentication unit 304 causes the process to proceed to step S1103. On the other hand, when the face authentication is not permitted, the biometric authentication unit 304 ends the element authentication process.

  In step S1103, the authentication information acquisition unit 306 waits for the reading operation of the IC card 104 by the user 105. When the reading operation is performed, authentication information (for example, a card ID) is received from the IC card 104 of the user 105. get.

  In step S1104, the belongings authenticating unit 307 determines whether the authentication information acquired by the authentication information acquiring unit 306 is registered in user information a313 as shown in FIG. 4, for example. Alternatively, the belonging authentication unit 307 determines whether the authentication information acquired by the authentication information acquisition unit 306 is registered in the user information a313 of the operation unit 120 or the user information A327 of the main body 110. Also good.

  If the authentication information acquired by the authentication information acquisition unit 306 is not registered in the user information, the belonging authentication unit 307 rejects the possession authentication of the user 105 in step S1105.

  On the other hand, when the authentication information acquired by the authentication information acquisition unit 306 is registered in the user information, the property authentication unit 307 permits the property authentication of the user 105 in step S1106.

  In step S1107, the usage control unit 305 compares the user who has been permitted face authentication in step S1101 with the user who has been permitted to carry personal belongings in step S1106.

  For example, the usage control unit 305 includes the identification information (for example, the address book number in FIG. 4) included in the authentication result notified from the biometric authentication unit 304 and the authentication notified from the belonging authentication unit 307. The identification information of the user 105 included in the result is compared.

  In step S <b> 1108, the usage control unit 305 branches the process depending on whether or not the user 105 for whom face authentication is permitted and the user for which possession authentication is permitted are the same user.

  When the user 105 for whom face authentication is permitted and the user for which possession authentication is permitted are not the same user, the use control unit 305 ends the two-factor authentication process. On the other hand, if the user 105 for whom face authentication is permitted and the user for which possession authentication is permitted are the same user, the use control unit 305, in step S1109, the image forming apparatus 101 by the user 105. Allow the use of.

(Authentication process from power saving state)
FIG. 12 is a diagram illustrating an example of authentication processing from the power saving state according to the second embodiment. Note that the processing in steps S901 to S908 and S1001 in FIG. 12 is the same as the authentication processing according to the first embodiment shown in FIG. 10, and therefore, here, the description will focus on differences from the processing shown in FIG. .

  In step S1201, the imaging unit 302 and the extraction unit 303 perform facial feature information extraction processing, for example, as illustrated in steps S909 to S911 in FIG.

  In step S1202, the extraction unit 303 notifies the state control unit (operation unit) 301 of an extraction notification indicating that facial feature information has been extracted.

  In step S <b> 1203, upon receiving an extraction notification from the extraction unit 303, the state control unit (operation unit) 301 activates another processing unit.

  In step S1204, the operation unit 120 returns from the power saving state to the normal state and is connected to the main body 110.

  In step S1205, the biometric authentication unit 304 performs a face authentication process as shown in FIG. 7, for example.

  In step S1206, when the face authentication of the user 105 is permitted, the biometric authentication unit 304 notifies the use control unit 305 of an authentication result indicating that the face authentication of the user 105 is permitted. This authentication result includes identification information (for example, address book number) for identifying the user 105.

  In step S <b> 1207, the user 105 performs a reading operation of the IC card 104 with respect to the IC card reader 106.

  In step S1208, when an IC card reading operation is performed, the belongings authenticating unit 307 executes an belongings authentication process as shown in steps S1103 to S1106 in FIG.

  In step S1209, when the possession authentication of the user 105 is permitted, the belonging authentication unit 307 notifies the use control unit 305 of an authentication result indicating that the possession authentication of the user 105 is permitted. This authentication result includes identification information (for example, address book number) for identifying the user 105.

  In step S1210, the usage control unit 305 executes usage control processing as shown in steps S1107 to S1109 in FIG. 11, for example.

  In step S <b> 1211, when the use of the image forming apparatus 101 by the user 105 is permitted, the usage control unit 305 displays usage permission information indicating that the use of the image forming apparatus 101 by the user 105 is permitted. To the authentication control unit 324.

  In step S <b> 1212, the main body authentication control unit 324 permits the use of the main body 110 when receiving the use permission information from the operation unit 120. As a result, the user 105 can use image processing functions such as copying, scanning, and printing executed by the main body 110.

  With the above processing, in the information processing system 100 that performs two-factor authentication based on face authentication (an example of biometric authentication) and IC card authentication (an example of possession authentication), the authentication waiting time required for biometric authentication can be reduced. become able to.

[Third Embodiment]
In the first and second embodiments, when the access detection unit 321 detects the approach of the user 105 in the power saving state, the activation control unit that preferentially activates the process related to face authentication is performed by the state control unit (operation unit). ) 301 has been described.

  In the third embodiment, when the approach detection unit 321 detects the approach of the user 105 in the power saving state, the activation control unit that preferentially activates the processing related to face authentication is the state control unit (main body) 322. An example in a certain case will be described.

<Process flow>
(Main unit startup process)
FIG. 13 is a flowchart illustrating an example of a main body activation process according to the third embodiment. This processing is an example of processing on the main body 110 side when the approach detection unit 321 detects the approach of the user 105 in the power saving state.

  In step S1301, when the approach detection unit 321 of the image forming apparatus 101 detects the approach of the user 105 in the power saving state, the state control unit (main body) 322 executes the processing after step S1302.

  In step S1302, the state control unit (operation unit) 301 activates the storage unit 114, the engine unit 117, and the like, for example, and returns the main body 110 from the power saving state to the normal state.

  In step S1303, the state control unit (operation unit) 301 acquires authentication setting information 315 as illustrated in FIG. 4C from the operation unit 120, for example.

  Here, the communication unit 311 and the storage unit 312 of the operation unit 120 continue the processing even after the operation unit 120 shifts to the power saving state, and store in response to an authentication setting information acquisition request from the main body 110. It is assumed that the authentication setting information 315 stored in the unit 312 can be provided.

  In step S <b> 1304, the state control unit (operation unit) 301 determines whether or not face authentication is valid in the image forming apparatus 101.

  For example, in the status setting unit (operation unit) 301, the authentication setting is “valid” in the authentication setting information 315 as illustrated in FIG. 4C, and “face authentication” is included in the authentication process to be executed. In this case, the image forming apparatus 101 determines that face authentication is effective. Further, when the authentication setting is “invalid” in the authentication setting information 315 or when “face authentication” is not included in the authentication process to be executed, the state control unit (operation unit) 301 performs the operation in the image forming apparatus 101. Judge that face authentication is not valid.

  When face authentication is valid in the image forming apparatus 101, the state control unit (operation unit) 301 transmits an activation request for requesting activation of the operation unit 120 with priority to face authentication to the operation unit 120 in step S 1305. .

  On the other hand, when face authentication is not valid in the image forming apparatus 101, the state control unit (operation unit) 301 transmits an activation request for requesting activation of the normal operation unit 120 to the operation unit 120 in step S <b> 1306.

(Startup processing of image forming apparatus)
FIG. 14 is a sequence diagram (1) illustrating an example of activation processing of the image forming apparatus according to the third embodiment. This process is an example of the entire process of the image forming apparatus 101 corresponding to the activation process of the main body 110 shown in FIG.

  In step S1401, it is assumed that the user 105 approaches the detection range 601 of the human body detection sensor 102.

  In steps S1402 and S1403, when detecting the approach of the user 105, the approach detection unit 321 of the main body 110 notifies the state control unit (main body) 322 of an approach notification indicating that the approach of the user 105 has been detected.

  In step S1404, the state control unit (main body) 322 activates the storage unit 114, the engine unit 117, and the like, for example, and returns the main body 110 to the normal state.

  In step S <b> 1405, the state control unit (main body) 322 transmits an authentication setting information acquisition request for requesting acquisition of the authentication setting information 315 to the operation unit 120.

  In step S 1406, the state control unit (main body) 322 receives the authentication setting information 315 transmitted from the operation unit 120.

  In step S <b> 1407, the state control unit (main body) 322 confirms whether the face authentication is valid in the image forming apparatus 101 based on the authentication setting information 315.

  When the face authentication is valid, the image forming apparatus 101 executes processing 1410 when the face authentication is valid shown in steps S <b> 1411 to S <b> 1414. On the other hand, when the face authentication is not valid, the image forming apparatus 101 executes processing 1420 when the face authentication is not valid shown in steps S1421 and S1422.

  In step 1411, the state control unit (main body) 322 transmits an activation request (face authentication priority) requesting activation of the operation unit 120 with face authentication priority to the operation unit 120.

  In step S1411, the state control unit (operation unit) 301 receives the activation request (face authentication priority) from the main body 110, and activates the operation unit 120 with face authentication priority. For example, the state control unit (operation unit) 301 activates the imaging unit 302, the extraction unit 303, the biometric authentication unit 304, and the like by the processing in steps S907, S908, and S1001 in FIG.

  In step S1413, the imaging unit 302, the extraction unit 303, and the biometric authentication unit 304 execute face authentication processing. For example, the imaging unit 302 captures an image of the user 105, and the extraction unit 303 extracts facial feature information of the user 105 from the captured image. In addition, the biometric authentication unit 304 executes a face authentication process as shown in FIG.

  In step S <b> 1414, the state control unit (operation unit) 301 activates another processing unit among the processing units of the operation unit 120.

  On the other hand, in step S1421, the state control unit (main body) 322 transmits an activation request (normal) requesting normal activation to the operation unit 120.

  In step S <b> 1422, the state control unit (operation unit) 301 cancels the process of starting up the operation unit 120 with face authentication priority, and executes a normal start-up process of starting up each processing unit of the operation unit 120.

  In this way, even in the power saving state, when the approach detection unit 321 detects the approach of the user 105, the activation control unit that preferentially activates processing related to face authentication is the state control unit (main body) 322. good.

(Process when face authentication fails)
FIG. 15 is a sequence diagram (2) illustrating an example of the activation process of the image forming apparatus according to the third embodiment. This process is an example of a suitable process when the image forming apparatus 101 fails in face authentication. Note that the processing in steps S1501 to S1413 in FIG. 15 is the same as the processing shown in FIG. 14, and therefore, here, the description will focus on differences from the processing shown in FIG.

  If the face authentication fails in step S1501, the operation unit 120 executes the processes after step S1502.

  When face authentication fails, for example, when the imaging unit 302 cannot capture an image within a predetermined time, when the extraction unit 303 cannot extract facial feature information, the biometric authentication unit 304 This includes the case where face authentication is rejected by.

  In step S1502, the state control unit (operation unit) 301 stops the face authentication processing by the imaging unit 302, the extraction unit 303, and the biometric authentication unit 304.

  In step S <b> 1503, the state control unit (operation unit) 301 activates another processing unit among the processing units of the operation unit 120.

  In step S1504, for example, the display input control unit 309 displays a display screen 1600 as shown in FIG. 16 on the operation panel 126 to notify the user 105 that the face authentication cannot be used.

  As shown in FIG. 16, the display screen 1600 for notifying the user 105 that face authentication cannot be used includes a message indicating that face authentication cannot be used and that other user authentication is performed. As a result, the image forming apparatus 101 can prompt the user 105 to perform another user authentication (for example, password authentication) operation.

DESCRIPTION OF SYMBOLS 100 Information processing system 101 Image forming apparatus 102 Human body detection sensor (detection apparatus)
103 camera (imaging device)
110 Main body (execution device)
120 operation unit (information processing device, operation device)
301 State control unit (operation unit) (an example of an activation control unit)
303 Extraction unit 304 Biometric authentication unit 305 Usage control unit 306 Authentication information acquisition unit 307 Inventory authentication unit 310 Setting management unit 322 Status control unit (main body) (an example of an activation control unit)

JP, 2006-173813, A

Claims (10)

An information processing system including a detection device that detects approach of a user, an imaging device that captures an image of the user, and an information processing device connected to the imaging device,
The information processing apparatus includes:
An extraction unit for extracting feature information of the user's living body from the image of the user imaged by the imaging device;
A biometric authentication unit that performs biometric authentication of the user by using biometric feature information registered in advance and the biometric feature information of the user extracted by the extraction unit;
Based on the result of the biometric authentication, a usage control unit that permits the user to use the information processing device;
Have
The information processing system includes:
In accordance with a predetermined transition condition, a state control unit that shifts the imaging device and the information processing apparatus from a normal state in which predetermined processing can be performed to a power saving state in which power consumption is lower than that in the normal state;
In the power saving state, when the detection device detects the approach of the user, an activation control unit that preferentially activates the imaging device and the extraction unit;
An information processing system. The activation control unit
In the power saving state, when the detection device detects the user, the imaging device and the extraction unit are activated,
The information processing system according to claim 1, wherein another processing unit of the information processing apparatus is activated in response to extraction of the biological feature information by the extraction unit. The activation control unit
The information processing according to claim 1, wherein, in the power saving state, when the detection device detects the user, the biometric authentication unit is preferentially activated in addition to the imaging device and the extraction unit. system. The activation control unit
The information processing system according to claim 3, wherein another processing unit of the information processing apparatus is activated according to the biometric authentication process of the user by the biometric authentication unit.   The information processing system according to claim 4, wherein the activation control unit stops the biometric authentication and activates the other processing unit when the biometric authentication of the user is not permitted. An authentication information acquisition unit for acquiring authentication information used for the user's possession authentication from the possession possessed by the user;
Using the authentication information registered in advance and the authentication information extracted by the authentication information acquisition unit, the possession authentication unit that performs the possession authentication of the user,
Have
The use control unit permits use of the information processing apparatus by the user when the user who is permitted to perform biometric authentication and the user who is permitted to perform possession authentication are the same user. Item 6. The information processing system according to any one of Items 1 to 5. A setting management unit for managing whether the authentication setting of the information processing system is valid;
The activation control unit
The imaging apparatus and the extraction unit are preferentially activated when authentication settings of the information processing system are valid when the detection apparatus detects the user in the power saving state. The information processing system according to any one of 1 to 6. A setting management unit that manages information of one or more authentication processes valid in the information processing system;
The activation control unit
If the biometric authentication is included in the one or more authentication processes when the detection device detects the user in the power saving state, the imaging device, the extraction unit, and the biometric authentication unit are given priority. The information processing system according to any one of claims 3 to 5, wherein the information processing system is activated automatically. A detection device that detects the approach of a user, an operation device that is connected to an imaging device that captures an image of the user and receives an operation of the user, and an execution device that executes image processing based on the operation An image processing apparatus including:
The operating device is:
An extraction unit for extracting feature information of the user's living body from the image of the user imaged by the imaging device;
A biometric authentication unit that performs biometric authentication of the user by using biometric feature information registered in advance and the biometric feature information of the user extracted by the extraction unit;
Based on the result of the biometric authentication, a usage control unit that permits the user to use the image processing device;
An activation control unit that preferentially activates the imaging device and the extraction unit when the detection device detects the approach of the user in a power saving state in which power consumption is less than a normal state in which predetermined processing can be performed When,
An image processing apparatus. An authentication method for a user in an information processing system, comprising: a detection device that detects approach of a user; an imaging device that captures an image of the user; and an information processing device connected to the imaging device. ,
When the detection device detects the approach of the user in a power saving state in which the power consumption is lower than a normal state in which a predetermined process can be performed, the imaging device and the image of the user captured by the imaging device Preferentially starting an extraction process for extracting feature information of the user's living body from:
Performing biometric authentication of the user using biometric feature information registered in advance and the biometric feature information of the user extracted in the extraction process;
Permitting the user to use the information processing device based on the result of the biometric authentication;
A user authentication method for causing the information processing apparatus to execute.

Images