JP2018045682A - Information processing apparatus, information processing system, information processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve processing efficiency in registering face information to be used for face authentication.SOLUTION: An information processing apparatus includes a storage unit, a tag identification information acquisition unit, a face information acquisition unit, and a registration control unit. The storage unit stores address book information formed by associating tag identification information identifying a wireless tag with user personal information at least. The tag identification information acquisition unit acquires tag identification information. The face information acquisition unit refers to the address book information, to acquire face information, when face information of the user is not associated with the tag identification information acquired by the tag identification information acquisition unit, on the basis of a captured image obtained by imaging an imaging range corresponding to a range where the tag identification information can be acquired. The registration control unit controls the face information acquired by the face information acquisition unit to be registered on the address book information in association with the tag identification information.SELECTED DRAWING: Figure 5

Description

  The present invention relates to an information processing apparatus, an information processing system, an information processing method, and a program.

  Conventionally, a technique for authenticating a user who uses an MFP using a face authentication technique is known. For example, Patent Document 1 discloses a composite authentication method that combines an authentication method for acquiring biometric information such as a face and performing authentication, and an authentication method for performing authentication by reading information in a tag wirelessly. .

  However, in a system using a conventional face authentication method, for example, an administrator of a device such as an MFP (device that can be used on the condition of authentication) registers in advance personal information (name, address, email address, etc.) for each user. In addition, it is necessary to take a face image that is the basis of the face information used for face authentication, and register the face information based on the image obtained by the photographing and personal information in association with each other. That is, there is a problem that the process of registering face information used for face authentication is inefficient.

  The present invention has been made in view of the above, and provides an information processing apparatus, an information processing system, an information processing method, and a program capable of improving the efficiency of processing for registering face information used for face authentication The purpose is to do.

  In order to solve the above-described problems and achieve the object, the present invention stores address book information in which tag identification information for identifying a wireless tag indicating a medium capable of wireless communication is associated with at least user personal information. The face information of the user with respect to the tag identification information acquired by the tag identification information acquisition unit with reference to the address book information, the tag identification information acquisition unit for acquiring the tag identification information, and the address book information A face information acquisition unit that acquires the face information based on a captured image obtained by capturing an imaging range corresponding to a range in which the tag identification information can be acquired; And a registration control unit that performs control for registering the face information acquired in step 1 in association with the tag identification information in the address book information.

  ADVANTAGE OF THE INVENTION According to this invention, the efficiency of the process which registers the face information used for face authentication can be improved.

FIG. 1 is a diagram illustrating an example of a configuration of an information processing system according to the first embodiment. FIG. 2 is a diagram for explaining a state in which a user possessing a wireless tag places a wireless tag on a tag reader in the information processing system according to the first embodiment. FIG. 3 is a diagram illustrating a hardware configuration example of the MFP according to the first embodiment. FIG. 4 is a diagram illustrating a software configuration example of the MFP according to the first embodiment. FIG. 5 is a diagram illustrating an example of functions of the MFP according to the first embodiment. FIG. 6 is a diagram illustrating an example of default address book information according to the first embodiment. FIG. 7 is a diagram illustrating an example of address book information after the feature point information according to the first embodiment is registered. FIG. 8 is a flowchart illustrating an operation example of the PC according to the first embodiment. FIG. 9 is a flowchart illustrating an operation example of the MFP according to the first embodiment. FIG. 10 is a diagram illustrating a configuration example of the application layer of the operation unit according to the second embodiment. FIG. 11 is a diagram illustrating an example of a relationship between functions and applications included in the operation unit according to the second embodiment. FIG. 12 is a flowchart illustrating an operation example of the MFP according to the second embodiment.

(First embodiment)
Hereinafter, embodiments of an information processing apparatus, an information processing system, an information processing method, and a program according to the present invention will be described in detail with reference to the accompanying drawings. Hereinafter, as an information processing apparatus according to the present invention, a multifunction peripheral (MFP), which is one of image processing apparatuses, will be described as an example. However, the present invention is not limited to this. For example, examples of the information processing apparatus include a camera, a projector, an interactive whiteboard (electronic blackboard), a dedicated terminal for a video conference / Web conference system, a digital signage, a production printer, a 3D printer, and a facsimile. In short, the information processing device may be any device that can be used on the condition of authentication, and the type thereof is arbitrary. Note that a multifunction peripheral is a device having a plurality of different functions such as a copy function, a scanner function, a printer function, and a facsimile function.

  FIG. 1 is a diagram illustrating an example of a configuration of an information processing system 100 according to the present embodiment. As shown in FIG. 1, the information processing system 100 includes an MFP 1 and a PC (Personal Computer) 2 that functions as an external tool, which can be connected to each other via a network 8 such as the Internet. As will be described later, the PC 2 responds to the operation of the administrator of the MFP 1 by using a tag number (tag identification) that identifies a user's personal information (name, address, email address, etc.) and a wireless tag indicating a medium capable of wireless communication. An example of information) is registered in address book information described later.

  In this example, a wireless tag 114 storing a tag number is distributed in advance for each of one or more users who use the MFP 1. Then, as shown in FIG. 2, when the user holding the wireless tag 114 holds the wireless tag 114 over the tag reader 113 installed in the MFP 1, short-range wireless communication is performed between the wireless tag 114 and the tag reader 113. The tag number stored in the wireless tag 114 is read by the tag reader 113. In this example, the camera 112 for imaging an imaging range corresponding to the range in which the tag number can be acquired (in other words, the camera 112 for imaging the user holding the wireless tag 114 over the tag reader 113) is the MFP1. It is connected to the. The face image of the user holding the wireless tag 114 can be detected from the captured image obtained by the imaging by the camera 112, and the user is authenticated using the detected face image. Specific contents will be described later. Note that imaging refers to converting an object image formed by an optical system such as a lens into an electrical signal.

  FIG. 3 is a hardware configuration diagram of the MFP (Multifunction Peripheral) 1 according to the first embodiment. The MFP 1 is an image processing apparatus that includes an operation unit 20 that receives an operation and a main body 10 that performs an operation according to the operation received by the operation unit 20. In this example, the main body 10 includes various functions such as a copy function, a scanner function, a facsimile function, and a printer function.

  In the example of FIG. 3, the main body 10 and the operation unit 20 are connected so as to be able to communicate with each other via a dedicated communication path 30. The communication path 30 may be, for example, a USB (Universal Serial Bus) standard, but may be of any standard regardless of wired or wireless. The main body 10 may have one function or a plurality of functions among image generation functions such as a copy function, a scanner function, a facsimile function, and a printer function.

  As the operation unit 20, an electronic device capable of executing complete information processing independently can be used. As an example, an information processing terminal such as a smartphone or a tablet terminal can be used as the operation unit 20. In this case, the information processing terminal used as the operation unit 20 functions as the operation unit of the MFP 1.

  More specifically, the information processing terminal used as the operation unit 20 is detachably connected to the MFP 1 instead of an operation panel that has been conventionally fixed and installed as an operation unit dedicated to the MFP 1. That is, the information processing terminal used as the operation unit 20 is installed integrally with the MFP 1 while being detachable (separable) at a predetermined position such as a position where the operation panel of the MFP 1 is disposed. Accordingly, the information processing terminal and the MFP 1 used as the operation unit 20 may be grasped as a single device. When the information processing terminal that is the operation unit 20 is removed from the MFP 1, the information processing terminal performs wireless communication such as Bluetooth (registered trademark) or infrared communication with the MFP 1 and functions as an operation unit of the MFP 1.

(Hardware configuration of the main unit)
Next, the hardware configuration of the main body 10 will be described. As shown in FIG. 3, the main body 10 includes a CPU 11, a ROM 12, a RAM 13, an HDD (hard disk drive) 14, a human body detection sensor 15, an engine unit 16, a connection I / F 17, and a communication I / F 18. . The above units 11 to 18 are connected to each other via a system bus 19.

  The CPU 11 comprehensively controls the operation of the main body 10. The CPU 11 controls the overall operation of the main body 10 by executing a program stored in the ROM 12 or the HDD 14 or the like using the RAM 13 as a work area (work area), and the above-described copy function, scanner function, facsimile function, printer function, etc. Implement various functions.

  The human body detection sensor 15 is a sensor that detects the presence or absence of a human body within the detection range. Here, the detection range is a range including at least the imaging range of the camera 112. As the human body detection sensor 15, for example, a pyroelectric sensor or the like is used.

  The engine unit 16 is hardware that performs processing other than general-purpose information processing and communication for realizing a copy function, a scanner function, a facsimile function, a printer function, and the like. The engine unit 16 includes, for example, a scanner that scans and reads an image of a document, a plotter that performs printing on a sheet material such as paper, and a facsimile communication unit that performs facsimile communication. Furthermore, a specific option such as a finisher for sorting printed sheet materials and an automatic document feeder (ADF) for automatically feeding a document can be provided.

  The connection I / F 17 is an interface for communicating with the operation unit 20 via the communication path 30. In FIG. 3, the communication path 30 is illustrated in a wired manner, but the operation unit 20 can be attached to and detached from the main body 10 of the MFP 1 as described above. Therefore, when the operation unit 20 is attached to the MFP 1, the communication path 30 functions as a wired communication path, and when the operation unit 20 is detached from the MFP 1, the communication path 30 functions as a wireless communication path. The communication I / F 18 is an interface for communicating with an external device such as the PC 2 on the network 8.

(Hardware configuration of operation unit)
Next, the hardware configuration of the operation unit 20 will be described. As shown in FIG. 3, the operation unit 20 includes a CPU 21, a ROM 22, a RAM 23, a flash memory 24, a communication I / F 25, a camera I / F 26, a tag reader I / F 27, a connection I / F 28, And an operation panel 29, which are connected to each other via a system bus 40.

  The CPU 21 comprehensively controls the operation of the operation unit 20. The CPU 21 controls the overall operation of the operation unit 20 by executing a program stored in the ROM 22 or the flash memory 24 using the RAM 23 as a work area (work area). The communication I / F 25 is an interface for communicating with an external device such as the PC 2 on the network 8, for example.

  The camera I / F 26 is an interface for connecting to a camera 112 that captures a predetermined imaging range. The tag reader I / F 27 is an interface for connecting to the tag reader 113. The tag reader 113 is a device that performs short-range wireless communication with the wireless tag 114 within the detection range and reads (receives) a tag number stored in the wireless tag 114. As a communication method between the wireless tag 114 and the tag reader 113, there are an Active type that transmits a radio wave from the wireless tag 114, and a Passive type that transmits a radio wave from the tag reader 113, and the wireless tag 114 receiving the response returns a response. Exists. Here, the imaging range of the camera 112 corresponds to a range in which the tag reader 113 can receive (acquire) a tag number. In short, the imaging range of the camera 112 is set to a range in which a user holding the wireless tag 114 over the tag reader 113 can be imaged.

  In this example, it is assumed that the camera 112 and the operation unit 20 or the tag reader 113 and the operation unit 20 are physically connected to each other via a USB cable or the like. However, the camera 112 and the tag reader 113 may be built in the operation unit 20. That is, the operation unit 20 and the camera 112, or the operation unit 20 and the tag reader 113 may be integrally formed (may be formed as one device).

  The connection I / F 28 is an interface for communicating with the main body 10 via the communication path 30. The operation panel 29 is configured by a liquid crystal display device (LCD) provided with a touch sensor. The operation panel 29 receives various inputs according to user operations, and displays various information such as information according to the received input, information indicating the operation status of the MFP 1, and information indicating a setting state. The operation panel 29 may be composed of an organic EL display device provided with a touch sensor. Further, in addition to or instead of this, an operation unit such as a hardware key or a display unit such as a light emitting unit may be provided.

(Software configuration of MFP)
FIG. 4 shows an example of the software configuration of the MFP 1. As shown in FIG. 4, the main body 10 includes an application layer 101, a service layer 102, and an OS layer 103 (first operating system). The entities of the application layer 101, the service layer 102, and the OS layer 103 are various software stored in the ROM 12, the HDD 14, or the like. Various functions are provided by the CPU 11 executing these software.

  The software of the application layer 101 is application software for operating a hardware resource to provide a predetermined function (in the following description, it may be simply referred to as “application”). For example, examples of the application include a copy application for providing a copy function, a scanner application for providing a scanner function, a facsimile application for providing a facsimile function, a printer application for providing a printer function, and the like.

  The software of the service layer 102 is software that is interposed between the application layer 101 and the OS layer 103 and provides an interface for using hardware resources included in the main body 10 for the application. Specifically, it is software for providing a function of accepting an operation request for a hardware resource and arbitrating the operation request. The operation requests received by the service layer 102 include requests such as reading by a scanner and printing by a plotter.

  Note that the interface function by the service layer 102 is provided not only to the application layer 101 of the main body 10 but also to the application layer 201 of the operation unit 20. That is, the application layer 201 (application) of the operation unit 20 can also realize a function using hardware resources (for example, the engine unit 16) of the main body 10 through the interface function of the service layer 102.

  The software of the OS layer 103 is basic software (operating system) for providing a basic function for controlling hardware included in the main body 10. The software of the service layer 102 converts a hardware resource use request from various applications into a command interpretable by the OS layer 103 and passes the command to the OS layer 103. Then, when the command is executed by the software of the OS layer 103, the hardware resource performs an operation according to the request of the application.

  Similarly, the operation unit 20 includes an application layer 201, a service layer 202, and an OS layer 203 (second operating system). The application layer 201, the service layer 202, and the OS layer 203 included in the operation unit 20 have the same hierarchical structure as that of the main body 10 side. However, the functions provided by the applications in the application layer 201 and the types of operation requests that can be accepted by the service layer 202 are different from those on the main body 10 side. The application of the application layer 201 is software for operating a hardware resource included in the operation unit 20 and providing a predetermined function. Mainly, software for providing a UI (user interface) function for performing operations and display related to functions (copy function, scanner function, facsimile function, printer function) provided in the main body 10.

  In the example of the embodiment, the software of the OS layer 103 on the main body 10 side is different from the software of the OS layer 203 on the operation unit 20 side in order to maintain the independence of functions. That is, the main body 10 and the operation unit 20 operate independently of each other with different operating systems. For example, it is possible to use Linux (registered trademark) as the software of the OS layer 103 on the main body 10 side and Android (registered trademark) as the software of the OS layer 203 on the operation unit 20 side.

  By operating the main body 10 and the operation unit 20 with different operating systems, communication between the main body 10 and the operation unit 20 is performed as communication between different devices, not communication between processes in a common device. . The operation (command communication) for transmitting the input (instruction content from the user) received by the operation unit 20 to the main body 10 and the operation for the main body 10 notifying the operation unit 20 of an event correspond to this. Here, the function of the main body 10 can be used when the operation unit 20 performs command communication with the main body 10. Further, the event notified from the main body 10 to the operation unit 20 includes the execution status of the operation in the main body 10 and the contents set on the main body 10 side.

  In the example of the embodiment, since power is supplied to the operation unit 20 from the main body 10 via the communication path 30, the power control of the operation unit 20 is performed separately from the power control of the main body 10 (independently). Can do).

  In this example, the main body 10 and the operation unit 20 are electrically and physically connected via the communication path 30, but the operation unit 20 can be detached from the main body 10 as described above. In this case, the main body 10 and the operation unit 20 are provided with a short-range wireless communication unit such as an infrared communication unit, an RF communication unit, or a Bluetooth (registered trademark) communication unit. RF is an abbreviation for “Radio Frequency”. Alternatively, the main body 10 and the operation unit 20 are provided with a wireless LAN communication function such as Wi-Fi (registered trademark), and communicate with each other via the wireless LAN access point (wireless LANAP) 41 and the network 8 as shown in FIG. It may be possible. LAN is an abbreviation for “Local Area Network”. When the operation unit 20 can be removed from the main body 10, the operation unit 20 stores the power supplied from the main body 10 via the communication path 30 in the secondary battery, and when the operation unit 20 is removed from the main body 10, It operates with the power stored in the secondary battery and communicates with the main body 10.

  Next, functions of the MFP 1 will be described. FIG. 5 is a diagram illustrating an example of functions that the operation unit 20 of the MFP 1 has. As illustrated in FIG. 5, the operation unit 20 includes a human body detection information reception unit 211, an energy saving control unit 212, an address book information processing unit 213, a captured image acquisition unit 214, a face image detection unit 215, and a face image. It has an authentication processing unit 216, a tag identification information acquisition unit 217, a wireless tag authentication processing unit 218, and an authentication unit 219. For convenience of explanation, FIG. 5 mainly illustrates functions related to the present invention, but the functions of the operation unit 20 are not limited to these. For example, a form in which some of the functions described above are mounted on the main body 10 side may be employed.

  The human body detection information receiving unit 211 receives (acquires) human body detection information indicating the presence or absence of a human body within the detection range from the human body detection sensor 15. The human body detection information receiving unit 211 passes the human body detection information received from the human body detection sensor 15 to the energy saving control unit 212.

  The energy saving control unit 212 is an energy saving state that indicates a state in which the power consumption is smaller than a normal state in which the operation unit 20 is operable, and from the human body detection information receiving unit 211, human body detection information indicating that a human body exists within the detection range. Is received, each of the captured image acquisition unit 214 and the tag identification information acquisition unit 217 is returned to an operable state (a power ON command is transmitted).

  The address book information processing unit 213 sends a tag number (an example of tag identification information) for identifying the wireless tag 114 and personal information of the user to each of the face image authentication processing unit 216 and the wireless tag authentication processing unit 218 described later. Is provided at least in correspondence with the address book information. For example, the address book information may be stored in the flash memory 24 in the operation unit 20, stored in the HDD 14 in the main body 10, or stored in an external server. It may be. That is, any one of the flash memory 24, the HDD 14, and the external server functions as a “storage unit”.

  The address book information in the present embodiment is information in which user information, a tag number, and user face information are associated with each other. In this example, the face information is feature point information indicating the feature points included in the user's face image, but is not limited thereto, and may be a face image, for example. Among the information included in the address book information, the user information and tag number are registered in advance by the administrator of the MFP 1 by operating the PC 2. The address book information in the initial state after completion of the registration work by the administrator (hereinafter sometimes referred to as “default address book information”) is in a form as shown in FIG. 6 and the feature point information is not entered. ("Null"). In this example, for each set of one user information, one tag number, and one feature point information (information group for one line), a number for identifying the set (hereinafter referred to as “address”) May be referred to as a “number”.

  Returning to FIG. As shown in FIG. 5, the address book information processing unit 213 includes a tag number confirmation unit 220, a face information acquisition unit 221, and a registration control unit 222. Each time a tag number is acquired by a tag identification information acquisition unit 217 described later, the tag number confirmation unit 220 receives the acquired tag number from a wireless tag authentication processing unit 218 described later. Then, the tag number confirmation unit 220 confirms whether or not the tag number acquired by the tag identification information acquisition unit 217 (the tag number received from the wireless tag authentication processing unit 218) exists in the address book information. If it exists in the information, the corresponding address number is transmitted to the wireless tag authentication processing unit 218, and if it does not exist in the address book information, an error is transmitted. In addition, when the tag number acquired by the tag identification information acquisition unit 217 (the tag number received from the wireless tag authentication processing unit 218) exists in the address book information, the tag number confirmation unit 220 acquires the tag number from the face information. Notification to the unit 221.

  The face information acquisition unit 221 refers to the address book information, and can acquire the tag number when the user face information is not associated with the tag number acquired by the tag identification information acquisition unit 217 described later. Face information is acquired based on a captured image obtained by imaging an imaging range corresponding to a range. In the present embodiment, the face information acquisition unit 221 acquires face information based on the face image detected by the face image detection unit 215 described later. More specifically, the face information acquisition unit 221 refers to the address book information, and feature point information (an example of face information) is not associated with the tag number notified from the tag number confirmation unit 220. Transmits a face image request for requesting a face image to the face image detection unit 215 described later, and acquires the face image as a response. Then, feature points included in the face image are extracted to obtain (generate) feature point information. Then, the feature point information acquired as described above and the tag number notified from the tag number confirmation unit 220 are notified to the registration control unit 222.

  The registration control unit 222 performs control to register the feature point information acquired by the face information acquisition unit 221 in the address book information in association with the tag number. In this example, the registration control unit 222 performs control to register the feature point information notified from the face information acquisition unit 221 and the tag number in association with the address book information. FIG. 7 is a diagram illustrating an example of the address book information after the registration of the feature point information by the registration control unit 222 is performed.

  The description of FIG. 5 is continued. The captured image acquisition unit 214 acquires a captured image obtained by capturing with the camera 112 from the camera 112. In this example, when a person enters the detection range, the captured image acquisition unit 214 starts operation and acquires a captured image from the camera 112. The captured image acquisition unit 214 transmits the captured image acquired from the camera 112 to the face image detection unit 215.

  The face image detection unit 215 detects a face image from the captured image acquired by the captured image acquisition unit 214. Then, during the predetermined period, the reception of the above-described face image request is waited. When the face image request is received, the detected face image is transmitted to each of the face information acquisition unit 221 and the face image authentication processing unit 216, When the face image request is not received, the detected face image is transmitted only to the face image authentication processing unit 216. Here, when a face image is transmitted to each of the face information acquisition unit 221 and the face image authentication processing unit 216, the same face image is transmitted (the face image authentication process described later succeeds automatically). Will do).

  Various known techniques can be used as a method for detecting a face image. For example, P6-P26 of http://www.vision.cs.chubu.ac.jp/cvtutorial/pdf/03objection.pdf “Face detection by Haar-like features” as disclosed may be used. The outline of “face detection by Haar-like features” will be described below. A value obtained by subtracting the sum of the pixel values of the white region from the sum of the pixel values of the black region in the rectangle to be calculated in the search region is called a Haar-Like feature amount. Since this rectangular arrangement place may be arranged anywhere in the search area, there are tens of thousands of possible arrangement places in the search area. On the other hand, each weak classifier in the search region is weighted by prior learning by boosting, and only a few dozen weak classifiers with higher importance are selected to create a strong classifier. Then, this strong discriminator determines whether or not the area is a human face area (by a black-and-white rectangular number pattern indicating human face-likeness).

  The face image authentication processing unit 216 performs face image authentication (face authentication) processing for determining whether or not face information corresponding to the face image detected by the face image detection unit 215 exists in the address book information. In this example, when the face image authentication processing unit 216 receives a face image from the face image detection unit 215, the face image authentication processing unit 216 transmits an address book information request for requesting address book information to the address book information processing unit 213, and the response As address book information. Then, feature points included in the face image received from the face image detection unit 215 are extracted to generate feature point information, and the generated feature point information (an example of face information corresponding to the face image) is address book information. It is determined whether or not the address book information received from the processing unit 213 exists. In short, the feature point information is matched by the number of users registered in the address book information. When a face image is adopted as the face information instead of the feature point information, the face image authentication processing unit 216 receives the face image received from the face image detection unit 215 from the address book information processing unit 213. It is determined whether or not the address book information exists. In this case, for example, there is a method in which the luminance value of each pixel per face image is set as one vector and matching is performed by pattern recognition. An example is face image authentication using a subspace method as disclosed in http://www.cvlab.cs.tsukuba.ac.jp/~kfukui/papers/ssii2007.pdf. Then, the face image authentication processing unit 216 transmits a face authentication result indicating the result of the face image authentication process to the authentication unit 219. In this example, the face image authentication processing unit 216 transmits the corresponding address number to the authentication unit 219 when the result of the face image authentication processing is affirmative.

  The tag identification information acquisition unit 217 acquires the read tag number from the tag reader 113 each time the tag reader 113 reads the tag number. The tag identification information acquisition unit 217 transmits the tag number acquired from the tag reader 113 to the wireless tag authentication processing unit 218.

  The wireless tag authentication processing unit 218 performs wireless tag authentication processing that determines whether or not the tag number acquired by the tag identification information acquisition unit 217 exists in the address book information. In this example, the wireless tag authentication processing unit 218 transmits the tag number received from the tag identification information acquisition unit 217 to the address book information processing unit 213, and whether or not the tag number exists in the address book information. The address book information processing unit 213 makes this determination. As described above, when the tag number received from the wireless tag authentication processing unit 218 is present in the address book information, the address book information processing unit 213 (tag number confirmation unit 220) performs the wireless tag authentication processing on the corresponding address number. If it does not exist in the address book information, an error is notified. When receiving an address number from the address book information processing unit 213, the wireless tag authentication processing unit 218 determines that the result of the wireless tag authentication processing is affirmative, and when receiving an error, the result of the wireless tag authentication processing Can be determined to be negative. Then, the wireless tag authentication processing unit 218 transmits a wireless tag authentication result indicating the result of the wireless tag authentication processing to the authentication unit 219. In this example, the wireless tag authentication processing unit 218 transmits the corresponding address number to the authentication unit 219 together when the result of the wireless tag authentication processing is affirmative.

  Based on the result of the face image authentication process and the result of the wireless tag authentication process, the authentication unit 219 includes the tag number acquired by the tag identification information acquisition unit 217 in the address book information and associates it with the tag number. If the obtained face information (feature point information in this example) matches the face information corresponding to the face image detected by the face image detection unit 215, the tag number acquired by the tag identification information acquisition unit 217 is stored. The user who owns the wireless tag 114 recognizes that he has the authority to use the MFP 1 (authenticates the user who owns the wireless tag 114). In this example, the authentication unit 219 receives a face authentication result indicating that the result of the face image authentication processing is affirmative from the face image authentication processing unit 216, and the result of the wireless tag authentication processing from the wireless tag authentication processing unit 218. Receives the RFID tag authentication result indicating that is positive, and authenticates the user when the address number notified together with the face authentication result matches the address number notified together with the RFID tag authentication result Then, the MFP 1 is controlled to be usable.

  FIG. 8 is a flowchart illustrating an operation example of the PC 2 when the administrator of the MFP 1 registers default address book information. The administrator operates the PC 2 to display a screen (registration screen) for registering address book information, and performs an operation for registering personal information of unregistered users. The PC 2 that has received this operation performs a process of registering personal information (step S1). Next, the administrator performs an operation for registering the tag number of the wireless tag 114 to be distributed to the user who registered the personal information in step S1. The PC 2 that has received this operation performs a process of registering the tag number in association with the personal information registered in step S1 (step S2). Then, the PC 2 performs processing for updating default address information (processing for updating address information in the storage unit) (step S3).

  FIG. 9 is a flowchart illustrating an operation example of the MFP 1 when the user who owns the wireless tag 114 deceives the wireless tag 114 possessed by the user with respect to the tag reader 113. Since the specific contents of each step are as described above, detailed description will be omitted as appropriate. As shown in FIG. 9, the tag identification information acquisition unit 217 acquires a tag number from the tag reader 113 (step S101). Next, the tag number confirmation unit 220 determines whether or not the tag number acquired in step S101 exists in the address book information (step S102). When the result of step S102 is negative (step S102: No), the result is that the authentication is not performed (described here as the end of processing). If the result of step S102 is affirmative (step S102: Yes), the face information acquisition unit 221 refers to the address book information, and whether the feature point information is associated with the tag number acquired in step S101. It is confirmed whether or not (step S103). If the result of step S102 is affirmative (step S102: Yes), the tag number confirmation unit 220 transmits the corresponding address number to the wireless tag authentication processing unit 218. As described above, if the wireless tag authentication processing unit 218 receives an address number from the address book information processing unit 213 (tag number confirmation unit 220), the wireless tag authentication processing unit 218 may determine that the result of the wireless tag authentication processing is positive. The wireless tag authentication result indicating the result of the wireless tag authentication process is transmitted to the authentication unit 219.

  When the result of step S103 is negative (step S103: No), the face information acquisition unit 221 acquires a face image from the face image detection unit 215 (step S104), and extracts feature points included in the acquired face image. The feature point information is acquired (generated) (step S105). Thereafter, the face information acquisition unit 221 discards the face image acquired from the face image detection unit 215 (step S106). Then, the registration control unit 222 performs control for associating the feature point information acquired in step S105 with the tag number acquired in step S101 and registering it in the address book information (step S107). Then, the process proceeds to step S108.

  When the result of step S103 is affirmative (step S103: Yes), or after step S107, face image authentication processing by the face image authentication processing unit 216 is performed (step S108), and the face indicating the result of the face image authentication processing The image authentication result is transmitted to the authentication unit 219. Then, the authentication unit 219 determines whether the authentication is successful based on the result of the face image authentication process and the result of the wireless tag authentication process (step S109). If the result of step S109 is affirmative (step S109: Yes), the authentication unit 219 controls the MFP 1 to be usable (step S110). If the result of step S109 is negative (step S109: No), the process ends.

  As described above, in the present embodiment, a feature point is previously stored with respect to the tag number (the tag number acquired by the tag identification information acquisition unit 217) stored in the wireless tag 114 that is deceived toward the tag reader 113. If the information is not associated, a feature point based on a captured image obtained by capturing an imaging range corresponding to a range in which the tag number can be acquired (a range in which the tag reader 113 and the wireless tag 114 can wirelessly communicate) Information is acquired, and the acquired feature point information is associated with the tag number and registered in the address book information. As a result, the workload on the administrator of the MFP 1 can be reduced, and the efficiency of processing for registering face information (feature point information in this example) used for face authentication can be improved.

  For example, in an arbitrary company, when registering the above address book in an MFP installed in the company, feature point information may be extracted and registered using a photograph taken for each employee's ID card. is assumed. However, for companies that do not take photographs for employee IDs, or when the resolution of the photo is coarse and feature point information cannot be obtained, address book information cannot be created, and face authentication is performed appropriately. I can't do it. Therefore, if the administrator of the device performs photography, registration work that associates the feature point information extracted from the image (photograph) obtained by the photography and the tag number, etc., the administrator's work The load becomes high. On the other hand, according to the present embodiment described above, face authentication can be appropriately performed while reducing the workload of the administrator.

  Although the embodiments according to the present invention have been described above, the present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above-described embodiments. For example, you may delete some components from all the components shown by the above-mentioned embodiment.

  In the above-described embodiment, the main body 10 and the operation unit 20 operate independently of each other with different operating systems (OS). However, the present invention is not limited to this, and for example, the main body 10 and the operation unit 20 have the same operating system. The form which operate | moves may be sufficient.

  The program executed by the MFP 1 of the above-described embodiment is a file in an installable or executable format, and is a CD-ROM, flexible disk (FD), CD-R, DVD (Digital Versatile Disk), USB ( It may be configured to be recorded and provided on a computer readable recording medium such as Universal Serial Bus), or may be configured to be provided or distributed via a network such as the Internet. Further, various programs may be provided by being incorporated in advance in a nonvolatile recording medium such as a ROM.

  Although other embodiments will be described below with reference to the drawings, the same or similar portions as those of the first embodiment are denoted by the same reference numerals and description thereof is omitted.

(Second Embodiment)
FIG. 10 is a diagram illustrating a configuration example of the application layer 201 according to the second embodiment. The application layer 201 according to the present embodiment includes a tag authentication application 301 (tag authentication application), a face information registration application 311 (face information registration application), and a face authentication application 312 (face authentication application). The tag authentication application 301, the face information registration application 311 and the face authentication application 312 operate on the OS layer 203 (second operating system). The face information registration application 311 and the face authentication application 312 may be one application (integrated application 321).

  Here, the configuration in which all of the tag authentication application 301, the face information registration application 311 and the face authentication application 312 are included in the application layer 201 is illustrated, but the software configuration according to the present embodiment is not limited to this. Absent. For example, at least some of the tag authentication application 301, the face information registration application 311 and the face authentication application 312 may be included in the service layer 202.

  FIG. 11 is a diagram illustrating a relationship example between the function of the operation unit 50 and the application according to the second embodiment. The tag authentication application 301 includes a tag identification information acquisition unit 217 and a wireless tag authentication processing unit 218. The tag authentication application 301 performs tag authentication by comparing the tag number (tag identification information) acquired by the tag identification information acquisition unit 217 with the tag number included in the address book information.

  The face information registration application 311 includes a face information acquisition unit 221, a registration control unit 222, and a password authentication unit 351. The password authentication unit 351 compares the password input by the user and the password associated with the tag number in the address book information after tag authentication by the tag authentication application 301 and when the user's face image is captured. Perform password authentication. The registration control unit 222 permits control for registering face information in the address book information in association with the tag number when password authentication is successful.

  The face authentication application 312 includes a captured image acquisition unit 214, a face image detection unit 215, and a face image authentication processing unit 216. The face authentication application 312 detects a face image from the captured image and determines whether face information corresponding to the detected face image exists in the address book information.

  FIG. 12 is a flowchart illustrating an operation example of the MFP 1 according to the second embodiment. The flowchart according to the present embodiment is different from the flowchart according to the first embodiment shown in FIG. 9 in that step S201 is inserted between step S102 and step S103. If the result of step S102 is affirmative (step S102: Yes), that is, if the tag number confirmation unit 220 determines that the tag number acquired in step S101 exists in the address book information, the password authentication unit 351 performs tag authentication. The password input later by the user is compared with the password associated with the tag number acquired in step S101, and it is determined whether or not the password authentication is successful (S201). If the result of step S201 is affirmative (step S201: Yes), that is, if the password input by the user matches the password associated with the acquired tag number, the process of step S103 (face information acquisition unit 221) (A process for confirming whether or not the feature point information is associated with the tag number) is performed. If the result of step S201 is negative (S201: No), that is, if the password input by the user and the password associated with the acquired tag number do not match, authentication is not performed as a result.

  According to the present embodiment, processing related to authentication (tag authentication using tag information, acquisition / registration of user face information, face authentication using face information, etc.) is performed by the OS layer 203 (second process) of the operation unit 50. This is performed by an application (a tag authentication application 301, a face information registration application 311, a face authentication application 312 or the like) operating on the operating system). The OS layer 203 of the operation unit 50 operates independently of the OS layer 103 (first operating system) of the main body 10. Therefore, it is possible to perform processing related to authentication independently of the main body 10 and to improve workability such as setting related to authentication and maintenance. Further, according to the present embodiment, password authentication is performed after tag authentication by the password authenticating unit 351, and face information is registered when the password authentication is successful. Therefore, the security can be improved as compared with the first embodiment. It becomes possible.

  As mentioned above, although embodiment of this invention was described, the said embodiment is shown as an example and is not intending limiting the range of invention. The novel embodiment can be implemented in various other forms, and various omissions, replacements, changes, and combinations can be made without departing from the scope of the invention. This embodiment and its modifications are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

1 MFP
2 PC
8 Network 10 Main body 20, 50 Operation unit 100 Information processing system 112 Camera 113 Tag reader 114 Wireless tag 211 Human body detection information reception unit 212 Energy saving control unit 213 Address book information processing unit 214 Captured image acquisition unit 215 Face image detection unit 216 Face image authentication Processing unit 217 Tag identification information acquisition unit 218 Wireless tag authentication processing unit 219 Authentication unit 220 Tag number confirmation unit 221 Face information acquisition unit 222 Registration control unit 301 Tag authentication application 311 Face information registration application 312 Face authentication application 321 Integrated application 351 Password authentication Part

JP2012-88835A

Claims (12)

A storage unit that stores address identification information that associates at least tag identification information for identifying a wireless tag indicating a medium capable of wireless communication and personal information of the user;
A tag identification information acquisition unit for acquiring the tag identification information;
When the face identification information is not associated with the tag identification information acquired by the tag identification information acquisition unit with reference to the address book information, the tag identification information can be acquired. A face information acquisition unit that acquires the face information based on a captured image obtained by imaging the imaging range to be performed;
A registration control unit that controls to register the face information acquired by the face information acquisition unit in the address book information in association with the tag identification information;
Information processing device. A captured image acquisition unit that acquires the captured image;
A face image detection unit that detects a face image from the captured image acquired by the captured image acquisition unit;
The face information acquisition unit acquires the face information based on the face image detected by the face image detection unit;
The information processing apparatus according to claim 1. A face image authentication processing unit that performs a face image authentication process for determining whether the face information corresponding to the face image detected by the face image detection unit exists in the address book information;
The information processing apparatus according to claim 2. A wireless tag authentication processing unit that performs wireless tag authentication processing to determine whether or not the tag identification information acquired by the tag identification information acquisition unit exists in the address book information;
The information processing apparatus according to claim 3. Based on the result of the face image authentication process and the result of the RFID tag authentication process, the tag identification information acquired by the tag identification information acquisition unit exists in the address book information and corresponds to the tag identification information When the attached face information matches the face information corresponding to the face image detected by the face image detection unit, the user possessing the wireless tag has the authority to use the information processing apparatus. Further comprising an authentication unit for
The information processing apparatus according to claim 4. The information processing apparatus is an image processing apparatus including an operation unit that receives an operation, and a main body that performs an operation according to the operation received by the operation unit.
The operation unit is
Having at least the tag identification information acquisition unit, the face information acquisition unit, and the registration control unit,
The information processing apparatus according to any one of claims 1 to 5. The information processing apparatus is an image processing apparatus including an operation unit that receives an operation, and a main body that performs an operation according to the operation received by the operation unit.
The body is
A first operating system;
An engine unit controlled by an application running on the first operating system and functioning as a scanner or a printer;
The storage unit;
With
The operation unit is
A second operating system;
A tag authentication application that operates on the second operating system and performs tag authentication by comparing the tag identification information acquired by the tag identification information acquisition unit with the tag identification information included in the address book information; ,
A face information registration application that operates on the second operating system and includes the face information acquisition unit and the registration control unit;
Comprising
The information processing apparatus according to claim 1. The operation unit is
A captured image acquisition unit that operates on the second operating system and acquires the captured image, a face image detection unit that detects a face image from the captured image acquired by the captured image acquisition unit, and the face image A face authentication application for determining whether the face information corresponding to the face image detected by the detection unit is present in the address book information,
Further comprising
The face information registration application and the face authentication application are one application.
The information processing apparatus according to claim 7. The face information registration application further includes a password authentication unit that performs password authentication by comparing a password input by a user after the tag authentication with a password associated with the tag identification information in the address book information. Have
The registration control unit permits control of registering the face information in the address book information in association with the tag identification information when the password authentication is successful.
The information processing apparatus according to claim 8. A storage unit that stores address identification information that associates at least tag identification information for identifying a wireless tag indicating a medium capable of wireless communication and personal information of the user;
A tag identification information acquisition unit for acquiring the tag identification information;
If the face information of the user is not associated with the tag identification information acquired by the tag identification information acquisition unit with reference to the address book information, the tag identification information can be acquired. A face information acquisition unit that acquires the face information based on a captured image obtained by imaging an imaging range;
A registration control unit that controls to register the face information acquired by the face information acquisition unit in the address book information in association with the tag identification information;
Information processing system. A tag identification information acquisition step for acquiring tag identification information for identifying a wireless tag indicating a medium capable of wireless communication;
With reference to address book information that associates at least the tag identification information with the user's personal information, the user's face information is associated with the tag identification information acquired by the tag identification information acquisition step. If not, a face information acquisition step of acquiring the face information based on a captured image obtained by capturing an imaging range corresponding to a range in which the tag identification information can be acquired;
A registration control step for performing control to associate the face information acquired in the face information acquisition step with the tag identification information and register it in the address book information.
Information processing method. On the computer,
A tag identification information acquisition step for acquiring tag identification information for identifying a wireless tag indicating a medium capable of wireless communication;
With reference to address book information that associates at least the tag identification information with the user's personal information, the user's face information is associated with the tag identification information acquired by the tag identification information acquisition step. If not, a face information acquisition step of acquiring the face information based on a captured image obtained by capturing an imaging range corresponding to a range in which the tag identification information can be acquired;
A registration control step for executing a control for registering the face information acquired in the face information acquisition step in the address book information in association with the tag identification information.

Images