US20220180629A1 - Information providing device, information providing method, and storage medium - Google Patents
Information providing device, information providing method, and storage medium Download PDFInfo
- Publication number
- US20220180629A1 US20220180629A1 US17/683,608 US202217683608A US2022180629A1 US 20220180629 A1 US20220180629 A1 US 20220180629A1 US 202217683608 A US202217683608 A US 202217683608A US 2022180629 A1 US2022180629 A1 US 2022180629A1
- Authority
- US
- United States
- Prior art keywords
- person
- iris data
- iris
- face image
- unsuitable
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000000034 method Methods 0.000 title claims description 43
- 238000012545 processing Methods 0.000 claims description 76
- 210000000744 eyelid Anatomy 0.000 claims description 26
- 210000000554 iris Anatomy 0.000 description 412
- 210000001508 eye Anatomy 0.000 description 69
- 238000003384 imaging method Methods 0.000 description 45
- 210000001747 pupil Anatomy 0.000 description 28
- 230000006399 behavior Effects 0.000 description 9
- 238000009826 distribution Methods 0.000 description 9
- 210000000720 eyelash Anatomy 0.000 description 8
- 238000004891 communication Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000002093 peripheral effect Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000011156 evaluation Methods 0.000 description 2
- 238000002474 experimental method Methods 0.000 description 2
- 210000004209 hair Anatomy 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000010365 information processing Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 208000024891 symptom Diseases 0.000 description 2
- 241001469893 Oxyzygonectes dovii Species 0.000 description 1
- 206010044565 Tremor Diseases 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000004040 coloring Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 210000004709 eyebrow Anatomy 0.000 description 1
- 210000001061 forehead Anatomy 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 210000001525 retina Anatomy 0.000 description 1
- 210000003786 sclera Anatomy 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/98—Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns
- G06V10/993—Evaluation of the quality of the acquired pattern
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/19—Sensors therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/50—Maintenance of biometric data or enrolment thereof
Definitions
- the disclosure relates to a technique for performing authentication using an iris.
- biometrics authentication One type of biological authentication (biometrics authentication) is authentication using an iris.
- PTL 1 discloses a biometrics authentication device that executes processing including a step for determining a quality of read iris data and a step for executing collation processing using data with high quality.
- a control unit detects that a part of the iris data is missing due to an obstacle or the like, the eyes are not sufficiently opened, and the iris is defocused and cannot be confirmed due to a movement of a user when the iris is read, or the like.
- a failure of the authentication is notified to the user. Then, when the user presses a button, a cause of the failure of the authentication is displayed by a display unit.
- the technique in PTL 1 attempts to improve a success rate of the authentication of the user through such processing.
- the biometrics authentication device described in PTL 1 assumes that the cause of the failure of the authentication be a cause that can be resolved, the cause is notified to the user.
- One object of the example embodiments is to provide a device, a method, or the like that reduces a wasteful behavior, wasteful processing, or the like that may occur in a scene in which iris data is acquired.
- An information providing device includes: reception means for receiving a face image, determination means for determining whether a person in the face image is unsuitable for iris data acquisition on the basis of the face image; and output means for outputting information based on determining that the person is unsuitable for the iris data acquisition when the person is determined to be unsuitable for the iris data acquisition.
- An information providing method includes receiving a face image, determining whether a person in the face image is unsuitable for iris data acquisition on the basis of the face image, and outputting information based on determining that the person is unsuitable for the iris data acquisition in a case where it is determined that the person is unsuitable for the iris data acquisition.
- a storage medium stores a program causing a computer to execute: reception processing of receiving a face image; determination processing of determining whether a person in the face image is unsuitable for iris data acquisition on the basis of the face image; and output processing of outputting information based on determining that the person is unsuitable for the iris data acquisition in a case where it is determined that the person is unsuitable for the iris data acquisition.
- One aspect of the example embodiments is also achieved by the program.
- FIG. 1 is a block diagram illustrating a configuration of an information providing device according to a first example embodiment.
- FIG. 2 is a flowchart illustrating a flow of an information providing method according to the first example embodiment.
- FIG. 3 is a block diagram illustrating a configuration of an iris data acquisition device according to a second example embodiment.
- FIG. 4 is a flowchart illustrating a flow of processing by the iris data acquisition device according to the second example embodiment.
- FIG. 5 is a block diagram illustrating an example of hardware included in each unit of each example embodiment.
- FIG. 1 is a block diagram illustrating a configuration of an information providing device 10 according to the first example embodiment.
- the information providing device 10 includes a reception unit 101 , a determination unit 102 , and an output unit 103 .
- the reception unit 101 receives a face image as an input.
- the face image is an image of a part of or an entire face of a person including at least an eye region.
- the determination unit 102 determines whether the person in the face image is unsuitable for iris data acquisition on the basis of the face image received by the reception unit 101 .
- the iris data indicates data of an iris.
- the output unit 103 outputs information based on the determination that the person in the face image is unsuitable for the iris data acquisition.
- the reception unit 101 receives a face image (step S 101 ).
- the determination unit 102 determines whether a person in the face image is unsuitable for iris data acquisition on the basis of the face image received by the reception unit 101 (step S 102 ).
- the output unit 103 outputs information based on the determination that the person in the face image is unsuitable for the iris data acquisition (step S 103 ). In a case where it is not determined that the person in the face image is unsuitable for the iris data acquisition, the output unit 103 does not output the image output in a case where it is determined that the person in the face image is unsuitable for the iris data acquisition. Alternatively, the output unit 103 may output information different from the information output in a case where it is determined that the person in the face image is unsuitable for the iris data acquisition.
- the information providing device 10 it is possible to reduce a wasteful behavior, wasteful processing, or the like that may occur in a scene in which iris data is acquired. This is because, in a case where the person who is unsuitable for the iris data acquisition is in the face image, the determination unit 102 determines that the person is a person who is unsuitable for the iris data acquisition. Then, this is because the output unit 103 outputs the information based on that the person is a person who is unsuitable for the iris data acquisition.
- the device or the person for receiving the information performs processing, a behavior, or determination based on that a person who is unsuitable for the iris data acquisition attempts to make the device acquire the iris data in such a way that it is possible to stop or prevent the attempt of the person to make the device acquire the iris data.
- the information providing device 10 is an iris data acquisition device 11 illustrated in FIG. 3 .
- the iris data acquisition device 11 is a device that acquires iris data.
- the iris data acquisition device 11 determines whether a person is unsuitable for the iris data acquisition in a process of processing of imaging and recording an iris from the person.
- the iris data acquisition device 11 is communicatively connected to an iris database 21 .
- the iris database 21 is a database that stores the iris data.
- the iris database 21 stores information used to identify an individual and data of an iris of the individual in a form in which the information and the iris data are associated with each other.
- the information used to identify the individual may include, for example, a name, a date of birth, an attribute (gender, age, official position, or the like), a unique Identifier (ID) assigned to each person.
- the iris data is, for example, an iris code (to be described later).
- the iris data acquisition device 11 includes a control unit 111 , an imaging unit 112 , an iris data acquisition unit 113 , a success determination unit 114 , a suitability determination unit 115 , a generation unit 116 , an output unit 117 , an input interface 118 , and a memory 119 .
- the input interface 118 receives inputs of various commands from outside (for example, user of iris data acquisition device 11 ).
- the input interface 118 is, for example, a touch panel, a touch pad, a keyboard, and/or a port that receives a signal from an input device (mouse, keyboard, or the like), or the like.
- the memory 119 temporarily or non-temporarily stores data handled by the iris data acquisition device 11 .
- the memory 119 may be achieved, for example, by a Random Access Memory (RAM), a hard disk, a portable storage device, or the like. With respect to the memory 119 , other components included in the iris data acquisition device 11 can freely read and write data.
- RAM Random Access Memory
- other components included in the iris data acquisition device 11 can freely read and write data.
- the control unit 111 controls operations of the components included in the iris data acquisition device 11 .
- the control unit 111 controls a flow of the data handled by the iris data acquisition device 11 .
- the control unit 111 may receive an image generated by the imaging unit 112 and record the received image in the memory 119 .
- the imaging unit 112 generates an image including an iris by imaging the iris.
- the imaging unit 112 is, for example, a camera.
- the imaging unit 112 may be a visible light camera or an infrared camera.
- the imaging unit 112 performs imaging, for example, in response to an imaging instruction issued from the control unit 111 .
- the imaging instruction is issued, for example, on the basis of a command that is input by a person to be imaged by the imaging unit 112 (that is, subject whose iris data is to be acquired) to the iris data acquisition device 11 .
- the subject In order to cause the iris data acquisition device 11 to acquire the data of the iris of the subject, the subject is positioned in front of the imaging unit 112 and inputs the command to the iris data acquisition device 11 via the input interface 118 . Therefore, it is assumed that the subject be imaged in the image generated by the imaging unit 112 .
- the subject may particularly adjust a direction of the imaging unit 112 or a position of the face of the subject in such a way that the iris of the subject is imaged.
- the iris data acquisition unit 113 is configured to acquire the data of the iris of the subject included in the image from the image generated by the imaging unit 112 . Specifically, the iris data acquisition unit 113 is configured to generate iris data that can be used for authentication from a pixel value in a region of the iris in the image.
- Typical iris data that can be used for authentication is data referred to as an iris code.
- the iris code is data that is obtained by processing image data of the iris region. Because the iris code is biological information peculiar to an individual (so-called biometric information), the iris code is data that can be used for authentication in a case where the iris is appropriately imaged.
- a method for generating the iris code by the iris data acquisition unit 113 includes, for example, the following steps.
- the iris data acquisition unit 113 may be configured to generate the iris code by executing the above steps.
- the success determination unit 114 determines whether the iris data has been successfully acquired by the iris data acquisition unit 113 . Whether the iris data is successfully acquired is, in other words, whether the iris data that can be used for authentication can be acquired.
- the success determination unit 114 determines that the iris data has been successfully acquired. In a case where it is not possible for the iris data acquisition unit 113 to acquire the iris data that can be used for authentication, the success determination unit 114 determines that the iris data has not been successfully acquired (that is, has failed).
- a case where it is not possible to acquire the iris data that can be used for authentication is, for example, a case where it is not possible to acquire the iris data itself because it is not possible to specify the position of the iris, an area of the iris displayed in the image is too small, or the like.
- the success determination unit 114 may determine that the iris data has not been successfully acquired by the iris data acquisition unit 113 .
- a case where it is not possible to acquire the iris data that can be used for authentication is a case where it is determined that the acquired iris data is unusable for authentication.
- the success determination unit 114 determines whether the acquired iris data can be used for authentication.
- the iris data can be used for authentication, that is, specifically, quality of the iris data satisfies a predetermined standard for authentication using the iris data.
- the quality is evaluation on information represented by the iris data.
- the predetermined standard is a standard at which the authentication using the iris data can be performed with required accuracy.
- the predetermined standard is a design matter. However, as an example, the predetermined standard is that “authentication such that a false acceptance rate is equal to or less than 0.001% can be performed using the iris data”.
- the success determination unit 114 may analyze the feature that appears in the acquired iris data, and determine whether the iris data can be used for authentication on the basis of the analysis.
- the success determination unit 114 determines that the iris data is successfully acquired. In a case where the iris data acquisition unit 113 cannot normally complete the acquisition of the iris data or in a case where the acquired iris data cannot be used for authentication, the success determination unit 114 determines that the iris data is not successfully acquired.
- the suitability determination unit 115 determines whether the subject is suitable for the iris data acquisition.
- a person who is unsuitable for the iris data acquisition is a person who is not expected to acquire the iris data that can be used for authentication, from one point of view.
- the person who is unsuitable for the iris data acquisition is a person that has a cause that interferes the acquisition of the iris data, from one point of view.
- the suitability determination unit 115 be configured to detect that the subject has any one of the above-mentioned causes from the face image.
- the cause detected by the suitability determination unit 115 may be some of the plurality of causes described above.
- the specific example described above is an example, and the suitability determination unit 115 may be configured to detect a cause other than the above that interferes the acquisition of the iris data.
- to determine whether the subject is unsuitable for the iris data acquisition is also referred to as “to determine a suitability of the subject”.
- to determine that the subject is unsuitable for the iris data acquisition is also simply referred to as “to determine that the subject is unsuitable”.
- the suitability determination unit 115 may determine that the subject is unsuitable, for example, by detecting that the detected eye has a feature of an artificial eye.
- the feature of the artificial eye may be, for example, a feature indicating that the eye is not a living body.
- the feature indicating that the eye is not a living body may be that the size of the pupil does not change.
- the imaging unit 112 may image a moving image including the eye region of the subject in an imaging range.
- the suitability determination unit 115 may detect a variation in the size of the pupil.
- a light source such as a Light Emitting Diode (LED) may be attached to the imaging unit 112 .
- the light source may be configured to emit light under control of the control unit 111 .
- the control unit 111 may control the light source in such a way that the light source emits visible light to the face of the subject, for example, for a predetermined time period.
- the suitability determination unit 115 may detect the variation in the size of the pupil in the obtained moving image.
- the suitability determination unit 115 may determine a possibility that the eyes of the subject are artificial eyes on the basis of the magnitude of the detected variation, a distribution of the variation in the size of the pupil detected in the eye that is not an artificial eye and a distribution of the variation in the size of the pupil detected in the artificial eye. These distributions may be generated through experiments in advance.
- the suitability determination unit 115 may determine that the eye is not a living body, that is, the eye has the feature of the artificial eye.
- the feature of the artificial eye may be that a pupil is not detected in a region of an iris.
- the suitability determination unit 115 may detect a region of the iris and a region of the pupil, for example, by any one of existing methods. Then, in a case where the region of the pupil is not detected in the region of the iris, the suitability determination unit 115 may determine that the imaged eye is an artificial eye. For example, in a case where a human eye is irradiated with near infrared light, reflection light of the near infrared light reflected by the retina is strengthened in a direction toward a light source of the near infrared light.
- a portion of the pupil is brighter than a portion of the iris in an image obtained by imaging the face of the subject by the imaging unit 112 .
- the pupil in such a state is referred to as a bright pupil.
- a method for detecting a pupil using this feature is referred to as a bright pupil method.
- the portion of the pupil is darker than the portion of the iris in the image obtained by imaging the face of the subject by the imaging unit 112 .
- the pupil in such as state is referred to as a dark pupil.
- a method for detecting a pupil using this feature is referred to as a dark pupil method.
- the suitability determination unit 115 may detect a pupil with a combination or either one of the bright pupil method and the dark pupil method. Then, in a case where the pupil is not detected, the suitability determination unit 115 may determine that the eyes of the subject are artificial eyes.
- a light source of near infrared light that is connected to the iris data acquisition device 11 may be provided at a position suitable for the method for detecting the pupil.
- the light source may be configured to emit infrared light, for example, for a predetermined time period while the imaging unit 112 performs imaging, for example, under the control of the control unit 111 .
- the suitability determination unit 115 may detect the pupil using the obtained image.
- the suitability determination unit 115 may determine the possibility that the eyes of the subject are artificial eyes, for example, on the basis of a difference in the brightness of the pupil between a state where the near infrared light is not irradiated and a state where the near infrared light is irradiated.
- the suitability determination unit 115 may determine the possibility that the eyes of the subject are artificial eyes on the basis of a difference between brightness of the bright pupil and brightness of the dark pupil.
- a distribution of the difference in the brightness of the eyes that are not artificial eyes and a distribution of the difference in the brightness of the eyes that are artificial eyes may be obtained, for example, through experiments in advance.
- the suitability determination unit 115 may determine that the eye is not a living body, that is, the eye has the feature of the artificial eye.
- the method for determining the feature of the artificial eye is not limited to the above method.
- the suitability determination unit 115 may determine that the subject is unsuitable by detecting presence of the colored contact lens and detecting that a range of the colored contact lens narrows a range of the iris.
- the suitability determination unit 115 may determine the presence of the colored contact lens in the region of the iris and the range of the colored contact lens, for example, by template matching.
- the suitability determination unit 115 may hold images of iris portions of various colored contact lenses as templates.
- the suitability determination unit 115 may translate, enlarge, reduce, and rotate the template.
- the suitability determination unit 115 may determine whether the colored contact lens exists on the basis of a value indicating a magnitude of a difference from the template at the matching place.
- the pattern of the portion of the iris of the colored contact lens is drawn by repeating patterns and in a case where the pattern of the portion of the iris is represented by halftone dots, the pattern of the portion of the iris has periodicity.
- the suitability determination unit 115 may detect the region of the iris and determine whether pixel values in the detected region of the iris have the periodicity.
- the suitability determination unit 115 may determine whether the periodicity exists in the circumferential direction and the radial direction in the region of the iris.
- the suitability determination unit 115 may convert the image of the region of the iris into a rectangular image, for example, in such a way that the radial direction is set as, for example, the vertical axis, and the circumferential direction is set as, for example, the horizontal axis.
- the suitability determination unit 115 may determine whether the converted rectangular image periodically changes in the vertical direction and the horizontal direction, for example, using conversion such as Fourier transformation on the converted image.
- the suitability determination unit 115 may set two axes orthogonal to each other to the image in which the face of the subject is imaged.
- the suitability determination unit 115 may cut out an image, in the rectangle surrounding the region of the iris, that has sides parallel to the set two axes from the image.
- the suitability determination unit 115 may determine whether the periodicity exists in the axial direction of the cut image. In a case where it is determined that there is periodicity, the suitability determination unit 115 may determine that the colored contact lens exists. The suitability determination unit 115 may determine whether the colored contact lens exists on the basis of a color of the pixel value in the region of the iris.
- the suitability determination unit 115 may generate, for example, a distribution of the pixel value of the pixel included in the region of the iris. Then, the suitability determination unit 115 may detect the peaks of the pixel value of which a ratio of the number in the region of the iris is equal to or more than a predetermined ratio. The suitability determination unit 115 may determine sharpness of the detected peak. The sharpness of the peak may be represented, for example, by a half width.
- the suitability determination unit 115 may determine that the colored contact lens exists in a case where there is a peak sharper than a predetermined standard.
- the suitability determination unit 115 may further specify the distribution, in the region of the iris, of the pixel having the pixel value that appears in the distribution as the peak sharper than the predetermined standard.
- the suitability determination unit 115 may determine whether a level of a frequency of such a pixel in an outer peripheral portion of the iris region with respect to a frequency of such a pixel in an inner peripheral portion of the iris region exceeds a predetermined standard.
- the suitability determination unit 115 may determine that the colored contact lens exists in a case where the level of the frequency of such a pixel in the outer peripheral portion of the iris region with respect to the frequency of such a pixel in the inner peripheral portion of the iris region exceeds the predetermined standard.
- the method for determining whether the colored contact lens exists is not limited to the above method.
- the suitability determination unit 115 may determine that the subject is unsuitable.
- the suitability determination unit 115 may determine that the subject is unsuitable.
- the iris data acquisition device 11 may inquire whether the subject is imaged in the state where the subject fully opens the eyes by the output unit 117 and receive an input of “Yes” or “No”. In a case where “Yes” is input, because the iris data is not successfully acquired although the subject fully opens the eyes, the suitability determination unit 115 may determine that the subject is unsuitable.
- the suitability determination unit 115 may detect features of the eyes or features around the eyes that occur in a case where the eyes are fully opened. For example, in a case where it is detected that the eyebrows are raised, the forehead is wrinkled, or the like, the suitability determination unit 115 may estimate that the subject fully opens the eyes.
- the suitability determination unit 115 may estimate that the iris data that can be used for authentication cannot be acquired even if the subject fully opens the eyes on the basis of the positions and/or the shapes of the eyelids.
- the suitability determination unit 115 may acquire a moving image of the eye of the subject and analyze the moving image. If the subject opens and closes the eyes in the moving image, a state where the eyelids are raised most is estimated as a state at the time when the subject fully opens the eyes at some extent. The suitability determination unit 115 may estimate the state where the subject fully opens the eyes from the state where the subject fully opens the eyes at some extent.
- the suitability determination unit 115 may detect that the iris data that can be used for authentication cannot be acquired even if the subject fully opens the eyes by detecting a feature of a person who has characteristics such that most of the iris is constantly hidden by the eyelid (person having symptoms of eyelid droop and person having extremely narrow eyes) on the basis of the shapes of the eyelids in the received image. That is, the suitability determination unit 115 may detect, on the basis of the shapes of the eyelids, that the state of the eyelids that hides most of the irises is not temporary and is caused by the characteristics of the subject.
- the suitability determination unit 115 may perform learning to prepare a discriminator that distinguishes between a shape of an eyelid when a person who can open the eyes so as not to hide the iris temporarily covers the iris with the eyelid and the shape of the eyelid when a person who has characteristics that most of the iris is obscured by the eyelid and may use the discriminator for the image of the eye of the subject.
- the suitability determination unit 115 may determine that the subject is unsuitable by detecting an obstacle that obscures a part or all of the region of the iris, that the obstacle is the eyelash, and that a degree to which the eyelashes obscure the region of the iris is unacceptable.
- the suitability determination unit 115 may detect, for example, that the obstacle is the eyelash on the basis of the shape of the obstacle and the position of the obstacle in the face image.
- the suitability determination unit 115 may use an area of the eyelashes that covers over the iris portion as a measure of the degree to which the eyelashes obscure the iris region. In a case where the area exceeds a predetermined reference value, the suitability determination unit 115 may determine that the degree to which the eyelashes obscure the iris region is unacceptable.
- the suitability determination unit 115 may determine a suitability of the subject by analyzing a state of the subject from a plurality of face images that is temporally continuous. For example, the suitability determination unit 115 may detect that the eyes of the subject are slightly shaking. The suitability determination unit 115 may detect that not only the eyes but also the entire face of the subject is slightly shaking or continuously moving. In a case where it is determined that the movement of the subject specified from the plurality of face images is at a level that interferes the acquisition of the iris data, the suitability determination unit 115 may determine that the subject is unsuitable.
- the suitability determination unit 115 may be configured to execute a part or all of the plurality of determination methods described above.
- some of the above-described determination methods are methods for detecting that the subject has the feature (or nature) that interferes the acquisition of the iris data.
- the generation unit 116 generates information to be output by the output unit 117 .
- the information to be generated is information indicating a result or progress of the processing by the iris data acquisition device 11 .
- a specific example of the information to be generated will be described in the description of the operation of the iris data acquisition device 11 .
- the output unit 117 outputs the information generated by the generation unit 116 .
- An output destination of the output unit 117 is, for example, a display device that has an information display function or an information processing device or the like other than the iris data acquisition device 11 .
- each processing is executed by a processor that executes a program
- each processing be executed in an order of instructions in the program.
- each processing is executed by an individual device
- each unit that executes processing receive data necessary for each processing, for example, from a unit that generates the data and/or read the data from the memory 119 .
- the processing by the iris data acquisition device 11 described later may be started in a case where a person who intends to use the iris authentication uses the iris data acquisition device 11 to register iris data of the person in the iris database 21 .
- the processing by the iris data acquisition device 11 may be started in a case where the person who intends to use the iris authentication uses the iris data acquisition device 11 to execute authentication processing of collating the iris data of the person with iris data registered in the iris database 21 .
- the person who intends to cause the iris data acquisition device 11 to acquire the iris data of the person is referred to as a “user”.
- the imaging unit 112 images a face of a user (step S 11 ). For example, it is sufficient that the user stand in front of the imaging unit 112 , input a command to perform imaging to the iris data acquisition device 11 via the input interface 118 , and the control unit 111 send an imaging instruction to the imaging unit 112 in response to the command.
- the imaging unit 112 performs imaging in such a way that a face image in which the face of the user is imaged is generated.
- the face image does not necessarily need to include the entire face. It is sufficient that the face image be an image in which a range where the iris exists is imaged.
- the iris data acquisition unit 113 attempts to acquire iris data from the face image (step S 12 ).
- the success determination unit 114 determines that the processing in step S 12 , that is, acquisition of the iris data is successfully performed (step S 13 ).
- the control unit 111 records the acquired iris data as iris data to be used for authentication (step S 14 ).
- the control unit 111 register the acquired iris data in the iris database 21 .
- the iris data acquisition device 11 may receive an input of personal identification information of the user via the input interface 118 (may have received in advance) and register a pair of the received personal identification information and the acquired iris data in the iris database 21 .
- the control unit 111 record the iris data in the memory 119 for collation.
- the iris data acquisition device 11 may collate the iris data recorded in the memory 119 with the iris data registered in the iris database 21 .
- step S 14 After the processing in step S 14 , the generation unit 116 generates information indicating that the iris data is successfully acquired, and the output unit 117 outputs the information (step S 15 ).
- the information indicating that the iris data is successfully acquired may be, for example, a message of “normally registered”.
- the information indicating that the iris data is successfully acquired may be information indicating whether the collation is successfully performed.
- the output unit 117 may output the personal identification information of the user specified by the collation as the information indicating that the iris data is successfully acquired.
- Information indicating that the collation fails may be one piece of the information indicating that the iris data is successfully acquired.
- the suitability determination unit 115 determines whether the user is suitable for the iris data acquisition (step S 16 ).
- the generation unit 116 In a case where it is determined that the user is unsuitable for the iris data acquisition (YES in step S 17 ), the generation unit 116 generates output information on the basis of that the user is unsuitable for the iris data acquisition (step S 18 ). Then, the output unit 117 outputs the output information (step S 19 ).
- the output information is information output because the user is unsuitable for the iris data acquisition, and is different from the information output in step S 15 and information to be output in step S 21 described later.
- the output information may be, for example, information including a message to the user.
- Content of the message is, for example, a message indicating that an effort to cause the iris data acquisition device 11 to acquire the iris data should be stopped.
- Specific examples of the messages are “You are unsuitable for the iris data acquisition”, “Undoubtedly, it is difficult to acquire the iris data from you”, “Please stop acquisition of the iris data”, or the like.
- the output information may be information including a message indicating that the user cannot perform a behavior to acquire the iris data anymore, for example, “The staff will be right with you. Please follow the staff's instructions”, “It is difficult to acquire the iris data. The acquisition processing is terminated”, or the like.
- the output unit 117 output the output information to a display device that can be visually recognized by the user.
- the output information may be, for example, information including a message that indicates that the person who is unsuitable for the iris data acquisition uses the iris data acquisition device 11 to a person other than the user.
- An example of the message is “Current user is unsuitable for the iris data acquisition. Please take care of the person” or the like.
- the output unit 117 output (transmit) the output information to a terminal used by the person.
- the output information does not need to include a message.
- the output information may be a signal that lights a light emitter. If the light emitter is positioned at a position that can be visually recognized by a user or a staff, the user or the staff may understand that the user is unsuitable for the iris data acquisition on the basis of the lighting of the light emitter.
- the output information may be a signal that sounds a buzzer, an image from which occurrence of an error can be sensed, a signal that causes an information processing device connected to the iris data acquisition device 11 to execute specific processing, or the like.
- the iris data acquisition device 11 starts or ends the specific processing on the basis of that the user is unsuitable for the iris data acquisition
- information indicating that the iris data acquisition device 11 has started the specific processing and information indicating that the iris data acquisition device 11 ends the specific processing can be assumed as the output information.
- step S 17 In a case where the determination result in step S 17 is YES, the acquisition of the iris data is not attempted again, and the control unit 111 terminates the processing.
- control unit 111 may continue the attempt to acquire the iris data.
- the procedure returns to step S 11 , and the iris data acquisition device 11 may attempt to acquire the iris data again.
- the generation unit 116 In a case where the attempt to acquire the iris data is not continued (NO in step S 20 ), the generation unit 116 generates information indicating that the acquisition of the iris data fails, and the output unit 117 outputs the information.
- the information indicating that the acquisition of the iris data fails is, for example, information including a message of “Failed to acquire the iris data”.
- the information indicating that the acquisition of the iris data fails is designed to be different from the output information output in step S 19 .
- control unit 111 may determine not to continue the attempt to acquire the iris data.
- the determination in step S 20 may be made on the basis of determination by the user.
- the iris data acquisition device 11 may execute the processing in step S 21 before the determination in step S 20 , display a message for inquiring “whether to attempt to acquire the iris data again” to the user, and receive a determination result of the user. In a case of receiving an input indicating that the user has determined to “attempt to acquire the iris data again”, it is sufficient that the control unit 111 determine to continue the attempt to acquire the iris data.
- the face may be automatically imaged after it is determined as YES in step S 20 (without waiting for imaging instruction of user).
- the face may be imaged after it is determined as YES in step S 20 in response to the reception of the imaging instruction from the user again.
- the determination in step S 16 may be made with different criteria for the same user between the first processing and the second and subsequent processing. That is, the criterion of the determination in step S 16 may be designed to be different according to the number of times when step S 12 or S 16 is executed by the same user.
- the output unit 117 may output a message to the user before the processing in step S 11 . It is sufficient that this message be generated by the generation unit 116 .
- the message may have the same content as the message displayed in step S 21 .
- This message may be a message indicating advice to acquire more appropriate iris data such as “Please open your eyes” or “Your hair may cover your eyes. Please remove your hair”.
- the generation unit 116 may generate such a message indicating the advice on the basis of a part of the result of the processing executed by the suitability determination unit 115 .
- the suitability determination unit 115 may determine that the user is unsuitable for the iris data acquisition in step S 16 . Such a configuration detects that there is a high possibility that the iris data is not successfully acquired even if the user is repeatedly imaged, and contributes to stop further attempts to acquire the iris data by the user.
- the suitability determination unit 115 may determine that the user is unsuitable for the iris data acquisition in step S 16 . Such a configuration detects that there is a high possibility that the user does not make improvement efforts or the improvement efforts of the user are not rewarded, and contributes to stop further attempts to acquire the iris data by the user.
- the above-described predetermined value may be differently set according to a type, a degree, or the like of the failure of the acquisition of the iris data. For example, in a case where it is determined that the obstacle obscures a part of the iris in step S 13 , the predetermined value may be set to “4”, and in a case where it is determined that the position of the iris cannot be specified in step S 13 , the predetermined value may be set to “2”.
- the success determination unit 114 may be configured to record the type and the degree of the failure in the memory 119 in step S 13 .
- the degree of the failure is a measure of seriousness of the cause that has contributed the failure, and for example, is a degree of separation from an index for successful acquisition of iris data.
- the degree of the failure may be expressed by a value obtained by subtracting the area of the iris region that is visible in the image from a standard value (may be set on the basis of standard normal iris data).
- Another example of the information indicating the degree of the failure is, for example, a value indicating a possibility that eyes are artificial eyes, a value indicating an amount of an obstacle (eyelashes) that covers an iris, an evaluation value indicating a blurriness of an image, or the like.
- the suitability determination unit 115 may calculate the degree of the failure, for the failure to be determined in step S 13 , on the basis of the data used in the determination in step S 13 . In a case where a score according to the degree of the failure determined in step S 13 is cumulatively added and the accumulated value exceeds a predetermined value, the suitability determination unit 115 may determine that the user is unsuitable for the iris data acquisition. For example, in a case where the iris region is not sufficient in step S 13 , the success determination unit 114 makes the memory 119 store a value obtained by subtracting the area of the iris region that is visible in the image from the standard value as a score.
- the success determination unit 114 accumulates the score each time when it is determined that the iris region is not sufficient in step S 13 .
- the suitability determination unit 115 may determine that the user is unsuitable for the iris data acquisition.
- the score is set to be higher as the degree of the failure increases in a form in which the accumulated value is compared with the predetermined value as described above.
- a uniform score may be set for a specific type of failure.
- a uniform score may be set for each type of failure.
- the suitability determination unit 115 may make the determination in step S 16 on the basis of the comparison between a degree of a recent failure and a degree of a previous failure. For example, in a case where the degree of the failure does not change even though the imaging is performed again, it can be said there is no possibility that the acquisition is successfully performed. Therefore, the success determination unit 114 may, for example, record the degree of the failure determined in step S 13 in the memory 119 . Then, for example, in a case where the degree of the recent failure is compared with the degree of the previous failure and a difference is less (smaller) than a reference in step S 16 , the suitability determination unit 115 may determine that the user is unsuitable for the iris data acquisition.
- the iris data acquisition device 11 According to the iris data acquisition device 11 according to the second example embodiment, it is possible to reduce a wasteful behavior, wasteful processing, or the like that may occur in a scene in which the iris data is acquired.
- the reason is the same as the reason described in the description of the first example embodiment.
- the user determines whether the user is suitable for the iris data acquisition before the iris data acquired from the user is recorded.
- the iris data acquisition device 11 is used at the time when the iris data is registered in the iris database 21 .
- the user can recognize that the user is unsuitable for the iris data acquisition before the iris data is registered in the iris database 21 .
- the iris data acquisition device 11 is used at the time of authentication, it is possible to urge the user to perform authentication using another authentication method other than the iris authentication at an early stage.
- a block illustrating each component of each device is illustrated in functional units.
- the blocks illustrating the components do not necessarily mean that the components are configured by separate modules.
- Processing of each component may be achieved, for example, by reading and executing a program that is stored in a computer-readable storage medium and causes a computer system to execute the processing by the computer system.
- the “computer-readable storage medium” is, for example, a portable medium such as an optical disk, a magnetic disk, a magneto-optical disk, or a nonvolatile semiconductor memory and a storage device such as a Read Only Memory (ROM), a hard disk, or the like built in a computer system.
- the “computer-readable storage medium” includes a storage medium that can temporarily hold a program such as a volatile memory in the computer system and a storage medium that transmits a program such as a communication line such as a network, a telephone line, or the like.
- the program may implement a part of the above-described functions or may implement the functions described above by a combination with a program that has been already stored in the computer system.
- the “computer system” is, for example, a system including a computer 900 as illustrated in FIG. 5 .
- the computer 900 includes the following components.
- each component of each device in each example embodiment is implemented by loading the program 904 for implementing the function of the component to the RAM 903 and executing the program 904 by the CPU 901 .
- the program 904 for implementing the function of each component of each device is, for example, stored in the storage device 905 or the ROM 902 in advance.
- the CPU 901 reads the program 904 as necessary.
- the storage device 905 is, for example, a hard disk.
- the program 904 may be supplied to the CPU 901 via the communication network 909 or may be stored in the storage medium 906 in advance, read by the drive device 907 , and supplied to the CPU 901 .
- the storage medium 906 is a portable medium, for example, an optical disk, a magnetic disk, a magneto-optical disk, a nonvolatile semiconductor memory, or the like.
- each device may be implemented by a possible combination of a separate computer 900 and a program for each component.
- a plurality of components included in each device may be implemented by a possible combination of a single computer 900 and a program.
- each device may be implemented by another general-purpose or dedicated circuit, a computer, or a combination of these. These may be configured by a single chip or a plurality of chips connected via a bus.
- the plurality of computers, circuits, or the like may be centrally arranged or dispersedly arranged.
- the computers, the circuits, or the like may be implemented as a form, in which each of the computers, the circuits, or the like is connected via a communication network, such as a client and server system, a cloud computing system, or the like.
- An information providing device including:
- reception means for receiving a face image
- determination means for determining whether a person in the face image is unsuitable for iris data acquisition based on the face image
- output means for outputting information based on that it is determined that the person is unsuitable for the iris data acquisition in a case where it is determined that the person is unsuitable for the iris data acquisition.
- the output means outputs at least one of information indicating that the person is unsuitable for the iris data acquisition and information that urges the person to stop a behavior to acquire the iris data of the person, as the information.
- the determination means detects, from the face image, that the person has a cause that interferes the acquisition of the iris data and determines that the person is unsuitable for the iris data acquisition in a case where it is detected that the person has the cause that interferes the acquisition of the iris data.
- the determination means determines that the person is unsuitable for the iris data acquisition by detecting that the person has the cause regarding opening of eyelids based on shapes of the eyelids of the person.
- the information providing device according to any one of supplementary notes 1 to 4, further including:
- iris data acquisition means for attempting to acquire the iris data from the face image
- success determination means for determining whether the iris data acquisition means has acquired the iris data and whether quality of the iris data acquired by the iris data acquisition means is sufficient to be used for authentication, in which
- the determination means determines whether the person is unsuitable for the iris data acquisition in a case where it is not possible for the iris data acquisition means to acquire the iris data or in a case where the success determination means determines that the quality of the acquired iris data is not sufficient to be used for authentication.
- the output means outputs a message to the person in a case where it is not determined that the person is unsuitable for the iris data acquisition
- the iris data acquisition means attempts to acquire iris data from the new face image, and the success determination means makes the determination, and
- the determination means determines that the person is unsuitable for the iris data acquisition in a case where the number of times when the message is output to the person exceeds a threshold in a case where the iris data having quality sufficient to be used for authentication has never been acquired from the person.
- the success determination means calculates a seriousness of a cause of that the iris data having the quality sufficient to be used for authentication is not acquired based on information used for the determination and records seriousness information indicating the seriousness in a memory, and
- the determination means determines whether the person is unsuitable for the iris data acquisition based on a history of the seriousness information.
- the information providing device according to any one of supplementary notes 1 to 7, further including:
- imaging means for generating a face image by imaging
- registration means in a case where the iris data of which quality satisfies a predetermined reference for authentication processing using the iris data is acquired, for registering, in a database, a pair of the acquired iris data and identification information of the person.
- An information providing method including:
- At least one of information indicating that the person is unsuitable for the iris data acquisition and information that urges the person to stop a behavior to acquire the iris data of the person is output as the information.
- the person is unsuitable for the iris data acquisition in a case where the number of times when the message is output to the person exceeds a threshold in a case where the iris data having quality sufficient to be used for authentication has never been acquired from the person.
- a seriousness of a cause of that the iris data having the quality sufficient to be used for authentication is not acquired is calculated based on information used for the determination, and seriousness information indicating the seriousness is recorded in a memory, and
- a storage medium that stores a program for causing a computer to execute processing including:
- the output processing outputs at least one of information indicating that the person is unsuitable for the iris data acquisition and information that urges the person to stop a behavior to acquire the iris data of the person, as the information.
- the determination processing detects, from the face image, that the person has a cause that interferes the acquisition of the iris data and determines that the person is unsuitable for the iris data acquisition in a case where it is detected that the person has the cause that interferes the acquisition of the iris data.
- the determination processing determines that the person is unsuitable for the iris data acquisition by detecting that the person has the cause regarding opening of eyelids based on shapes of the eyelids of the person.
- the storage medium according to any one of supplementary notes 17 to 20, that stores the program for causing the computer to execute processing further including:
- the determination processing determines whether the person is unsuitable for the iris data acquisition in a case where it is not possible for the iris data acquisition processing to acquire the iris data or in a case where the success determination processing determines that the quality of the acquired iris data is not sufficient to be used for authentication.
- the output processing outputs a message to the person in a case where it is not determined that the person is unsuitable for the iris data acquisition
- the iris data acquisition processing attempts to acquire the iris data from the new face image, and the success determination processing makes the determination, and
- the determination processing determines that the person is unsuitable for the iris data acquisition in a case where the number of times when the message is output to the person exceeds a threshold in a case where the iris data having quality sufficient to be used for authentication has never been acquired from the person.
- the storage medium in which in a case where the iris data having the quality sufficient to be used for authentication is not acquired, the success determination processing calculates a seriousness of a cause of that the iris data having the quality sufficient to be used for authentication is not acquired based on information used for the determination and records seriousness information indicating the seriousness in a memory, and
- the determination processing determines whether the person is unsuitable for the iris data acquisition based on a history of the seriousness information.
- the storage medium according to any one of supplementary notes 17 to 23 that stores the program for causing the computer to execute processing further including:
- registration processing in a case where the iris data of which quality satisfies a predetermined reference for authentication processing using the iris data is acquired, of registering, in a database, a pair of the acquired iris data and identification information of the person.
Landscapes
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Ophthalmology & Optometry (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Collating Specific Patterns (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Quality & Reliability (AREA)
- Image Analysis (AREA)
- Image Input (AREA)
Abstract
An information providing device according to one aspect of the present disclosure includes: at least one memory storing a set of instructions; and at least one processor configured to execute the set of instructions to: receive a face image; determine whether a person in the face image is unsuitable for iris data acquisition based on the face image; and output information based on determining that the person is unsuitable for the iris data acquisition when the person is determined to be unsuitable for the iris data acquisition.
Description
- The present application is a Continuation application of Ser. No. 17/278,381 filed on Mar. 22, 2021, which is a National Stage Entry of PCT/JP2019/036497 filed on Sep. 18, 2019, which claims priority from Japanese Patent Application 2018-181027 filed on Sep. 26, 2018, the contents of all of which are incorporated herein by reference, in their entirety.
- The disclosure relates to a technique for performing authentication using an iris.
- One type of biological authentication (biometrics authentication) is authentication using an iris.
- PTL 1 discloses a biometrics authentication device that executes processing including a step for determining a quality of read iris data and a step for executing collation processing using data with high quality. In the step for determining the quality, a control unit detects that a part of the iris data is missing due to an obstacle or the like, the eyes are not sufficiently opened, and the iris is defocused and cannot be confirmed due to a movement of a user when the iris is read, or the like. In a case were the number of times when data with poor quality is acquired or the number of times when collation fails exceeds the predetermined number of times, a failure of the authentication is notified to the user. Then, when the user presses a button, a cause of the failure of the authentication is displayed by a display unit. The technique in PTL 1 attempts to improve a success rate of the authentication of the user through such processing.
-
- [PTL 1] JP 2007-257040 A
- Because the biometrics authentication device described in PTL 1 assumes that the cause of the failure of the authentication be a cause that can be resolved, the cause is notified to the user.
- However, there is a cause that has a low possibility to be resolved from among the causes that data with high quality cannot be acquired. For example, in a case where the user is a person who is not able to or has difficulty in acquiring data with an appropriate quality, even if the cause is notified to the user, the cause is unlikely to be resolved, and there is a possibility that a success rate of the authentication of the user is not improved.
- For such a user, even if the device repeatedly attempts to acquire the iris data, the iris data suitable for authentication cannot be acquired. Therefore, the attempt to acquire the iris data goes in vain. A processing time of the device that attempts to acquire the iris data is wasted, and in addition, there is a disadvantage that the user wastes labor and time.
- One object of the example embodiments is to provide a device, a method, or the like that reduces a wasteful behavior, wasteful processing, or the like that may occur in a scene in which iris data is acquired.
- An information providing device according to one aspect of the example embodiments includes: reception means for receiving a face image, determination means for determining whether a person in the face image is unsuitable for iris data acquisition on the basis of the face image; and output means for outputting information based on determining that the person is unsuitable for the iris data acquisition when the person is determined to be unsuitable for the iris data acquisition.
- An information providing method according to one aspect of the example embodiments includes receiving a face image, determining whether a person in the face image is unsuitable for iris data acquisition on the basis of the face image, and outputting information based on determining that the person is unsuitable for the iris data acquisition in a case where it is determined that the person is unsuitable for the iris data acquisition.
- A storage medium according to one aspect of the example embodiments stores a program causing a computer to execute: reception processing of receiving a face image; determination processing of determining whether a person in the face image is unsuitable for iris data acquisition on the basis of the face image; and output processing of outputting information based on determining that the person is unsuitable for the iris data acquisition in a case where it is determined that the person is unsuitable for the iris data acquisition. One aspect of the example embodiments is also achieved by the program.
- According to the example embodiments, it is possible to reduce a wasteful behavior, wasteful processing, or the like that may occur in a scene in which iris data is acquired.
-
FIG. 1 is a block diagram illustrating a configuration of an information providing device according to a first example embodiment. -
FIG. 2 is a flowchart illustrating a flow of an information providing method according to the first example embodiment. -
FIG. 3 is a block diagram illustrating a configuration of an iris data acquisition device according to a second example embodiment. -
FIG. 4 is a flowchart illustrating a flow of processing by the iris data acquisition device according to the second example embodiment. -
FIG. 5 is a block diagram illustrating an example of hardware included in each unit of each example embodiment. - Hereinafter, example embodiments will be described in detail with reference to the drawings.
- First, a first example embodiment will be described.
-
FIG. 1 is a block diagram illustrating a configuration of aninformation providing device 10 according to the first example embodiment. - The
information providing device 10 includes areception unit 101, adetermination unit 102, and anoutput unit 103. - The
reception unit 101 receives a face image as an input. The face image is an image of a part of or an entire face of a person including at least an eye region. - The
determination unit 102 determines whether the person in the face image is unsuitable for iris data acquisition on the basis of the face image received by thereception unit 101. The iris data indicates data of an iris. - In a case where it is determined that the person in the face image is unsuitable for the acquiring the iris data, the
output unit 103 outputs information based on the determination that the person in the face image is unsuitable for the iris data acquisition. - A flow of an operation of the
information providing device 10 will be described with reference to the flowchart inFIG. 2 . First, thereception unit 101 receives a face image (step S101). - Next, the
determination unit 102 determines whether a person in the face image is unsuitable for iris data acquisition on the basis of the face image received by the reception unit 101 (step S102). - Then, in a case where it is determined that the person in the face image is unsuitable for the iris data acquisition, the
output unit 103 outputs information based on the determination that the person in the face image is unsuitable for the iris data acquisition (step S103). In a case where it is not determined that the person in the face image is unsuitable for the iris data acquisition, theoutput unit 103 does not output the image output in a case where it is determined that the person in the face image is unsuitable for the iris data acquisition. Alternatively, theoutput unit 103 may output information different from the information output in a case where it is determined that the person in the face image is unsuitable for the iris data acquisition. - According to the
information providing device 10, it is possible to reduce a wasteful behavior, wasteful processing, or the like that may occur in a scene in which iris data is acquired. This is because, in a case where the person who is unsuitable for the iris data acquisition is in the face image, thedetermination unit 102 determines that the person is a person who is unsuitable for the iris data acquisition. Then, this is because theoutput unit 103 outputs the information based on that the person is a person who is unsuitable for the iris data acquisition. According to the information output from theoutput unit 103, the device or the person for receiving the information performs processing, a behavior, or determination based on that a person who is unsuitable for the iris data acquisition attempts to make the device acquire the iris data in such a way that it is possible to stop or prevent the attempt of the person to make the device acquire the iris data. - Hereinafter, a specific example of the first example embodiment will be described.
- One of specific examples of the
information providing device 10 is an irisdata acquisition device 11 illustrated inFIG. 3 . The irisdata acquisition device 11 is a device that acquires iris data. The irisdata acquisition device 11 determines whether a person is unsuitable for the iris data acquisition in a process of processing of imaging and recording an iris from the person. - As illustrated in
FIG. 3 , the irisdata acquisition device 11 is communicatively connected to aniris database 21. Theiris database 21 is a database that stores the iris data. - The
iris database 21 stores information used to identify an individual and data of an iris of the individual in a form in which the information and the iris data are associated with each other. - The information used to identify the individual may include, for example, a name, a date of birth, an attribute (gender, age, official position, or the like), a unique Identifier (ID) assigned to each person.
- The iris data is, for example, an iris code (to be described later).
- <Configuration>
- Hereinafter, components of the iris
data acquisition device 11 will be described. - As illustrated in
FIG. 3 , the irisdata acquisition device 11 includes acontrol unit 111, animaging unit 112, an irisdata acquisition unit 113, asuccess determination unit 114, asuitability determination unit 115, ageneration unit 116, anoutput unit 117, aninput interface 118, and amemory 119. - ===
Input Interface 118=== - The
input interface 118 receives inputs of various commands from outside (for example, user of iris data acquisition device 11). Theinput interface 118 is, for example, a touch panel, a touch pad, a keyboard, and/or a port that receives a signal from an input device (mouse, keyboard, or the like), or the like. - ===
Memory 119=== - The
memory 119 temporarily or non-temporarily stores data handled by the irisdata acquisition device 11. Thememory 119 may be achieved, for example, by a Random Access Memory (RAM), a hard disk, a portable storage device, or the like. With respect to thememory 119, other components included in the irisdata acquisition device 11 can freely read and write data. - ===
Control Unit 111=== - The
control unit 111 controls operations of the components included in the irisdata acquisition device 11. - The
control unit 111 controls a flow of the data handled by the irisdata acquisition device 11. For example, thecontrol unit 111 may receive an image generated by theimaging unit 112 and record the received image in thememory 119. - ===
Imaging Unit 112=== - The
imaging unit 112 generates an image including an iris by imaging the iris. Theimaging unit 112 is, for example, a camera. Theimaging unit 112 may be a visible light camera or an infrared camera. Theimaging unit 112 performs imaging, for example, in response to an imaging instruction issued from thecontrol unit 111. The imaging instruction is issued, for example, on the basis of a command that is input by a person to be imaged by the imaging unit 112 (that is, subject whose iris data is to be acquired) to the irisdata acquisition device 11. In order to cause the irisdata acquisition device 11 to acquire the data of the iris of the subject, the subject is positioned in front of theimaging unit 112 and inputs the command to the irisdata acquisition device 11 via theinput interface 118. Therefore, it is assumed that the subject be imaged in the image generated by theimaging unit 112. The subject may particularly adjust a direction of theimaging unit 112 or a position of the face of the subject in such a way that the iris of the subject is imaged. - ===Iris
Data Acquisition Unit 113=== - The iris
data acquisition unit 113 is configured to acquire the data of the iris of the subject included in the image from the image generated by theimaging unit 112. Specifically, the irisdata acquisition unit 113 is configured to generate iris data that can be used for authentication from a pixel value in a region of the iris in the image. - Typical iris data that can be used for authentication is data referred to as an iris code. The iris code is data that is obtained by processing image data of the iris region. Because the iris code is biological information peculiar to an individual (so-called biometric information), the iris code is data that can be used for authentication in a case where the iris is appropriately imaged.
- A method for generating the iris code by the iris
data acquisition unit 113 includes, for example, the following steps. -
- Step for detecting an eye region from an image
- Step for detecting an edge of an upper eyelid, an edge of a lower eyelid, a boundary between a pupil and an iris, and a boundary between an iris and a white eye (also referred to as sclera) in the eye region
- Step for developing a pattern in a region in which the iris is imaged in a band-like shape
- Step for encoding the developed pattern
- The iris
data acquisition unit 113 may be configured to generate the iris code by executing the above steps. - ===
Success Determination Unit 114=== - The
success determination unit 114 determines whether the iris data has been successfully acquired by the irisdata acquisition unit 113. Whether the iris data is successfully acquired is, in other words, whether the iris data that can be used for authentication can be acquired. - In a case where the iris data that can be used for authentication can be acquired by the iris
data acquisition unit 113, thesuccess determination unit 114 determines that the iris data has been successfully acquired. In a case where it is not possible for the irisdata acquisition unit 113 to acquire the iris data that can be used for authentication, thesuccess determination unit 114 determines that the iris data has not been successfully acquired (that is, has failed). - A case where it is not possible to acquire the iris data that can be used for authentication is, for example, a case where it is not possible to acquire the iris data itself because it is not possible to specify the position of the iris, an area of the iris displayed in the image is too small, or the like. In a case where an error occurs in any one of the processing in the steps executed by the iris
data acquisition unit 113 described above and the acquisition of the iris data is not normally completed, thesuccess determination unit 114 may determine that the iris data has not been successfully acquired by the irisdata acquisition unit 113. - In addition, a case where it is not possible to acquire the iris data that can be used for authentication is a case where it is determined that the acquired iris data is unusable for authentication.
- In a case where the acquisition of the iris data by the iris
data acquisition unit 113 has been normally completed, thesuccess determination unit 114 determines whether the acquired iris data can be used for authentication. - The iris data can be used for authentication, that is, specifically, quality of the iris data satisfies a predetermined standard for authentication using the iris data. The quality is evaluation on information represented by the iris data. The predetermined standard is a standard at which the authentication using the iris data can be performed with required accuracy. The predetermined standard is a design matter. However, as an example, the predetermined standard is that “authentication such that a false acceptance rate is equal to or less than 0.001% can be performed using the iris data”.
- For example, in a case where a feature specific for an individual does not sufficiently appear in the acquired iris data, it cannot be said that the iris data can be used for authentication. In a case where the acquired iris data has an unnatural feature as the feature of the iris, it cannot be said that the iris data can be used for authentication. Therefore, the
success determination unit 114 may analyze the feature that appears in the acquired iris data, and determine whether the iris data can be used for authentication on the basis of the analysis. - In a case where the acquisition of the iris data is normally completed and the acquired iris data can be used for authentication, the
success determination unit 114 determines that the iris data is successfully acquired. In a case where the irisdata acquisition unit 113 cannot normally complete the acquisition of the iris data or in a case where the acquired iris data cannot be used for authentication, thesuccess determination unit 114 determines that the iris data is not successfully acquired. - ===
Suitability Determination Unit 115=== - The
suitability determination unit 115 determines whether the subject is suitable for the iris data acquisition. - A person who is unsuitable for the iris data acquisition is a person who is not expected to acquire the iris data that can be used for authentication, from one point of view. The person who is unsuitable for the iris data acquisition is a person that has a cause that interferes the acquisition of the iris data, from one point of view.
- Specific examples of the cause that interfere the acquisition of the iris data will be given.
-
- The eye is an artificial eye
- A colored contact lens is worn that obscures a part of or an entire iris in such a way that the feature of the iris cannot be sufficiently extracted
- Most part of the iris is obscured by the eyelid due to symptoms of eyelid droop
- Most part of the iris is obscured because an eyelid opening degree is extremely small (that is, slit eye)
- The degree to which the iris is obscured by the eyelashes is unacceptable
- It is not possible to obtain iris data with sufficient clarity due to movements such as tremors
- It is sufficient that the
suitability determination unit 115 be configured to detect that the subject has any one of the above-mentioned causes from the face image. However, when thesuitability determination unit 115 is configured, the cause detected by thesuitability determination unit 115 may be some of the plurality of causes described above. The specific example described above is an example, and thesuitability determination unit 115 may be configured to detect a cause other than the above that interferes the acquisition of the iris data. - Hereinafter, to determine whether the subject is unsuitable for the iris data acquisition is also referred to as “to determine a suitability of the subject”. In the following, to determine that the subject is unsuitable for the iris data acquisition is also simply referred to as “to determine that the subject is unsuitable”.
- The
suitability determination unit 115 may determine that the subject is unsuitable, for example, by detecting that the detected eye has a feature of an artificial eye. - The feature of the artificial eye may be, for example, a feature indicating that the eye is not a living body. The feature indicating that the eye is not a living body may be that the size of the pupil does not change. In this case, the
imaging unit 112 may image a moving image including the eye region of the subject in an imaging range. Then, thesuitability determination unit 115 may detect a variation in the size of the pupil. For example, a light source such as a Light Emitting Diode (LED) may be attached to theimaging unit 112. For example, the light source may be configured to emit light under control of thecontrol unit 111. While theimaging unit 112 images a moving image, thecontrol unit 111 may control the light source in such a way that the light source emits visible light to the face of the subject, for example, for a predetermined time period. Thesuitability determination unit 115 may detect the variation in the size of the pupil in the obtained moving image. Thesuitability determination unit 115 may determine a possibility that the eyes of the subject are artificial eyes on the basis of the magnitude of the detected variation, a distribution of the variation in the size of the pupil detected in the eye that is not an artificial eye and a distribution of the variation in the size of the pupil detected in the artificial eye. These distributions may be generated through experiments in advance. In a case where the possibility that the eyes of the subject are artificial eyes is lower than a predetermined standard, thesuitability determination unit 115 may determine that the eye is not a living body, that is, the eye has the feature of the artificial eye. - The feature of the artificial eye may be that a pupil is not detected in a region of an iris. The
suitability determination unit 115 may detect a region of the iris and a region of the pupil, for example, by any one of existing methods. Then, in a case where the region of the pupil is not detected in the region of the iris, thesuitability determination unit 115 may determine that the imaged eye is an artificial eye. For example, in a case where a human eye is irradiated with near infrared light, reflection light of the near infrared light reflected by the retina is strengthened in a direction toward a light source of the near infrared light. In a case where the face of the subject is irradiated with near infrared light from the direction of theimaging unit 112, a portion of the pupil is brighter than a portion of the iris in an image obtained by imaging the face of the subject by theimaging unit 112. The pupil in such a state is referred to as a bright pupil. A method for detecting a pupil using this feature is referred to as a bright pupil method. In a case where the face of the subject is irradiated with infrared light from a direction different from an optical axis of theimaging unit 112, the portion of the pupil is darker than the portion of the iris in the image obtained by imaging the face of the subject by theimaging unit 112. The pupil in such as state is referred to as a dark pupil. A method for detecting a pupil using this feature is referred to as a dark pupil method. Thesuitability determination unit 115 may detect a pupil with a combination or either one of the bright pupil method and the dark pupil method. Then, in a case where the pupil is not detected, thesuitability determination unit 115 may determine that the eyes of the subject are artificial eyes. In this case, a light source of near infrared light that is connected to the irisdata acquisition device 11 may be provided at a position suitable for the method for detecting the pupil. In this case, the light source may be configured to emit infrared light, for example, for a predetermined time period while theimaging unit 112 performs imaging, for example, under the control of thecontrol unit 111. Thesuitability determination unit 115 may detect the pupil using the obtained image. Thesuitability determination unit 115 may determine the possibility that the eyes of the subject are artificial eyes, for example, on the basis of a difference in the brightness of the pupil between a state where the near infrared light is not irradiated and a state where the near infrared light is irradiated. Thesuitability determination unit 115 may determine the possibility that the eyes of the subject are artificial eyes on the basis of a difference between brightness of the bright pupil and brightness of the dark pupil. In these cases, a distribution of the difference in the brightness of the eyes that are not artificial eyes and a distribution of the difference in the brightness of the eyes that are artificial eyes may be obtained, for example, through experiments in advance. In a case where the possibility that the eyes of the subject are artificial eyes is lower than a predetermined standard, thesuitability determination unit 115 may determine that the eye is not a living body, that is, the eye has the feature of the artificial eye. The method for determining the feature of the artificial eye is not limited to the above method. - For example, the
suitability determination unit 115 may determine that the subject is unsuitable by detecting presence of the colored contact lens and detecting that a range of the colored contact lens narrows a range of the iris. - The
suitability determination unit 115 may determine the presence of the colored contact lens in the region of the iris and the range of the colored contact lens, for example, by template matching. In this case, thesuitability determination unit 115 may hold images of iris portions of various colored contact lenses as templates. In this template matching, thesuitability determination unit 115 may translate, enlarge, reduce, and rotate the template. In a case where the region of the iris matches the template, thesuitability determination unit 115 may determine whether the colored contact lens exists on the basis of a value indicating a magnitude of a difference from the template at the matching place. - In a case where the portion of the iris of the colored contact lens is drawn by repeating patterns and in a case where the pattern of the portion of the iris is represented by halftone dots, the pattern of the portion of the iris has periodicity. The
suitability determination unit 115 may detect the region of the iris and determine whether pixel values in the detected region of the iris have the periodicity. Thesuitability determination unit 115 may determine whether the periodicity exists in the circumferential direction and the radial direction in the region of the iris. In this case, thesuitability determination unit 115 may convert the image of the region of the iris into a rectangular image, for example, in such a way that the radial direction is set as, for example, the vertical axis, and the circumferential direction is set as, for example, the horizontal axis. Thesuitability determination unit 115 may determine whether the converted rectangular image periodically changes in the vertical direction and the horizontal direction, for example, using conversion such as Fourier transformation on the converted image. Thesuitability determination unit 115 may set two axes orthogonal to each other to the image in which the face of the subject is imaged. Thesuitability determination unit 115 may cut out an image, in the rectangle surrounding the region of the iris, that has sides parallel to the set two axes from the image. Thesuitability determination unit 115 may determine whether the periodicity exists in the axial direction of the cut image. In a case where it is determined that there is periodicity, thesuitability determination unit 115 may determine that the colored contact lens exists. Thesuitability determination unit 115 may determine whether the colored contact lens exists on the basis of a color of the pixel value in the region of the iris. - In a case where the pattern of the iris portion of the colored contact lens is drawn using coloring matters of the limited number (for example, equal to or less than three) of colors, it is considered that a sharp peak occurs in the distribution of the color of the iris portion of the colored contact lens. The
suitability determination unit 115 may generate, for example, a distribution of the pixel value of the pixel included in the region of the iris. Then, thesuitability determination unit 115 may detect the peaks of the pixel value of which a ratio of the number in the region of the iris is equal to or more than a predetermined ratio. Thesuitability determination unit 115 may determine sharpness of the detected peak. The sharpness of the peak may be represented, for example, by a half width. Thesuitability determination unit 115 may determine that the colored contact lens exists in a case where there is a peak sharper than a predetermined standard. Thesuitability determination unit 115 may further specify the distribution, in the region of the iris, of the pixel having the pixel value that appears in the distribution as the peak sharper than the predetermined standard. Thesuitability determination unit 115 may determine whether a level of a frequency of such a pixel in an outer peripheral portion of the iris region with respect to a frequency of such a pixel in an inner peripheral portion of the iris region exceeds a predetermined standard. Thesuitability determination unit 115 may determine that the colored contact lens exists in a case where the level of the frequency of such a pixel in the outer peripheral portion of the iris region with respect to the frequency of such a pixel in the inner peripheral portion of the iris region exceeds the predetermined standard. The method for determining whether the colored contact lens exists is not limited to the above method. - In a case where it is estimated that the iris data that can be used for authentication cannot be acquired even if the subject fully opens the eyes, the
suitability determination unit 115 may determine that the subject is unsuitable. - For example, in a case where it is recognized that the received image is an image of a state where the subject fully opens the eyes in a case where the iris data is not successfully acquired, the
suitability determination unit 115 may determine that the subject is unsuitable. To recognize whether the received image is the image of the state where the subject fully opens the eyes, for example, the irisdata acquisition device 11 may inquire whether the subject is imaged in the state where the subject fully opens the eyes by theoutput unit 117 and receive an input of “Yes” or “No”. In a case where “Yes” is input, because the iris data is not successfully acquired although the subject fully opens the eyes, thesuitability determination unit 115 may determine that the subject is unsuitable. - To recognize whether the received image is the image of the state where the subject fully opens the eyes, the
suitability determination unit 115 may detect features of the eyes or features around the eyes that occur in a case where the eyes are fully opened. For example, in a case where it is detected that the eyebrows are raised, the forehead is wrinkled, or the like, thesuitability determination unit 115 may estimate that the subject fully opens the eyes. - The
suitability determination unit 115 may estimate that the iris data that can be used for authentication cannot be acquired even if the subject fully opens the eyes on the basis of the positions and/or the shapes of the eyelids. - For example, the
suitability determination unit 115 thesuitability determination unit 115 may acquire a moving image of the eye of the subject and analyze the moving image. If the subject opens and closes the eyes in the moving image, a state where the eyelids are raised most is estimated as a state at the time when the subject fully opens the eyes at some extent. Thesuitability determination unit 115 may estimate the state where the subject fully opens the eyes from the state where the subject fully opens the eyes at some extent. - Alternatively, the
suitability determination unit 115 may detect that the iris data that can be used for authentication cannot be acquired even if the subject fully opens the eyes by detecting a feature of a person who has characteristics such that most of the iris is constantly hidden by the eyelid (person having symptoms of eyelid droop and person having extremely narrow eyes) on the basis of the shapes of the eyelids in the received image. That is, thesuitability determination unit 115 may detect, on the basis of the shapes of the eyelids, that the state of the eyelids that hides most of the irises is not temporary and is caused by the characteristics of the subject. For example, thesuitability determination unit 115 may perform learning to prepare a discriminator that distinguishes between a shape of an eyelid when a person who can open the eyes so as not to hide the iris temporarily covers the iris with the eyelid and the shape of the eyelid when a person who has characteristics that most of the iris is obscured by the eyelid and may use the discriminator for the image of the eye of the subject. - The
suitability determination unit 115 may determine that the subject is unsuitable by detecting an obstacle that obscures a part or all of the region of the iris, that the obstacle is the eyelash, and that a degree to which the eyelashes obscure the region of the iris is unacceptable. Thesuitability determination unit 115 may detect, for example, that the obstacle is the eyelash on the basis of the shape of the obstacle and the position of the obstacle in the face image. Thesuitability determination unit 115 may use an area of the eyelashes that covers over the iris portion as a measure of the degree to which the eyelashes obscure the iris region. In a case where the area exceeds a predetermined reference value, thesuitability determination unit 115 may determine that the degree to which the eyelashes obscure the iris region is unacceptable. - The
suitability determination unit 115 may determine a suitability of the subject by analyzing a state of the subject from a plurality of face images that is temporally continuous. For example, thesuitability determination unit 115 may detect that the eyes of the subject are slightly shaking. Thesuitability determination unit 115 may detect that not only the eyes but also the entire face of the subject is slightly shaking or continuously moving. In a case where it is determined that the movement of the subject specified from the plurality of face images is at a level that interferes the acquisition of the iris data, thesuitability determination unit 115 may determine that the subject is unsuitable. - The
suitability determination unit 115 may be configured to execute a part or all of the plurality of determination methods described above. - It can be said that some of the above-described determination methods are methods for detecting that the subject has the feature (or nature) that interferes the acquisition of the iris data.
- As the person who is determined by the
suitability determination unit 115 to be unsuitable for the iris data acquisition, persons other than the person described above can be exemplified. The person other than the person described above who is determined to be unsuitable for the iris data acquisition will be described in “Note” field. - ===
Generation Unit 116=== - The
generation unit 116 generates information to be output by theoutput unit 117. The information to be generated is information indicating a result or progress of the processing by the irisdata acquisition device 11. A specific example of the information to be generated will be described in the description of the operation of the irisdata acquisition device 11. - ===
Output Unit 117=== - The
output unit 117 outputs the information generated by thegeneration unit 116. - An output destination of the
output unit 117 is, for example, a display device that has an information display function or an information processing device or the like other than the irisdata acquisition device 11. - <Operation>
- Hereinafter, a flow of the processing by the iris
data acquisition device 11 will be described with reference to the flowchart inFIG. 4 . In a case where each processing is executed by a processor that executes a program, it is sufficient that each processing be executed in an order of instructions in the program. In a case where each processing is executed by an individual device, it is sufficient that the processing be executed in order by issuing a notification by a device that has completed the processing to a device that executes next processing or by recognizing the end of each processing and instructing to start each processing by thecontrol unit 111. It is sufficient that each unit that executes processing receive data necessary for each processing, for example, from a unit that generates the data and/or read the data from thememory 119. - The processing by the iris
data acquisition device 11 described later may be started in a case where a person who intends to use the iris authentication uses the irisdata acquisition device 11 to register iris data of the person in theiris database 21. The processing by the irisdata acquisition device 11 may be started in a case where the person who intends to use the iris authentication uses the irisdata acquisition device 11 to execute authentication processing of collating the iris data of the person with iris data registered in theiris database 21. Hereinafter, the person who intends to cause the irisdata acquisition device 11 to acquire the iris data of the person is referred to as a “user”. - First, the
imaging unit 112 images a face of a user (step S11). For example, it is sufficient that the user stand in front of theimaging unit 112, input a command to perform imaging to the irisdata acquisition device 11 via theinput interface 118, and thecontrol unit 111 send an imaging instruction to theimaging unit 112 in response to the command. - The
imaging unit 112 performs imaging in such a way that a face image in which the face of the user is imaged is generated. However, the face image does not necessarily need to include the entire face. It is sufficient that the face image be an image in which a range where the iris exists is imaged. - When the face image is generated, the iris
data acquisition unit 113 attempts to acquire iris data from the face image (step S12). - Next, the
success determination unit 114 determines that the processing in step S12, that is, acquisition of the iris data is successfully performed (step S13). - In a case where it is determined that the iris data is successfully acquired (YES in step S13), the
control unit 111 records the acquired iris data as iris data to be used for authentication (step S14). In a case where the iris data is acquired to register the iris data, it is sufficient that thecontrol unit 111 register the acquired iris data in theiris database 21. In this case, the irisdata acquisition device 11 may receive an input of personal identification information of the user via the input interface 118 (may have received in advance) and register a pair of the received personal identification information and the acquired iris data in theiris database 21. In a case where the iris data is acquired for collation with the iris data registered in theiris database 21, it is sufficient that thecontrol unit 111 record the iris data in thememory 119 for collation. In this case, the irisdata acquisition device 11 may collate the iris data recorded in thememory 119 with the iris data registered in theiris database 21. - After the processing in step S14, the
generation unit 116 generates information indicating that the iris data is successfully acquired, and theoutput unit 117 outputs the information (step S15). - In a case where the iris data is acquired to register the iris data, the information indicating that the iris data is successfully acquired may be, for example, a message of “normally registered”. In a case where the iris data is acquired for the collation with the iris data registered in the
iris database 21, the information indicating that the iris data is successfully acquired may be information indicating whether the collation is successfully performed. In particular, in a case where the collation is successfully performed (that is, in a case where iris data that matches acquired iris data is found in iris database 21), theoutput unit 117 may output the personal identification information of the user specified by the collation as the information indicating that the iris data is successfully acquired. Information indicating that the collation fails (for example, message of “does not match data registered in database”, or the like) may be one piece of the information indicating that the iris data is successfully acquired. - In a case where it is determined that the iris data is not successfully acquired (NO in step S13), the
suitability determination unit 115 determines whether the user is suitable for the iris data acquisition (step S16). - In a case where it is determined that the user is unsuitable for the iris data acquisition (YES in step S17), the
generation unit 116 generates output information on the basis of that the user is unsuitable for the iris data acquisition (step S18). Then, theoutput unit 117 outputs the output information (step S19). The output information is information output because the user is unsuitable for the iris data acquisition, and is different from the information output in step S15 and information to be output in step S21 described later. - The output information may be, for example, information including a message to the user.
- Content of the message is, for example, a message indicating that an effort to cause the iris
data acquisition device 11 to acquire the iris data should be stopped. Specific examples of the messages are “You are unsuitable for the iris data acquisition”, “Unfortunately, it is difficult to acquire the iris data from you”, “Please stop acquisition of the iris data”, or the like. - The output information may be information including a message indicating that the user cannot perform a behavior to acquire the iris data anymore, for example, “The staff will be right with you. Please follow the staff's instructions”, “It is difficult to acquire the iris data. The acquisition processing is terminated”, or the like.
- In a case where the output information is the information including the message to the user, it is sufficient that the
output unit 117 output the output information to a display device that can be visually recognized by the user. - The output information may be, for example, information including a message that indicates that the person who is unsuitable for the iris data acquisition uses the iris
data acquisition device 11 to a person other than the user. An example of the message is “Current user is unsuitable for the iris data acquisition. Please take care of the person” or the like. - In a case where the output information is the information including the message to the person other than the user, it is sufficient that the
output unit 117 output (transmit) the output information to a terminal used by the person. - The output information does not need to include a message. For example, the output information may be a signal that lights a light emitter. If the light emitter is positioned at a position that can be visually recognized by a user or a staff, the user or the staff may understand that the user is unsuitable for the iris data acquisition on the basis of the lighting of the light emitter. In addition, the output information may be a signal that sounds a buzzer, an image from which occurrence of an error can be sensed, a signal that causes an information processing device connected to the iris
data acquisition device 11 to execute specific processing, or the like. - In a case where the iris
data acquisition device 11 starts or ends the specific processing on the basis of that the user is unsuitable for the iris data acquisition, information indicating that the irisdata acquisition device 11 has started the specific processing and information indicating that the irisdata acquisition device 11 ends the specific processing can be assumed as the output information. - In a case where the determination result in step S17 is YES, the acquisition of the iris data is not attempted again, and the
control unit 111 terminates the processing. - In a case where it is not determined that the user is unsuitable for the iris data acquisition (NO in step S17), the
control unit 111 may continue the attempt to acquire the iris data. In a case where the attempt to acquire the iris data is continued (YES in step S20), the procedure returns to step S11, and the irisdata acquisition device 11 may attempt to acquire the iris data again. - In a case where the attempt to acquire the iris data is not continued (NO in step S20), the
generation unit 116 generates information indicating that the acquisition of the iris data fails, and theoutput unit 117 outputs the information. - The information indicating that the acquisition of the iris data fails is, for example, information including a message of “Failed to acquire the iris data”. The information indicating that the acquisition of the iris data fails is designed to be different from the output information output in step S19.
- For example, in a case where a predetermined period of time has elapsed from the start of the processing in step S11, in a case where the number of times when it is determined as NO in step S13 reaches a predetermined number of times, or the like, the
control unit 111 may determine not to continue the attempt to acquire the iris data. - Alternatively, the determination in step S20 may be made on the basis of determination by the user. The iris
data acquisition device 11 may execute the processing in step S21 before the determination in step S20, display a message for inquiring “whether to attempt to acquire the iris data again” to the user, and receive a determination result of the user. In a case of receiving an input indicating that the user has determined to “attempt to acquire the iris data again”, it is sufficient that thecontrol unit 111 determine to continue the attempt to acquire the iris data. - The face may be automatically imaged after it is determined as YES in step S20 (without waiting for imaging instruction of user). The face may be imaged after it is determined as YES in step S20 in response to the reception of the imaging instruction from the user again.
- The determination in step S16 may be made with different criteria for the same user between the first processing and the second and subsequent processing. That is, the criterion of the determination in step S16 may be designed to be different according to the number of times when step S12 or S16 is executed by the same user.
- In a case where it is determined as YES in step S20, the
output unit 117 may output a message to the user before the processing in step S11. It is sufficient that this message be generated by thegeneration unit 116. The message may have the same content as the message displayed in step S21. This message may be a message indicating advice to acquire more appropriate iris data such as “Please open your eyes” or “Your hair may cover your eyes. Please remove your hair”. Thegeneration unit 116 may generate such a message indicating the advice on the basis of a part of the result of the processing executed by thesuitability determination unit 115. - [Note] More examples of the criteria of the determination in step S16 by the
suitability determination unit 115. - Some examples of the criteria of the determination in step S16 by the
suitability determination unit 115 have been already described. However, more examples will be described below. - In a case where the number of times of reception of the imaging instruction from the same user in a state where the iris data is not successfully acquired exceeds a predetermined value, the
suitability determination unit 115 may determine that the user is unsuitable for the iris data acquisition in step S16. Such a configuration detects that there is a high possibility that the iris data is not successfully acquired even if the user is repeatedly imaged, and contributes to stop further attempts to acquire the iris data by the user. - In a case where the number of times when the message indicating the advice is output to the same user in a state where the iris data is not successfully acquired exceeds a predetermined value, the
suitability determination unit 115 may determine that the user is unsuitable for the iris data acquisition in step S16. Such a configuration detects that there is a high possibility that the user does not make improvement efforts or the improvement efforts of the user are not rewarded, and contributes to stop further attempts to acquire the iris data by the user. - The above-described predetermined value may be differently set according to a type, a degree, or the like of the failure of the acquisition of the iris data. For example, in a case where it is determined that the obstacle obscures a part of the iris in step S13, the predetermined value may be set to “4”, and in a case where it is determined that the position of the iris cannot be specified in step S13, the predetermined value may be set to “2”. For such determination, the
success determination unit 114 may be configured to record the type and the degree of the failure in thememory 119 in step S13. - The degree of the failure is a measure of seriousness of the cause that has contributed the failure, and for example, is a degree of separation from an index for successful acquisition of iris data. For example, if the type of the failure is that an area of an iris that is visible in an image is small, the degree of the failure may be expressed by a value obtained by subtracting the area of the iris region that is visible in the image from a standard value (may be set on the basis of standard normal iris data). Another example of the information indicating the degree of the failure is, for example, a value indicating a possibility that eyes are artificial eyes, a value indicating an amount of an obstacle (eyelashes) that covers an iris, an evaluation value indicating a blurriness of an image, or the like.
- The
suitability determination unit 115 may calculate the degree of the failure, for the failure to be determined in step S13, on the basis of the data used in the determination in step S13. In a case where a score according to the degree of the failure determined in step S13 is cumulatively added and the accumulated value exceeds a predetermined value, thesuitability determination unit 115 may determine that the user is unsuitable for the iris data acquisition. For example, in a case where the iris region is not sufficient in step S13, thesuccess determination unit 114 makes thememory 119 store a value obtained by subtracting the area of the iris region that is visible in the image from the standard value as a score. Then, thesuccess determination unit 114 accumulates the score each time when it is determined that the iris region is not sufficient in step S13. In a case where thesuitability determination unit 115 determines whether the accumulated value exceeds the predetermined value in the determination in step S16 and the accumulated value exceeds the predetermined value, thesuitability determination unit 115 may determine that the user is unsuitable for the iris data acquisition. The score is set to be higher as the degree of the failure increases in a form in which the accumulated value is compared with the predetermined value as described above. A uniform score may be set for a specific type of failure. A uniform score may be set for each type of failure. - The
suitability determination unit 115 may make the determination in step S16 on the basis of the comparison between a degree of a recent failure and a degree of a previous failure. For example, in a case where the degree of the failure does not change even though the imaging is performed again, it can be said there is no possibility that the acquisition is successfully performed. Therefore, thesuccess determination unit 114 may, for example, record the degree of the failure determined in step S13 in thememory 119. Then, for example, in a case where the degree of the recent failure is compared with the degree of the previous failure and a difference is less (smaller) than a reference in step S16, thesuitability determination unit 115 may determine that the user is unsuitable for the iris data acquisition. - <Effect>
- According to the iris
data acquisition device 11 according to the second example embodiment, it is possible to reduce a wasteful behavior, wasteful processing, or the like that may occur in a scene in which the iris data is acquired. The reason is the same as the reason described in the description of the first example embodiment. - In the second example embodiment, it is determined whether the user is suitable for the iris data acquisition before the iris data acquired from the user is recorded. In a case where the iris
data acquisition device 11 is used at the time when the iris data is registered in theiris database 21, the user can recognize that the user is unsuitable for the iris data acquisition before the iris data is registered in theiris database 21. As a result, it is possible to make the user who is unsuitable for the iris data acquisition to abandon the use of the iris authentication at an early stage. In a case where the irisdata acquisition device 11 is used at the time of authentication, it is possible to urge the user to perform authentication using another authentication method other than the iris authentication at an early stage. - <Hardware Configuration that Implements Each Unit of Example Embodiment>
- In each example embodiment described above, a block illustrating each component of each device is illustrated in functional units. However, the blocks illustrating the components do not necessarily mean that the components are configured by separate modules.
- Processing of each component may be achieved, for example, by reading and executing a program that is stored in a computer-readable storage medium and causes a computer system to execute the processing by the computer system. The “computer-readable storage medium” is, for example, a portable medium such as an optical disk, a magnetic disk, a magneto-optical disk, or a nonvolatile semiconductor memory and a storage device such as a Read Only Memory (ROM), a hard disk, or the like built in a computer system. The “computer-readable storage medium” includes a storage medium that can temporarily hold a program such as a volatile memory in the computer system and a storage medium that transmits a program such as a communication line such as a network, a telephone line, or the like. The program may implement a part of the above-described functions or may implement the functions described above by a combination with a program that has been already stored in the computer system.
- The “computer system” is, for example, a system including a
computer 900 as illustrated inFIG. 5 . Thecomputer 900 includes the following components. -
- One or a plurality of central Processing Units (CPU) 901
-
ROM 902 -
RAM 903 -
Program 904 loaded onRAM 903 -
Storage device 905 that storesprogram 904 -
Drive device 907 that reads/writes from/tostorage medium 906 -
Communication interface 908 connected tocommunication network 909 - Input/
output interface 910 that inputs/outputs data - Bus 911 that connects components
- For example, each component of each device in each example embodiment is implemented by loading the
program 904 for implementing the function of the component to theRAM 903 and executing theprogram 904 by theCPU 901. Theprogram 904 for implementing the function of each component of each device is, for example, stored in thestorage device 905 or theROM 902 in advance. TheCPU 901 reads theprogram 904 as necessary. Thestorage device 905 is, for example, a hard disk. Theprogram 904 may be supplied to theCPU 901 via thecommunication network 909 or may be stored in thestorage medium 906 in advance, read by thedrive device 907, and supplied to theCPU 901. Thestorage medium 906 is a portable medium, for example, an optical disk, a magnetic disk, a magneto-optical disk, a nonvolatile semiconductor memory, or the like. - There are various modifications of the method for implementing each device. For example, each device may be implemented by a possible combination of a
separate computer 900 and a program for each component. A plurality of components included in each device may be implemented by a possible combination of asingle computer 900 and a program. - Some or all the components of each device may be implemented by another general-purpose or dedicated circuit, a computer, or a combination of these. These may be configured by a single chip or a plurality of chips connected via a bus.
- In a case where some or all of the components of each device are implemented by a plurality of computers, circuits, or the like, the plurality of computers, circuits, or the like may be centrally arranged or dispersedly arranged. For example, the computers, the circuits, or the like may be implemented as a form, in which each of the computers, the circuits, or the like is connected via a communication network, such as a client and server system, a cloud computing system, or the like.
- Although a part or all of the example embodiments may be described as supplementary notes below, a part or all of the example embodiments are not limited to the following supplementary notes.
- <<Supplementary Note>>
- An information providing device including:
- reception means for receiving a face image;
- determination means for determining whether a person in the face image is unsuitable for iris data acquisition based on the face image; and
- output means for outputting information based on that it is determined that the person is unsuitable for the iris data acquisition in a case where it is determined that the person is unsuitable for the iris data acquisition.
- The information providing device according to supplementary note 1, in which
- the output means outputs at least one of information indicating that the person is unsuitable for the iris data acquisition and information that urges the person to stop a behavior to acquire the iris data of the person, as the information.
- The information providing device according to supplementary note 1 or 2, in which
- the determination means detects, from the face image, that the person has a cause that interferes the acquisition of the iris data and determines that the person is unsuitable for the iris data acquisition in a case where it is detected that the person has the cause that interferes the acquisition of the iris data.
- The information providing device according to supplementary note 3, in which
- the determination means determines that the person is unsuitable for the iris data acquisition by detecting that the person has the cause regarding opening of eyelids based on shapes of the eyelids of the person.
- [Supplementary Note 5]
- The information providing device according to any one of supplementary notes 1 to 4, further including:
- iris data acquisition means for attempting to acquire the iris data from the face image; and
- success determination means for determining whether the iris data acquisition means has acquired the iris data and whether quality of the iris data acquired by the iris data acquisition means is sufficient to be used for authentication, in which
- the determination means determines whether the person is unsuitable for the iris data acquisition in a case where it is not possible for the iris data acquisition means to acquire the iris data or in a case where the success determination means determines that the quality of the acquired iris data is not sufficient to be used for authentication.
- The information providing device according to supplementary note 5, in which
- the output means outputs a message to the person in a case where it is not determined that the person is unsuitable for the iris data acquisition,
- in a case where a new face image is input after the output of the message, the iris data acquisition means attempts to acquire iris data from the new face image, and the success determination means makes the determination, and
- the determination means determines that the person is unsuitable for the iris data acquisition in a case where the number of times when the message is output to the person exceeds a threshold in a case where the iris data having quality sufficient to be used for authentication has never been acquired from the person.
- The information providing device according to supplementary note 5, in which
- in a case where the iris data having the quality sufficient to be used for authentication is not acquired, the success determination means calculates a seriousness of a cause of that the iris data having the quality sufficient to be used for authentication is not acquired based on information used for the determination and records seriousness information indicating the seriousness in a memory, and
- the determination means determines whether the person is unsuitable for the iris data acquisition based on a history of the seriousness information.
- The information providing device according to any one of supplementary notes 1 to 7, further including:
- imaging means for generating a face image by imaging; and
- registration means, in a case where the iris data of which quality satisfies a predetermined reference for authentication processing using the iris data is acquired, for registering, in a database, a pair of the acquired iris data and identification information of the person.
- An information providing method including:
- receiving a face image;
- determining whether a person in the face image is unsuitable for iris data acquisition based on the face image; and
- outputting information based on that it is determined that the person is unsuitable for the iris data acquisition in a case where it is determined that the person is unsuitable for the iris data acquisition.
- The information providing method according to supplementary note 9, in which
- at least one of information indicating that the person is unsuitable for the iris data acquisition and information that urges the person to stop a behavior to acquire the iris data of the person is output as the information.
- The information providing method according to
supplementary note 9 or 10, in which - it is detected, from the face image, that the person has a cause that interferes the acquisition of the iris data and it is determined that the person is unsuitable for the iris data acquisition in a case where it is detected that the person has the cause that interferes the acquisition of the iris data.
- The information providing method according to
supplementary note 11, in which - it is determined that the person is unsuitable for the iris data acquisition by detecting that the person has the cause regarding opening of eyelids based on shapes of the eyelids of the person.
- The information providing method according to any one of supplementary notes 9 to 12, further including:
- attempting to acquire the iris data from the face image;
- determining whether the iris data is acquired by the acquisition and whether quality of the iris data acquired by the acquisition is sufficient to be used for authentication; and
- determining whether the person is unsuitable for the iris data acquisition in a case where it is not possible to acquire the iris data or in a case where it is determined that the quality of the acquired iris data is not sufficient to be used for authentication.
- The information providing method according to
supplementary note 13, in which - in a case where it is not determined that the person is unsuitable for the iris data acquisition, a message to the person is output,
- in a case where a new face image is input after the output of the message, acquisition of the iris data from the new face image is attempted, and the determination is made, and
- it is determined that the person is unsuitable for the iris data acquisition in a case where the number of times when the message is output to the person exceeds a threshold in a case where the iris data having quality sufficient to be used for authentication has never been acquired from the person.
- The information providing method according to
supplementary note 13, in which - in a case where the iris data having the quality sufficient to be used for authentication is not acquired, a seriousness of a cause of that the iris data having the quality sufficient to be used for authentication is not acquired is calculated based on information used for the determination, and seriousness information indicating the seriousness is recorded in a memory, and
- it is determined whether the person is unsuitable for the iris data acquisition based on a history of the seriousness information.
- The information providing method according to any one of supplementary notes 9 to 15, further including:
- in a case where the iris data of which quality satisfies a predetermined reference for authentication processing using the iris data is acquired, registering, in a database, a pair of the acquired iris data and identification information of the person.
- A storage medium that stores a program for causing a computer to execute processing including:
- reception processing of receiving a face image;
- determination processing of determining whether a person in the face image is unsuitable for iris data acquisition based on the face image; and
- output processing of outputting information based on that it is determined that the person is unsuitable for the iris data acquisition in a case where it is determined that the person is unsuitable for the iris data acquisition.
- The storage medium according to supplementary note 17, in which
- the output processing outputs at least one of information indicating that the person is unsuitable for the iris data acquisition and information that urges the person to stop a behavior to acquire the iris data of the person, as the information.
- The storage medium according to
supplementary note 17 or 18, in which - the determination processing detects, from the face image, that the person has a cause that interferes the acquisition of the iris data and determines that the person is unsuitable for the iris data acquisition in a case where it is detected that the person has the cause that interferes the acquisition of the iris data.
- The storage medium according to
supplementary note 19, in which - the determination processing determines that the person is unsuitable for the iris data acquisition by detecting that the person has the cause regarding opening of eyelids based on shapes of the eyelids of the person.
- The storage medium according to any one of supplementary notes 17 to 20, that stores the program for causing the computer to execute processing further including:
- iris data acquisition processing of attempting to acquire the iris data from the face image; and
- success determination processing of determining whether the iris data acquisition processing has acquired the iris data and whether quality of the iris data acquired by the iris data acquisition processing is sufficient to be used for authentication, in which
- the determination processing determines whether the person is unsuitable for the iris data acquisition in a case where it is not possible for the iris data acquisition processing to acquire the iris data or in a case where the success determination processing determines that the quality of the acquired iris data is not sufficient to be used for authentication.
- The storage medium according to
supplementary note 21, in which - the output processing outputs a message to the person in a case where it is not determined that the person is unsuitable for the iris data acquisition,
- in a case where a new face image is input after the output of the message, the iris data acquisition processing attempts to acquire the iris data from the new face image, and the success determination processing makes the determination, and
- the determination processing determines that the person is unsuitable for the iris data acquisition in a case where the number of times when the message is output to the person exceeds a threshold in a case where the iris data having quality sufficient to be used for authentication has never been acquired from the person.
- The storage medium according to
supplementary note 21, in which in a case where the iris data having the quality sufficient to be used for authentication is not acquired, the success determination processing calculates a seriousness of a cause of that the iris data having the quality sufficient to be used for authentication is not acquired based on information used for the determination and records seriousness information indicating the seriousness in a memory, and - the determination processing determines whether the person is unsuitable for the iris data acquisition based on a history of the seriousness information.
- The storage medium according to any one of supplementary notes 17 to 23 that stores the program for causing the computer to execute processing further including:
- imaging processing of generating a face image by imaging; and
- registration processing, in a case where the iris data of which quality satisfies a predetermined reference for authentication processing using the iris data is acquired, of registering, in a database, a pair of the acquired iris data and identification information of the person.
- The application is not limited to the example embodiments described above. It will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the example embodiments as defined by the claims.
- This application is based upon and claims the benefit of priority from Japanese patent application No. 2018-181027, filed on Sep. 26, 2018, the disclosure of which is incorporated herein in its entirety by reference.
-
- 10 information providing device
- 101 reception unit
- 102 determination unit
- 103 output unit
- 11 iris data acquisition device
- 111 control unit
- 112 imaging unit
- 113 iris data acquisition unit
- 114 success determination unit
- 115 suitability determination unit
- 116 generation unit
- 117 output unit
- 118 input interface
- 119 memory
- 21 iris database
- 900 computer
- 901 CPU
- 902 ROM
- 903 RAM
- 904 program
- 905 storage device
- 906 storage medium
- 907 drive device
- 908 communication interface
- 909 communication network
- 910 input/output interface
- 911 bus
Claims (20)
1. An information providing device comprising:
at least one memory storing a set of instructions; and
at least one processor configured to execute the set of instructions to:
receive a face image;
determine whether a person in the face image has an physical feature based on the face image;
when the person is determined to have the physical feature, determine that the person is unsuitable for iris data acquisition; and
output information based on determining that the person is unsuitable for the iris data acquisition when the person is determined to be unsuitable for the iris data acquisition.
2. The information providing device according to claim 1 , wherein
the at least one processor is further configured to execute the set of instructions to
determine whether the person has the physical feature that a fully opened eye of the person is insufficient for acquisition of iris data.
3. The information providing device according to claim 2 , wherein
the at least one processor is further configured to execute the set of instructions to:
detect a fully-opened-eye feature in the face image;
determine an eye of the person is fully opened when the fully-opened-eye feature is detected; and
determine that the person has the physical feature that a fully opened eye of the person is insufficient for acquisition of iris data when iris data sufficient for iris authentication is not extracted from the face image and the eye is determined to be fully opened.
4. The information providing device according to claim 2 , wherein
the at least one processor is further configured to execute the set of instructions to
detect a hidden-iris feature, as the physical feature, using a shape of an eyelid in the face image, the hidden-iris feature being characteristics that an iris is constantly hidden by the eyelid in such a way that iris data insufficient for iris authentication is constantly obtained.
5. The information providing device according to claim 2 , wherein
the at least one processor is further configured to execute the set of instructions to:
output a message inquiring whether the person fully opens an eye;
receive an answer to the message; and
when the answer indicates that the person fully open the eye, determine that the person has the physical feature that a fully opened eye of the person is insufficient for acquisition of iris data.
6. The information providing device according to claim 1 , wherein
the at least one processor is further configured to execute the set of instructions to:
receive a moving image as the face image; and
detect, as the physical feature, a shaking of an eye of the person in the moving image.
7. The information providing device according to claim 1 , wherein
the at least one processor is further configured to execute the set of instructions to:
receive a moving image as the face image; and
detect, as the physical feature, a shaking or a continuous moving of an eye and the face of the person in the moving image.
8. The information providing device according to claim 1 , wherein
the at least one processor is further configured to execute the set of instructions to:
attempt acquisition of the iris data from the face image;
perform determination including determining whether the iris data is acquired and determining whether quality of the iris data acquired is sufficient to be used for authentication; and
determine whether the person is unsuitable for the iris data acquisition when the iris data is not acquired or when quality of the acquired iris data is determined to be not sufficient to be used for authentication.
9. The information providing device according to claim 8 , wherein
the at least one processor is further configured to execute the set of instructions to:
output a message to the person when the person is not determined to be unsuitable for the iris data acquisition;
attempt acquisition of iris data from the new face image when a new face image is input after the message is output, and perform the determination; and
determine that the person is unsuitable for the iris data acquisition when a count of times when the message is output to the person exceeds a threshold in a case where the iris data having quality sufficient to be used for authentication is not acquired even once from the person.
10. The information providing device according to claim 8 , wherein
the at least one processor is further configured to execute the set of instructions to:
calculate, based on information used for the determination, a seriousness of a reason that the iris data having the quality sufficient to be used for authentication is not acquired when the iris data having the quality sufficient to be used for authentication is not acquired, and record seriousness information indicating the seriousness in a memory; and
determine whether the person is unsuitable for acquiring the iris data based on a history of the seriousness information.
11. An information providing method comprising:
receiving a face image;
determining whether a person in the face image has an physical feature based on the face image;
when the person is determined to have the physical feature, determining that the person is unsuitable for iris data acquisition; and
outputting information based on determining that the person is unsuitable for the iris data acquisition when the person is determined to be unsuitable for the iris data acquisition.
12. The information providing method according to claim 11 , wherein
determining whether the person has the physical feature that a fully opened eye of the person is insufficient for acquisition of iris data.
13. The information providing method according to claim 12 , wherein
detecting a fully-opened-eye feature in the face image;
determining an eye of the person is fully opened when the fully-opened-eye feature is detected; and
determining that the person has the physical feature that a fully opened eye of the person is insufficient for acquisition of iris data when iris data sufficient for iris authentication is not extracted from the face image and the eye is determined to be fully opened.
14. The information providing method according to claim 12 , wherein
detecting a hidden-iris feature, as the physical feature, using a shape of an eyelid in the face image, the hidden-iris feature being characteristics that an iris is constantly hidden by the eyelid in such a way that iris data insufficient for iris authentication is constantly obtained.
15. The information providing method according to claim 12 , wherein
outputting a message inquiring whether the person fully opens an eye;
receiving an answer to the message; and
when the answer indicates that the person fully open the eye, determining that the person has the physical feature that a fully opened eye of the person is insufficient for acquisition of iris data.
16. The information providing method according to claim 11 , wherein
receiving a moving image as the face image; and
detecting, as the physical feature, a shaking of an eye of the person in the moving image.
17. The information providing method according to claim 11 , wherein
receiving a moving image as the face image; and
detecting, as the physical feature, a shaking or a continuous moving of an eye and the face of the person in the moving image.
18. The information providing method according to claim 11 , wherein
attempting acquisition of the iris data from the face image;
performing determination including determining whether the iris data is acquired and determining whether quality of the iris data acquired is sufficient to be used for authentication; and
determining whether the person is unsuitable for the iris data acquisition when the iris data is not acquired or when quality of the acquired iris data is determined to be not sufficient to be used for authentication.
19. The information providing method according to claim 18 , wherein
outputting a message to the person when the person is not determined to be unsuitable for the iris data acquisition;
attempting acquisition of iris data from the new face image when a new face image is input after the message is output, and performing the determination; and
determining that the person is unsuitable for the iris data acquisition when a count of times when the message is output to the person exceeds a threshold in a case where the iris data having quality sufficient to be used for authentication is not acquired even once from the person.
20. A non-transitory computer readable storage medium storing a program causing a computer to execute processing of:
receiving a face image;
determining whether a person in the face image has an physical feature based on the face image;
when the person is determined to have the physical feature, determining that the person is unsuitable for iris data acquisition; and
outputting information based on determining that the person is unsuitable for the iris data acquisition when the person is determined to be unsuitable for the iris data acquisition.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/683,608 US20220180629A1 (en) | 2018-09-26 | 2022-03-01 | Information providing device, information providing method, and storage medium |
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2018181027 | 2018-09-26 | ||
JP2018-181027 | 2018-09-26 | ||
PCT/JP2019/036497 WO2020066776A1 (en) | 2018-09-26 | 2019-09-18 | Information providing device, information providing method, and storage medium |
US202117278381A | 2021-03-22 | 2021-03-22 | |
US17/683,608 US20220180629A1 (en) | 2018-09-26 | 2022-03-01 | Information providing device, information providing method, and storage medium |
Related Parent Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2019/036497 Continuation WO2020066776A1 (en) | 2018-09-26 | 2019-09-18 | Information providing device, information providing method, and storage medium |
US17/278,381 Continuation US11816927B2 (en) | 2018-09-26 | 2019-09-18 | Information providing device, information providing method, and storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
US20220180629A1 true US20220180629A1 (en) | 2022-06-09 |
Family
ID=69952372
Family Applications (6)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/278,381 Active 2040-05-28 US11816927B2 (en) | 2018-09-26 | 2019-09-18 | Information providing device, information providing method, and storage medium |
US17/683,608 Abandoned US20220180629A1 (en) | 2018-09-26 | 2022-03-01 | Information providing device, information providing method, and storage medium |
US17/683,592 Pending US20220189156A1 (en) | 2018-09-26 | 2022-03-01 | Information providing device, information providing method, and storage medium |
US17/683,620 Active US11816928B2 (en) | 2018-09-26 | 2022-03-01 | Information providing device, information providing method, and storage medium |
US18/223,462 Active US12056955B2 (en) | 2018-09-26 | 2023-07-18 | Information providing device, information providing method, and storage medium |
US18/227,851 Pending US20230377371A1 (en) | 2018-09-26 | 2023-07-28 | Information providing device, information providing method, and storage medium |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/278,381 Active 2040-05-28 US11816927B2 (en) | 2018-09-26 | 2019-09-18 | Information providing device, information providing method, and storage medium |
Family Applications After (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/683,592 Pending US20220189156A1 (en) | 2018-09-26 | 2022-03-01 | Information providing device, information providing method, and storage medium |
US17/683,620 Active US11816928B2 (en) | 2018-09-26 | 2022-03-01 | Information providing device, information providing method, and storage medium |
US18/223,462 Active US12056955B2 (en) | 2018-09-26 | 2023-07-18 | Information providing device, information providing method, and storage medium |
US18/227,851 Pending US20230377371A1 (en) | 2018-09-26 | 2023-07-28 | Information providing device, information providing method, and storage medium |
Country Status (5)
Country | Link |
---|---|
US (6) | US11816927B2 (en) |
EP (1) | EP3859665A4 (en) |
JP (2) | JP7173153B2 (en) |
SG (1) | SG11202103106YA (en) |
WO (1) | WO2020066776A1 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2024166250A1 (en) * | 2023-02-08 | 2024-08-15 | 日本電気株式会社 | Information processing device, information processing method, and program |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030020828A1 (en) * | 2001-07-24 | 2003-01-30 | Matsushita Electric Industrial Co., Ltd. | Iris image pickup apparatus |
JP2004086614A (en) * | 2002-08-27 | 2004-03-18 | Matsushita Electric Ind Co Ltd | Eye image pickup device and eye image verifying device |
US20080292144A1 (en) * | 2005-01-08 | 2008-11-27 | Dae Hoon Kim | Iris Identification System and Method Using Mobile Device with Stereo Camera |
CN201207196Y (en) * | 2008-05-23 | 2009-03-11 | 徐州市博通科贸有限公司 | Anti-forge iris collection and recognition device |
CN206195921U (en) * | 2016-11-11 | 2017-05-24 | 浙江树人大学 | Device is taken a candid photograph to moving target people face iris |
WO2017136857A1 (en) * | 2016-02-05 | 2017-08-10 | Mcbain Theodore Dean | System, method and device for confirmation of an operator's health condition and alive status |
US20180018516A1 (en) * | 2016-07-18 | 2018-01-18 | Samsung Electronics Co., Ltd. | Method and apparatus for iris recognition |
US20180137335A1 (en) * | 2016-11-11 | 2018-05-17 | Samsung Electronics Co., Ltd. | Method and apparatus with iris region extraction |
US20180285544A1 (en) * | 2017-03-28 | 2018-10-04 | Samsung Electronics Co., Ltd. | Method for adaptive authentication and electronic device supporting the same |
Family Cites Families (33)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH1115972A (en) * | 1997-06-20 | 1999-01-22 | Oki Electric Ind Co Ltd | Iris image pickup device |
JP3315648B2 (en) * | 1998-07-17 | 2002-08-19 | 沖電気工業株式会社 | Iris code generation device and iris recognition system |
JP2002312772A (en) | 2001-04-13 | 2002-10-25 | Oki Electric Ind Co Ltd | Individual identification device and eye forgery judgment method |
JP2003138817A (en) | 2001-10-31 | 2003-05-14 | Denso Corp | Keyless entry system for vehicle, person identifying method, and person identifying system |
JP2005334402A (en) | 2004-05-28 | 2005-12-08 | Sanyo Electric Co Ltd | Method and device for authentication |
JP4525286B2 (en) * | 2004-10-14 | 2010-08-18 | 沖電気工業株式会社 | Biometric information authentication apparatus and authentication method |
JP2006212185A (en) * | 2005-02-03 | 2006-08-17 | Matsushita Electric Ind Co Ltd | Living body discrimination device, authentication apparatus and living body discrimination method |
JP2007257040A (en) | 2006-03-20 | 2007-10-04 | Oki Electric Ind Co Ltd | Biometrics authentication device and biometrics authentication system |
US9036871B2 (en) * | 2007-09-01 | 2015-05-19 | Eyelock, Inc. | Mobility identity platform |
CN100573556C (en) * | 2008-05-23 | 2009-12-23 | 徐州市博通科贸有限公司 | A kind of anti-fake eye iris capturing and recognition device |
KR20130115840A (en) * | 2012-04-13 | 2013-10-22 | 이광희 | Iris identification camera system for mobile device |
CN103106401B (en) * | 2013-02-06 | 2017-02-22 | 北京中科虹霸科技有限公司 | Mobile terminal iris recognition device with human-computer interaction mechanism |
KR102037417B1 (en) * | 2013-08-13 | 2019-10-28 | 삼성전자주식회사 | Method of capturing an iris image, Computer readable storage medium of recording the method and an iris image capture device |
US10042994B2 (en) * | 2013-10-08 | 2018-08-07 | Princeton Identity, Inc. | Validation of the right to access an object |
KR102412290B1 (en) * | 2014-09-24 | 2022-06-22 | 프린스톤 아이덴티티, 인크. | Control of wireless communication device capability in a mobile device with a biometric key |
US9767358B2 (en) * | 2014-10-22 | 2017-09-19 | Veridium Ip Limited | Systems and methods for performing iris identification and verification using mobile devices |
KR20160050755A (en) * | 2014-10-31 | 2016-05-11 | 삼성전자주식회사 | Electronic Device and Method for Recognizing Iris by the same |
EP3218845A4 (en) | 2014-11-13 | 2018-07-11 | Intel Corporation | Facial liveness detection in image biometrics |
US9412029B2 (en) | 2014-12-12 | 2016-08-09 | Iris Id, Inc. | Apparatus for recognizing iris and operating method thereof |
JP6333712B2 (en) * | 2014-12-12 | 2018-05-30 | 株式会社日立建機ティエラ | Excavator |
KR102322029B1 (en) | 2015-03-27 | 2021-11-04 | 삼성전자주식회사 | Method and Apparatus for acquiring a biometric information |
US9811681B2 (en) * | 2015-07-28 | 2017-11-07 | Sony Mobile Communications Inc. | Method and system for providing access to a device for a user |
JP6920329B2 (en) * | 2016-03-07 | 2021-08-18 | マジック リープ, インコーポレイテッドMagic Leap,Inc. | Blue light regulation for biometric security |
KR20180014624A (en) * | 2016-08-01 | 2018-02-09 | 삼성전자주식회사 | System and Method for Iris Authentication |
JP6773493B2 (en) * | 2016-09-14 | 2020-10-21 | 株式会社東芝 | Detection device, detection method, and detection program |
JP6946649B2 (en) | 2017-01-31 | 2021-10-06 | ソニーグループ株式会社 | Electronic devices, information processing methods and programs |
WO2018151349A1 (en) * | 2017-02-16 | 2018-08-23 | 엘지전자 주식회사 | Mobile terminal |
JP6866742B2 (en) | 2017-04-17 | 2021-04-28 | カシオ計算機株式会社 | Information processing equipment, journal entry support methods and programs |
CN110945405B (en) * | 2017-05-31 | 2024-01-02 | 奇跃公司 | Eye tracking calibration technique |
CN108154126B (en) * | 2017-12-27 | 2024-01-05 | 中国科学院深圳先进技术研究院 | Iris imaging system and method |
CN108629293B (en) * | 2018-04-16 | 2020-10-27 | 西安交通大学 | Self-adaptive near-infrared iris image acquisition method with feedback mechanism |
CN108960153A (en) * | 2018-07-06 | 2018-12-07 | 深圳虹识技术有限公司 | A kind of method and apparatus of adaptive iris recognition |
CN108470170B (en) * | 2018-07-25 | 2018-11-02 | 上海聚虹光电科技有限公司 | U.S. pupil detection method |
-
2019
- 2019-09-18 EP EP19867478.0A patent/EP3859665A4/en not_active Withdrawn
- 2019-09-18 US US17/278,381 patent/US11816927B2/en active Active
- 2019-09-18 SG SG11202103106YA patent/SG11202103106YA/en unknown
- 2019-09-18 WO PCT/JP2019/036497 patent/WO2020066776A1/en unknown
- 2019-09-18 JP JP2020548539A patent/JP7173153B2/en active Active
-
2022
- 2022-03-01 US US17/683,608 patent/US20220180629A1/en not_active Abandoned
- 2022-03-01 US US17/683,592 patent/US20220189156A1/en active Pending
- 2022-03-01 US US17/683,620 patent/US11816928B2/en active Active
- 2022-11-02 JP JP2022175963A patent/JP7400924B2/en active Active
-
2023
- 2023-07-18 US US18/223,462 patent/US12056955B2/en active Active
- 2023-07-28 US US18/227,851 patent/US20230377371A1/en active Pending
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030020828A1 (en) * | 2001-07-24 | 2003-01-30 | Matsushita Electric Industrial Co., Ltd. | Iris image pickup apparatus |
JP2004086614A (en) * | 2002-08-27 | 2004-03-18 | Matsushita Electric Ind Co Ltd | Eye image pickup device and eye image verifying device |
US20080292144A1 (en) * | 2005-01-08 | 2008-11-27 | Dae Hoon Kim | Iris Identification System and Method Using Mobile Device with Stereo Camera |
CN201207196Y (en) * | 2008-05-23 | 2009-03-11 | 徐州市博通科贸有限公司 | Anti-forge iris collection and recognition device |
WO2017136857A1 (en) * | 2016-02-05 | 2017-08-10 | Mcbain Theodore Dean | System, method and device for confirmation of an operator's health condition and alive status |
US20180018516A1 (en) * | 2016-07-18 | 2018-01-18 | Samsung Electronics Co., Ltd. | Method and apparatus for iris recognition |
CN206195921U (en) * | 2016-11-11 | 2017-05-24 | 浙江树人大学 | Device is taken a candid photograph to moving target people face iris |
US20180137335A1 (en) * | 2016-11-11 | 2018-05-17 | Samsung Electronics Co., Ltd. | Method and apparatus with iris region extraction |
US20180285544A1 (en) * | 2017-03-28 | 2018-10-04 | Samsung Electronics Co., Ltd. | Method for adaptive authentication and electronic device supporting the same |
Also Published As
Publication number | Publication date |
---|---|
US20210350158A1 (en) | 2021-11-11 |
EP3859665A1 (en) | 2021-08-04 |
JP7400924B2 (en) | 2023-12-19 |
US20230377371A1 (en) | 2023-11-23 |
JPWO2020066776A1 (en) | 2021-08-30 |
SG11202103106YA (en) | 2021-04-29 |
US20220189157A1 (en) | 2022-06-16 |
WO2020066776A1 (en) | 2020-04-02 |
JP7173153B2 (en) | 2022-11-16 |
US20220189156A1 (en) | 2022-06-16 |
JP2023011813A (en) | 2023-01-24 |
US11816927B2 (en) | 2023-11-14 |
US12056955B2 (en) | 2024-08-06 |
EP3859665A4 (en) | 2021-11-24 |
US11816928B2 (en) | 2023-11-14 |
US20230360439A1 (en) | 2023-11-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107995979B (en) | System, method and machine-readable medium for authenticating a user | |
CN107438854B (en) | System and method for performing fingerprint-based user authentication using images captured by a mobile device | |
CN110326001A (en) | The system and method for executing the user authentication based on fingerprint using the image captured using mobile device | |
WO2019130670A1 (en) | Biometric authentication system | |
US11756338B2 (en) | Authentication device, authentication method, and recording medium | |
US12056955B2 (en) | Information providing device, information providing method, and storage medium | |
JP6160148B2 (en) | Biological information input device, biometric information input program, and biometric information input method | |
US11163994B2 (en) | Method and device for determining iris recognition image, terminal apparatus, and storage medium | |
US20160366317A1 (en) | Apparatuses and methods for image based biometric recognition | |
CN110889356A (en) | Method and device for unlocking AR glasses based on infrared camera and AR glasses | |
US11195009B1 (en) | Infrared-based spoof detection | |
Amjed et al. | Noncircular iris segmentation based on weighted adaptive hough transform using smartphone database | |
US11250242B2 (en) | Eye tracking method and user terminal performing same | |
CN113553890A (en) | Multi-modal biological feature fusion method and device, storage medium and equipment | |
JP7272510B2 (en) | Verification device, verification method, program | |
CN117197541B (en) | User classification method and system based on convolutional neural network | |
US20240032856A1 (en) | Method and device for providing alopecia information | |
KR102439216B1 (en) | Method and server for recognizing face wearing mask using artificial intelligence deep learning | |
US20220254192A1 (en) | Processing system, processing method, and non-transitory storage medium | |
Barra et al. | MICHE competitions: A realistic experience with uncontrolled eye region acquisition | |
KR20220106399A (en) | Apparatus and Method for Recognizing Liveness of Image | |
KR20230064660A (en) | Method and Apparatus for Providing Pet Mutual Compatibility | |
CN116844219A (en) | Display method, device, equipment and storage medium for preventing eyestrain | |
WO2023156473A1 (en) | Method for determining an access right of a user, requesting computer device, authenticating computer device, and authenticating system | |
WO2015108911A1 (en) | Method and apparatus for controlling intensity of illumination in eye based biometric systems |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |