US20220180629A1 - Information providing device, information providing method, and storage medium - Google Patents

Information providing device, information providing method, and storage medium Download PDF

Info

Publication number
US20220180629A1
US20220180629A1 US17/683,608 US202217683608A US2022180629A1 US 20220180629 A1 US20220180629 A1 US 20220180629A1 US 202217683608 A US202217683608 A US 202217683608A US 2022180629 A1 US2022180629 A1 US 2022180629A1
Authority
US
United States
Prior art keywords
person
iris data
iris
face image
unsuitable
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US17/683,608
Inventor
Keiichi Chono
Masato Tsukada
Chisato Funayama
Ryuichi AKASHI
Yuka OGINO
Takashi Shibata
Shoji Yachida
Hiroshi Imai
Emi KITAGAWA
Yasuhiko Yoshida
Yusuke Mori
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NEC Corp
Original Assignee
NEC Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NEC Corp filed Critical NEC Corp
Priority to US17/683,608 priority Critical patent/US20220180629A1/en
Publication of US20220180629A1 publication Critical patent/US20220180629A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/98Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns
    • G06V10/993Evaluation of the quality of the acquired pattern
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • G06V40/19Sensors therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/50Maintenance of biometric data or enrolment thereof

Definitions

  • the disclosure relates to a technique for performing authentication using an iris.
  • biometrics authentication One type of biological authentication (biometrics authentication) is authentication using an iris.
  • PTL 1 discloses a biometrics authentication device that executes processing including a step for determining a quality of read iris data and a step for executing collation processing using data with high quality.
  • a control unit detects that a part of the iris data is missing due to an obstacle or the like, the eyes are not sufficiently opened, and the iris is defocused and cannot be confirmed due to a movement of a user when the iris is read, or the like.
  • a failure of the authentication is notified to the user. Then, when the user presses a button, a cause of the failure of the authentication is displayed by a display unit.
  • the technique in PTL 1 attempts to improve a success rate of the authentication of the user through such processing.
  • the biometrics authentication device described in PTL 1 assumes that the cause of the failure of the authentication be a cause that can be resolved, the cause is notified to the user.
  • One object of the example embodiments is to provide a device, a method, or the like that reduces a wasteful behavior, wasteful processing, or the like that may occur in a scene in which iris data is acquired.
  • An information providing device includes: reception means for receiving a face image, determination means for determining whether a person in the face image is unsuitable for iris data acquisition on the basis of the face image; and output means for outputting information based on determining that the person is unsuitable for the iris data acquisition when the person is determined to be unsuitable for the iris data acquisition.
  • An information providing method includes receiving a face image, determining whether a person in the face image is unsuitable for iris data acquisition on the basis of the face image, and outputting information based on determining that the person is unsuitable for the iris data acquisition in a case where it is determined that the person is unsuitable for the iris data acquisition.
  • a storage medium stores a program causing a computer to execute: reception processing of receiving a face image; determination processing of determining whether a person in the face image is unsuitable for iris data acquisition on the basis of the face image; and output processing of outputting information based on determining that the person is unsuitable for the iris data acquisition in a case where it is determined that the person is unsuitable for the iris data acquisition.
  • One aspect of the example embodiments is also achieved by the program.
  • FIG. 1 is a block diagram illustrating a configuration of an information providing device according to a first example embodiment.
  • FIG. 2 is a flowchart illustrating a flow of an information providing method according to the first example embodiment.
  • FIG. 3 is a block diagram illustrating a configuration of an iris data acquisition device according to a second example embodiment.
  • FIG. 4 is a flowchart illustrating a flow of processing by the iris data acquisition device according to the second example embodiment.
  • FIG. 5 is a block diagram illustrating an example of hardware included in each unit of each example embodiment.
  • FIG. 1 is a block diagram illustrating a configuration of an information providing device 10 according to the first example embodiment.
  • the information providing device 10 includes a reception unit 101 , a determination unit 102 , and an output unit 103 .
  • the reception unit 101 receives a face image as an input.
  • the face image is an image of a part of or an entire face of a person including at least an eye region.
  • the determination unit 102 determines whether the person in the face image is unsuitable for iris data acquisition on the basis of the face image received by the reception unit 101 .
  • the iris data indicates data of an iris.
  • the output unit 103 outputs information based on the determination that the person in the face image is unsuitable for the iris data acquisition.
  • the reception unit 101 receives a face image (step S 101 ).
  • the determination unit 102 determines whether a person in the face image is unsuitable for iris data acquisition on the basis of the face image received by the reception unit 101 (step S 102 ).
  • the output unit 103 outputs information based on the determination that the person in the face image is unsuitable for the iris data acquisition (step S 103 ). In a case where it is not determined that the person in the face image is unsuitable for the iris data acquisition, the output unit 103 does not output the image output in a case where it is determined that the person in the face image is unsuitable for the iris data acquisition. Alternatively, the output unit 103 may output information different from the information output in a case where it is determined that the person in the face image is unsuitable for the iris data acquisition.
  • the information providing device 10 it is possible to reduce a wasteful behavior, wasteful processing, or the like that may occur in a scene in which iris data is acquired. This is because, in a case where the person who is unsuitable for the iris data acquisition is in the face image, the determination unit 102 determines that the person is a person who is unsuitable for the iris data acquisition. Then, this is because the output unit 103 outputs the information based on that the person is a person who is unsuitable for the iris data acquisition.
  • the device or the person for receiving the information performs processing, a behavior, or determination based on that a person who is unsuitable for the iris data acquisition attempts to make the device acquire the iris data in such a way that it is possible to stop or prevent the attempt of the person to make the device acquire the iris data.
  • the information providing device 10 is an iris data acquisition device 11 illustrated in FIG. 3 .
  • the iris data acquisition device 11 is a device that acquires iris data.
  • the iris data acquisition device 11 determines whether a person is unsuitable for the iris data acquisition in a process of processing of imaging and recording an iris from the person.
  • the iris data acquisition device 11 is communicatively connected to an iris database 21 .
  • the iris database 21 is a database that stores the iris data.
  • the iris database 21 stores information used to identify an individual and data of an iris of the individual in a form in which the information and the iris data are associated with each other.
  • the information used to identify the individual may include, for example, a name, a date of birth, an attribute (gender, age, official position, or the like), a unique Identifier (ID) assigned to each person.
  • the iris data is, for example, an iris code (to be described later).
  • the iris data acquisition device 11 includes a control unit 111 , an imaging unit 112 , an iris data acquisition unit 113 , a success determination unit 114 , a suitability determination unit 115 , a generation unit 116 , an output unit 117 , an input interface 118 , and a memory 119 .
  • the input interface 118 receives inputs of various commands from outside (for example, user of iris data acquisition device 11 ).
  • the input interface 118 is, for example, a touch panel, a touch pad, a keyboard, and/or a port that receives a signal from an input device (mouse, keyboard, or the like), or the like.
  • the memory 119 temporarily or non-temporarily stores data handled by the iris data acquisition device 11 .
  • the memory 119 may be achieved, for example, by a Random Access Memory (RAM), a hard disk, a portable storage device, or the like. With respect to the memory 119 , other components included in the iris data acquisition device 11 can freely read and write data.
  • RAM Random Access Memory
  • other components included in the iris data acquisition device 11 can freely read and write data.
  • the control unit 111 controls operations of the components included in the iris data acquisition device 11 .
  • the control unit 111 controls a flow of the data handled by the iris data acquisition device 11 .
  • the control unit 111 may receive an image generated by the imaging unit 112 and record the received image in the memory 119 .
  • the imaging unit 112 generates an image including an iris by imaging the iris.
  • the imaging unit 112 is, for example, a camera.
  • the imaging unit 112 may be a visible light camera or an infrared camera.
  • the imaging unit 112 performs imaging, for example, in response to an imaging instruction issued from the control unit 111 .
  • the imaging instruction is issued, for example, on the basis of a command that is input by a person to be imaged by the imaging unit 112 (that is, subject whose iris data is to be acquired) to the iris data acquisition device 11 .
  • the subject In order to cause the iris data acquisition device 11 to acquire the data of the iris of the subject, the subject is positioned in front of the imaging unit 112 and inputs the command to the iris data acquisition device 11 via the input interface 118 . Therefore, it is assumed that the subject be imaged in the image generated by the imaging unit 112 .
  • the subject may particularly adjust a direction of the imaging unit 112 or a position of the face of the subject in such a way that the iris of the subject is imaged.
  • the iris data acquisition unit 113 is configured to acquire the data of the iris of the subject included in the image from the image generated by the imaging unit 112 . Specifically, the iris data acquisition unit 113 is configured to generate iris data that can be used for authentication from a pixel value in a region of the iris in the image.
  • Typical iris data that can be used for authentication is data referred to as an iris code.
  • the iris code is data that is obtained by processing image data of the iris region. Because the iris code is biological information peculiar to an individual (so-called biometric information), the iris code is data that can be used for authentication in a case where the iris is appropriately imaged.
  • a method for generating the iris code by the iris data acquisition unit 113 includes, for example, the following steps.
  • the iris data acquisition unit 113 may be configured to generate the iris code by executing the above steps.
  • the success determination unit 114 determines whether the iris data has been successfully acquired by the iris data acquisition unit 113 . Whether the iris data is successfully acquired is, in other words, whether the iris data that can be used for authentication can be acquired.
  • the success determination unit 114 determines that the iris data has been successfully acquired. In a case where it is not possible for the iris data acquisition unit 113 to acquire the iris data that can be used for authentication, the success determination unit 114 determines that the iris data has not been successfully acquired (that is, has failed).
  • a case where it is not possible to acquire the iris data that can be used for authentication is, for example, a case where it is not possible to acquire the iris data itself because it is not possible to specify the position of the iris, an area of the iris displayed in the image is too small, or the like.
  • the success determination unit 114 may determine that the iris data has not been successfully acquired by the iris data acquisition unit 113 .
  • a case where it is not possible to acquire the iris data that can be used for authentication is a case where it is determined that the acquired iris data is unusable for authentication.
  • the success determination unit 114 determines whether the acquired iris data can be used for authentication.
  • the iris data can be used for authentication, that is, specifically, quality of the iris data satisfies a predetermined standard for authentication using the iris data.
  • the quality is evaluation on information represented by the iris data.
  • the predetermined standard is a standard at which the authentication using the iris data can be performed with required accuracy.
  • the predetermined standard is a design matter. However, as an example, the predetermined standard is that “authentication such that a false acceptance rate is equal to or less than 0.001% can be performed using the iris data”.
  • the success determination unit 114 may analyze the feature that appears in the acquired iris data, and determine whether the iris data can be used for authentication on the basis of the analysis.
  • the success determination unit 114 determines that the iris data is successfully acquired. In a case where the iris data acquisition unit 113 cannot normally complete the acquisition of the iris data or in a case where the acquired iris data cannot be used for authentication, the success determination unit 114 determines that the iris data is not successfully acquired.
  • the suitability determination unit 115 determines whether the subject is suitable for the iris data acquisition.
  • a person who is unsuitable for the iris data acquisition is a person who is not expected to acquire the iris data that can be used for authentication, from one point of view.
  • the person who is unsuitable for the iris data acquisition is a person that has a cause that interferes the acquisition of the iris data, from one point of view.
  • the suitability determination unit 115 be configured to detect that the subject has any one of the above-mentioned causes from the face image.
  • the cause detected by the suitability determination unit 115 may be some of the plurality of causes described above.
  • the specific example described above is an example, and the suitability determination unit 115 may be configured to detect a cause other than the above that interferes the acquisition of the iris data.
  • to determine whether the subject is unsuitable for the iris data acquisition is also referred to as “to determine a suitability of the subject”.
  • to determine that the subject is unsuitable for the iris data acquisition is also simply referred to as “to determine that the subject is unsuitable”.
  • the suitability determination unit 115 may determine that the subject is unsuitable, for example, by detecting that the detected eye has a feature of an artificial eye.
  • the feature of the artificial eye may be, for example, a feature indicating that the eye is not a living body.
  • the feature indicating that the eye is not a living body may be that the size of the pupil does not change.
  • the imaging unit 112 may image a moving image including the eye region of the subject in an imaging range.
  • the suitability determination unit 115 may detect a variation in the size of the pupil.
  • a light source such as a Light Emitting Diode (LED) may be attached to the imaging unit 112 .
  • the light source may be configured to emit light under control of the control unit 111 .
  • the control unit 111 may control the light source in such a way that the light source emits visible light to the face of the subject, for example, for a predetermined time period.
  • the suitability determination unit 115 may detect the variation in the size of the pupil in the obtained moving image.
  • the suitability determination unit 115 may determine a possibility that the eyes of the subject are artificial eyes on the basis of the magnitude of the detected variation, a distribution of the variation in the size of the pupil detected in the eye that is not an artificial eye and a distribution of the variation in the size of the pupil detected in the artificial eye. These distributions may be generated through experiments in advance.
  • the suitability determination unit 115 may determine that the eye is not a living body, that is, the eye has the feature of the artificial eye.
  • the feature of the artificial eye may be that a pupil is not detected in a region of an iris.
  • the suitability determination unit 115 may detect a region of the iris and a region of the pupil, for example, by any one of existing methods. Then, in a case where the region of the pupil is not detected in the region of the iris, the suitability determination unit 115 may determine that the imaged eye is an artificial eye. For example, in a case where a human eye is irradiated with near infrared light, reflection light of the near infrared light reflected by the retina is strengthened in a direction toward a light source of the near infrared light.
  • a portion of the pupil is brighter than a portion of the iris in an image obtained by imaging the face of the subject by the imaging unit 112 .
  • the pupil in such a state is referred to as a bright pupil.
  • a method for detecting a pupil using this feature is referred to as a bright pupil method.
  • the portion of the pupil is darker than the portion of the iris in the image obtained by imaging the face of the subject by the imaging unit 112 .
  • the pupil in such as state is referred to as a dark pupil.
  • a method for detecting a pupil using this feature is referred to as a dark pupil method.
  • the suitability determination unit 115 may detect a pupil with a combination or either one of the bright pupil method and the dark pupil method. Then, in a case where the pupil is not detected, the suitability determination unit 115 may determine that the eyes of the subject are artificial eyes.
  • a light source of near infrared light that is connected to the iris data acquisition device 11 may be provided at a position suitable for the method for detecting the pupil.
  • the light source may be configured to emit infrared light, for example, for a predetermined time period while the imaging unit 112 performs imaging, for example, under the control of the control unit 111 .
  • the suitability determination unit 115 may detect the pupil using the obtained image.
  • the suitability determination unit 115 may determine the possibility that the eyes of the subject are artificial eyes, for example, on the basis of a difference in the brightness of the pupil between a state where the near infrared light is not irradiated and a state where the near infrared light is irradiated.
  • the suitability determination unit 115 may determine the possibility that the eyes of the subject are artificial eyes on the basis of a difference between brightness of the bright pupil and brightness of the dark pupil.
  • a distribution of the difference in the brightness of the eyes that are not artificial eyes and a distribution of the difference in the brightness of the eyes that are artificial eyes may be obtained, for example, through experiments in advance.
  • the suitability determination unit 115 may determine that the eye is not a living body, that is, the eye has the feature of the artificial eye.
  • the method for determining the feature of the artificial eye is not limited to the above method.
  • the suitability determination unit 115 may determine that the subject is unsuitable by detecting presence of the colored contact lens and detecting that a range of the colored contact lens narrows a range of the iris.
  • the suitability determination unit 115 may determine the presence of the colored contact lens in the region of the iris and the range of the colored contact lens, for example, by template matching.
  • the suitability determination unit 115 may hold images of iris portions of various colored contact lenses as templates.
  • the suitability determination unit 115 may translate, enlarge, reduce, and rotate the template.
  • the suitability determination unit 115 may determine whether the colored contact lens exists on the basis of a value indicating a magnitude of a difference from the template at the matching place.
  • the pattern of the portion of the iris of the colored contact lens is drawn by repeating patterns and in a case where the pattern of the portion of the iris is represented by halftone dots, the pattern of the portion of the iris has periodicity.
  • the suitability determination unit 115 may detect the region of the iris and determine whether pixel values in the detected region of the iris have the periodicity.
  • the suitability determination unit 115 may determine whether the periodicity exists in the circumferential direction and the radial direction in the region of the iris.
  • the suitability determination unit 115 may convert the image of the region of the iris into a rectangular image, for example, in such a way that the radial direction is set as, for example, the vertical axis, and the circumferential direction is set as, for example, the horizontal axis.
  • the suitability determination unit 115 may determine whether the converted rectangular image periodically changes in the vertical direction and the horizontal direction, for example, using conversion such as Fourier transformation on the converted image.
  • the suitability determination unit 115 may set two axes orthogonal to each other to the image in which the face of the subject is imaged.
  • the suitability determination unit 115 may cut out an image, in the rectangle surrounding the region of the iris, that has sides parallel to the set two axes from the image.
  • the suitability determination unit 115 may determine whether the periodicity exists in the axial direction of the cut image. In a case where it is determined that there is periodicity, the suitability determination unit 115 may determine that the colored contact lens exists. The suitability determination unit 115 may determine whether the colored contact lens exists on the basis of a color of the pixel value in the region of the iris.
  • the suitability determination unit 115 may generate, for example, a distribution of the pixel value of the pixel included in the region of the iris. Then, the suitability determination unit 115 may detect the peaks of the pixel value of which a ratio of the number in the region of the iris is equal to or more than a predetermined ratio. The suitability determination unit 115 may determine sharpness of the detected peak. The sharpness of the peak may be represented, for example, by a half width.
  • the suitability determination unit 115 may determine that the colored contact lens exists in a case where there is a peak sharper than a predetermined standard.
  • the suitability determination unit 115 may further specify the distribution, in the region of the iris, of the pixel having the pixel value that appears in the distribution as the peak sharper than the predetermined standard.
  • the suitability determination unit 115 may determine whether a level of a frequency of such a pixel in an outer peripheral portion of the iris region with respect to a frequency of such a pixel in an inner peripheral portion of the iris region exceeds a predetermined standard.
  • the suitability determination unit 115 may determine that the colored contact lens exists in a case where the level of the frequency of such a pixel in the outer peripheral portion of the iris region with respect to the frequency of such a pixel in the inner peripheral portion of the iris region exceeds the predetermined standard.
  • the method for determining whether the colored contact lens exists is not limited to the above method.
  • the suitability determination unit 115 may determine that the subject is unsuitable.
  • the suitability determination unit 115 may determine that the subject is unsuitable.
  • the iris data acquisition device 11 may inquire whether the subject is imaged in the state where the subject fully opens the eyes by the output unit 117 and receive an input of “Yes” or “No”. In a case where “Yes” is input, because the iris data is not successfully acquired although the subject fully opens the eyes, the suitability determination unit 115 may determine that the subject is unsuitable.
  • the suitability determination unit 115 may detect features of the eyes or features around the eyes that occur in a case where the eyes are fully opened. For example, in a case where it is detected that the eyebrows are raised, the forehead is wrinkled, or the like, the suitability determination unit 115 may estimate that the subject fully opens the eyes.
  • the suitability determination unit 115 may estimate that the iris data that can be used for authentication cannot be acquired even if the subject fully opens the eyes on the basis of the positions and/or the shapes of the eyelids.
  • the suitability determination unit 115 may acquire a moving image of the eye of the subject and analyze the moving image. If the subject opens and closes the eyes in the moving image, a state where the eyelids are raised most is estimated as a state at the time when the subject fully opens the eyes at some extent. The suitability determination unit 115 may estimate the state where the subject fully opens the eyes from the state where the subject fully opens the eyes at some extent.
  • the suitability determination unit 115 may detect that the iris data that can be used for authentication cannot be acquired even if the subject fully opens the eyes by detecting a feature of a person who has characteristics such that most of the iris is constantly hidden by the eyelid (person having symptoms of eyelid droop and person having extremely narrow eyes) on the basis of the shapes of the eyelids in the received image. That is, the suitability determination unit 115 may detect, on the basis of the shapes of the eyelids, that the state of the eyelids that hides most of the irises is not temporary and is caused by the characteristics of the subject.
  • the suitability determination unit 115 may perform learning to prepare a discriminator that distinguishes between a shape of an eyelid when a person who can open the eyes so as not to hide the iris temporarily covers the iris with the eyelid and the shape of the eyelid when a person who has characteristics that most of the iris is obscured by the eyelid and may use the discriminator for the image of the eye of the subject.
  • the suitability determination unit 115 may determine that the subject is unsuitable by detecting an obstacle that obscures a part or all of the region of the iris, that the obstacle is the eyelash, and that a degree to which the eyelashes obscure the region of the iris is unacceptable.
  • the suitability determination unit 115 may detect, for example, that the obstacle is the eyelash on the basis of the shape of the obstacle and the position of the obstacle in the face image.
  • the suitability determination unit 115 may use an area of the eyelashes that covers over the iris portion as a measure of the degree to which the eyelashes obscure the iris region. In a case where the area exceeds a predetermined reference value, the suitability determination unit 115 may determine that the degree to which the eyelashes obscure the iris region is unacceptable.
  • the suitability determination unit 115 may determine a suitability of the subject by analyzing a state of the subject from a plurality of face images that is temporally continuous. For example, the suitability determination unit 115 may detect that the eyes of the subject are slightly shaking. The suitability determination unit 115 may detect that not only the eyes but also the entire face of the subject is slightly shaking or continuously moving. In a case where it is determined that the movement of the subject specified from the plurality of face images is at a level that interferes the acquisition of the iris data, the suitability determination unit 115 may determine that the subject is unsuitable.
  • the suitability determination unit 115 may be configured to execute a part or all of the plurality of determination methods described above.
  • some of the above-described determination methods are methods for detecting that the subject has the feature (or nature) that interferes the acquisition of the iris data.
  • the generation unit 116 generates information to be output by the output unit 117 .
  • the information to be generated is information indicating a result or progress of the processing by the iris data acquisition device 11 .
  • a specific example of the information to be generated will be described in the description of the operation of the iris data acquisition device 11 .
  • the output unit 117 outputs the information generated by the generation unit 116 .
  • An output destination of the output unit 117 is, for example, a display device that has an information display function or an information processing device or the like other than the iris data acquisition device 11 .
  • each processing is executed by a processor that executes a program
  • each processing be executed in an order of instructions in the program.
  • each processing is executed by an individual device
  • each unit that executes processing receive data necessary for each processing, for example, from a unit that generates the data and/or read the data from the memory 119 .
  • the processing by the iris data acquisition device 11 described later may be started in a case where a person who intends to use the iris authentication uses the iris data acquisition device 11 to register iris data of the person in the iris database 21 .
  • the processing by the iris data acquisition device 11 may be started in a case where the person who intends to use the iris authentication uses the iris data acquisition device 11 to execute authentication processing of collating the iris data of the person with iris data registered in the iris database 21 .
  • the person who intends to cause the iris data acquisition device 11 to acquire the iris data of the person is referred to as a “user”.
  • the imaging unit 112 images a face of a user (step S 11 ). For example, it is sufficient that the user stand in front of the imaging unit 112 , input a command to perform imaging to the iris data acquisition device 11 via the input interface 118 , and the control unit 111 send an imaging instruction to the imaging unit 112 in response to the command.
  • the imaging unit 112 performs imaging in such a way that a face image in which the face of the user is imaged is generated.
  • the face image does not necessarily need to include the entire face. It is sufficient that the face image be an image in which a range where the iris exists is imaged.
  • the iris data acquisition unit 113 attempts to acquire iris data from the face image (step S 12 ).
  • the success determination unit 114 determines that the processing in step S 12 , that is, acquisition of the iris data is successfully performed (step S 13 ).
  • the control unit 111 records the acquired iris data as iris data to be used for authentication (step S 14 ).
  • the control unit 111 register the acquired iris data in the iris database 21 .
  • the iris data acquisition device 11 may receive an input of personal identification information of the user via the input interface 118 (may have received in advance) and register a pair of the received personal identification information and the acquired iris data in the iris database 21 .
  • the control unit 111 record the iris data in the memory 119 for collation.
  • the iris data acquisition device 11 may collate the iris data recorded in the memory 119 with the iris data registered in the iris database 21 .
  • step S 14 After the processing in step S 14 , the generation unit 116 generates information indicating that the iris data is successfully acquired, and the output unit 117 outputs the information (step S 15 ).
  • the information indicating that the iris data is successfully acquired may be, for example, a message of “normally registered”.
  • the information indicating that the iris data is successfully acquired may be information indicating whether the collation is successfully performed.
  • the output unit 117 may output the personal identification information of the user specified by the collation as the information indicating that the iris data is successfully acquired.
  • Information indicating that the collation fails may be one piece of the information indicating that the iris data is successfully acquired.
  • the suitability determination unit 115 determines whether the user is suitable for the iris data acquisition (step S 16 ).
  • the generation unit 116 In a case where it is determined that the user is unsuitable for the iris data acquisition (YES in step S 17 ), the generation unit 116 generates output information on the basis of that the user is unsuitable for the iris data acquisition (step S 18 ). Then, the output unit 117 outputs the output information (step S 19 ).
  • the output information is information output because the user is unsuitable for the iris data acquisition, and is different from the information output in step S 15 and information to be output in step S 21 described later.
  • the output information may be, for example, information including a message to the user.
  • Content of the message is, for example, a message indicating that an effort to cause the iris data acquisition device 11 to acquire the iris data should be stopped.
  • Specific examples of the messages are “You are unsuitable for the iris data acquisition”, “Undoubtedly, it is difficult to acquire the iris data from you”, “Please stop acquisition of the iris data”, or the like.
  • the output information may be information including a message indicating that the user cannot perform a behavior to acquire the iris data anymore, for example, “The staff will be right with you. Please follow the staff's instructions”, “It is difficult to acquire the iris data. The acquisition processing is terminated”, or the like.
  • the output unit 117 output the output information to a display device that can be visually recognized by the user.
  • the output information may be, for example, information including a message that indicates that the person who is unsuitable for the iris data acquisition uses the iris data acquisition device 11 to a person other than the user.
  • An example of the message is “Current user is unsuitable for the iris data acquisition. Please take care of the person” or the like.
  • the output unit 117 output (transmit) the output information to a terminal used by the person.
  • the output information does not need to include a message.
  • the output information may be a signal that lights a light emitter. If the light emitter is positioned at a position that can be visually recognized by a user or a staff, the user or the staff may understand that the user is unsuitable for the iris data acquisition on the basis of the lighting of the light emitter.
  • the output information may be a signal that sounds a buzzer, an image from which occurrence of an error can be sensed, a signal that causes an information processing device connected to the iris data acquisition device 11 to execute specific processing, or the like.
  • the iris data acquisition device 11 starts or ends the specific processing on the basis of that the user is unsuitable for the iris data acquisition
  • information indicating that the iris data acquisition device 11 has started the specific processing and information indicating that the iris data acquisition device 11 ends the specific processing can be assumed as the output information.
  • step S 17 In a case where the determination result in step S 17 is YES, the acquisition of the iris data is not attempted again, and the control unit 111 terminates the processing.
  • control unit 111 may continue the attempt to acquire the iris data.
  • the procedure returns to step S 11 , and the iris data acquisition device 11 may attempt to acquire the iris data again.
  • the generation unit 116 In a case where the attempt to acquire the iris data is not continued (NO in step S 20 ), the generation unit 116 generates information indicating that the acquisition of the iris data fails, and the output unit 117 outputs the information.
  • the information indicating that the acquisition of the iris data fails is, for example, information including a message of “Failed to acquire the iris data”.
  • the information indicating that the acquisition of the iris data fails is designed to be different from the output information output in step S 19 .
  • control unit 111 may determine not to continue the attempt to acquire the iris data.
  • the determination in step S 20 may be made on the basis of determination by the user.
  • the iris data acquisition device 11 may execute the processing in step S 21 before the determination in step S 20 , display a message for inquiring “whether to attempt to acquire the iris data again” to the user, and receive a determination result of the user. In a case of receiving an input indicating that the user has determined to “attempt to acquire the iris data again”, it is sufficient that the control unit 111 determine to continue the attempt to acquire the iris data.
  • the face may be automatically imaged after it is determined as YES in step S 20 (without waiting for imaging instruction of user).
  • the face may be imaged after it is determined as YES in step S 20 in response to the reception of the imaging instruction from the user again.
  • the determination in step S 16 may be made with different criteria for the same user between the first processing and the second and subsequent processing. That is, the criterion of the determination in step S 16 may be designed to be different according to the number of times when step S 12 or S 16 is executed by the same user.
  • the output unit 117 may output a message to the user before the processing in step S 11 . It is sufficient that this message be generated by the generation unit 116 .
  • the message may have the same content as the message displayed in step S 21 .
  • This message may be a message indicating advice to acquire more appropriate iris data such as “Please open your eyes” or “Your hair may cover your eyes. Please remove your hair”.
  • the generation unit 116 may generate such a message indicating the advice on the basis of a part of the result of the processing executed by the suitability determination unit 115 .
  • the suitability determination unit 115 may determine that the user is unsuitable for the iris data acquisition in step S 16 . Such a configuration detects that there is a high possibility that the iris data is not successfully acquired even if the user is repeatedly imaged, and contributes to stop further attempts to acquire the iris data by the user.
  • the suitability determination unit 115 may determine that the user is unsuitable for the iris data acquisition in step S 16 . Such a configuration detects that there is a high possibility that the user does not make improvement efforts or the improvement efforts of the user are not rewarded, and contributes to stop further attempts to acquire the iris data by the user.
  • the above-described predetermined value may be differently set according to a type, a degree, or the like of the failure of the acquisition of the iris data. For example, in a case where it is determined that the obstacle obscures a part of the iris in step S 13 , the predetermined value may be set to “4”, and in a case where it is determined that the position of the iris cannot be specified in step S 13 , the predetermined value may be set to “2”.
  • the success determination unit 114 may be configured to record the type and the degree of the failure in the memory 119 in step S 13 .
  • the degree of the failure is a measure of seriousness of the cause that has contributed the failure, and for example, is a degree of separation from an index for successful acquisition of iris data.
  • the degree of the failure may be expressed by a value obtained by subtracting the area of the iris region that is visible in the image from a standard value (may be set on the basis of standard normal iris data).
  • Another example of the information indicating the degree of the failure is, for example, a value indicating a possibility that eyes are artificial eyes, a value indicating an amount of an obstacle (eyelashes) that covers an iris, an evaluation value indicating a blurriness of an image, or the like.
  • the suitability determination unit 115 may calculate the degree of the failure, for the failure to be determined in step S 13 , on the basis of the data used in the determination in step S 13 . In a case where a score according to the degree of the failure determined in step S 13 is cumulatively added and the accumulated value exceeds a predetermined value, the suitability determination unit 115 may determine that the user is unsuitable for the iris data acquisition. For example, in a case where the iris region is not sufficient in step S 13 , the success determination unit 114 makes the memory 119 store a value obtained by subtracting the area of the iris region that is visible in the image from the standard value as a score.
  • the success determination unit 114 accumulates the score each time when it is determined that the iris region is not sufficient in step S 13 .
  • the suitability determination unit 115 may determine that the user is unsuitable for the iris data acquisition.
  • the score is set to be higher as the degree of the failure increases in a form in which the accumulated value is compared with the predetermined value as described above.
  • a uniform score may be set for a specific type of failure.
  • a uniform score may be set for each type of failure.
  • the suitability determination unit 115 may make the determination in step S 16 on the basis of the comparison between a degree of a recent failure and a degree of a previous failure. For example, in a case where the degree of the failure does not change even though the imaging is performed again, it can be said there is no possibility that the acquisition is successfully performed. Therefore, the success determination unit 114 may, for example, record the degree of the failure determined in step S 13 in the memory 119 . Then, for example, in a case where the degree of the recent failure is compared with the degree of the previous failure and a difference is less (smaller) than a reference in step S 16 , the suitability determination unit 115 may determine that the user is unsuitable for the iris data acquisition.
  • the iris data acquisition device 11 According to the iris data acquisition device 11 according to the second example embodiment, it is possible to reduce a wasteful behavior, wasteful processing, or the like that may occur in a scene in which the iris data is acquired.
  • the reason is the same as the reason described in the description of the first example embodiment.
  • the user determines whether the user is suitable for the iris data acquisition before the iris data acquired from the user is recorded.
  • the iris data acquisition device 11 is used at the time when the iris data is registered in the iris database 21 .
  • the user can recognize that the user is unsuitable for the iris data acquisition before the iris data is registered in the iris database 21 .
  • the iris data acquisition device 11 is used at the time of authentication, it is possible to urge the user to perform authentication using another authentication method other than the iris authentication at an early stage.
  • a block illustrating each component of each device is illustrated in functional units.
  • the blocks illustrating the components do not necessarily mean that the components are configured by separate modules.
  • Processing of each component may be achieved, for example, by reading and executing a program that is stored in a computer-readable storage medium and causes a computer system to execute the processing by the computer system.
  • the “computer-readable storage medium” is, for example, a portable medium such as an optical disk, a magnetic disk, a magneto-optical disk, or a nonvolatile semiconductor memory and a storage device such as a Read Only Memory (ROM), a hard disk, or the like built in a computer system.
  • the “computer-readable storage medium” includes a storage medium that can temporarily hold a program such as a volatile memory in the computer system and a storage medium that transmits a program such as a communication line such as a network, a telephone line, or the like.
  • the program may implement a part of the above-described functions or may implement the functions described above by a combination with a program that has been already stored in the computer system.
  • the “computer system” is, for example, a system including a computer 900 as illustrated in FIG. 5 .
  • the computer 900 includes the following components.
  • each component of each device in each example embodiment is implemented by loading the program 904 for implementing the function of the component to the RAM 903 and executing the program 904 by the CPU 901 .
  • the program 904 for implementing the function of each component of each device is, for example, stored in the storage device 905 or the ROM 902 in advance.
  • the CPU 901 reads the program 904 as necessary.
  • the storage device 905 is, for example, a hard disk.
  • the program 904 may be supplied to the CPU 901 via the communication network 909 or may be stored in the storage medium 906 in advance, read by the drive device 907 , and supplied to the CPU 901 .
  • the storage medium 906 is a portable medium, for example, an optical disk, a magnetic disk, a magneto-optical disk, a nonvolatile semiconductor memory, or the like.
  • each device may be implemented by a possible combination of a separate computer 900 and a program for each component.
  • a plurality of components included in each device may be implemented by a possible combination of a single computer 900 and a program.
  • each device may be implemented by another general-purpose or dedicated circuit, a computer, or a combination of these. These may be configured by a single chip or a plurality of chips connected via a bus.
  • the plurality of computers, circuits, or the like may be centrally arranged or dispersedly arranged.
  • the computers, the circuits, or the like may be implemented as a form, in which each of the computers, the circuits, or the like is connected via a communication network, such as a client and server system, a cloud computing system, or the like.
  • An information providing device including:
  • reception means for receiving a face image
  • determination means for determining whether a person in the face image is unsuitable for iris data acquisition based on the face image
  • output means for outputting information based on that it is determined that the person is unsuitable for the iris data acquisition in a case where it is determined that the person is unsuitable for the iris data acquisition.
  • the output means outputs at least one of information indicating that the person is unsuitable for the iris data acquisition and information that urges the person to stop a behavior to acquire the iris data of the person, as the information.
  • the determination means detects, from the face image, that the person has a cause that interferes the acquisition of the iris data and determines that the person is unsuitable for the iris data acquisition in a case where it is detected that the person has the cause that interferes the acquisition of the iris data.
  • the determination means determines that the person is unsuitable for the iris data acquisition by detecting that the person has the cause regarding opening of eyelids based on shapes of the eyelids of the person.
  • the information providing device according to any one of supplementary notes 1 to 4, further including:
  • iris data acquisition means for attempting to acquire the iris data from the face image
  • success determination means for determining whether the iris data acquisition means has acquired the iris data and whether quality of the iris data acquired by the iris data acquisition means is sufficient to be used for authentication, in which
  • the determination means determines whether the person is unsuitable for the iris data acquisition in a case where it is not possible for the iris data acquisition means to acquire the iris data or in a case where the success determination means determines that the quality of the acquired iris data is not sufficient to be used for authentication.
  • the output means outputs a message to the person in a case where it is not determined that the person is unsuitable for the iris data acquisition
  • the iris data acquisition means attempts to acquire iris data from the new face image, and the success determination means makes the determination, and
  • the determination means determines that the person is unsuitable for the iris data acquisition in a case where the number of times when the message is output to the person exceeds a threshold in a case where the iris data having quality sufficient to be used for authentication has never been acquired from the person.
  • the success determination means calculates a seriousness of a cause of that the iris data having the quality sufficient to be used for authentication is not acquired based on information used for the determination and records seriousness information indicating the seriousness in a memory, and
  • the determination means determines whether the person is unsuitable for the iris data acquisition based on a history of the seriousness information.
  • the information providing device according to any one of supplementary notes 1 to 7, further including:
  • imaging means for generating a face image by imaging
  • registration means in a case where the iris data of which quality satisfies a predetermined reference for authentication processing using the iris data is acquired, for registering, in a database, a pair of the acquired iris data and identification information of the person.
  • An information providing method including:
  • At least one of information indicating that the person is unsuitable for the iris data acquisition and information that urges the person to stop a behavior to acquire the iris data of the person is output as the information.
  • the person is unsuitable for the iris data acquisition in a case where the number of times when the message is output to the person exceeds a threshold in a case where the iris data having quality sufficient to be used for authentication has never been acquired from the person.
  • a seriousness of a cause of that the iris data having the quality sufficient to be used for authentication is not acquired is calculated based on information used for the determination, and seriousness information indicating the seriousness is recorded in a memory, and
  • a storage medium that stores a program for causing a computer to execute processing including:
  • the output processing outputs at least one of information indicating that the person is unsuitable for the iris data acquisition and information that urges the person to stop a behavior to acquire the iris data of the person, as the information.
  • the determination processing detects, from the face image, that the person has a cause that interferes the acquisition of the iris data and determines that the person is unsuitable for the iris data acquisition in a case where it is detected that the person has the cause that interferes the acquisition of the iris data.
  • the determination processing determines that the person is unsuitable for the iris data acquisition by detecting that the person has the cause regarding opening of eyelids based on shapes of the eyelids of the person.
  • the storage medium according to any one of supplementary notes 17 to 20, that stores the program for causing the computer to execute processing further including:
  • the determination processing determines whether the person is unsuitable for the iris data acquisition in a case where it is not possible for the iris data acquisition processing to acquire the iris data or in a case where the success determination processing determines that the quality of the acquired iris data is not sufficient to be used for authentication.
  • the output processing outputs a message to the person in a case where it is not determined that the person is unsuitable for the iris data acquisition
  • the iris data acquisition processing attempts to acquire the iris data from the new face image, and the success determination processing makes the determination, and
  • the determination processing determines that the person is unsuitable for the iris data acquisition in a case where the number of times when the message is output to the person exceeds a threshold in a case where the iris data having quality sufficient to be used for authentication has never been acquired from the person.
  • the storage medium in which in a case where the iris data having the quality sufficient to be used for authentication is not acquired, the success determination processing calculates a seriousness of a cause of that the iris data having the quality sufficient to be used for authentication is not acquired based on information used for the determination and records seriousness information indicating the seriousness in a memory, and
  • the determination processing determines whether the person is unsuitable for the iris data acquisition based on a history of the seriousness information.
  • the storage medium according to any one of supplementary notes 17 to 23 that stores the program for causing the computer to execute processing further including:
  • registration processing in a case where the iris data of which quality satisfies a predetermined reference for authentication processing using the iris data is acquired, of registering, in a database, a pair of the acquired iris data and identification information of the person.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Ophthalmology & Optometry (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Collating Specific Patterns (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Quality & Reliability (AREA)
  • Image Analysis (AREA)
  • Image Input (AREA)

Abstract

An information providing device according to one aspect of the present disclosure includes: at least one memory storing a set of instructions; and at least one processor configured to execute the set of instructions to: receive a face image; determine whether a person in the face image is unsuitable for iris data acquisition based on the face image; and output information based on determining that the person is unsuitable for the iris data acquisition when the person is determined to be unsuitable for the iris data acquisition.

Description

  • The present application is a Continuation application of Ser. No. 17/278,381 filed on Mar. 22, 2021, which is a National Stage Entry of PCT/JP2019/036497 filed on Sep. 18, 2019, which claims priority from Japanese Patent Application 2018-181027 filed on Sep. 26, 2018, the contents of all of which are incorporated herein by reference, in their entirety.
  • TECHNICAL FIELD
  • The disclosure relates to a technique for performing authentication using an iris.
  • BACKGROUND ART
  • One type of biological authentication (biometrics authentication) is authentication using an iris.
  • PTL 1 discloses a biometrics authentication device that executes processing including a step for determining a quality of read iris data and a step for executing collation processing using data with high quality. In the step for determining the quality, a control unit detects that a part of the iris data is missing due to an obstacle or the like, the eyes are not sufficiently opened, and the iris is defocused and cannot be confirmed due to a movement of a user when the iris is read, or the like. In a case were the number of times when data with poor quality is acquired or the number of times when collation fails exceeds the predetermined number of times, a failure of the authentication is notified to the user. Then, when the user presses a button, a cause of the failure of the authentication is displayed by a display unit. The technique in PTL 1 attempts to improve a success rate of the authentication of the user through such processing.
  • CITATION LIST Patent Literature
    • [PTL 1] JP 2007-257040 A
    SUMMARY Technical Problem
  • Because the biometrics authentication device described in PTL 1 assumes that the cause of the failure of the authentication be a cause that can be resolved, the cause is notified to the user.
  • However, there is a cause that has a low possibility to be resolved from among the causes that data with high quality cannot be acquired. For example, in a case where the user is a person who is not able to or has difficulty in acquiring data with an appropriate quality, even if the cause is notified to the user, the cause is unlikely to be resolved, and there is a possibility that a success rate of the authentication of the user is not improved.
  • For such a user, even if the device repeatedly attempts to acquire the iris data, the iris data suitable for authentication cannot be acquired. Therefore, the attempt to acquire the iris data goes in vain. A processing time of the device that attempts to acquire the iris data is wasted, and in addition, there is a disadvantage that the user wastes labor and time.
  • One object of the example embodiments is to provide a device, a method, or the like that reduces a wasteful behavior, wasteful processing, or the like that may occur in a scene in which iris data is acquired.
  • Solution to Problem
  • An information providing device according to one aspect of the example embodiments includes: reception means for receiving a face image, determination means for determining whether a person in the face image is unsuitable for iris data acquisition on the basis of the face image; and output means for outputting information based on determining that the person is unsuitable for the iris data acquisition when the person is determined to be unsuitable for the iris data acquisition.
  • An information providing method according to one aspect of the example embodiments includes receiving a face image, determining whether a person in the face image is unsuitable for iris data acquisition on the basis of the face image, and outputting information based on determining that the person is unsuitable for the iris data acquisition in a case where it is determined that the person is unsuitable for the iris data acquisition.
  • A storage medium according to one aspect of the example embodiments stores a program causing a computer to execute: reception processing of receiving a face image; determination processing of determining whether a person in the face image is unsuitable for iris data acquisition on the basis of the face image; and output processing of outputting information based on determining that the person is unsuitable for the iris data acquisition in a case where it is determined that the person is unsuitable for the iris data acquisition. One aspect of the example embodiments is also achieved by the program.
  • Advantageous Effects
  • According to the example embodiments, it is possible to reduce a wasteful behavior, wasteful processing, or the like that may occur in a scene in which iris data is acquired.
  • BRIEF DESCRIPTION OF DRAWINGS
  • FIG. 1 is a block diagram illustrating a configuration of an information providing device according to a first example embodiment.
  • FIG. 2 is a flowchart illustrating a flow of an information providing method according to the first example embodiment.
  • FIG. 3 is a block diagram illustrating a configuration of an iris data acquisition device according to a second example embodiment.
  • FIG. 4 is a flowchart illustrating a flow of processing by the iris data acquisition device according to the second example embodiment.
  • FIG. 5 is a block diagram illustrating an example of hardware included in each unit of each example embodiment.
  • EXAMPLE EMBODIMENT
  • Hereinafter, example embodiments will be described in detail with reference to the drawings.
  • First Example Embodiment
  • First, a first example embodiment will be described.
  • FIG. 1 is a block diagram illustrating a configuration of an information providing device 10 according to the first example embodiment.
  • The information providing device 10 includes a reception unit 101, a determination unit 102, and an output unit 103.
  • The reception unit 101 receives a face image as an input. The face image is an image of a part of or an entire face of a person including at least an eye region.
  • The determination unit 102 determines whether the person in the face image is unsuitable for iris data acquisition on the basis of the face image received by the reception unit 101. The iris data indicates data of an iris.
  • In a case where it is determined that the person in the face image is unsuitable for the acquiring the iris data, the output unit 103 outputs information based on the determination that the person in the face image is unsuitable for the iris data acquisition.
  • A flow of an operation of the information providing device 10 will be described with reference to the flowchart in FIG. 2. First, the reception unit 101 receives a face image (step S101).
  • Next, the determination unit 102 determines whether a person in the face image is unsuitable for iris data acquisition on the basis of the face image received by the reception unit 101 (step S102).
  • Then, in a case where it is determined that the person in the face image is unsuitable for the iris data acquisition, the output unit 103 outputs information based on the determination that the person in the face image is unsuitable for the iris data acquisition (step S103). In a case where it is not determined that the person in the face image is unsuitable for the iris data acquisition, the output unit 103 does not output the image output in a case where it is determined that the person in the face image is unsuitable for the iris data acquisition. Alternatively, the output unit 103 may output information different from the information output in a case where it is determined that the person in the face image is unsuitable for the iris data acquisition.
  • According to the information providing device 10, it is possible to reduce a wasteful behavior, wasteful processing, or the like that may occur in a scene in which iris data is acquired. This is because, in a case where the person who is unsuitable for the iris data acquisition is in the face image, the determination unit 102 determines that the person is a person who is unsuitable for the iris data acquisition. Then, this is because the output unit 103 outputs the information based on that the person is a person who is unsuitable for the iris data acquisition. According to the information output from the output unit 103, the device or the person for receiving the information performs processing, a behavior, or determination based on that a person who is unsuitable for the iris data acquisition attempts to make the device acquire the iris data in such a way that it is possible to stop or prevent the attempt of the person to make the device acquire the iris data.
  • Second Example Embodiment
  • Hereinafter, a specific example of the first example embodiment will be described.
  • One of specific examples of the information providing device 10 is an iris data acquisition device 11 illustrated in FIG. 3. The iris data acquisition device 11 is a device that acquires iris data. The iris data acquisition device 11 determines whether a person is unsuitable for the iris data acquisition in a process of processing of imaging and recording an iris from the person.
  • As illustrated in FIG. 3, the iris data acquisition device 11 is communicatively connected to an iris database 21. The iris database 21 is a database that stores the iris data.
  • The iris database 21 stores information used to identify an individual and data of an iris of the individual in a form in which the information and the iris data are associated with each other.
  • The information used to identify the individual may include, for example, a name, a date of birth, an attribute (gender, age, official position, or the like), a unique Identifier (ID) assigned to each person.
  • The iris data is, for example, an iris code (to be described later).
  • <Configuration>
  • Hereinafter, components of the iris data acquisition device 11 will be described.
  • As illustrated in FIG. 3, the iris data acquisition device 11 includes a control unit 111, an imaging unit 112, an iris data acquisition unit 113, a success determination unit 114, a suitability determination unit 115, a generation unit 116, an output unit 117, an input interface 118, and a memory 119.
  • ===Input Interface 118===
  • The input interface 118 receives inputs of various commands from outside (for example, user of iris data acquisition device 11). The input interface 118 is, for example, a touch panel, a touch pad, a keyboard, and/or a port that receives a signal from an input device (mouse, keyboard, or the like), or the like.
  • ===Memory 119===
  • The memory 119 temporarily or non-temporarily stores data handled by the iris data acquisition device 11. The memory 119 may be achieved, for example, by a Random Access Memory (RAM), a hard disk, a portable storage device, or the like. With respect to the memory 119, other components included in the iris data acquisition device 11 can freely read and write data.
  • ===Control Unit 111===
  • The control unit 111 controls operations of the components included in the iris data acquisition device 11.
  • The control unit 111 controls a flow of the data handled by the iris data acquisition device 11. For example, the control unit 111 may receive an image generated by the imaging unit 112 and record the received image in the memory 119.
  • ===Imaging Unit 112===
  • The imaging unit 112 generates an image including an iris by imaging the iris. The imaging unit 112 is, for example, a camera. The imaging unit 112 may be a visible light camera or an infrared camera. The imaging unit 112 performs imaging, for example, in response to an imaging instruction issued from the control unit 111. The imaging instruction is issued, for example, on the basis of a command that is input by a person to be imaged by the imaging unit 112 (that is, subject whose iris data is to be acquired) to the iris data acquisition device 11. In order to cause the iris data acquisition device 11 to acquire the data of the iris of the subject, the subject is positioned in front of the imaging unit 112 and inputs the command to the iris data acquisition device 11 via the input interface 118. Therefore, it is assumed that the subject be imaged in the image generated by the imaging unit 112. The subject may particularly adjust a direction of the imaging unit 112 or a position of the face of the subject in such a way that the iris of the subject is imaged.
  • ===Iris Data Acquisition Unit 113===
  • The iris data acquisition unit 113 is configured to acquire the data of the iris of the subject included in the image from the image generated by the imaging unit 112. Specifically, the iris data acquisition unit 113 is configured to generate iris data that can be used for authentication from a pixel value in a region of the iris in the image.
  • Typical iris data that can be used for authentication is data referred to as an iris code. The iris code is data that is obtained by processing image data of the iris region. Because the iris code is biological information peculiar to an individual (so-called biometric information), the iris code is data that can be used for authentication in a case where the iris is appropriately imaged.
  • A method for generating the iris code by the iris data acquisition unit 113 includes, for example, the following steps.
      • Step for detecting an eye region from an image
      • Step for detecting an edge of an upper eyelid, an edge of a lower eyelid, a boundary between a pupil and an iris, and a boundary between an iris and a white eye (also referred to as sclera) in the eye region
      • Step for developing a pattern in a region in which the iris is imaged in a band-like shape
      • Step for encoding the developed pattern
  • The iris data acquisition unit 113 may be configured to generate the iris code by executing the above steps.
  • ===Success Determination Unit 114===
  • The success determination unit 114 determines whether the iris data has been successfully acquired by the iris data acquisition unit 113. Whether the iris data is successfully acquired is, in other words, whether the iris data that can be used for authentication can be acquired.
  • In a case where the iris data that can be used for authentication can be acquired by the iris data acquisition unit 113, the success determination unit 114 determines that the iris data has been successfully acquired. In a case where it is not possible for the iris data acquisition unit 113 to acquire the iris data that can be used for authentication, the success determination unit 114 determines that the iris data has not been successfully acquired (that is, has failed).
  • A case where it is not possible to acquire the iris data that can be used for authentication is, for example, a case where it is not possible to acquire the iris data itself because it is not possible to specify the position of the iris, an area of the iris displayed in the image is too small, or the like. In a case where an error occurs in any one of the processing in the steps executed by the iris data acquisition unit 113 described above and the acquisition of the iris data is not normally completed, the success determination unit 114 may determine that the iris data has not been successfully acquired by the iris data acquisition unit 113.
  • In addition, a case where it is not possible to acquire the iris data that can be used for authentication is a case where it is determined that the acquired iris data is unusable for authentication.
  • In a case where the acquisition of the iris data by the iris data acquisition unit 113 has been normally completed, the success determination unit 114 determines whether the acquired iris data can be used for authentication.
  • The iris data can be used for authentication, that is, specifically, quality of the iris data satisfies a predetermined standard for authentication using the iris data. The quality is evaluation on information represented by the iris data. The predetermined standard is a standard at which the authentication using the iris data can be performed with required accuracy. The predetermined standard is a design matter. However, as an example, the predetermined standard is that “authentication such that a false acceptance rate is equal to or less than 0.001% can be performed using the iris data”.
  • For example, in a case where a feature specific for an individual does not sufficiently appear in the acquired iris data, it cannot be said that the iris data can be used for authentication. In a case where the acquired iris data has an unnatural feature as the feature of the iris, it cannot be said that the iris data can be used for authentication. Therefore, the success determination unit 114 may analyze the feature that appears in the acquired iris data, and determine whether the iris data can be used for authentication on the basis of the analysis.
  • In a case where the acquisition of the iris data is normally completed and the acquired iris data can be used for authentication, the success determination unit 114 determines that the iris data is successfully acquired. In a case where the iris data acquisition unit 113 cannot normally complete the acquisition of the iris data or in a case where the acquired iris data cannot be used for authentication, the success determination unit 114 determines that the iris data is not successfully acquired.
  • ===Suitability Determination Unit 115===
  • The suitability determination unit 115 determines whether the subject is suitable for the iris data acquisition.
  • A person who is unsuitable for the iris data acquisition is a person who is not expected to acquire the iris data that can be used for authentication, from one point of view. The person who is unsuitable for the iris data acquisition is a person that has a cause that interferes the acquisition of the iris data, from one point of view.
  • Specific examples of the cause that interfere the acquisition of the iris data will be given.
      • The eye is an artificial eye
      • A colored contact lens is worn that obscures a part of or an entire iris in such a way that the feature of the iris cannot be sufficiently extracted
      • Most part of the iris is obscured by the eyelid due to symptoms of eyelid droop
      • Most part of the iris is obscured because an eyelid opening degree is extremely small (that is, slit eye)
      • The degree to which the iris is obscured by the eyelashes is unacceptable
      • It is not possible to obtain iris data with sufficient clarity due to movements such as tremors
  • It is sufficient that the suitability determination unit 115 be configured to detect that the subject has any one of the above-mentioned causes from the face image. However, when the suitability determination unit 115 is configured, the cause detected by the suitability determination unit 115 may be some of the plurality of causes described above. The specific example described above is an example, and the suitability determination unit 115 may be configured to detect a cause other than the above that interferes the acquisition of the iris data.
  • Hereinafter, to determine whether the subject is unsuitable for the iris data acquisition is also referred to as “to determine a suitability of the subject”. In the following, to determine that the subject is unsuitable for the iris data acquisition is also simply referred to as “to determine that the subject is unsuitable”.
  • The suitability determination unit 115 may determine that the subject is unsuitable, for example, by detecting that the detected eye has a feature of an artificial eye.
  • The feature of the artificial eye may be, for example, a feature indicating that the eye is not a living body. The feature indicating that the eye is not a living body may be that the size of the pupil does not change. In this case, the imaging unit 112 may image a moving image including the eye region of the subject in an imaging range. Then, the suitability determination unit 115 may detect a variation in the size of the pupil. For example, a light source such as a Light Emitting Diode (LED) may be attached to the imaging unit 112. For example, the light source may be configured to emit light under control of the control unit 111. While the imaging unit 112 images a moving image, the control unit 111 may control the light source in such a way that the light source emits visible light to the face of the subject, for example, for a predetermined time period. The suitability determination unit 115 may detect the variation in the size of the pupil in the obtained moving image. The suitability determination unit 115 may determine a possibility that the eyes of the subject are artificial eyes on the basis of the magnitude of the detected variation, a distribution of the variation in the size of the pupil detected in the eye that is not an artificial eye and a distribution of the variation in the size of the pupil detected in the artificial eye. These distributions may be generated through experiments in advance. In a case where the possibility that the eyes of the subject are artificial eyes is lower than a predetermined standard, the suitability determination unit 115 may determine that the eye is not a living body, that is, the eye has the feature of the artificial eye.
  • The feature of the artificial eye may be that a pupil is not detected in a region of an iris. The suitability determination unit 115 may detect a region of the iris and a region of the pupil, for example, by any one of existing methods. Then, in a case where the region of the pupil is not detected in the region of the iris, the suitability determination unit 115 may determine that the imaged eye is an artificial eye. For example, in a case where a human eye is irradiated with near infrared light, reflection light of the near infrared light reflected by the retina is strengthened in a direction toward a light source of the near infrared light. In a case where the face of the subject is irradiated with near infrared light from the direction of the imaging unit 112, a portion of the pupil is brighter than a portion of the iris in an image obtained by imaging the face of the subject by the imaging unit 112. The pupil in such a state is referred to as a bright pupil. A method for detecting a pupil using this feature is referred to as a bright pupil method. In a case where the face of the subject is irradiated with infrared light from a direction different from an optical axis of the imaging unit 112, the portion of the pupil is darker than the portion of the iris in the image obtained by imaging the face of the subject by the imaging unit 112. The pupil in such as state is referred to as a dark pupil. A method for detecting a pupil using this feature is referred to as a dark pupil method. The suitability determination unit 115 may detect a pupil with a combination or either one of the bright pupil method and the dark pupil method. Then, in a case where the pupil is not detected, the suitability determination unit 115 may determine that the eyes of the subject are artificial eyes. In this case, a light source of near infrared light that is connected to the iris data acquisition device 11 may be provided at a position suitable for the method for detecting the pupil. In this case, the light source may be configured to emit infrared light, for example, for a predetermined time period while the imaging unit 112 performs imaging, for example, under the control of the control unit 111. The suitability determination unit 115 may detect the pupil using the obtained image. The suitability determination unit 115 may determine the possibility that the eyes of the subject are artificial eyes, for example, on the basis of a difference in the brightness of the pupil between a state where the near infrared light is not irradiated and a state where the near infrared light is irradiated. The suitability determination unit 115 may determine the possibility that the eyes of the subject are artificial eyes on the basis of a difference between brightness of the bright pupil and brightness of the dark pupil. In these cases, a distribution of the difference in the brightness of the eyes that are not artificial eyes and a distribution of the difference in the brightness of the eyes that are artificial eyes may be obtained, for example, through experiments in advance. In a case where the possibility that the eyes of the subject are artificial eyes is lower than a predetermined standard, the suitability determination unit 115 may determine that the eye is not a living body, that is, the eye has the feature of the artificial eye. The method for determining the feature of the artificial eye is not limited to the above method.
  • For example, the suitability determination unit 115 may determine that the subject is unsuitable by detecting presence of the colored contact lens and detecting that a range of the colored contact lens narrows a range of the iris.
  • The suitability determination unit 115 may determine the presence of the colored contact lens in the region of the iris and the range of the colored contact lens, for example, by template matching. In this case, the suitability determination unit 115 may hold images of iris portions of various colored contact lenses as templates. In this template matching, the suitability determination unit 115 may translate, enlarge, reduce, and rotate the template. In a case where the region of the iris matches the template, the suitability determination unit 115 may determine whether the colored contact lens exists on the basis of a value indicating a magnitude of a difference from the template at the matching place.
  • In a case where the portion of the iris of the colored contact lens is drawn by repeating patterns and in a case where the pattern of the portion of the iris is represented by halftone dots, the pattern of the portion of the iris has periodicity. The suitability determination unit 115 may detect the region of the iris and determine whether pixel values in the detected region of the iris have the periodicity. The suitability determination unit 115 may determine whether the periodicity exists in the circumferential direction and the radial direction in the region of the iris. In this case, the suitability determination unit 115 may convert the image of the region of the iris into a rectangular image, for example, in such a way that the radial direction is set as, for example, the vertical axis, and the circumferential direction is set as, for example, the horizontal axis. The suitability determination unit 115 may determine whether the converted rectangular image periodically changes in the vertical direction and the horizontal direction, for example, using conversion such as Fourier transformation on the converted image. The suitability determination unit 115 may set two axes orthogonal to each other to the image in which the face of the subject is imaged. The suitability determination unit 115 may cut out an image, in the rectangle surrounding the region of the iris, that has sides parallel to the set two axes from the image. The suitability determination unit 115 may determine whether the periodicity exists in the axial direction of the cut image. In a case where it is determined that there is periodicity, the suitability determination unit 115 may determine that the colored contact lens exists. The suitability determination unit 115 may determine whether the colored contact lens exists on the basis of a color of the pixel value in the region of the iris.
  • In a case where the pattern of the iris portion of the colored contact lens is drawn using coloring matters of the limited number (for example, equal to or less than three) of colors, it is considered that a sharp peak occurs in the distribution of the color of the iris portion of the colored contact lens. The suitability determination unit 115 may generate, for example, a distribution of the pixel value of the pixel included in the region of the iris. Then, the suitability determination unit 115 may detect the peaks of the pixel value of which a ratio of the number in the region of the iris is equal to or more than a predetermined ratio. The suitability determination unit 115 may determine sharpness of the detected peak. The sharpness of the peak may be represented, for example, by a half width. The suitability determination unit 115 may determine that the colored contact lens exists in a case where there is a peak sharper than a predetermined standard. The suitability determination unit 115 may further specify the distribution, in the region of the iris, of the pixel having the pixel value that appears in the distribution as the peak sharper than the predetermined standard. The suitability determination unit 115 may determine whether a level of a frequency of such a pixel in an outer peripheral portion of the iris region with respect to a frequency of such a pixel in an inner peripheral portion of the iris region exceeds a predetermined standard. The suitability determination unit 115 may determine that the colored contact lens exists in a case where the level of the frequency of such a pixel in the outer peripheral portion of the iris region with respect to the frequency of such a pixel in the inner peripheral portion of the iris region exceeds the predetermined standard. The method for determining whether the colored contact lens exists is not limited to the above method.
  • In a case where it is estimated that the iris data that can be used for authentication cannot be acquired even if the subject fully opens the eyes, the suitability determination unit 115 may determine that the subject is unsuitable.
  • For example, in a case where it is recognized that the received image is an image of a state where the subject fully opens the eyes in a case where the iris data is not successfully acquired, the suitability determination unit 115 may determine that the subject is unsuitable. To recognize whether the received image is the image of the state where the subject fully opens the eyes, for example, the iris data acquisition device 11 may inquire whether the subject is imaged in the state where the subject fully opens the eyes by the output unit 117 and receive an input of “Yes” or “No”. In a case where “Yes” is input, because the iris data is not successfully acquired although the subject fully opens the eyes, the suitability determination unit 115 may determine that the subject is unsuitable.
  • To recognize whether the received image is the image of the state where the subject fully opens the eyes, the suitability determination unit 115 may detect features of the eyes or features around the eyes that occur in a case where the eyes are fully opened. For example, in a case where it is detected that the eyebrows are raised, the forehead is wrinkled, or the like, the suitability determination unit 115 may estimate that the subject fully opens the eyes.
  • The suitability determination unit 115 may estimate that the iris data that can be used for authentication cannot be acquired even if the subject fully opens the eyes on the basis of the positions and/or the shapes of the eyelids.
  • For example, the suitability determination unit 115 the suitability determination unit 115 may acquire a moving image of the eye of the subject and analyze the moving image. If the subject opens and closes the eyes in the moving image, a state where the eyelids are raised most is estimated as a state at the time when the subject fully opens the eyes at some extent. The suitability determination unit 115 may estimate the state where the subject fully opens the eyes from the state where the subject fully opens the eyes at some extent.
  • Alternatively, the suitability determination unit 115 may detect that the iris data that can be used for authentication cannot be acquired even if the subject fully opens the eyes by detecting a feature of a person who has characteristics such that most of the iris is constantly hidden by the eyelid (person having symptoms of eyelid droop and person having extremely narrow eyes) on the basis of the shapes of the eyelids in the received image. That is, the suitability determination unit 115 may detect, on the basis of the shapes of the eyelids, that the state of the eyelids that hides most of the irises is not temporary and is caused by the characteristics of the subject. For example, the suitability determination unit 115 may perform learning to prepare a discriminator that distinguishes between a shape of an eyelid when a person who can open the eyes so as not to hide the iris temporarily covers the iris with the eyelid and the shape of the eyelid when a person who has characteristics that most of the iris is obscured by the eyelid and may use the discriminator for the image of the eye of the subject.
  • The suitability determination unit 115 may determine that the subject is unsuitable by detecting an obstacle that obscures a part or all of the region of the iris, that the obstacle is the eyelash, and that a degree to which the eyelashes obscure the region of the iris is unacceptable. The suitability determination unit 115 may detect, for example, that the obstacle is the eyelash on the basis of the shape of the obstacle and the position of the obstacle in the face image. The suitability determination unit 115 may use an area of the eyelashes that covers over the iris portion as a measure of the degree to which the eyelashes obscure the iris region. In a case where the area exceeds a predetermined reference value, the suitability determination unit 115 may determine that the degree to which the eyelashes obscure the iris region is unacceptable.
  • The suitability determination unit 115 may determine a suitability of the subject by analyzing a state of the subject from a plurality of face images that is temporally continuous. For example, the suitability determination unit 115 may detect that the eyes of the subject are slightly shaking. The suitability determination unit 115 may detect that not only the eyes but also the entire face of the subject is slightly shaking or continuously moving. In a case where it is determined that the movement of the subject specified from the plurality of face images is at a level that interferes the acquisition of the iris data, the suitability determination unit 115 may determine that the subject is unsuitable.
  • The suitability determination unit 115 may be configured to execute a part or all of the plurality of determination methods described above.
  • It can be said that some of the above-described determination methods are methods for detecting that the subject has the feature (or nature) that interferes the acquisition of the iris data.
  • As the person who is determined by the suitability determination unit 115 to be unsuitable for the iris data acquisition, persons other than the person described above can be exemplified. The person other than the person described above who is determined to be unsuitable for the iris data acquisition will be described in “Note” field.
  • ===Generation Unit 116===
  • The generation unit 116 generates information to be output by the output unit 117. The information to be generated is information indicating a result or progress of the processing by the iris data acquisition device 11. A specific example of the information to be generated will be described in the description of the operation of the iris data acquisition device 11.
  • ===Output Unit 117===
  • The output unit 117 outputs the information generated by the generation unit 116.
  • An output destination of the output unit 117 is, for example, a display device that has an information display function or an information processing device or the like other than the iris data acquisition device 11.
  • <Operation>
  • Hereinafter, a flow of the processing by the iris data acquisition device 11 will be described with reference to the flowchart in FIG. 4. In a case where each processing is executed by a processor that executes a program, it is sufficient that each processing be executed in an order of instructions in the program. In a case where each processing is executed by an individual device, it is sufficient that the processing be executed in order by issuing a notification by a device that has completed the processing to a device that executes next processing or by recognizing the end of each processing and instructing to start each processing by the control unit 111. It is sufficient that each unit that executes processing receive data necessary for each processing, for example, from a unit that generates the data and/or read the data from the memory 119.
  • The processing by the iris data acquisition device 11 described later may be started in a case where a person who intends to use the iris authentication uses the iris data acquisition device 11 to register iris data of the person in the iris database 21. The processing by the iris data acquisition device 11 may be started in a case where the person who intends to use the iris authentication uses the iris data acquisition device 11 to execute authentication processing of collating the iris data of the person with iris data registered in the iris database 21. Hereinafter, the person who intends to cause the iris data acquisition device 11 to acquire the iris data of the person is referred to as a “user”.
  • First, the imaging unit 112 images a face of a user (step S11). For example, it is sufficient that the user stand in front of the imaging unit 112, input a command to perform imaging to the iris data acquisition device 11 via the input interface 118, and the control unit 111 send an imaging instruction to the imaging unit 112 in response to the command.
  • The imaging unit 112 performs imaging in such a way that a face image in which the face of the user is imaged is generated. However, the face image does not necessarily need to include the entire face. It is sufficient that the face image be an image in which a range where the iris exists is imaged.
  • When the face image is generated, the iris data acquisition unit 113 attempts to acquire iris data from the face image (step S12).
  • Next, the success determination unit 114 determines that the processing in step S12, that is, acquisition of the iris data is successfully performed (step S13).
  • In a case where it is determined that the iris data is successfully acquired (YES in step S13), the control unit 111 records the acquired iris data as iris data to be used for authentication (step S14). In a case where the iris data is acquired to register the iris data, it is sufficient that the control unit 111 register the acquired iris data in the iris database 21. In this case, the iris data acquisition device 11 may receive an input of personal identification information of the user via the input interface 118 (may have received in advance) and register a pair of the received personal identification information and the acquired iris data in the iris database 21. In a case where the iris data is acquired for collation with the iris data registered in the iris database 21, it is sufficient that the control unit 111 record the iris data in the memory 119 for collation. In this case, the iris data acquisition device 11 may collate the iris data recorded in the memory 119 with the iris data registered in the iris database 21.
  • After the processing in step S14, the generation unit 116 generates information indicating that the iris data is successfully acquired, and the output unit 117 outputs the information (step S15).
  • In a case where the iris data is acquired to register the iris data, the information indicating that the iris data is successfully acquired may be, for example, a message of “normally registered”. In a case where the iris data is acquired for the collation with the iris data registered in the iris database 21, the information indicating that the iris data is successfully acquired may be information indicating whether the collation is successfully performed. In particular, in a case where the collation is successfully performed (that is, in a case where iris data that matches acquired iris data is found in iris database 21), the output unit 117 may output the personal identification information of the user specified by the collation as the information indicating that the iris data is successfully acquired. Information indicating that the collation fails (for example, message of “does not match data registered in database”, or the like) may be one piece of the information indicating that the iris data is successfully acquired.
  • In a case where it is determined that the iris data is not successfully acquired (NO in step S13), the suitability determination unit 115 determines whether the user is suitable for the iris data acquisition (step S16).
  • In a case where it is determined that the user is unsuitable for the iris data acquisition (YES in step S17), the generation unit 116 generates output information on the basis of that the user is unsuitable for the iris data acquisition (step S18). Then, the output unit 117 outputs the output information (step S19). The output information is information output because the user is unsuitable for the iris data acquisition, and is different from the information output in step S15 and information to be output in step S21 described later.
  • The output information may be, for example, information including a message to the user.
  • Content of the message is, for example, a message indicating that an effort to cause the iris data acquisition device 11 to acquire the iris data should be stopped. Specific examples of the messages are “You are unsuitable for the iris data acquisition”, “Unfortunately, it is difficult to acquire the iris data from you”, “Please stop acquisition of the iris data”, or the like.
  • The output information may be information including a message indicating that the user cannot perform a behavior to acquire the iris data anymore, for example, “The staff will be right with you. Please follow the staff's instructions”, “It is difficult to acquire the iris data. The acquisition processing is terminated”, or the like.
  • In a case where the output information is the information including the message to the user, it is sufficient that the output unit 117 output the output information to a display device that can be visually recognized by the user.
  • The output information may be, for example, information including a message that indicates that the person who is unsuitable for the iris data acquisition uses the iris data acquisition device 11 to a person other than the user. An example of the message is “Current user is unsuitable for the iris data acquisition. Please take care of the person” or the like.
  • In a case where the output information is the information including the message to the person other than the user, it is sufficient that the output unit 117 output (transmit) the output information to a terminal used by the person.
  • The output information does not need to include a message. For example, the output information may be a signal that lights a light emitter. If the light emitter is positioned at a position that can be visually recognized by a user or a staff, the user or the staff may understand that the user is unsuitable for the iris data acquisition on the basis of the lighting of the light emitter. In addition, the output information may be a signal that sounds a buzzer, an image from which occurrence of an error can be sensed, a signal that causes an information processing device connected to the iris data acquisition device 11 to execute specific processing, or the like.
  • In a case where the iris data acquisition device 11 starts or ends the specific processing on the basis of that the user is unsuitable for the iris data acquisition, information indicating that the iris data acquisition device 11 has started the specific processing and information indicating that the iris data acquisition device 11 ends the specific processing can be assumed as the output information.
  • In a case where the determination result in step S17 is YES, the acquisition of the iris data is not attempted again, and the control unit 111 terminates the processing.
  • In a case where it is not determined that the user is unsuitable for the iris data acquisition (NO in step S17), the control unit 111 may continue the attempt to acquire the iris data. In a case where the attempt to acquire the iris data is continued (YES in step S20), the procedure returns to step S11, and the iris data acquisition device 11 may attempt to acquire the iris data again.
  • In a case where the attempt to acquire the iris data is not continued (NO in step S20), the generation unit 116 generates information indicating that the acquisition of the iris data fails, and the output unit 117 outputs the information.
  • The information indicating that the acquisition of the iris data fails is, for example, information including a message of “Failed to acquire the iris data”. The information indicating that the acquisition of the iris data fails is designed to be different from the output information output in step S19.
  • For example, in a case where a predetermined period of time has elapsed from the start of the processing in step S11, in a case where the number of times when it is determined as NO in step S13 reaches a predetermined number of times, or the like, the control unit 111 may determine not to continue the attempt to acquire the iris data.
  • Alternatively, the determination in step S20 may be made on the basis of determination by the user. The iris data acquisition device 11 may execute the processing in step S21 before the determination in step S20, display a message for inquiring “whether to attempt to acquire the iris data again” to the user, and receive a determination result of the user. In a case of receiving an input indicating that the user has determined to “attempt to acquire the iris data again”, it is sufficient that the control unit 111 determine to continue the attempt to acquire the iris data.
  • The face may be automatically imaged after it is determined as YES in step S20 (without waiting for imaging instruction of user). The face may be imaged after it is determined as YES in step S20 in response to the reception of the imaging instruction from the user again.
  • The determination in step S16 may be made with different criteria for the same user between the first processing and the second and subsequent processing. That is, the criterion of the determination in step S16 may be designed to be different according to the number of times when step S12 or S16 is executed by the same user.
  • In a case where it is determined as YES in step S20, the output unit 117 may output a message to the user before the processing in step S11. It is sufficient that this message be generated by the generation unit 116. The message may have the same content as the message displayed in step S21. This message may be a message indicating advice to acquire more appropriate iris data such as “Please open your eyes” or “Your hair may cover your eyes. Please remove your hair”. The generation unit 116 may generate such a message indicating the advice on the basis of a part of the result of the processing executed by the suitability determination unit 115.
  • [Note] More examples of the criteria of the determination in step S16 by the suitability determination unit 115.
  • Some examples of the criteria of the determination in step S16 by the suitability determination unit 115 have been already described. However, more examples will be described below.
  • In a case where the number of times of reception of the imaging instruction from the same user in a state where the iris data is not successfully acquired exceeds a predetermined value, the suitability determination unit 115 may determine that the user is unsuitable for the iris data acquisition in step S16. Such a configuration detects that there is a high possibility that the iris data is not successfully acquired even if the user is repeatedly imaged, and contributes to stop further attempts to acquire the iris data by the user.
  • In a case where the number of times when the message indicating the advice is output to the same user in a state where the iris data is not successfully acquired exceeds a predetermined value, the suitability determination unit 115 may determine that the user is unsuitable for the iris data acquisition in step S16. Such a configuration detects that there is a high possibility that the user does not make improvement efforts or the improvement efforts of the user are not rewarded, and contributes to stop further attempts to acquire the iris data by the user.
  • The above-described predetermined value may be differently set according to a type, a degree, or the like of the failure of the acquisition of the iris data. For example, in a case where it is determined that the obstacle obscures a part of the iris in step S13, the predetermined value may be set to “4”, and in a case where it is determined that the position of the iris cannot be specified in step S13, the predetermined value may be set to “2”. For such determination, the success determination unit 114 may be configured to record the type and the degree of the failure in the memory 119 in step S13.
  • The degree of the failure is a measure of seriousness of the cause that has contributed the failure, and for example, is a degree of separation from an index for successful acquisition of iris data. For example, if the type of the failure is that an area of an iris that is visible in an image is small, the degree of the failure may be expressed by a value obtained by subtracting the area of the iris region that is visible in the image from a standard value (may be set on the basis of standard normal iris data). Another example of the information indicating the degree of the failure is, for example, a value indicating a possibility that eyes are artificial eyes, a value indicating an amount of an obstacle (eyelashes) that covers an iris, an evaluation value indicating a blurriness of an image, or the like.
  • The suitability determination unit 115 may calculate the degree of the failure, for the failure to be determined in step S13, on the basis of the data used in the determination in step S13. In a case where a score according to the degree of the failure determined in step S13 is cumulatively added and the accumulated value exceeds a predetermined value, the suitability determination unit 115 may determine that the user is unsuitable for the iris data acquisition. For example, in a case where the iris region is not sufficient in step S13, the success determination unit 114 makes the memory 119 store a value obtained by subtracting the area of the iris region that is visible in the image from the standard value as a score. Then, the success determination unit 114 accumulates the score each time when it is determined that the iris region is not sufficient in step S13. In a case where the suitability determination unit 115 determines whether the accumulated value exceeds the predetermined value in the determination in step S16 and the accumulated value exceeds the predetermined value, the suitability determination unit 115 may determine that the user is unsuitable for the iris data acquisition. The score is set to be higher as the degree of the failure increases in a form in which the accumulated value is compared with the predetermined value as described above. A uniform score may be set for a specific type of failure. A uniform score may be set for each type of failure.
  • The suitability determination unit 115 may make the determination in step S16 on the basis of the comparison between a degree of a recent failure and a degree of a previous failure. For example, in a case where the degree of the failure does not change even though the imaging is performed again, it can be said there is no possibility that the acquisition is successfully performed. Therefore, the success determination unit 114 may, for example, record the degree of the failure determined in step S13 in the memory 119. Then, for example, in a case where the degree of the recent failure is compared with the degree of the previous failure and a difference is less (smaller) than a reference in step S16, the suitability determination unit 115 may determine that the user is unsuitable for the iris data acquisition.
  • <Effect>
  • According to the iris data acquisition device 11 according to the second example embodiment, it is possible to reduce a wasteful behavior, wasteful processing, or the like that may occur in a scene in which the iris data is acquired. The reason is the same as the reason described in the description of the first example embodiment.
  • In the second example embodiment, it is determined whether the user is suitable for the iris data acquisition before the iris data acquired from the user is recorded. In a case where the iris data acquisition device 11 is used at the time when the iris data is registered in the iris database 21, the user can recognize that the user is unsuitable for the iris data acquisition before the iris data is registered in the iris database 21. As a result, it is possible to make the user who is unsuitable for the iris data acquisition to abandon the use of the iris authentication at an early stage. In a case where the iris data acquisition device 11 is used at the time of authentication, it is possible to urge the user to perform authentication using another authentication method other than the iris authentication at an early stage.
  • <Hardware Configuration that Implements Each Unit of Example Embodiment>
  • In each example embodiment described above, a block illustrating each component of each device is illustrated in functional units. However, the blocks illustrating the components do not necessarily mean that the components are configured by separate modules.
  • Processing of each component may be achieved, for example, by reading and executing a program that is stored in a computer-readable storage medium and causes a computer system to execute the processing by the computer system. The “computer-readable storage medium” is, for example, a portable medium such as an optical disk, a magnetic disk, a magneto-optical disk, or a nonvolatile semiconductor memory and a storage device such as a Read Only Memory (ROM), a hard disk, or the like built in a computer system. The “computer-readable storage medium” includes a storage medium that can temporarily hold a program such as a volatile memory in the computer system and a storage medium that transmits a program such as a communication line such as a network, a telephone line, or the like. The program may implement a part of the above-described functions or may implement the functions described above by a combination with a program that has been already stored in the computer system.
  • The “computer system” is, for example, a system including a computer 900 as illustrated in FIG. 5. The computer 900 includes the following components.
      • One or a plurality of central Processing Units (CPU) 901
      • ROM 902
      • RAM 903
      • Program 904 loaded on RAM 903
      • Storage device 905 that stores program 904
      • Drive device 907 that reads/writes from/to storage medium 906
      • Communication interface 908 connected to communication network 909
      • Input/output interface 910 that inputs/outputs data
      • Bus 911 that connects components
  • For example, each component of each device in each example embodiment is implemented by loading the program 904 for implementing the function of the component to the RAM 903 and executing the program 904 by the CPU 901. The program 904 for implementing the function of each component of each device is, for example, stored in the storage device 905 or the ROM 902 in advance. The CPU 901 reads the program 904 as necessary. The storage device 905 is, for example, a hard disk. The program 904 may be supplied to the CPU 901 via the communication network 909 or may be stored in the storage medium 906 in advance, read by the drive device 907, and supplied to the CPU 901. The storage medium 906 is a portable medium, for example, an optical disk, a magnetic disk, a magneto-optical disk, a nonvolatile semiconductor memory, or the like.
  • There are various modifications of the method for implementing each device. For example, each device may be implemented by a possible combination of a separate computer 900 and a program for each component. A plurality of components included in each device may be implemented by a possible combination of a single computer 900 and a program.
  • Some or all the components of each device may be implemented by another general-purpose or dedicated circuit, a computer, or a combination of these. These may be configured by a single chip or a plurality of chips connected via a bus.
  • In a case where some or all of the components of each device are implemented by a plurality of computers, circuits, or the like, the plurality of computers, circuits, or the like may be centrally arranged or dispersedly arranged. For example, the computers, the circuits, or the like may be implemented as a form, in which each of the computers, the circuits, or the like is connected via a communication network, such as a client and server system, a cloud computing system, or the like.
  • Although a part or all of the example embodiments may be described as supplementary notes below, a part or all of the example embodiments are not limited to the following supplementary notes.
  • <<Supplementary Note>>
  • [Supplementary Note 1]
  • An information providing device including:
  • reception means for receiving a face image;
  • determination means for determining whether a person in the face image is unsuitable for iris data acquisition based on the face image; and
  • output means for outputting information based on that it is determined that the person is unsuitable for the iris data acquisition in a case where it is determined that the person is unsuitable for the iris data acquisition.
  • [Supplementary Note 2]
  • The information providing device according to supplementary note 1, in which
  • the output means outputs at least one of information indicating that the person is unsuitable for the iris data acquisition and information that urges the person to stop a behavior to acquire the iris data of the person, as the information.
  • [Supplementary Note 3]
  • The information providing device according to supplementary note 1 or 2, in which
  • the determination means detects, from the face image, that the person has a cause that interferes the acquisition of the iris data and determines that the person is unsuitable for the iris data acquisition in a case where it is detected that the person has the cause that interferes the acquisition of the iris data.
  • [Supplementary Note 4]
  • The information providing device according to supplementary note 3, in which
  • the determination means determines that the person is unsuitable for the iris data acquisition by detecting that the person has the cause regarding opening of eyelids based on shapes of the eyelids of the person.
  • [Supplementary Note 5]
  • The information providing device according to any one of supplementary notes 1 to 4, further including:
  • iris data acquisition means for attempting to acquire the iris data from the face image; and
  • success determination means for determining whether the iris data acquisition means has acquired the iris data and whether quality of the iris data acquired by the iris data acquisition means is sufficient to be used for authentication, in which
  • the determination means determines whether the person is unsuitable for the iris data acquisition in a case where it is not possible for the iris data acquisition means to acquire the iris data or in a case where the success determination means determines that the quality of the acquired iris data is not sufficient to be used for authentication.
  • [Supplementary Note 6]
  • The information providing device according to supplementary note 5, in which
  • the output means outputs a message to the person in a case where it is not determined that the person is unsuitable for the iris data acquisition,
  • in a case where a new face image is input after the output of the message, the iris data acquisition means attempts to acquire iris data from the new face image, and the success determination means makes the determination, and
  • the determination means determines that the person is unsuitable for the iris data acquisition in a case where the number of times when the message is output to the person exceeds a threshold in a case where the iris data having quality sufficient to be used for authentication has never been acquired from the person.
  • [Supplementary Note 7]
  • The information providing device according to supplementary note 5, in which
  • in a case where the iris data having the quality sufficient to be used for authentication is not acquired, the success determination means calculates a seriousness of a cause of that the iris data having the quality sufficient to be used for authentication is not acquired based on information used for the determination and records seriousness information indicating the seriousness in a memory, and
  • the determination means determines whether the person is unsuitable for the iris data acquisition based on a history of the seriousness information.
  • [Supplementary Note 8]
  • The information providing device according to any one of supplementary notes 1 to 7, further including:
  • imaging means for generating a face image by imaging; and
  • registration means, in a case where the iris data of which quality satisfies a predetermined reference for authentication processing using the iris data is acquired, for registering, in a database, a pair of the acquired iris data and identification information of the person.
  • [Supplementary Note 9]
  • An information providing method including:
  • receiving a face image;
  • determining whether a person in the face image is unsuitable for iris data acquisition based on the face image; and
  • outputting information based on that it is determined that the person is unsuitable for the iris data acquisition in a case where it is determined that the person is unsuitable for the iris data acquisition.
  • [Supplementary Note 10]
  • The information providing method according to supplementary note 9, in which
  • at least one of information indicating that the person is unsuitable for the iris data acquisition and information that urges the person to stop a behavior to acquire the iris data of the person is output as the information.
  • [Supplementary Note 11]
  • The information providing method according to supplementary note 9 or 10, in which
  • it is detected, from the face image, that the person has a cause that interferes the acquisition of the iris data and it is determined that the person is unsuitable for the iris data acquisition in a case where it is detected that the person has the cause that interferes the acquisition of the iris data.
  • [Supplementary Note 12]
  • The information providing method according to supplementary note 11, in which
  • it is determined that the person is unsuitable for the iris data acquisition by detecting that the person has the cause regarding opening of eyelids based on shapes of the eyelids of the person.
  • [Supplementary Note 13]
  • The information providing method according to any one of supplementary notes 9 to 12, further including:
  • attempting to acquire the iris data from the face image;
  • determining whether the iris data is acquired by the acquisition and whether quality of the iris data acquired by the acquisition is sufficient to be used for authentication; and
  • determining whether the person is unsuitable for the iris data acquisition in a case where it is not possible to acquire the iris data or in a case where it is determined that the quality of the acquired iris data is not sufficient to be used for authentication.
  • [Supplementary Note 14]
  • The information providing method according to supplementary note 13, in which
  • in a case where it is not determined that the person is unsuitable for the iris data acquisition, a message to the person is output,
  • in a case where a new face image is input after the output of the message, acquisition of the iris data from the new face image is attempted, and the determination is made, and
  • it is determined that the person is unsuitable for the iris data acquisition in a case where the number of times when the message is output to the person exceeds a threshold in a case where the iris data having quality sufficient to be used for authentication has never been acquired from the person.
  • [Supplementary Note 15]
  • The information providing method according to supplementary note 13, in which
  • in a case where the iris data having the quality sufficient to be used for authentication is not acquired, a seriousness of a cause of that the iris data having the quality sufficient to be used for authentication is not acquired is calculated based on information used for the determination, and seriousness information indicating the seriousness is recorded in a memory, and
  • it is determined whether the person is unsuitable for the iris data acquisition based on a history of the seriousness information.
  • [Supplementary Note 16]
  • The information providing method according to any one of supplementary notes 9 to 15, further including:
  • in a case where the iris data of which quality satisfies a predetermined reference for authentication processing using the iris data is acquired, registering, in a database, a pair of the acquired iris data and identification information of the person.
  • [Supplementary Note 17]
  • A storage medium that stores a program for causing a computer to execute processing including:
  • reception processing of receiving a face image;
  • determination processing of determining whether a person in the face image is unsuitable for iris data acquisition based on the face image; and
  • output processing of outputting information based on that it is determined that the person is unsuitable for the iris data acquisition in a case where it is determined that the person is unsuitable for the iris data acquisition.
  • [Supplementary Note 18]
  • The storage medium according to supplementary note 17, in which
  • the output processing outputs at least one of information indicating that the person is unsuitable for the iris data acquisition and information that urges the person to stop a behavior to acquire the iris data of the person, as the information.
  • [Supplementary Note 19]
  • The storage medium according to supplementary note 17 or 18, in which
  • the determination processing detects, from the face image, that the person has a cause that interferes the acquisition of the iris data and determines that the person is unsuitable for the iris data acquisition in a case where it is detected that the person has the cause that interferes the acquisition of the iris data.
  • [Supplementary Note 20]
  • The storage medium according to supplementary note 19, in which
  • the determination processing determines that the person is unsuitable for the iris data acquisition by detecting that the person has the cause regarding opening of eyelids based on shapes of the eyelids of the person.
  • [Supplementary Note 21]
  • The storage medium according to any one of supplementary notes 17 to 20, that stores the program for causing the computer to execute processing further including:
  • iris data acquisition processing of attempting to acquire the iris data from the face image; and
  • success determination processing of determining whether the iris data acquisition processing has acquired the iris data and whether quality of the iris data acquired by the iris data acquisition processing is sufficient to be used for authentication, in which
  • the determination processing determines whether the person is unsuitable for the iris data acquisition in a case where it is not possible for the iris data acquisition processing to acquire the iris data or in a case where the success determination processing determines that the quality of the acquired iris data is not sufficient to be used for authentication.
  • [Supplementary Note 22]
  • The storage medium according to supplementary note 21, in which
  • the output processing outputs a message to the person in a case where it is not determined that the person is unsuitable for the iris data acquisition,
  • in a case where a new face image is input after the output of the message, the iris data acquisition processing attempts to acquire the iris data from the new face image, and the success determination processing makes the determination, and
  • the determination processing determines that the person is unsuitable for the iris data acquisition in a case where the number of times when the message is output to the person exceeds a threshold in a case where the iris data having quality sufficient to be used for authentication has never been acquired from the person.
  • [Supplementary Note 23]
  • The storage medium according to supplementary note 21, in which in a case where the iris data having the quality sufficient to be used for authentication is not acquired, the success determination processing calculates a seriousness of a cause of that the iris data having the quality sufficient to be used for authentication is not acquired based on information used for the determination and records seriousness information indicating the seriousness in a memory, and
  • the determination processing determines whether the person is unsuitable for the iris data acquisition based on a history of the seriousness information.
  • [Supplementary Note 24]
  • The storage medium according to any one of supplementary notes 17 to 23 that stores the program for causing the computer to execute processing further including:
  • imaging processing of generating a face image by imaging; and
  • registration processing, in a case where the iris data of which quality satisfies a predetermined reference for authentication processing using the iris data is acquired, of registering, in a database, a pair of the acquired iris data and identification information of the person.
  • The application is not limited to the example embodiments described above. It will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the example embodiments as defined by the claims.
  • This application is based upon and claims the benefit of priority from Japanese patent application No. 2018-181027, filed on Sep. 26, 2018, the disclosure of which is incorporated herein in its entirety by reference.
  • REFERENCE SIGNS LIST
    • 10 information providing device
    • 101 reception unit
    • 102 determination unit
    • 103 output unit
    • 11 iris data acquisition device
    • 111 control unit
    • 112 imaging unit
    • 113 iris data acquisition unit
    • 114 success determination unit
    • 115 suitability determination unit
    • 116 generation unit
    • 117 output unit
    • 118 input interface
    • 119 memory
    • 21 iris database
    • 900 computer
    • 901 CPU
    • 902 ROM
    • 903 RAM
    • 904 program
    • 905 storage device
    • 906 storage medium
    • 907 drive device
    • 908 communication interface
    • 909 communication network
    • 910 input/output interface
    • 911 bus

Claims (20)

1. An information providing device comprising:
at least one memory storing a set of instructions; and
at least one processor configured to execute the set of instructions to:
receive a face image;
determine whether a person in the face image has an physical feature based on the face image;
when the person is determined to have the physical feature, determine that the person is unsuitable for iris data acquisition; and
output information based on determining that the person is unsuitable for the iris data acquisition when the person is determined to be unsuitable for the iris data acquisition.
2. The information providing device according to claim 1, wherein
the at least one processor is further configured to execute the set of instructions to
determine whether the person has the physical feature that a fully opened eye of the person is insufficient for acquisition of iris data.
3. The information providing device according to claim 2, wherein
the at least one processor is further configured to execute the set of instructions to:
detect a fully-opened-eye feature in the face image;
determine an eye of the person is fully opened when the fully-opened-eye feature is detected; and
determine that the person has the physical feature that a fully opened eye of the person is insufficient for acquisition of iris data when iris data sufficient for iris authentication is not extracted from the face image and the eye is determined to be fully opened.
4. The information providing device according to claim 2, wherein
the at least one processor is further configured to execute the set of instructions to
detect a hidden-iris feature, as the physical feature, using a shape of an eyelid in the face image, the hidden-iris feature being characteristics that an iris is constantly hidden by the eyelid in such a way that iris data insufficient for iris authentication is constantly obtained.
5. The information providing device according to claim 2, wherein
the at least one processor is further configured to execute the set of instructions to:
output a message inquiring whether the person fully opens an eye;
receive an answer to the message; and
when the answer indicates that the person fully open the eye, determine that the person has the physical feature that a fully opened eye of the person is insufficient for acquisition of iris data.
6. The information providing device according to claim 1, wherein
the at least one processor is further configured to execute the set of instructions to:
receive a moving image as the face image; and
detect, as the physical feature, a shaking of an eye of the person in the moving image.
7. The information providing device according to claim 1, wherein
the at least one processor is further configured to execute the set of instructions to:
receive a moving image as the face image; and
detect, as the physical feature, a shaking or a continuous moving of an eye and the face of the person in the moving image.
8. The information providing device according to claim 1, wherein
the at least one processor is further configured to execute the set of instructions to:
attempt acquisition of the iris data from the face image;
perform determination including determining whether the iris data is acquired and determining whether quality of the iris data acquired is sufficient to be used for authentication; and
determine whether the person is unsuitable for the iris data acquisition when the iris data is not acquired or when quality of the acquired iris data is determined to be not sufficient to be used for authentication.
9. The information providing device according to claim 8, wherein
the at least one processor is further configured to execute the set of instructions to:
output a message to the person when the person is not determined to be unsuitable for the iris data acquisition;
attempt acquisition of iris data from the new face image when a new face image is input after the message is output, and perform the determination; and
determine that the person is unsuitable for the iris data acquisition when a count of times when the message is output to the person exceeds a threshold in a case where the iris data having quality sufficient to be used for authentication is not acquired even once from the person.
10. The information providing device according to claim 8, wherein
the at least one processor is further configured to execute the set of instructions to:
calculate, based on information used for the determination, a seriousness of a reason that the iris data having the quality sufficient to be used for authentication is not acquired when the iris data having the quality sufficient to be used for authentication is not acquired, and record seriousness information indicating the seriousness in a memory; and
determine whether the person is unsuitable for acquiring the iris data based on a history of the seriousness information.
11. An information providing method comprising:
receiving a face image;
determining whether a person in the face image has an physical feature based on the face image;
when the person is determined to have the physical feature, determining that the person is unsuitable for iris data acquisition; and
outputting information based on determining that the person is unsuitable for the iris data acquisition when the person is determined to be unsuitable for the iris data acquisition.
12. The information providing method according to claim 11, wherein
determining whether the person has the physical feature that a fully opened eye of the person is insufficient for acquisition of iris data.
13. The information providing method according to claim 12, wherein
detecting a fully-opened-eye feature in the face image;
determining an eye of the person is fully opened when the fully-opened-eye feature is detected; and
determining that the person has the physical feature that a fully opened eye of the person is insufficient for acquisition of iris data when iris data sufficient for iris authentication is not extracted from the face image and the eye is determined to be fully opened.
14. The information providing method according to claim 12, wherein
detecting a hidden-iris feature, as the physical feature, using a shape of an eyelid in the face image, the hidden-iris feature being characteristics that an iris is constantly hidden by the eyelid in such a way that iris data insufficient for iris authentication is constantly obtained.
15. The information providing method according to claim 12, wherein
outputting a message inquiring whether the person fully opens an eye;
receiving an answer to the message; and
when the answer indicates that the person fully open the eye, determining that the person has the physical feature that a fully opened eye of the person is insufficient for acquisition of iris data.
16. The information providing method according to claim 11, wherein
receiving a moving image as the face image; and
detecting, as the physical feature, a shaking of an eye of the person in the moving image.
17. The information providing method according to claim 11, wherein
receiving a moving image as the face image; and
detecting, as the physical feature, a shaking or a continuous moving of an eye and the face of the person in the moving image.
18. The information providing method according to claim 11, wherein
attempting acquisition of the iris data from the face image;
performing determination including determining whether the iris data is acquired and determining whether quality of the iris data acquired is sufficient to be used for authentication; and
determining whether the person is unsuitable for the iris data acquisition when the iris data is not acquired or when quality of the acquired iris data is determined to be not sufficient to be used for authentication.
19. The information providing method according to claim 18, wherein
outputting a message to the person when the person is not determined to be unsuitable for the iris data acquisition;
attempting acquisition of iris data from the new face image when a new face image is input after the message is output, and performing the determination; and
determining that the person is unsuitable for the iris data acquisition when a count of times when the message is output to the person exceeds a threshold in a case where the iris data having quality sufficient to be used for authentication is not acquired even once from the person.
20. A non-transitory computer readable storage medium storing a program causing a computer to execute processing of:
receiving a face image;
determining whether a person in the face image has an physical feature based on the face image;
when the person is determined to have the physical feature, determining that the person is unsuitable for iris data acquisition; and
outputting information based on determining that the person is unsuitable for the iris data acquisition when the person is determined to be unsuitable for the iris data acquisition.
US17/683,608 2018-09-26 2022-03-01 Information providing device, information providing method, and storage medium Abandoned US20220180629A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US17/683,608 US20220180629A1 (en) 2018-09-26 2022-03-01 Information providing device, information providing method, and storage medium

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
JP2018181027 2018-09-26
JP2018-181027 2018-09-26
PCT/JP2019/036497 WO2020066776A1 (en) 2018-09-26 2019-09-18 Information providing device, information providing method, and storage medium
US202117278381A 2021-03-22 2021-03-22
US17/683,608 US20220180629A1 (en) 2018-09-26 2022-03-01 Information providing device, information providing method, and storage medium

Related Parent Applications (2)

Application Number Title Priority Date Filing Date
PCT/JP2019/036497 Continuation WO2020066776A1 (en) 2018-09-26 2019-09-18 Information providing device, information providing method, and storage medium
US17/278,381 Continuation US11816927B2 (en) 2018-09-26 2019-09-18 Information providing device, information providing method, and storage medium

Publications (1)

Publication Number Publication Date
US20220180629A1 true US20220180629A1 (en) 2022-06-09

Family

ID=69952372

Family Applications (6)

Application Number Title Priority Date Filing Date
US17/278,381 Active 2040-05-28 US11816927B2 (en) 2018-09-26 2019-09-18 Information providing device, information providing method, and storage medium
US17/683,608 Abandoned US20220180629A1 (en) 2018-09-26 2022-03-01 Information providing device, information providing method, and storage medium
US17/683,592 Pending US20220189156A1 (en) 2018-09-26 2022-03-01 Information providing device, information providing method, and storage medium
US17/683,620 Active US11816928B2 (en) 2018-09-26 2022-03-01 Information providing device, information providing method, and storage medium
US18/223,462 Active US12056955B2 (en) 2018-09-26 2023-07-18 Information providing device, information providing method, and storage medium
US18/227,851 Pending US20230377371A1 (en) 2018-09-26 2023-07-28 Information providing device, information providing method, and storage medium

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US17/278,381 Active 2040-05-28 US11816927B2 (en) 2018-09-26 2019-09-18 Information providing device, information providing method, and storage medium

Family Applications After (4)

Application Number Title Priority Date Filing Date
US17/683,592 Pending US20220189156A1 (en) 2018-09-26 2022-03-01 Information providing device, information providing method, and storage medium
US17/683,620 Active US11816928B2 (en) 2018-09-26 2022-03-01 Information providing device, information providing method, and storage medium
US18/223,462 Active US12056955B2 (en) 2018-09-26 2023-07-18 Information providing device, information providing method, and storage medium
US18/227,851 Pending US20230377371A1 (en) 2018-09-26 2023-07-28 Information providing device, information providing method, and storage medium

Country Status (5)

Country Link
US (6) US11816927B2 (en)
EP (1) EP3859665A4 (en)
JP (2) JP7173153B2 (en)
SG (1) SG11202103106YA (en)
WO (1) WO2020066776A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024166250A1 (en) * 2023-02-08 2024-08-15 日本電気株式会社 Information processing device, information processing method, and program

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030020828A1 (en) * 2001-07-24 2003-01-30 Matsushita Electric Industrial Co., Ltd. Iris image pickup apparatus
JP2004086614A (en) * 2002-08-27 2004-03-18 Matsushita Electric Ind Co Ltd Eye image pickup device and eye image verifying device
US20080292144A1 (en) * 2005-01-08 2008-11-27 Dae Hoon Kim Iris Identification System and Method Using Mobile Device with Stereo Camera
CN201207196Y (en) * 2008-05-23 2009-03-11 徐州市博通科贸有限公司 Anti-forge iris collection and recognition device
CN206195921U (en) * 2016-11-11 2017-05-24 浙江树人大学 Device is taken a candid photograph to moving target people face iris
WO2017136857A1 (en) * 2016-02-05 2017-08-10 Mcbain Theodore Dean System, method and device for confirmation of an operator's health condition and alive status
US20180018516A1 (en) * 2016-07-18 2018-01-18 Samsung Electronics Co., Ltd. Method and apparatus for iris recognition
US20180137335A1 (en) * 2016-11-11 2018-05-17 Samsung Electronics Co., Ltd. Method and apparatus with iris region extraction
US20180285544A1 (en) * 2017-03-28 2018-10-04 Samsung Electronics Co., Ltd. Method for adaptive authentication and electronic device supporting the same

Family Cites Families (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1115972A (en) * 1997-06-20 1999-01-22 Oki Electric Ind Co Ltd Iris image pickup device
JP3315648B2 (en) * 1998-07-17 2002-08-19 沖電気工業株式会社 Iris code generation device and iris recognition system
JP2002312772A (en) 2001-04-13 2002-10-25 Oki Electric Ind Co Ltd Individual identification device and eye forgery judgment method
JP2003138817A (en) 2001-10-31 2003-05-14 Denso Corp Keyless entry system for vehicle, person identifying method, and person identifying system
JP2005334402A (en) 2004-05-28 2005-12-08 Sanyo Electric Co Ltd Method and device for authentication
JP4525286B2 (en) * 2004-10-14 2010-08-18 沖電気工業株式会社 Biometric information authentication apparatus and authentication method
JP2006212185A (en) * 2005-02-03 2006-08-17 Matsushita Electric Ind Co Ltd Living body discrimination device, authentication apparatus and living body discrimination method
JP2007257040A (en) 2006-03-20 2007-10-04 Oki Electric Ind Co Ltd Biometrics authentication device and biometrics authentication system
US9036871B2 (en) * 2007-09-01 2015-05-19 Eyelock, Inc. Mobility identity platform
CN100573556C (en) * 2008-05-23 2009-12-23 徐州市博通科贸有限公司 A kind of anti-fake eye iris capturing and recognition device
KR20130115840A (en) * 2012-04-13 2013-10-22 이광희 Iris identification camera system for mobile device
CN103106401B (en) * 2013-02-06 2017-02-22 北京中科虹霸科技有限公司 Mobile terminal iris recognition device with human-computer interaction mechanism
KR102037417B1 (en) * 2013-08-13 2019-10-28 삼성전자주식회사 Method of capturing an iris image, Computer readable storage medium of recording the method and an iris image capture device
US10042994B2 (en) * 2013-10-08 2018-08-07 Princeton Identity, Inc. Validation of the right to access an object
KR102412290B1 (en) * 2014-09-24 2022-06-22 프린스톤 아이덴티티, 인크. Control of wireless communication device capability in a mobile device with a biometric key
US9767358B2 (en) * 2014-10-22 2017-09-19 Veridium Ip Limited Systems and methods for performing iris identification and verification using mobile devices
KR20160050755A (en) * 2014-10-31 2016-05-11 삼성전자주식회사 Electronic Device and Method for Recognizing Iris by the same
EP3218845A4 (en) 2014-11-13 2018-07-11 Intel Corporation Facial liveness detection in image biometrics
US9412029B2 (en) 2014-12-12 2016-08-09 Iris Id, Inc. Apparatus for recognizing iris and operating method thereof
JP6333712B2 (en) * 2014-12-12 2018-05-30 株式会社日立建機ティエラ Excavator
KR102322029B1 (en) 2015-03-27 2021-11-04 삼성전자주식회사 Method and Apparatus for acquiring a biometric information
US9811681B2 (en) * 2015-07-28 2017-11-07 Sony Mobile Communications Inc. Method and system for providing access to a device for a user
JP6920329B2 (en) * 2016-03-07 2021-08-18 マジック リープ, インコーポレイテッドMagic Leap,Inc. Blue light regulation for biometric security
KR20180014624A (en) * 2016-08-01 2018-02-09 삼성전자주식회사 System and Method for Iris Authentication
JP6773493B2 (en) * 2016-09-14 2020-10-21 株式会社東芝 Detection device, detection method, and detection program
JP6946649B2 (en) 2017-01-31 2021-10-06 ソニーグループ株式会社 Electronic devices, information processing methods and programs
WO2018151349A1 (en) * 2017-02-16 2018-08-23 엘지전자 주식회사 Mobile terminal
JP6866742B2 (en) 2017-04-17 2021-04-28 カシオ計算機株式会社 Information processing equipment, journal entry support methods and programs
CN110945405B (en) * 2017-05-31 2024-01-02 奇跃公司 Eye tracking calibration technique
CN108154126B (en) * 2017-12-27 2024-01-05 中国科学院深圳先进技术研究院 Iris imaging system and method
CN108629293B (en) * 2018-04-16 2020-10-27 西安交通大学 Self-adaptive near-infrared iris image acquisition method with feedback mechanism
CN108960153A (en) * 2018-07-06 2018-12-07 深圳虹识技术有限公司 A kind of method and apparatus of adaptive iris recognition
CN108470170B (en) * 2018-07-25 2018-11-02 上海聚虹光电科技有限公司 U.S. pupil detection method

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030020828A1 (en) * 2001-07-24 2003-01-30 Matsushita Electric Industrial Co., Ltd. Iris image pickup apparatus
JP2004086614A (en) * 2002-08-27 2004-03-18 Matsushita Electric Ind Co Ltd Eye image pickup device and eye image verifying device
US20080292144A1 (en) * 2005-01-08 2008-11-27 Dae Hoon Kim Iris Identification System and Method Using Mobile Device with Stereo Camera
CN201207196Y (en) * 2008-05-23 2009-03-11 徐州市博通科贸有限公司 Anti-forge iris collection and recognition device
WO2017136857A1 (en) * 2016-02-05 2017-08-10 Mcbain Theodore Dean System, method and device for confirmation of an operator's health condition and alive status
US20180018516A1 (en) * 2016-07-18 2018-01-18 Samsung Electronics Co., Ltd. Method and apparatus for iris recognition
CN206195921U (en) * 2016-11-11 2017-05-24 浙江树人大学 Device is taken a candid photograph to moving target people face iris
US20180137335A1 (en) * 2016-11-11 2018-05-17 Samsung Electronics Co., Ltd. Method and apparatus with iris region extraction
US20180285544A1 (en) * 2017-03-28 2018-10-04 Samsung Electronics Co., Ltd. Method for adaptive authentication and electronic device supporting the same

Also Published As

Publication number Publication date
US20210350158A1 (en) 2021-11-11
EP3859665A1 (en) 2021-08-04
JP7400924B2 (en) 2023-12-19
US20230377371A1 (en) 2023-11-23
JPWO2020066776A1 (en) 2021-08-30
SG11202103106YA (en) 2021-04-29
US20220189157A1 (en) 2022-06-16
WO2020066776A1 (en) 2020-04-02
JP7173153B2 (en) 2022-11-16
US20220189156A1 (en) 2022-06-16
JP2023011813A (en) 2023-01-24
US11816927B2 (en) 2023-11-14
US12056955B2 (en) 2024-08-06
EP3859665A4 (en) 2021-11-24
US11816928B2 (en) 2023-11-14
US20230360439A1 (en) 2023-11-09

Similar Documents

Publication Publication Date Title
CN107995979B (en) System, method and machine-readable medium for authenticating a user
CN107438854B (en) System and method for performing fingerprint-based user authentication using images captured by a mobile device
CN110326001A (en) The system and method for executing the user authentication based on fingerprint using the image captured using mobile device
WO2019130670A1 (en) Biometric authentication system
US11756338B2 (en) Authentication device, authentication method, and recording medium
US12056955B2 (en) Information providing device, information providing method, and storage medium
JP6160148B2 (en) Biological information input device, biometric information input program, and biometric information input method
US11163994B2 (en) Method and device for determining iris recognition image, terminal apparatus, and storage medium
US20160366317A1 (en) Apparatuses and methods for image based biometric recognition
CN110889356A (en) Method and device for unlocking AR glasses based on infrared camera and AR glasses
US11195009B1 (en) Infrared-based spoof detection
Amjed et al. Noncircular iris segmentation based on weighted adaptive hough transform using smartphone database
US11250242B2 (en) Eye tracking method and user terminal performing same
CN113553890A (en) Multi-modal biological feature fusion method and device, storage medium and equipment
JP7272510B2 (en) Verification device, verification method, program
CN117197541B (en) User classification method and system based on convolutional neural network
US20240032856A1 (en) Method and device for providing alopecia information
KR102439216B1 (en) Method and server for recognizing face wearing mask using artificial intelligence deep learning
US20220254192A1 (en) Processing system, processing method, and non-transitory storage medium
Barra et al. MICHE competitions: A realistic experience with uncontrolled eye region acquisition
KR20220106399A (en) Apparatus and Method for Recognizing Liveness of Image
KR20230064660A (en) Method and Apparatus for Providing Pet Mutual Compatibility
CN116844219A (en) Display method, device, equipment and storage medium for preventing eyestrain
WO2023156473A1 (en) Method for determining an access right of a user, requesting computer device, authenticating computer device, and authenticating system
WO2015108911A1 (en) Method and apparatus for controlling intensity of illumination in eye based biometric systems

Legal Events

Date Code Title Description
STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: ADVISORY ACTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION