JP2006181012A - Eye image photographing device, authentication device and guiding method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To guide a person to be authenticated by easily understandably indicating a moving direction to a prescribed position to the person to be authenticated when the person to be authenticated positions an eye. <P>SOLUTION: An eye image photographing device 50 comprises: a photographing part 20 provided with a lens part 21, an imaging element 22 and a preprocessing part 23; an image signal processing part 30 provided with a pupil detection part 31, a judgement part 32 and an authentication image acquisition part 33; an illumination part 60 provided with an LED 62 for illumination and an illumination control part 61; an iris authentication processing part 40; and a guiding part 10 provided with a guiding mirror 13 and an LED 12 for guiding. The LED 12 for guiding is constituted of LEDs 12R and 12L for guiding arranged at both left and right ends of the guiding mirror 13, and one of them is made to emit light in the case of judging that the position of a pupil inside a photographed eye image is not at an appropriate position by the judgement part 32. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an eye image capturing device, an authentication device, and a guidance method.

  In recent years, as a method of personal authentication at the time of access in devices that require high security such as entry / exit management devices and information devices storing important information such as personal information, human fingerprints, irises, fundus blood vessels, facial Various authentication methods using so-called biometric information unique to the person to be authenticated, such as features, blood vessel patterns such as arms and hands, have been put into practical use.

  Among them, because of the high reliability such as the high authentication rate and the low acceptance rate of others, the authentication method using the difference in the eyelid pattern of the iris part of the eye (hereinafter referred to as the “Iris authentication method”). ”) And has been put to practical use in devices that require particularly high security.

  This iris authentication method is to illuminate the subject's eye and its surroundings with near-infrared illumination, etc., and take an image of an area including the eye of the person to be authenticated (hereinafter referred to as “eye image”) using a camera, Extract the iris region from the obtained eye image and create authentication information that is coded so that the difference in the eyelid pattern of the iris part is expressed as numerical information, and this authentication information is registered in advance as authentication information (below In this case, the person to be authenticated is authenticated as a person who has been registered in advance (see, for example, Patent Document 1). . In addition, since the iris image is the clearest image obtained in the vicinity of the near infrared region, many of the devices that capture the eye image used at this time have a visible light cut filter attached to the lens.

  Such an iris authentication method is widely used as an authentication method in places where high security is required because of its high reliability such as low identity rejection rate and low acceptance rate of others. is doing.

  On the other hand, in an authentication apparatus that performs personal authentication by the iris authentication method as described above, an eye image that can be authenticated by the authentication apparatus, that is, an area including the iris of the person to be authenticated is included in an appropriate position at an appropriate size. The eye image must be captured in the authentication device. For this purpose, a method is generally known in which a mirror (hereinafter referred to as a “guide mirror”) is provided on the front surface of the photographing apparatus, and the person to be authenticated adjusts his / her own eye position while viewing a reflected image reflected in the mirror.

  However, in this method, the person to be authenticated does not align the eye (hereinafter also referred to as “eye alignment”) while looking at the guiding mirror with the same eye as the eye reflected on the guiding mirror. There was a problem that it was difficult to arrange. For example, if the person to be authenticated performs eye alignment while looking at the reflected image of the left eye reflected on the guide mirror with the right eye, the eye is actually placed at a position deviated from the appropriate position. In some cases, the person to be authenticated can see a reflected image as if the eye was placed at an appropriate position. When the size of the guide mirror is not sufficient and the reflected image of one eye of the person to be authenticated is only large enough to be reflected, the reflected image of one eye can be seen on the guide mirror by the person to be authenticated. Therefore, it is difficult to distinguish whether the eyes reflected on the guide mirror are viewed with the same eye or with the other eye.

In order to solve such a problem, a guide mirror made of a material that transmits light from the back surface, light sources provided at the left and right ends of the back side of the guide mirror, and guide light to shield the light from the light source It is equipped with light-shielding plates provided on the left and right ends of the mirror, respectively, and aligns the eyes while viewing the eyes reflected on the guide mirror with the same eyes depending on the difference in how the light source is seen from the person to be authenticated. A technique relating to an eye image capturing device that can easily determine whether the eye is aligned while viewing with the other eye or the other eye (see, for example, Patent Document 2).
Japanese Patent No. 3307936 JP 2003-339676 A

  In recent years, the performance of portable terminal devices typified by portable telephones has been remarkably improved. For example, portable terminal devices that can be used as so-called electronic money, such as those equipped with functions that can be used in payment systems, etc. Has been introduced to the market. Such a portable terminal device is required to have a function for preventing unauthorized use by a third party, such as allowing only a registered person to use it. In order to meet such a demand, for example, it has been proposed to install a personal authentication function using the above-described iris authentication method in a mobile terminal device.

  On the other hand, in the portable terminal device, the device itself must be miniaturized as much as possible in order to improve portability, and the size of each component is limited due to such restrictions on the installation area. For example, when an iris authentication device is mounted on a mobile terminal device, a guide mirror for eye alignment is limited to a size that can be mounted on the mobile terminal device. If the size of the guide mirror is not sufficient, as described above, the reflected image of the eye reflected on the guide mirror is viewed with the same eye, or the eye is aligned with the other eye. It is difficult for a person to be authenticated to distinguish whether he / she is doing while watching. For this reason, the eye is positioned while viewing the reflected image of the eye reflected on the guide mirror with a different eye, and the eye may not be placed at an appropriate position.

  In order to solve such a problem in the mobile terminal device using the above-described conventional technology, the device must be downsized so that the mobile terminal device can be mounted on the mobile terminal device. However, in order to place the eyes at an appropriate position with respect to the mobile terminal device, the difference in the appearance of the left and right light sources between the light sources arranged at the left and right ends of the guide mirror and between the light source and the light shielding plate Therefore, a distance that allows the person to be authenticated to determine the position of his / her eyes is necessary. Therefore, the device according to the related art described above cannot exhibit the function of guiding the eye to an appropriate position as the size of the device is reduced, and the function is substantially reduced when the device is downsized to be mountable on the portable terminal device. It cannot be obtained.

  The present invention has been made in view of such problems, and even if the subject is positioned while looking at the reflected image of the eye reflected on the guide mirror with the other eye, it is promptly performed. An eye imaging device, an authentication device, and a guide that can place an eye at a predetermined position and can be easily mounted on a small device such as a portable terminal device without losing its function even if it is downsized. It aims to provide a method.

  The eye image capturing device of the present invention has an image capturing unit that captures an eye image of a subject, a guide mirror that confirms the position of the subject's own eye with respect to the image capturing unit, and light emitting elements arranged on the left and right of the guide mirror. And a light guide that guides the eyes of the subject to a predetermined position with the light emitting element.

  With this configuration, when capturing an eye image of a subject, the direction of movement to a position suitable for capturing the eye image can be easily shown to the subject.

  Further, a guide display unit having a light reflecting function may be provided instead of the guide mirror, and the guide display unit may perform display for guiding the eye of the subject. According to this configuration, it is possible to clearly show the moving direction to a position suitable for photographing an eye image to a user who is a subject without using a light emitting element.

  Also, a pupil detection unit that detects a region including the pupil from the eye image captured by the imaging unit, and whether or not the region including the pupil detected by the pupil detection unit is included in a predetermined region in the eye image And when the determination unit determines that the region including the pupil detected by the pupil detection unit is not included in the predetermined region in the eye image, It is good also as a structure guided to a position. According to this configuration, when the subject's eyes are arranged at a position shifted from a position suitable for photographing an eye image, it is easy for the user who is the subject to know the moving direction to a position suitable for photographing the eye image. It becomes possible to show.

  In addition, the guide unit may be configured to guide the right eye or the left eye that is set. According to this configuration, it is possible to clearly show the moving direction for placing the preset eye at a position suitable for photographing an eye image to the user who is the subject.

  The determination unit may select the right eye or the left eye as the eye that guides the eye that is closer to the center of the eye image, and the guide unit may guide the eye selected by the determination unit. According to this configuration, since the eye closer to the position suitable for photographing the eye image is guided, the user who is the subject promptly arranges his / her eyes at a position suitable for photographing the eye image. be able to.

  In addition, when the determination that the region including the pupil detected by the pupil detection unit is not included in the predetermined region in the eye image continues for a predetermined time, the guide unit starts to guide the eye position of the subject. It is good. According to this configuration, it is possible to reduce the start of guidance by the guidance unit while the user who is the subject is performing eye alignment, thereby reducing the psychological stress of the user who is the subject. Can do.

  The authentication device of the present invention includes an eye image capturing device and an authentication processing unit that performs an authentication process using an iris portion of an eye image captured by the eye image capturing device. According to this configuration, since an eye image necessary for authentication can be quickly captured in the eye image capturing device, authentication using an iris can be performed promptly.

  Further, the guiding method of the present invention is a method for photographing an eye image and detecting a region including a pupil from the photographed eye image in an eye image photographing apparatus including a guiding unit for guiding a subject's eye to a predetermined position. A step of determining whether a region including the detected pupil is included in a predetermined region of the captured eye image; and a predetermined region of the eye image in which the region including the detected pupil is captured A display for guiding the subject's eyes to a predetermined position when the subject's eyes are not included, and guiding the subject's eyes to a predetermined position. According to this method, the position of the pupil in the photographed eye image is detected, thereby determining whether or not the subject's eye is photographed at a position suitable for photographing the eye image and starting the guidance of the subject's eye Therefore, when the subject's eyes are arranged at a position deviated from the position suitable for photographing the eye image, the direction of movement to the position suitable for photographing the eye image can be easily shown to the user who is the subject. It becomes possible.

  According to the present invention, even when the subject is positioned while looking at the reflected image of the eye reflected on the guide mirror with the other eye, the eye is quickly placed at a predetermined position. Therefore, an eye image capturing device, an authentication device, and a guidance method can be provided that can be easily mounted on a small device such as a portable terminal device without sacrificing its function even if it is downsized.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

(Embodiment 1)
An eye image capturing apparatus according to Embodiment 1 of the present invention will be described with reference to FIG. FIG. 1 is an external view of a foldable portable telephone 100 equipped with an eye image capturing device and an iris authentication processing unit according to Embodiment 1 of the present invention. The mobile phone 100 is configured by a first main body 100a and a second main body 100b being foldably connected by a connecting portion 100c. The second main body 100b is provided with an input operation key 2 and a microphone 5. The first main body 100a emits near-infrared light, a display unit 3 using liquid crystal, organic EL, and the like. Two LED 62 for illumination which is a light emitting element, and the antenna 6 are provided. Furthermore, the first main body 100a has a guiding mirror 13 used for the person to be authenticated to confirm the position of his / her eyes with its reflection image, and the right and left ends of the guiding mirror 13 which are to be authenticated. Guidance LEDs 12 including guidance LEDs 12R and 12L, which are light-emitting elements that emit visible light used for guidance when performing the above.

  In addition, the mobile phone 100 includes an eye image capturing device 50 described later and an iris authentication processing unit 40 described later, and the iris authentication processing unit 40 captures the person to be authenticated photographed by the eye image capturing device 50. If the person to be authenticated is authenticated as a pre-registered person from the eye image, the mobile phone 100 starts a normal operation.

  Note that the mobile phone 100 can display the captured eye image on the display unit 3, but in the present embodiment, the eye image is displayed to make it difficult for others to detect the iris authentication operation. It is set as the structure which is not displayed on the part 3. FIG.

  FIG. 2 is a block diagram showing the configuration of the eye image capturing device 50 and the iris authentication processing unit 40 provided in the mobile phone 100 according to Embodiment 1 of the present invention.

  The eye image capturing device 50 includes a guiding unit 10 that guides the eye of the person to be authenticated to a predetermined position, a capturing unit 20 that captures an eye image, and image signal processing that performs signal processing on the eye image captured by the capturing unit 20. And a lighting unit 60 that illuminates a region including at least eyes of the person to be authenticated.

  The illumination unit 60 includes an illumination LED 62 made of a known light emitting element such as a light emitting diode that emits near-infrared light, and an illumination control unit 61 that controls the illumination. The illumination LED 62 is suitable for eye image acquisition. The irradiated light amount is irradiated toward an area including at least the eyes of the person to be authenticated.

  The imaging unit 20 includes a lens unit 21 configured with a generally used fixed focus lens, an imaging device 22 configured with a known element such as a CCD, and a preprocessing unit 23. Near-infrared light emitted from the illumination LED 62 is reflected by the face and eyes of the person to be authenticated, and the reflected light is input to the image sensor 22 through the lens unit 21. The input incident light is photoelectrically converted by the image sensor 22 and input to the preprocessing unit 23 as an electrical signal. The pre-processing unit 23 extracts an image signal component from the electrical signal input from the image sensor 22 and performs image quality determination regarding contrast, focus, and the like, and performs necessary processing as an image signal such as gain adjustment and the like. The signal is output to the signal processing unit 30.

  The image signal processing unit 30 includes a pupil detection unit 31 that detects the position of the pupil from the eye image captured by the imaging unit 20, and whether the pupil detected by the pupil detection unit 31 is at an appropriate position in the eye image. And an authentication image acquisition unit 33 that receives the result of the determination unit 32 and acquires an eye image captured by the imaging unit 20 as an authentication eye image.

  The pupil detection unit 31 detects the pupil position from the eye image signal output from the preprocessing unit 23. As a method for detecting the pupil position from the signal of the eye image, a generally known technique such as a method using template matching or a method using circular integration (Japanese Patent Publication No. 8-504979) can be used. . The determination unit 32 determines whether or not the position of the pupil detected by the pupil detection unit 31 is at the center position of the eye image, and the pupil is kept at the center position of the eye image for a certain time (for example, about 0.5 seconds). When the detection is stable, a signal indicating that the eye guidance is completed is output to the authentication image acquisition unit 33. The authentication image acquisition unit 33 receives the signal from the determination unit 32, takes in the eye image signal output from the preprocessing unit 23, and outputs it as an authentication eye image to the iris authentication processing unit 40.

  The guiding unit 10 is a guiding mirror 13 installed on the front surface of the lens unit 21, a pair of guiding LEDs 12R and 12L disposed on the left and right ends of the guiding mirror 13, and guidance control for controlling lighting of the guiding LEDs 12R and 12L. Part 11. The guide mirror 13 is used by the person to be authenticated to confirm the position of his / her eyes by looking at the reflected image. The guide mirror 13 is formed of a generally known semi-transparent material, and reflects and transmits light at the same time, and part of the transmitted light is input to the photographing unit 20. The guiding LEDs 12R and 12L are formed of known light emitting elements such as light emitting diodes that emit visible light, and guide the eyes of the person to be authenticated to a predetermined position by the light emitted from each. Details of the guidance LEDs 12R and 12L will be described later. The guidance control unit 11 selectively turns on the guidance LEDs 12R and 12L based on the output from the determination unit 32.

  The iris authentication processing unit 40 cuts out the image of the iris region from the authentication eye image output from the image signal processing unit 30, and creates authentication information based on the iris pattern of the iris part. Then, the registered authentication information registered in advance and the authentication information are compared and collated to determine whether or not they match each other to determine whether or not the person to be authenticated is a registrant. The function of the iris authentication processing unit 40 can be realized, for example, using a method known so far as described in Patent Document 1 described above.

  As described above, the eye image capturing device 50 and the iris authentication processing unit 40 according to Embodiment 1 of the present invention capture the eye image of the person to be authenticated, collate the iris pattern in the captured eye image, It authenticates whether the person to be authenticated is a person registered in advance.

  Note that the functions of the image signal processing unit 30, the preprocessing unit 23, the illumination control unit 61, and the iris authentication processing unit 40 may each be realized by hardware, or each function can be realized by software. It may be described and executed by an arithmetic device or the like. When each function is realized by software, it is possible to configure the eye image capturing device 50 and the iris authentication processing unit 40 using a computer loaded with a program that realizes each of the above functional blocks in an arithmetic device. It becomes.

  FIG. 3 is a flowchart showing the operations of the eye image capturing device 50 and the iris authentication processing unit 40 according to Embodiment 1 of the present invention. First, the person to be authenticated places a face in front of the mobile phone 100, aligns the eyes while looking at the guide mirror 13, and then starts an authentication operation by inputting an instruction to start authentication (S11). ). Then, the imaging unit 20 captures an eye image of the person to be authenticated (S12). The pre-processing unit 23 determines whether the image quality such as focus, brightness, and contrast of the acquired eye image is appropriate. If it is not appropriate, the pre-processing unit 23 performs necessary processing such as an instruction to the person to be authenticated and captures the eye image again ( S13). If the acquired eye image has an appropriate image quality, the pupil detection unit 31 detects the pupil position and its radius from the eye image (S14). Then, the determination unit 32 determines whether or not the detected pupil position and its radius are suitable for the authentication process (S15). If the eye image is determined not to be suitable for the authentication process by the determination unit 32, the guidance control unit 11 guides the LEDs 12R and 12L for guidance in order to guide the eye position of the person to be authenticated to a predetermined position. Select one of them to make it emit light. In the present embodiment, a function for selecting the right eye or the left eye is assigned to any two keys of the input operation key 2, for example, which of the right eye and the left eye is to be guided, The user is set in advance by pressing any key before the start of authentication. Then, when guiding the right eye, the guidance control unit 11 emits the guidance LED 12L disposed on the right side (left side as viewed from the person to be authenticated) of the guidance mirror 13 and guides the left eye. The guiding LED 12R disposed on the left side (right side as viewed from the person to be authenticated) of the guiding mirror 13 in FIG. 2 is caused to emit light (S16). About the eye image which the judgment part 32 judged to be an eye position suitable for an authentication process, the authentication image acquisition part 33 outputs it to the iris authentication process part 40 as an eye image for authentication (S40). The iris authentication processing unit 40 cuts out an iris image from the eye image data based on the center coordinates of the pupil (S41). Then, the iris image is converted into unique authentication information indicating the iris pattern as a numerical value (S42), and the authentication operation is executed by comparing with the registered authentication information registered (S43).

  Next, guidance based on the position of the eye of the person to be authenticated and the light emission of the guidance LED 12 will be described with reference to FIGS.

  FIG. 4 is a diagram showing a case where the eye is placed at an appropriate position in the eye image capturing device 50 according to Embodiment 1 of the present invention. At such an eye position, the person to be authenticated can see a reflected image 71A of the eye that has a pupil portion in the approximate center of the guiding mirror 13 and is shown without any loss. Since the eye is in an appropriate position, the imaging unit 20 captures an eye image 70A in which the eye is captured at an appropriate position in the eye image with an appropriate size.

  At this time, the determination unit 32 determines that the eye position is in an appropriate position because the pupil is captured at an appropriate size in the center of the eye image 70A. Therefore, the guidance LED 12 does not emit light.

  In this way, the person to be authenticated can place the eye in an appropriate position without any problem as long as the reflected image of the eye reflected on the guide mirror 13 is viewed with the same eye. However, in the case where the size of the guide mirror 13 provided in the mobile phone 100 is not sufficient and the reflection image of one eye of the person to be authenticated is reflected, the person to be authenticated is Because only the reflected image of one eye is visible on the guide mirror, it is difficult to distinguish whether the eye is seen with the same eye as the eye reflected on the guide mirror or with the other eye. . Then, even if the person to be authenticated performs eye alignment while looking at the guiding mirror 13 with the eye different from the eye reflected on the guiding mirror 13, the person to be authenticated is not likely to notice that, and in such a case In some cases, the eye is placed at a position shifted from an appropriate position.

  FIG. 5 is a diagram showing a case where the eye is arranged at a position shifted from an appropriate position to the left in the drawing in the eye image capturing device 50 according to Embodiment 1 of the present invention.

  In the example illustrated in FIG. 5, the person to be authenticated performs eye alignment while viewing the reflected image of the left eye reflected on the guide mirror 13 with the right eye. In such a case, even if the person to be authenticated moves the position of his / her eyes so that the pupil can be seen near the center of the guide mirror 13, the actual eye of the person to be authenticated is near the center between the right eye and the left eye Is shifted to a position where the optical axis of the photographing unit 20 is located. However, since the person to be authenticated sees the reflected image 71B as if the eyes were placed at an appropriate position on the guide mirror 13, it is difficult to notice that his / her own eyes are not placed at the appropriate positions.

  When an eye image is captured at such an eye position, the imaging unit 20 captures an eye image 70B in which the right eye and the left eye are at both ends in the eye image and each pupil region is missing. The

  Therefore, in the eye image photographing device 50 according to Embodiment 1 of the present invention, the pupil detection unit 31 detects the position of the pupil of the photographed eye image, and this is an appropriate position in the eye image, that is, the center of the eye image. The determination unit 32 determines whether or not there is. If the determination unit 32 determines that it is not appropriate, the guidance control unit 11 causes one of the guidance LEDs 12R and 12L to emit light in order to guide the right eye or the left eye.

  In this embodiment, the person to be authenticated is configured to set in advance which of the right eye and the left eye is to be guided. Then, when guiding the right eye, the guidance control unit 11 causes the guidance LED 12L disposed on the right side (left side as viewed from the person to be authenticated) of the guidance mirror 13 to emit light, and when guiding the left eye, guidance is performed. The guidance LED 12R disposed on the left side of the mirror 13 in the drawing (right side as viewed from the person to be authenticated) is caused to emit light. For example, when the right eye is set in advance as the eye to guide, the guidance control unit 11 causes the guidance LED 12L to emit light to guide the right eye of the person to be authenticated, and causes the person to be authenticated to move rightward in the drawing ( Indicates that the user must move to the left when viewed from the person being authenticated.

  Then, the person to be authenticated can see the reflected image 71B as if the eye is placed at an appropriate position on the guidance mirror 13 by the light emission of the guidance LED 12L. It can be seen that, in order to place the eye at an appropriate position, it must move in the right direction in the drawing (left direction as viewed from the person to be authenticated).

  FIG. 6 shows a state in which the person to be authenticated is guided rightward in the drawing (leftward as viewed from the person to be authenticated) by the light emitted from the guidance LED 12L in the eye image photographing device 50 according to Embodiment 1 of the present invention. FIG.

  Here, the right eye is set in advance as the guiding eye. Therefore, as shown in FIG. 6, the guidance LED 12L is emitted by the guidance control unit 11, and the person to be authenticated is moved in the right direction (from the person to be authenticated). (Left direction) And when a to-be-authenticated person moves to the right direction (left direction seeing from a to-be-authenticated person) in a drawing, when the reflected image of the left eye seen with the right eye moves to the end of the guidance mirror 13 At the same time, the right-eye reflection image 71 </ b> C is now visible on the guide mirror 13. As described above, when the person to be authenticated moves by the guidance LED 12, the right eye of the person to be authenticated can see the reflected image 71C of the right eye in addition to the reflected image of the left eye. In this way, the person to be authenticated can adjust the position of the eye while viewing the reflected image 71C of the right eye reflected on the guide mirror 13 with the right eye, and can place the eye at an appropriate position. 70C is photographed.

  As described above, in the eye image capturing device 50 according to Embodiment 1 of the present invention, when the person to be authenticated performs eye alignment, the person to be authenticated is informed when the eye is not placed at a predetermined position. By indicating the direction of movement to the predetermined position in an easy-to-understand manner, the person to be authenticated can easily align the eyes.

  That is, the eye image capturing device 50 according to the first embodiment of the present invention includes guidance LEDs 12R and 12L arranged on the left and right sides of the guidance mirror 13, the determination unit 32, and the guidance control unit 11, and the photographed eye Judgment is made based on the position of the pupil detected in the image whether or not the eye is placed at an appropriate position, and if it is determined that the eye is not placed at the appropriate position, the pre-set eye is guided. One of the LEDs 12 for use is caused to emit light.

  Therefore, the person to be authenticated performed eye alignment while viewing the reflected image of the eye reflected on the guide mirror 13 with the eye different from that, and as a result, the eye was placed at a position shifted from an appropriate position. In this case, the person to be authenticated easily knows that his / her eyes are not placed at an appropriate position and the moving direction for placing the eyes at an appropriate position by the light emission of any of the guidance LEDs 12. be able to.

  As described above, according to the first embodiment of the present invention, it is possible to easily align the eyes of the person to be authenticated, and the system that does not impair the effect even if the size is reduced with a relatively simple configuration. Can be realized and provided.

(Embodiment 2)
In the second embodiment of the present invention, a display device having a function as a mirror, for example, a generally known mirror liquid crystal, is used instead of the configuration in which guiding LEDs are arranged on the left and right ends of the guiding mirror shown in the first embodiment. The guidance display part is formed by the above, and a character or a symbol is displayed on the guidance display part instead of the light emission of the light emitting element. In this embodiment, it is configured such that the same effect as that of the first embodiment can be obtained by displaying the instruction display unit instructing the moving direction to the person to be authenticated.

  FIG. 7 is an external view of the folding portable phones 110 and 120 in the opened state according to the second embodiment of the present invention. The same components as those of the mobile phone 100 shown in FIG. A mobile phone 110 shown in FIG. 7A includes a first main body 110a and a second main body each having a display device having a function as a mirror, for example, a guidance display portion 13A formed by a generally known mirror liquid crystal. 100b is foldably connected by a connecting portion 100c. As described above, the mobile phone 110 according to the present embodiment has a configuration in which the guide display unit 13A having both the function of the guide mirror 13 and the function of the guide LED 12 in the mobile phone 100 is provided.

  7B includes a first main body 120a and a second main body 120a each having a display device 3A formed of a display device having a mirror function, for example, a generally known mirror liquid crystal. The main body 100b is connected in a foldable manner by the connecting portion 100c. As described above, the mobile phone 120 according to the present embodiment is configured to include the display unit 3A that combines the function of the display unit 3, the function of the guide mirror 13, and the function of the guidance LED 12 in the mobile phone 100. .

  In the cellular phones 110 and 120, instead of the light emission of the guidance LED 12 shown in the first embodiment, a symbol such as “+” is displayed on the right side or the left side of the center of the guidance display unit 13A and the display unit 3A. Thus, the configuration shows the moving direction to the person to be authenticated, and the same effect as in the first embodiment is obtained. Further, in the mobile phone 120, the display unit 3A also has a function as a guide mirror, thereby eliminating the space for arranging the guide mirror and saving space.

  The symbol to be displayed may be “◯”, a line having an appropriate width, or the like, or a symbol indicating a moving direction such as an arrow, “Right, Left”, “R, L” (Right, Left) It may be a character indicating the moving direction. In addition, if it is an arrow or a character, the movement direction can be shown to the person to be authenticated without selecting the display location.

  8 and 9 are diagrams showing examples of guidance display in the folding portable telephone 120 according to Embodiment 2 of the present invention.

  FIG. 8 is a diagram showing an example of guidance display immediately after the start of eye image capturing in folding mobile phone 120 according to Embodiment 2 of the present invention. In the present embodiment, immediately after the start of eye image capturing, as shown in FIG. 8A, a symbol “+” is displayed at the center of the display unit 3A. This is a display for the person to be authenticated to make a target at the time of eye alignment, and the person to be authenticated aligns his / her eyes so that his / her pupil part appears to overlap this “+”. And if a to-be-authenticated person aligns an eye, seeing the reflection image of the eye which appeared in the display part 3A with the same eye, the to-be-authenticated person can arrange | position an eye in an appropriate position.

  At this time, as shown in FIG. 8B, for example, if the subject is positioned while looking at the reflected image of the left eye seen on the display unit 3A with the right eye, the eyes are correctly arranged. Even if the user's eyes are arranged at a position where the reflected image 71D can be seen, the eyes of the person to be authenticated may be arranged at a position deviated from an appropriate position. In such a case, the imaging unit 20 captures an eye image 70D in which the pupil is greatly displaced from the center of the eye image.

  In order to eliminate such possibility, the display as shown in FIG. 9 is performed in the second embodiment of the present invention. FIG. 9 is a diagram showing an example of guidance display in the foldable portable telephone 120 according to Embodiment 2 of the present invention. In the present embodiment, when the eye of the person to be authenticated is placed at a position shifted from an appropriate position and the shift is detected by detection of the pupil position by a pupil detection unit (not shown), the eye alignment is performed. The target “+” sign is displayed on the right or left side of the center of the display unit 3A to guide the eye position of the person to be authenticated.

  For example, when the right eye is set in advance as the eye to be guided by the person to be authenticated, as shown in FIG. 9A, the left side from the center of the display unit 3A (left side as viewed from the person to be authenticated) The symbol “+” is displayed. By this display, the guiding unit (not shown) indicates to the person to be authenticated that the eye of the person to be authenticated is not placed at an appropriate position, and simultaneously guides the eye of the person to be authenticated to an appropriate position. The person to be authenticated moves his / her eye position to the left in the drawing so that his / her pupil part appears to overlap this “+”.

  Then, as shown in FIG. 9B, the person to be authenticated moves in the left direction in the drawing, so that the person to be authenticated has a left eye and a right eye in which the sign “+” overlaps the pupil part. The reflected image 71E reflected at the same time can be seen. Thus, the person to be authenticated can place the right eye near the center of the reflected image 71E, and the eye image 70E in which the eye is placed at an appropriate position is photographed. In the present embodiment, in this way, the person to be authenticated places his / her eyes in an appropriate position so that an authenticable eye image can be taken.

  As described above, in the second embodiment of the present invention, a guidance LED is arranged by forming a guidance display unit with a display device having a mirror function, for example, a generally known mirror liquid crystal. Without doing so, the same effect as in the first embodiment can be obtained. Furthermore, if the display unit is formed by a display device having a function as a mirror, the space for arranging the guide mirror is not required, and the space can be saved.

(Embodiment 3)
When the person to be authenticated performs eye alignment, it may take some time to complete the operation because it is not used to the operation. In addition, if a guidance operation such as the guidance LED 12 emitting light during eye alignment is performed, this may give psychological stress to the person to be authenticated. Therefore, in the third embodiment of the present invention, the apparatus configuration is the same as that in the first or second embodiment, and the determination that “the pupil is not positioned at an appropriate position” in the determination unit 32 continues for a certain period of time. In this case, the guidance operation is started. The other operations are the same as those in the first or second embodiment.

  FIG. 10 is a flowchart illustrating operations of the eye image capturing device and the iris authentication processing unit according to Embodiment 3 of the present invention. In addition, the same code | symbol is attached about the step which performs the same operation | movement as the flowchart shown in FIG. 3, and description is abbreviate | omitted.

  If it is determined in step S15 that the photographed eye image is not suitable for the authentication process, the determination unit 32 measures the time during which the determination is continued. Then, if it is within a predetermined time, for example, within 5 seconds, the guiding LED 12 does not emit light, and when it exceeds the predetermined time, the guiding LED 12 is caused to emit light (S151).

  Thus, in this embodiment, the duration of the determination that the pupil is not placed at an appropriate position is measured, and the guidance LED 12 is caused to emit light when the time exceeds a predetermined time. By setting it as such operation | movement, it can reduce that guidance operation | movement, such as LED12 for guidance light-emitting during the position alignment of eyes, is performed, and can reduce the psychological stress given to a to-be-authenticated person. .

  Generally, the person to be authenticated stops the eye alignment operation when he / she thinks that the eye alignment is completed. Therefore, if the pupil is stationary at a position deviated from the center of the eye image for a certain time, for example, about 2 seconds, the person to be authenticated has completed the eye alignment with his / her eye placed at the wrong position. It can also be judged that it is assumed. Therefore, instead of step S151, it is detected whether the pupil is moving or stationary, the time when the pupil is stationary is measured, and the pupil is at a position deviated from the center of the eye image for a certain time, for example, 2 seconds. The step of causing the guidance LED 12 to emit light when it is stationary may be added. By setting it as such operation | movement, the psychological stress given to a to-be-authenticated person can be reduced more.

  In the embodiment of the present invention, the configuration in which the person to be authenticated sets in advance which of the right eye and the left eye is to be guided is not limited to this example. For example, the determination unit It is also possible to determine which of the right eye and the left eye in the eye image is close to the center of the image and select the near eye as the guiding eye.

  The “center” in the “determination of whether or not the pupil is at the center of the eye image” in the determination unit is used to determine whether or not the pupil portion in the photographed eye image is within the authentication processable range. It means a substantial “center” and deviations in this range are allowed.

  According to the present invention, even if the subject is aligning the eye while viewing the reflected image of the eye reflected on the guide mirror with the other eye, the eye is quickly placed at a predetermined position. This is useful as an eye image capturing device, an authentication device, and a guidance method because it can be easily mounted on a small device such as a portable terminal device without sacrificing its function even if it is downsized. .

1 is an external view of a folding portable phone equipped with an eye image capturing device and an iris authentication processing unit according to Embodiment 1 of the present invention in an open state. The block diagram which shows the structure of the eye imaging device with which the portable telephone was equipped, and the iris authentication process part Flowchart showing operations of the same-eye image capturing apparatus and iris authentication processing unit The figure shown about the case where eyes are arranged in an appropriate position in the same-eye image capturing device The figure shown about the case where eyes are arrange | positioned in the position which shifted | deviated from the appropriate position to the left in drawing in the same-eye image capturing device The figure which showed the state which guide | induced the to-be-authenticated person rightward in drawing by light emission of guidance LED in the same-eye imaging device External view of the folding portable phone in the opened state according to the second embodiment of the present invention The figure which showed the example of the display for guidance immediately after the eye image photography start in the portable telephone The figure which showed the example of the mode of the display for guidance in the portable telephone The flowchart which shows operation | movement of the eye image imaging device and iris authentication process part in Embodiment 3 of this invention.

Explanation of symbols

2 Input operation keys 3, 3A Display unit 4 Speaker 5 Microphone 6 Antenna 10 Guidance unit 11 Guidance control unit 12, 12R, 12L Guidance LED
DESCRIPTION OF SYMBOLS 13 Guide mirror 13A Guidance display part 20 Image | photographing part 21 Lens part 22 Image pick-up element 23 Pre-processing part 30 Image signal process part 31 Pupil detection part 32 Judgment part 33 Authentication image acquisition part 40 Iris authentication process part 50 Eye image imaging device 60 Illumination part 61 Illumination control unit 62 LED for illumination
70A, 70B, 70C, 70D, 70E Eye images 71A, 71B, 71C, 71D, 71E Reflected images 100a, 110a, 120a First main body 100b Second main body 100c Connecting portion 100, 110, 120 Mobile phone

Claims (8)

A photographing unit for photographing an eye image of the subject;
A guiding mirror for confirming the position of the subject's own eye with respect to the photographing unit;
A light guide that is arranged on the left and right of the guide mirror, and guides the subject's eye to a predetermined position with the light emitter;
An eye image photographing apparatus. A guide display unit having a light reflection function instead of the guide mirror,
The eye image capturing apparatus according to claim 1, wherein the guide display unit performs display for guiding a subject's eyes. A pupil detection unit that detects a region including the pupil from the eye image captured by the imaging unit;
A determination unit that determines whether or not a region including the pupil detected by the pupil detection unit is included in a predetermined region in the eye image;
When the determination unit determines that the region including the pupil detected by the pupil detection unit is not included in the predetermined region in the eye image, the guide unit guides the subject's eye to a predetermined position. The eye image photographing device according to claim 1 or 2, wherein The eye image capturing device according to claim 3, wherein the guide unit guides the right eye or the left eye. The determination unit selects either the right eye or the left eye as an eye that guides the eye closer to the center of the eye image, and the guide unit guides the eye selected by the determination unit. The eye image capturing device according to claim 3. When the determination that the region including the pupil detected by the pupil detection unit is not included in the predetermined region in the eye image continues for a predetermined time, the guide unit starts to guide the eye position of the subject. The eye image photographing device according to claim 4, wherein the eye image photographing device is characterized. An eye image capturing device according to any one of claims 1 to 6;
An authentication processing unit that performs an authentication process using an iris portion of an eye image captured by the eye image capturing device;
An authentication apparatus comprising: In an eye image capturing apparatus including a guide unit that guides the subject's eyes to a predetermined position,
Taking an eye image;
Detecting a region including the pupil from the photographed eye image;
Determining whether a region including the detected pupil is included in a predetermined region of the photographed eye image;
Performing a display for guiding the eye of the subject to the predetermined position when the region including the detected pupil is not included in the predetermined region of the photographed eye image;
And guiding the eye of the subject to the predetermined position.

Images