JP2003108983A - Eye image pickup device, iris authentication device, and portable terminal device with iris authentication function - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow an iris authentication function to be mounted on a cellphone or the like. SOLUTION: This iris authentication device has an image pickup camera 62 taking in an image of an eye, a display device 61 disposed on the same plane as a lens arrangement position of the camera 62, and a guide character generation means. By displaying guide characters 66, 67 on the display device 61, the eye position of a person to be authenticated looking at the guide characters 66, 67 is guided. Thereby, the excellent iris image can be acquired even by a single camera type without a zoom function, so that the iris authentication device can be mounted in an small casing of the cellphone or the like.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an eye image pickup device used in an iris authentication system for identifying an individual by using iris information of a person or an animal.

[0002]

2. Description of the Related Art As a technique for recognizing an iris image of a human with a camera and performing individual recognition, for example, a technique described in Japanese Patent Publication No. 5-84166 is known. In general, an iris recognition device applies near-infrared illumination to the person to be authenticated, shoots an eye image with one video camera using a telephoto lens, extracts iris information from the obtained eye image, and Personal authentication is performed by comparing and collating with the data in the registered iris information database.

In this personal authentication, in order to accurately extract the iris information of the person to be authenticated, the important factor is how accurately the eye image is picked up, and it is necessary to take a picture of the eye in a desired size on the photographing screen. There is. Therefore, the eye position is detected from the captured image of the entire face, and only the eye is zoomed up by a zoom lens or the like to photograph the eye image in a desired size.

A two-camera iris authentication device introduced in Japanese Patent Laid-Open No. 10-40386 has a wide-angle camera for picking up the entire face and a mobile telephoto camera for picking up only the eyes. The position of the eyes is detected in the face image or the upper body image captured by the wide-angle camera, and is transmitted to the movement control portion of the mobile telephoto camera as coordinate information in the wide-angle image. Based on this position information, the mobile telephoto camera is turned to the person to be authenticated to photograph an eye image in a desired size, and detailed iris information is obtained.

[0005]

However, the conventional iris authentication device has the following problems when it is mounted on a terminal device such as a mobile phone in which small size, light weight and low price are strongly desired. For example, in the case of an iris authentication device that zooms in and shoots an iris image with a one-camera method, an advanced zoom function capable of picking up a wide-angle face image to a telephoto eye image must be provided, and the lens is small and low in size. There is a problem that the price does not come.

Further, the above-described two-camera iris authentication device is composed of a wide-angle camera and a telephoto camera having a moving function.
Since it is necessary to equip two cameras, the camera part cannot be made small and lightweight, and further, a drive mechanism and a circuit for moving the telephoto camera are also required,
There is a problem that it is not possible to mount it on a mobile terminal.

The present invention has been made to solve the above problems, and an eye image pickup device, an iris authentication device, and a mobile phone with an iris authentication function, which can obtain a good iris image without a zoom function or a driving mechanism. An object is to provide a terminal device.

[0008]

An eye image pickup apparatus which achieves the above object includes an image pickup camera for capturing an image of an eye, a display unit arranged on the same plane as a lens arrangement position of the image pickup camera, and the display. A guide character generating means for displaying a guide character on the means and guiding the eye position for viewing the guide character.

With this configuration, the person to be authenticated sees the guide character displayed on the display means so that the eye position is guided to the optimum position and distance, and the iris authentication processing is performed by the one-camera system even if the zoom mechanism is not provided. A good magnified iris image is acquired. In addition, the person to be authenticated can be caused to perform a motion of "seeing" the guide character, which also has the effect of opening the eyes.

In the above, preferably, the guide character is superimposed on the image of the eye captured from the image pickup camera and displayed on the display means. With this configuration, the person to be authenticated can easily and intuitively recognize where to match his eyes, and can move the position of his eyes with the guide character as a target.

In the above, the guide character is
It is a cross-shaped character with an intersection at the center of the captured image, a frame-shaped character that fits the outer periphery of the desired size of the black eye, and the directionality indicating the direction in which the eye should move. It is a character, and is characterized by a plurality of concentric characters with the center of the photographed image as the center point. With this configuration, the person to be authenticated can easily and intuitively recognize how to align his or her eyes with the camera.

In the above description, preferably, when the size of the black eye in the eye image is smaller than the desired size, the plurality of concentric characters are turned on or blinked in order from the inner circle to the outer circle. When the size of the iris is larger than a desired size, the plurality of concentric characters are displayed by lighting or blinking sequentially from the outer circle to the inner circle. . With this configuration, the person to be authenticated can easily and intuitively recognize whether the eye position is too close to or far from the camera.

In the above, the guide character generating means is characterized in that each of the plurality of types of guide characters is independently generated, or the plurality of types of guide characters are simultaneously generated. With this configuration, a guide character suitable for guiding the position of the person to be authenticated to the optimum position can be used.

In the above, the guide character generating means generates a guide character indicating that the size of the focused black-eye image in the eye image is imaged to a desired size, and generates the guide character of the focus in the eye image. This configuration is characterized in that the image is displayed on the display unit when the size of the matched black-eye image is picked up to a desired size. It becomes possible to inform.

In the above, the guide character generation means changes the background color displayed on the display means when the size of the focused black-eye image in the eye image is imaged to a desired size. It is characterized by displaying as
Alternatively, the guide character generating means is characterized by continuing to display the eye image as a still image on the display means when the size of the focused black eye image in the eye image is imaged to a desired size. To do. Even with this configuration, it is possible to notify the person to be authenticated that a good image has been acquired for the iris authentication processing.

In the above, when the size of the focused black-eye image in the eye image is imaged to a desired size, the size of the focused black-eye image in the eye image becomes the desired size. It is characterized in that it is provided with a voice notification means for giving a voice notification that the image has been captured. With this configuration as well, it is possible to notify the person to be authenticated that a good image has been acquired for the iris authentication processing.

An iris authentication device that achieves the above object is registered as an eye image capturing device having the above-described configuration and an image of a desired size of a focused black eye in an eye image obtained from the eye image capturing device. It is achieved by including an iris authenticating unit that collates the iris image that has been formed and determines whether or not the iris images match.

By configuring the iris authentication device by the above-mentioned eye image pickup device and iris authentication means, it becomes possible to adopt a one-camera system without a zoom function,
The iris authentication device can be provided at low cost.

A portable terminal device with an iris authentication function that achieves the above object can be achieved by mounting the above iris authentication device. Further, when the mobile terminal device is a mobile phone, the display unit of the mobile phone is also used as the display means.

Since the above-mentioned iris authentication device is a one-camera system without a zoom function, it can be made compact and lightweight, and can be easily mounted on a portable terminal such as a compact mobile phone. Moreover, since an iris image suitable for iris authentication processing can be acquired, high security can be ensured, and functions such as electronic money and credit card can be installed in the mobile terminal device.

[0021]

BEST MODE FOR CARRYING OUT THE INVENTION An embodiment of the present invention will be described below with reference to the drawings.

FIG. 1 is a block diagram of an iris authentication device according to an embodiment of the present invention. This iris authentication device includes an illumination unit 1
0, the imaging unit 20, the display unit 30, the preprocessing unit 40,
The authentication processing unit 50 is included.

The illumination unit 10 is composed of a near-infrared illumination 11 and an illumination control unit 12, and is adapted to irradiate a person to be authenticated with illumination light in an amount suitable for obtaining an eye image.

The image pickup section 20 includes a lens 21, a visible light cut filter 22, an image pickup element 23, and a video signal processing section 2.
It is composed of 4. The eye 1 of the person to be authenticated is illuminated by the near-infrared illumination 11 of the illumination unit 10, and the reflected light from the eye 1 is input to the image sensor 23 through the lens 21 and the visible light cut filter 22.

The incident light input to the image pickup device 23 is photoelectrically converted by the image pickup device 23 and input to the video signal processing section 24 as an electric signal. The video signal processing unit 24 extracts a video signal component from the electric signal input from the image sensor 23, performs necessary processing such as gain adjustment as a video signal, and then outputs the image data of the person 1 to be authenticated. To do.

The preprocessing section 40 comprises a focus degree determination section 41 and a iris position / size determination section 42. The focus degree determination unit 41 determines the focus by performing edge detection or the like from the image data of the eye 1 obtained by the image capturing unit 20. If the desired focus degree is not obtained, the determination result is obtained. Is transmitted to the display unit 30.

The iris position and size determination unit 42 is
From the image data of the eye 1 obtained by the imaging unit 20, the position and size of the iris are determined by processing such as pattern matching. If the desired iris position and size are not obtained, the determination result is displayed on the display unit 30. Tell.

When the iris position and size and the degree of focus of the obtained image data of the eye 1 reach the desired values by repeating the above processing, the image data of the eye 1 is sent to the authentication processing unit 50 in the subsequent stage. Is output.

The authentication processing unit 50 includes an iris information extraction unit 51.
And an iris information storage unit 52 and an iris matching processing unit 53. If the iris authentication device is in the registration mode, the iris information extracted by the iris information extraction unit 51 is accumulated in the iris information accumulation unit 52. If the iris authentication device is in the authentication mode, the iris collation processing unit 53 compares the iris information obtained from the iris information extraction unit 51 with the accumulated data of the iris information accumulation unit 52 registered in the past, An authentication judgment is made as to whether the certifier is a past registrant. The result of the authentication is transmitted to the subsequent processing, and also to the display unit 30 to convey the result of the authentication to the person to be authenticated.

The display unit 30 is a display device 3 such as a liquid crystal monitor.
1, a display signal switch 32, and a character generator 33. Character generator 33
For example, as shown in FIG. 2, as the guide characters displayed on the display 31, a cross-shaped guide character 66,
The desired iris frame guide character 67, the direction instruction guide character 68, and the concentric circle guide character 69 composed of a plurality of circles are generated individually or in combination.

The character generator 33 selects a guide character to be displayed from the guide character group illustrated in FIG. 2 based on the information from the preprocessing unit 40 and the authentication processing unit 50, and inputs it from the image pickup unit 20. The above-mentioned guide character is superimposed on the generated video signal and output to the display signal switch 32.

The display signal switch 32 switches the display information from the main body of the mobile terminal and the display signal from the character generator 33 according to the switching information of the external button 2 of the mobile terminal and outputs the display signal to the display. Has become.

FIG. 3 is a flow chart showing a processing procedure performed by the preprocessing unit 40 in the iris authentication apparatus shown in FIG. When the image of the eye of the person to be authenticated is input from the image capturing unit 20 shown in FIG. 1 to the preprocessing unit 40, it is first determined in step S1 whether the position of the black eye in the eye image is within a desired range. If it is not within the desired range, go to step S4,
Apply the corresponding guide character to the character generator 3
3 and wait until the next eye image is input.

If the position of the iris is within the desired range, the process proceeds from step S1 to step S2. This time, it is determined whether or not the size of the iris is within the desired range, and within the desired range. If not, the process proceeds to step S4 to cause the character generator 33 to generate a corresponding guide character.

If the size of the iris is within the desired range, the process proceeds from step S2 to step S3, this time it is judged whether or not the degree of focus of the eye image is within the desired range, and the desired degree is obtained. If it is not within the range of the focus degree, the process proceeds to step S4, and the character generator 33 is caused to generate a corresponding guide character. That is, if the captured eye image is not a clear image, the authentication process cannot be performed.
A guide character such as "Please stop still" is displayed on the display unit 3.
Display on 1.

When all of the above steps S1, S2, and S3 are cleared, the preprocessing unit 40 passes the eye image input from the image pickup unit 20 to the authentication processing unit 50 of the next stage which performs the iris authentication processing. Becomes

Next, the display form of the above-mentioned guide character will be specifically described. For example, when the iris authentication device shown in FIG. 1 is mounted on a mobile phone, a guide character is displayed on the liquid crystal display of the mobile phone. The left diagram of FIG. 4 is an external view of the mobile phone 60 with an iris authentication function. As shown in the diagram, the liquid crystal display unit 61 and the camera 62 are shown.
And are arranged on the same plane and close to each other. The person to be authenticated, that is, the holder of the mobile phone 60 sets the mobile phone 60 to the iris authentication mode using the external button 63 or the like. The mobile phone 60 displays the screen for iris authentication on the screen of the liquid crystal display unit 61 at the time of entering the iris authentication mode.

The right side of FIG. 4 is an enlarged view of the liquid crystal display section 61 when the mobile phone 60 is in the iris authentication mode.
In this enlarged view, in this example, in addition to the eye image 64 of the person to be authenticated, a cross-shaped guide character 66 that guides the center position of the black eye and a desired black eye frame guide character 67 that guides the target size of the black eye. Is displayed.

The person to be authenticated adjusts the position of his / her eyes with respect to the camera 62 while moving the position of the portable telephone 60 while looking at the liquid crystal display portion 61. At this time, since the liquid crystal display unit 61 and the camera 62 are arranged very close to each other, the line of sight, that is, the center of the eye easily enters the camera view angle. The person to be authenticated uses his / her own eye image 64 and the guide display displayed on the liquid crystal display unit 61 to determine where his / her eyes are now, where to center the eyes, and how large the black eye should be. You can easily find out whether you should copy it.

In this embodiment, the black eye frame guide character 67 for guiding the entire circumference of the black eye is used as the guide display. However, it is not necessary to guide the entire circumference and, for example, as shown in FIG. A circular black-eye frame guide character 67a may be used.

FIG. 6 is a diagram showing an example in which, as a guide character display, a direction indicating guide character 68 indicating which direction the black eye should be moved is displayed. In the example shown in FIG. 6, the black-eye image 65 of the person to be authenticated is shifted to the upper right from the desired black-eye position. Therefore, as shown in FIG.
The direction guidance character 68 is lit or blinked to move the black eye to the lower left on the screen to guide the position. In this example, the lower left direction is instructed by simultaneously displaying two characters 68, an arrow character indicating the left direction and an arrow character indicating the downward direction.

FIG. 7 is a diagram showing an example in which a guide character for displaying a correction instruction is displayed when the size of the black eye is smaller than the desired size. By displaying the direction indicating guide character 68 in four directions of up, down, left, and right toward the outside of the center of the image, the player is guided in a direction in which the black eye is enlarged (the direction in which the eyes approach the camera 61, that is, the direction in which the mobile phone approaches the eyes). .

On the contrary, FIG. 8 is a diagram showing an example in which a guide character for instructing a correction is displayed when the size of the black eye is larger than the desired size. In this case, the direction indicating guide character 68 is displayed in the four directions of up, down, left, and right toward the center of the image to reduce the black eye (the direction in which the eyes are moved away from the camera 61, that is, the direction in which the mobile phone is moved away from the eyes). Direct to.

FIG. 9 is a diagram showing an example in which a concentric guide character 69 centered on the screen center of the display is displayed as the guide character in addition to the example shown in FIG.
By displaying the concentric circle guide character 69 composed of a plurality of concentric circles as shown in FIG. 9, it becomes possible for the person to be authenticated to more clearly recognize the center of the screen (lens center of the camera 61). The certifier's black eye position is easily guided to the center of the screen.

FIG. 10 is a diagram showing a display example of the concentric circle guide character 69 which gives a correction instruction when the size of the black eye is smaller than the desired size. In this case, it is necessary to guide in the direction of increasing the size of the black eye,
Therefore, the plurality of concentric circles of the concentric circular guide character 69 are sequentially turned on or blinked from the inner circle to the outer circle. This allows the person to be authenticated to intuitively recognize that it is necessary to capture a larger image of the black eye,
The eye is brought closer to the camera (in the case of a mobile phone, the mobile phone is brought closer to the eye).

FIG. 11 is a diagram showing a display example of the concentric circle guide character 69 which gives a correction instruction when the size of the black eye is larger than the desired size. In this case, it is necessary to guide in the direction of reducing the size of the black eye,
Therefore, the plurality of concentric circles of the concentric guide character 69 are sequentially turned on or blinked from the outer circle toward the inner circle. As a result, the person to be authenticated can intuitively recognize that it is necessary to image the black eye in a smaller size, and move his / her eyes away from the camera (remove the mobile phone from the eyes).

FIG. 12 is a diagram showing an example in which the result is displayed on the display unit when the black eye portion of the person to be authenticated falls within the desired position, size, and focus range. In the example shown in FIG. 12, the result notification character 70 of “eye position OK” is displayed to notify the person to be authenticated of the end of the guiding action.
Further, in the example of FIG. 12, by changing the color of the background 71 of the liquid crystal display (color of the liquid crystal backlight), the person to be authenticated is more easily notified of the end of the guiding action. still,
It is also possible to give a notification by voice and further notify the iris matching result by using the same notifying means.

Although various guide character displays have been described above, each guide character display may be displayed alone or in combination. A fixed value may be used as the size of the desired black-eye frame guide character 67, but there are few objects to be authenticated,
And if you want to distinguish the size of each person's iris in detail, detect the registrant's iris frame at the first iris information registration,
The registered black-eye frame may be used for subsequent authentication.

Although an example in which the iris authentication device is mounted on the mobile phone has been described, the present invention is not limited to the mobile phone, and when the iris authentication function is applied to another device having a display such as an intercom device. However, the present invention can be applied.

[0050]

According to the present invention, it is possible to provide an eye image pickup device capable of obtaining a good iris image without having a zoom mechanism or a drive mechanism.

[Brief description of drawings]

FIG. 1 is a configuration diagram of an iris authentication device according to an embodiment of the present invention.

FIG. 2 is an explanatory diagram of a guide character used in the iris authentication device according to the embodiment of the present invention.

FIG. 3 is a flowchart showing an iris image acquisition procedure in the iris authentication device according to the embodiment of the present invention.

FIG. 4 is an external view of a mobile phone with an iris authentication function according to an embodiment of the present invention.

FIG. 5 is a diagram showing a modification of the guide character used in the mobile phone with the iris authentication function according to the embodiment of the present invention.

FIG. 6 is an explanatory diagram showing a guidance display when the subject's black eye is displaced to the upper right from the desired black eye position.

FIG. 7 is an explanatory diagram showing a guide display when the subject's black eye is smaller than the desired black eye size.

FIG. 8 is an explanatory diagram showing a guide display when the subject's black eye is larger than the desired black eye size.

FIG. 9 is an explanatory diagram for guiding the hand iris position to the center position using the guide character display.

FIG. 10 is an explanatory diagram showing a guide display when the subject's black eye is smaller than the desired size of the black eye.

FIG. 11 is an explanatory diagram showing a guide display when the subject's black eye is larger than the desired black eye size.

FIG. 12 is an explanatory diagram showing a notification display when the eye position, size, and degree of focus are within a desired range.

[Explanation of symbols]

1 Subject's eyes 2 External button 10 Lighting unit 11 Near infrared lighting 12 Lighting control unit 20 Imaging unit 21 lens 22 Visible light cut filter 23 Image sensor 24 Video signal processor 30 Display 31 Display 32 display signal switch 33 Character Generator 40 Pretreatment section 41 Focus Determining Section 42 Black eye position and size determination unit 50 Authentication processing unit 51 Iris information extraction unit 52 Iris information storage unit 53 Iris matching processing unit 60 mobile phones 61 Liquid crystal display 62 cameras 63 External button 64th image 65 Black Eye 66 Cross-shaped guide character 67 Desired black-eye frame guide character 67a Desired black-eye frame guide character (semicircular shape) 68 Direction Guidance Character 69 Concentric guide character 70 Result Notification Character 71 Background of LCD

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) H04Q 7/38 H04B 7/26 109R // A61B 3/14 M (72) Inventor Honeko Kaneko Yokohama City, Kanagawa Prefecture 4-3, Tsunashima Higashi 4-chome, Kohoku Ward Matsushita Communication Industry Co., Ltd. F-term (reference) 4C038 VA07 VB04 VC01 VC05 5B043 AA09 BA04 DA05 GA01 HA11 5B047 AA23 BA03 CA12 5C022 AA12 AB21 AC03 AC13 AC18 AC42 AC54 AC69 AC71 5K067 A04AA33 A04 EE02 HH22 HH23

Claims (16)

[Claims] 1. An image pickup camera for capturing an image of an eye, a display unit arranged on the same plane as a lens arrangement position of the image pickup camera, and a guide character displayed on the display unit for viewing the guide character. An eye image capturing apparatus, comprising: a guide character generating unit that guides a position. 2. The eye image capturing apparatus according to claim 1, wherein the guide character is superimposed on the image of the eye captured by the image capturing camera and displayed on the display unit. 3. The eye image pickup device according to claim 1, wherein the guide character is a cross-shaped character having an intersection at the image center of the display means. 4. The eye image capturing apparatus according to claim 1, wherein the guide character is a frame-shaped character that matches the outer periphery of a desired size of black eye. 5. The eye image pickup device according to claim 1, wherein the guide character is a directional character that indicates a direction in which the eye should be moved. 6. The eye image pickup device according to claim 1, wherein the guide character is a plurality of concentric circle characters having a center of a screen center of the display means as a center point. 7. When the size of a black eye in an eye image is smaller than a desired size, the plurality of concentric characters are lit or blinked in order from an inner circle to an outer circle, and the black eye is turned on. 7. If the size is larger than a desired size, the plurality of concentric characters are displayed by lighting or blinking sequentially from the outer circle toward the inner circle. Eye image capturing device. 8. The guide character generating means is the guide character according to claim 3, the guide character according to claim 4, the guide character according to claim 5, and the guide character according to claim 5.
The eye image pickup device according to claim 1 or 2, wherein each of the described guide characters is independently generated, or a plurality of guide characters are simultaneously generated. 9. The guide character generating means generates a guide character indicating that the size of the image of the black eye in the eye image is imaged within a desired range. The eye image pickup device according to any one of claims 1 to 8. 10. The guide character generation means generates a guide character indicating that the value of the degree of focus of the black eye in the eye image is within a desired range. The eye image pickup device according to claim 9. 11. The guide character generation means, when at least one of a size of a black eye image in the eye image and a focus degree value of the black eye in the eye image is photographed within a desired range. The eye image pickup device according to any one of claims 1 to 10, wherein a background color displayed on the display unit is changed and displayed. 12. The guide character generating means, when at least one of a size of a black eye image in the eye image and a focus degree value of the black eye in the eye image is photographed within a desired range. 11. The eye image pickup device according to claim 1, wherein the display unit displays the eye image as a still image. 13. The guide character generation means, when at least one of a size of a black eye image in the eye image and a focus value of a black eye in the eye image is photographed within a desired range. The eye image pickup device according to any one of claims 1 to 12, further comprising: a voice notification unit for performing voice notification. 14. An eye image pickup device according to any one of claims 1 to 13, and an image of a desired size of a focused black eye in an eye image obtained from the eye image pickup device. An iris authentication device, comprising: an iris authentication unit that compares a registered iris image to determine whether or not they match. 15. A mobile terminal device comprising the iris authentication device according to claim 14. 16. The mobile terminal device according to claim 15, wherein the mobile terminal device is a mobile phone, and the display means also serves as a display of the mobile phone.