KR101884263B1 - Method and system for estimating iris region through inducing eye blinking - Google Patents

Abstract

The present invention relates to a method and system for rapidly estimating an iris region by inducing eye blinking.
A method for promptly blinking a user's eyes to authenticate a user by quickly estimating an iris region includes the steps of capturing images of the user's eyes and blurred images by photographing the user's face multiple times for a predetermined time, Comparing the plurality of images with each other, discriminating an area having the largest difference between pixel values based on the comparison result, and detecting a pupil area based on the selected grid of the extracted area.

Description

BACKGROUND OF THE INVENTION Field of the Invention [0001] The present invention relates to a method and system for quickly estimating an iris region by inducing blinking of an eye,

The present invention relates to a method and system for quickly estimating an iris region by inducing blinking of an eye. More particularly, the present invention relates to a method and system for quickly estimating an iris region by blinking an eye, And more particularly, to a method and system for interfacing a smart device and an iris recognition module for quickly estimating an iris recognition module.

In order to authenticate a user, a method of recognizing a fingerprint of a person or authenticating a user through iris recognition is widely used in a conventional contact or contactless card system. In recent years, financial transactions and payments using mobile have become common due to the development of information and communication technology, and products equipped with iris recognition module in mobile devices are being launched.

In the iris recognition, a characteristic pattern of an iris is acquired from an iris image photographed by a camera, data is generated using an image processing technique, and the user is authenticated against the previously registered iris data.

This iris recognition method is inconvenient for the user to wait until the recognition is completed without blinking in front of the camera in order to perform iris recognition.

Open Patent Publication No. 10-2016-0068884 discloses an iris biometric module and an access control assembly.

SUMMARY OF THE INVENTION The present invention has been conceived to solve the problems of the related art, and it is an object of the present invention to provide an iris recognition apparatus and an iris recognition apparatus, And to provide a method and system for interworking with a smart device and an iris recognition module for quickly estimating the iris recognition module.

A method for promptly blinking a user's eyes to authenticate a user by quickly estimating an iris region includes the steps of capturing images of the user's eyes and blurred images by photographing the user's face multiple times for a predetermined time, Comparing the plurality of images with each other, discriminating an area having the largest difference between pixel values based on the comparison result, and detecting a pupil area based on the selected grid of the extracted area.

Thereafter, the step of detecting the iris information based on the detected pupil region and the step of authenticating the user by comparing the registered iris information with the detected iris information are performed.

In the step of photographing an image, when a user's face is sensed, automatic focus photographing is performed for 0 to 10 seconds to obtain a plurality of eye-closed images and blurred images.

The number of selected grids in the extracted region for detecting the pupil region is within 10% of the total number of grids in the image.

There is provided an apparatus for promptly blinking a user's eyes to authenticate a user by quickly estimating an iris region, the apparatus comprising: a camera unit for photographing the face of the user a plurality of times for a predetermined period of time; A control unit for determining an area having the largest difference between pixel values based on a comparison result of the pixel comparison unit; a control unit for detecting a pupil area of the user based on the selected grid of the area extracted by the control unit, And a detection unit for detecting the iris information based on the area.

The apparatus further includes an authentication unit for authenticating the user by comparing the iris information of the user stored in the memory unit with the detected iris information, and a memory unit for receiving and storing iris information of the user in advance. When the user senses the face of the user, the camera unit performs auto focus shooting for 0 to 10 seconds to acquire a plurality of eye-closed images and blurred images.

The device is implemented as a wired connection such as universal serial bus on-the-go (USB_OTG) of a smart device such as USB to be connected to a USB slot of a PC or a mobile terminal, and a system for interfacing with a wireless connection form such as WiFi, Bluetooth or NFC .

The present invention has the effect of promptly authenticating a user by rapidly estimating an iris region based on a difference image between a captured image of a closed eye and an image of a rising eye even if the user blinks in the iris recognition.

In addition, since the liveness can be confirmed by estimating the iris region while blinking, it is possible to prevent forgery and alteration.

USB, USB OTG, WiFi, Bluetooth, etc., can be connected to mobile devices that do not have iris recognition module.

1 is a conceptual diagram of a system for quickly estimating an iris region by inducing blinking of eyes according to an embodiment of the present invention.
FIG. 2 is a flowchart illustrating a method for quickly estimating an iris region by inducing an eye flicker according to an embodiment of the present invention. Referring to FIG.
FIG. 3 is a block diagram of a system for quickly estimating an iris region by inducing an eye flicker according to an embodiment of the present invention. Referring to FIG.
FIG. 4 illustrates an example of a wired connection such as a USB-OTG (universal serial bus on-the-go) of a terminal and iris recognition apparatus according to an exemplary embodiment of the present invention and an interface signal of a wireless connection such as WiFi, Bluetooth, .
5 is an exemplary view illustrating a USB-OTG signal connecting a camera unit and a control unit in the iris recognition apparatus according to an embodiment of the present invention.
FIG. 6 is an exemplary view showing a blurred image and an eye-closed image of a user according to an embodiment of the present invention.
FIG. 7 is a diagram for explaining a method of detecting a pupil region by comparing images photographed in FIG. 3;
8 is a diagram for explaining a lighter computation algorithm for detecting a pupil region of the present invention.

It is to be understood that the specific structural or functional description of embodiments of the present invention disclosed herein is for illustrative purposes only and is not intended to limit the scope of the inventive concept But may be embodied in many different forms and is not limited to the embodiments set forth herein.

The embodiments according to the concept of the present invention can make various changes and can take various forms, so that the embodiments are illustrated in the drawings and described in detail herein. It is not intended to be exhaustive or to limit the invention to the particular forms disclosed, but on the contrary, is intended to cover all modifications, equivalents, or alternatives falling within the spirit and scope of the invention.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, the terms "comprises" or "having" and the like are used to specify that there are features, numbers, steps, operations, elements, parts or combinations thereof described herein, But do not preclude the presence or addition of one or more other features, integers, steps, operations, components, parts, or combinations thereof.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings attached hereto.

1 is a conceptual diagram of a system for quickly estimating an iris region by inducing blinking of eyes according to an embodiment of the present invention.

Referring to FIG. 1, a system 10 for quickly estimating an iris region by inducing an eye blink includes an iris recognition apparatus 100 and a terminal 200. The iris recognition apparatus 100 can capture a face of a user by incorporating a camera 110 and transmit the photographed image to the terminal 200 to recognize a user's iris and perform user authentication.

The terminal 200 is a computing device that is not limited to a mobile computing device that is capable of executing a processor defined by operating system software and various application software, such as a smart phone or a tablet PC, , Desktop PCs, and laptop PCs.

The iris recognition apparatus 100 and the terminal 200 can transmit and receive images and the like through wired / wireless communication such as USB, USB OTG (on-the-go), WiFi and Bluetooth.

FIG. 2 is a flowchart illustrating a method for quickly estimating an iris region by inducing an eye flicker according to an embodiment of the present invention. Referring to FIG.

Referring to FIG. 2, a method of quickly inducing blinking and rapidly estimating an iris region is performed as follows. First, the camera unit 110 of the iris recognition apparatus 100 photographs a user's face multiple times for a predetermined time period, And blurred images (S110). At this time, when the user's face is sensed, the automatic focus photographing is performed for 0 to 10 seconds to acquire a plurality of eye-closed images and blurred images. In addition, an infrared sensor may be further provided to detect that the user has entered the camera within a predetermined radius of the camera unit 110, and perform imaging. The iris recognition apparatus 100 may transmit the photographed images to the terminal 200. [

Thereafter, the pixel comparison unit 240 of the terminal 200 compares the plurality of photographed images (S120), and determines an area having the largest difference between the pixel values based on the comparison result (S130).

Thereafter, the detection unit 250 of the terminal 200 detects the pupil region based on the selected grid of the extracted region (S140), and detects the iris information of the user based on the detected pupil region (S150). At this time, the number of selected grids in the extracted region for detecting the pupil region is within 10% of the total number of grids in the image.

Thereafter, the authentication unit 230 of the terminal 200 compares the iris information of the user stored in the memory unit 220 with the detected iris information to authenticate the user (S160). In addition, the authentication unit 230 can determine whether the image is falsified or altered by estimating the iris region while blinking at the time of user authentication.

FIG. 3 is a block diagram of a system for quickly estimating an iris region by inducing an eye flicker according to an embodiment of the present invention. Referring to FIG.

Referring to FIG. 3, a system 10 for quickly estimating an iris region by inducing blinking of a user includes an iris recognition apparatus 100 and a terminal 200.

The iris recognition apparatus 100 includes a camera unit 110, a first interface unit 120, and a first control unit 130.

The camera unit 110 may capture images of the user's eyes and blurred images by photographing the user's face plural times for a predetermined time. When the user recognizes the face of the user, the camera unit 110 performs auto focus shooting for 0 to 10 seconds to acquire a plurality of eye-closed images and a blurred image. However, the photographing time is not limited, and the auto focus photographing can be performed for 0 to 5 seconds according to the embodiment. The camera unit 110 may further include an infrared sensor to detect that the user has entered the camera unit 110 within a certain radius of the camera unit 110 and to perform imaging. That is, when a user enters a certain radius without driving a separate application, it is possible to capture a plurality of eye-closed images and blurred images by photographing the user's face a plurality of times.

The first interface unit 120 is a communication module that exchanges data with an external device. The first interface unit 120 transmits images photographed from the camera unit 110 to the terminal 200 through the second interface unit 260 of the terminal 200 through wired / wireless communication such as USB, USB OTG, WiFi, Bluetooh, Lt; / RTI >

The first control unit 130 controls the camera unit 110 and the first interface unit 120 to guide the user to blink and blink. A method of inducing blinking of the eyes may include a method of inducing voice, text, .

The terminal 200 includes a second control unit 210, a memory unit 220, an authentication unit 230, a pixel comparison unit 240, a detection unit 250, and a second interface unit 260.

The second control unit 210 controls the process of the process related to the execution of the application software and controls the operation of each configuration of the terminal 200. [ The second control unit 210 can control the process of the execution related process using the web browser through the world wide web as well as the application software.

The pixel comparing unit 240 compares a plurality of images photographed from the iris recognition apparatus 100 with each other and can identify the region having the largest difference between the pixel values of the comparison results. The pixel comparing unit 240 may detect an eye region based on the feature points of the face region image and discriminate the region having the largest difference in pixel values with respect to each of the detected eye regions.

The detection unit 250 can detect the user's pupil region based on the selected grid of the region extracted by the pixel comparison unit 240 and detect the iris information based on the detected pupil region. Using the characteristics of the gray level based on the detected pupil area, iris region can be separated and iris information can be detected in the extracted iris region.

The authentication unit 230 can authenticate the user by comparing the iris information of the user of the memory unit 220, which receives and stores the iris information of the user in advance, with the iris information detected by the detection unit 250.

The first interface unit 260 is capable of receiving images photographed from the camera unit 110 through wired / wireless communication with the first interface unit 120 of the iris recognition apparatus 100 via USB, USB OTG, WiFi, Bluetooh, have.

That is, according to the present invention, even if the user blinks in the iris recognition, the iris region is quickly estimated based on the difference image between the closed-eye image and the eye-opening image, It can be connected to a mobile device not equipped with an iris recognition module.

FIG. 4 illustrates an example of a wired connection such as a USB-OTG (universal serial bus on-the-go) of a terminal and iris recognition apparatus according to an exemplary embodiment of the present invention and an interface signal of a wireless connection such as WiFi, Bluetooth, 5 is a diagram illustrating an example of a USB-OTG signal connecting a camera unit and a control unit in the iris recognition apparatus according to an embodiment of the present invention.

4 illustrates signal waveforms when the first interface unit 120 of the iris recognition apparatus 100 and the second interface unit of the terminal 200 are connected by USB 2.0 or USB 2.0 OTG. Has a characteristic of transmitting data at a high speed by transmitting a signal in a differential manner to two lines and receiving less influence from noise.

5, there is shown a waveform of a mobile industry processor interface (MIPI) signal used for connecting the camera unit 110 and the first controller 130 in the iris recognition apparatus 100, To transmit data at high speed and to receive less influence from noise. 4 and 5 illustrate signal waveforms according to an embodiment and are not limited to connection schemes.

FIG. 6 is an exemplary view showing a blurred image and an eye-closed image of a user according to an embodiment of the present invention.

6, the camera unit 110 of the iris recognition apparatus 100 photographs a face of a user for a predetermined period of time and generates a blurred image (Figs. 6 (a) and 6 (c) 6 (b)). This is an image that is continuously photographed, and these images can be mixed naturally. According to an embodiment of the present invention, a discriminator (not shown) for discriminating the brightest blurred image and the sensed image among a plurality of photographed images may be further provided so that the pupil region can be detected through the difference image by extracting two images .

FIG. 7 is an exemplary diagram illustrating a method of detecting a pupil region by comparing images photographed in FIG. 6;

7 (a) is a diagram showing a difference between blurred images, FIG. 7 (b) is a diagram showing a difference between a blurred image and a sensed image, and FIG. 7 (c) (b), and a grid image 410 in which a pupil region is searched through a threshold value based on a drawing showing the difference between the blurred image and the sensed image.

When the present invention is used, the number of gratings used in the search can be reduced to about 1/10 of the number of gratings in the whole image, and iris recognition can be performed quickly.

8 is a diagram for explaining a lighter computation algorithm for detecting a pupil region of the present invention.

Referring to FIG. 8, the lighter computation algorithm divides the entire image into a rectangular grid, calculates an average pixel value for each lattice point, calculates a grid value providing the lowest value among the calculated average values, . 8A, a rectangular grid shape 530 is used for the pupil region 510 and the iris region 520 for the entire eye image. 8 (b), the pupil region 510 can be detected after the initial pupil region grating 540 is detected and the morphology processing is performed in FIG. 8 (c). In other words, this algorithm calculates the average pixel value for each lattice point and determines the grid with the most pixel value as the initial position of the pupil area. The present invention has devised a method and an apparatus for quickly estimating an iris region based on a difference image between an eye closed image and an eye opening image even if a user blinks based on the above algorithm.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is evident that many alternatives, modifications and variations will be apparent to those skilled in the art. Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.

100; Iris recognition device 110; Camera part
120; A first interface unit 130; [0035]
200; A terminal 210; The second control section
220; A memory unit 230; Authentication unit
240; Pixel comparison number 250; The detection unit
260; The second interface unit

Claims (10)

The present invention relates to a method of quickly authenticating a user by inducing blinking of a user's eye to quickly estimate an iris region,
(a) capturing a plurality of images of the user's face for a predetermined period of time to acquire images of the user's eyes and blurred images;
(b) comparing each of the plurality of photographed images;
(c) determining an area having a largest difference in pixel value based on the comparison result;
(d) detecting a pupil region based on the selected grating of the extracted region,
The step of detecting the pupil region in the step (d) may include dividing the entire image into a rectangular lattice, calculating an average pixel value for each lattice point, and calculating a lattice providing the lowest value among the calculated average values, And a pupil region is detected by performing a morphology process. The method for quickly estimating an iris region by inducing blinking of an eye. The method according to claim 1,
(e) detecting iris information based on the detected pupil region;
(f) comparing the registered iris information with the detected iris information to authenticate the user, wherein the blinking of the eye is induced to quickly estimate the iris region. The method according to claim 1,
In the step (a), when the face of the user is sensed, automatic focus sensing is performed for 0 to 10 seconds to induce blinking of eyes to acquire a plurality of eye-sighted images and blurred images, thereby quickly estimating the iris region. The method according to claim 1,
In the step (d), the number of selected grids in the extracted region is less than 10% of the total number of grids in the image, thereby inducing blinking of the eye, thereby quickly estimating the iris region. 3. The method of claim 2,
In the step (f), an iris region is estimated during blinking in user authentication, thereby inducing an eye flicker for judging whether or not falsification and modulation are performed, thereby quickly estimating an iris region. The present invention relates to a device for authenticating a user by quickly estimating an iris region by inducing blinking of a user's eyes,
An iris recognition device including a camera for photographing the user's face plural times for a predetermined time;
A pixel comparison unit for comparing a plurality of images photographed by the iris recognition device with each other and determining an area having a largest difference in pixel value based on the comparison result; And a detection unit for detecting a pupil region of the user and detecting iris information based on the detected pupil region,
The pixel comparison unit divides the entire image into a rectangular grid, calculates an average pixel value for each grid point, determines a grid providing the lowest value among the calculated average values as an initial position for the pupil region, Wherein the pupil region is detected by detecting a pupil region of the iris region. The method according to claim 6,
The terminal comprises:
A memory unit for receiving and storing iris information of a user in advance; And
And an authentication unit for comparing the iris information of the user stored in the memory unit and the detected iris information to authenticate the user, wherein the iris information is quickly estimated by inducing an eye flicker. 8. The method of claim 7,
Wherein the authentication unit estimates the iris region while blinking at the time of user authentication, thereby inducing an eye flicker for judging whether the image is forged or altered, thereby quickly estimating the iris region. The method according to claim 6,
Wherein the camera unit performs automatic focus photographing for 0 to 10 seconds when a user's face is sensed to induce blinking of eyes to acquire a plurality of eye-closed images and blurred images, thereby quickly estimating the iris region. The method according to claim 6,
Wherein the iris recognition device and the terminal are connected to each other through at least one interface of USB, USB OTG, WiFi, and Bluetooth to induce an eye flicker to transmit / receive data, thereby quickly estimating the iris region.

Images