KR20160044403A - User Terminal Device and Method for Iris Recognition thereof - Google Patents

Abstract

A user terminal device and an iris recognition method using the user terminal device are provided. The user terminal device comprises: an imaging unit which photographs an image of a user; a display unit which displays the photographed image; and a control unit which detects user′s eye from the photographed image, controls the display unit to display a guide image at a position where the detected user′s eye is present in the photographed image, and performs iris recognition when the difference between the size of the iris included in the detected user′s eye and the size of the guide image falls within a preset range.

Description

Technical Field [0001] The present invention relates to a user terminal device and an iris recognition method therefor,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a user terminal and an iris recognition method thereof, and more particularly, to a terminal device and a iris recognition method for displaying a guide image for recognizing a user iris.

Various personal information and content information are stored in a user terminal device used by an individual, and the demand for security of the user terminal device is increasing. In particular, in the past, a method of inputting a password for security of a user terminal device has been used. Recently, various authentication methods such as fingerprint recognition, speech recognition, and iris recognition have been introduced.

Particularly, in the case of iris recognition, in a conventional user terminal, a user looks at a mirror-shaped infrared pass filter called a cold mirror and attempts to recognize iris by matching his or her eyes. However, there is a position and size of the iris that can be recognized by the user terminal device in order for the user terminal to perform iris recognition. However, in the past, the user can not recognize the position and size of the iris, There was a difficulty in recognition. Particularly, in the case of a user terminal equipped with a photographing portion which can not be controlled automatically, it is difficult to determine an appropriate recognition distance for iris recognition.

Also, for the iris recognition, the user terminal device needs a process for registering the user iris code. In particular, when registering the user iris code, several iris images are acquired to obtain high quality iris images, and the acquired images are analyzed and stored in an iris code database obtained from one or more iris images judged to be high quality images . Even if the user's iris code is stored in the selected iris image by acquiring a plurality of iris images, there arises a problem that it obstructs the accurate iris recognition due to the portion covered by the eyelid and the eyebrow.

It is an object of the present invention to provide a user terminal device and an iris recognition method therefor which enable a user to perform iris recognition more conveniently and accurately.

According to an aspect of the present invention, there is provided a user terminal including: a photographing unit photographing a user; A display unit for displaying the photographed image; And controlling the display unit to display a guide image at a position where the detected user eye exists among the photographed images, wherein the size of the iris included in the detected user eye And a controller for performing iris recognition when the size difference of the guide image is within a predetermined range.

The control unit detects the iris boundary on the detected user's eye, estimates the iris diameter based on the detected iris boundary, and responds to the user's eyes and iris based on the recognized user's eye and iris diameter The control unit can control the display unit to display the guide image at a position where the guide image is displayed.

In addition, the guide image may include an eye guide image corresponding to the user's eyes and an iris guide image corresponding to the user's irises.

The guide image may be an image corresponding to a size of a user's eye and iris existing at a position corresponding to a focal distance of the photographing unit.

The control unit detects the user iris in the photographed image, and when the difference between the detected size of the user iris and the size of the guide image corresponding to the iris is less than a preset value, It is possible to perform the iris recognition of the user.

The controller detects the user iris in the photographed image, and when the difference between the detected size of the user iris and the size of the guide image corresponding to the iris is less than a preset value, Messages can be output.

The control unit may control the image processing unit to process the photographed image so that the pattern of the user's iris can not be recognized while the iris recognition is performed, The display unit may be controlled to display the image.

The controller may generate an iris code by normalizing the detected iris region into a rectangular shape, mask an area covered by the eyebrow or the eyelid among the iris codes normalized by the rectangle, and determine a remaining region excluding the masked region It is possible to perform the iris recognition of the user by comparing with the previously registered iris code.

In addition, when the detected iris region is recognized as a pre-registered user, the controller may update the iris code of the previously registered user using the remaining region of the detected iris region excluding the masked region have.

According to another aspect of the present invention, there is provided an iris recognition method for a user terminal, comprising: capturing a user; Displaying the photographed image; Detecting a user's eye on the photographed image; Displaying a guide image at a position where the detected user eye exists among the photographed images; And performing iris recognition when the difference between the size of the iris included in the detected user's eye and the size of the guide image is within a predetermined range.

The detecting of the user eye may include detecting an iris boundary on the detected user eye, The method of claim 1, further comprising: estimating an iris diameter based on the detected iris boundary, wherein the step of displaying the guide image includes displaying the iris diameter at a position corresponding to the user's eyes and irises based on the recognized user's eyes and iris diameter A guide image can be displayed.

In addition, the guide image may include an eye guide image corresponding to the user's eyes and an iris guide image corresponding to the user's irises.

The guide image may be an image corresponding to a size of a user's eye and iris existing at a position corresponding to a focal distance of the photographing unit.

If the difference between the detected size of the user iris and the size of the guide image corresponding to the iris is less than a preset value, the detecting of the detected user iris It is possible to perform iris recognition of the user by judging whether or not the iris is coincident with the previously registered iris.

If the difference between the size of the detected user iris and the size of the guide image corresponding to the iris is less than a preset value, the iris recognition of the user is performed. And outputting a feedback message to guide the user.

The step of displaying the photographed image may further include the steps of: processing the photographed image so that the pattern of the user's iris can not be confirmed during the iris recognition; And displaying the processed image.

The performing step may include generating an iris code by normalizing the detected iris area into a rectangular shape, masking an iris code normalized by the rectangle, masked by an eyebrow or an eyelid, Area can be compared with the previously registered iris code to perform the iris recognition of the user.

And updating the iris code of the previously registered user using the remaining region of the detected iris region excluding the masked region when the detected iris region is recognized as a pre-registered user .

According to various embodiments of the present invention as described above, the user can perform iris recognition more conveniently and accurately.

1 is a block diagram schematically illustrating a configuration of a user terminal according to an embodiment of the present invention;
2 is a block diagram illustrating a detailed configuration of a user terminal according to an exemplary embodiment of the present invention.
FIGS. 3A and 3B illustrate a guide image for iris recognition according to an embodiment of the present invention;
4A to 4C are flowcharts for explaining a method of extracting iris features in consideration of eyelids and eyelashes according to an embodiment of the present invention,
FIGS. 5A through 5C are diagrams illustrating image processing for an image captured for security according to an embodiment of the present invention; FIGS.
FIGS. 6A and 6B are views showing an iris masked by an eyelid or an eyebrow, according to an embodiment of the present invention,
7 is a diagram for explaining a method of generating an iris code according to an embodiment of the present invention;
Figures 8A-10 illustrate a method for normalizing an iris region according to various embodiments of the present invention,
11 is a diagram for explaining a method for updating an iris code according to an embodiment of the present invention;
FIG. 12 is a flowchart illustrating an iris recognition method of a user terminal according to an embodiment of the present invention. FIG.
13 is a flowchart illustrating an iris code storing and updating method of a user terminal according to an exemplary embodiment of the present invention.
14A to 18 are views for explaining an embodiment of switching a screen through iris recognition of a user terminal according to another embodiment of the present invention,
FIGS. 19A and 22 are diagrams for explaining an embodiment of performing iris recognition through an eye-shaped gaze UI according to an embodiment of the present invention,
23 to 29 are diagrams for explaining an embodiment in which iris recognition is performed using a plurality of reference images acquired according to photographing conditions, according to another embodiment of the present invention.

These embodiments are capable of various modifications and various embodiments, and specific embodiments are illustrated in the drawings and described in detail in the description. It is to be understood, however, that it is not intended to limit the scope of the specific embodiments but includes all transformations, equivalents, and alternatives falling within the spirit and scope of the disclosure disclosed. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS In the following description of the embodiments of the present invention,

The terms first, second, etc. may be used to describe various elements, but the elements should not be limited by terms. Terms are used only for the purpose of distinguishing one component from another.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the scope of the claims. The singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, the terms "comprise", "comprising" and the like are used to specify that there is a stated feature, number, step, operation, element, component, or combination thereof, But do not preclude the presence or addition of features, numbers, steps, operations, components, parts, or combinations thereof.

In the embodiment, 'module' or 'sub' performs at least one function or operation, and may be implemented in hardware or software, or a combination of hardware and software. In addition, a plurality of 'modules' or a plurality of 'parts' may be integrated into at least one module except for 'module' or 'module' which need to be implemented by specific hardware, and implemented by at least one processor (not shown) .

In the embodiment, it is assumed that the user terminal device collectively refers to a mobile stationary or stationary user station device such as a UE (User Equipment), an MS (Mobile Station), an AMS (Advanced Mobile Station)

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. Referring to the accompanying drawings, the same or corresponding elements are denoted by the same reference numerals, and a duplicate description thereof will be omitted.

1 is a block diagram briefly showing a configuration of a user terminal device 100 according to an embodiment of the present invention. 1, the user terminal 100 includes a photographing unit 110, a display unit 120, and a control unit 130. [

The photographing unit 110 photographs the user. In particular, the photographing unit 110 may photograph the face region of the user to recognize the iris of the user.

The display unit 120 displays an image under the control of the controller 130. In particular, the display unit 120 can display an image photographed by the photographing unit 110. Also, the display unit 120 may display a guide image for iris recognition on the photographed image.

The control unit 130 controls the overall operation of the user terminal device 100. In particular, the control unit 130 detects the user's eyes in the image captured by the photographing unit 110, and controls the display unit 120 to display the guide image at a position where the detected user's eyes exist in the captured image Iris recognition can be performed when the difference between the size of the iris detected by the user's eye and the size of the guide image is within a preset value.

Specifically, the control unit 130 detects the iris boundary on the detected user's eye, estimates the iris diameter based on the detected iris boundary, and calculates a position corresponding to the user's eye and iris based on the recognized user's eye and iris diameter The display unit 120 may be controlled to display the guide image on the display unit 120. [ Here, the guide image includes an eye guide image corresponding to the user's eye and an iris guide image corresponding to the user's iris, the eye guide image is displayed at a position corresponding to the user's eye, the iris guide image is displayed at a position corresponding to the user's iris Lt; / RTI >

In particular, the guide image may be an image corresponding to the sizes of the user's eyes and irises existing in positions corresponding to the focal length of the photographing unit 110. [ That is, when the user is located farther away from the focal length of the photographing unit 110, the eye guide image and the iris guide image may be larger than the actual user's eye and iris. When the user is located closer to the focal distance of the photographing unit 110 The eye guide image and the iris guide image may be smaller than the actual user's eye and iris. Accordingly, the user can perform the iris recognition by adjusting the distance from the photographing unit 110 through the guide image.

When the user iris is detected in the photographed image and the difference between the detected size of the user iris and the size of the guide image corresponding to the iris is less than a predetermined value, The controller 130 may determine whether the detected user iris matches the previously registered iris and perform iris recognition of the user. In particular, the controller 130 may detect the iris code in the detected user iris and perform user authentication by comparing the iris code with previously registered iris codes.

If the difference between the detected size of the user iris and the size of the guide image corresponding to the iris is less than a predetermined value, that is, if the user is located at a distance at which iris recognition is possible , The control unit 130 may output a feedback message to guide the user to perform iris recognition. At this time, the feedback message may be implemented with at least one of a visual feedback message (e.g., an image), an auditory feedback message (e.g., audio), and a tactile feedback message (e.g., vibration).

In order to enhance the security during the iris recognition, the controller 130 processes the photographed image so that the user iris pattern can not be recognized while the user performs the iris recognition, and displays the processed image on the display unit 120 Can be controlled.

Also, the controller 130 may generate the iris code by normalizing the detected iris region into a rectangular shape. The controller 130 masks the iris code normalized by the rectangle, masked by the eyebrows or eyelids, and performs iris recognition of the user by comparing the remaining irregularities with the previously registered iris code except for the masked area .

In addition, when the detected iris region is recognized as a pre-registered user, the controller 130 can update the iris code of the previously registered user by using the remaining region excluding the masked region of the detected iris region.

With the user terminal device 100 as described above, the user can more easily and accurately perform iris recognition and authenticate the user.

Hereinafter, various embodiments of the present invention will be described with reference to FIGS. 2 to 7. FIG.

FIG. 2 is a block diagram illustrating a detailed configuration of a user terminal 200 according to an embodiment of the present invention. 2, the user terminal 200 includes a communication unit 210, a photographing unit 220, an image processing unit 230, a display unit 240, a storage unit 250, an input unit 260, (Not shown).

The communication unit 210 is configured to perform communication with various types of external devices according to various types of communication methods. The communication unit 210 may include various communication chips such as a Wi-Fi chip, a Bluetooth chip, an NFC chip, a wireless communication chip, an IR chip, and the like. At this time, the Wi-Fi chip, the Bluetooth chip, the NFC chip, and the IR chip communicate by WiFi, Bluetooth, NFC, and IR, respectively. Among these, the NFC chip refers to a chip operating in an NFC (Near Field Communication) system using 13.56 MHz band among various RF-ID frequency bands such as 135 kHz, 13.56 MHz, 433 MHz, 860 to 960 MHz and 2.45 GHz. When a Wi-Fi chip or a Bluetooth chip is used, various connection information such as an SSID and a session key may be transmitted and received first, and communication information may be used to transmit and receive various information. The wireless communication chip refers to a chip that performs communication according to various communication standards such as IEEE, ZigBee, 3G (3rd Generation), 3rd Generation Partnership Project (3GPP), LTE (Long Term Evolution)

The photographing unit 220 performs a photographing operation. At this time, the photographing unit 220 is located at the front of the user terminal device 100 and can photograph the user. In addition, the photographing unit 220 may include a mirror-type infrared ray passing filter called a cold mirror.

The image processing unit 230 processes the image captured by the photographing unit 220. At this time, the image processing unit 230 may perform image processing on the image photographed by the photographing unit 220 to enhance security.

The display unit 240 displays images and UI input from various sources. In particular, the display unit 240 may display an image photographed by the photographing unit 220, and may display a guide image for iris recognition at a position corresponding to the user's eyes among the photographed images.

The storage unit 250 stores various modules for driving the user terminal device 200. For example, the storage unit 250 may store software including a base module, a sensing module, a communication module, a presentation module, a web browser module, and a service module. At this time, the base module is a base module that processes a signal transmitted from each hardware included in the user terminal device 200 and transfers the processed signal to an upper layer module. The sensing module is a module for collecting information from various sensors and analyzing and managing the collected information, and may include a face recognition module, a voice recognition module, a motion recognition module, and an NFC recognition module. The presentation module is a module for constructing a display screen, and may include a multimedia module for reproducing and outputting multimedia contents, a UI, and a UI rendering module for performing graphics processing. The communication module is a module for performing communication with the outside. A web browser module refers to a module that accesses a web server by performing web browsing. A service module is a module including various applications for providing various services.

As described above, the storage unit 250 may include various program modules, but it goes without saying that the various program modules may be omitted, modified or added depending on the type and characteristics of the user terminal device 200. For example, when the user terminal device 200 is implemented as a tablet PC, the base module may further include a position determination module for determining a GPS-based position, and the sensing module may include a sensing module .

Also, the storage unit 250 stores iris codes corresponding to at least one user. At this time, the iris code is data obtained by normalizing the iris region of the user into a rectangular shape, and is used for iris recognition. At this time, if the iris recognition is successful, the storage unit 250 can update the iris code of the user by the control unit 270. [

The input unit 260 receives various user commands for controlling the user terminal 200. The input unit 260 may be implemented as a touch screen. However, the input unit 260 may be implemented by various types of input devices (e.g., a remote controller, a keyboard, a mouse, and a pointing device)

The control unit 270 controls the overall operation of the user terminal 200 using various programs stored in the storage unit 250.

2, the control unit 270 includes a RAM 271, a ROM 272, a graphics processing unit 273, a main CPU 274, first to n interfaces 275-1 to 275-n, Bus 276. < / RTI > At this time, the RAM 271, the ROM 272, the graphic processor 273, the main CPU 274, the first through n interfaces 275-1 through 275-n, etc. may be connected to each other via the bus 276 .

A ROM 272 stores a command set for booting the system and the like. The main CPU 274 copies the O / S stored in the storage unit 250 to the RAM 271 according to the instruction stored in the ROM 272, and executes the O / S To boot the system. When the booting is completed, the main CPU 274 copies various application programs stored in the storage unit 250 to the RAM 271, executes the application program copied to the RAM 271, and performs various operations.

The graphic processing unit 273 generates a screen including various objects such as a pointer, an icon, an image, and a text using an operation unit (not shown) and a rendering unit (not shown). The operation unit calculates an attribute value such as a coordinate value, a shape, a size, a color, and the like to be displayed by each object according to the layout of the screen using the control command received from the input unit. The rendering unit generates screens of various layouts including the objects based on the attribute values calculated by the operation unit. The screen generated by the rendering unit is displayed in the display area of the display unit 240.

The main CPU 274 accesses the storage unit 250 and performs booting using the O / S stored in the storage unit 250. [ The main CPU 274 performs various operations using various programs, contents, data stored in the storage unit 250, and the like.

The first to n-th interfaces 275-1 to 275-n are connected to the various components described above. One of the interfaces may be a network interface connected to an external device via a network.

In particular, the control unit 270 controls the display unit 240 to detect the user's eyes in the image photographed by the photographing unit 220 and display the guide image at a position where the detected user's eyes exist in the photographed image .

In particular, the control unit 270 may detect an eye from an image photographed through the photographing unit 220, and may detect an iris boundary based on the detected eye position.

Specifically, the control unit 270 can calculate the center coordinates (x, y) of the eye from the detected eye region. At this time, the control unit 270 may calculate the center coordinates of the region estimated to be the eye region as the center coordinates of the eye, or calculate the illumination reflected light (i.e., glint) that forms the pupil region in the eye region as the center coordinates of the eye .

The controller 270 can detect the iris boundary by analyzing the degree of change of the pixel value with reference to the center of eye. At this time, the degree of change of the pixel value can utilize the first differential value or the second differential value as well as the luminance difference of the adjacent pixels.

In this case, in one embodiment of detecting the iris boundary, the controller 270 searches for a specific direction determined for iris boundary detection based on the eye center coordinate. The control unit 270 may use a method of estimating a circle approximating the minutiae obtained by analyzing the degree of change of pixel values in the searching process. The method of determining the feature point by analyzing the degree of change of the pixel value can determine the portion where the degree of change of the pixel value suddenly increases or decreases as the feature point position. In another embodiment of detecting the iris boundary, the controller 270 finds a circle having the maximum degree of change in the pixel values of the inside and outside of the circle while changing the center point and the size of the circle on the basis of the eye center coordinate The center of the iris and the boundary line may be detected. The control unit 270 may also use an ellipse in which the center of the ellipse and the major axis and minor axis of the ellipse are changed with reference to the center of the eye, The center of the iris and the boundary line may be detected.

Then, the controller 270 can estimate the iris diameter based on the detected iris boundary line.

The control unit 270 may control the display unit 240 to display the guide image at a position corresponding to the user's eyes and irises based on the recognized user's eyes and iris diameter. Here, the guide image may be an image corresponding to the sizes of the user's eyes and the irises existing in positions corresponding to the focal length of the photographing unit 220. [ In addition, the guide image may include an eye guide image corresponding to the user's eyes and an iris guide image corresponding to the user's irises. The eye guide image and the iris guide image may have a statistical size of the user's eyes and irises when the user exists at a position corresponding to the focal distance of the photographing unit 220. [

3A, the control unit 270 controls the display unit 240 to display the eye guide image 310 around the detected eye, and displays the iris guide image (FIG. 3A) around the user's iris The display unit 240 may be controlled so as to display the display image. At this time, the controller 270 may control the display unit 240 to display the actually detected user's iris line 330 together with the guide images 310 and 320 in order to check the position and distance at which the user should align his or her eyes .

At this time, the user can confirm that the iris line 330 is smaller than the iris guide image 320. Accordingly, the user confirms that the user is far away from the user terminal 200 based on the guide images 310 and 320 and the iris line 330 and confirms that the user terminal 200 is far away from the user terminal 200, . ≪ / RTI >

3B, the control unit 270 controls the display unit 240 to display the eye guide image 310 around the detected eye, and displays the iris guide image 310 around the iris of the user, The display unit 240 may be controlled so as to display the display unit 320. At this time, the controller 270 may control the display unit 240 to display the actually detected user's iris line 340 together with the guide images 310 and 320 in order to confirm the position and the distance at which the user should align his or her eyes .

At this time, the user can confirm that the iris line 340 is larger than the iris guide image 320. Accordingly, the user confirms that the user is close to the user terminal 200 based on the guide images 310 and 320 and the iris line 340 and confirms that the user terminal 200 is in a direction away from the user terminal 200 You can move.

However, even if the iris region is detected, accurate iris recognition can not be performed due to eyelids or eyelashes. 4A is a flowchart for explaining a method of extracting iris features considering eyelids and eyelashes according to an embodiment of the present invention.

First, the controller 270 detects the iris region from the detected image (S410). Then, the controller 270 detects the eyelid from the detected image (S420). Then, the controller 270 determines whether the eyelash occupied by the eyelid in the iris region is equal to or greater than the first value (e.g., 5%) (S430). If the eyelid ratio is less than the first value (S430-N), the controller 270 detects the eyelashes from the detected image (S440). Then, the controller 270 determines whether the eyelashes occupied by the eyelashes in the iris region are equal to or greater than the second value (S450). If the eyelash rate is less than the second value (S450-N), the controller 270 extracts iris features for iris recognition (S470). That is, the controller 270 can perform iris recognition only when the eyelashes and eyelids are less than a predetermined value.

However, if the eyelid ratio is equal to or greater than the first value (S430-Y) and the eyelash rate is equal to or greater than the second value (S450-Y), the display unit 240 displays the guide UI for smooth iris recognition (S460). Specifically, the display unit 240 can display a guide UI 480 including a guide message "Open your eyes" as shown in FIG. 4B. That is, when the user does not open his or her eyes and can not perform smooth iris recognition by the eyelid or the eyelashes, the control unit 270 can display the guide UI 480 for iris recognition.

Also, as shown in FIG. 4C, when only a part of the photographed user's iris region is photographed, the control unit 270 may not display a guide image for performing iris recognition.

On the other hand, security of the iris image is very important as the personal information of the user. In particular, when the iris image is directly displayed, there is a possibility that iris information, which is personal information of the user, is leaked to the outside by capturing a displayed screen or taking a picture. Accordingly, the control unit 270 controls the image processing unit 230 to process the photographed image so that the iris information can not be confirmed by various methods without displaying the photographed iris image, and is processed by the image processing unit 230 The display unit 240 may be controlled to display the image. For example, as shown in FIG. 5A, the controller 270 displays the remaining irregular parts of the photographed image as it is, and displays the virtual iris image 510 in the iris area. And the display unit 240 can be controlled.

5B, the control unit 270 may display the detected eye region and iris region as edge information by detecting the eye region and the iris region, process the remaining region as a monochrome image, The processing unit 230 and the display unit 240 can be controlled.

5C, the controller 270 may display only the iris image 560 corresponding to the iris region of the actual user and the guide images 540 and 550 without displaying the photographed image itself, The control unit 230 and the display unit 240 can be controlled. At this time, the guide images 540 and 550 may be displayed as a solid line, and the iris line 560 may be displayed as a dotted line, as shown in FIG. 5C.

Further, when an iris image representing the current iris size is expressed, a problem that the number of frames per second (FPS) falls may occur depending on the performance of the user terminal 200. [ In this case, an abrupt change such as a sudden decrease or an increase in the iris image indicating the size of the current user iris may occur due to the movement of the user terminal device 200. Accordingly, in order to mitigate this problem, the iris size of the current frame can be determined based on Equation (1) below by reflecting the iris size information in the previous frame.

In this case, Iris_Diameter _F is the diameter of the iris image, Iris_Diameter _C is the diameter of the iris estimated in the current frame, and Iris_Diameter _P is the diameter of the iris estimated in the previous frame. In this case, a is a weight given to the current frame and has a value between 0 and 1.

Meanwhile, although the guide image is shown as ellipses and circles in the above-described embodiment, it may be expressed in various shapes such as a rectangle, a triangle, and the like only as an example.

When the user is positioned at a focal distance of the photographing unit 220 and is located at a proper position for performing iris recognition, that is, when the difference between the size of the detected user iris and the size of the iris guide image is less than a predetermined value, The control unit 270 may output a feedback message to guide iris recognition to perform iris recognition. For example, when the difference between the size of the detected user iris and the size of the iris guide image is within 2% of the size of the user iris, the controller 270 performs a feedback process to guide iris recognition Can be output.

Specifically, the control unit 270 may output a visual feedback message. The controller 270 controls the display unit 330 to change or blink the color of the iris image 330 when the iris guide image 320 has the iris image 330 and a size less than a predetermined value, (240). In addition, the controller 270 may control the display unit 240 to display a separate UI for informing that the entire screen is blinking or iris recognition is being performed.

In addition, the controller 270 may output an audible feedback message. In one embodiment of the present invention, when the iris guide image 320 has an iris image 330 and a size smaller than a preset value, the controller 270 displays an AUI Can be output.

In addition, the control unit 270 may output a tactile feedback message such as vibration.

When the user is positioned at a focal distance of the photographing unit 220 and is located at a proper position for performing iris recognition, that is, when the difference between the size of the detected user iris and the size of the iris guide image is less than a predetermined value, The control unit 270 may determine whether the detected user iris matches the iris previously registered in the storage unit 250 and perform iris recognition of the user.

At this time, in performing iris recognition, the controller 270 can capture all of the iris as shown in FIG. 6A, but as shown in FIG. 6B, part of the iris may be obscured by eyebrows or eyelids . As shown in FIG. 6A, no problem occurs when the entire iris is exposed and the iris recognition is performed. However, as shown in FIG. 6B, when the iris is covered by the eyebrows and the eyelids, The recognition rate may be lowered.

In order to solve this problem, the controller 270 may generate the iris code by normalizing the detected iris region 700 into a rectangular shape as shown in FIG. Then, the controller 270 may mask the regions 710, 720, and 730 hidden by the eyebrows or the eyelids among the iris codes normalized in the rectangle.

Hereinafter, a method for generating an iris code by normalizing an iris region will be described with reference to FIGS. 8A to 10. FIG.

8A is a flowchart illustrating a method of extracting and normalizing the inner and outer angles of eyes according to an embodiment of the present invention. First, the control unit 270 detects the iris boundary from the photographed user's eye region (S810). Then, the controller 270 calculates the coordinates of the iris center point P (S820). Then, the control unit 270 detects the inner angle 880 and the outer angle 870 as shown in FIG. 8B (S830). Then, as shown in FIG. 8B, the controller 270 calculates a straight line L (890) connecting the inner and outer angles (S840). Then, the controller 270 calculates a straight line S 895 perpendicular to the iris center point P and the straight line L (S850). Then, the controller 270 performs polar coordinate conversion on the iris region based on the reference line S (S860) and performs normalization.

FIG. 9A is a flowchart for explaining a method of extracting and normalizing an eyelid outer line according to another embodiment of the present invention. FIG. First, the control unit 270 detects the iris boundary from the photographed user's eye region (S910). Then, the controller 270 calculates the coordinates of the iris center point P (S920). Then, the control unit 270 detects the outline lines 970-1 and 970-2 of the eyelid as shown in FIG. 9B (S930). Then, the controller 270 measures the distance from the iris center point P to the eyelid (S940). Then, the controller 270 selects the straight line having the shortest distance from the iris center point P to the eyelid as the reference line S (S950). Then, the controller 270 performs polar coordinate conversion on the iris region based on the reference line S (S960) and performs normalization.

FIG. 10 is a flowchart illustrating a method of normalizing an iris region using all of the reference lines detected in FIGS. 8A and 9A according to another embodiment of the present invention. First, the controller 270 calculates a reference line S1 using the external angle and the internal angle as described with reference to FIG. 8A (S1010). Then, the controller 270 calculates the reference line S2 using the eyelid as described with reference to FIG. 9A (S1020). Then, the controller 270 calculates the final reference line S using the reference line S1 and the reference line S2 (S1030). At this time, the controller 270 can calculate the final reference line S by averaging the reference line S1 and the reference line S2, and calculate the final reference line S by weighting the specific reference line. Then, the controller 270 performs polar coordinate conversion on the iris region based on the final reference line S (S940) and performs normalization.

Referring to FIG. 7 again, the controller 270 compares the irregularized irregularity code with the previously registered iris code to record the matching score, and outputs a predetermined value (for example, , 97%) or more of the irregularly-registered iris codes, and perform iris recognition of the user. That is, if there is a pre-registered iris code having a matching score equal to or greater than a preset value, the control unit 270 sets the user photographed by the photographing unit 220 to a pre-registered iris code having a matching score of a preset value or more It can authenticate as a corresponding user. For example, when the remaining area excluding the masked area is compared with the iris code of the first user, the matching score is 98%, and the remaining area excluding the masked area is compared with the iris code of the second user As a result of the comparison, if the matching score is 33% and the remaining area excluding the masked area is compared with the iris code of the third registered user, if the matching score is 17%, the controller 270 calculates the iris recognition result The user can authenticate that the user is the first user.

If the iris recognition is successful, the controller 270 analyzes the previously registered iris code and the masked area of the iris code used for authentication. If the masked portion of the previously registered iris code is not masked in the iris code used for authentication, the control unit 270 uses the information of the remaining irregular regions of the user iris code except for the masked region, Update the masked portion of the iris code. 11, in a case where an unmasked area (hatched area) 1140 exists in the iris code 1120 that has been successfully authenticated among the masked areas of the previously registered iris code 1110, The controller 270 can update and store the unmasked area 1140 among the iris codes that have succeeded in authentication.

As described above, as the iris recognition is repeatedly performed, the masked area of the iris code registered in the storage unit 250 is gradually reduced, and iris code parts that can be matched at the time of authentication increase. Accordingly, the iris code registered in the storage unit 250 is updated through the iterative iris recognition, and the performance of the iris recognition is improved, thereby increasing the reliability of the user.

Hereinafter, the iris recognition method and iris code update method of the user terminal 200 will be described with reference to FIGS. 12 and 13. FIG.

12 is a flowchart illustrating an iris recognition method of the user terminal 200 according to an embodiment of the present invention.

First, the user terminal device 200 photographs a user (S1210) and displays the photographed image (S1220).

Then, the user terminal device 200 detects the user's eyes from the photographed image (S1230). At this time, the user terminal 200 can detect the user's iris from the detected user's eyes.

Then, the user terminal device 200 displays the guide image at a position corresponding to the detected user's eyes (S1240). At this time, the user terminal device 200 may display the eye guide image at a position corresponding to the user's eyes, and may display the iris guide image at a position corresponding to the user's irises.

Then, the user terminal device 200 performs iris recognition (S1250). In this case, when the user is located at an appropriate distance for iris recognition through the iris guide image, that is, when the difference between the size of the iris included in the detected user's eye and the size of the guide image is within a predetermined range, 200) can perform iris recognition.

By displaying the guide image at the detected eye position as described above, the user can perform iris recognition more conveniently.

13 is a flowchart illustrating an iris code storing and updating method of a user terminal according to an exemplary embodiment of the present invention.

First, the user terminal device 200 captures a user (S1310).

Then, the user terminal device 200 determines whether the current mode is the iris code registration mode or the iris authentication mode (S1320).

In the iris code registration mode, the user terminal device 200 generates an iris code from the photographed image (S1330). Specifically, the user terminal device 200 detects an iris region from a photographed image, normalizes the detected iris region into a rectangular shape, and generates an iris code by masking an area such as eyebrows or eyelids in the normalized iris region .

Then, the user terminal device 200 stores the generated iris code in the database DB (S1340).

In the iris authentication mode, the user terminal 200 generates an iris code and performs a masking operation on a part not required for authentication such as eyebrows or eyelids (S1350).

Then, the user terminal device 200 determines whether the iris code on which the masking operation has been performed has been successfully authenticated (S1360). Specifically, the user terminal 200 can compare the iris code previously stored in the database (DB) with the code for which the masking operation has been performed to determine whether or not the authentication is successful.

If the authentication is successful (S1360-Y), the user terminal device 200 updates the previously registered iris code using the iris code used for authentication (S1370). Specifically, if the masked portion of the pre-registered iris code is not masked in the iris pattern used for authentication, the user terminal device 200 uses the information on the remaining region of the user iris code except the masking region, It is possible to update the masked portion of the iris code previously registered in the database DB.

As described above, by updating the registered iris code when the iris recognition is successful, the performance of the iris recognition can be improved and the reliability of the user can be increased.

Hereinafter, an embodiment in which the screen is switched through iris recognition will be described with reference to FIGS. 14A to 18. The control unit 270 may control the display unit 240 to display the candidate UI and the guide image on various screens requiring user authentication. When the iris recognition is performed through the gazing UI and the guide image, the control unit 270 may control the display unit 240 to switch the screen requiring the user authentication to another screen. At this time, the control unit 270 may control the display unit 240 to enlarge the candidate UI and switch to another screen.

In an embodiment of the present invention, the control unit 270 may control the display unit 240 to display the idle screen 1400, as shown in FIG. 14A. At this time, the idle screen 1400 may include an examination UI 1410 and a guide image 1420. At this time, the gazing UI 1410 is a UI for guiding the user's point of view, and the guide image 1420 is an image for guiding the position and size of the eyes viewed by the user through the position and size relative to the gazing UI 1410 Lt; / RTI > Specifically, as shown in FIG. 15A, it can be confirmed that the guide image 1520 is larger than the gazing UI and positioned on the right side. In this case, when the user is farther to the left and moves to the left as the user's face is close to the user terminal device 200 and is located on the right side, The size of the staring UI 1510 and the guide image 1520 may be matched.

14B, when the position and size of the gaze UI 1410 and the guide image 1420 correspond to each other, the controller 270 displays the shape (e.g., color, flicker, transparency) of the guide image 1420 Etc.) to inform that the iris recognition performance is started. When the user authentication is performed through the iris recognition, the control unit 270 controls the display unit 240 to gradually enlarge the examination UI 1410 and display a part of the start screen 1430, as shown in FIG. 14C can do. The control unit 170 may further enlarge the gaze UI 1410 to control the display unit 240 to display the start screen as a full screen as shown in FIG. 14D.

16A, the control unit 270 controls the display unit 240 to display the gazing UI 1610 and the guide image 1620 on the start screen 1600 of a specific application that requires login, Can be controlled. When the user authentication is successful by performing the iris recognition through the gazing UI 1610 and the guide image 1620, the control unit 270 enlarges the gazing UI 1610 as shown in FIG. 16B, The display unit 240 can be controlled to switch to the back screen 1630.

In another embodiment, the control unit 270 can control the display unit 240 to display the gazing UI 1710 and the guide image 1720 on the settlement screen 1700, as shown in Fig. 17A. 17B, the control unit 270 enlarges the examination UI 1710 and displays an authentication success screen (FIG. 17B). The user UI 1710 displays the authentication success screen The display unit 240 can be controlled so as to switch to the display mode.

18 is a flowchart illustrating an iris recognition method of the user terminal 200 according to another embodiment of the present invention.

First, the user terminal device 200 displays the candidate UI and the guide image on the first screen (S1810). At this time, the first screen is a screen requiring user authentication, and may be a standby screen, a login screen, a payment screen, and the like. The gazing UI is a UI for guiding the user's point of view, and the guide image may be an image for guiding the position and size of the user's eyes through the position and size of the gazing UI.

Then, the user terminal device 200 performs iris recognition using the candidate UI and the guide image (S1820).

Then, the user terminal device 200 determines whether user authentication is successful through iris recognition (S1830).

If the user authentication is successful (S1830-Y), the user terminal device 200 enlarges the candidate UI and switches to the second screen (S1840). At this time, the second screen is a screen after user authentication, and may include a start screen, a post-login screen, an authentication success screen, and the like.

If the user authentication fails (S1830-N), the user terminal device 200 outputs an authentication failure message (S1850).

As described above, iris recognition can be more easily performed through the gazing UI and the guide image, and a new user experience can be provided by switching to another screen through the screen gazing.

Hereinafter, an embodiment in which iris recognition is performed through a human eye-shaped gaze UI will be described with reference to FIGS. 19A to 22. FIG.

In order to increase the success rate of iris recognition, the user must gaze for a long time. However, this behavior itself may be a somewhat unnatural act to the user. Therefore, according to an embodiment of the present invention, the user terminal 200 displays an eye-shaped gaze UI to induce a user to make a snowball fight with a virtual person, thereby guiding the user to open his eyes for a long time.

In an embodiment of the present invention, the control unit 270 may control the display unit 240 to display a human eye-shaped gaze UI 1910 on a display screen, as shown in FIG. 19A. At this time, the control unit 270 may cause a snowball game repeatedly by repeatedly displaying the eyeball-like visual UI 1910 in a small size.

When the iris recognition is performed, the controller 270 changes the color of the eye UI 1910 as shown in FIG. 19B, or changes the color of the eye UI 1910, as shown in FIG. The display unit 240 may be controlled to display the UI 1920 that guides the recognition progress rate to the user.

When the iris recognition is performed, the control unit 270 closes the eyes of the eye UI 1930 and displays the iris recognition success message 1940 on the display unit 1940 240 can be controlled. At this time, the iris recognition success message 1940 may be displayed in a visual form, but it may be outputted in an audible form or a vibration form, which is only an example.

Also, when a plurality of people use the user terminal 200, the controller 270 may preferentially determine a person who wants to control the user terminal 200 and perform iris recognition.

Specifically, as shown in FIG. 20A, the user terminal device 200 may include a camera 2010 capable of simultaneously recognizing iris recognition and gesture. 20B, when a plurality of users use the user terminal device 200 (for example, when a plurality of users view a movie or a web page at the same time), the control unit 270 preferentially It is possible to detect the user who looks at the display screen by detecting the movement of the user's face. The control unit 270 can perform iris recognition of the detected user in various ways as described above to give the user terminal 200 the priority of the interaction.

21 is a flowchart illustrating an iris recognition method of the user terminal 200 according to another embodiment of the present invention.

First, the user terminal device 200 displays a gaze-like UI on a display screen. At this time, the human eye included in the gazing UI of the human eye may cause a snowball to repeat by repeatedly opening and closing the eyes.

Then, the user terminal device 200 determines whether iris recognition is started (S2120).

If the iris recognition is started (S2120-Y), the user terminal device 200 changes the color of the eye UI or displays the recognition progress rate to inform that the iris recognition is being performed (S2130).

Then, the user terminal device 200 performs iris recognition (S2140).

22 is a flowchart illustrating an iris recognition method of the user terminal 200 according to another embodiment of the present invention.

The user terminal device 200 captures a plurality of users (S2210).

Then, the user terminal device 200 detects the face motions of a plurality of users (S2220). At this time, the user terminal device 200 can determine whether or not the direction of the face movement of a plurality of users is directed to the user terminal device 200. Alternatively, the user terminal device 200 may detect a user located in front of the user terminal device 200.

The user terminal device 200 determines the priority of the user among the plurality of users based on the detected face movement of the user (S2230). Specifically, the user terminal device 200 can determine a user who is looking at the user terminal device 200.

Then, the user terminal device 200 performs iris recognition for the interaction priority authority (S2240).

If the user authentication is successful by performing the iris recognition, the user terminal device 200 gives the interaction priority right to the interaction priority right (S2250). Specifically, the user terminal device 200 can ignore voice, motion, and the like input by other users, except for the function of the user terminal device 200, on the basis of the voice, motion, etc. inputted by the interaction priority authority.

Meanwhile, according to another exemplary embodiment of the present invention, the user terminal 200 may acquire a plurality of reference images according to an imaging condition, and perform iris recognition using a plurality of reference images obtained. Specifically, the control unit 240 can acquire a plurality of reference images according to the shooting conditions. Here, the photographing condition may include at least one of distance, resolution, illuminance, focus state, and IR light reflection between the user terminal device 200 and the user. When a user is photographed to perform iris recognition, the control unit 240 detects the user's eyes in the photographed image, compares the reference image having the photographing condition corresponding to the detected eyes among the plurality of reference images with the user's eye Thereby performing iris recognition.

In particular, when registering a plurality of reference images, the control unit 270 may convert a plurality of reference images into iris codes and store the iris codes in the storage unit 250. However, converting a plurality of reference images into iris codes and storing them is only an embodiment, and raw data of a plurality of reference images can be stored in the storage unit 250. [

In addition, when registering a plurality of reference images, the control unit 240 stores shooting condition information (e.g., distance information) with the user corresponding to each of the plurality of reference images in the plurality of reference images and registers them . When performing the iris recognition, the controller 270 acquires the photographing condition information with the user sensed through the sensing unit (not shown), and acquires the photographing condition information and the photographing condition information stored in the plurality of reference images It is possible to select a reference image for performing iris recognition among a plurality of reference images. Then, the controller 270 can perform iris recognition by comparing the selected reference image with the detected user's eye.

Meanwhile, when generating the plurality of reference images, the controller 270 may acquire a plurality of reference images for each of the imaging conditions, but this is only an example, and image resizing or noise determination a plurality of reference images can be obtained through addition. Specifically, the control unit 270 acquires the first reference image through the photographing unit 220, generates a plurality of reference images according to the photographing conditions through image resizing or noise addition to the first reference image, (250).

Hereinafter, a method for performing iris recognition using a plurality of reference images acquired according to an imaging condition according to another embodiment of the present invention will be described with reference to FIGS. 23 to 29. FIG. 23 is a flowchart for explaining a method of performing iris recognition using a plurality of reference images acquired according to photographing conditions according to another embodiment of the present invention.

First, the user terminal device 200 registers a plurality of reference images according to shooting conditions (S2310). Specifically, the user terminal device 200 can acquire a plurality of reference images according to the shooting conditions. For example, the user terminal device 200 may acquire a plurality of reference images according to the distance between the user terminal device 200 and the user. As another example, the user terminal device 200 may acquire a plurality of reference images according to the resolution. As another example, the user terminal device 200 may acquire a plurality of reference images according to the ambient illuminance. As another example, the user terminal device 200 may acquire a plurality of reference images according to the focus state. As another example, the user terminal device 200 may acquire a plurality of reference images according to the point where the IR light reflection occurs. At this time, the user terminal device 200 may store the photographing condition information together with a plurality of reference images corresponding thereto. In addition, the user terminal device 200 can acquire a plurality of reference images by photographing by photographing conditions, but this is merely an example, and it is possible to obtain a plurality of reference images in accordance with photographing conditions through image resizing or noise addition to one reference image The reference image of FIG.

Then, the user terminal device 200 photographs the user's eyes for user authentication (S2320).

Then, the user terminal device 200 detects the user's eyes from the photographed image and detects the photographing conditions (S2330). At this time, the user terminal 200 can detect the user's eyes (in particular, the iris) by detecting the inner and outer boundaries of the iris from the photographed image. Then, the user terminal device 200 can detect the shooting conditions (e.g., the distance between the user terminal device 200 and the user). At this time, the user terminal 200 can detect the distance between the user terminal 200 and the user through the distance detector.

Then, the user terminal 200 compares the detected eye with the reference image to perform user authentication (S2340). Specifically, the user terminal device 200 can select a reference image having a photographing condition corresponding to the photographing condition detected among a plurality of reference images. Then, the user terminal device 200 can perform user authentication by comparing the reference image having the photographing condition corresponding to the detected photographing condition and the detected eye.

As described above, iris recognition is performed using a plurality of reference images acquired according to photographing conditions, so that even if the user's eyes are photographed under various photographing conditions, quicker and more accurate iris images can be obtained.

24 is a diagram for explaining a method of registering a plurality of reference images and performing authentication using a plurality of reference images, according to another embodiment of the present invention.

First, the user terminal device 200 acquires the photographing condition information and the iris image (S2410). Specifically, the user terminal 200 can acquire an iris image by capturing an image including a user, and acquire photographing condition information through various sensors (for example, a distance sensor, an illuminance sensor, etc.) .

Then, the user terminal device 200 detects the inner and outer boundaries of the iris (S2420). That is, the user terminal 200 can detect the user's iris by detecting the inner and outer boundaries of the iris in the iris image.

Then, the user terminal device 200 determines whether the current step is a registration step or an authentication step (S2430).

If the current step is the registration step, the user terminal device 200 generates a reference image (S2440). Specifically, the user terminal 200 may generate a reference image by storing the acquired user iris and the detected photographing information condition together.

Then, the user terminal device 200 generates an iris code using the reference image (S2450). Since a method of generating an iris code has been described above, a detailed description thereof will be omitted.

Then, the user terminal device 200 stores the iris code in the database (S2460). That is, the user terminal 200 can store the iris code in a database instead of storing the user iris image in a database.

On the other hand, if the current step is the authentication step, the user terminal device 200 generates the iris code (S2470). That is, the user terminal device 200 can generate the iris code through the detected user iris.

Then, the user terminal device 200 compares the generated iris code with the iris code stored in the database (S2480). Specifically, the user terminal device 200 can search an iris code having imaging condition information corresponding to the imaging condition information obtained in step S2410 among the iris codes stored in the database. The user terminal device 200 can compare the retrieved iris code with the generated iris code.

Then, the user terminal device 200 performs user authentication based on the comparison result (S2490). Specifically, when the comparison result between the iris code retrieved from the database and the generated iris code indicates that the degree of similarity is equal to or greater than a preset value, the user terminal 200 performs user authentication. If the degree of similarity is less than a preset value, The user terminal device 200 may output a user authentication failure message.

As shown in FIG. 24, when the reference image is registered, the iris code is stored instead of the reference image itself, so that the operation of converting the reference image into the iris code may not be performed each time authentication is performed. In addition, by storing the iris code without storing the iris image itself, the user's personal information can be protected even if the database is hacked.

25 is a view for explaining a method of registering a plurality of reference images and authenticating using a plurality of reference images, according to another embodiment of the present invention.

First, the user terminal device 200 acquires the photographing condition information and the iris image (S2510). Specifically, the user terminal 200 can acquire an iris image by capturing an image including a user, and acquire photographing condition information through various sensors (for example, a distance sensor, an illuminance sensor, etc.) .

Then, the user terminal device 200 detects the inner and outer boundaries of the iris (S2520). That is, the user terminal 200 can detect the user's iris by detecting the inner and outer boundaries of the iris in the iris image.

Then, the user terminal device 200 determines whether the present step is a registration step or an authentication step (S2530).

If the current step is the registration step, the user terminal device 200 generates a reference image (S2540). Specifically, the user terminal 200 may generate a reference image by storing the acquired user iris and the detected photographing information condition together.

Then, the user terminal device 200 stores the generated reference image in the database (S2550). That is, the user terminal device 200 may store the reference image itself in the database instead of storing the iris code in the database.

On the other hand, if the current step is the authentication step, the user terminal device 200 generates the first iris code (S2560). That is, the user terminal device 200 can generate the first iris code through the detected user iris.

Then, the user terminal device 200 generates the second iris code for the reference image of the same photographing condition as the detected photographing condition (S2570). Specifically, the user terminal device 200 searches for a reference image having the same photographing condition as the detected photographing condition. Then, the user terminal device 200 can generate the second iris code using the searched reference image.

Then, the user terminal device 200 compares the first iris code and the second iris code (S2580).

Then, the user terminal device 200 performs user authentication based on the comparison result (S2590). Specifically, when the comparison result between the first iris code and the second iris code indicates that the degree of similarity is equal to or greater than the preset value, the user terminal device 200 performs the user authentication. If the degree of similarity is less than the predetermined value, The terminal device 200 may output a user authentication failure message.

As shown in Fig. 25, when the reference image is registered, the amount of data to be stored can be reduced by registering the reference image itself.

26 to 28B illustrate a method for generating a plurality of reference images through image resizing of at least one reference image, according to another embodiment of the present invention.

First, the user terminal device 200 acquires the photographing condition information and the iris image (S2610). Then, the user terminal device 200 detects the inner and outer boundaries of the iris (S2620). Then, the user terminal device 200 registers the detected user iris as a reference image (S2630).

Then, the user terminal device 200 determines whether the number of reference images is one or more (S2640). If the number of reference images is one or more (S2640-Y), the user terminal device 200 stores a plurality of reference images (S2650). However, if the number of reference images is one (S2640-N), the user terminal device 200 stores a single reference image (S2660).

The user terminal 200 performs image resizing according to the photographing conditions using a plurality of stored reference images or a single reference image (S2670). 27A, when the first reference image 2710 is obtained at a distance of 20 cm between the user terminal 200 and the user, the user terminal 200 transmits the first reference image 2710 27B, a second reference image 2720-1 such as a distance between the user terminal 200 and the user is photographed at 50 cm, a user terminal 200, A third reference image 2720-2 such that the distance between the user and the user is taken at 40 cm and a fourth reference image 2720-3 at which the distance between the user terminal 200 and the user is 20cm, Can be obtained. In the above-described embodiment, the image is resized in units of 10 cm. However, the image may be resized in units other than 10 cm (for example, 5 cm). 28A, when the first through fourth reference images 2810-1 through 2810-4 are obtained for each distance between the user terminal 200 and the user, the user terminal 200 28B, image resizing is performed on the first reference image 2810-1 to obtain a fifth reference image 2820-i such that the distance between the user terminal 200 and the user is 45cm, 1). ≪ / RTI > In the same manner, the user terminal device 200 performs image resizing for the second reference image 2810-2 to obtain a sixth reference image 2810-2, such as a distance between the user terminal device 200 and the user, (2820-2).

Meanwhile, in the above-described embodiment, the shooting condition is the distance between the user terminal 200 and the user. However, this is merely an example, and a plurality of reference images can be generated by resizing an image for each resolution.

Then, the user terminal device 200 generates a plurality of iris codes using the generated plurality of reference images (S2680). Then, the user terminal device 200 stores the generated iris mode in the database (S2690).

FIG. 29 illustrates a method of generating a plurality of reference images through noise addition to at least one reference image, according to an embodiment of the present invention. Referring to FIG.

First, the user terminal device 200 acquires the photographing condition information and the iris image (S2910). Then, the user terminal device 200 detects the inner and outer boundaries of the iris (S2920). Then, the user terminal device 200 registers the detected user iris as a reference image (S2930).

Then, the user terminal device 200 determines whether the number of reference images is one or more (S2940). If the number of reference images is one or more (S2940-Y), the user terminal device 200 stores a plurality of reference images (S2950). However, if the number of reference images is one (S2940-N), the user terminal device 200 stores a single reference image (S2960).

Then, the user terminal 200 performs noise addition according to shooting conditions using a plurality of stored reference images or a single reference image (S2670). The user terminal 200 performs a noise addition (e.g., brightness adjustment) on the first reference image 2710 to obtain the second reference image 2710. In this case, A third reference image such as that taken at the third illuminance value, and a fourth reference image as taken at the fourth illuminance value. Even when a plurality of reference images are acquired, more reference images can be acquired through the noise addition.

Meanwhile, in the above-described embodiment, it is explained that the photographing condition is illuminance. However, it is only an embodiment, and a plurality of reference images can be generated through the noise addition adding IR light reflection.

Then, the user terminal device 200 generates a plurality of iris codes using the generated plurality of reference images (S2980). Then, the user terminal device 200 stores the generated iris mode in the database (S2990).

As described with reference to FIGS. 26 to 29, by acquiring a plurality of reference images for each photographing condition through image resizing or noise addition, more accurate iris recognition can be performed even if a small number of iris registration is performed.

An apparatus according to the present embodiments may include a processor, a memory for storing and executing program data, a permanent storage such as a disk drive, a communication port for communicating with an external device, a touch panel, a key, User interface devices, and the like. Methods implemented with software modules or algorithms may be stored on a computer readable recording medium as computer readable codes or program instructions executable on the processor. Here, the computer-readable recording medium may be a magnetic storage medium such as a read-only memory (ROM), a random-access memory (RAM), a floppy disk, a hard disk, ), And a DVD (Digital Versatile Disc). The computer-readable recording medium may be distributed over networked computer systems so that computer readable code can be stored and executed in a distributed manner. The medium is readable by a computer, stored in a memory, and executable on a processor.

This embodiment may be represented by functional block configurations and various processing steps. These functional blocks may be implemented in a wide variety of hardware and / or software configurations that perform particular functions. For example, embodiments may include integrated circuit components such as memory, processing, logic, look-up tables, etc., that may perform various functions by control of one or more microprocessors or other control devices Can be employed. Similar to how components may be implemented with software programming or software components, the present embodiments may be implemented in a variety of ways, including C, C ++, Java (" Java), an assembler, and the like. Functional aspects may be implemented with algorithms running on one or more processors. In addition, the present embodiment can employ conventional techniques for electronic environment setting, signal processing, and / or data processing. Terms such as "mechanism", "element", "means", "configuration" are broadly used and are not limited to mechanical and physical configurations. The term refers to a set of routines ). ≪ / RTI >

The specific implementations described in this embodiment are illustrative and do not in any way limit the scope of the invention. For brevity of description, descriptions of conventional electronic configurations, control systems, software, and other functional aspects of such systems may be omitted. Also, the connections or connecting members of the lines between the components shown in the figures are illustrative of functional connections and / or physical or circuit connections, which may be replaced or additionally provided by a variety of functional connections, physical Connection, or circuit connections.

In this specification (particularly in the claims), the use of the term "above " and similar indication words may refer to both singular and plural. In addition, when a range is described, it includes the individual values belonging to the above range (unless there is a description to the contrary), and the individual values constituting the above range are described in the detailed description. Finally, if there is no explicit description or contradiction to the steps constituting the method, the steps may be performed in an appropriate order. It is not necessarily limited to the description order of the above steps. The use of all examples or exemplary terms (e. G., The like) is merely intended to be illustrative of technical ideas and is not to be limited in scope by the examples or the illustrative terminology, except as by the appended claims. It will also be appreciated by those skilled in the art that various modifications, combinations, and alterations may be made depending on design criteria and factors within the scope of the appended claims or equivalents thereof.

110, 220: photographing unit 120, 240:
130, 270: control unit 210:
230: Image processing unit 250:
260: Input unit

Claims (24)

In a user terminal,
A photographing unit for photographing a user;
A display unit for displaying the photographed image; And
And controlling the display unit to display a guide image at a position where the detected user eye exists among the photographed images, wherein the size of the iris included in the detected user eye and the size of the iris And a controller for performing iris recognition when the size difference of the guide image is within a predetermined range. The method according to claim 1,
Wherein,
The method includes detecting an iris boundary on the detected user's eye, estimating an iris diameter based on the detected iris boundary, calculating a guide image at a position corresponding to the user's eye and iris based on the recognized user's eye and iris diameter And controls the display unit to display the image. 3. The method of claim 2,
In the guide image,
An eye guide image corresponding to a user's eye, and an iris guide image corresponding to a user's iris. 3. The method of claim 2,
In the guide image,
And an image corresponding to a size of a user's eye and an iris existing at a position corresponding to a focal distance of the photographing unit. 5. The method of claim 4,
Wherein,
The method comprising: detecting a user iris in the photographed image; determining whether the detected user iris matches the previously registered iris if the difference between the detected size of the user iris and the size of the guide image corresponding to the iris is less than a preset value And performs iris recognition of the user. 5. The method of claim 4,
Wherein,
And outputting a feedback message to guide the user to perform iris recognition if the difference between the detected size of the user iris and the size of the guide image corresponding to the iris is less than a preset value . The method according to claim 1,
And an image processing unit for processing the photographed image,
Wherein,
Controls the image processing unit to process the photographed image so that the pattern of the user's iris can not be confirmed during the iris recognition, and controls the display unit to display the processed image. The method according to claim 1,
Wherein,
The iris code is generated by normalizing the detected iris region into a rectangular shape and the iris code normalized by the rectangle is masked by the eyebrow or the eyelid, and the remaining region excluding the masked region is compared with the previously registered iris code And performs iris recognition of the user. The method according to claim 1,
Wherein,
And updates the iris code of the pre-registered user using the remaining region of the detected iris region excluding the masked region when the detected iris region is recognized as a pre-registered user. . A method for recognizing iris of a user terminal,
Photographing a user;
Displaying the photographed image;
Detecting a user's eye on the photographed image;
Displaying a guide image at a position where the detected user eye exists among the photographed images; And
And performing iris recognition when the difference between the size of the iris included in the detected user's eye and the size of the guide image is within a preset range. 11. The method of claim 10,
Wherein the step of detecting the user eye comprises:
Detecting an iris boundary on the detected user eye;
And estimating an iris diameter based on the detected iris boundary,
Wherein displaying the guide image comprises:
And displaying a guide image at a position corresponding to the user's eyes and irises based on the recognized user's eyes and iris diameter. 12. The method of claim 11,
In the guide image,
An eye guide image corresponding to a user's eye, and an iris guide image corresponding to a user's iris. 12. The method of claim 11,
In the guide image,
Wherein the image is an image corresponding to a size of a user's eye and an iris existing at a position corresponding to a focal distance of the photographing unit. 14. The method of claim 13,
Wherein the performing comprises:
The method comprising: detecting a user iris in the photographed image; determining whether the detected user iris matches the previously registered iris if the difference between the detected size of the user iris and the size of the guide image corresponding to the iris is less than a preset value And performs iris recognition of the user. 14. The method of claim 13,
Wherein the performing comprises:
And outputs a feedback message to guide the user to perform iris recognition if the difference between the detected size of the user iris and the size of the guide image corresponding to the iris is less than a preset value The method of claim 1, further comprising: 11. The method of claim 10,
Wherein the step of displaying the photographed image comprises:
Processing the photographed image so that the pattern of the user's iris can not be confirmed during the iris recognition; and
And displaying the processed image. 11. The method of claim 10,
Wherein the performing comprises:
The iris code is generated by normalizing the detected iris region into a rectangular shape and the iris code normalized by the rectangle is masked by the eyebrow or the eyelid, and the remaining region excluding the masked region is compared with the previously registered iris code And performs iris recognition of the user. 11. The method of claim 10,
And updating the iris information of the previously registered user using the remaining irregular region excluding the masked region when the detected iris region is recognized as a pre-registered user / RTI > In a user terminal,
A storage unit for storing a plurality of reference images obtained by different shooting conditions;
A photographing unit for photographing a user;
A display unit for displaying the photographed image; And
And a controller for detecting the user's eyes in the photographed image and performing iris recognition by comparing the user's eyes with a reference image having a photographing condition corresponding to the detected user's eyes among the plurality of reference images, Device. 20. The method of claim 19,
Wherein,
A distance between the user terminal and the user, resolution, illuminance, focus state, and IR light reflection. 20. The method of claim 19,
Wherein,
Wherein when the plurality of reference images are registered, the plurality of reference images are converted into iris codes and stored in the storage unit. 20. The method of claim 19,
Wherein,
Wherein when the plurality of reference images are registered, distance information between the plurality of reference images and the user corresponding to each of the plurality of reference images is stored together with the plurality of reference images. 23. The method of claim 22,
And a sensing unit for sensing a distance to the user,
Wherein,
Wherein when the iris of the user is recognized, one of the plurality of reference images is selected based on the distance from the user sensed by the sensing unit, and the iris recognition is performed by comparing the selected reference image with the detected user's eye. To the user terminal device. 23. The method of claim 22,
Wherein,
Acquiring a first reference image through the photographing unit, generating a plurality of reference images along a distance through image resizing of the first reference image, and storing the reference images in the storage unit.

Images