WO2015133700A1

WO2015133700A1 - User device for performing unlocking on basis of location of pupil, method for unlocking user device on basis of location of pupil, and recording medium having computer program recorded therein

Info

Publication number: WO2015133700A1
Application number: PCT/KR2014/010559
Authority: WO
Inventors: 신형철; 전혁준; 장언동; 전병기
Original assignee: 에스케이플래닛 주식회사
Priority date: 2014-03-06
Filing date: 2014-11-05
Publication date: 2015-09-11

Abstract

Disclosed are a user device for performing unlocking on the basis of a location of a pupil, a method for unlocking a user device on the basis of a location of a pupil, and a recording medium having computer program recorded therein. That is, the present invention can collect pupil location information input to a user device, determine whether a sequence of directions in which the detected location of the pupil moves coincides with a predetermined sequence of directions, by comparing the two sequences with each other, and then determine whether the user device is unlocked, according to a result of the determination. Using the method, it is possible to enhance the security as well as providing a user-friendly environment which is more convenient than the existing key input, etc.

Description

User device performing unlock based on pupil position, method of unlocking user device based on pupil position, and recording medium recording computer program

The present invention relates to a user device performing unlocking based on a pupil position, a method of unlocking a user device based on pupil position, and a recording medium on which a computer program is recorded. In particular, a coordinate value is calculated based on the pupil position. The present invention relates to a user device for unlocking using the same, a method for releasing a user device based on a pupil position, and a recording medium in which a computer program is recorded.

Mobile terminals, including cell phones, are now indispensable for modern people. The mobile terminal, which appeared as a simple calling function, has evolved into a mobile communication terminal equipped with a camera that can take pictures on the fly and transfer them to a mobile phone. Is equipped. As the popularity of camera phones spreads rapidly, the demand is increasing rapidly, and camera phone evolution is progressing rapidly.

Smartphones can be equipped with a variety of functions and applications, the wide range of use of the personal information such as personal information and financial information of the user (owner) is stored and accordingly personal information of the individual should be guaranteed accordingly, but conventional phones The security method of setting a password or an encryption key is difficult to guarantee the safety of such personal information even though most smartphones are private devices.

Recently, the unlocking technology using face recognition has been used due to the development of a smartphone technology using a camera, which has a problem of being able to circumvent using a photo. As a result, improvements have been made to check whether images are blinked continuously or are not identical. However, there is a problem of bypassing through video playback.

SUMMARY OF THE INVENTION An object of the present invention is to provide a user device that performs unlocking based on pupil position, a method of unlocking a user device based on pupil position, and a recording medium on which a computer program is recorded, in order to prevent unauthorized use of a third party by the user apparatus. There is.

Another object of the present invention is to unlock the user device based on the pupil position to perform the unlock based on the pupil position without a separate touch on the terminal to unlock the user device to improve the convenience of unlocking the user device A method and a computer program provide a recorded recording medium.

Another object of the present invention is to perform a user authentication by combining the movement of the pupil and the face recognition of the user to perform a user-based unlocking security improved security, the method of unlocking the user device based on the pupil position and A computer program provides a recorded recording medium.

Another object of the present invention is to unlock the user device based on the pupil position and stop time of the user to prevent unauthorized use of the third party to the user device, unlocking the user device based on the pupil position A method and a computer program provide a recorded recording medium.

Another object of the present invention is a user device utilizing a pupil position and a stop time based interface without a separate touch on the terminal to unlock the user device to improve the convenience of unlocking the user device, the user device based on the pupil position A method of unlocking and providing a recording medium on which a computer program is recorded.

It is still another object of the present invention to perform user authentication by combining a pupil position and stop time with a user's face recognition, thereby improving user security, a method of unlocking a user device based on pupil position, and a recording medium on which a computer program is recorded. To provide.

A user device for unlocking based on a pupil position according to an exemplary embodiment of the present invention may include a camera unit configured to collect pupil position information on a position of a user device gazed by a user's pupil; A position measuring unit for sequentially detecting a direction in which the pupil's position moves based on the pupil position information; And a controller configured to compare the order of the detected pupil positions with the order of the preset direction to determine whether there is a match and then release the lock according to the result.

As an example related to the present invention, the controller may be further configured to perform facial recognition of the user and release the lock according to the result.

As an example related to the present invention, the controller may be implemented to release the lock according to the result in consideration of the movement length and the position information of the pupil.

According to an embodiment of the present invention, a method of unlocking a user device based on a pupil position includes: displaying a cryptographic component at different positions of a display; A detection step of identifying a pupil of a user gazing at a display and sequentially detecting a direction in which a position of the display at which the pupil gazes moves; And releasing the lock according to the result after determining whether the measured pupil position is matched by comparing the order of the moving direction and the order of the preset direction.

As an example related to the present invention, the displaying step may be characterized in that the cryptographic component is displayed on the display in any arrangement.

As an example related to the present disclosure, the cryptographic component may include at least one of a symbol, a photo, a figure, a number, a letter, and a symbol.

As an example related to the present invention, the displaying may include setting a plurality of cryptographic components and setting the plurality of cryptographic components to different passwords.

As an example related to the present invention, the password may be set to an input sequence of a cipher component or a movement pattern of a pupil.

As an example related to the present invention, the releasing step may be implemented to further perform facial recognition of the user and release the lock according to the result.

As an example related to the present invention, the detecting step may be implemented to realize feedback on an input by a pupil gazing at the display.

A computer program for performing the method according to the above-described embodiments may be stored in a recording medium on which a computer program according to an embodiment of the present invention is recorded.

According to an embodiment of the present invention, a user device for unlocking based on a pupil position may include a camera unit configured to collect position information of a pupil input to the user device; A position measuring unit for sequentially detecting a direction in which the position of the pupil moves based on the pupil position information; A pupil input time measuring unit configured to measure a time duration of the stop state after the movement of the pupil to determine a stop time of the pupil in a time zone divided by stages; And a controller configured to compare the order of the detected pupil positions with the order of the predetermined direction and the stop time, determine whether they match, and release the lock according to the result.

The present invention uses a method of recognizing the position of a human eye to unlock a user device, thereby providing a user-friendly environment and improving security than an unlocking method based on a conventional key input.

In addition, the present invention has the effect of improving the security by performing the user authentication by combining the movement of the eyes and the user's face recognition.

In addition, the present invention uses a method of recognizing the position and stop time of the human eye to unlock the user device to provide a more user-friendly environment than the conventional method for unlocking based on the key input, as well as to improve security. It has an effect.

In addition, the present invention has the effect that the security can be improved by performing the user authentication by combining the pupil position and stop time and the user's face recognition.

1 is a conceptual diagram illustrating an authentication method based on pupil position according to an embodiment of the present invention.

2 is a conceptual diagram illustrating a pupil photographing screen of a user to which an XY coordinate system is applied according to an exemplary embodiment of the present invention.

3 is a conceptual diagram illustrating a pupil descriptor for detection of pupil positions according to an embodiment of the present invention.

4 is a conceptual diagram illustrating a user device according to an exemplary embodiment of the present invention.

5 is a conceptual diagram illustrating an authentication method based on pupil position and stop time according to another embodiment of the present invention.

6 is a conceptual diagram illustrating a user device according to another embodiment of the present invention.

7 is a flowchart illustrating a method of unlocking a user device based on pupil positions according to a first embodiment of the present invention.

8 is a conceptual diagram illustrating an authentication method based on pupil positions according to another embodiment of the present invention.

9 is a flowchart illustrating a method of unlocking a user device based on a pupil position and a stop time according to a second embodiment of the present invention.

It should be noted that the technical terms used in the present invention are merely used to describe specific embodiments, and are not intended to limit the present invention. In addition, the technical terms used in the present invention should be interpreted as meanings generally understood by those skilled in the art unless the present invention has a special meaning defined in the present invention, and is excessively comprehensive. It should not be interpreted in the sense of or in the sense of being excessively reduced. In addition, when a technical term used in the present invention is an incorrect technical term that does not accurately express the spirit of the present invention, it should be replaced with a technical term that can be understood by those skilled in the art. In addition, the general terms used in the present invention should be interpreted as defined in the dictionary or according to the context before and after, and should not be interpreted in an excessively reduced sense.

Also, the singular forms used in the present invention include plural forms unless the context clearly indicates otherwise. Terms such as “consisting of” or “comprising” in the present invention should not be construed as necessarily including all of the various components or steps described in the present invention, and some of the components or some steps may not be included. It should be construed that it may further include, or further include, additional components or steps.

In addition, terms including ordinal numbers such as first and second used in the present invention may be used to describe components, but the components should not be limited by the terms. The terms are used only to distinguish one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, and the same or similar components will be given the same reference numerals regardless of the reference numerals, and redundant description thereof will be omitted.

In addition, in describing the present invention, when it is determined that the detailed description of the related known technology may obscure the gist of the present invention, the detailed description thereof is omitted. In addition, it should be noted that the accompanying drawings are only for easily understanding the spirit of the present invention and should not be construed as limiting the spirit of the present invention by the accompanying drawings.

Hereinafter, an embodiment of the present invention discloses a method of unlocking a user device based on pupil position. For convenience of description, a method of releasing a lock on a user device based on a pupil position will be described. However, the method for releasing a lock based on a pupil position according to an embodiment of the present invention provides an operation of the device or other authentication process required for the user device. It may be used to control.

Hereinafter, in the embodiment of the present invention, the user device may be called in various terms. For example, a user equipment (UE) may be fixed or mobile, and may include a mobile station (MS), a mobile terminal (MT), a user terminal (UT), a subscriber station (SS), and a wireless device. ), A personal digital assistant (PDA), a wireless modem, a handheld device, and a wireless terminal.

As shown in FIG. 1, the user device 100 may be implemented to be used after unlocking a locked state through user authentication. The user device 100 may receive a position signal of the pupil of the user 200 and perform identity verification. For example, the user enters a movement of the pupil 200 staring at the cryptographic component 120 in a preset order to unlock the user device 100, and the user device 100 analyzes it to lock it. It may be determined whether to release the state.

According to an embodiment of the present invention, the user device 100 compares the order of the direction of movement of the received pupil 200 with the order of the direction of the preset pupil which should be input to release the lock of the user device 100. You can decide whether to release the lock state. The order of the predetermined movement direction of the pupil may be the order of the direction of the pupil moving in the order of the character or the figure, or may be the order of the direction of the pupil moving the specific area of the screen in order regardless of the character or the figure. .

As shown, the user device 100 includes a camera unit 130. The camera unit 130 performs a function of collecting image information from the outside. The camera unit 130 may collect eye movement information of the user and image information for facial recognition of the user.

The display 105 of the user device 100 may display a screen necessary for driving and using the user device 100.

Display 105 may show cryptographic component 120 for unlocking it in a locked state. The cryptographic component 120 may be composed of image symbols (symbols, photographs, figures, numbers, letters, symbols, etc.) used to set the cryptography. The cryptographic component 120 may be arranged in a certain location or may be randomly arranged in a different location each time on the lock screen. In addition, a plurality of formats may be used in combination with each other for a symbol, a photo, a figure, a number, a letter, and a symbol used as an image symbol.

The password input screen 110 may be displayed on the display 105. The password may be set in the order of entry of the cryptographic components or the movement pattern of the pupil. When the password is set in the input order of the cryptographic component, the lock is released if the input order of the cryptographic component 120 input by the pupil 200 matches the preset order. If the password is set to the movement pattern of the pupil, the lock is released if the movement pattern of the pupil matches the preset order.

The password component 120 that is input for security does not display the specific contents entered on the password input screen 110, or the contents of the password component 120 that was input last are displayed on the password input screen 110 for a predetermined time. After the display, the input contents may be set not to be displayed after a predetermined time has elapsed.

Vibration, light, sound, etc. can be used as feedback to the input. Feedback on the input may not be used depending on the setting.

In the embodiment of FIG. 1, when the password for unlocking is 3457, the user may stare at the

numbers

3, 4, 5, and 7 in order of the password to unlock the lock. At this time, the pupil of the user moves in the order of the top left, bottom right, left, top right from the center area. The camera unit 130 may collect the eye movement information of the user and may release the lock if the collected eye movement information of the user matches a preset order for unlocking the user device 100.

The cryptographic component 120 can be arranged in any order each time the lock screen is displayed. That is, when the password for unlocking is 3457, since the position of each number is changed, the pupil movement information of the user required for unlocking may be correspondingly changed.

Alternatively, the order of movement of the eyes of the user required for unlocking is fixed, and the encryption component 120 may be arranged in any order each time the lock screen is displayed. If the user's eye movement order required for unlocking is left top, right bottom, left, top right, regardless of the arrangement of the cryptographic component 120, the user moves the pupil to the top left, bottom right, left, top right, You can unlock it.

Hereinafter, in the embodiment of the present invention, the user device 100 receives the pupil movement information, analyzes the received pupil movement information, and specifically discloses a method of determining whether to release the lock setting of the user apparatus 100. do.

2 is a conceptual diagram illustrating a pupil photographing screen of a user to which an XY coordinate system is applied according to an exemplary embodiment of the present invention, and FIG. 3 is a conceptual diagram illustrating a pupil descriptor for detecting pupil positions according to an exemplary embodiment of the present invention. The XY coordinate system may be applied to the photographing screen in which the user's pupils are photographed through the camera unit 130. In the XY coordinate system, the origin may be the center of the display 105 or may be a predetermined point of the display 105 according to the user's selection.

As shown in FIG. 2, when the XY coordinate system is applied to the photographing screen, the coordinates of the point where the user's pupil 200 is located are calculated based on the origin of the XY coordinate system. In order to calculate the coordinates, the X-axis and the Y-axis may each have coordinate values at regular intervals. For example, the user's pupil 200 may have an X axis coordinate value x1 of −4 and a Y axis coordinate value y1 of 4. In this case, the coordinate value of the point where the user's pupil 200 is located may be calculated as (-4, 4).

Using the coordinate values of the point where the user's pupil 200 is located, it is possible to determine where the user's pupil 200 is located in nine areas of the display 105 (eg, R1 to R9 divided into nine). have.

Specifically, when the X-axis coordinate value (x1) of the position of the pupil 200 is less than -3, it can be determined that the position of the pupil 200 of the user is left by dividing by three equal to the X-axis, In this case, it can be determined to be the center of the X axis, and if it is 3 or more, it can be determined to be the right side of the X axis. In addition, when the Y-axis coordinate value y1 of the pupil 200 position is less than -3, it may be determined that the position of the pupil 200 of the user is lower than the Y axis. It can be determined to be the center, and if it is 3 or more, it can be determined as the top based on the Y axis.

This is described as an example, and may be set differently according to the number of divisions and the size of the display 105.

As described above, according to the result of the determination of the X-axis coordinate value and the Y-axis coordinate value of the pupil 200, the pupil 200 of the user is positioned in nine regions (R1 to R9 divided into nine) on the display 105. Can be judged. If the password is 3457 as shown in FIG. 1, the user's pupil 200 must be moved in the order of R1, R9, R7, and R3 to unlock the lock. If the password is 3457 and the position of each number is changed, the position of the pupil 200 for unlocking is also changed in correspondence with the order of the regions corresponding to the changed positions of 3, 4, 5, and 7.

If the user's eye movement information required for unlocking regardless of the password is in the upper left, lower right, left, upper right, in addition to the order of R1, R9, R7 and R3, (R5, R9, R7, R3), (R1, R5, The lock can also be released in other orders, such as R4, R2), (R5, R9, R8, R6), and the like. In order to prevent this, when the lock is released with the pupil movement information of the user regardless of the password, the movement length and the position of the pupil 200 may be considered simultaneously in addition to the movement direction in the pupil movement information of the user.

In addition, in order to determine that the corresponding area is input according to the movement of the position of the pupil 200, an input that lasts for a predetermined time or more is required for the same area.

If the position of the pupil 200 lasts for a predetermined period of time to be recognized as an input, and the cryptographic component 120 located in the corresponding area is recognized as input, the user may notify the user of the feedback with vibration, light, sound, or the like. have.

4 is a conceptual diagram illustrating a user device according to an exemplary embodiment of the present invention. Referring to FIG. 4, the user device 100 may include a camera unit 130, a pupil position measuring unit 140, a storage unit 150, a user setting unit 160, and a controller 170.

The camera unit 130 may capture and collect an external image and recognize the pupil 200. The camera unit 130 may photograph the user's face in order to photograph the user's pupil 200. When the users use the user device 100, most of the user devices 100 face each other at a position close to their faces, so that the camera unit 130 may photograph the user with the eyes of the user as the center. The camera unit 130 continuously photographs the user for real-time tracking of the location of the pupil 200.

In addition, the camera unit 130 may recognize the user's face. Accordingly, even if the password is known, the lock cannot be unlocked unless the personal authentication through the face recognition is completed, thereby improving security by interlocking the user's face recognition.

The pupil position measuring unit 140 measures the position of the pupil 200 of the user necessary to release the lock and data-sets it.

The pupil position measuring unit 140 calculates a geometric pupil position by using angles in both eye directions and distances between both eyes from the camera unit 130. The pupil position measuring unit 140 outputs pupil position data on the calculated actual geometric eye position.

The pupil position measuring unit 140 sets a predetermined reference point of the photographing screen including the pupil of the user captured by the camera unit 130 as the origin, and sets the center point position of the pupil 200 of the photographed user as the origin. Based on the origin, the pupil's X-axis and Y-axis coordinates are calculated.

The origin may set the center of the pupil 200 as a reference point when the user gazes at a specific point of the display 105, and the specific point may be the center of the display 105. Specifically, a reference point may be set by the user staring at a specific area displayed in the center area of the display 105 on the initial screen for unlocking, and using the reference point, the X-axis coordinate value of the pupil 200. And calculating the Y-axis coordinate value to measure the position of the pupil 200. The reference point can be used by the user to set initially and can be changed as necessary.

The storage unit 150 may store a password set by the user setting unit 160, and the control unit 170 may include a camera unit 130, a pupil position measuring unit 140, a storage unit 150, and a user setting unit. It may be implemented to control the operation of 160.

In addition, the controller 170 may be implemented to release the locked state of the user device 100 when the information regarding the position of the pupil input as a result of the analysis of the pupil position measurement may release the locked state of the user device 100. Can be. On the contrary, when the information on the position of the pupil input as a result of the analysis of the pupil position measurement cannot release the locked state of the user device 100, the controller 170 does not release the locked state of the user device 100. It may be implemented to instruct to re-enter the information about the pupil position.

As shown in FIG. 5, the user device 100 may be implemented to be used after unlocking a locked state through user authentication. The user device 100 may receive the position and the stop time of the pupil of the user 200 and perform identity verification. In other words, the user may position the pupil 200 gazing at the cryptographic component 120 in a preset order to unlock the user device 100 and the position of the pupil 200 gazing at each cryptographic component 120. After entering the stop time, the user device 100 may analyze it to determine whether to release the lock state.

According to an embodiment of the present invention, the user device 100 compares the order and the stop time of the movement direction of the pupil 200 with the order and the stop time of the movement direction of the preset pupil which should be input to release the lock. It may be determined whether to unlock the device 100. The order of the predetermined movement direction of the pupil may be the order of the direction of the pupil moving in the order of the character or the figure, and the order of the direction of the pupil moving the specific area of the screen in order regardless of the arrangement of the character or the figure. It may be.

The stop time of the pupil 200 may refer to a gaze time that continues without changing the gaze region including a specific position after the gaze is started by moving a specific position. That is, the point where the pupil 200 gazes may be changed in the same area.

The password input screen 110 may be displayed on the display 105. The password may be set to the input order of the cryptographic component 120 or the movement pattern of the pupil, and may include the stop time of the pupil 200. If the password is set including the input sequence and the stop time of the cryptographic component 120, the input sequence of the cryptographic component 120 and the stop to stare at each cryptographic component 120 entered by the pupil 200 If the time matches the preset input order and time, the lock is released. When the password is set to the movement pattern and the stop time of the pupil 200, the lock is released if the movement pattern and the stop time of the pupil 200 match the preset order and time.

In this case, the password for unlocking may include time information for the pupil 200 to stop and gaze in addition to the order in which the encryption component 120 is selected by the input. For example, when the password for unlocking is 3457, 3, 4, 5, and 7 may be set to have the same gaze time of the pupil 200 required to be recognized as an input, respectively.

Alternatively, the movement order of the pupils 200 of the user required for unlocking is fixed, and the encryption component 120 may be arranged in the same or random order every time the lock screen is displayed. If the user's eye movement order required for unlocking is left top, right bottom, left, top right, regardless of the arrangement of the cryptographic component 120, the user moves the pupil to the top left, bottom right, left, top right, You can unlock it.

In this case, the password for unlocking may include time information in which the pupil 200 stops and the gaze continues in addition to the movement order of the pupil 200 of the user.

In addition, in order to release the lock state of the user device based on the position and stop time of the pupil 200, an input that lasts for a predetermined time or more is required for the same area. In response to this, when the user's pupil 200 looks at a specific area, a loading bar 180 indicating a stop time of the pupil 200 may be displayed.

The loading bar 180 may indicate the stop time of the pupil 200 step by step. That is, when the gaze time recognized as an input is set in three stages, it may be divided into a first area 181, a second area 182, and a third area 183, and the pupil 200 stops. As the gaze time increases, the input may be changed from the first area 181 to the third area 183. The loading bar 180 may be displayed on a portion of the display 105 or the entire display 105 in response to the position of the pupil 200 of the user.

Since the input step of time according to the gaze time must be distinguished in the input process and recognized by the user, when the loading bar 180 is not displayed, the input step of time according to the gaze time may be performed by using color change or vibration of the display 105. I can display it. For example, the background screen of the display 105 may indicate a blue color representing a gaze input time of a first stage, a red color representing a gaze input time of a second stage, and a gaze input time of a third stage according to the elapsed input time of a pupil. The display may be alternately displayed in white, and may be repeatedly displayed in the order of the first step, the second step, and the third step over time.

When the user wants to input the gaze input time of the second stage, when the display 105 is red, the second method is to move the gaze to the password of the next cryptographic element, or to shake or tilt the user device 100. The gaze time input of the step may be determined, and when the gaze time input of the pupil 200 is determined, the user may be notified of the gaze time by vibration, light, sound, or the like.

6 is a conceptual diagram illustrating a user device according to another embodiment of the present invention. Referring to FIG. 6, the user device 100 includes a camera unit 130, a pupil position measuring unit 140, a pupil input time measuring unit 145, a storage unit 150, a user setting unit 160, and a controller ( 170).

The pupil input time measuring unit 145 measures the input time of the pupil 200. That is, by measuring the time duration of the stop state after the movement of the pupil 200 to determine the input time zone of the pupil of the time zone divided by stages.

The storage unit 150 may store a password, etc. set by the user setting unit 160, and the controller 170 may include a camera unit 130, a pupil position measuring unit 140, a pupil input time measuring unit 145, The controller 150 may be implemented to control operations of the storage 150 and the user setter 160.

In addition, the controller 170 releases the lock state of the user device 100 when the information on the position and the stop time of the pupil input as a result of the analysis of the pupil position measurement can release the lock state of the user device 100. It can be implemented to. On the contrary, the controller 170 does not release the locked state of the user device 100 when the information on the position and the stop time of the input pupil as a result of the analysis of the pupil position measurement cannot release the locked state of the user device 100. And re-enter information about the user's pupil position and stop time.

As shown in FIG. 1, the user device 100 displays the cryptographic component 120 on the display 105 to release the lock (S710). The cipher component 120 is an image symbol used to set a cipher, and may include a symbol, a photograph, a figure, a number, a letter, a symbol, or the like, and may be displayed as a combination thereof.

The cryptographic component 120 may be arranged in a series of orders on the display 105, or may be arranged in any order. For example, it may be displayed in an ordinal number starting from the upper left of the display 105 toward the lower right and may be displayed in any order as shown in FIG. 1. According to the arrangement order of the cryptographic components 120 displayed on the display 105, the movement information of the user pupil 200 required for unlocking may also be correspondingly changed.

Next, the camera unit 130 collects position information of the pupil 200 (S720). Collecting the position information of the pupil 200 is a step of applying a XY coordinate system to the shooting screen by setting a predetermined reference point as the origin, the X-axis coordinate value and the Y-axis coordinate value of the position of the pupil of the user 200 is photographed Calculating.

Next, by comparing the position information of the pupil 200 collected by the camera unit 130 and the position of the pupil required for unlocking, it is determined whether or not it matches the password (S730), and locks the user device 100 according to the determination result. It is determined whether to release the state (S740). In determining whether to release the locked state, in addition to the information related to the position of the pupil, the user may further include a face recognition authentication procedure of the user.

The password may be set in the order of entry of the cryptographic components or the movement pattern of the pupil. When the password is set in the input order of the cipher components, the lock is released when the input order of the cipher components 120 input by the pupil 200 matches the preset order. If the password is set to the movement pattern of the pupil, the lock is released if the movement pattern of the pupil matches the preset order.

In addition, when the position information of the pupil 200 and the position of the pupil required for unlocking are not matched with each other and the password is not matched, the determination step may be terminated without the unlocking state of the user device 100 being released.

8 is a conceptual diagram illustrating an authentication method based on pupil positions according to another embodiment of the present invention. The cryptographic component 120 displayed on the display 105 may be set in plural. That is, the first cryptographic component 120-1, the second cryptographic component 120-2, and the third cryptographic component 120-3 may be set. Each cryptographic component can be set to a different password. For example, the password of the first cryptographic component 120-1 may be set to 1674, the password of the second cryptographic component 120-2 may be set to 8194, and the third cryptographic component 120 The password of -3) may be set to the right, top, left, and bottom of the pupil based on the star figure in which the movement pattern of the pupil is displayed in the center.

The first cryptographic component 120-1, the second cryptographic component 120-2, and the third cryptographic component 120-3 may be distinguished by the color of the display 105, the page display, and the like. For example, if the display 105 is blue, it can be unlocked by entering the password of the first cryptographic component 120-1, and if the display 105 is red, the second cryptographic component 120 -2) can be unlocked by entering the password, and if the display 105 is yellow, it can be unlocked by entering the password of the third cryptographic component 120-3.

If the display 105 is blue, the password of the first cryptographic component 120-1 is 1674, so the user can move the pupil 200 in order of 1674 to unlock it. In the drawing, the first cryptographic component 120-1 is sequentially displayed, but may be displayed in any order, such as the second cryptographic component 120-2. Even in this case, the user can enter the password 1674 of the first cryptographic component 120-1 to unlock it.

If the display 105 is red, the password of the second cryptographic component 120-2 is 8194, so the user can move the pupil 200 in order of 8194 to unlock.

When the display 105 is yellow, the password of the third cipher component 120-3 is right, up, left, and bottom based on the figure of the star in which the movement pattern of the pupil is displayed in the center. Can be unlocked by moving right, up, left and down.

As described above, passwords are set differently according to each cryptographic component, thereby improving security.

By using a method of recognizing the movement of the position of the eyes of a person, which is a biometric technology, not only can provide a user-friendly environment more convenient than the existing key input, but also improves security. In addition, the user's range can be widened by using an eye position based interface.

A user device for unlocking based on pupil position according to an embodiment of the present invention may be used for unlocking various devices.

As shown in FIG. 9, the user device 100 displays the cryptographic component 120 on the display 105 to release the lock (S910). The cipher component 120 is an image symbol used to set a cipher, and may include a symbol, a photograph, a figure, a number, a letter, a symbol, or the like, and may be displayed as a combination thereof.

The cryptographic component 120 may be arranged in a series of orders on the display 105, or may be arranged in any order. For example, the display 105 may be displayed in an ordinal number starting from the upper left of the display 105 toward the lower right and may be displayed in any order as shown in FIG. 9. According to the arrangement order of the cryptographic components 120 displayed on the display 105, the movement information of the user pupil 200 required for unlocking may also be correspondingly changed.

Next, the camera unit 130 collects position information of the pupil 200, and the pupil input time measuring unit 145 measures the input time of the pupil 200 (S920). Collecting the position information of the pupil 200 is a step of applying a XY coordinate system to the shooting screen by setting a predetermined reference point as the origin, the X-axis coordinate value and the Y-axis coordinate value of the position of the pupil of the user 200 is photographed Calculating.

Next, the location information of the pupil 200 collected by the camera unit 130 and the position and stop time of the pupil required for unlocking are compared to determine whether the password matches the password (S930), and the user device 100 according to the determination result. It is determined whether or not to release the lock state (S940). In determining whether to release the locked state, in addition to the information related to the position of the pupil, the user may further include a face recognition authentication procedure of the user.

In addition, when the location information of the pupil 200 and the location and stop time of the pupil required for unlocking are not matched with each other and the password is not matched, the determination step may be terminated without unlocking the user device 100.

In addition, in FIG. 6, since the password includes the stop time of the pupil 200, the color of the display 105 may be sequentially changed as time passes, or the input time may be confirmed by a change in vibration or brightness. have.

The unlocking method of the user device based on the pupil position according to the embodiment of the present invention can be written by a computer program, and codes and code segments constituting the computer program can be easily inferred by a computer programmer in the art. In addition, the computer program may be stored in a computer readable media and may be read and executed by a computer or a user device according to an embodiment of the present invention to implement a method of releasing a locked state of the user device. have.

The information storage medium includes a magnetic recording medium, an optical recording medium and a carrier wave medium. A computer program for implementing a method of releasing a locked state of a user device according to an embodiment of the present invention may be stored and installed in an internal memory of a user device. Alternatively, an external memory such as a smart card storing and installing a computer program for implementing a method of releasing a locked state of a user device according to an embodiment of the present invention may be mounted on a terminal or the like through an interface.

The above description may be modified and modified by those skilled in the art without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the present invention.

The present invention can determine whether to unlock the user device by determining whether the location information of the pupil input to the user device matches the password. Such a method may be utilized in a user device to provide a more convenient user-friendly environment and to increase the security of the user device.

In addition, the present invention uses the user's facial recognition authentication process in addition to the pupil position information to unlock the user device to determine the degree of security to the user device to adaptively set whether to unlock the user device according to the situation Can be applied to

Claims

A camera unit for collecting pupil location information on the location of the user device gazing at the pupil of the user;

A position measuring unit for sequentially detecting a direction in which the position of the pupil moves based on the pupil position information; And

And a control unit configured to compare the order of the detected pupil positions with a preset direction and determine whether they match, and to release the lock according to the result. User device performing the release.
The method of claim 1,

And the control unit is further configured to perform face recognition of the user and release the lock according to the result.
The method of claim 1,

The control unit is configured to release the lock based on the result of the pupil in consideration of the movement length and position information of the pupil.
Displaying the cryptographic components at different locations on the display;

A detection step of identifying a pupil of a user gazing at the display and sequentially detecting a direction in which the position of the display at which the pupil gazes moves; And

And releasing the lock according to the result after determining whether the position of the display gazed by the measured pupil is compared with the order of the moving direction and the preset direction to determine whether there is a match. How to unlock user device based on pupil position.
The method of claim 4, wherein

And wherein said displaying step displays said cryptographic component in any arrangement on said display.
The method of claim 4, wherein

And wherein the cryptographic component comprises at least one of a symbol, a picture, a figure, a number, a letter, and a symbol.
The method of claim 4, wherein

And displaying the plurality of cryptographic components and setting the plurality of cryptographic components to different passwords, respectively.
The method of claim 7, wherein

And the password is set to an input order of the cryptographic component or a movement pattern of the pupil.
The method of claim 4, wherein

And said unlocking step is further implemented to perform facial recognition of said user and to unlock according to the result.
The method of claim 4, wherein

And wherein said detecting step is implemented to realize feedback on an input by said pupil staring at said display.
A recording medium on which a computer program for performing the method according to any one of claims 4 to 10 is recorded.
A camera unit which collects position information of the pupil input to the user device;

A position measuring unit for sequentially detecting a direction in which the position of the pupil moves based on the pupil position information;

A pupil input time measuring unit configured to measure a time duration of the stop state after the movement of the pupil to determine a stop time of the pupil in a time zone divided by stages; And

And a controller configured to compare the order of the detected pupil positions with the order of the predetermined direction and the stop time, determine whether they match, and release the lock according to the result. User device to unlock based on position and stop time.