KR102216020B1 - Method for providing user interface using gaze recognition and user apparatus using the same - Google Patents

Abstract

The present application relates to a method of providing a gaze recognition interface and a user terminal therefor. The method of providing a gaze recognition interface of a user terminal according to an embodiment of the present invention uses a gaze recognition sensor, A gaze recognition step of recognizing a gaze position; And when the gaze position is recognized, a recognition display step of displaying a recognition display icon indicating that the gaze position is being recognized in a setting area of the display unit.

Description

Method for providing gaze recognition interface and user terminal therefor {Method for providing user interface using gaze recognition and user apparatus using the same}

The present application relates to a method of providing a gaze recognition interface and a user terminal therefor, and to a method of providing a gaze recognition interface capable of displaying whether or not the user's gaze is recognized and the recognized gaze position, and a user terminal therefor.

The gaze recognition technology is a technology that captures the movement of the eyes and estimates the point at which the user gazes. With the development of information technology, gaze recognition technologies are being used in various fields. For example, in the field of advertising, it is possible to evaluate whether people are looking at products, advertising models, or company brands by showing advertisement proposals to consumers and collecting information about where and when they look. I can. In addition, in the marketing field, it is possible to provide a number of contents to a device to people, and set a high user preference score for contents that people watch for a long time with interest.

On the other hand, information communication technology using wired and wireless communication networks is growing very rapidly in a short period of time due to new technologies and functions that stimulate consumer purchase. In particular, due to the development of the technology, various applications that meet the needs of users are being installed beyond the step of performing simple applications. Accordingly, the user can use voice information, text information, image information, MP3 (Moving Picture Experts Group) layer 3 (MP3), games, and the like through a portable terminal.

However, in the portable terminal, it may be difficult for the user to input a touch input due to the limitation of the screen size, and in order to solve this problem, a method of utilizing gaze recognition technology as an input method for the portable terminal may be considered.

The present application is to provide a method for providing a gaze recognition interface that can intuitively provide a user with a gaze recognition status and a gaze position recognized when gaze recognition, and a user terminal for the same.

The present application is to provide a method of providing a gaze recognition interface capable of displaying a user's gaze position in various embodiments, and a user terminal therefor.

According to an embodiment of the present invention, a method of providing a gaze recognition interface of a user terminal includes a gaze recognition step of recognizing a gaze position of a user positioned on a display unit using a gaze recognition sensor; And when the gaze position is recognized, a recognition display step of displaying a recognition display icon indicating that the gaze position is being recognized in a setting area of the display unit.

A user terminal according to an embodiment of the present invention includes a display unit; A gaze recognition sensor for recognizing a gaze position of a user positioned on the display unit; And a control unit for controlling to display a recognition display icon indicating that the gaze position is being recognized in a setting area of the display unit when the gaze position is recognized.

In addition, the solution to the above-described problem does not enumerate all the features of the present invention. Various features of the present invention and advantages and effects thereof may be understood in more detail with reference to the following specific embodiments.

According to the method for providing a gaze recognition interface and a user terminal therefor according to an embodiment of the present invention, whether or not the user terminal is currently performing gaze recognition of the user can be intuitively displayed. Therefore, the user can easily check whether the gaze is recognized, and in consideration of this, the user terminal can be efficiently controlled.

According to the method for providing a gaze recognition interface and a user terminal therefor according to an embodiment of the present invention, the gaze position recognized by the user terminal may be displayed to the user in various embodiments. Accordingly, the user can intuitively check his gaze position being recognized, and can easily apply various inputs using gaze recognition to the user terminal.

However, the method for providing a gaze recognition interface according to embodiments of the present invention and the effects that can be achieved by the user terminal therefor are not limited to those mentioned above, and other effects not mentioned are the present invention from the following description. It will be clearly understood by those of ordinary skill in the art to which it belongs.

1 is a schematic diagram showing a system for providing a gaze recognition interface according to an embodiment of the present invention.
2 is a block diagram showing a user terminal according to an embodiment of the present invention.
3 is a schematic diagram showing gaze recognition of a user terminal according to an embodiment of the present invention.
4 to 8 are schematic diagrams showing a gaze recognition interface according to an embodiment of the present invention.
9 is a flowchart illustrating a method of providing a gaze recognition interface of a user terminal according to an embodiment of the present invention.

Hereinafter, exemplary embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings, but identical or similar elements are denoted by the same reference numerals regardless of the reference numerals, and redundant descriptions thereof will be omitted. The suffixes "module" and "unit" for components used in the following description are given or used interchangeably in consideration of only the ease of preparation of the specification, and do not have meanings or roles that are distinguished from each other by themselves. That is, the term'unit' used in the present invention means a hardware component such as software, FPGA or ASIC, and the'unit' performs certain roles. However,'part' is not limited to software or hardware. The'unit' may be configured to be in an addressable storage medium, or may be configured to reproduce one or more processors. Thus, as an example,'unit' refers to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, procedures, Includes subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, database, data structures, tables, arrays and variables. The functions provided in the components and'units' may be combined into a smaller number of components and'units', or may be further divided into additional components and'units'.

In addition, in describing the embodiments disclosed in the present specification, when it is determined that a detailed description of related known technologies may obscure the subject matter of the embodiments disclosed in the present specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are for easy understanding of the embodiments disclosed in the present specification, and the technical idea disclosed in the present specification is not limited by the accompanying drawings, and all changes included in the spirit and scope of the present invention It should be understood to include equivalents or substitutes.

1 is a schematic diagram showing a system for providing a gaze recognition interface according to an embodiment of the present invention.

Referring to FIG. 1, a system for providing a gaze recognition interface according to an embodiment of the present invention may include a user terminal 100 and a service server 200.

Hereinafter, a system for providing a gaze recognition interface according to an embodiment of the present invention will be described with reference to FIG. 1.

The user terminal 100 may execute various types of applications, and may display the running application in visual or auditory manner and provide it to the user. The user terminal 100 may include a display unit for visually displaying an application, and may include an input unit receiving user input, a communication unit, a memory storing at least one program, and a processor.

The user terminal 100 may be a mobile terminal such as a smart phone or a tablet PC, and according to embodiments, a fixed device such as a desktop may also be included. Here, the user terminal 100 includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistants (PDA), a portable multimedia player (PMP), a slate PC, and a tablet. PC (tablet PC), ultrabook (ultrabook), wearable device (wearable device, for example, a watch-type terminal (smartwatch), glass-type terminal (smart glass), HMD (head mounted display)) and the like may be included.

The user terminal 100 may access an App store or a play store to download and install various applications. Depending on the embodiment, it may be downloaded through wired or wireless communication with the service server 200 or other devices (not shown).

Here, the application may be a web browser application that outputs content such as a webtoon, game, news, image, audio, or video provided online, or a dedicated application for providing each content.

Depending on the embodiment, the user terminal 100 may provide a function of recognizing the user's gaze position, and the application may provide various user interfaces using a function of recognizing the gaze position. For example, in the case of an application that recognizes the user's gaze position and performs an action such as clicking, or provides webtoon or e-book content, natural page scrolling and page turning are performed through the user's gaze recognition. Can be done. In this case, the user can concentrate on the content without being disturbed, such as taking other actions, etc., and it is possible to provide a new user experience that replaces the existing touch input.

Meanwhile, the user terminal 100 may be connected to the service server 10 through a communication network. Here, the communication network may include a wired network and a wireless network, and specifically, various types of networks such as a local area network (LAN), a metropolitan area network (MAN), and a wide area network (WAN). May include a network. Further, the communication network may include a well-known World Wide Web (WWW). However, the communication network according to the present invention is not limited to the networks listed above, and may include a known wireless data network, a known telephone network, a known wired or wireless television network, and the like.

The service server 200 may be connected to the user terminal 100 through an application, and may provide various contents such as webtoons, games, news, images, audio, and video in response to a request of the user terminal 100.

2 is a block diagram showing a user terminal according to an embodiment of the present invention.

Referring to FIG. 2, the user terminal 100 according to an embodiment of the present invention may include a display unit 110, a gaze recognition sensor 120, and a control unit 130.

Hereinafter, a user terminal according to an embodiment of the present invention will be described with reference to FIG. 2.

The display unit 110 may display applications or contents running in the user terminal 100, and the user may visually check the application or contents through the display unit 110. Here, the display unit 110 is a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, 3 It may be implemented as a 3D display, an electrophoretic display, or the like. However, the content of the present invention is not limited thereto, and the display unit 110 may be implemented in various ways.

Depending on the embodiment, a touch panel (not shown) may be included in the display unit 110, and the touch panel may receive a touch or a gesture using an electronic pen or a user's body part as an input. The touch panel may be implemented in a capacitive type, a pressure sensitive type, an infrared type, or the like, and may further include a pressure sensor capable of measuring the intensity of a pressure for a user's touch according to embodiments. The pressure sensor may be implemented integrally with the touch panel, or may be implemented as one or more sensors separate from the touch panel.

The gaze recognition sensor 120 may recognize the gaze position of the user located on the display unit 110. As shown in FIG. 3, the gaze recognition sensor 120 may acquire an image including the user's pupils, and then, from the image, may determine a location where an external light source is formed in the user's pupil. In this case, by using the correlation between the location of the external light source and the location of the external light source in the pupil, the location of the user's pupil center can be determined. Here, since the location where the extension line of the pupil center meets the display unit 110 corresponds to the user's gaze location, it is possible to recognize the user's gaze location from the location of the user's pupil center. The gaze recognition sensor 120 may be implemented with a general camera or an infrared camera, but is not limited thereto, and may be implemented with various types of sensors or algorithms according to embodiments.

Whether the gaze recognition sensor 120 is operated may be determined by the controller 130, and the gaze position recognized by the gaze recognition sensor 120 may be provided to the controller 130. Depending on the embodiment, when the gaze recognition sensor 120 transmits measurement information, such as an image of a user's pupils, to the controller, the controller 130 may directly calculate the gaze position using the measurement information.

The controller 130 may control the overall operation of the user terminal 100, and according to an embodiment, various gaze recognition interfaces may be provided using the user's gaze position recognized by the gaze recognition sensor 120. .

Specifically, the control unit 130 may control to display a recognition display icon indicating that the gaze position is being recognized in the setting area of the display unit 110. For example, when a user uses a user terminal 100 such as a smartphone, the user terminal 100 receives a touch input applied by the user using a finger and a gaze input through the user's gaze recognition. I can. However, the user may not be able to recognize that gaze is currently being recognized, and in this case, gaze recognition may not be accurately performed, such as the user's finger covering the display unit 110 during a touch input. In order to prevent this, the controller 130 may display a recognition display icon on the display unit 110 so that the user can easily confirm that the current gaze position is being recognized.

That is, as shown in FIG. 4, the controller 130 may indicate that the user terminal 100 is currently recognizing the gaze by displaying the recognition display icon b in the setting area a. Here, the setting area (a) may be a status bar displayed on the top of the display unit 110, as shown in Fig. 4(a), and the recognition display icon (b) is a status display bar. Can be located within. In addition, as shown in Fig. 4(b), the setting area (a) is set in an arbitrary area in the display unit 110 other than the status display bar, and the recognition display icon (b) is displayed in the setting area (a). It is also possible to do.

On the other hand, gaze recognition by the gaze recognition sensor 120 may be disturbed by a body part such as a user's hand or arm or other objects positioned between the user terminal 100 and the user's eyes. In this case, the gaze recognition sensor 120 may stop gaze recognition because gaze recognition fails. Alternatively, the user may want to stop the gaze recognition function by himself. In this way, when recognition of the gaze position fails or a request for stopping gaze recognition is received from the user, the controller 130 may remove the recognition display icon b from the setting area (a). That is, the user can clearly recognize whether the user terminal 100 is currently performing gaze recognition by checking the presence or absence of the recognition display icon (b) in the setting area (a).

Additionally, when receiving a gaze recognition request from a user, the controller 130 may output a first animation corresponding to the gaze recognition request on the display unit 110. For example, as shown in Fig. 5(a), the first animation c1 may be a countdown that sequentially displays 5, 4, 3, 2, 1, and 0, and the controller 130 counts While down is in progress, gaze recognition for the user can be performed. That is, while the first animation c1 is being output, the control unit 130 may track the user's gaze and recognize the gaze position. Here, the first animation c1 may be implemented in various ways, such as an animation in which a progressive bar is sequentially filled in addition to the countdown.

In addition, depending on the embodiment, as shown in Fig. 5(b), it is possible to further include an element that can attract the user's attention such as a character image c2 in the first animation. That is, it is possible to induce the user's gaze position to be located at a specific point of the display unit 110 using the first animation. Here, the specific point corresponds to a preset position as advantageous for the gaze recognition sensor 120 to recognize the user's gaze position. For example, the specific point may be a central point among the entire area of the display unit 110 or one of vertices included in the display unit 110. The control unit 130 can induce the user's gaze in a manner such as displaying a character, symbol, character, etc. on a specific point, or flashing a specific point, through which the gaze recognition sensor 120 can easily You can recognize the position of the eye.

Thereafter, when the user's gaze position is recognized, the controller 130 may display a location corresponding to the user's gaze position on the display unit 110. That is, the user may display the gaze position on the display unit 110 so as to intuitively recognize where his or her gaze position is located on the display unit 110. Here, the controller 130 may display the user's gaze position using various embodiments.

Referring to FIG. 6A, the controller 130 may display the gaze position icon d on the display unit 110 in correspondence to the recognized gaze position. That is, the user can clearly recognize his/her gaze position by using the gaze position icon d located on the display unit 110. In this case, the controller 130 may display the gaze position icon d in a translucent manner, so that the user does not interfere with viewing the content displayed on the display unit 110. The controller 130 may move the gaze position icon d according to a change in the user's gaze position.

In addition, as shown in FIG. 6(b), the gaze position may be indicated by displaying a second animation (e) indicating movement of the user's gaze position on the display unit. For example, the movement of the gaze position may be indicated by using an animation in which a wave occurs, an animation in which a wave occurs, or an animation displaying an afterimage of the gaze position icon d in response to a path in which the gaze position moves. Here, although the case of displaying the gaze position icon d is illustrated, it is possible to display the gaze position of the user only by the second animation e without displaying the gaze position icon d according to an embodiment.

Specifically, the control unit 130 may indicate the gaze position by overlapping and displaying the first layer and the second layer. That is, a running application or content may be displayed on the first layer, and a second animation e corresponding to a change in the user's gaze position may be displayed on the second layer. Thereafter, when the first layer and the second layer are overlapped, the gaze position of a user moving on the application or content may be displayed on the display unit 110 as a second animation.

In addition, the controller 130 may display the user's gaze position by vibrating objects close to the user's gaze position. That is, as shown in Fig. 7(a), when the gaze position f is located within the set range from the objects g displayed on the display unit 110, the objects g are vibrated to display the gaze position. I can. In Fig. 7(a), the gaze position f is displayed as a gaze position icon, but this is for convenience of explanation. Instead of displaying the gaze position icon on the display unit 110, it is also possible to display the gaze position only by vibration of objects It is possible.

In addition, according to an exemplary embodiment, as the gaze position f approaches the object g, the vibration period of the object g may be shortened. That is, the user can check his/her gaze position f through the vibration period of the object g. Here, in the case where the user positions the gaze position on a specific object g for a predetermined time or longer, the control unit 130 may process the object g as selected, and move to a page connected to the object g. You can perform a corresponding operation such as.

Meanwhile, when a plurality of objects are located, the vibration period of the object g close to the gaze position f may be displayed relatively shorter. For example, the vibration period is set in proportion to the distance between the gaze position (f) and the objects (g), or depending on the embodiment, objects (g) located within a set distance from the gaze position (f) Regarding, the vibration period can be given a weight to make it vibrate faster. Furthermore, after dividing into a plurality of steps according to the distance from the gaze position f, it is also possible to set a different vibration period for each step. Accordingly, the user can easily check that his/her gaze position is located around the object g having a fast vibration period, and can grasp the movement of the gaze position.

As shown in FIG. 8, when two objects g1 and g2 are displayed on the display unit 110, the controller 130 is relatively close to the gaze position f among the two objects g1 and g2. You can make the object on the side vibrate faster. Here, the distance from the gaze position f may be based on a virtual center line formed between the first object g1 and the second object g2.

Therefore, as shown in Fig. 8(a), when the user's gaze position f is close to the first object g1, the first object g1 vibrates rapidly and the second object g2 vibrates relatively little. You can do it. In addition, when the user's gaze position f is located on the center line as shown in FIG. 8(b), both the first object g1 and the second object g2 may vibrate relatively little. On the other hand, as shown in FIG. 8(c), when the user's gaze position f exceeds the center line, the second object g2 vibrates rapidly and the first object g1 vibrates relatively less. Through this, it is possible for the user to clearly grasp his gaze position f.

Additionally, the controller 130 may vibrate the objects g in consideration of the moving direction of the gaze position. That is, as shown in FIG. 7B, the region of interest h may be set based on the moving direction of the gaze position, and objects included in the region of interest h may be controlled to vibrate. In the case of vibrating an object (g) located within a certain range based on the gaze position (f), all objects (g) located in all directions around the gaze position (f) can vibrate, so the gaze position (f It can be difficult to determine the exact location of ). Accordingly, after setting the region of interest h based on the moving direction of the gaze position f, it is possible to display only the objects g located in the region of interest h to vibrate.

9 is a flowchart illustrating a method of providing a gaze recognition interface of a user terminal according to an embodiment of the present invention.

Referring to FIG. 9, a method for providing a gaze recognition interface of a user terminal according to an embodiment of the present invention includes a gaze recognition step (S110), a recognition display step (S120), a gaze display step (S130), and a recognition stop step (S140). It may include.

Hereinafter, a method of providing a gaze recognition interface of a user terminal according to an embodiment of the present invention will be described with reference to FIG. 9.

In the gaze recognition step (S110), the gaze position of the user located on the display unit of the user terminal may be recognized using the gaze recognition sensor. The gaze recognition sensor may be implemented with a general camera or an infrared camera, but is not limited thereto, and may be implemented with various types of sensors or algorithms according to embodiments. The user terminal may perform an operation such as a click using the recognized gaze position, or may perform a page scrolling operation or a page turning operation in the case of webtoon or e-book content.

In the recognition display step S120, when the gaze position is recognized, a recognition display icon indicating that the gaze position is being recognized may be displayed in a setting area of the display unit. The user may not be able to recognize that the user terminal is currently recognizing the gaze, and in this case, a part of the user's body or other object may cover the display unit and thus gaze recognition may not be accurately performed. To prevent this, the user terminal may display a recognition display icon on the display unit to indicate to the user that the current gaze position is being recognized. That is, by displaying the recognition display icon in the setting area, it is possible to notify that the user terminal is currently recognizing the gaze. Here, the setting area may be a status bar displayed on the top of the display unit or may be set in an arbitrary area in the display unit other than the status display bar.

Additionally, when receiving a gaze recognition request from a user, a first animation corresponding to the gaze recognition request may be output on the display unit. That is, while the first animation is being output, the user's gaze may be tracked to recognize the gaze position. Here, the first animation can be implemented in various ways, such as a countdown or a progress bar.

In addition, depending on the embodiment, it is possible to further include an element that can attract the user's attention, such as a character image, in the first animation. That is, it is possible to induce the user's gaze position to be located at a specific point of the display unit using the first animation. Here, the specific point may be a preset position as advantageous for the gaze recognition sensor to recognize the user's gaze position.

In the gaze display step S130, a location corresponding to the recognized gaze location may be displayed on the display unit. That is, the user may display the gaze position on the display unit so that the user can intuitively recognize where his or her gaze position is located on the display unit. Here, the user terminal may display the user's gaze position using various embodiments.

First, the user terminal may display a gaze location icon on the display unit in response to the recognized gaze location. That is, the gaze position can be clearly indicated on the display unit by using the gaze position icon. At this time, the gaze position icon may be translucent, and may be moved according to a change in the user's gaze position.

Also, the user terminal may indicate the gaze position by displaying a second animation indicating movement of the gaze position of the user on the display unit. For example, the movement of the gaze position may be indicated by using an animation in which a wave occurs, an animation in which a wave occurs, an animation displaying an afterimage of the gaze position icon, or the like in response to a path in which the gaze position moves. In this case, the user terminal may indicate the gaze position by overlapping and displaying the first layer and the second layer. That is, a running application or content may be displayed on the first layer, and a second animation corresponding to a change in the user's gaze position may be displayed on the second layer. Thereafter, by overlapping the first layer and the second layer, the gaze position of the user moving on the application or content may be displayed as a second animation on the display unit.

In addition, the user terminal may display the user's gaze position by vibrating objects close to the user's gaze position. That is, when the gaze position is located within a set range from objects displayed on the display unit, the objects may be vibrated to display the gaze position. In this case, as the gaze position gets closer to the object, the vibration period of the object can be shortened, and the user can check his gaze position through the vibration period of the object.

When a plurality of objects are located, the user terminal may relatively shorten the vibration period of the object close to the gaze position. That is, the vibration period may be set in proportion to the gaze position and the distance between the objects, or objects located within a set distance from the gaze position may be made to vibrate faster by giving a weight to the vibration period. Further, it is possible to divide into a plurality of steps according to the distance from the gaze position, and then set a different vibration period for each step.

Additionally, the user terminal may vibrate the objects in consideration of the moving direction of the gaze position. That is, an ROI may be set based on the moving direction of the gaze position, and objects close to the gaze position among objects included in the ROI may be vibrated.

In the recognition stop step (S140), if recognition of the gaze position fails or a gaze recognition stop request is received from the user, the recognition display icon may be removed from the setting area. The gaze recognition by the gaze recognition sensor may be disturbed by a body part such as a user's hand or arm or other objects positioned between the user terminal and the user's eyes. In this case, the gaze recognition sensor may fail gaze recognition and stop gaze recognition. In addition, there may be a case in which the user himself wants to stop the gaze recognition function.

In this way, when recognition of the gaze position fails or a request for stopping gaze recognition is received from the user, the user terminal may indicate that gaze recognition has been stopped by removing the recognition display icon from the setting area. That is, the user can check whether or not the recognition display icon in the setting area is present, and recognize whether the user terminal is currently performing gaze recognition.

The above-described present invention can be implemented as a computer-readable code on a medium on which a program is recorded. The computer-readable medium may be one that continuously stores a program executable by a computer, or temporarily stores a program for execution or download. In addition, the medium may be a variety of recording means or storage means in a form in which a single piece of hardware or several pieces of hardware are combined, but is not limited to a medium directly connected to a computer system, and may be distributed on a network. Examples of media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magnetic-optical media such as floptical disks, and And a ROM, RAM, flash memory, and the like, and may be configured to store program instructions. In addition, examples of other media include an app store that distributes applications, a site that supplies or distributes various software, and a recording medium or storage medium managed by a server. Therefore, the detailed description above should not be construed as restrictive in all respects and should be considered as illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

The present invention is not limited by the above-described embodiments and the accompanying drawings. It will be apparent to those of ordinary skill in the art to which the present invention pertains, that components according to the present invention can be substituted, modified, and changed within the scope of the technical spirit of the present invention.

100: user terminal 110: display unit
120: gaze recognition sensor 130: control unit
200: service server
S110: gaze recognition step S120: recognition display step
S130: gaze display step S140: recognition interruption step

Claims (16)

In the method of providing a gaze recognition interface of a user terminal including a display unit, a gaze recognition sensor, and a control unit,
A gaze recognition step of recognizing a gaze position of a user positioned on the display unit by using a gaze recognition sensor;
A recognition display step of displaying a recognition display icon indicating that the gaze position is being recognized in a status bar displayed on an upper portion of the display unit, when the gaze position is recognized;
A recognition stopping step of removing the recognition display icon from the status display bar when the recognition of the gaze position fails or when a user inputs a gaze recognition stop request; And
And a gaze display step of displaying a location corresponding to the recognized gaze location on the display unit,
The gaze display step
When the gaze position is located within a set range from the objects displayed on the display unit, the objects are vibrated to display the gaze position,
The gaze display step
When the plurality of objects are located, the vibrating period of the object close to the gaze position is displayed relatively shorter.
delete delete The method of claim 1, wherein the gaze recognition step
When receiving a gaze recognition request from a user, a first animation corresponding to the gaze recognition request is output on the display unit, and the gaze position is recognized by tracking the user's gaze while the first animation is being output. A method of providing a gaze recognition interface of a user terminal.
The method of claim 4, wherein the gaze recognition step
Using the first animation, the method of providing a gaze recognition interface of a user terminal, characterized in that inducing the gaze position to be located at a specific point of the display unit.
delete The method of claim 1, wherein the step of displaying the line of sight
A method for providing a gaze recognition interface of a user terminal, comprising displaying a gaze location icon on the display unit in response to the recognized gaze location.
The method of claim 1, wherein the step of displaying the line of sight
When the gaze position moves, a second animation indicating the movement of the gaze position is displayed on the display unit.
The method of claim 8, wherein the step of displaying the line of sight
A gaze recognition interface of a user terminal, characterized in that a second layer including a second animation representing a wave or wave corresponding to the movement of the gaze position is superimposed and displayed on the first layer including the content selected by the user Delivery method.
delete The method of claim 1, wherein the step of displaying the line of sight
A method for providing a gaze recognition interface of a user terminal, characterized in that as the gaze position approaches the object, the vibration period of the object is displayed shortly.
In the method of providing a gaze recognition interface of a user terminal including a display unit, a gaze recognition sensor, and a control unit,
A gaze recognition step of recognizing a gaze position of a user positioned on the display unit by using a gaze recognition sensor;
A recognition display step of displaying a recognition display icon indicating that the gaze position is being recognized in a setting area of the display unit when the gaze position is recognized; And
And a gaze display step of displaying a location corresponding to the recognized gaze location on the display unit,
The gaze display step
When the gaze position is located within a set range from the objects displayed on the display unit, the objects are vibrated to display the gaze position,
The gaze display step
When the plurality of objects are located, the vibrating period of the object close to the gaze position is displayed relatively shorter.
The method of claim 12, wherein the step of displaying the line of sight
The gaze recognition interface of a user terminal, characterized in that the vibration period is set in proportion to the gaze position and the distance between the objects, and a weight is given to the vibration period for objects located within a set distance from the gaze location. Delivery method.
The method of claim 1, wherein the step of displaying the line of sight
A method for providing a gaze recognition interface of a user terminal, characterized in that: setting a region of interest based on a moving direction of the gaze position, and displaying the object located in the region of interest to vibrate in response to the gaze position.
A computer program stored in a medium to execute the method of providing a gaze recognition interface according to any one of claims 1, 4 to 5, 7 to 9, 11 to 14 in combination with hardware .
A display unit;
A gaze recognition sensor for recognizing a gaze position of a user positioned on the display unit; And
When the gaze position is recognized, a control unit for controlling to display a recognition display icon indicating that the gaze position is being recognized in a status bar displayed at the top of the display unit,
The control unit
When the recognition of the gaze position fails or a request to stop gaze recognition is received from the user, the recognition display icon is removed from the status display bar,
The control unit
A position corresponding to the recognized gaze position is displayed on the display unit, and when the gaze position is within a set range from objects displayed on the display unit, the objects are vibrated to display the gaze position, and the object When a plurality of are located, the user terminal, characterized in that to display a relatively shorter vibration period of the object close to the gaze position.

Images