KR102133018B1 - Method and its apparatus for controlling a mouse cursor using eye recognition - Google Patents

Abstract

The present invention relates to a method for controlling a mouse cursor using eye recognition and an electronic device thereof. The method for controlling a mouse cursor using eye recognition of an electronic device includes a process of receiving an eye image and analyzing the eye image to allow the eye to stare Including the process of determining a gaze point, a process of determining a smoothing filter coefficient according to the moving distance of the gaze point, and a process of controlling the movement speed of a mouse cursor based on the smoothing filter coefficient, the electronic There is an effect of adjusting the movement speed of the mouse cursor according to the movement speed of the gaze point that the user gazes at the device.

Description

A mouse cursor control method using eye recognition and its electronic device{METHOD AND ITS APPARATUS FOR CONTROLLING A MOUSE CURSOR USING EYE RECOGNITION}

The present invention relates to an electronic device, and more particularly, to a method and apparatus for controlling a mouse cursor using eye recognition technology in an electronic device.

An electronic device having a touch screen detects a user's hand or a touch pen through the touch screen, and performs an operation corresponding to the detected position. However, when an electronic device senses and operates a user's hand or touch pen, a user with a physically inadequate condition may not be able to operate the electronic device. Accordingly, recently, a method for controlling the operation of the electronic device by recognizing the user's eye (or eye) input from the camera in the electronic device has been discussed. For example, the electronic device may acquire an image of the eyeball using a camera provided in the electronic device, analyze the obtained eyeball image, and control a mouse cursor displayed on the display device.

However, when a mouse cursor is controlled using an eyeball image, a phenomenon in which the accuracy of determining the coordinates of the mouse cursor is reduced due to various factors occurs. For example, it is difficult for an electronic device to accurately determine coordinates based on eye movement capability, camera performance, and noise. In addition, when a mouse cursor is controlled using a conventional eyeball image, the moving speed of the mouse cursor is significantly reduced compared to the speed at which the user's gaze point moves, and there is a problem that it is difficult to efficiently control the eye mouse cursor.

Accordingly, there is a need to provide a method for accurately determining the coordinates of the mouse cursor when controlling the eye mouse cursor, and controlling the movement speed of the mouse cursor according to the user's gaze speed.

Accordingly, an embodiment of the present invention is to provide a method and apparatus for controlling a mouse cursor using an eye recognition technology in an electronic device.

Another embodiment of the present invention provides a method and apparatus for determining a flat filter coefficient according to a movement speed of a gaze point in an electronic device.

Another embodiment of the present invention to provide a method and apparatus for controlling the movement speed of the mouse cursor according to the movement speed of the gaze point in the electronic device.

Another embodiment of the present invention is to provide a method and apparatus for controlling the speed of a mouse cursor when the gaze point approaches within a threshold distance of content in the electronic device.

According to an embodiment of the present invention, in a method for controlling a mouse cursor using eye recognition in an electronic device, a process of receiving an eyeball image, analyzing the eyeball image, and determining a gaze point of the eyeball, And determining a smoothing filter coefficient according to the moving distance of the gaze point, and controlling a moving speed of the mouse cursor based on the smoothing filter coefficient.

According to an embodiment of the present invention, an electronic device that controls a mouse cursor using eye recognition includes an image acquisition unit that receives an eyeball image, analyzes the eyeball image, determines a gaze point at which the eyeball gazes, and the gaze After determining the smoothing filter coefficient according to the moving distance of the point, a cursor speed control unit controlling the moving speed of the mouse cursor based on the smoothing filter coefficient.

In the present invention, the electronic device receives an eyeball image, analyzes the received eyeball image, determines a gaze point that the user gazes, applies different flat filter coefficients according to the determined moving distance of the gaze point, and mouse cursor By controlling the moving speed of, the moving speed of the mouse cursor may be adjusted according to the moving speed of the gaze point that the user gazes in the electronic device.

1 is a diagram illustrating an electronic device for controlling a mouse by recognizing a user's eye according to an embodiment of the present invention;
2 is a block diagram of an electronic device for controlling a mouse by recognizing a user's eye according to an embodiment of the present invention;
FIG. 3 is a graph showing a relationship between a gaze point and a flat filter coefficient in an electronic device according to an embodiment of the present invention;
4A is a diagram illustrating a procedure for controlling a moving speed of a mouse cursor according to a moving distance of a gaze point in an electronic device according to an embodiment of the present invention;
4B is a view showing a means for controlling a movement speed of a mouse cursor according to a movement distance of a gaze point in an electronic device according to an embodiment of the present invention;
5 is a view showing a procedure for controlling the mouse cursor according to the movement speed of the gaze point by recognizing the eyeball in the electronic device according to an embodiment of the present invention;
6 is a view showing a procedure for controlling the speed of the mouse cursor when the gaze point is moved in the electronic device according to an embodiment of the present invention;
7 is a diagram illustrating a procedure for controlling the speed of a mouse cursor when a gaze point is moved around content in an electronic device according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. And, in the description of the present invention, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description will be omitted. In addition, terms to be described later are terms defined in consideration of functions in the present invention, which may vary according to a user's or operator's intention or practice. Therefore, the definition should be made based on the contents throughout this specification.

1 illustrates an electronic device for controlling a mouse by recognizing a user's eye according to an embodiment of the present invention.

Referring to FIG. 1, the electronic device includes a display device 101, a first light emitting diode (LED) 103, a second LED 105, and a camera 107.

The display device 101 displays graphic elements of the electronic device. The display device 101 provides an interface for input/output between the electronic device and the user. That is, the display device 101 provides visual output based on text, graphics, and video to the user in response to user input. The display device 101 according to the present invention may display a mouse cursor at a position corresponding to the gaze point coordinates determined by the user's eyeball to gaze. In addition, the display device 101 may display the mouse cursor by moving the user's gaze point according to the moving speed.

The first LED 103 may output light to the user's eyeball to obtain a user's eyeball image clearly. At this time, the first LED 103 means one or more LEDs provided around the camera of the electronic device. Specifically, the first LED may output bright light to the pupil of the user in order to accurately determine the position of the LED point output from the second LED in the user's eye image. That is, when the point of the second LED overlaps the user pupil, it may be difficult to accurately determine the point position of the second LED due to the dark color of the pupil. Therefore, in order to solve this problem, it is possible to more accurately determine the point position of the second LED by outputting bright light to the pupil of the user through the first LED so that the pupil portion of the eye image has a brighter color than the original color. To make.

The second LED 105 may output light to determine the gaze point that the user gazes, and to make the LED point on the user's eyeball. At this time, the second LED 105 may be composed of two or more LEDs. The second LED 105 according to an embodiment of the present invention may be output at a point in time after light is output from the first LED 103 to make the LED point on the eyeball.

The camera 107 may photograph an eyeball of the user to obtain an eyeball image. The camera 107 according to an embodiment of the present invention may acquire an eyeball image by performing image shooting after the first LED 103 and the second LED 105 sequentially output light. At this time, since the camera 107 performs photographing after the first LED 103 and the second LED 105 output light, it is possible to photograph an image in which the point of the second LED 105 is formed on the eyeball. .

2 is a block diagram of an electronic device for controlling a mouse by recognizing a user's eye according to an embodiment of the present invention.

Referring to FIG. 2, the electronic device 200 includes an LED output control unit 201, an image acquisition unit 203, and a cursor speed control unit 205.

The LED output control unit 201 may control the first LED and the second LED provided in the electronic device 200 to output light. In detail, when the input for eye recognition is received by the user control, the LED output control unit 201 controls the second LED to output light, and when the second LED outputs light, the LED output control unit 201 is attached to the eyeball. In order to distinguish the LED points, the first LED provided around the camera may be driven to control light output. The LED output control unit 201 may drive the first LED first so that light is output, and then control the second LED to output light, and simultaneously drive the first LED and the second LED to generate light. It can also be controlled to be output.

After the light is output from the second LED, the image acquisition unit 203 may capture an image of the eyeball using a camera provided in the electronic device. In other words, the image acquisition unit 203 may take an image of the eyeball using a camera after the LED point is formed on the eyeball by the light output from the second LED. Subsequently, the image acquisition unit 203 may acquire an eyeball image by capturing an image through a camera at a predetermined period, or may acquire an eyeball image in real time through the camera.

The cursor speed control unit 205 may analyze the image acquired by the image acquisition unit 203 to control the moving speed of the mouse cursor. First, the cursor speed controller 205 may determine a gaze point that the user gazes based on the position of the pupil and the position of the LED point in the eyeball image acquired by the image acquisition unit 203. In other words, the cursor speed control unit 205 analyzes the eyeball image acquired by the image acquisition unit 203 and checks the pupil's position based on the LED point to determine the gaze point that the user's eyeball is staring at. .

In addition, the cursor speed controller 205 can detect the movement of the determined gaze point. Specifically, the cursor speed control unit 205 may analyze the eyeball image to determine whether the determined gaze point has been moved, and if the gaze point has been moved, may determine a movement distance at which the gaze point has been moved.

Thereafter, the cursor speed control unit 205 determines the flat filter coefficient according to the comparison result of the determined travel distance of the gaze point and the predetermined first threshold distance and the second threshold distance, and based on the determined filter coefficient You can determine the location. For example, when the movement distance of the gaze point is greater than the first threshold distance, the cursor speed control unit 205 may determine the position of the mouse cursor based on the minimum flat filter coefficient. For another example, when the movement distance of the gaze point is smaller than the second threshold distance, the cursor speed control unit 205 may determine the position of the mouse cursor based on the maximum flat filter coefficient. For another example, when the movement distance of the gaze point is smaller than the first threshold distance and larger than the second threshold distance, the cursor speed control unit 205 uses the mouse cursor based on the flat filter coefficient calculated using a preset function. You can determine the location. When the movement distance of the gaze point is smaller than the first threshold distance and larger than the second threshold distance, the cursor speed controller 205 may calculate the flat filter coefficient f as shown in the following equation.

At this time, α means the maximum flatness coefficient, β means the minimum flatness coefficient, T means the first critical distance, and t means the second critical distance. In addition, the cursor speed control unit 205 uses the current gaze point (g[n]) and the mouse cursor position (p[n-1]) of the previous frame to determine the movement distance (d) of the gaze point as in the following equation. Can be calculated.

As a result, the cursor speed control unit 205 uses the determined flat filter coefficient f, the mouse cursor position (p[n-1]) of the previous frame, and the current gaze point (g[n]) as shown in the following equation. The current mouse cursor position (p[n]) can be calculated.

Here, the relationship between the moving distance of the gaze point and the flat filter coefficient may be visualized in the form of a graph as shown in FIG. 3. The form of the graph shown in FIG. 3 is one embodiment, and the form of the graph between t and T can be expressed in any graph form as long as the start point and the end point are the same. Expression, tanh, etc.)

Accordingly, when the gaze point moves relatively quickly, since the distance difference between the previous gaze point and the subsequent gaze point is large, the cursor speed control unit 205 determines the flat filter coefficient as the minimum flat filter coefficient and moves the mouse cursor. Speed can be controlled quickly.

On the other hand, when the gaze point moves relatively slowly, since the distance difference between the previous gaze point and the subsequent gaze point is small, the cursor speed control unit 205 determines the flat filter coefficient as the maximum flat filter coefficient and moves the mouse cursor. Can be controlled slowly.

In addition, the cursor speed control unit 205 may control the mouse cursor speed in a preset area. For example, the cursor speed control unit 205 may set the threshold distance from the preset content, and when the gaze point moves within the threshold distance, the movement of the mouse cursor may be controlled slowly. At this time, when the mouse cursor moves to a preset area, the cursor speed control unit 205 may determine the flat filter coefficient as the maximum flat filter coefficient, and slowly control the moving speed of the mouse cursor.

4A illustrates a procedure for controlling the movement speed of the mouse cursor according to the movement distance of the gaze point in the electronic device 200 according to an embodiment of the present invention.

Referring to FIG. 4A, the electronic device 200 receives an eyeball image in step 401. Specifically, the electronic device 200 may photograph a user through a camera for eye recognition, and extract an area of the eye using a known technique from the acquired image.

Thereafter, in step 403, the electronic device 200 analyzes the eyeball image to determine a gaze point at which the eyeball stares. At this time, the electronic device 200 may determine a gaze point at which the eyeball stares, based on a previously known technique of controlling a mouse cursor through eyeball recognition. For example, the electronic device 200 may output light through the first LED provided around the camera, and then output the light through the second LED, so that the LED point of the second LED is clearly formed on the eyeball. . At this time, after outputting the light through the first LED, outputting the light through the second LED causes the LED point of the second LED to be clearly formed on the eyeball, so that the position of the point of the second LED in the eyeball image is accurately This is to make judgment possible. Thereafter, the electronic device 200 may receive an eyeball image through the camera, and analyze the position of the pupil and the LED point in the received eyeball image to determine the gaze point.

In step 405, the electronic device 200 may determine the flat filter coefficient according to the movement distance of the gaze point. If the movement distance of the gaze point is greater than a first predetermined threshold distance, the electronic device 200 may determine a predetermined minimum flat filter coefficient as a flat filter coefficient to be used for positioning the mouse cursor. Also, when the movement distance of the gaze point is smaller than the predetermined second threshold distance, the electronic device 200 may determine the predetermined maximum flat filter coefficient as a flat filter coefficient to be used for positioning the mouse cursor. In addition, when the movement distance of the gaze point is smaller than a predetermined first threshold distance and larger than a second threshold distance, the electronic device 200 uses the flat filter coefficient calculated using a preset function as shown in Equation (1). It can be determined by a flat filter coefficient to be used for positioning the mouse cursor.

Thereafter, the electronic device 200 proceeds to step 407 to control the movement speed of the mouse cursor based on the flat filter coefficients. That is, by determining the position of the mouse cursor in the manner as shown in Equation 3 using the determined flat filter coefficient, the moving speed of the mouse cursor can be controlled. For example, when the gaze movement is fast (when the gaze point movement distance is long), the electronic device 200 may control the mouse cursor to move at a high speed using the minimum flat filter coefficient. Also, the electronic device 200 may control the mouse cursor to move at a slow speed by using the maximum flat filter coefficient when the gaze movement is slow (when the gaze point movement distance is short). Accordingly, the electronic device 200 according to an embodiment of the present invention can control the movement of the mouse cursor more precisely by applying different flat coefficient filters according to the movement speed of the gaze.

4B illustrates a means for controlling the movement speed of the mouse cursor according to the movement distance of the gaze point in the electronic device 200 according to an embodiment of the present invention.

Referring to FIG. 4B, the electronic device 200 includes means 411 for receiving an eyeball image. At this time, the electronic device 200 may include a camera for image capture. In addition, the electronic device 200 may include a module for extracting and recognizing the user's eyeball from the captured image.

In addition, the electronic device 200 includes means 413 for analyzing an eyeball image to determine a gaze point at which the eyeball stares. In this case, the electronic device 200 may include a second LED outputting light so that the LED point is formed on the eyeball and a first LED outputting light so that the LED point of the second LED is clearly formed on the eyeball.

In addition, the electronic device 200 includes means 415 for determining a flat filter coefficient according to the movement distance of the gaze point. In addition, the electronic device 200 may include means for storing the flat filter coefficients in advance and means for storing a function for calculating the flat filter coefficients, in order to apply different flat filter coefficients according to the moving distance of the gaze point. have.

In addition, the electronic device 200 may include means 417 for controlling the movement speed of the mouse cursor based on the flat filter coefficients. In this case, when the movement of the gaze point is detected within the preset area, the electronic device 20 may include means for setting the movement speed of the mouse cursor slowly.

5 illustrates a procedure for controlling the mouse cursor according to the movement speed of the gaze point by recognizing the eyeball in the electronic device 200 according to an embodiment of the present invention.

Referring to FIG. 5, the electronic device 200 may output light through the first LED in step 501. More specifically, when the eyeball image is acquired through the camera, the electronic device 200 may output light from the first LED provided around the camera in order to clearly distinguish the location of the pupil and the LED point in the corresponding image. .

Thereafter, the electronic device 200 may output light through the second LED in step 503. At this time, the electronic device 200 may output the light from the second LED to obtain the eyeball image and determine the gaze point that the user gazes.

Thereafter, the electronic device 200 receives an eyeball image through a camera in operation 505. Specifically, the electronic device 200 may photograph a user through a camera and extract an eyeball region from the photographed user's image. At this time, the electronic device 200 may extract the eye region from the person image using a technique known in advance.

Thereafter, the electronic device 200 proceeds to step 507, analyzes the position of the pupil and the LED point in the eyeball image, and determines the gaze point that the user gazes based on the analysis result in step 509. More specifically, the electronic device 200 may determine a gaze point that the user is gazing according to the position of the pupil based on the position of the LED point in the eyeball image.

Thereafter, the electronic device 200 may detect movement of the gaze point in step 511. At this time, the movement distance of the gaze point may be determined based on the distance between the gaze point of the current pupil and the mouse cursor position of the previous frame.

Thereafter, the electronic device 200 may determine the flat filter coefficient by comparing the movement distance d of the gaze point with the first threshold distance T and the second threshold distance t in operation 513. At this time, the first threshold distance T and the second threshold distance t may be preset and stored in the design stage, and may be changed according to user control.

First, when the movement distance d of the gaze point is greater than the first threshold distance T, the electronic device 200 may determine the flat filter coefficient as a predetermined minimum flat filter coefficient in step 515.

When the movement distance d of the gaze point is smaller than the first threshold distance and larger than the second threshold distance, the electronic device 200 proceeds to step 517 to determine a flat filter coefficient based on a preset function. In this case, the electronic device 200 may determine the flat filter coefficient using Equation 1 above.

When the movement distance d of the gaze point is smaller than the second threshold distance, the electronic device 2000 may determine the flat filter coefficient as a predetermined maximum flat filter coefficient in step 519.

When the flat filter coefficient is determined based on the comparison result of the movement distance of the gaze point and a preset threshold distance, the electronic device 200 may proceed to step 521 to determine the position of the mouse cursor based on the determined filter coefficient. At this time, the electronic device 200 may determine the position of the mouse cursor using Equation 3 described above.

Thereafter, the electronic device 200 proceeds to step 523 to move the mouse cursor to the determined position and display it. The electronic device 200 can quickly control the movement of the mouse cursor when the gaze moves rapidly, and apply the different flat filter coefficients according to the movement distance of the gaze point, and the mouse cursor when the gaze moves slowly. You can control the movement slowly. For example, when the gaze moves rapidly, the electronic device 200 may quickly control the movement of the mouse cursor by setting the flat filter coefficient to a small value. For another example, when the gaze moves slowly, the electronic device 200 may control the movement of the mouse cursor slowly by setting the flat filter coefficient to a large value.

Thereafter, the electronic device 200 may end the procedure according to an embodiment of the present invention.

6 and 7 described below are examples of the method for controlling the mouse cursor described above, and when the mouse cursor is moved according to the movement distance of the gaze point, a method for more precisely controlling the movement of the mouse cursor around the content to be.

6 illustrates a procedure for controlling the speed of the mouse cursor when the gaze point is moved in the electronic device according to an embodiment of the present invention.

Referring to FIG. 6, when the gaze point movement distance is long, the electronic device may quickly move the position of the mouse cursor from the location A 601 to the location B 603 by setting the flat filter coefficient to a small value.

Meanwhile, as illustrated in FIG. 7, when a movement of the user's gaze point is detected within a threshold distance of a specific content, the electronic device sets the flat filter coefficient to a large value to precisely control the mouse cursor. The position of the mouse cursor can be moved slowly from position A (701) to position B (703). More specifically, when the user controls the electronic device 200 using a mouse cursor, the electronic device 200 sets a threshold distance of frequently used content, and when the gaze point movement is detected within the corresponding threshold distance , By setting the flat filter coefficient to a large value, it can be controlled to move the mouse cursor slowly within a critical distance of the content. At this time, the electronic device may set different threshold distances according to the UI size of the content, and the threshold distances for each content may be set in the design stage of the electronic device, and may be set by user control when installing the content. It can be changed under control.

Embodiments of the invention and all functional operations described herein may be implemented in computer software, firmware, or hardware, including a structure disclosed herein and equivalent structures thereof, or in a combination of one or more thereof. . In addition, embodiments of the invention described herein are one or more computer program products, ie, one or more modules of computer program instructions that are executed by a data processing device or encoded on a computer readable medium for controlling the operation of the device. Can be practiced.

The computer-readable medium can be a machine-readable storage medium, a machine-readable storage substrate, a memory device, a composition of materials affecting a machine-readable propagation stream, or a combination of one or more of these. The term data processing device includes, for example, a programmable processor, computer, or any device, device, and machine for processing data, including multiple processors or computers. The device may include, in addition to hardware, code that generates an execution environment for a corresponding computer program, such as processor firmware, a protocol stack, a database management system, an operating system, or code constituting one or more combinations thereof.

On the other hand, in the detailed description of the present invention, specific embodiments have been described, but various modifications are possible without departing from the scope of the present invention. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined not only by the scope of the claims to be described later, but also by the scope and equivalents of the claims.

Claims (18)

A method of an electronic device for controlling a cursor of an eye mouse, comprising:
Receiving an eyeball image including at least one point output from a light emitting diode (LED) provided in the electronic device;
Analyzing the eyeball image to obtain a gaze point at which the eyeball stares,
Obtaining a moving distance of the gaze point based on the gaze point and the position of the mouse cursor of the previous frame,
Obtaining a smoothing filter coefficient based on a moving distance of the gaze point and a predefined threshold distance;
And controlling a moving speed of the mouse cursor based on the flat filter coefficients.
The method according to claim 1,
The process of receiving the eyeball image,
Outputting light using the first LED provided in the electronic device;
Outputting light using a second LED provided in the electronic device;
A process of photographing an eyeball image including a point by at least one LED using a camera provided in the electronic device;
And extracting an eye region from the photographed image.
The method according to claim 1,
The process of analyzing the image of the eyeball and obtaining a gaze point at which the eyeball stares,
The process of identifying the pupil and the LED point in the image,
And acquiring a gaze point at which the eyeball gazes according to the position of the pupil based on the position of the LED point.
The method according to claim 1,
The process of obtaining a smoothing filter coefficient according to the moving distance of the gaze point,
Comparing the moving distance of the gaze point with a first critical distance and a second critical distance,
And when the moving distance of the gaze point is greater than a first threshold distance, obtaining a preset minimum flat filter coefficient as the flat filter coefficient.
The method according to claim 4,
Calculating a flat filter coefficient using the following equation when the moving distance of the gaze point is smaller than the first critical distance and larger than the second critical distance,
And obtaining the calculated flat filter coefficients as the flat filter coefficients.

Where f is the flat filter coefficient, α is the maximum flat filter coefficient,

Is the minimum flat filter coefficient, T is the first critical distance, and t is the second critical distance.
The method according to claim 5,
And if the moving distance of the gaze point is smaller than a second threshold distance, obtaining a preset maximum flat filter coefficient as the flat filter coefficient.
The method according to claim 1,
The process of controlling the movement speed of the mouse cursor based on the flat filter coefficients,
The process of calculating the position of the mouse cursor based on the flat filter coefficients as in the following equation,
And moving the mouse cursor to the calculated position.

Here, p[n] is the mouse cursor position of the current frame, f is the obtained flat filter coefficient, p[n-1] is the mouse cursor position of the previous frame and g[n] is the current gaze point.
The method according to claim 1,
The process of obtaining a smoothing filter coefficient according to the moving distance of the gaze point,
Confirming whether the gaze point moves within a predetermined threshold distance of a specific content,
And when the gaze point moves within a predetermined threshold distance of specific content, obtaining the flat filter coefficient as a preset maximum flat filter coefficient.
In the electronic device for controlling the cursor of the eye mouse,
An image acquiring unit receiving an eyeball image including at least one point output from a light emitting diode (LED) provided in the electronic device;
The eyeball image is analyzed to obtain a gaze point at which the eyeball gazes, a movement distance of the gaze point is obtained based on the gaze point and the mouse cursor position of the previous frame, and the movement distance and critical distance of the gaze point After obtaining a smoothing filter coefficient based on, a device including a cursor speed control unit that controls a moving speed of a mouse cursor based on the smoothing filter coefficient.
The method according to claim 9,
Further comprising an LED output control unit for controlling to output light using the first LED provided in the electronic device, and controlling to output the light using the second LED provided in the electronic device,
The image acquisition unit controls to capture an eyeball image including a point by at least one LED using a camera provided in the electronic device.
The cursor speed controller is a device that extracts the eyeball area from the captured image.
The method according to claim 9,
The cursor speed control unit checks the pupil and the LED point in the image, and obtains a gaze point at which the eyeball stares according to the pupil position based on the position of the LED point.
The method according to claim 9,
The cursor speed control unit compares a movement distance of the gaze point with a first threshold distance and a second threshold distance, and when the movement distance of the gaze point is greater than the first threshold distance, the preset minimum flat filter coefficient is the flat filter A device obtained by counting.
The method according to claim 12,
When the movement distance of the gaze point is smaller than the first threshold distance and larger than the second threshold distance, the cursor speed control unit calculates a flat filter coefficient by using the following equation, and calculates the flat filter filter coefficient using the flat filter. A device obtained by counting.

Where f is the flat filter coefficient, α is the maximum flat filter coefficient,

Is the minimum flat filter coefficient, T is the first critical distance, and t is the second critical distance.
The method according to claim 12,
The cursor speed control unit acquires a preset maximum flat filter coefficient as the flat filter coefficient when the movement distance of the gaze point is smaller than a second threshold distance.
The method according to claim 9,
The cursor speed control unit calculates the position of the mouse cursor based on the flat filter coefficients as in the following equation, and moves the mouse cursor to the calculated position.

Here, p[n] is the mouse cursor position of the current frame, f is the obtained flat filter coefficient, p[n-1] is the mouse cursor position of the previous frame and g[n] is the current gaze point.
The method according to claim 9,
The cursor speed control unit determines whether the gaze point moves within a predetermined threshold distance of a specific content, and when the gaze point moves within a predetermined threshold distance of a specific content, acquires the flat filter coefficient as a preset maximum flat filter coefficient Device.
delete delete

Images