KR100664832B1 - Apparatus for pointing at two dimensional monitor by tracing of eye's movement - Google Patents

Abstract

The present invention relates to a two-dimensional monitor pointing device through eye movement tracking to improve accuracy and motion sensitivity by accurately tracking the position of a pointer on a monitor in real time by tracking the eye movement of a user. By pointing in real time to the place where the pupil points on the two-dimensional monitor through, it is possible to provide a system for the handicapped people with the eye and mouth to interface with information terminals such as computers.

Description

Apparatus for pointing at two dimensional monitor by tracing of eye's movement}

1 is a schematic overall configuration diagram of a two-dimensional monitor pointing device according to an embodiment of the present invention;

2 is a detailed configuration diagram of a two-dimensional monitor pointing device according to an embodiment of the present invention;

3A and 3B illustrate a pupil motion tracking initialization operation according to an embodiment of the present invention;

4 is a view illustrating a two-dimensional pointing operation of pupil movement according to an embodiment of the present invention;

5 is a view for explaining a three-dimensional position correction operation of pupil movement according to an embodiment of the present invention,

6 and 7 are structural examples of special glasses employed in the embodiment of the present invention.

<Description of Symbols for Major Parts of Drawings>

10: special glasses

10a, 10b: left eye / right eye coordinate tracking unit (CCD camera)

10c: time synchronization unit

10d: encoding part

20: monitor

20a, 20b, 20c, 20d: CCD camera

30: computer body

32: eye movement tracking initialization unit

34: decoding unit

36: two-dimensional position correction unit

38: three-dimensional position tracking unit

40: three-dimensional position correction unit

42: 2D monitor position conversion unit

44: light emitting element 100a, 100b: glasses glass

110: position detecting element 120: encoding means

The present invention relates to a two-dimensional monitor pointing device through eye movement tracking, and more specifically, to track a pupil's movement using a special glasses and a position correction device equipped with a CCD (Charge Coupled Device) camera and report the user's movement. The present invention relates to an apparatus for pointing a location on a two-dimensional monitor.

The mouse is an important peripheral and an essential interface device for various operations using the computer such as the Internet, programming, CAD, CAM, and OA.

However, when using the mouse, which is an important interface device, one of the two hands using the keyboard must be used, and the motion of the human hand is much slower than the eye looking at the monitor. By displaying the signal generated according to the degree of movement on the two-dimensional monitor, there is a big disadvantage that it is very inconvenient in accuracy and operation sensitivity. In particular, the eye can be used normally, but if you become a systemic disorder due to general paralysis, you cannot use the mouse because you cannot operate the mouse.

Accordingly, the present invention has been made to solve the above-mentioned conventional problems, and tracks the movement of the user's eyes to accurately point the position of the pointer on the monitor in real time to improve the accuracy and the motion sensitivity. The purpose is to provide a two-dimensional monitor pointing device through.

A two-dimensional monitor pointing device using eye movement tracking according to a preferred embodiment of the present invention tracks the movement of glasses to track the movement of a user's pupil, and receives movement information of the pupil from the glasses to receive the pupil movement information. And two-dimensional correction of the position values of both eyes by using the motion information of the glasses, and then correcting according to the three-dimensional position movement of the pupil to point to the position currently indicated by the pupil.
In addition, the two-dimensional monitor pointing device through eye movement tracking in accordance with a preferred embodiment of the present invention, the transparent image pickup material is attached to the surface of the glass to track the movement of the user's eyes and transmits the signal, and the transmitted signal And a special eyeglass having a position detecting element for detecting current position information of the current pupil and encoding means for encoding the detected eye position information.

delete

delete

The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a schematic overall configuration diagram of a two-dimensional monitor pointing device according to an embodiment of the present invention, in which two CCD cameras 10a and 10b (only one CCD camera is shown in the drawing) are left and right eyeglass frame portions, respectively. The special glasses 10 attached to the monitor and four position correction CCD cameras 20a, 20b, 20c, and 20d are constituted by the monitor 20 mounted on the corner side.

Two CCD cameras 10a and 10b attached to the special glasses 10 respectively track the movement of the pupils.

CCD cameras 20a, 20b, 20c, and 20d attached to the monitor 20 track the direction and movement of the special glasses 10. Reference numeral 30 denotes a computer main body connected to the monitor 20 and receiving information from the special glasses 10 wired or wirelessly. The computer body 30 has a two-dimensional monitor pointing program through eye movement tracking.

2 is a detailed block diagram of a two-dimensional monitor pointing device according to an embodiment of the present invention.

The special glasses 10 includes a left eye coordinate tracking unit 10a which is a CCD camera that tracks coordinates according to the movement of the user's left eye, and a right eye coordinates that is a CCD camera that tracks coordinates according to the movement of the user's right eye. A time synchronization unit 10c for adjusting the time synchronization of the tracking unit 10b, the left eye coordinate tracking unit 10a, and the right eye coordinate tracking unit 10b at regular intervals, and the left eye coordinate tracking unit 10a and the right side An encoding unit 10d for encoding the coordinate information in the eye coordinate tracking unit 10b and transmitting it to the main body 30 of the computer is provided.

The computer main body 30 includes a pupil motion tracking initialization unit 32 for initializing tracking operations for left and right eye movements, a decoding unit 34 for receiving and decoding coordinate information transmitted from the encoding unit 10d; The two-dimensional position correction unit 36 corrects the position values of both eyes based on the coordinate information decoded by the decoding unit 34 so that an accurate two-dimensional mapping of the eyes pointed by the user is performed. Although the eye is turned, the eye is looking at the monitor 20, that is, the three-dimensional position tracking unit 38 capable of three-dimensional position tracking, the two-dimensional position correction unit 36, and the three-dimensional position tracking unit 38. Monitor the result of the correction in the three-dimensional position correction unit 40 and the three-dimensional position correction unit 40 for correcting according to the three-dimensional position movement of the user's pupils 20) Eyes of the user on the prize And it is provided with a two-dimensional monitor where converter 42 for converting a specified position.

In order for the pointer of the monitor 20 to move as the user's eyes move, the computer main body 30 must recognize where the eye is looking at the monitor 20.

Accordingly, the eye movement tracking initialization unit 32 moves the constant pointer from the center of the monitor 20 to each end as shown in FIGS. 3A and 3B, or at the end of the monitor 20 in a constant direction. When moving the pointer toward the center, instruct the user to look directly at the pointer, the computer body 30 by tracking the pupil movement of the user with the CCD camera (10a, 10b) attached to the special glasses 10 Perform the initialization operation.

A method of two-dimensional mapping the movement of the pupil to a point on the monitor 20 will be described with reference to the drawings of FIG. 4.

With the color of the human skin, the white of the eye, the color of the pupil, and the color of the pupil, the computer can position the center of the eyeball in the center of the computer monitor 20, and the initialization operation in the eye movement tracking initialization unit 32 described above. You can map a part of the monitor that your eyes are currently looking at in two dimensions.

The three-dimensional position tracking unit 38 is a position that can be easily calculated by the computer main body 30 as shown in FIG. 5, that is, a plurality of points installed at each end of the special glasses 10 and the center point of the curve drawn by the glasses. The light emitting element 44 is comprised.

FIG. 6 is a view showing an example of special glasses with a CCD camera. As described with reference to FIG. 1, the glasses are supported by the support members 11a and 11b at the left and right eyeglass frames of the glasses to maintain a certain distance from the glasses glass. To the encoding means 10d which encodes the CCD cameras 10a and 10b facing the side and the imaging information (ie, coordinate information according to the pupil movement) from the CCD cameras 10a and 10b and transmits them to the computer main body 30 side. It is composed. Lines connecting the CCD cameras 10a and 10b and the encoding means 10d are embedded in the support members 11a and 11b.

7 is a view showing another configuration example of special glasses according to the present invention, by applying or attaching a transparent imaging material on the surface of the glasses glass (100a, 100b) to track the movement of the pupil to transmit a signal, The position detecting element 110 detects the current pupil position based on the transmitted signal, and the detected pupil position information is encoded by the encoding means 120 and transmitted to the computer main body 30 side.

Referring to the operation of the two-dimensional monitor pointing device by eye movement tracking according to an embodiment of the present invention configured as described above are as follows.

Each of the CCD cameras 10a and 10b of the special glasses 10 is first synchronized with the time synchronization unit 10c at regular intervals.

Thereafter, the movement of the pupil is continuously tracked by the CCD cameras 10a and 10b, and the position value is modulated by the encoding unit 10d, and then the computer main body 30 is used using a wired or wireless transmission method. To send.

The decoding unit 34 of the computer body 30 receiving the signal decodes the modulated signal and provides it to the two-dimensional position correction unit 36, and the two-dimensional position correction unit 36 provides both eyes. Correct the position value of so that accurate two-dimensional mapping of the eye points is achieved.

Then, even when the user turns his head, the eye performs three-dimensional correction in the three-dimensional position correction unit 40 so that the eye can accurately track the movement of the eye even when looking at the monitor.

In the three-dimensional position correction unit 40, when the user turns or moves his / her head, the CCD having data of not only the light emitting sensitivity of the plurality of light emitting devices 40 shown in FIG. 5 but also the moving angle is attached to the monitor 20. Since it is transmitted to the cameras 20a, 20b, 20c, and 20d and the computer main body 30, the computer main body 30 analyzes the data to obtain α, β, and γ values shown in FIG. Therefore, it is possible to determine how and how much the user currently moves his head. Through this method, three-dimensional correction is performed.

When the result value corrected by the three-dimensional position correction unit 40 is sent to the two-dimensional monitor position converter 42, the two-dimensional monitor position converter 42 determines the final correction result. Is converted to a position designated by the pupil of the user on the monitor 20.

According to the present invention as described above, by tracking the movement of the eye in real time pointing to the place where the eye points on the two-dimensional monitor, it is possible to interface with information terminals, such as a computer only to the whole body disabled people with eyes and mouth It can be used for microscopic tumor removal surgery using endoscopy and computer control technology, and can also be mounted on aircraft control systems and real-time tracking and sniper combat equipment such as fighters, tanks, cannons, and missiles.

In addition, preferred embodiments of the present invention are disclosed for the purpose of illustration, those skilled in the art will be able to various modifications, changes, additions, etc. within the spirit and scope of the present invention, such modifications and modifications belong to the following claims You will have to look.

Claims (6)

It tracks the movement of the glasses to track the movement of the user's eyes, receives the movement information of the eye from the glasses, and two-dimensional position values of both eyes using the eye movement information and the movement information of the glasses And a monitor pointing unit for correcting according to the three-dimensional position movement of the pupil after the correction, and pointing to the position currently indicated by the pupil. The method of claim 1, wherein the glasses, A left eye coordinate tracking unit for tracking coordinates according to the movement of the left eye of the user; A right eye coordinate tracking unit for tracking coordinates according to the movement of the right eye of the user; A time synchronization unit for synchronizing the time synchronization of the left eye coordinate tracking unit with the right eye coordinate tracking unit at a predetermined period; And And an encoding unit for encoding the coordinate information in the left eye coordinate tracking unit and the right eye coordinate tracking unit. 2D monitor pointing device using eye movement tracking. The method of claim 1, wherein the glasses, A transparent imaging material attached to a surface of the spectacle glass and transmitting a signal by tracking eye movements; A position detecting element detecting position information of a current pupil based on the transmitted signal; And 2D monitor pointing device using eye movement tracking, characterized in that the encoding means for encoding the detected pupil position information. The method of claim 1, wherein the monitor pointing unit, A pupil motion tracking initialization unit for initializing a tracking operation for both pupil motions of the user; A decoder which receives and decodes coordinate information transmitted from the glasses; A two-dimensional position corrector for correcting position values of both eyes based on the coordinate information decoded by the decoder; A three-dimensional position tracking unit for performing three-dimensional position tracking for both eyes; A three-dimensional position correcting unit which receives position information from the two-dimensional position correcting unit and the three-dimensional position tracking unit and corrects according to a three-dimensional positional movement of the pupil of the user; And A two-dimensional monitor pointing device using eye movement tracking, characterized in that it comprises a two-dimensional monitor position conversion unit for converting the result value corrected by the three-dimensional position correction unit to a position designated by the user's pupils on the monitor. . The method of claim 4, wherein the three-dimensional position tracking unit, 2D monitor pointing device using eye movement tracking, characterized in that it comprises a plurality of light emitting elements installed at each end of the glasses and the center point of the curve drawn by the glasses. A transparent imaging material attached to a surface of the glass to track a movement of a user's eyes and transmit a signal; A position detecting element detecting position information of a current pupil based on the transmitted signal; And And a special eyeglass having encoding means for encoding the detected pupil position information.

Images