JP2001154794A - Pointing device with click function by blink - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a pointing device to realize click operation without using an auxiliary device. SOLUTION: Eye movement is picked up, a stared position on a display is detected and an input function is realized by blink of an eye. The input function consists essentially of a click function, a display is spectacle display 2 in the shape of spectacles to display a computer screen, provided with an eye camera 3 to detect which part of the spectacle display 2 is started by picking up the eye movement, a spectacle-shaped frame 1 to support the spectacle display 2, a left eye blink sensor 4 and a right eye blink sensor 5 to detect blinks of a left eye and a right eye among the blinks and a function to judge the blink as one-eye blink when period in which only one of the left and right eyes is closed exceeds fixed time and to cancel pointing operation when both eyes are judged to be closed.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to a pointing device having a click function, and more particularly to a pointing device having a click function by blinking.

[0002]

2. Description of the Related Art In recent years, a wearable computer has been actively developed as an ultimate form of a mobile computer. As an input device in the wearable computer, a pointing device using human eyes or voice may be used. As a conventional eye-catching pointing device, Japanese Patent Application Laid-Open No. 10-16180
There is an input / output device described in Japanese Patent Publication No.
The click operation is realized not by blinking but by causing the computer to recognize the operator's voice. Further, as another conventional example, in a click signal generation method for computer control described in Japanese Patent Application Laid-Open No. 10-3150, a method in which a sound generated by a tooth meeting is detected by an acoustic sensor is disclosed.

[0003]

However, in the above-mentioned conventional examples, the click operation is performed using an auxiliary device, which goes against the present situation in which the device is downsized. There was a problem of incompatibility.

Accordingly, an object of the present invention is to provide a pointing device capable of realizing a click operation by blinking without using an auxiliary device in order to solve the above problem.

[0005]

SUMMARY OF THE INVENTION In order to achieve the above object, a pointing device having a click function by blinking according to the present invention captures the movement of an operator's eye and detects a gaze position on a display. When a target to be clicked is positioned from the viewpoint of the eye, a click operation is performed by blinking one eye of the eye.

It is preferable that the display is a spectacle display for transmitting a display portion of a computer through a lens portion of spectacles for display.

[0007] Further, it is preferable to provide a spectacle type frame for supporting the spectacle display.

[0008] Still further, it is preferable to provide an eye camera for capturing eye movements and detecting where the eyeglass display is staring.

It is preferable that the apparatus further includes a left-eye blink sensor and a right-eye blink sensor for detecting blinking of the left and right eyes of the eye.

[0010] Furthermore, it is preferable that the left-eye blink sensor and the right-eye blink sensor determine that a single-eye blink is detected when a period in which only one of the left eye and the right eye is closed exceeds a predetermined time.

Further, it is preferable that a function of canceling a pointing operation when it is determined that both the left eye and the right eye are closed by a left eye blink sensor and a right eye blink sensor is provided.

[0012] It is preferable that the apparatus further includes a spectacle display, an eye camera, a left-eye blink sensor, a right-eye blink sensor, and a controller which is controlled via a cable.

Further, it is preferable that the controller is connected to a mouse, a keyboard, and a video interface for the computer to be controlled.

[0014] Furthermore, it is preferable that the controller is provided with a signal correction unit connected to the left-eye blink sensor and the right-eye blink sensor, and for outputting signals of a mouse, a keyboard, and a video interface from the blinking operation.

Preferably, the controller is connected to an eye camera, and includes a viewpoint coordinate conversion unit for detecting where the operator is staring at the eyeglass display and outputting the xy coordinates thereof.

Further, the controller samples the xy coordinates output from the viewpoint coordinate conversion unit at regular time intervals, and calculates the difference when the eye pointer indicating the place where the eye is staring moves, and calculates the difference. It is preferable to include a viewpoint coordinate movement difference conversion unit that outputs a signal corresponding to the above to a mouse interface.

Still further, the controller creates an image of an eye pointer on the xy coordinates from the xy coordinates from the viewpoint coordinate conversion unit, combines the image with a signal of a video interface, and outputs a video signal eye pointer unit for outputting to a glasses display. Preferably, it is provided.

Further, the controller determines whether or not an eye pointer is present in a portion displayed on the eyeglass display based on the xy coordinates from the viewpoint coordinate conversion unit, and the eye pointer gazes at a character in the key area. In addition, it is preferable to include a keyboard emulation unit that outputs a character code to a keyboard interface when a click operation is performed by blinking the left eye.

As described above, in the pointing device using the click function by blinking according to the present invention, computer operation can be performed as if wearing glasses, and necessary information can be stored on the network by adding a wireless network. Another computer database will be available for every scene.

[0020]

Next, an embodiment of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a schematic diagram showing an entire configuration of an embodiment of a pointing device having a click function by blinking according to the present invention. The pointing device 10 having a click function by blinking according to the present invention includes a transmissive type spectacle display 2 for displaying a computer screen on a spectacle type frame 1 serving as a base of the device, and a spectacle display 2 for capturing eye movements. An eye camera 3 for detecting whether the user is staring at the camera, a left-eye blink sensor 4 and a right-eye blink sensor 5 for detecting that the eyes are blinking
Are implemented. Eyeglass display 2, Eye camera 3,
The signals of the left-eye blink sensor 4 and the right-eye blink sensor 5 are connected to a controller 6 through a cable 8 arranged in the eyeglass-type frame 1. The controller 6
These signals are converted into mouse, video signal, and keyboard interfaces, and connected to the computer 7 to be operated.

Next, the operation of the blink sensor according to the embodiment of the present invention will be described with reference to FIGS. FIG. 2 is a schematic diagram showing details of the operation of the blink sensor in the embodiment of the pointing device having a click function by blinking according to the present invention. FIG. 3 is a graph showing a change in output due to opening and closing of the blink in the embodiment of the pointing device having a click function by blink according to the present invention.

As shown in FIG. 2, the left eye blink sensor 4
Alternatively, the right-eye blink sensor 5 detects opening and closing of the eyelid by irradiating the eyeball with light such as infrared light and measuring the amount of reflected light. Each of the left-eye blink sensor 4 and the right-eye blink sensor 5 includes an infrared lamp 90 for irradiating infrared light and sensor output units LI and RI. The operation of the left-eye blink sensor 4 and the right-eye blink sensor 5 will be described first.
Infrared light emitted from 0 to the eyeball is reflected on the surface of the eyeball as shown by the dotted line in the figure, and the reflected light
to go into. In addition, the output LI of the left-eye blink sensor or the output R of the right-eye blink sensor is output from the infrared receiving unit 91.
An I signal is output.

Thereafter, as shown in the graph of FIG. 3, the amount of reflected infrared light changes due to the opening / closing operation of the eyelid during blinking, and the output of the blink sensor changes. That is, the adjustment is performed so that the output of the blink sensor is maximized when the eyelid is closed, and the output of the blink sensor is minimized when the eyelid is opened. Therefore, in the present embodiment, as shown in FIG. 3, the output of the blink sensor changes with the opening and closing of the blink, and the output of the blink sensor increases when the blink is closed, as shown in the center part of the figure. Adjust the blink sensor as described.

FIG. 4 is a block diagram showing an entire configuration of an embodiment of a pointing device having a click function by blinking according to the present invention. A left-eye blink sensor 4 and a right-eye blink sensor 5 for detecting a left-eye and a right-eye blink, an eye camera 3 for detecting a viewpoint of an eyeball, and glasses for displaying computer images, centering on a controller 6 which is a main part of the present invention. The display 2 is connected to each of them. The controller 6 is connected to a computer 7 (shown in FIG. 1) to be controlled by a mouse interface, a keyboard interface, and a video interface.

Next, the controller 6 according to the embodiment of the present invention will be described with reference to FIG. The controller 6 includes a blink signal correction unit 32 and a viewpoint coordinate conversion unit 2
0, a video signal eye pointer synthesizing unit 21, a viewpoint coordinate movement difference converting unit 22, and a keyboard emulator unit 23. The blink signal correction unit 32 includes the left eye blink sensor 4
And a right-eye blink sensor 5, and outputs a left-click signal L and a right-click signal R of the mouse interface from the blink operation. Viewpoint coordinate converter 20
Is connected to the eye camera 3, detects where the operator is staring in the eyeglass display 2, and outputs xy coordinate data. The viewpoint coordinate movement difference conversion unit 22 samples the xy coordinate data output from the viewpoint coordinate conversion unit 20 at fixed time intervals, and calculates the difference when the coordinates of the gaze point (eye pointer) move, Mouse interface signals X and Y of x-axis and y-axis corresponding to movement
Is output. The video signal eye pointer synthesizing unit 21 creates an image of the eye pointer on the coordinates from the xy coordinate data from the viewpoint coordinate conversion unit 20, synthesizes it with the video interface signal from the computer 7, and outputs it to the eyeglass display 2.

The keyboard emulator unit 23
On the basis of the xy coordinate data from the viewpoint coordinate conversion unit 20, a keyboard display unit 54 (shown in FIG. 6 described below) having a spectacle display configuration displayed on the spectacle display 2.
It is determined whether or not the eye pointer 50 (shown in FIGS. 7 and 8 to be described later) is present in the key area 55 of the character inside, and at that time, by blinking left, the character code of the character stared in the key area is displayed on the keyboard interface. It has the function of outputting to The keyboard emulator unit 23 also receives an ESC signal from the blink signal correction unit 32 and outputs a character code ESC. The ESC signal is a signal that is output when the blinking signal correction unit 32 detects the cancellation of the pointer operation, and causes the keyboard emulator unit 23 to output the character code of the ESC key from the keyboard emulator unit 23 to the computer 7 to be operated. Is to press the ESC key.

FIG. 5 is a block diagram showing a configuration of the blink signal correction unit 32 according to the embodiment of the present invention. The output signals LI and RI of the left-eye blink sensor 4 and the right-eye blink sensor 5 are output from the waveform shaping circuit 8.
0 and 81. Output L of waveform shaping circuit 80
L is connected to a one-shot 82 and a waveform shaping circuit 81
Is connected to a one-shot 83. Also,
The output LL and the output RL are connected to the AND circuit 84. Output LS of one shot 82, one shot 8
3 and the output of the AND circuit 84
After the output of the OR circuit 85 passes through the delay circuit 86, it is connected as gate signals of the gate circuits 87 and 88, and controls the signal of the output LH of the waveform shaping circuit 80 and the output RH of the waveform shaping circuit 81. ing. AND circuit 8
9 is the output L of the gate circuit 87 and one shot 8
3 as an input, and its output is an ESC signal.

FIG. 6 is a schematic diagram showing a configuration of an image displayed on the eyeglass display 2 according to the embodiment of the present invention. The screen of the computer 7 (shown in FIG. 1) to be operated is displayed on the PC screen 56. The key input operation is performed by moving the eye pointer 50 (shown in FIGS. 7 and 8) into the character key area 55 in which characters in the keyboard display unit 54 are arranged, and performing a click operation by blinking left. Execute. Further, a pointer calibration area (1) 60 is provided at a plurality of locations on the PC screen 56, and the coordinates of the gaze, the coordinates recognized by the viewpoint coordinate conversion unit 20, and the mouse output from the operating computer 7 are provided. It has a function of calibrating the displacement of the coordinates of the pointer (PC pointer 51 (shown in FIGS. 7 and 8)). The calibration of the eye pointer on the keyboard display is performed in the pointer calibration area (2).
Perform at 61. Here, since it is not the displayable area of the PC pointer 51, the calibration of the PC pointer 51 is performed only on the X axis.

FIGS. 7 and 8 are schematic diagrams showing the operation of the eye pointer according to the embodiment of the present invention. Based on the viewpoint coordinates described above, the video signal eye pointer combining unit 21
The eye pointer 50 shown in FIGS. 7 and 8 is created and displayed on the glasses display 2. Viewpoint coordinate movement difference conversion unit 2
Reference numeral 2 calculates a difference between the coordinates at which the viewpoint coordinates have moved in a predetermined time, and outputs pulse signals corresponding to the movement as mouse interface signals X and Y. This signal is processed by the computer 7, and a PC pointer 51 is output from the computer 7 as a video signal, as shown in FIG. 8, and displayed on the eyeglass display 2 through the video signal eye pointer synthesizing unit 21. That is, the eye pointer 50 is displayed at the gaze point, and the PC pointer 51 output from the computer is displayed at the same position. If the viewpoint is moved, the eye pointer 50 moves, and the PC pointer 51 follows it.

[0031]

Next, an embodiment of the present invention will be described in detail with reference to FIGS.

First, the pointing operation according to the present embodiment will be described. First, the eye camera 3 shown in FIG. 4 detects the coordinates on the spectacle display 2 where the spectacle display 2 is staring. Next, as shown in FIG. 6, if the upper left is the origin (0, 0), the viewpoint coordinates (x, y) are
It is calculated by the viewpoint coordinate conversion unit 20 shown in FIG.

Next, the click operation in this embodiment will be described in detail. First, the blinking of the left and right eyes is detected by the left blink sensor 4 and the right blink sensor 5 shown in FIG. The left-eye blink sensor 4 and the right-eye blink sensor 5 are connected to the blink signal correction unit 32 so that a click operation is not performed by blinks that are performed simultaneously with both eyes unconsciously. In addition, erroneous click operations caused by variations in left and right eyelid opening and closing times are also prevented.

Next, the operation of the blink signal correction section 32 in this embodiment will be described. As shown in FIG. 4, the left eye blink sensor 4 and the right eye blink sensor 5
Is obtained by irradiating an eyeball with infrared rays and detecting the amount of reflected light with a sensor, and analog signals LI (left eye) and RI (right eye) proportional to the degree of eyelid closure to some extent
Is output. This signal is converted to a waveform shaping circuit 80 shown in FIG.
And 81, the signal is converted into two types of digital signals, one that outputs "1" at a high level and one that outputs "1" at a low level. A signal is output at a low level at the timing when the eyelids begin to fall, and a high-level signal is output at a timing immediately before the eyelids fall completely. Here, the low level is LL (left eye) and RL (right eye), and the high level is LH (left eye) and RH (right eye). One shots 82 and 8 starting from rising of LL and RL
3 is provided so that a click signal is not output for a certain period from the start of blinking. This means that malfunctions due to slight variations in the opening and closing timings of the left and right, which occur when blinking with both eyes, are meant. Also, an AND circuit 84 that detects that the left and right sensors are closing the eyelids at the same time prevents the click signal from being output even when both eyes are closed. This means that a click operation is not performed in the blinking of both eyes performed in a normal unconscious manner. Part 3
The two inhibitory signals are logically ORed by an OR circuit 85, and a signal delayed by a delay circuit 86 is used as a DIS signal. This DIS signal is used as a gate signal for determining whether to output the LH and RH signals as L and R of the mouse interface signal. The reason for delaying the gate signal by the delay circuit 86 is to create a timing for generating an ESC signal for canceling the drag during the drag operation by the mouse operation. If the right blink is performed during the left click operation, that is, while the left blink is continuously performed, the ESC signal is generated for the delay period of the delay circuit 86.

Next, the operation of the blinking signal correction unit in the embodiment of the present invention will be described with reference to FIGS. 9 (a) and 9 (b). FIG. 9A shows blinking of the left eye (left click operation), and FIG. 9B shows blinking of both eyes.

First, the operation of the blink signal correction unit 32 for blinking the left eye (left click) will be described with reference to the time chart of FIG. The figure showing the eyes is shown on the upper side of the figure, and the left eye is shown in a closed state, an opened state, and a closed state in order. First, when only the left eye is closed from the state where both eyes are opened, the output LI of the left eye blink sensor 4 gradually increases. Then, when the output of the waveform shaping circuit 80 is at a low level, LL changes from "0" to "1", and then at a high level, LH changes from "0" to "1". When completely closed, both LL and LH become "1". And
When the left eye is gradually opened from the closed state, LH
Changes from “1” to “0”, and then LL changes from “1” to “0”. The output LS of the one-shot 82 starts at the rising edge of LL, and after the timing when LH changes from “0” to “1”,
It is assumed that "1" returns to "0". Since the right eye remains open, there is no change in RI, RL, RH, and RS.
It remains "0". In this case, the output of the AND circuit 84 of LL and RL, which are the input signals of the OR circuit 85, remains "0", the RS remains "0", and only the LS becomes "1", which becomes valid. The output of the OR circuit 85 becomes a DIS signal through the delay circuit 86 to control the gate circuit 87. The gate circuit 87 receives the output LH of the waveform shaping circuit 80 as an input signal, and outputs the signal suppressed by the DIS signal as L. It is only after one of the eyes has been closed for a while that it is possible to judge whether it is blinking with normal eyes or blinking with one eye. The fixed period is one shot 82 or 83
Is activated (while the DIS signal is "1") so as not to output the click signal L. The circuit for suppressing the shift of the left and right blink timings and the output of the click signals L and R at the time of blinking with both eyes includes a left eye,
Since the circuit is targeted by the right eye, the suppression function is effective regardless of which of the left and right eyes is closed first.

Next, the operation of the blink signal correction unit 32 in the case of blinking with both eyes will be described with reference to the time chart of FIG. Despite the blinking of both eyes, there is a case where the left and right signal timings are shifted when the left and right displacement due to the individual difference of the operator and the relative positional relationship between the blinking sensor and the eyelid are shifted. It is described that the click signals R and L are not output even in such a case. The operation time chart for blinking the left eye is shown in FIG.
This is the same as the time chart of FIG. The time chart for blinking the right eye is the same as the time chart for the left eye, except that the blinking timing is slightly behind the left eye. At this time, the one shots 82 and 83 operate at the timing when both eyes start blinking, so that the click signal L or R is not output even if the left or right eye is closed first. Also one shot 82
The output of the AND circuit 84, which is the logical product of LL and RL, becomes "1" at a timing after the period in which the signals LL and RL are suppressed. I am trying to be. That is, the click signals R and L are not output even during the period in which the blinking of both eyes is determined.

Next, with reference to FIG. 10, a cancel operation in this embodiment will be described. FIG. 10 is a time chart showing a cancel operation during dragging. A detailed description will be given of how canceling during dragging with a mouse operation is realized. Dragging refers to performing an operation of moving an object to be operated while holding down a click button continuously. If the user releases the click button during dragging, the object will be dropped at that location. To avoid this, in the present invention, the ESC key is simulated by closing both eyes. If you want to cancel the drop operation, in normal mouse and keyboard operations, the ESC key is pressed from the keyboard to cancel the operation. However, in the present invention, the keyboard cannot be emulated during pointing, so that both eyes are closed and replaced. I have.

Next, an operation of canceling a click operation during a left click will be described with reference to a time chart of FIG. First, a time chart from the start of blinking the left eye to the output of the left click signal L is shown in FIG.
This is as shown in FIG. Next, when the left click signal is determined and the left eyelid is opened after L becomes "1", the left click is completed, but the right eye is closed while the left eye is closed, so that the left eye click is canceled. Signal E
SC is output. Specifically, a logical product of the left click signal L and the output RS of the right-eye one-shot 83 is performed by the AND circuit 89, and the output is output from the blinking signal correction unit 32 as an ESC signal. The ESC signal is input to the keyboard emulator unit 23, and it is assumed that the "ESC key" has been pressed, and the character code "ESC" is output from the keyboard interface in a pseudo manner. At this time, the right eye blink is performed, but the left eye blink is already performed and the both eyes are blinked. Therefore, the result is the same as that described in the time chart of FIG. 9A, and the right click signal R is not output. become.

Next, returning to FIG. 4 and FIG. 6, the keyboard emulator 23 in this embodiment will be described. The key input operation is emulated by selecting and staring at the characters in the key area 55 of the characters arranged in the keyboard display unit 54 displayed on the eyeglass display 2 and performing a click by blinking the left eye. Specifically, the eye pointer 50 is moved by moving the position where the operator is staring into the key area, and blinks the left eye. If the coordinates of the eye pointer are within the coordinate range of the character key area 55, the character code corresponding to the key is output to the keyboard interface. The keyboard emulator also has a function of receiving the ESC signal of the blinking signal correction unit 32 and outputting a character code ESC in order to cancel the pointing operation when both eyes are closed.

Next, with reference to FIGS. 7 and 8, the operation of calibrating the eye pointer in this embodiment will be described. In theory, the eye pointer 50 and the PC pointer 51 should be at the same position. However, if the position recognition accuracy of the eye camera 3, the viewpoint coordinate conversion unit 20, or the viewpoint coordinate movement difference conversion unit 22 is poor, a slight shift may occur. May occur. To solve this problem, the viewpoint coordinate movement difference conversion unit 22 has a pointer calibration function described below. In order to execute pointer calibration, the pointer calibration area (1) 60 is displayed on the PC screen 5
6 at the upper right, upper left, lower right, lower left. This pointer calibration function is performed by the viewpoint coordinate movement difference conversion unit 22 in FIG. The calibration operation is performed as follows. First, the place where the right eye is staring is moved to an arbitrary 60 which is the pointer calibration area (1). Then, the eye pointer 50 also enters the pointer calibration area (1) 60. When the viewpoint coordinate conversion unit 20 recognizes that the eye pointer 50 is located at the coordinates in the pointer calibration area (1) 60,
The eye pointer is forcibly moved to the coordinates of the calibration point 53 and locked for a certain period. During this lock period, the mouse pointer signals X and Y of the computer are output so that the PC pointer 51 is also moved to the coordinates of the calibration point 53. Further, it is necessary for the operator to fix his eyes on the calibration point 53 during the lock period. Accordingly, the eye pointer 50, the PC pointer 51, and the xy coordinates of the operator's viewpoint match at the position of the calibration point 53, and calibration is performed. If the colors of the calibration point 53 and the eye pointer 50 are changed while the calibration is locked, it is possible to easily inform the operator of the locked period. Further, a calibration area (2) 61 is also provided at the center, lower left, and lower right of the display portion of the eyeglass display 2, and the eye pointer is calibrated for pointing operation of the keyboard emulator. Since the PC pointer 51 is not in the displayable area, the Y-axis is not corrected and only the X-axis is calibrated.

Next, another embodiment of the present invention will be described.

As another embodiment of the pointing device having a click function by blinking according to the present invention, an eye camera is mounted only on the right eye part, and an eye camera is mounted also on the left eye part to provide a left eye and a right eye eye camera. By providing a function of switching between the blink sensor and the blink sensor, the usage of the left and right eyes can be reversed. That is, a right click and a pointing operation can be performed with the left eye, and a left click can be performed with the right eye.

Further, as another embodiment of the pointing device having a click function by blinking according to the present invention, if the blinking of both eyes is performed several times consecutively, the display of the eyeglass display disappears and becomes transparent. It does not hinder the operator's view when not performing an operation.
In addition, by changing the number of times that both eyes are blinked continuously, if the lenses of both eyes become black like sunglasses, the appearance of unnatural faces from the perspective of a third party at first glance, such as eye movements and blinking movements while operating the computer. You can hide your expression. To make the lens black, it is possible to use a deflecting lens that changes the amount of light transmitted when a voltage is applied.

[0045]

As described above, according to the present invention, the blinking signal correction unit makes the blinking of both eyes and the unstable period of the blink detection at the start of blinking invalid. Therefore, there is an effect that the click operation can be performed by blinking one eye.

The key operation is realized by outputting a character code from the keyboard emulator to the keyboard interface. Therefore, there is an effect that not only a screen pointing operation but also a key input operation are possible.

Further, the character code of the ESC key is output in a pseudo manner by closing the right eye in a state where the pointing operation is performed with the right eye and the left eye is closed and the object is being grasped (draged). I have. Therefore,
This has the effect of having the function of canceling the pointing operation.

The pointing device of the present invention has an advantage that the pointer can be easily calibrated by providing a pointer calibration area at a key position on the screen even when the position recognition accuracy of an eye camera or the like is low.

Further, without changing the hardware, software and operating system of the computer to be operated, the conventional mouse interface,
This has the effect that the connection can be made without changing the keyboard interface and the video interface.

[Brief description of the drawings]

FIG. 1 is a schematic diagram showing an overall configuration of an embodiment of the present invention.

FIG. 2 is a schematic diagram showing the operation of the blink sensor according to the embodiment of the present invention.

FIG. 3 is a schematic diagram showing an operation of the blink sensor according to the embodiment of the present invention.

FIG. 4 is a block diagram showing an overall configuration of an embodiment of the present invention.

FIG. 5 is a block diagram illustrating a configuration of a blink signal correction unit according to the embodiment of the present invention.

FIG. 6 is a schematic diagram showing a configuration of an image displayed on an eyeglass display according to the embodiment of the present invention.

FIG. 7 is a schematic diagram showing an operation of an eye pointer according to the embodiment of the present invention.

FIG. 8 is a schematic diagram showing an operation of an eye pointer according to the embodiment of the present invention.

FIG. 9 is a time chart illustrating an operation of a blink signal correction unit in the embodiment of the present invention. (A) is a time chart showing blinking of the left eye, and (b) is a time chart showing blinking of both eyes.

FIG. 10 is a time chart showing a cancel operation during dragging in the embodiment of the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Glasses type frame 2 Glasses display 3 Eye camera 4 Left eye blink sensor 5 Right eye blink sensor 6 Controller 7 Computer 8 Cable 10 Pointing device 32 Blink signal correction unit 50 Eye pointer 53 Calibration point 51 PC pointer 55 Character key area 56 PC screen 54 Keyboard display unit 60 Pointer calibration area (1) 61 Pointer calibration area (2) 80, 81 Waveform shaping circuit 82, 83 One shot 85 OR circuit 86 Delay 87 Gate circuit 89 AND circuit 90 Infrared lamp 91 Infrared light receiving unit

Claims (14)

[Claims] An eye movement of an operator is captured, a gaze position on a display is detected, and a click operation is performed by blinking one eye of the eye when a target to be clicked is positioned at the viewpoint of the eye. A pointing device having a click function by blinking. 2. The pointing device according to claim 1, wherein the display is a spectacle display for displaying a display portion of a computer through a lens portion of spectacles for display. 3. The pointing device according to claim 2, further comprising a spectacle-shaped frame for supporting the spectacle display. 4. A pointing device having a click function by blinking according to claim 3, further comprising an eye camera which captures the movement of the eye and detects where the eyeglass display is staring. apparatus. 5. The pointing device according to claim 4, further comprising a left-eye blink sensor and a right-eye blink sensor for detecting a blink of the left and right eyes of the eye. 6. The method according to claim 1, wherein the left-eye blink sensor and the right-eye blink sensor determine that the one-eye blink is detected when a period in which only one of the left eye and the right eye is closed exceeds a predetermined time. A pointing device having a blinking click function according to claim 5. 7. A function for canceling a pointing operation when the left-eye blink sensor and the right-eye blink sensor determine that both the left eye and the right eye are closed.
A pointing device having a click function by blinking according to item 1. 8. The eyeglass display, the eye camera,
The left eye blink sensor and the right eye blink sensor,
The pointing device having a click function by blinking according to any one of claims 5 to 7, further comprising a controller controlled via a cable. 9. The pointing device according to claim 8, wherein the controller is connected to a mouse, a keyboard, and a video interface for a computer to be controlled. 10. A controller connected to the left-eye blink sensor and the right-eye blink sensor, and comprising a signal correction unit for outputting a signal of the mouse, keyboard, and video interface from a blink operation. Item 10. A pointing device having a click function by blinking according to item 9. 11. The apparatus according to claim 1, wherein the controller is connected to the eye camera, and includes a viewpoint coordinate conversion unit that detects where an operator is staring at the eyeglass display and outputs xy coordinates thereof. The pointing device having a click function by blinking according to claim 10. 12. The controller according to claim 1, wherein the controller samples the xy coordinates output from the viewpoint coordinate conversion unit at regular time intervals, and calculates a difference when an eye pointer indicating a position where the eye is staring moves. The pointing device according to claim 11, further comprising a viewpoint coordinate movement difference conversion unit that calculates and outputs a signal corresponding to movement to an interface of the mouse. 13. The controller according to claim 1, wherein the controller creates an image of an eye pointer on the xy coordinates from the XY coordinates from the viewpoint coordinate conversion unit, combines the image with an image signal of the video interface, and outputs the video signal to the glasses display. 13. The pointing device according to claim 12, further comprising an eye pointer unit. 14. The controller according to claim 1, wherein the controller determines whether or not an eye pointer is located in a portion displayed on the eyeglass display based on the xy coordinates from the viewpoint coordinate conversion unit. 14. The pointing device according to claim 13, further comprising a keyboard emulation unit that outputs a character code to the interface of the keyboard when the user is staring at the character.