TWI638286B - Ocular control system - Google Patents

Abstract

An electrooculogram control system controlled according to the relative movement of the eyeball and the head, comprising a sensing device and a programmable logic control unit. The sensing device contacts the human face to detect relative motion information between the eyeball and the head to be converted into respective electro-oculograms (EOG). The programmable logic control unit performs all operational controls and processes in a programmatic manner. The programmable logic control unit determines and processes the electrical-eye wave signals generated by the sensing device to control the mouse cursor motion and execution. Left, right and up and down keys.

Description

Ocular control system

The invention relates to a system for eye-controlled communication, in particular to an eye-electric control system for controlling displacement and lower command of a mouse cursor by using relative movement of an eyeball and a head.

Press, long-term use of hands to control the mouse, hand will have mouse syndrome, therefore, there is an eye movement control device that uses the movement of the eye to manipulate the cursor displacement of the mouse to overcome the long-term operation, causing hand acid, mouse Symptoms of the syndrome, or for people with handicap disabilities.

The conventional eye command control device relies entirely on the movement of the eye to control the displacement of the cursor. However, simply using the eyeball to control the cursor, the eyeball can only watch the focus one by one, the head can not move, otherwise the cursor will float (not synchronized with the eye movement or even run away from the screen), affecting the use effect. In addition, intentional blinking can be used as a control, but unintentional blinking can affect the operating function. The conventional system must be fixed by the head and controlled by simple eye movements. It is neither convenient nor humanized. It is too space-consuming to use the head fixing bracket.

In addition, in the past, the electrode was adhered to the face, and the metal electrode was directly attached to the skin, and the resistance between the skin contact electrode was blocked by sweating and powder makeup. In turn, it affects the stable acquisition of data.

Moreover, the adhesion of the electrodes should be done by yourself or by others. It is very inconvenient to remove the tape after use. Many wires are connected to the device body during use, which is easy to knot and hinder the foot. Therefore, the device is used beforehand and Subsequent actions take up too much time.

The invention provides an ocular power control system, which uses the moving direction and the moving amount of the eyeball relative to the head as the data for controlling the mouse cursor, and the sensing device is a mask close to the face, so that the electrodes are conveniently attached to the face. In order to obtain the oscillating voltage signal stably, and the multiple external wires connecting the electrodes and the device are missing, so that they can be worn directly when used, and can be taken out directly after use, which is safe, fast and convenient, and overcomes the conventional device. The problem that arises.

In addition, when the suction cup is adsorbed to the skin, the compression-deformed conductive medium simultaneously contacts the conductive sheet and the skin, and not only constitutes a conductive, but also the conductive medium containing the conductive gel (liquid) is in good contact with the skin, and the conductive liquid is not easily dried. Therefore, the resistance value of the contact is relatively stable, so that the acquisition of the ocular wave voltage is less affected, thereby achieving the effect of stably obtaining the voltage signal.

Thus, the electrooculogram control system of the present invention is connected to a host to perform the mouse function of the host, and includes a sensing device and a programmable logic control unit. The sensing device contacts the face of the human body to detect relative motion information of the eyeball and the head to respectively convert into respective electrical-eye movement signals. The programmable logic control unit to programmatically execute all operational controls and processes, the programmable logic The control unit is judged and processed according to the electric-eye wave signal generated by the sensing device to control the cursor cursor action and perform the functions of the left, right and up and down keys.

According to the above invention, the electrooculogram control system further comprises an interface unit for controlling or transmitting the mouse cursor motion and performing the functions of the left, right and up and down keys according to the signal generated by the programmable logic control unit.

According to the ophthalmic control system of the present invention, the sensing device comprises a mask body and a plurality of electrodes, the mask body providing a cover on the face, each of the electrodes being distributed and attached to the skin near the eyes.

In accordance with the above described ocular electrical control system of the present invention, the sensing device has a plurality of electrodes.

According to the ophthalmic control system of the present invention, the electrode has seven electrodes, one of which is attached to the center of both eyes of the face, the two electrodes are disposed outside the eyes, and the four electrodes are disposed on the upper side of the two eyes. With the underside.

According to the ocular control system of the present invention, each of the electrodes has a conductive sheet, a suction cup and a conductive medium. The suction cup is disposed on the conductive sheet to define a chamber, and the conductive medium is disposed in the chamber. And forming an electrical connection with the conductive sheet.

According to the above ocular control system of the present invention, the conductive medium has a sponge type and a conductive gel or a conductive liquid adsorbed in the sponge.

The electrooculogram control system according to the present invention further includes a wireless transmitting unit, a wireless receiving unit and a second programmable logic control unit, the wireless The transmitting unit is connected to the output end of the programmable logic control unit, and the wireless receiving unit is configured to receive the signal transmitted by the wireless transmitting unit, send the signal through the second programmable logic control unit, and then send the interface unit.

According to the ocular control system of the present invention, the mask body of the sensing device further includes a strap attached to both sides of the mask body for binding to the head.

The otoscope control system according to the present invention further includes an amplifier and a filter connected to the output end of the sensing device to amplify the signal detected by the electrode, and the filter is connected to the amplifier. The output is used to filter out the noise of the amplified signal, and the output of the filter is connected to the input of the programmable logic control unit.

The electro-oculography control system according to the present invention further includes a left button switch, a right button switch and a scroll button (or upper and lower buttons), wherein the left button switch, the right button switch and the scroll button are respectively connected to the Program logic control unit.

As described above, the present invention uses the moving direction and the amount of movement of the eyeball relative to the head as the data for controlling the cursor of the mouse. Thus, the head can also move, and can also participate in the control action, which is more in line with the needs of humanization, and also saves The space occupied by the head fixing bracket is used. The eyeball moves relatively in the eyelid of the head. This is the movement of the eyeball relative to the head. When the movement is measured, the voltage change can be measured. According to this change, it can be used as the data for controlling the mouse cursor.

The present invention further provides a sensing device for an ocular electrical control system, comprising an ergonomic mask body and a plurality of electrodes on the mask body The mask body is provided with a cover covering the face, and each of the electrodes is distributed and attached to the skin near the eyes.

According to the sensing device for an ocular electrical control system of the present invention, each of the electrodes has a conductive sheet, a suction cup and a conductive medium.

According to the sensing device for an ophthalmic control system of the present invention, the conductive medium has a sponge type and a conductive gel or a conductive liquid adsorbed in the sponge.

According to the sensing device for an ocular electrical control system of the present invention, wherein the suction cup is disposed on the conductive sheet to define a chamber, the conductive medium is disposed in the chamber and is in electrical contact with the conductive sheet. .

According to the sensing device for an ocular electrical control system of the present invention, the mask body further includes a strap attached to both sides of the mask body for binding to the head.

40‧‧‧Programmable logic control unit (including PIC)

80‧‧‧Second programmable logic control unit

230‧‧‧ scrolling keys (up and down keys)

100‧‧‧Host

10‧‧‧Sensing device

11‧‧‧ mask body

12‧‧‧ electrodes

121‧‧‧Conductor

122‧‧‧Sucker

123‧‧‧Electrical medium

1231‧‧‧ class sponge

1232‧‧‧ Conductive gel

124‧‧ ‧ room

15‧‧‧Female Velcro

14‧‧‧Male adhesive tape

20‧‧‧Amplifier

30‧‧‧ Filter

111‧‧‧Perforation

50‧‧‧Interface unit

60‧‧‧Wireless transmitting unit

70‧‧‧Wire receiving unit

13‧‧‧Belt

200‧‧‧Eye control device

210‧‧‧Left button switch

220‧‧‧right switch

300‧‧‧ Face

BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a circuit block diagram showing a first embodiment of the electrooculogram control system of the present invention.

Fig. 2 is a perspective view showing the appearance of one of the sensing devices in the present invention.

Fig. 3 is a schematic plan view showing the distribution of electrodes in the vicinity of the eye in the present invention.

Fig. 4 is a cross-sectional view showing the electrode in the present invention.

Fig. 5 is a cross-sectional view similar to Fig. 4 of the present invention, showing a state in which a conductive medium is subjected to compression deformation to contact a conductive sheet and a face.

Figure 6 is a block diagram showing the operation method of the electrooculogram control system of the present invention.

Figure 7 is a circuit block diagram of a second embodiment of the electrooculogram control system of the present invention.

The electrooculogram control system 200 of the present invention has the following functions: through the programmable logic control unit, the relative movement direction and movement amount of the eyeball and the head are used as data for controlling the mouse cursor. And through the programmable logic control unit, you can judge intentional blinking and unintentional blinking. The mask with the eye mask is placed close to the face, and the glasses can still be worn after being worn. Each electrode is kept in contact with the skin of the face by a soft conductive material to maintain the stability of the ocular voltage signal.

Referring to FIGS. 1 and 2, a first embodiment of the electrooculogram control system of the present invention is connected to a host 100 for performing a mouse function of the host 100. The host 100 can be a computer or a game machine or the like.

The electrooculogram control system 200 includes a sensing device 10, an amplifier 20, a filter 30, a programmable logic control unit 40, and an interface unit 50.

Referring to FIGS. 2~3, the sensing device 10 includes an ergonomically shaped mask body 11 and a plurality of electrodes 12 disposed on the mask body 11. The mask body 11 provides a cover over the face, and each of the electrodes 12 is distributed and attached to the skin adjacent the eyes. In this embodiment, there are seven electrodes 12, one of which is attached to the center of both eyes of the face, wherein two electrodes 12 are respectively disposed outside the eyes, and the other four electrodes 12 are disposed on the upper side of the eyes. With the underside. The mask body 11 is in the form of an eye mask so that the electrodes are attached to the skin of the face.

Referring to FIG. 4, each of the electrodes 12 is respectively embedded in the mask body. A through hole 111 of the 11 has a conductive piece 121, a suction cup 122 and a conductive medium 123. The chuck 122 is disposed on the conductive sheet 121 to define a chamber 124. The suction cup material is selected from conductive rubber, rubber, plastic and other materials. The conductive medium 123 is disposed in the chamber 124 and is in electrical contact with the conductive sheet 121. Referring to FIG. 5, in use, the suction cup 122 is attracted to the face 300, so that the conductive medium 123 is compressed and deformed to form a comparison. Good electrical connection.

In addition, in the present embodiment, the conductive medium 123 has a sponge 1231 and a conductive gel (or conductive liquid) 1232 adsorbed in the sponge 1231. The mask body 11 of the sensing device 10 further includes a two-belt belt 13 and a male adhesive strip 14 and a female adhesive strip 15 respectively connected to the sides of the mask body 12, and the male adhesive strip is used. 14 and the mother fastening tape 15 are bonded to each other for binding to the head. Alternatively, the strap may be an elastic band that is tied to the head with an elastic band. The male and female adhesive strips can be replaced by male or female buttons or magnets. In addition, the conductive gel 1232 can also be replaced by a conductive liquid such as saline, which is low in cost.

The sensing device 10 is in contact with the human face 300 for detecting relative motion information of the eyes and the head to be converted into respective electrical-eye movement signals (EOG), or may be in contact with the face. Other muscle groups are used to sense the movement information (EMG) of other muscles, but can be used as functional, such as left and right.

The amplifier 20 is connected to an output end of the sensing unit 10, The signal detected by the electrode 12 is amplified. This amplifier 20 is, for example, an operational amplifier (OP AMP).

The filter 30 is coupled to the output of the amplifier 20 to filter out the noise of the amplified signal, and the output of the filter 30 is coupled to the input of the programmable logic control unit 40.

The programmable logic control unit (including PIC) 40 is configured to execute all operational controls and processes. The programmable logic control unit 40 determines the electrical-eye movement signal (EOG) generated by the sensing device 10. And processing.

The interface unit 50 controls the mouse cursor motion and performs the left and right functions according to the signal obtained by the programmable logic control unit 40. The interface unit 50 can be a driving circuit, a conversion circuit, or a matching circuit, or a connector, as a bridge for the programmable logic control unit 40 to transmit signals to the host, and can be integrated (IC) It.

In addition, the electrooculogram control system 200 further includes a left button switch 210, a right button switch 220, and a scroll button (or upper and lower button) 230. The left button switch 210, the right button switch 220 and the scroll button 230 respectively Connected to the programmable logic control unit 40, placed in a suitable location, such as on a table or body, to provide the ability to manually perform left button, right button and scroll. Secondly, the left button switch 210, the right button switch 220 and the scroll button 230 can also be designed on the mask body 11 to be worn on the human body, and provide the functions of manually performing left button, right button and scrolling.

As described above, the present invention adopts the moving direction of the eyeball relative to the head and The amount of movement, as the data to control the cursor of the mouse, so that the head can move, can also participate in the control of the action, which not only meets the needs of humanization, but also can more effectively move the mouse cursor to the destination point, the eyeball is at the head The movement inside the eyelid is the movement of the eyeball relative to the head, and the voltage change (ΔVx, ΔVy) can be measured when moving.

In the present invention, the fluctuation of the potential difference in the left-right direction is replaced by ΔVx, and the variation of the potential difference in the vertical direction is replaced by ΔVy, and data of (ΔVx, ΔVy) can be obtained, whereby the moving direction of the visible focus can be derived. And the amount of movement to control the movement of the mouse cursor.

The operation method of the invention: when the eyeball moves, and the head is fixed, the focus is to the left, the mouse cursor can be moved to the left; when the head moves, the focus is fixed and the focus on the host 100 (monitor screen) is fixed. When the head moves to the left (but because the focus still looks at the same point, then the direction of movement of the eyeball in the eyelid relative to the head is toward the right side of the head), the mouse cursor can be moved to the right. The head is opposite to the mouse cursor.

In other words, when the focus is on a point, because the head and the mouse cursor are opposite in direction, moving the head can achieve the purpose of moving the mouse cursor to the focus.

In addition, the present invention takes the relative movement method as a spirit, and the eyeball and the head can be separately moved at the same time, and the position of the head can be finely adjusted at any time in order to overcome some unstable change factors, so that the eye movement can be easily achieved. The purpose of the mouse cursor.

Since the normal mouse is not in use, the mouse cursor is not known there. When you want to use it, you can find the cursor by moving the mouse a few times.

Similarly, in the present invention, when the cursor disappears from the screen, the user can quickly look for the cursor by simply looking at the center of the screen with the eye, and then turning the head a few times, the operation is simple and quick, and it is easy to get started.

Referring to FIG. 7, a second embodiment of the electrooculogram control system 200 of the present invention is connected to a host 100 for performing the mouse function of the host 100. The host 100 can be a computer or a game machine or the like. The otoscope control system 200 of the second embodiment includes a sensing device 10, an amplifier 20, a filter 30, a programmable logic control unit 40, a wireless transmitting unit 60, a wireless receiving unit 70, and a second The program logic control unit 80, an interface unit 50, a left button switch 210, a right button switch 220, and a scroll button 230.

The wireless transmitting unit 60 is connected to the output end of the programmable logic control unit 40. The wireless receiving unit 70 is configured to receive the signal transmitted by the wireless transmitting unit 60, send it to the second programmable logic control unit 80 for processing, and then send the signal. Interface unit 50.

Therefore, in the second embodiment, the electric-eye wave signal (EOG) is transmitted by means of wireless communication to control the mouse cursor of the computer and the game machine. As for the control mode, except for transmitting signals in a wireless manner, other functions are the same as those in the first embodiment described above, and details are not described herein again.

In addition, the programmable logic control unit 40, the interface unit 50, the wireless transmitting unit 60, the wireless receiving unit 70, and the like in the present invention can be integrated to reduce the volume thereof and is convenient to use. It’s worth mentioning that because of all the parts Can be reduced, we can set the wireless transmitter unit 60 and all the previous components in the eye mask body, which not only can eliminate the inconvenience of multiple long wires of the external electrodes, just wear the eye mask when using, use It’s just fine, very convenient.

In summary, the present invention programmatically sets all control operations by the programmable logic control unit 40, and utilizes a mask close to the face (mask body 11), which can still be worn after being worn, and the seven electrodes thereon. 12. The horizontal and vertical potentials of the left eye and the horizontal and vertical potentials of the right eye (including single or double eyes) can be obtained.

In the blink of an eye (including one or both eyes), a glitch is generated on the EOG, which is the discharge phenomenon of the muscle group associated with blinking (EMG). This is an interference signal in the EOG test, which will hinder the correct data. The reading, but in the present invention, is used to replace the left and right keys and the like, and the program resolves the waveform to identify the correct command, and the programmable logic control unit 40 can perform the command once or twice.眨 three times, such as the left eye or the single eye, and the length of each blink, to determine whether it is an intentional or unintentional blink, to distinguish which instruction to overcome the unintentional blind effect of the use of the effect problem.

Please refer to Figure 6. Before the operation, you can adjust the calibration point, the setting of the blink, the number of seconds to pause, the left and right eyes and the main eye setting according to your personal situation. When starting to use, the eyeball moves to sense the potential change (ΔVx, ΔVy), and the programmable logic control unit 40 starts the calculation process and converts it into the mouse cursor coordinate data (the screen displays the moving cursor at this time), if the user To select a point to press the left and right button, select a point (for example: point A), focus does not move, adjust the head to stop the cursor at the selected point A, Prepare the action with a manual button or a blink of an eye.

As for the intentional and unintentional blind control method: unintentional blinking action, when the computer judges the glitch, does not move the mouse cursor, after the glitch is over, it automatically returns to the focus movement; intentional blinking action, to simulate the left and right keys, use The focus and mouse cursor will be paused at a selected position. The time and method of blinking are different. When the computer judges the reading, the mouse cursor is not moved. After the glitch is over, the automatic return glitch occurs before the spurt occurs. The position of the pause is not moving for a few seconds. Wait for the next left or right eye or both eyes (execute the left or right button function). The left and right buttons must be clicked or two or three times, single or double eyes. In the software setting, if the mouse cursor stops for a few seconds without blinking, it is regarded as an ordinary unintentional blink, and the mouse cursor is resumed with the focus. In addition, it can also be set before use. After selecting point A, directly select the selected intentional blink type and immediately enter the page linked by point A.

Therefore, in the ocular electric control system of the present invention, the sensing device of the mask shape can be used by being worn on the head, and the relative movement of the eyeball and the head can be used to obtain the function of controlling the cursor of the mouse, so that the table can be slid out. The position of the mouse, the hand can also be free to play the keyboard, writing, etc., can also rest to reduce the occurrence of mouse syndrome.

Secondly, when the suction cup is adsorbed to the skin, the compression-deformed conductive medium simultaneously contacts the conductive sheet and the skin, and not only constitutes a conductive, but also the conductive medium containing the conductive gel (liquid) is in good contact with the skin, and the conductive liquid is not easily dried. Therefore, the resistance value of the contact is not easily changed, so that the voltage signal of the ocular wave can be stably obtained.

In addition, the (Vx, Vy) signal detected from the electrode, after passing through the amplifier, has sufficient strength for subsequent processing, and then filters the noise to enter the programmable logic. The PIC in the control unit contains A/D, I/O, CPU, memory, burnable program memory, etc., which is calculated and judged in the chip. After the data is processed, it becomes the coordinates of the mouse cursor. The data or the commands of the left, right, up, and down keys are transmitted to the computer or game console via USB or wired, and the cursor position or the left, right, up, and down keys are displayed on the screen. Complete the work of replacing the normal mouse. The PIC in the programmable logic control unit was developed and manufactured by Microchip Technology, exemplified by the PIC16F684, but the operational amplifier is LM324.

However, the above is only the preferred embodiment of the present invention, and the scope of the present invention is not limited thereto, that is, the simple equivalent changes and modifications made in accordance with the scope of the present invention and the description of the invention. All remain within the scope of the invention patent.

Claims (10)

A method for controlling the movement of a mouse cursor, the method uses the movement of the head to participate in controlling the cursor of the mouse, and the movement direction and the movement amount of the eyeball relative to the head are obtained when the head moves, as data for controlling the cursor of the mouse, wherein Using the focus to focus on a target point while moving the head toward the cursor position to manipulate the mouse cursor to move in the opposite direction, moving the cursor toward the focus, which moves in the opposite direction to the mouse cursor. The method for controlling movement of a mouse cursor according to claim 1 of the patent application scope, wherein the method is that the eyeball moves in the eyelid of the head, and is a movement of the eyeball relative to the head, and the measurement voltage changes when moving (△ Vx, ΔVy). The method for controlling the movement of a mouse cursor according to the second aspect of the patent application, wherein the method is that the potential difference in the left-right direction is replaced by ΔVx, and the potential difference in the up-and-down direction is replaced by ΔVy, which is obtained (Δ). The data of Vx, ΔVy) is used to calculate the moving direction and the amount of movement of the visual focus to control the movement of the mouse cursor. According to the method for controlling the movement of the mouse cursor according to the first aspect of the patent application, the method is to look at the point in the screen and turn the head to find the cursor when the cursor disappears from the screen. A method for controlling the movement of a mouse cursor, the method uses the movement of the head to participate in controlling the cursor of the mouse, and the movement direction and the movement amount of the eyeball relative to the head are obtained when the head moves, as data for controlling the cursor of the mouse, wherein The method moves the eyeball and the head separately at the same time, and adjusts the position of the head at any time to move the mouse cursor. The method for controlling movement of a mouse cursor according to item 5 of the patent application scope, wherein the method is that the eyeball moves in the eyelid of the head, which is a movement of the eyeball relative to the head, and the measurement voltage changes when moving (△ Vx, ΔVy). According to the method for controlling the movement of the mouse cursor according to item 6 of the patent application scope, In this method, the potential difference in the left-right direction is replaced by ΔVx, and the potential difference in the vertical direction is replaced by ΔVy, and data of (ΔVx, ΔVy) can be obtained to estimate the moving direction and movement of the focus. Amount to control the movement of the mouse cursor. A method for controlling the movement of a mouse cursor, the method uses the movement of the head to participate in controlling the cursor of the mouse, and the movement direction and the movement amount of the eyeball relative to the head are obtained when the head moves, as data for controlling the cursor of the mouse, wherein In this method, when the cursor disappears from the screen, the eye is focused on a point in the screen and the head is turned to find the cursor. A method for controlling the movement of a mouse cursor, the method uses the movement of the head to participate in controlling the cursor of the mouse, and the movement direction and the movement amount of the eyeball relative to the head are obtained when the head moves, as data for controlling the cursor of the mouse, wherein The method uses the EOG or EMG signal of the blink to make the left and right scroll keys. The method for controlling movement of a mouse cursor according to claim 1 or 5 or 8 or 9 of the patent application, which uses an ocular power control system to control movement of a mouse cursor, the ocular control system For connecting to a host to perform the mouse function of the host, the eye electric control system comprises: a sensing device that contacts the face of the human body to detect relative motion information of the eyes and the head, respectively, to be converted into Each of the electrical-eye movement signals has an ergonomic mask body and a plurality of electrodes, the mask body providing a cover over the face, each of the electrodes being distributed and attached to the skin near the eyes; a program logic control unit for programmatically executing all operational controls and processes. The programmable logic control unit determines and processes the electric-eye wave signals generated by the sensing unit to control the mouse cursor motion and execute the left The function of the right and up and down keys; as the data of the mouse cursor is controlled by the movement direction and movement amount of the eyeball relative to the head, while the focus is focused by the moving head while watching the point To the cursor position Set the direction to manipulate the mouse cursor to move in the opposite direction, move the cursor to the target point of the focus, or use the eyeball and the head to move separately, and interactive changes to control the movement of the mouse cursor.