KR100499391B1 - Virtual input device sensed finger motion and method thereof - Google Patents

Abstract

The present invention relates to an input device and a method by the movement of the finger, and to measure the movement of the finger, such as the keyboard of a personal computer without a physical keyboard or mouse, and 100 key input functions such as letters, symbols, functions, and the like; A new concept input device that realizes a mouse function. It is a compact and lightweight type that can be worn on the hand. It is easy to carry, no new operation training is required, and its structure is relatively simple. Lower prices also have the advantage of being possible.

Description

Input device by finger movement and its method {VIRTUAL INPUT DEVICE SENSED FINGER MOTION AND METHOD THEREOF}

The present invention relates to an input device by a finger movement and a method thereof, and more particularly, by inputting a character movement or a movement of a finger capable of moving a mouse pointer without a physical keyboard or a mouse by measuring a finger movement. An apparatus and a method thereof are provided.

Smaller, more compact portable inputs with the advent of various information devices that can be carried by humans such as portable PCs, wearable PCs, portable computers, Internet-enabled mobile phones, and PDAs. There is a need for a device. There are two types of character information input apparatuses that can cope with this, a method using a key and a method based on a recognition technology.

First of all, the method of using a key is basically a method of using a key switch to arrange a plurality of keys to correspond to a plurality of codes on one key, a folding keyboard to fold a keyboard, and a cloth keyboard to bend like a cloth. It is proposed.

Next, as a method based on a recognition technology, a pen input method based on handwriting recognition and a voice recognition method have been proposed or partially used.

However, these methods have many limitations. That is, in the case of the voice recognition input, the recognition rate improvement, the separate recognition technology of the command and the data, and the like are the key issues. In addition, a character recognition method such as a pen mouse suffers from a problem of recognition error as well as a slow input speed when working with a large amount of documents, and a human worker easily tired.

On the other hand, the one-key-multi-code corresponding method for mapping various codes to one key used in a mobile phone requires a new typing training and has a problem of slow input speed.

In terms of technology to date, these devices are useful for simple text input, but are not suitable for bulk or complex document input. In terms of text input, text documents can be as large as a computer keyboard. There is no familiar device.

Therefore, the keyboard type is most likely as a bulk document input method. However, since miniaturization of about 100 keys has a limitation on the area of keys that users can press, foldable keyboards and cloth-type keyboards that minimize the volume have been proposed, but durability, integration of mouse functions, and moving For example, there is a problem of limitation of use place where there is no flat floor for the working height.

Therefore, the advantages of the keyboard, that is, a large number of documents or complex documents can be input, the user who is familiar with the existing key input method can be easily operated without new training, and also a portable device that can be worn directly on the hand as a glove type keyboard type This has been presented.

In the armored keyboard type, US Pat. No. 5,581,484 proposes a method of estimating the position of a finger through integration by arranging three-axis acceleration sensors at the end of each finger. The armored keyboard has a problem that is not practical as a keyboard unless an error is accumulated over time due to the drift of the acceleration sensor and a special error correction algorithm is developed. In addition, the method of informing the human operator of the position information of the keyboard also has a problem that is not realistic.

In addition, although not a keyboard, there is a data glove such as Korean Unexamined Patent Publication No. 1998-36079 "Glove Interface Device for Digital Data Input" that can monitor a hand motion, but it is not used as a key input device. There is an impossible problem.

The present invention has been made to solve the above problems, an object of the present invention is to detect the bending of the finger joint and the distance between the fingers and pressing state to move the input of the character or the mouse pointer without a physical keyboard or mouse The present invention provides an input device and a method by which a finger moves.

Another object of the present invention is to provide a method of using an input device by a movement of a finger to input a key while watching a virtual keyboard displayed on a screen and a user's virtual finger.

Another object of the present invention is to provide an input method by the movement of one finger to control the movement of the mouse pointer by the movement of the finger.

Input device by the movement of the finger of the present invention for realizing the above object is a bend detection sensor for detecting a distance change according to the bending of the finger joint, a gap detection sensor for detecting a change in the distance between the fingers; Key-in sensor for detecting key-in status by finger, Hand-rotation sensor for detecting hand rotation, Hand movement sensor for detecting the top, bottom, left and right positions of hand, Bending sensor and gap detection A control unit that sequentially scans the values of the sensor, key-in sensor, hand-rotation sensor, and hand movement sensor and outputs them to an external device, sets the functions by receiving signals from the control unit, sets the mouse pointer, virtual hand shape and text. Characterized in that consisting of a data processing unit for outputting.

Bend detection sensor from the above is characterized in that consisting of a reflected light sensor is installed on the finger joint to measure the distance according to the bending of the finger joint.

In addition, the gap detection sensor is characterized in that consisting of a reflected light sensor for measuring the distance between adjacent fingers.

On the other hand, the gap detection sensor is characterized in that consisting of a link-type sensor for measuring the distance between adjacent fingers.

In addition, the key-in detection sensor is characterized in that consisting of a touch sensor is installed to the fingertips of the finger to detect the pressing when pressed.

On the other hand, the key-in detection sensor is characterized in that consisting of a shock sensor for detecting the impact of knocking a finger to key in.

In addition, the bending detection sensor, the open detection sensor, key-in detection sensor, hand rotation detection sensor, hand movement detection sensor and the control unit is characterized in that the glove is installed.

In addition, the bending detection sensor, the gap detection sensor and the key-in sensor is characterized in that formed on the ring that can be put on each finger.

In addition, the hand rotation sensor is characterized by consisting of a gyroscope of one axis for detecting the rotation of the hand on the working plane of the entire hand.

In addition, the hand movement sensor is characterized by consisting of two-axis acceleration sensor for detecting the up, down, left and right positions of the hand on the working plane of the entire hand.

In addition, the control unit is a pulse driving method, the bending detection sensor and the separation detection sensor is sequentially selected by the mux / demux to receive a signal, the bending amount detection unit for measuring the amount of bending of the hand and the amount of finger spread, and the hand Rotation amount detection unit for measuring the amount of rotation of the hand by inputting the value of the rotation sensor, a movement amount detection unit for measuring the amount of movement of the hand up, down, left and right by inputting the value of the hand movement sensor, bending amount detection unit and the amount of rotation It is characterized by consisting of a processor for encapsulating and transmitting the output data of the sensing unit, the movement detection unit and the key-in detection sensor, and an interface unit for generating a serial / parallel data signal to output to the data processing unit of the external device.

The data processing unit may further include a position signal processing unit for processing values of the bending amount, rotation amount sensing unit, and movement amount sensing unit, a key-in signal processing unit for receiving and processing a value of a key-in detection sensor, and key-in. In order to increase the input success rate during keyboard function according to the value processed by the position signal processor and the mode converter which transmits / receives the signal between the signal processor and the position signal processor, the key arrangement is virtually changed according to the user's hand size or habit. A learning algorithm to be relocated, a mouse mode unit to perform a mouse function according to the value processed by the position signal processing unit, and a character corresponding to the position of the hand input by the learning algorithm and the selected key value to be displayed and displayed. Characterized in that consisting of the keyboard mode.

In addition, the input method according to the movement of the finger according to the present invention is the step of continuously receiving and inputting the values of the bending detection sensor, the open detection sensor, the key-in detection sensor, the hand rotation detection sensor and the hand movement detection sensor sequentially according to each mode And determining the function setting data and the key data from the input signal, and mode switching to the function setting mode for the input value in the case of the function setting data, and the function set according to the input value after the function setting is completed. And determining the position of the finger and outputting the key value pressed by the corresponding finger and the current hand gesture on the screen.

The function setting mode is characterized by consisting of a keyboard mode and a mouse mode.

In addition, the keyboard mode is characterized by consisting of an expert mode, an unskilled mode and a key setting mode.

Also, in the non-skilled mode, whether the user works with all fingers or typing with only a certain finger, the signal of the bend sensor and the open sensor can be detected by analyzing the signal of the key-in sensor. It is characterized in that to determine whether to use the signal of the hand rotation sensor and the hand movement sensor to measure the amount of rotation of the hand.

The present invention made as described above according to the value of the sensor input by setting the keyboard mode and the mouse mode by detecting the movement of the finger through the bending sensor, the open sensor and the hand rotation sensor and the hand movement sensor and the key-in sensor The location and state of fingers can be determined so that data can be entered without a keyboard or mouse.

Hereinafter, exemplary embodiments of the present invention will be described with reference to the accompanying drawings. In addition, this embodiment is not intended to limit the scope of the present invention, but is presented by way of example only.

1 is a state diagram showing a state installed in the glove as an input device by the movement of the finger according to the present invention.

As shown here, the bending sensor 10 detects the change of distance between the first and second fingers of the finger 120 according to the bending of the second joint below the third finger and the middle finger, middle finger, and ring finger. First to fourth reflective light sensors 11 to 14 are provided. As the gap detection sensor 20, a thumb is provided with a fifth reflective light sensor 15 for measuring the distance between the second node and the index finger, and a sixth reflective light sensor 16 for measuring the distance between the index finger and the middle finger. A seventh reflective light sensor 17 for measuring the distance between the ring finger and the base is installed.

The first to fifth film type touch sensors 31 to 35 are attached to all the fingertips of the thumb, the index finger, the middle finger, the ring finger, and the hand as the key-in detection sensor 30.

In this way, the first to seventh reflecting light sensors 11 to 17 and the first to fifth touch sensors 31 to 35 are provided at the same position in both the right hand and the left hand.

In addition, the gyroscope 40 as a hand rotation detection sensor for measuring the amount of rotation of the hand, and the acceleration sensor 50 as a hand movement detection sensor for measuring the amount of movement up, down, left and right of the hand is installed on the back of the hand.

In addition, the first to seventh reflective light sensors 11 to 17 and the first to fifth touch sensors 31 to 35 are connected to the control unit 60 and connected as serial / parallel communication ports of an external computer (keyboard port, RS232C port). , USB port, etc.) is wired or wireless.

Figure 2 is a block diagram showing an input device by the movement of the finger according to the present invention.

As shown here, the controller 60 sequentially mutes the bend detection sensor by the first to fourth reflection light sensors 11 to 14 and the gap detection sensor by the fifth to seventh reflection light sensors 15 to 17. (75) by the demux 71 receives a signal by the bending amount detection unit 70 for measuring the amount of bending of the hand and the amount of finger spread, and by the gyroscope 40 which is a hand rotation detection sensor Rotation amount detection unit 80 for measuring the amount of rotation of the hand, the movement amount detection unit 90 for measuring the amount of movement up, down, left and right by the acceleration sensor 50, which is a hand movement sensor, and the first to fifth touch Encapsulate the output data of the key-in sensor 30, the bending amount sensor 70, the rotation amount sensor 80, the movement amount sensor 90, and the key-in sensor 30 by the sensors 31-35. To the processor 61 for transmitting and outputting the serial / parallel data signal to the data processing unit 100 of the external device. It is composed.

In addition, the drive power 63 of the controller 40 is supplied through an external signal line when wired, and by its own battery power when wireless.

In addition, the bending amount detecting unit 70 includes a pulse generator 72 for generating a constant frequency in order to reduce the influence of disturbance and a pulse generated by the pulse generator 72 to the selection signal in the processor 61. A demux 71 for selecting the light emitting units 10-1 and 20-1 of the first to seventh reflecting light sensors 11 to 17 located at each finger, and the first to seventh at each finger. A first filter 73 for filtering signals input from the light receiving units 10-2 and 20-2 of the reflected light sensors 11 to 17, and a first amplifier 74 for amplifying a signal passing through the first filter 73. ) And signals of the light receiving units 10-2 and 20-2 of the first to seventh reflecting light sensors 11 to 17 selected by the selection signal of the processor 61 among the signals amplified by the first amplifier 74. And a first A / D converter 76 for converting the signal selected by the mux (MUX, 75) and the mux (MUX, 75) into a digital signal.

In addition, the rotation amount detecting unit 80 includes a gyroscope 40, a second filter 81 for filtering an output signal of the gyroscope 40, and a filtered output signal to measure the rotation amount of the entire hand. A second amplifier 82 for amplifying the signal and a second A / D converter 83 for converting the output signal of the second amplifier into a digital signal.

In addition, the movement amount detection unit 90 is a movement amount detection unit 90 for detecting the position of the top, bottom, left and right of the entire hand, the third sensor for filtering the output signal of the acceleration sensor 50 and the acceleration sensor 50; Integrate the filter 91, the third amplifier 92 for amplifying the filtered signal, the first integrator 94 for obtaining the speed by integrating the amplified signal, and the output signal of the first integrator 94 Output of the first integrator 94 and the acceleration drift correction unit 93 for solving the drift due to error accumulation when integrating the signal of the acceleration sensor 50 to obtain the movement amount A speed drift correction unit 95 for solving the drift due to error accumulation when integrating the signal and a third A / D converter 97 for converting the output signal of the second integrator to digital are included.

In addition, the data processing unit 100 may include a bending amount detecting unit 70 detecting a bending and opening of a finger by the first to seventh reflective light sensors 11 to 17 received from the interface unit 62, and a gyroscope ( A position signal processor 102 for processing a value of the rotation amount sensing unit 80 for sensing the rotation amount of the hand by the 40 and the movement amount sensing unit 90 sensing the movement amount of the hand by the acceleration sensor 50; To process the data of the key-in signal processing unit 101 and the position-input signal processing unit 102 and the key-in signal processing unit 101 to receive and process the values of the first to fifth touch sensors 31 to 35. In the case of the keyboard mode, the mode conversion unit 103 and the mode conversion unit 103 which perform the conversion, rearrange the key arrangement virtually according to the dimensions and habits of the user's hand in order to increase the input success rate during the keyboard function. The learning algorithm process, in mouse mode, Learning algorithm 104 for sending the mouse mode unit 105 or the keyboard mode unit 110 through the learning process to adjust the scale of the hand movement and bending amount according to the habit to send the data for each mode, and learning A key table unit for outputting a key value corresponding to the input position by the keyboard mode unit 110 displaying the position and shape of the hand processed by the algorithm unit 104 on the screen and outputting a character corresponding to the selected key value ( 112 and a display unit 111 which graphically reconstructs the display of the position and shape of the hand processed by the learning algorithm unit 104 on the monitor 150.

Referring to the operation of the input device made as described above is as follows.

Connect the interface unit 62 of the input device to the serial / parallel communication port (keyboard port, RS232C port, USB port, etc.) of the computer by wireless or wired. In the case of wired, the power supply 63 is applied via a signal line. In one case, an independent battery power is applied to sense the position of each finger.

At this time, the method of sensing the position of the finger is a scan driving method to generate a pulse of a constant frequency (for example, 3 kHz) in the pulse generator 72 by applying a pulse driving method when driving the sensor to reduce the influence of disturbance. This pulse is a select signal from the processor 61. The light emitting units 10-1 and 20-1 of the first to seventh reflecting light sensors 11 to 17 positioned on each finger by the demux 71 are selected. Select to turn on only the selected light emitting units 10-1 and 20-1.

Thus, at the same time as turning on the selected light emitting units 10-1 and 20-1 of the first to seventh reflecting light sensors 11 to 17, the light emitting unit of the first to seventh reflecting light sensors 11 to 17 is performed. A light receiving unit of a finger having the same signal as the (10-1,20-1) selection signal and the light emitting units 10-1 and 20-1 selected from the first to seventh reflecting light sensors 11 to 17 are turned on. Only the (10-2, 20-2) signal is received by the MUX 73 into the first A / D converter 76. At this time, the first filter 73 and the first amplifier 74 are installed in the light receiving units 10-2 and 20-2 of the first to seventh reflective light sensors 11 to 17. Only a certain frequency (eg 3kHz) is filtered and amplified.

The input signal is converted into a digital signal by the first A / D converter 76 and then encapsulated the selection signal of the finger currently on and the signal of whether the key-in signal is generated via the processor 61 and then the interface unit ( The data is transmitted to the external device (computer) through 62).

The transmitted data is transmitted to the position signal processing unit 101 and the key-in signal processing unit 102 to go through a signal processing process to find out the current hand motion.

The signal processing process is repeated through the position signal processing unit 101 and the key-in signal processing unit 102 to find out the operation of each finger one by one, and by analyzing the data at that time, the current mode is recognized and the user's algorithm is learned. After analyzing the input habits, the current gesture of the user's hand is displayed on the monitor 150, a text is output, or the pointer is moved by the mouse mode unit 105.

However, if a key-in signal is generated from the first to fifth touch sensors 31 to 35 positioned at the tip of the thumb, the index finger, the middle finger, the ring finger, and the finger in the middle of the process, an interrupt is generated and the processor of the controller 60 ( In step 61), the information on the finger having the current interrupt is transmitted to the external device (computer) through the above process, and then the signal processing process for detecting the hand gesture is performed in the same manner. Code (ascii code, etc.) is converted to output characters and displayed on the monitor 150 together with the current hand gesture shape or click or drag of the pointer by the mouse mode module.

On the other hand, according to the value processed by the position signal processing unit 101 using the learning algorithm unit 104 to increase the input success rate, if the operator's finger almost bent during the keyboard function, the value of the pin state and the left and right movement amount of the finger are completely reduced. Initially set key position by interpolation method by measuring in order and setting it as reference data, and virtually rearrange key arrangement according to user's hand size or habit to increase input success rate. The input device is adapted to change of input pattern according to the worker.

3 is a view showing the input state by the input device by the movement of the finger according to the present invention.

As shown here, the screen displays the virtual keyboard and the current hand gesture.

As such, the keyboard may be classified into a keyboard input mode and a mouse input mode according to the display of the virtual keyboard and the hand gesture on the screen.

First, in the keyboard mode, it can be set to the expert mode, the non-skilled mode, the setting key mode, and can also set the mouse mode.

The keyboard input mode is also divided into the expert mode, the non-skilled mode and the key setting mode. The non-skilled mode is set to the non-skilled mode as an initial state when the power is turned on.In addition to the initial initial state, the first touch of the thumb of both hands is performed. The signal of the sensor 31 can be switched on simultaneously. The shifting to the expert mode is performed by turning on all of the first to fifth touch sensors 31 to 35 of the left hand, and the shifting to the key setting mode is to switch the first to fifth touch sensors 31 to 35 of both hands. You can convert them by turning them all ON.

Such mode conversion may be performed by various methods depending on the user.

In addition, in the three modes presented above, various modes such as a general mode, that is, a special key input mode and a numeric key input mode, can be set.

In the non-skilled mode, whether the user works with all fingers or typing with only a specific finger, the signal analysis of the key-in sensor 30 through the signal analysis of the general inexperienced hand bending and shape bending sensor 10 and the signal of the bending amount detection unit 70 measured by the gap detection sensor 20, the gyro of the rotation amount detection unit 80 for measuring the amount of rotation of the hand in the case of a completely unskilled First, it is determined to use the signal of the acceleration sensor 50 of the movement amount detecting unit 90 that measures the movement amount of the scope 40 and the hand.

In addition, as a result of analyzing the signal, a virtual keyboard floated on the screen of the monitor 150 and a virtual hand are displayed while typing. In this case, a work word window and a virtual keyboard are displayed on the work screen. The virtual hand appears according to the position of the finger on the virtual keyboard according to the movement of, and when the key is pressed, the state of the key pressed is visually displayed, and at the same time, a short beep sounds to make the input sense.

In the expert mode, a virtual keyboard on a work screen is not displayed as a typing mode suitable for a skilled worker to input at a high speed on a keyboard of a general computer. However, when the work is suspended, the virtual keyboard appears so that it automatically switches to the non-skilled mode, which not only helps the operator visually, but also allows the operator to obtain the effect of correction. Again, if the input operation shows continuity, switch to expert mode automatically.

In the key setting mode, the user can arbitrarily specify the initial setting of the key position and the key function.

4 is a table showing a mapping relationship between a position signal of a finger of a input device and a key caused by the movement of a finger according to the present invention.

In the table, ∨ indicates the current mode and 와 and ◎ indicate the finger that the touch sensor signal is input to. In addition to the normal mode, fingers with ● and ◎ are simultaneously pressed to output characters, and ○ indicates the position processing result of the finger with the touch sensor signal.

In the keyboard input mode of the input device according to the present invention, since it is not possible to perform the input function of more than 100 keys at a time, when a numeric key or a special key is desired as shown here, the special mode is input in the general mode by converting the mode. Switch to the mode to use.

In this case, the general mode refers to the portion of the keyboard that we are currently using to input Korean-English characters, and the special-key input mode rearranges the keyboard to input special-key characters instead of Korean-English characters on the keyboard of the normal mode. Means keyboard.

Mode conversion occurs when a certain key is pressed for a certain time. For example, if you hold down the letter A with your left hand for a certain period of time, the keyboard that you can type with your right hand (the right part of the English letter YHN key) is converted to a keyboard that lets you enter numbers. By pressing the key, the letter of the key of the converted mode is input, not the letter of the normal mode.

And when you release the pressed mode switch key, it automatically switches to normal mode.

By using this mode conversion method, one finger mode switching, two finger combination switching, three finger combination switching, four finger combination switching, five finger combination switching There are hundreds of modes to switch between, and each mode has 14 character input functions.

If you switch the mode in this way, you will be able to enter all characters that can be entered on your computer.

5 is a view showing a state in which the operation of the mouse mode of the input device by the movement of the finger according to the present invention.

In order to operate in the mouse mode, all of the first to fifth touch sensors 31 to 35 of the right hand finger are turned on to change modes. When the same operation is repeated again, the mode returns to the keyboard mode.

When the mouse mode is set, the mouse function can be realized by two methods. First, the up and down movement signal uses the signal of the acceleration sensor 50 of the movement amount sensing unit 90 for detecting the up and down movement, and the left and right movement signal is the signal of the acceleration sensor 50 of the movement amount sensing unit 90 for detecting the left and right movement. There is a method of realizing a mouse function and a vertical motion signal by a bending motion of the index finger, and a method of realizing a mouse function by a thumb motion of a thumb. Of the two methods, the user selects and uses a convenient method in software.

In both methods, the click signal uses the key-in detection sensor 30 attached to the fingertip. However, in the method using the acceleration sensor 50, if you want to click and drag the icon, the position signal moves the position of the whole hand while pressing the tip of the finger, ie, turning on the second touch sensor 32 installed at the tip of the index finger. This can be done by changing the pointer. In the second method, it is implemented by bending or extending a finger while pressing a fingertip.

6 to 8 are views illustrating an operation state of a sensor for measuring the movement of a finger in an input device caused by the movement of a finger according to the present invention.

First, FIG. 6 shows the index and middle finger, and the bending of the second joint through the bending detection sensor 10 by the first to fourth reflective light sensors 11 to 14 installed under the third finger of the ring finger and the finger. The distance is measured.

That is, when a signal is generated by the light emitting unit 10-1, the light receiving unit 10-2 detects the signal and measures the distances at which the fingers are stretched or bent as d1, d2, and d3.

And, Figure 7 is a principle diagram for determining the vertical position of the key, Figure 8 is a fifth reflected light sensor 15 for measuring the distance between the second node of the thumb and the index finger, and the sixth for measuring the distance between the index finger and middle finger The principle for discriminating the left and right positions of the key through the gap detection sensor 20 by the reflected light sensor 16 and the seventh reflected light sensor 17 measuring the distance between the ring finger and the base.

In this way, the position of the finger is determined through the first to seventh reflecting light sensors 11 to 17.

The position of the fingertip is determined by the up and down position of the finger direction and the left and right movement of the finger. The up and down position is the amount of bending of each joint on the finger, and the left and right movement is the third joint of the finger on the palm (Metacarpal joint, Metacarpo-Phalangeal Joint, 161 is determined by the left and right rotation. Each joint that determines this position is interfered by the ligaments with geometric restraints, limiting its range of motion. In the typing operation, only a more limited operating range than this movable range is required.

Therefore, if the finger is aligned on the reference key of the keyboard, the only movement of the finger requires the reference key, its upper key, the lower key, and three key divisions. You will manipulate the side key row. Therefore, the main joint involved in key position manipulation during the typing operation has a second joint (Phalanx-Interpahalangeal joint, 162) of FIG. Corresponding to the rotation, 162 and the left and right are only the left and right directions of the third joint 161, and the remaining finger joints are all surplus induction and passive bending occurs according to the bending amount of the second joint 162. In addition, the key pressing operation of tapping the key is mainly driven by the vertical rotation of the third joint 161.

In the present invention, the first to fourth reflective light sensors 11 to 14 are installed on the third segment of each finger to measure the bending amount of the second joint 162. The fifth to seventh reflecting light sensors 15 to 17 were installed for the horizontal movement measurement. In addition, the first to fifth touch sensors 31 to 35 are provided at the end of each finger for key tapping.

The position of the finger is measured by the bending sensor 10 attached to the third node of each finger as shown in FIG. The light emitting unit 10-1 of the bending detection sensor 10 is a point light source and diffuses with distance, and output brightness is increased. When referred to the distance between the sensor and the second joint of the finger d, the amount of light coming back is reflected by the second node E,, At this time, if the reflectivity is constant optical signal relation, which is inversely proportional to the following: the square of the same distance, as shown in equation (1) Hold.

Therefore, rotation of the second joint 162 The distance d proportional to can be estimated by measuring the change in the optical signal.

This result also predicts the top and bottom positions of the key by predicting the position of the fingertip.

Because, as described above, the rotation of the second joint 162 is an active element for designating the key position, and the bending of the remaining joints is appropriately determined according to this bending amount. In order to measure the exact position, the influence of other joints should be considered, but in the case of typing, this value is sufficient because only the upper and lower positions of the key position need to be determined. The same principle applies because the detection corresponding to the left and right positions of the keys and the left and right movements of the ring finger need only be discriminated from the reference key and the left or right key.

The position of the fingertip is also determined by the up, down, left, and right movement positions of the hand, which is determined by integrating the signal with the acceleration according to the up, down, left, and right movements of the hand by the acceleration sensor 50. Can be. This method is applied to determine the position of the fingertips when the complete beginner uses only one specific finger without typing while the wrist is fully supported.

The pressing operation is determined by ON / OFF of the film type first to fifth touch sensors 31 to 35 attached to the tip of the finger. The signal is analyzed to determine whether the user is typing while the wrist is fully supported or which specific finger is used.

When mapping the key value to the position value of the finger determined as described above, the learning algorithm 104 determines the initial calibration (Calibration), and the algorithm for learning and adjusting the key layout during typing, the difference in hand size for each user, gloves It is also possible to cope with the case of using the wearing state, the constraints of the operator's typing work space, i.e., the thighs and the like rather than the flat bottom.

In addition, it is equipped with a function that can adjust the size of the key and the space arrangement in response to the typing habit of the operator to add to the operator's convenience.

Therefore, the initial measurement is performed the first time the glove equipped with the input device is used. According to the instructions on the screen, the user's fingers are bent to approximately 90 °, and the measured values of the first to fourth reflected light sensors 11 to 14 are read again while the fingers are completely pinned. Then, the left, right, and right movements of the thumb, the index finger, and the hand are measured by the fifth to seventh reflected light sensors 15 to 17 in order, and the respective key positions are set by interpolation by comparing the data with reference data values.

In addition, it is adjusted according to the learning principle of the key size and the arrangement position which are adapted to the worker's typing habits.

Arbitrary key center position in reference coordinate in virtual space Lago center location When a circle having a radius r in E is a key size, the position of the key center is defined as shown in Equation 2 when updated by a new input x corresponding to the key.

Where i is the learning order and x (i) is the key position value, α, Is appropriately selected as the learning gain. Based on this result, each key center position , Radius of each key found and memorized , By the keyboard in the virtual space is reconstructed and drawn. If two adjacent key sizes overlap and satisfy Equation 3,

The radius of each key , Is corrected by Equation 4.

This algorithm gradually corrects the position and size of successful keystrokes, thereby keeping track of the typewriter's hand shape and the temporal transition of input habits.

For example, when the letter S is input, a key of any key size area r including the entire position of the finger stored in the past S letter is drawn in the virtual keyboard and is recognized as a typo when it is out of the area. If you enter the letter in the range, it is recognized as the letter S and printed on the screen. The predicted position and area size for the S letter are updated to be used for the next input judgment.

Figure 9 is a state diagram showing a state installed in the ring as an input device by the movement of the finger according to the present invention.

As shown here, the ring type is equipped with a variety of sensors in the ring that can be put each finger at a time and the ring 130 to be fitted to each finger is connected to each other by a band 135 is configured to facilitate wearing and ring ( 130 is a built-in bending sensor 10, key-in sensor 30 and a filter and amplifier for filtering and amplifying the signals of each sensor.

In addition, the controller 60, in which the rotation amount detecting unit 80, the movement amount detecting unit 90, the processor 61, and the interface unit 62 are embedded, is connected to the detection, middle finger, and ring finger.

Figure 10 is a block diagram showing a state formed in the ring as an input device by the movement of the finger according to the present invention.

Arrangement of the bending detection sensor 10, the open detection sensor 20 and the key-in detection sensor 30 is the same as the glove type shown in Figure 1 detection, middle finger, ring finger, holding the third joint of the second joint under the finger First to fourth reflective light sensors 11 to 14 are provided for detecting a change in distance caused by bending, and a fifth reflective light sensor 15 for measuring the distance between the second node and the index finger is provided on the thumb. The sixth reflected light sensor 16 for measuring the distance is installed, and the seventh reflected light sensor 17 for measuring the distance between the ring finger and the base is installed, and a total of seven reflected light sensors are mounted.

The major difference from the armored type is that the first to fifth shock sensors 31 'to 35' are built in as the key-in sensor 30 on each ring 130, and the same configuration is used to detect the typing shock of the finger. The movement of the finger is detected.

Therefore, the principle of the ring keyboard is the same principle as the armored keyboard, but the part that detects the press of the key is not a touch sensor attached to the fingertips, but a ring fitted to the third joint to detect the up and down impact on the third segment of the finger. A shock sensor for detecting a shock generated when a key is pressed in 130 is disposed to generate a key press signal.

Since the impact sensor is a beam-type or spring-type sensor with a mass body, the mass body moves downward by using the inertia during key press operation to turn on a contact or generate a signal by a change in capacitance or a Hall element.

The ring-type keyboard has the same skill / expert / key setting mode conversion method, but the general mode / special key input mode / numeric key input mode within the aforementioned mode can be set in the same way as the mode switching method in the armor type. .

Further, in the ring type, the mode can be switched by pressing the mode change key 140 attached to the ring 130 of the index finger.

Thus, when using the mode conversion key 140 in the table shown in Figure 4 the signal can be operated by the mode conversion key 140 attached to the ring 130, the signal is generated by the impact sensor It shows the state.

Figure 11 is a state diagram showing a state installed in the box on which the hand can be placed as an input device by the movement of the finger according to the present invention.

As shown here, in the box 170 on which the hand can be placed, various sensors are installed in accordance with the position of each finger, and the box is configured to be worn by the band, and the finger on the top of the box 170. The second bend detection sensor 181 for detecting the shank movement of the third node of the finger in accordance with the position of the first bend, and the first bend detection sensor for detecting the forward and backward movement of the finger tip in accordance with the position of the finger in the front lower part ( 180).

At this time, the second bending detection sensor 181 installed on the upper side detects that the third node of the finger moves up and down on the box 170 as the optical sensor, and the first bending detection sensor 180 installed on the lower side is the optical sensor. As a result, the front and rear movements of the fingertips of the box 170 are detected.

In addition, a key-in detection sensor 190 is installed deeper than the light receiving unit of the first bend detection sensor 180 at the bottom of the box 170 so that the reflected light does not come in when the fingertip does not touch the floor and only the bending operation is performed. Only when it touches the floor, the reflected light enters.

At this time, the key-in detection sensor 190 to detect the light emission signal of the bending detection sensor installed in the lower portion using only the light receiving unit.

In addition, the hand rotation sensor 200 and the hand movement sensor 210 is installed in the box 170.

Here, a gyroscope, an acceleration sensor, or an optical mouse sensor were used as the hand rotation sensor 200 and the hand movement sensor 210.

In this case, when using a gyroscope and an acceleration sensor, the same principle as in a glove type, and when using an optical mouse sensor in the lower portion of the box 170 as a signal for detecting the amount of hand rotation and movement in the keyboard mode, the mouse In mode, you can use the pointer as a moving signal.

The control unit is installed in the box 170.

12 is a plan view showing a state installed in a box on which a hand can be placed as an input device by a finger movement according to the present invention.

As shown here, the first to second bend detection sensors 180 and 181 are installed to match the finger position, and the hand rotation detection sensor 200 and the hand movement detection sensor 210 are placed on the hand. Is installed.

By installing the first to second bend detection sensors 180, 181 on the upper and lower portions of the box 170 as described above, the bending of the second joint of each finger causes the first joint to bend and accordingly the first node A change in distance occurs and is detected by the first bending sensor 180. At this time, since the bending of the third joint occurs together, the third node moves up and down and is detected by the second bending detection sensor 181.

As described above, the first to second bend detection sensors 180 and 181 are detected in a complex manner to remove the nonlinearity of the optical sensor so that the amount of bending of the hand can be determined more accurately and easily.

That is, as the distance of the fingertip is farther from the first bend detection sensor 180, the change of the output value of the first bend detection sensor 180 according to the distance change becomes very small and the change of the output value of the second bend detection sensor 181. Because of the large size, the output value of the first bending amount sensor 180 is used when the keys of the lower row of the keyboard are input, and the output value of the second bending detection sensor 181 is used when the keys of the upper row are input.

Thus, when positioning the fingers, the bending amount of the third joint as well as the second joint was considered.

In the present embodiment, only the keyboard and the mouse have been described, but the same can be used for input devices such as a portable PC, a wearable PC, a PDA, a mobile phone, an entertainment game machine, a calculator, and a virtual instrument having an input device inputted through the movement of a finger. .

As described above, the present invention has the advantages of being compact and lightweight, easy to carry, relatively simple in structure, high in product reliability, easy to mass-produce, and low in price.

In addition, all the text input and mouse input functions are realized through the keyboard by operating the keyboard and the mouse by moving a finger, so it is not tiring to input a large amount of documents and does not give a feeling of rejection to the user. There is also an advantage that does not require training.

In addition, the virtual keyboard and the movement of the finger floated on the screen to visually display the typing or mouse operations, and when the key is pressed by the short beep sound, there is an advantage to feel the input keyboard feel like tapping the real keyboard .

In addition, the learning process of reconfiguring the size and position of the keys by recognizing various user input patterns enables the user to perform convenient and less typographical input without the inconvenience of adapting the keyboard to the size and position of the keys. There is an advantage to that.

In addition, there is an advantage that can reduce the power consumption by scanning and detecting the respective sensors for detecting the movement of the finger and hand.

In addition, the input device by the finger movement has the advantage that it can be configured as an input device in a special environment or field can be configured in the armored, ring-shaped, box-type input device.

On the other hand, in addition to the keyboard function there is an advantage that can be applied to input devices in various fields such as game consoles and virtual reality.

1 is a configuration diagram showing a state installed in the glove as an input device by the movement of the finger according to the present invention.

Figure 2 is a block diagram showing an input device by the movement of the finger according to the present invention.

3 is a view showing the input state by the input device by the movement of the finger according to the present invention.

4 is a table showing a mapping relationship between a position signal of a finger of a input device and a key caused by the movement of a finger according to the present invention.

5 is a view showing a state in which the operation of the mouse mode of the input device by the movement of the finger according to the present invention.

6 to 8 are views illustrating an operation state of a sensor for measuring the movement of a finger in an input device caused by the movement of a finger according to the present invention.

Figure 9 is a state diagram showing a state installed in the ring as an input device by the movement of the finger according to the present invention.

Figure 10 is a block diagram showing a state formed in the ring as an input device by the movement of the finger according to the present invention.

Figure 11 is a state diagram showing a state installed in the box on which the hand can be placed as an input device by the movement of the finger according to the present invention.

12 is a plan view showing a state installed in a box on which a hand can be placed as an input device by a finger movement according to the present invention.

   -Explanation of symbols for the main parts of the drawings-

10: bending detection sensor 11 to 17: first to seventh reflection light sensor

20: gap detection sensor 30: key detection sensor

31 to 35: first to fifth touch sensors

31 'to 35': First to fifth shock sensor

40: gyroscope 50: acceleration sensor

60: control unit 61: processor

62: interface unit 63: power supply

70: bending amount detection unit 71: Demux

72: pulse generator 73,81,91: first to third filter

74,82,92: first to third amplifiers

76,83,97: First to Third A / D Converters

75: mux 80: rotation amount detection unit

90: movement detection unit 93: speed drift correction

94,96: 1st to 2nd integrator

95: acceleration drift correction unit 100: data processing unit

101: position signal processing unit 102: key in signal processing unit

103: mode conversion unit 104: learning algorithm unit

105: mouse mode unit 110: keyboard mode unit

111: display unit 112: key table unit

120: Gloves 130: Ring

135: band 140: mode conversion key

150: monitor 161: third joint

162: second joint 163: first joint

170: box

180, 181: first to second bend detection sensor

190: key detection sensor 200: hand rotation detection sensor

210: hand movement sensor

Claims (13)

A box where you can put your hands on, A second bend detection sensor installed at an upper portion of the box to detect a shank movement of a third node of the finger according to the position of the finger; A first bend detection sensor installed at the front lower part of the box to detect forward and backward movement of the fingertip according to the position of the finger; A key-in detection sensor installed deeper than the first bending detection sensor in the lower part of the box and detecting a reflected signal of the first bending detection sensor when the fingertip touches the floor; A hand rotation sensor installed in the box to detect rotation of the whole hand; A hand movement sensor installed in the box to detect the up, down, left and right positions of the whole hand; Control unit for sequentially scanning the values of the first bend detection sensor, the second bend detection sensor, the key-in detection sensor, the hand rotation detection sensor and the hand movement detection sensor and output them to an external device Input device by the movement of the finger, characterized in that consisting of. The method of claim 1, wherein the control unit A bend detection unit for measuring a bend amount of a hand and a gap of a finger by receiving a signal by sequentially selecting a first bend detection sensor and a second bend detection sensor by a mux / demux by a pulse driving method; Rotation amount detection unit for inputting the value of the hand rotation sensor to measure the amount of rotation of the hand, A movement amount detecting unit for measuring the amount of movement of the hand up, down, left, and right by receiving the value of the hand movement sensor; A processor for encapsulating and transmitting the output data of the bend amount detection unit, the rotation amount detection unit, the movement amount detection unit, and the key-in detection sensor; Interface unit for making serial / parallel data signals and outputting them to the data processing unit of external devices Input device by the movement of the finger, characterized in that consisting of. delete delete delete delete According to claim 1, wherein the hand rotation sensor is made of a single axis gyroscope for detecting the rotation of the hand on the working plane of the hand, The hand movement sensor is a 2-axis acceleration sensor for detecting the position of the hand up, down, left and right on the work plane of the hand Input device by the movement of the finger, characterized in that consisting of The method of claim 2, wherein the data processing unit A position signal processor for processing values of the bend amount detection unit, the rotation amount detection unit, and the movement amount detection unit received from the control unit; A key-in signal processor for receiving and processing a value of the key-in sensor; A mode conversion unit which transmits / receives to and receives mode from the key-in signal processing unit and the position signal processing unit; A learning algorithm for virtually rearranging key arrangements according to user's hand dimensions or habits in order to increase the input success rate when the keyboard functions according to the value processed by the position signal processor; A mouse mode unit configured to perform a mouse function according to the value processed by the position signal processor; Keyboard mode unit for outputting and displaying characters corresponding to the position of the hand and the selected key value input by the learning algorithm Input device by the movement of the finger, characterized in that consisting of. Continuously scanning and inputting values of the first bend detection sensor, the second bend detection sensor, the key in detection sensor, the hand rotation detection sensor, and the hand movement detection sensor; Determining the function setting data and the key data in the input value; In case of function setting data, switching the mouse mode or the keyboard mode for the input value into the expert mode, the non-skilled mode, and the key setting mode; After the function setting is completed, determining the position of the finger according to the set function according to the input value and outputting the key value of the corresponding finger. Input method by the movement of the finger, characterized in that consisting of. 10. The method according to claim 9, wherein in the non-skilled user mode, whether the user is typing using all fingers or typing using only a specific finger, the hand motion and shape are separated from the bend sensor through the signal analysis of the key-in sensor. And determining whether to use a signal of a hand sensor or a hand movement sensor to measure the amount of rotation of the hand. 4. 10. The input method according to claim 9, wherein the mode changeover is switched by a selective manipulation of a key-in sensor or a mode changeover key. The method of claim 9, wherein the mouse mode is The vertical movement signal is realized by at least one of the bending motion of the index finger and the shank motion signal of the hand position sensor, and the thumb movement and the left and right movement signals of the hand position sensor and the rotation of the hand rotation sensor are realized. The input method according to the movement of a finger, characterized in that the left and right movement signals are realized by at least one of the signals. 10. The method of claim 9, further comprising: displaying a work word window and a virtual keyboard on the work screen of the monitor and a finger position on the virtual keyboard to visually display a state in which a key is pressed and to output a short sound at the same time. Characterized by the movement of the finger input method.