JP2010238208A - Input device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an input device for accurately outputting a desired input code even when the initial position of a finger is different. <P>SOLUTION: An input device for outputting an input code corresponding to the spacial operation of the finger is provided with: a detection means mounted on the mounting part of the finger or hand of a user for detecting an operation signal changing according to the spatial operation of the finger; an initial position input means to be used for inputting the presence of the finger at an initial position; and a code output means for, on the basis of the detected operation signal and the input initial position, outputting an input code corresponding to an operation signal from the input initial position. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention belongs to the technical field of input devices, and more specifically, an input device that detects an operation signal that changes with spatial movement of a finger and outputs an input code corresponding to the detected operation signal. Belongs to the technical field.

  2. Description of the Related Art A computer device or the like uses a keyboard on which keys operated by a finger corresponding to each character are arranged as an input device for inputting characters such as alphabets. This keyboard requires a space for its arrangement, and it is desired to reduce the size of the keyboard from the viewpoint of space saving. However, considering that the keyboard keys are operated by fingers, there is a limit to downsizing the keyboard from the viewpoint of operability.

  Therefore, a virtual keyboard device that does not require a space for keyboard layout has been proposed as an input device. In this type of keyboard device, a sensor is attached to a finger, a spatial motion of the finger is detected by the sensor, and an input code corresponding to an operation signal indicating the detected motion is output. Conventional techniques relating to such a virtual keyboard device are described in, for example, Patent Documents 1 to 3 below.

  In the virtual keyboard device described in Patent Document 1, a ring-type sensor is attached to a finger, and an impact or the like when a supporting object such as a desk is hit with a fingertip is detected by the sensor. Based on the detection signal from the sensor, the character or action to be input by the finger is recognized.

  In a data input device for a person with limited hand functions described in Patent Document 2, a glove having a bending sensor for detecting the movement of a finger is attached to the hand, and the bending sensor corresponding to the movement of the finger is used. Based on this detection signal, the movement of the finger is recognized as a key input of the keyboard.

  In the virtual keyboard device described in Patent Document 3, the glove device worn on the hand indirectly detects the bending state of the joint of each finger of the operator using the amount of light of the embedded optical fiber, and further The detection device disposed on the desk detects a change in the magnetic field to detect which of the left and right hands has moved. Then, based on detection signals from the globe device and the detection device, it is determined which of the virtual keys has been operated with the finger.

JP-A-7-121294 Japanese Patent Application No. 2004-528660 (Japanese Patent Publication No. 2006-503350) Japanese Patent Laid-Open No. 5-289972

  In the virtual keyboard device described in Patent Literature 1 to Patent Literature 3, the initial position of the finger may be different depending on the operator, and the initial position of the finger may be different for each operation even for the same operator. is there. As described above, when the key input operation of the virtual keyboard device is performed in a state where the initial positions of the fingers are different, there is a problem that an accurate key input operation cannot be performed.

  The present invention has been made in view of the above-described problems and the like, and an example of the purpose is an input that can accurately output a desired input code even when the initial position of a finger changes. To provide an apparatus.

  In order to solve the above-described problem, the invention according to claim 1 is an input device that outputs an input code corresponding to a spatial movement of a finger, and is mounted on a user's finger or hand mounting portion. Detecting means for detecting an operation signal that changes with spatial movement of a finger; initial position input means used for inputting that the finger is in an initial position; the detected operation signal; An input device comprising: code output means for outputting the input code corresponding to the operation signal from the input initial position based on the input initial position.

  In order to solve the above-mentioned problem, the invention according to claim 2 is the input device according to claim 1, wherein the initial position input means includes an initial position input switch for a right hand and an initial position for a left hand. The initial position input switch for the right hand is disposed at a position that can be pressed with the left hand, and the initial position input switch for the left hand is disposed at a position that can be pressed with the right hand. Is an input device.

  In order to solve the above-mentioned problem, the invention according to claim 3 is the input device according to claim 1, wherein the input device is preset for the other hand with the finger of one hand placed in the initial position. The input device is characterized in that the initial position input means inputs that the finger of the one hand is in an initial position by executing a hand motion representing an initial position.

  In order to solve the above-mentioned problem, the invention according to claim 4 is the input device according to any one of claims 1 to 3, wherein the operation signal from the reference initial position of the finger is Storage means for storing pattern information indicating a finger motion signal pattern, the code output means, the initial position input by the initial position input means, the motion signal detected by the detection means, The input device outputs the input code corresponding to the detected operation signal based on the pattern information stored in the storage means.

  In order to solve the above-mentioned problem, the invention according to claim 5 is the input device according to claim 4, wherein the code output means detects the detection based on a difference between the reference initial position and the initial position. An input device that corrects the operation signal detected by the means, compares the corrected operation signal with the operation signal corresponding to the stored pattern information, and outputs the input code. It is.

  In order to solve the above-mentioned problem, the invention according to claim 6 is the input device according to claim 4, wherein the code output means stores the memory based on a difference between the reference initial position and the initial position. An input device that corrects the pattern information that has been corrected, compares the operation signal corresponding to the corrected pattern information with the operation signal detected by the detection means, and outputs the input code. is there.

  In order to solve the above-mentioned problem, the invention according to claim 7 is the input device according to any one of claims 1 to 6, wherein the detection means is mounted with the detection means. An input device that detects the motion signal by detecting an acceleration generated in the mounting portion by the movement of the finger for each of an X axis, a Y axis, and a Z axis that are set in advance for the mounting portion. .

  According to the first aspect of the present invention, when it is input that the finger is in the initial position, the operation signal from the input initial position is based on the input initial position and the detected operation signal. Therefore, even if the initial position of the finger is different, the desired input code can be output accurately.

  According to the invention described in claim 2, in addition to the effect described in claim 1, the initial position input switch for the right hand is disposed at a position where it can be pressed with the left hand, and the initial position input switch for the left hand is Therefore, the initial position can be easily input by the right-hand initial position input switch and the left-hand initial position input switch.

  According to the invention described in claim 3, in addition to the effect described in claim 1, the hand representing the initial position preset for the other hand in a state where the finger of one hand is placed at the initial position. By executing the operation, the initial position input means can easily input the initial position.

  According to the invention described in claim 4, in addition to the effect described in any one of claims 1 to 3, when it is input that the finger is in the initial position, the input initial position and Based on the detected motion signal and the stored pattern information, an input code corresponding to the motion signal from the input initial position is output, so even if the initial position is different, the desired input code Can be output accurately.

  According to the fifth aspect of the invention, in addition to the effect of the fourth aspect, the operation signal detected by the detecting means is corrected based on the difference between the reference initial position and the initial position, and the corrected Since the input code is output by comparing the operation signal with the operation signal corresponding to the pattern information, the input code corresponding to the operation signal from the initial position can be output accurately.

  According to the invention described in claim 6, in addition to the effect described in claim 4, the pattern information is corrected based on the difference between the reference initial position and the initial position, and the operation corresponds to the corrected pattern information. Since the input code is output by comparing the signal and the operation signal detected by the detection means, the input code corresponding to the operation signal from the initial position can be output accurately.

  According to the seventh aspect of the present invention, in addition to the effect of any one of the first to sixth aspects, the triaxial acceleration associated with the movement of the finger is detected and the movement signal of the finger is detected. Therefore, the operation signal can be accurately detected for each finger.

It is a figure which shows the structure of a virtual keyboard apparatus. It is a figure which shows the other structure of a virtual keyboard apparatus. It is a figure which shows a finger sensor. It is a graph which shows the example of the output voltage of the finger sensor in a stationary state. It is a graph which shows the output voltage of the finger sensor at the time of key depression. It is a figure which shows the structure of the input code output part containing a pattern judgment part. It is a flowchart figure which shows learning operation | movement of a virtual keyboard apparatus. It is a figure which shows the system containing a virtual keyboard apparatus. It is a figure which shows the virtual keyboard apparatus by embodiment of this application. It is a figure which shows the whole structure of the virtual keyboard apparatus by embodiment of this application. It is the figure which looked at the hand and the virtual keyboard from the side. It is the figure which looked at the hand and two virtual keyboards from the side. It is the figure which looked at two hands and two virtual keyboards from the side. It is the figure which looked at the hand and virtual keyboard in a vertical state from the side. It is a graph which shows the output voltage of the finger sensor in a stationary state when a hand and a virtual keyboard are vertical. FIG. 6 is a graph showing the output voltage when the virtual keyboard is at the actual initial position and the output voltage when the virtual keyboard is at the reference initial position.

  Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. The embodiment described below is an embodiment when the present invention is applied to a virtual keyboard device.

Outline of Virtual Keyboard Device According to Embodiment of Present Application First, an outline of a virtual keyboard device will be described.

  FIG. 1 shows the configuration of the virtual keyboard device. In FIG. 1, finger sensors 16-1 to 16-5 and 16-are respectively attached to the fingers 14-1 to 14-5 and 14-6 to 14-10 of the left hand 10 </ b> L and the right hand 10 </ b> R as the user's wearing parts. 6 to 16-10 are installed. The finger sensor 16 is a sensor that detects an operation signal that changes in accordance with the spatial motion of the finger, and includes, for example, an acceleration sensor or a gyro sensor. Details of the finger sensor 16 will be described later. For example, the backs of the left hand 10L and the right hand 10R are equipped with data collection units 18 and 20, respectively. The data collection units 18 and 20 have finger sensors 16-1 to 16-5 and 16-6 to 16 respectively. The operation signal from −10 is supplied via the harnesses 22-1 to 22-5 and 22-6 to 22-10. The data collection units 18 and 20 have radio units 24 and 26, respectively, and operation signals from the radio units 24 and 26 are received by the radio unit 30 of the input code output unit 28. The operation signals collected by the data collection units 18 and 20 may be received by the input code output unit 28 via a wire (harness).

  The input code output unit 28 includes an operation pattern dictionary unit 32 and an operation pattern determination unit 34 in addition to the radio unit 30. The motion pattern dictionary unit 32 is a storage unit that stores pattern information indicating patterns of finger motion signals. The motion pattern determination unit 34 compares the motion signal corresponding to the pattern information stored in the motion pattern dictionary unit 32 with the motion signal supplied from the wireless unit 30 and corresponds to the detected motion signal. Output the input code. The output input code is transmitted from the wireless unit 36 provided in the input code output unit 28 to the wireless unit 40 of the character display 38. The character display 38 has a display unit 42, and a character code 44, for example, is displayed on the display unit 42 as an input code input by the operation of a finger. Also in this case, the input code output unit 28 and the character display 38 may be connected by wire (harness) and communicated.

  FIG. 2 shows another configuration of the virtual keyboard device. In the configuration of FIG. 1, the data collection units 18 and 20 are attached to the left hand 10L and the right hand 10R, respectively. However, in the configuration of FIG. 2, no data collection unit is provided. The operation signals from the finger sensors 16-1 to 16-5 and 16-6 to 16-10 are input to the input code output unit 28 via the harnesses 22-1 to 22-5 and 22-6 to 22-10. Is supplied to the operation pattern determination unit 34.

  FIG. 3 shows an acceleration sensor as an example of the finger sensor 16. In FIG. 3, the finger sensor 16 is a three-axis acceleration sensor, and detects acceleration due to the movement of the finger for each of the X axis, the Y axis, and the Z axis. The Z axis indicates the direction 44 of gravitational acceleration.

  FIG. 4 shows an example of the output voltage of the finger sensor 16 when the finger is stationary. In FIG. 4, it can be seen that the output voltage in the Z-axis direction differs from the output voltage in the X-axis direction and the Y-axis direction by the gravitational acceleration (see reference numeral 46).

  FIG. 5 shows the output voltage of the finger sensor 16 when the key is depressed in the space. FIG. 5 shows the output voltage of the finger sensor when the finger of the left hand 10L is operated so as to push down the letter Q key on the virtual keyboard. The key layout of the virtual keyboard according to the present invention adopts the JIS layout. The upper, middle, and lower graphs in FIG. 5 show the X-axis direction, the Y-axis direction, and the Z-axis direction of the acceleration sensors attached to the little finger 14-5, the ring finger 14-4, and the thumb 14-1, respectively. Indicates the output voltage. The output voltages in the X-axis direction, the Y-axis direction, and the Z-axis direction of acceleration sensors mounted on other fingers are not shown. In FIG. 5, when the key of the letter Q is depressed (see the time indicated by reference numeral 48), the little finger 14-5 moves greatly, that is, as shown in the upper part of FIG. The change in the output voltage in the X-axis direction, the Y-axis direction, and the Z-axis direction of the acceleration sensor attached to 5 is changed in the X-axis direction, the Y-axis direction, and the Z-axis direction of the acceleration sensor attached to another finger. It can be seen that it is larger than the change in the output voltage.

  FIG. 6 shows a configuration of an input code output unit including the operation pattern determination unit 34. In FIG. 6, for example, considering the left hand, a finger sensor 16 is attached to each of the fingers 14, and one finger sensor 16 outputs three axis (X axis, Y axis, and Z axis) operation signals. Therefore, 5 × 3 = 15 operation signals 50 are supplied to the operation pattern determination unit 34. Learning is performed by mapping 15 motion signals 50, that is, 15 data, to each character 52 using a neural network, and a dictionary pattern in the motion pattern dictionary unit 32 is created or updated. This learning operation will be described with reference to FIG.

  FIG. 7 shows a flowchart showing the learning operation of the virtual keyboard device. In FIG. 7, in step S10, the power is turned on. In step S11-1, a hand is placed at the initial position and an initial position setting signal is input. In step S11-2, calibration is performed, and the process proceeds to step S12. In addition, these step S11-1 and step S11-2 show operation | movement of the virtual keyboard apparatus by embodiment of this application, and the detail of the virtual keyboard apparatus by embodiment of this application is mentioned later. If the learning mode is determined by the input operator in step S12, the process proceeds to step S14 to connect the keyboard to the input code output unit 28 (see FIGS. 1 and 2). In step S16, the keyboard is pressed. In step S18, acceleration data of the finger sensor 16 at the time of key pressing is read. In step S20, data processing of a required portion of the acceleration data (for example, within ± 500 ms from the change point of the acceleration data). Data processing). In step S22, learning is performed with a neural network. In step S24, a new dictionary pattern is constructed. In step S26, if the input operator does not finish learning, the process returns to step S16. In step S26, the input operator determines If learning ends, the process proceeds to step S28. If it is determined in step S12 that the learning mode is not determined by the input operator, the process proceeds to step S28.

  In step S28, the acceleration data of the finger sensor is read, and in step S30, the acceleration data is compared with the data table value to determine whether or not the hand or finger has moved. If NO in step S30, the process returns to step S28. If YES in step S30, the process proceeds to step S32, and data processing at a required portion of the acceleration data (for example, data processing within ± 500 ms from the change point of the finger sensor). I do. In step S34, the finger movement based on the acceleration data is compared with a dictionary pattern held as a database. In step S36, an input code corresponding to the closest input code is output. In step S38, the input code is The data is transmitted to a character output device such as a personal computer, and the process proceeds to step S40.

  If it is determined in step S40 that the input operator does not continue the input, the power is turned off in step S42. If the input operator continues the input in step S40, the process proceeds to step S44. In step S44, if the input operator views the display screen 60 (see FIG. 8 to be described later) and correct character input is performed based on the determination of the input operator, the process proceeds to step S28, while step S44 is performed. If the input operator sees the display screen 60 (see FIG. 8 to be described later) and the input operator has not made an accurate character input, the process proceeds to step S11-1.

  In the flowchart of FIG. 7, the determination of the input operator in steps S12, S26, S40, and S44 will be described. An operation button is provided in the data collection unit 18 or 20, and the input operator (that is, the user) The operation corresponding to the determination is performed on the operation button, and the virtual keyboard device performs the determination according to the operation performed on the operation button.

  FIG. 8 shows a system including a virtual keyboard device. In FIG. 8, the motion signal from the finger sensor 16 attached to each finger is supplied to the motion pattern determination unit 34, and the motion pattern determination unit 34 receives the motion signal from the finger sensor 16 and the motion pattern dictionary unit 32. Are compared with the operation signal corresponding to the pattern information stored therein, and an input code corresponding to the detected operation signal is supplied to the personal computer 56. The personal computer 56 outputs the input code to the display device 58 so that a character 59, for example, a column 59 of A, B, C,... Is displayed on the display screen 60 of the display device 58. .

Details of Virtual Keyboard Device According to Embodiment of Present Application In the above-described virtual keyboard device, the motion pattern dictionary unit 32 (see FIGS. 1 and 2) receives the motion signal from the reference initial position of the finger as the motion signal of the finger. Is stored as pattern information indicating the pattern. The motion pattern determination unit 34 (see FIGS. 1, 2, and 6) includes an operation signal corresponding to the pattern information stored in the motion pattern dictionary unit 32, and an operation signal from the finger sensor 16 attached to the finger. And an input code corresponding to the operation signal is output. Here, the initial position of the finger may differ from the reference initial position depending on the operator, and even for the same operator, the initial position of the finger may differ from the reference initial position for each operation. If the key input operation of the virtual keyboard device is performed in such a state where the initial position of the finger is different from the reference initial position, an accurate key input operation cannot be performed.

  Therefore, in the virtual keyboard device according to the embodiment of the present application, as shown in FIG. 9, an initial position input switch 62 used for inputting that the finger is in the initial position is attached to the finger. The initial position input switch 62 is, for example, a push-down switch, and the initial position input switch 62 attached to the right hand 10R is replaced with the left hand, which is the other hand, with the finger of the right hand 10R placed at the initial position. The initial position input switch 62 is operated by a pressing operation with a finger. Further, as the initial position input means, the present invention can be implemented even with another configuration other than the initial position input switch 62. For example, in the state where the finger of the right hand 10R is placed at the initial position, It is also possible to perform initial position input by executing a hand motion representing a preset initial position. As a configuration for connecting the initial position input switch 62 and the finger sensors 16-6 to 16-10 to the input code output unit 28, a configuration using the harness 22, the data collection unit 20, and the like (see FIG. 1). (See FIG. 2). Alternatively, it is possible to implement any of the configurations using only the harness 22 and not using the data collection unit (see FIG. 2). Note that the data can be supplied wirelessly instead of a harness (wired). The input code output unit 28 is based on the finger motion signal detected by the finger sensor 16, the initial position signal from the initial position input switch 62, and the pattern information stored in the motion pattern dictionary unit 32. An input code corresponding to the finger movement signal from the input initial position can be output.

  Thus, in the virtual keyboard device according to the embodiment of the present application, the actual initial position based on the detected finger motion signal, the initial position signal from the initial position input switch 62, and the stored pattern information. Therefore, even if the actual initial position is different from the reference initial position, the desired input code can be output accurately.

  Next, the operation of the virtual keyboard device according to the embodiment of the present application will be described. In the following description, a configuration using the harness 22 and the data collection units 18 and 20 (see FIG. 1) is employed as a configuration for connecting the initial position input switch and the finger sensor to the input code output unit. It is description of operation | movement of a virtual keyboard apparatus.

  (1) First, with the finger sensors attached to the fingers of the left and right hands, place the hand at the initial position.

  (2) The initial position input switch 62 is operated. Alternatively, a hand motion representing a preset initial position is executed.

  (3) A signal from the initial position input switch 62 or hand movement data representing the initial position is supplied to the data collection unit 20 via the harness 22.

  (4) Data is transmitted from the data collection unit 20 to the input code output unit 28 by wireless / wired. The operation pattern determination unit 34 in the input code output unit 28 determines the state of the hand (shape, installation state) and the like based on the received data.

  (5) In the operation pattern determination unit 34, a virtual keyboard plane is virtually formed so that the virtual keyboard is arranged on the plane of the finger based on the determined hand, and this virtual keyboard plane is held as a database. The operation pattern dictionary 32 is associated. In this way, the initial position setting is completed.

  (6) In the subsequent input operation, the motion pattern determination unit 34 compares the finger motion signal detected by the finger sensor 16 with the motion signal corresponding to the pattern information stored in the motion pattern dictionary unit 32. If the difference between the two is within a predetermined threshold, an input code corresponding to the detected finger movement signal is output and transmitted.

  (7) The transmitted input code is received by the display device 58, and characters corresponding to the input data are displayed.

  (8) While repeating the input operations (6) and (7) above, when the initial position of the finger is shifted and the number of erroneous inputs increases, notification means (for example, warning sound generation means, warning display) The input operator is prompted to set the initial position again. As described above, when the input operator prompts the input operator to set the initial position again, the process returns to (2).

  In the above description, the configuration using the harness 22 and the data collection unit 20 (see FIG. 1) is adopted as the configuration for connecting the initial position input switch 62 and the finger sensor 16 to the input code output unit 28. In this description, the initial position input switch 62 and the finger sensor 16 are connected to the input code output unit 28, and only the harness 22 is used and the data collection unit is not used. The present invention is also applied to a virtual keyboard device adopting (see FIG. 2). However, in this case, since the data collection unit is not used, the operations of (3) and (4) are described as follows: “The signal from the initial position input switch 62 or the data of the hand motion indicating the initial position is used as the harness 22. Is transmitted to the input code output unit 28. The operation pattern determination unit 34 in the input code output unit 28 determines the hand state (shape, installation state) and the like based on the received data. Become.

  Next, the virtual keyboard device according to the embodiment of the present application will be described in more detail with reference to FIGS. FIG. 10 shows the overall configuration of the virtual keyboard device according to the embodiment of the present application. In FIG. 10, the same members as those in FIG. In FIG. 10, the initial position input switch 64 described with reference to FIG. 9 is attached to the left hand 10L, and the same initial position input switch 62 is attached to the right hand 10R. The initial position input switches 62 and 64 are connected to the data collection units 20 and 18 via harnesses 22-11 and 22-12, respectively. In the virtual keyboard device, there is no actual keyboard, but for convenience of explanation, a virtual keyboard 66 is shown in FIG. In the virtual keyboard device, assuming such a virtual keyboard 66, an operation signal of the finger 14 is detected by the finger sensor 16, and an input code corresponding to an input key corresponding to the detected operation signal of the finger is output. . In FIG. 10, the fingers of the left hand 10L and the right hand 10R are in the initial positions, respectively, and input keys with white circles (for example, input keys with reference numeral 68) are moved by the fingers of the left hand 10L. On the other hand, an input key that is input is operated, and an input key that is circled with a diagonal line (for example, an input key that is denoted by reference numeral 70) is an input key that is input by a finger of the right hand 10R. is there.

  FIG. 11 is a side view of the hand and the virtual keyboard. In FIG. 11, the hand 10, the finger sensor 16, and the virtual keyboard 66 that does not exist are shown. Reference numeral 72 indicates the direction of gravity.

  FIG. 12 is a side view of the hand and two virtual keyboards. In FIG. 12, reference numeral 66L is a virtual keyboard for the left hand, and reference numeral 66R is a virtual keyboard for the right hand. When performing the input operation, the input key input by the left hand 10L and the input key input by the right hand 10R are divided as shown in FIG. Depending on the position, a left-hand virtual keyboard 66L and a right-hand virtual keyboard 66R can be set.

  FIG. 13 is a side view of two hands and two virtual keyboards. In FIG. 13, reference numeral 66L is a virtual keyboard for the left hand 10L, and reference numeral 66R is a virtual keyboard for the right hand 10R. is there. The virtual keyboard 66L indicated by the solid line is in the initial position serving as the reference for the left hand 10L, and the virtual keyboard 66R indicated by the solid line is in the initial position serving as the reference for the right hand 10R. Here, when the operator performs an input operation, the virtual keyboard for the left hand 10L and the right hand 10R may deviate from the initial position as a reference, and reference numerals 74L and 74R denote the actual values for the left hand 10L and the right hand 10R, respectively. Shows the virtual keyboard in the initial position.

  Since the actual initial position may deviate from the initial reference position as described above, in the virtual keyboard device according to the embodiment of the present application, the left and right hand fingers are in the initial position as shown in FIG. The initial position input switches 62 and 64 used for inputting the information are attached to the finger, the signals from the initial position input switches 62 and 64, the finger motion signal detected by the finger sensor 16, and the motion pattern Based on the pattern information stored in the dictionary unit 32, an input code corresponding to the finger motion signal is output to the virtual keyboards 74L and 74R at the actual initial position. Therefore, a desired input code can be accurately output even when the actual initial position is different.

  Here, when the hand 10 and the virtual keyboard 66 are in the state shown in FIG. 11, the output voltages in the X-axis, Y-axis, and Z-axis directions from the finger sensor 16 in the stationary state are shown in FIG. Has a waveform. On the other hand, when the hand 10 and the virtual keyboard 66 are in the state shown in FIG. 14, that is, when the hand 10 and the virtual keyboard 76 are in the vertical state, the X axis, Y axis, and The output voltage in the Z-axis direction has a waveform shown in FIG. In FIG. 15, the output voltage in the X-axis direction differs from the output voltage in the Y-axis direction and the Z-axis direction by the gravitational acceleration (see reference numeral 78).

  As described above, in the virtual keyboard device according to the embodiment of the present application, as shown in FIG. 10, signals from the initial position input switches 62 and 64, finger motion signals detected by the finger sensor 16, and motion patterns Based on the pattern information stored in the dictionary unit 32, an input code corresponding to the finger motion signal is output to the virtual keyboard 76 at the actual initial position. This process is performed by the operation pattern determination unit 34 in the input code output unit 28. Hereinafter, the process of the operation pattern determination unit 34 will be described.

  There are two types of correction processing as the correction processing of the operation pattern determination unit 34. In the first correction process, the detected finger motion signal is corrected based on the difference between the reference initial position and the actual initial position, and the corrected finger motion signal is converted into the motion pattern dictionary unit 32. This is a process of comparing with the operation signal corresponding to the pattern information stored in. As the second correction process, the pattern information stored in the motion pattern dictionary unit 32 is corrected based on the difference between the reference initial position and the actual initial position, and the corrected pattern information is handled. This is a process of comparing the motion signal with the motion signal of the detected finger. Hereinafter, the first process and the second process will be described. In the following description, the initial position serving as the reference of the virtual keyboard is the state shown in FIG. 11, and the actual initial position of the virtual keyboard is shown in FIG. Suppose that it is in a state.

  First, when the actual initial position of the virtual keyboard is in the state shown in FIG. 14, the output voltage is measured for the X-axis, Y-axis, and Z-axis data of the operation signal from the finger sensor 16. These X-axis, Y-axis, and Z-axis voltages are compared with the X-axis, Y-axis, and Z-axis data voltages when the virtual keyboard is at the reference initial position (FIG. 11). , The difference between the Y axis and the Z axis is obtained. Referring to FIG. 16, the graph on the left side of FIG. 16 shows the X-axis, Y-axis, and Z-axis from the finger sensor 16 when the virtual keyboard is in the actual initial position (ie, when in the state of FIG. 14). The output voltage is shown, which is similar to the graph of FIG. On the other hand, the graph on the right side of FIG. 16 shows the output voltages of the X-axis, Y-axis, and Z-axis from the finger sensor 16 when the virtual keyboard is the reference initial position (that is, when it is FIG. 11). This is the same as the graph of FIG. As can be seen from the comparison between the graph on the left side of FIG. 16 and the graph on the right side of FIG. 16, the output voltages on the Y axis are the same, but the output voltages on the X axis and the Z axis differ by differences DX and DZ, respectively. I understand that As described above, the difference between the reference initial position and the actual initial position is obtained.

  In the first correction process, in the subsequent input operation, the detected finger motion signal is corrected based on the difference between the reference initial position and the actual initial position, that is, the detected finger motion. For the signal, the Y-axis output voltage is not changed, and the differences DX and DZ are corrected (added) to the X-axis and Z-axis output voltages, respectively. Then, the corrected finger motion signal, that is, the unchanged Y-axis output voltage, and the X-axis and Z-axis output voltages in which the differences DX and DZ are corrected, are stored in the motion pattern dictionary unit 32. It compares with the output voltage of the X-axis, the Y-axis, and the Z-axis of the operation signal corresponding to the pattern information.

  On the other hand, in the second correction process, in the subsequent input operation, the pattern information stored in the operation pattern dictionary unit 32 is corrected based on the difference between the reference initial position and the actual initial position. For the operation signal corresponding to the pattern information stored in the operation pattern dictionary unit 32, the Y-axis output voltage is not changed, and the X-axis and Z-axis output voltages are corrected for the differences DX and DZ, respectively ( Subtract). Then, the operation signal corresponding to the corrected pattern information, that is, the unchanged Y-axis output voltage, the X-axis and Z-axis output voltages with the differences DX and DZ corrected, respectively, is detected. Are compared with the output voltages of the X-axis, Y-axis, and Z-axis of the operation signal.

  In the virtual keyboard device according to the embodiment of the present application, the motion pattern dictionary unit 32 stores the motion signal from the initial position serving as the finger reference as pattern information indicating the pattern of the finger motion signal. In other words, the motion pattern dictionary unit 32 stores one type of pattern information corresponding to the initial position serving as a reference for the finger. However, in the present application, the configuration of the motion pattern dictionary unit 32 is not limited to this, and the motion pattern dictionary unit 32 may be configured to store pattern information for each of a plurality of different initial positions. That is, a plurality of types of pattern information corresponding to a plurality of different initial positions are stored in the motion pattern dictionary unit 32, and the motion pattern determination unit 34 is input from the initial position input switches 62 and 64. Based on the initial position, pattern information corresponding to the input initial position is selected from a plurality of types of pattern information stored in the operation pattern dictionary unit 32, and an operation signal corresponding to the selected pattern information is detected. It is also possible to configure to compare with the generated operation signal.

  As described above, according to the virtual keyboard device according to the embodiment of the present application, when it is input that the finger is in the initial position, the input is performed based on the input initial position and the detected operation signal. Since the input code corresponding to the motion signal from the initial position is output, the desired input code can be output accurately even when the initial position of the finger is different.

  Further, in the virtual keyboard device according to the embodiment of the present application, the initial position input switch 62 for the right hand is disposed at a position where the left hand can be pressed, and the initial position input switch 64 for the left hand is positioned so as to be pressed with the right hand. Thus, the initial position input switch 62 for the right hand and the initial position input switch 64 for the left hand can be used to easily input the initial position.

  Further, in the virtual keyboard device according to the embodiment of the present application, the initial operation is performed by executing a hand motion representing a preset initial position for the other hand with a finger of the one hand placed at the initial position. The position input means can easily input the initial position.

  Further, in the virtual keyboard device according to the embodiment of the present application, when it is input that the finger is in the initial position, based on the input initial position, the detected operation signal, and the stored pattern information, Since the input code corresponding to the operation signal from the input initial position is output, the desired input code can be accurately output even when the initial position is different.

  Further, in the virtual keyboard device according to the embodiment of the present application, the operation signal detected by the detection unit is corrected based on the difference between the reference initial position and the initial position, and the operation corresponding to the corrected operation signal and pattern information is performed. Since the input code is output by comparing with the signal, the input code corresponding to the operation signal from the initial position can be output accurately.

  In the virtual keyboard device according to the embodiment of the present application, the pattern information is corrected based on the difference between the reference initial position and the initial position, and the operation signal corresponding to the corrected pattern information and the operation detected by the detection unit Since the input code is output by comparing with the signal, the input code corresponding to the operation signal from the initial position can be output accurately.

  Further, in the virtual keyboard device according to the embodiment of the present application, since the triaxial acceleration accompanying the finger motion is detected and the finger motion signal is detected, the motion signal can be accurately detected for each finger. it can.

  In the input device according to the embodiment of the present application, the finger of the hand is set as the mounting portion of the finger sensor 16, but the finger sensor 16 may be mounted on the back of the hand. Alternatively, the finger sensor 16 may be attached only to a specific finger that can detect the spatial movement of all the fingers without attaching the finger sensor 16 to all the fingers.

  As described above, the present invention can be used in the field of input devices, and particularly when applied to the field of input devices using a virtual keyboard, a particularly remarkable effect can be obtained.

10, 10L, 10R: hand 14, 14-1 to 14-10: finger 16, 16-1 to 16-10: finger sensor 28: input code output unit 32: operation pattern dictionary unit 34: operation pattern determination unit 36: Radio unit 62, 64: initial input switch

Claims (7)

In an input device that outputs an input code corresponding to the spatial movement of a finger,
A detecting means that is mounted on a user's finger or a hand mounting portion and detects an operation signal that changes with a spatial motion of the finger;
Initial position input means used to input that the finger is in an initial position;
Code output means for outputting the input code corresponding to the operation signal from the input initial position based on the detected operation signal and the input initial position. Input device. The input device according to claim 1,
The initial position input means comprises an initial position input switch for the right hand and an initial position input switch for the left hand,
The input device is characterized in that the initial position input switch for the right hand is disposed at a position that can be pressed with the left hand, and the initial position input switch for the left hand is disposed at a position that can be pressed with the right hand. The input device according to claim 1,
With the finger of one hand placed at the initial position, the initial position input means performs the operation of the hand representing the preset initial position for the other hand, so that the initial position input means An input device for inputting that is in an initial position. The input device according to any one of claims 1 to 3,
Storage means for storing the motion signal from the reference initial position of the finger as pattern information indicating a pattern of the motion signal of the finger;
The code output means is detected based on the initial position input by the initial position input means, the operation signal detected by the detection means, and pattern information stored in the storage means. An input device that outputs the input code corresponding to an operation signal. The input device according to claim 4,
The code output means corrects the operation signal detected by the detection means based on a difference between the reference initial position and the initial position, and corresponds to the corrected operation signal and the stored pattern information. An input device that compares the operation signal and outputs the input code. The input device according to claim 4,
The code output means corrects the stored pattern information based on a difference between the reference initial position and the initial position, and is detected by the operation signal corresponding to the corrected pattern information and the detection means. An input device that compares the operation signal and outputs the input code. The input device according to any one of claims 1 to 6,
The detection means detects an acceleration generated in the attachment portion by the movement of the finger for each of the X axis, the Y axis, and the Z axis that are set in advance for the attachment portion to which the detection means is attached. An input device for detecting an operation signal.

Images