JP2010277469A - Input device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an input device for facilitating input operation. <P>SOLUTION: The input device which detects a spatial operation of fingers to output an input code corresponding to the detected operation includes: detection means which are mounted on mounting parts of fingers or hands of the user to detect the operation of fingers; an output means which outputs an input code corresponding to the operation detected by the detection means; and display means which are mounted on fingers or hands relating to the mounting parts, on which the detection means are mounted, and display the input code output from the output means. The output means specifies candidates of the input code to be selected, on the basis of the operation detected by the detection means, and the display means display the specified candidates of the input code. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention belongs to the technical field of an input device, and more specifically, to the technical field of an input device that detects a spatial motion of a finger and outputs an input code corresponding to the detected motion.

  2. Description of the Related Art A computer device or the like uses a keyboard on which keys operated by a finger corresponding to each character are arranged as an input device for inputting characters such as alphabets. This keyboard requires a space for its arrangement, and it is desired to reduce the size of the keyboard from the viewpoint of space saving. However, considering that the keyboard keys are operated by fingers, there is a limit to downsizing the keyboard from the viewpoint of operability.

  Therefore, a virtual keyboard device that does not require a space for keyboard layout has been proposed as an input device. In this type of keyboard device, a sensor is attached to a finger, a spatial motion of the finger is detected by the sensor, and an input code corresponding to the detected motion is output. Conventional techniques relating to such a virtual keyboard device are described, for example, in Patent Documents 1 to 2 listed below.

  In Patent Literature 1, in a virtual keyboard device, a ring-type sensor is attached to a finger, and an impact or the like when a supporting object such as a desk is hit with a fingertip is detected by the sensor. Based on the detection signal from the sensor, the character or action to be input by the finger is recognized. Further, in Patent Document 2, in a data input device for humans with limited hand functions, a glove having a bending sensor for detecting finger movement is worn on the hand, and detection from the bending sensor corresponding to the finger movement is performed. Based on the signal, the movement of the finger is recognized as a key input of the keyboard.

JP-A-7-121294 Japanese Patent Application No. 2004-528660 (Japanese Patent Publication No. 2006-503350)

  In the virtual keyboard device disclosed in Patent Documents 1 and 2, since there is no actual keyboard, the input operator can display the input code that has been input on a display installed on a desk or the like. , Which input code is input cannot be recognized. For this reason, in particular, an input operation to the virtual keyboard device is difficult for an input operator who is not used to touch typing.

  The present invention has been made in view of the above-described problems and the like, and an example of the object is to provide an input device capable of easily performing an input operation.

  In order to solve the above problems, the invention according to claim 1 is directed to an input device that detects a spatial motion of a finger and outputs an input code corresponding to the detected motion. Detecting means for detecting the movement of the finger by being mounted on the mounting section, output means for outputting an input code corresponding to the motion detected by the detecting means, and the mounting section on which the detecting means is mounted Display means for displaying an input code output from the output means when worn on a finger or a hand according to the output means, wherein the output means is based on an action detected by the detection means. A candidate is specified, and the display means displays the specified input code candidate.

  In order to solve the above problem, the invention according to claim 2 is the input device according to claim 1, wherein the output means is a finger among keys of a keyboard pattern to be operated by a finger. An input code corresponding to a key set in advance is specified as a candidate of an input code to be selected, and the display means is configured to input an input code corresponding to the specified key set in advance for each finger. An input device that displays candidates.

  In order to solve the above-mentioned problem, the invention according to claim 3 is the input device according to claim 1 or 2, wherein the detection means is preset for the finger on which the detection means is mounted. An acceleration sensor that detects the motion by detecting an acceleration generated by the motion of the finger for each of the X axis, the Y axis, and the Z axis, and the output unit is configured to detect the motion detected by the acceleration sensor. An input device is characterized in that a candidate of an input code to be selected is specified based on a direction.

  In order to solve the above-described problem, the invention according to claim 4 is the input device according to any one of claims 1 to 3, wherein the display means displays the specified input code candidate. An input device that displays only for a preset time.

  In order to solve the above-mentioned problem, the invention according to claim 5 is the input device according to any one of claims 1 to 4, wherein the output means is an operation detected by the detection means. An input device is characterized in that an input code is determined from the identified input code candidates.

  In order to solve the above-mentioned problem, the invention according to claim 6 is the input device according to any one of claims 1 to 5, wherein the display means is attached to a finger or a hand. This is an input device.

  According to the first aspect of the present invention, since the input operator can recognize the input code candidate to be selected by looking at the display means attached to the finger or hand, the input operation can be easily performed. It can be carried out. In particular, an input operator who is not familiar with touch typing can easily perform an input operation.

  According to the invention described in claim 2, in addition to the effect of the invention described in claim 1, the input operator knows which key is input with which finger and which key is input before the operation. Can do.

  According to the invention described in claim 3, in addition to the effect of the invention described in claim 1 or 2, the output means is based on the detected motion directions of the X axis, the Y axis, and the Z axis. The input code candidate to be selected can be accurately specified.

  According to the invention described in claim 4, in addition to the effect of the invention described in any one of claims 1 to 3, the display means displays the specified input code candidates for a preset time. Since it is displayed, it is possible to prevent a situation in which unselected input code candidates are displayed unnecessarily for a long time.

  According to the invention described in claim 5, in addition to the effect of the invention described in any one of claims 1 to 4, since the input code is determined from the identified input code candidates, the input operator Can easily determine the input code.

  According to the invention described in claim 6, in addition to the effect of the invention described in any one of claims 1 to 5, the input operator looks at the display means mounted on the finger or hand. The input code candidate to be selected can be easily recognized.

It is a figure which shows the structure of a virtual keyboard apparatus. It is a figure which shows the other structure of a virtual keyboard apparatus. It is a figure which shows a finger sensor. It is a graph which shows the output voltage of the finger sensor in a stationary state. It is a graph which shows the output voltage of the finger sensor at the time of key depression. It is a figure which shows the structure of the input code output part containing a pattern judgment part. It is a flowchart figure which shows learning operation | movement of a virtual keyboard apparatus. It is a figure which shows the system containing a virtual keyboard apparatus. It is a figure which shows the state by which the finger sensor was mounted | worn with the finger | toe. It is a figure which shows the display with which the input device by embodiment of this application was mounted | worn with the back of the hand. It is a figure which shows the key pattern of a keyboard. It is a figure which shows the key which a left index finger takes charge of. It is a figure which shows the state which a left index finger moves. It is a figure which shows the state in which the candidate of two input codes is displayed on a display. It is a figure which shows the state which a left index finger moves further. It is a figure which shows the state in which the candidate of one input code is displayed on a display. It is a flowchart figure which shows the effect | action of the input device by embodiment of this application. It is a figure which shows the motion pattern at the time of a finger | toe moving to the left direction memorize | stored in the motion pattern dictionary part, (A) shows the motion pattern of an X 'axis direction, (B) is a Y' axis. The operation pattern of a direction is shown. It is a figure which shows the motion pattern at the time of a finger | toe moving rightward memorize | stored in the motion pattern dictionary part, (A) shows the motion pattern of X'-axis direction, (B) is Y'-axis The operation pattern of a direction is shown. It is a figure which shows the motion pattern at the time of a finger | toe moving straight ahead memorize | stored in the motion pattern dictionary part, (A) shows the motion pattern of an X 'axis direction, (B) is Y 'Show the movement pattern in the axial direction. It is a figure which shows the operation | movement pattern at the time of a finger | toe moving straight ahead, memorize | stored in the operation | movement pattern dictionary part, (A) shows the operation | movement pattern of X 'axis direction, (B) shows Y 'Show the movement pattern in the axial direction. It is a figure which shows the motion pattern at the time of a finger | toe moving to the left tip direction memorize | stored in the motion pattern dictionary part, (A) shows the motion pattern of X 'axis direction, (B) is Y 'Show the movement pattern in the axial direction. It is a figure which shows the operation | movement pattern at the time of a finger | toe moving rightward memorize | stored in the operation | movement pattern dictionary part, (A) shows the operation | movement pattern of X 'axis direction, (B) shows Y 'Show the movement pattern in the axial direction. It is a figure which shows the motion pattern at the time of a finger | toe moving to the left front direction memorize | stored in the motion pattern dictionary part, (A) shows the motion pattern of X'-axis direction, (B) is Y 'Show the movement pattern in the axial direction. It is a figure which shows the motion pattern at the time of a finger | toe moving to the right front direction memorize | stored in the motion pattern dictionary part, (A) shows the motion pattern of the X'-axis direction, (B) is Y 'Show the movement pattern in the axial direction. It is a figure which shows the motion pattern of the Z'-axis direction when the finger | toe performs click operation | movement memorize | stored in the motion pattern dictionary part. It is a flowchart figure which shows the detail of operation | movement of step S60 thru | or S62 of FIG. It is a flowchart figure which shows the operation | movement which determines the moving direction of the finger | toe which the movement pattern judgment part performs in step S104 of the flowchart figure of FIG. It is a flowchart figure which shows the detail of the candidate display process of step S104 of the flowchart figure of FIG. It is a flowchart figure which shows the detail of the process (4) of step S328 of the flowchart figure of FIG. It is a flowchart figure which shows the detail of the process (4) of step S328 of the flowchart figure of FIG.

  Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. The embodiment described below is an embodiment when the present invention is applied to a virtual keyboard device.

Outline of Virtual Keyboard Device First, an outline of a virtual keyboard device will be described.

  FIG. 1 shows the configuration of the virtual keyboard device. In FIG. 1, finger sensors 16-1 to 16-5 and 16-are respectively attached to the fingers 14-1 to 14-5 and 14-6 to 14-10 of the left hand 10 </ b> L and the right hand 10 </ b> R as the user's wearing parts. 6 to 16-10 are installed. The finger sensor 16 is a sensor that detects an operation signal that changes in accordance with the spatial motion of the finger 14, and includes, for example, an acceleration sensor or a gyro sensor. Details of the finger sensor 16 will be described later. For example, the backs of the left hand 10L and the right hand 10R are equipped with data collection units 18 and 20, respectively. The data collection units 18 and 20 have finger sensors 16-1 to 16-5 and 16-6 to 16 respectively. The operation signal from −10 is supplied via the harnesses 22-1 to 22-5 and 22-6 to 22-10. The data collection units 18 and 20 have radio units 24 and 26, respectively, and operation signals from the radio units 24 and 26 are received by the radio unit 30 of the input code output unit 28. The operation signals collected by the data collection units 18 and 20 may be received by the input code output unit 28 via a wire (harness).

  The input code output unit 28 includes an operation pattern dictionary unit 32 and an operation pattern determination unit 34 in addition to the radio unit 30. The motion pattern dictionary unit 32 is a storage unit that stores a relationship between pattern information indicating the pattern of the motion signal of the finger 14 and an input code corresponding thereto.

  The details of the operation pattern dictionary unit 32 are described at the end of the outline of the virtual keyboard device.

  The motion pattern determination unit 34 compares the motion signal corresponding to the pattern information stored in the motion pattern dictionary unit 32 with the motion signal supplied from the wireless unit 30 and corresponds to the detected motion signal. Output the input code. The output input code is transmitted from the wireless unit 36 provided in the input code output unit 28 to the wireless unit 40 of the character display 38. The character display 38 has a display unit 42, and a character code 44, for example, is displayed on the display unit 42 as an input code input by the operation of the finger 14. In this case as well, the input code output unit 28 and the character display 38 may be connected by wire (harness) and communicated.

  FIG. 2 shows another configuration of the virtual keyboard device. In the configuration of FIG. 1, the data collection units 18 and 20 are attached to the left hand 10L and the right hand 10R, respectively. However, in the configuration of FIG. 2, no data collection unit is provided. The operation signals from the finger sensors 16-1 to 16-5 and 16-6 to 16-10 are input to the input code output unit 28 via the harnesses 22-1 to 22-5 and 22-6 to 22-10. Is supplied to the operation pattern determination unit 34.

  FIG. 3 shows an acceleration sensor as an example of the finger sensor 16. In FIG. 3, the finger sensor 16 is a three-axis acceleration sensor, and detects acceleration due to the movement of the finger for each of the X axis, the Y axis, and the Z axis. The Z axis indicates the direction 45 of gravitational acceleration.

  FIG. 4 shows an example of the output voltage of the finger sensor 16 when the finger 14 is stationary. In FIG. 4, it can be seen that the output voltage in the Z-axis direction differs from the output voltage in the X-axis direction and the Y-axis direction by the gravitational acceleration (see reference numeral 46).

  FIG. 5 shows the output voltage of the finger sensor 16 when the key is depressed in the space. FIG. 5 shows the output voltage of the finger sensor 16 when the finger 14 of the left hand 10L is operated so as to press down the letter Q key on the virtual keyboard. The key layout of the virtual keyboard according to the present invention adopts the JIS layout. The upper, middle, and lower graphs in FIG. 5 show the X-axis direction, the Y-axis direction, and the Z-axis direction of the finger sensor 16 attached to the little finger 14-5, the ring finger 14-4, and the thumb 14-1, respectively. Indicates the output voltage. In addition, illustration is abbreviate | omitted about the output voltage of the X-axis direction of the finger sensor 16 with which the other finger | toe 14 was mounted | worn, a Y-axis direction, and a Z-axis direction. In FIG. 5, when the key of the letter Q is depressed (see the time indicated by reference numeral 48), the little finger 14-5 moves greatly, that is, as shown in the upper part of FIG. The change in the output voltage in the X-axis direction, the Y-axis direction, and the Z-axis direction of the finger sensor 16 mounted on the finger 5 varies with the X-axis direction, the Y-axis direction, and the Z-axis of the finger sensor 16 mounted on another finger. It can be seen that it is large compared to the change in the output voltage in the direction.

  FIG. 6 shows the configuration of the input code output unit 28 including the operation pattern determination unit 34. In FIG. 6, for example, considering the left hand, a finger sensor 16 is attached to each of the fingers 14, and one finger sensor 16 outputs three axis (X axis, Y axis, and Z axis) operation signals. Therefore, 5 × 3 = 15 operation signals 50 are supplied to the operation pattern determination unit 34. Learning is performed by mapping 15 motion signals 50, that is, 15 data, to each character 52 using a neural network, and a dictionary pattern in the motion pattern dictionary unit 32 is created or updated. This learning operation will be described with reference to FIG.

  FIG. 7 shows a flowchart showing the learning operation of the virtual keyboard device. In FIG. 7, the power is turned on in step S10, and the process proceeds to step S12. If it is determined in step S12 that the learning mode is set by the processing of the virtual keyboard device, the process proceeds to step S14, and the keyboard is connected to the input code output unit 28 (see FIGS. 1 and 2).

  In the flowchart of FIG. 7, the processing of the virtual keyboard device in step S12 and steps S26, S40, and S44 described later will be described. Operation buttons 18A or 20A are provided in the data collection unit 18 or 20 (see FIG. 1). The input operator (that is, the user) performs an operation corresponding to the determination on the operation button 18A or 20A, and the virtual keyboard device responds to the operation performed on the operation button 18A or 20A. Make a judgment.

  In step S16, the keyboard is pressed. In step S18, acceleration data of the finger sensor 16 at the time of key pressing is read. In step S20, data processing of a required portion of the acceleration data (for example, within ± 500 ms from the change point of the acceleration data). Data processing).

  Note that the data processing is to calculate the average value of the acceleration data of the finger sensor 16 for each finger every 100 ms, and to connect the data in a line to make the data processed data.

  In step S22, learning is performed with a neural network. In step S24, a new dictionary pattern is constructed. When it is determined in step S26 that the learning is not completed by the processing of the virtual keyboard device, the process returns to step S16. If it is determined by the processing of the device that the learning has ended, the process proceeds to step S28. If it is determined in step S12 that the learning mode is not set by the processing of the virtual keyboard device, the process proceeds to step S28.

  In step S28, acceleration data of the finger sensor 16 is read, and in step S30, the acceleration data is compared with the data table value to determine whether or not the hand or finger has moved. If NO in step S30, the process returns to step S28. On the other hand, if YES in step S30, the process proceeds to step S32, and data processing at a required portion of acceleration data (for example, data at ± 500 ms from the change point of acceleration data). Process).

  Note that the data processing is to calculate the average value of the acceleration data of the finger sensor 16 for each finger every 100 ms, and to connect the data in a line to make the data processed data.

  In step S34, the finger movement based on the acceleration data is compared with a dictionary pattern held as a database. In step S36, an input code corresponding to the closest input code is output. In step S38, the input code is The data is transmitted to a character output device such as a personal computer, and the process proceeds to step S40.

  If it is determined in step S40 that the input is not continued due to the process of the virtual keyboard device, the power is turned off in step S42. On the other hand, if it is determined in step S40 that the input is continued due to the process of the virtual keyboard device, Proceed to step S44. If it is determined in step S44 that the correct character input has been performed by the processing of the virtual keyboard device, the process proceeds to step S28, while the correct character input has not been performed by the processing of the virtual keyboard device in step S44. If it is determined, the process proceeds to step S12.

  Next, FIG. 8 shows a system including a virtual keyboard device. In FIG. 8, the motion signal from the finger sensor 16 attached to each finger is supplied to the motion pattern determination unit 34, and the motion pattern determination unit 34 receives the motion signal from the finger sensor 16 and the motion pattern dictionary unit 32. Are compared with the operation signal corresponding to the pattern information stored therein, and an input code corresponding to the detected operation signal is supplied to the personal computer 56. The personal computer 56 outputs the input code to the display device 58 so that a character 59, for example, a column 59 of A, B, C,... Is displayed on the display screen 60 of the display device 58. .

FIG. 9 shows a state in which the finger sensor 16 is attached to the finger 14. In FIG. 9, the finger sensor 16 attached to the finger 14 is a triaxial (X-axis, Y-axis, and Z-axis) acceleration sensor, and the X-axis, Y-axis, and Z-axis are respectively the finger sensor 16. X axis, Y axis, and Z axis are shown. In FIG. 9, since the finger sensor 16 is inclined by an angle α with respect to the direction of gravity, the acceleration Y ′ in the Y′-axis direction and the acceleration Z ′ in the Z′-axis direction of the finger sensor 16 are accelerations in the Y-axis direction. Based on the acceleration Z of the Y and Z axes, the following (1) and (2) are shown, respectively.
Y ′ = Z * Cosβ−Y * Sinβ Expression (1)
Z ′ = Z * Cosα + Y * Cosβ Formula (2)

  Here, the details of the operation pattern stored in the operation pattern dictionary unit 32 will be described. The operation pattern dictionary unit 32 stores the relationship between the operation pattern of the finger and the input code corresponding thereto, That is, the relationship between the finger movement direction determined by the finger movement pattern and the corresponding input code is stored.

  FIG. 18 shows an operation pattern stored in the operation pattern dictionary unit 32 when the finger moves in the left direction. FIG. 18A shows an operation pattern in the X′-axis direction, and FIG. (B) shows an operation pattern in the Y′-axis direction. The meaning in the Y′-axis direction is the same as that described in the expressions (1) and (2). Further, the X′-axis direction is the same as the original X-axis direction.

  Similarly, FIG. 19 shows an operation pattern when the finger moves rightward, FIG. 20 shows an operation pattern when the finger moves straight ahead, and FIG. 21 shows a finger straight ahead. 22 shows an operation pattern when the finger moves in the left direction, FIG. 22 shows an operation pattern when the finger moves in the left direction, and FIG. 23 shows an operation pattern when the finger moves in the right direction. 24 shows an operation pattern when the finger moves in the left front direction, and FIG. 25 shows an operation pattern when the finger moves in the right front direction.

  As shown in FIG. 18 to FIG. 25, the motion pattern determination unit 34 is in a situation where the output voltage in the X′-axis direction based on the output voltage of the finger sensor 16 breaks through the threshold 1 upward (in the + direction) The situation where the threshold value 2 breaks down (in the − direction), and the situation where the output voltage in the Y′-axis direction breaks the threshold value 1 up (in the + direction) or the threshold value 2 breaks down (in the − direction). The finger movement pattern is detected based on the finger movement pattern, and a corresponding input code is output based on the finger movement direction determined by the detected finger movement pattern.

Input Device According to the Embodiment of the Present Application The input device according to the embodiment of the present application will be described. In the input device according to the embodiment of the present application, the operation pattern determination unit 34 (see FIGS. 1, 2, 6, and 8) Based on a detection signal (that is, acceleration of finger movement) from the finger sensor 16 (see FIGS. 1, 2, 3, 8, and 9), a candidate of an input code to be selected is specified. On the other hand, as shown in FIG. 10, a display 64 is attached to the back 62 of the hand 10, and the display 64 displays the input code candidates specified by the operation pattern determination unit 34. It has become. The operation pattern determination unit 34 and the display 64 may be connected by a wire (harness) or may be connected wirelessly.

  Hereinafter, a method for specifying and displaying a candidate of an input code to be selected based on a detection signal from the finger sensor 16 will be described.

  First, FIG. 11 shows a keyboard key pattern. Reference numerals 66, 68, 70, 72, and 74 are assigned to the left little finger, the left ring finger, the left middle finger, the left index finger, and the left thumb, respectively. Reference numerals 76, 78, 80, 82, and 84 denote keys assigned to the right little finger, right ring finger, right middle finger, right index finger, and right thumb, respectively. As described above, the keys assigned to the fingers of each hand are set in advance. In the input device according to the embodiment of the present application, the keys set in advance for each finger based on the detection signal from the finger sensor 16. The input code candidates to be selected are identified from among the input codes corresponding to, and displayed on the display 64.

  FIG. 12 shows keys (6, 7, T, Y, F, G, V, and B keys) that the left index finger is in charge of. FIG. 12 shows detection signals from the finger sensor 16 in FIG. Based on the input codes corresponding to the keys (6, 7, T, Y, F, G, V, and B) preset for each finger, the input code candidates to be selected are specified. And displayed on the display 64 (see FIG. 10) attached to the back of the hand. That is, in FIG. 12, each key (T, Y, F, and G keys) adjacent to the initial position 86 is based on the detection signal from the finger sensor 16 in the moving direction in which one acceleration is detected ( (See arrows 88, 90, 92, and 94) and identified on the display 64.

  Here, the term “once” refers to an interval of ± 250 ms from the time when the sensor value of the finger sensor 16 breaks through a threshold value (see threshold values 1 and 2 in FIGS. 18 to 25).

  Note that how the input device determines the initial position 86 will be described. The sensor data from the finger sensor 16 has not changed for a certain period of time or has been acquired in step S54 of FIG. 17 described later. The initial position 86 is determined based on the fact that the initial position data and the sensor data from the finger sensor 16 coincide with each other for a certain period of time.

  On the other hand, the other keys (6, 7, V, and B keys) are identified as candidates based on the movement direction in which two accelerations are detected based on the detection signal from the finger sensor 16, and are displayed on the display 64. Is displayed.

  Note that the second time is a period of ± 250 ms from the time when the sensor value of the finger sensor 16 next exceeds the threshold value (see threshold value 1 and threshold value 2 in FIGS. 18 to 25) after the candidate is displayed. Say.

  Here, the keys 6 and 7 are identified as candidates by the moving direction 96 in which the first acceleration is detected and the moving direction (left direction or right direction) in which the second acceleration is detected. Each key of, V, and B is specified as a candidate by the moving direction 98 in which the first acceleration is detected and the moving direction (left direction or right direction) in which the second acceleration is detected. Hereinafter, a method in which the 7 keys are specified as candidates for the input code to be selected and displayed on the display 64 will be described with reference to FIGS. 13 to 16.

  In FIG. 13, when the left index finger moves from position 86 in the direction of arrow 96 to position 104, keys 6 and 7 are specified as input code candidates to be selected from the moving direction in which one acceleration is detected. The

  Thereby, as shown in FIG. 14, 6 and 7 are displayed on the display 64 as candidates for the input code to be selected. In FIG. 14, the left arrow displayed on the left side of 6 indicates that when the left index finger is moved left from the current position, the key 6 is reached, and the right arrow displayed on the left side of 7 The arrow indicates that when the left index finger is moved to the right from the current position, the key 7 is reached. The forward arrow displayed on the left side of the cancel moves the left index finger from the current position to the front. Then, candidates 6 and 7 are canceled.

  After that, as shown in FIG. 15, when the left index finger is moved from the position 104 in the direction of the arrow 106, the key 7 is specified as a candidate of the input code to be selected. Thereby, as shown in FIG. 16, 7 is displayed on the display 64 as a candidate of the input code to be selected. The left arrow displayed on the left side of the cancellation indicates that 7 as a candidate is canceled when the left index finger is moved leftward from the current position.

  Next, FIG. 17 is a flowchart showing the operation of the input device according to the embodiment of the present application. In FIG. 17, the process starts in step S50.

  Here, the start will be described. It is set to start when the power is turned on or in the keyboard mode.

  In step S52, the display displays a request for the initial position of the finger. When a predetermined time has elapsed in step S54, the initial position is determined, the inclination of the finger axis (see FIG. 9) is calculated, and the process proceeds to step S56. The display indicates that the initial position has been determined in step S56, and it is determined whether the value of the finger sensor 16 changes in step S58. If No in step S58, the process returns to step S56. On the other hand, if Yes in step S58, the process proceeds to step S60, where the input device infers the key that the user wants to press from the direction of acceleration, and the key candidate. Is displayed (see FIG. 16), and the process proceeds to step S62. In step S62, the input device determines whether the acceleration value is a value when clicked (that is, whether the user has pressed the virtual key is determined).

  Here, a method for determining the click operation will be described. FIG. 26 shows an operation pattern in the Z′-axis direction when the finger performs a click operation, which is stored in the operation pattern dictionary unit 32. Here, the meaning of the Z′-axis direction is the same as that in the above equation. It has just been described in the description of (1) and formula (2). As shown in FIG. 26, the operation pattern determination unit 34 determines that the output voltage in the Z′-axis direction based on the output voltage of the finger sensor 16 has exceeded the threshold value 1 upward (in the + direction) and then set the threshold value 2. By detecting a situation of breaking downward (in the − direction), it is determined that the finger has performed a click operation.

  In the case of Yes in step S62, the process proceeds to step S64, the virtual key that has been pressed is determined, the determined key is displayed on the display, and the process returns to step S52. If No in step S62, the process proceeds to step S66 to determine whether a predetermined time has elapsed since the key candidate was displayed. If no in step S66, the process returns to step S60, Candidates continue to appear on the display. On the other hand, if Yes in step S66, the key candidate is deleted from the display in step S68, and the process returns to step S52. The predetermined time in step S66 is a time for determining whether the key candidate displayed on the display is the key desired by the user, and can be set to about 1 second, for example.

  Note that the flowchart of FIG. 17 shows the operation of the finger of one hand, and it is preferable to prepare a flowchart for the operation of the fingers of both the left and right hands when implementing the present application.

  Next, details of a method for specifying and displaying input code candidates will be described.

  FIG. 27 shows details of operations in steps S60 to S62 in the flowchart of FIG.

  In FIG. 27, step S60 indicates step S60 in the flowchart of FIG. 17, and in the next step S100, it is determined whether a click determination has been made. If No in step S100, the process proceeds to step S102, and it is determined whether the sensor value has changed. If No in step S102, the process returns to step S100. If Yes in step S102, the process proceeds to step S104, and candidate display processing is performed. In the candidate display process of step S104, the motion pattern determination unit 34 performs the candidate display process based on the motion pattern stored in the motion pattern dictionary unit 32 and the sensor value of the finger sensor 16. It will be described later.

  When the candidate display process in step S104 ends, the process proceeds from step S104 to step S106. In the case of Yes in step S100, the process proceeds to step S106 as it is. In step S106, it is determined whether or not to proceed to click determination. If No in step S106, the process returns to step S102. On the other hand, if Yes in step S106, the process proceeds to step S108, and the process proceeds to step S62 (see FIG. 17).

  FIG. 28 shows an operation for determining the moving direction of the finger performed by the operation pattern determination unit 34 in step S104 in the flowchart of FIG.

  In FIG. 28, the process starts in step S200, and in step S202, the sensor value of the finger sensor 16, that is, the data is converted into the X′-axis direction, the Y′-axis direction, and the Z′-axis direction. The obtained data is compared with the data in the motion pattern dictionary unit 32. In step S206, the direction of each finger is determined from the converted data, and the process ends in step S208.

  Next, FIG. 29 shows details of candidate display processing in step S104 in the flowchart of FIG.

  In FIG. 29, the process starts in step S300, and in step S302, it is determined whether the sensor value of the left little finger has exceeded the threshold value. Refer to FIGS. 18 to 25 for the threshold breakthrough. If Yes in step S302, the process proceeds to step S304 (1), whereas if No in step S302, the process proceeds to step S306. Hereinafter, in steps S306 to S322, the same determination is made for the sensor value of the left ring finger to the sensor value of the right thumb, and in the case of Yes in steps S306 to S322, the processes (2) to S340 of step S324, respectively. On the other hand, in the case of No in steps S306 to S322, the process proceeds to the next step as it is.

  For example, step S310 will be described. In step S310, it is determined whether the sensor value of the left index finger has exceeded the threshold value. If YES in step S310, the process (4) in step S328, that is, the sensor value of the left index finger has the threshold value. On the other hand, the process in the case of breaking through is performed. On the other hand, if No in step S310, the process proceeds to the next step S312.

  Hereinafter, the process (4) of step S328, that is, the process when the sensor value of the left index finger has exceeded the threshold value will be taken as an example and described in detail.

  30 and 31 show details of the process (4) of step S328 in the flowchart of FIG. 29, and one flowchart is configured by FIG. 30 and FIG.

  In the following description, FIGS. 11 to 16 for describing a method for specifying and displaying a candidate of an input code to be selected based on a detection signal from the finger sensor 16 will be referred to as an example.

  30 and 31, the process starts at step S400 and proceeds to step S402, where it is determined whether a key candidate related to the left index finger is displayed. In the first stage, since the key candidate for the left index finger is not displayed, the process proceeds to step S402, where it is determined whether the sensor value indicates that the finger is pointed first. In the example of FIGS. 11 to 16, referring to the arrow 96 in FIG. 13, since the finger is moving forward and the finger is moving straight forward, the process proceeds from step S <b> 402 to step S <b> 406 through step S <b> 408. Proceed to In step S408, “6”, “7”, and “cancel” are displayed. Thereby, as shown in FIG. 14, “6” and “7” are displayed on the display 64 as candidates to be selected, and “cancel” is also displayed. From step S408, the process proceeds to step S462 and ends. Thus, the first candidate display process in step S104 of FIG. 27 is completed, and then the process proceeds from step S106 to step S102.

  In this state, the candidates “6”, “7”, and “Cancel” are displayed on the display 64, and the finger is moved to select one of the candidates. Thereby, since the sensor value of the finger sensor 16 changes, the process proceeds from step S102 in FIG. 27 to step S104, and the second candidate display process is performed as follows.

  Referring to the flowcharts of FIGS. 30 and 31 again, in this state, the candidates “6”, “7”, and “Cancel” are displayed on the display 64, so steps S 400, S 402, S 426, S 430, S 432, are displayed. The process proceeds from step S448 to step S450 via S434, S436, S438, S440, S442, and S444, and it is determined whether the sensor value indicates that the finger is directed to the left.

  In the examples of FIGS. 11 to 16, referring to the arrow 106 in FIG. 15, since the finger is directed in the right direction, the answer is No in Step S <b> 450, and thus the process proceeds to Step S <b> 454. Is displayed. Thereby, as shown in FIG. 16, “7” is displayed on the display 64 as a candidate to be selected, and “cancel” is also displayed. From step S454, the process proceeds to step S462 and ends. Thus, the second candidate display process in step S104 of FIG. 27 is completed, and then the process proceeds from step 106 to step S102.

  In this state, the candidates “7” and “Cancel” are displayed on the display 64, and the finger is moved to select the candidate “7” or “Cancel”. As a result, the sensor value of the finger sensor 16 changes, and the process proceeds from step S102 to step S104 in FIG.

  Referring to the flowcharts of FIGS. 30 and 31 again, in this state, the candidates “7” and “Cancel” are displayed on the display 64. Therefore, steps S400, S402, S426, S430, S432, S434, S436, The process proceeds from step S440 to step S446 via S438, and moves to click determination. That is, in the flowchart of FIG. 27, when the process proceeds from step S104 to step S106, the result is step S106, the process proceeds to step S108, that is, the process proceeds to step S62 in the flowchart of FIG.

  As described above, according to the input device according to the embodiment of the present application, the input operator can recognize the input code candidate to be selected by looking at the display 64 attached to the hand 10. Therefore, the input operation can be easily performed.

  In addition, since the input code candidates corresponding to the keys set in advance for each finger 14 are displayed on the display 64, the input operator performs which typing operation with which finger to input which key. Can be known before operation.

  In addition, since a three-axis acceleration sensor is used as the finger sensor 16, the motion pattern determination unit 34 determines the input code to be selected based on the detected X-axis, Y-axis, and Z-axis motion directions. Candidates can be identified accurately.

  Further, since the display 64 displays the specified input code candidates for a preset time, it is possible to prevent a situation in which unselected input code candidates are displayed unnecessarily for a long time.

  Further, since the input code is determined from the identified input code candidates, the input operator can easily determine the input code.

  Further, since the display 64 is mounted on the back 62 of the hand 10, the input operator can easily recognize the input code candidate to be selected by looking at the display 64.

  In the input device according to the embodiment of the present application, the display 64 is mounted on the back 62 of the hand 10. However, in this application, the place where the display 64 is mounted is not limited to the back 62 of the hand 10. It is also possible to attach 64 to each finger 14. When the display 64 is attached to the back 62 of the hand 10, the display 64 displays five lines in one line corresponding to the five fingers 14, while the display 64 is respectively displayed on the fingers 14 of the hand 10. In the case of wearing, one display 64 can display one column and one column corresponding to one finger 14.

  In the input device according to the embodiment of the present application, the finger 14 of the hand 10 is set as the mounting portion of the finger sensor 16, but the finger sensor 16 may be mounted on the back 62 of the hand 10. Alternatively, the finger sensor 16 may be attached only to a specific finger 14 that can detect the spatial movement of all the fingers 14 without attaching the finger sensor 16 to all the fingers 14.

  In the input device according to the embodiment of the present application, the finger sensor 16 is directly mounted on the finger 14 or the mounting portion of the hand 10. However, in the present application, in the glove, the finger sensor 16 is mounted at a position corresponding to the mounting portion of the finger 14 or the hand 10, and the finger operator 16 wears the glove through the glove. Or you may make it mount | wear with the mounting part of the hand 10 indirectly.

  As described above, the present invention can be used in the field of input devices, and particularly remarkable effects can be obtained when applied to the field of virtual keyboard devices.

10, 10L, 10R: hand 14, 14-1 to 14-10: finger 16, 16-1 to 16-10: finger sensor 22: harness 28: input code output unit 32: operation pattern dictionary unit 34: operation pattern judgment Part 62: Back of hand 64: Display

Claims (6)

In an input device that detects spatial movement of a finger and outputs an input code corresponding to the detected movement,
Detecting means for detecting the movement of the finger by being mounted on a user's finger or hand mounting portion;
Output means for outputting an input code corresponding to the operation detected by the detection means;
Display means for displaying an input code output from the output means by being attached to a finger or a hand related to the attachment portion to which the detection means is attached,
The output means specifies a candidate of an input code to be selected based on the operation detected by the detection means,
The display unit displays the identified input code candidates. The input device according to claim 1,
The output means identifies an input code corresponding to a key set in advance for each finger among keys of a keyboard pattern that is a target of finger movement as a candidate of an input code to be selected,
The display device displays input code candidates corresponding to the specified keys preset for each finger. The input device according to claim 1 or 2,
The detection means detects the movement by detecting acceleration generated by the movement of the finger for each of the X axis, the Y axis, and the Z axis set in advance for the finger on which the detection means is mounted. Acceleration sensor
The input device is characterized in that a candidate for an input code to be selected is specified based on a direction of motion detected by the acceleration sensor. The input device according to any one of claims 1 to 3,
The input device displays the specified input code candidate for a preset time. The input device according to any one of claims 1 to 4,
The input unit determines an input code from the identified input code candidates based on the operation detected by the detection unit. The input device according to any one of claims 1 to 5,
The input device, wherein the display means is attached to a finger or a hand.

Images