WO2010113786A1

WO2010113786A1 - Input device and program for input device

Info

Publication number: WO2010113786A1
Application number: PCT/JP2010/055337
Authority: WO
Inventors: 稲葉道夫
Original assignee: ブラザー工業株式会社
Priority date: 2009-03-31
Filing date: 2010-03-26
Publication date: 2010-10-07
Also published as: JPWO2010113786A1

Abstract

Provided is an input device which is capable of realizing an operation closer to that of an actual keyboard even if the device is a virtual input device having no actual keyboard. Disclosed is a virtual keyboard device which detects a spatial key input operation of fingers and outputs an input code corresponding to the key input operation. The virtual keyboard device comprises a finger sensor that a user wears at a wearing portion thereof, an operation determination unit (341), and a press state holding unit (342). The finger sensor outputs an operation signal (50) which changes in accordance with the key input operation. The operation determination unit (341) identifies a key which is an object of the key input operation on the basis of the operation signal (50). The press state holding unit (342) stores whether each key is currently in a press state or not. The virtual keyboard device separately determines whether there is a press operation of any finger or not and whether there is a release operation or not.

Description

Input device and program for input device

The present invention belongs to the technical field of input devices and programs for input devices. More specifically, the present invention belongs to the technical field of an input device that detects a detection signal that changes with spatial movement of a finger and outputs an input code corresponding to the detection signal, and a program for the input device.

A virtual keyboard device has been proposed as a kind of input device. The virtual keyboard device has a feature that a space for arranging the keyboard is unnecessary. In the technique disclosed in Patent Document 1 below, a sensor is attached to a finger of a user whose hand function is limited. The sensor simulates which key is pressed by detecting the movement of the finger to which the sensor is attached.

The specific key of the actual keyboard device is configured to output an input code different from the case where each key is pressed independently by simultaneously pressing a plurality of keys. For example, when a keyboard device is used as an input device for a computer, an input code equivalent to restarting the computer to which the keyboard device is connected is output by simultaneously pressing the CTRL key, ALT key, and DEL key. Is configured to do.

In the technique described in Patent Document 1, the simultaneous pressing is determined with both hands as a set. Specifically, for example, simultaneous pressing is determined by detecting whether one finger of the left hand and one finger of the right hand are simultaneously pressed.

JP 2006-503350 Gazette (see paragraph numbers [0073] to [0081])

However, Patent Document 1 does not disclose simultaneous pressing for pressing a plurality of keys within the range of a finger of one hand. Furthermore, in the technique for realizing the simultaneous pressing in the technique described in Patent Document 1, the pressing operation must be performed within a certain time. Therefore, there is a problem that the operability of the user may be lowered.

Therefore, the present invention has been made in view of the above problems, and an example of the object of the present invention is to detect an input of an input code by detecting a spatial finger movement without having a real key. It is an object of the present invention to provide an input device capable of realizing simultaneous operation of a plurality of keys or repeated operation of the same key, as well as a real keyboard device, and a program for the input device.

In order to solve the above problems, the present invention provides an input device that detects a spatial input motion of a finger and outputs an input code indicating a key that is a target of the detected input motion. Based on a detection means such as a finger sensor that is mounted on a mounting portion provided on at least one of the hands and outputs a detection signal that changes with the input operation of the finger, and the output detection signal, First motion detection means such as a motion determination unit that detects whether or not the input start operation of the finger for starting the input operation has been performed, and when it is detected that the input start operation has been detected. A first operation determination unit or the like that identifies the key that is the target of the input start operation and outputs an input start code that is the input code indicating that the input start operation has been performed for the identified key And an operation determining unit for detecting, based on the output detection signal, the presence or absence of an input end operation of the finger that ends the input operation after it is detected that the input start operation has been performed. The second operation detecting means, and the like, when the input end operation is detected, the key that is the target of the detected input end operation is identified, and the input end operation is performed for the identified key And a second code output unit such as an operation determination unit that outputs an input end code that is the input code indicating that the input has been performed.

According to the present invention, in the input device, input start operation pattern information indicating a pattern of the detection signal corresponding to the input start operation, input end operation pattern information indicating a pattern of the detection signal corresponding to the input end operation, and Are further provided with pattern information storage means such as an action pattern dictionary section for storing each of them separately, and the first action detection means and the first code output means are detected input start action patterns indicated by the output detection signals. And the stored input start operation pattern indicated by the input operation pattern information to detect the input start operation and identify the key that is the target of the detected input start operation, and the second operation detection means, The second code output means includes a detection input end operation pattern indicated by the output detection signal and the end operation. Constructed by comparing the recording input end operation pattern indicated by the turn information to perform the identification of detection and target serving the key of the detected input termination operation of said input termination operation.

In the input device, when it is detected that the input start operation has been performed, the input device stores that the key that is the target of the detected input start operation is in an input start state, and the input end operation is When it is detected that the key is the input end state for the detected input end operation, the first code output unit further includes an operation storage unit such as a pressed state holding unit that stores the input end state. The detection is performed only when it is detected that the input start operation has been performed and that the input end state is stored in the operation storage means for the key that is the target of the detected input start operation. The input start code indicating the identified key is output by identifying the key that is the target of the input start operation, and the second code output means is configured to output the input code The detected input is detected only when it is detected that the end operation has been performed and the operation storage means stores the input start state for the key that is the target of the detected input end operation. It is configured to identify the key that is the target of an end operation and output the input end code indicating the identified key.

According to the present invention, in the input device, each of the detection units is attached to each of the fingers of the user, and the second operation detection unit is configured to input the input of the key that is a detection target of the input end operation. When it is stored in the action storage means that it is in the start state, the input end is based only on the detection signal output from the detection means attached to the one finger that performs the input end action. It is configured to perform motion detection.
According to the present invention, in the input device, the first motion detection unit detects that the input start operation is continued, and when the input start operation continued by the first motion detection unit is detected, The first code output means and the second code output means are configured to alternately repeat the output of the input start code and the output of the input end code.

The present invention is an input device that detects a spatial input motion of a finger and outputs an input code indicating a key that is a target of the detected input motion, and is applied to at least one of a user's finger or hand. Based on the output detection signal, a computer included in an input device equipped with a detection means such as a finger sensor that is mounted on a provided mounting portion and outputs a detection signal that changes with the input operation of the finger. A first motion detecting means for detecting whether or not the finger input start operation for starting the input operation has been performed; when it is detected that the input start operation has been performed, the detected input start operation; 1st code output means which identifies the said key which is the object of this, and outputs the input start code which is the said input code which shows that the said input start operation | movement was performed about the identified key, Second motion detection means for detecting, based on the output detection signal, the presence or absence of an input end motion of the finger that ends the input motion after it is detected that a force start motion has been performed; and the input When it is detected that an end operation has been performed, the input code identifies the key that is the target of the detected input end operation, and indicates that the input end operation has been performed for the identified key It functions as a second code output means for outputting an input end code.

According to the present invention, the input start operation and the input end operation are separately detected, and the corresponding input start code or input end code is output. By separately detecting the start operation and the input end operation, an input code corresponding to simultaneous operation of a plurality of keys or repeated operation of the same key can be accurately output for each finger.

According to the present invention, the computer functions to separately detect that the input start operation has been performed and that the input end operation has been performed, and to output the corresponding input start code or input end code. Therefore, by separately detecting the input start operation and the input end operation for a key, it is possible to accurately output an input code corresponding to simultaneous operation of a plurality of keys or repeated operation of the same key for each finger. it can.

Therefore, according to the present invention, even in an input device that does not have a real key and detects an action of a spatial finger and outputs an input code, a plurality of keys can be simultaneously used as in the real keyboard device. Operation or repeated operation of the same key can be realized.

According to the present invention, in addition to the above-described effects, the input start operation pattern information and the input end operation pattern information are separately stored, and the detection of each of the input start operation and the input end operation is performed by comparing the detection signal with them. Since each corresponding key is identified, the input operation can be detected more accurately.

According to the present invention, in addition to the above effect, when it is detected that an input start operation has been performed, it is stored that an input start code indicating a key that is a target of the input start operation has been output. When it is detected that the input end operation has been performed, the state after the input end code indicating the target key of the input end operation is output is stored, and the input start operation has been performed. Is detected, and the key that is the target of the input start operation is identified only when the input end code indicating the key that is the target of the detected input start operation is stored. The corresponding input start code is output, and it is detected that the input end operation has been performed, and the input start code indicating the key that is the target of the detected input end operation is output. Only when the key is stored, and the corresponding input end code is output and the corresponding input end code is output. Can be reduced.

According to the present invention, in addition to the above-described effect, whether the input start code is in the output state or the input end code is in the output state and stores the key to be detected when detecting the input end operation. When the input start code indicating the output state is stored, the input end operation is detected based only on the detection signal output from the detecting means attached to the one finger that performs the input end operation. Therefore, it is possible to reduce the burden of the input end operation detection process in the case where the input start state is stored.
According to the present invention, in addition to the above effect, when the continuous input start operation is detected, the output of the input start code and the output of the input end code are alternately repeated, so that the input end operation is continued without being executed. Even when the input start operation is continued, a code corresponding to the operation can be output.

It is a figure which shows the structure of a virtual keyboard apparatus. It is a figure which shows the other structure of a virtual keyboard apparatus. It is a figure which shows a finger sensor. It is a graph which shows the output voltage of the finger sensor in a stationary state. It is a graph which shows the output voltage of the finger sensor at the time of key depression. It is a figure which shows the structure of the input code output part containing a pattern judgment part. It is a flowchart figure which shows learning operation | movement of a virtual keyboard apparatus. It is a figure which shows the input system containing a virtual keyboard apparatus. FIG. 2 is a block diagram showing a configuration of an operation pattern determination unit according to the embodiment, (a) is the block diagram, and (b) is a flowchart showing an operation of the operation pattern determination unit. It is a flowchart which shows the repeat operation | movement which concerns on embodiment.

(I) Schematic of virtual keyboard device In FIG. 1, fingers 14-1 to 14-5 and 14-6 to 14-10 as examples of mounting portions of the left hand 10L and the right hand 10R of the input operator as a user Finger sensors 16-1 to 16-5 and 16-6 to 16-10, which are examples of detection means, are mounted.

The finger sensor 16 is a sensor that detects an operation signal that changes with the spatial motion of the finger. The finger sensor 16 is composed of, for example, an acceleration sensor or a gyro sensor.

The

data collection units

18 and 20 are mounted on the back of the left hand 10L and the right hand 10R, for example. The

data collection units

18 and 20 receive operation signals from the finger sensors 16-1 to 16-5 and 16-6 to 16-10 via the harnesses 22-1 to 22-5 and 22-6 to 22-10. Supplied. The

data collection units

18 and 20 have radio units 24 and 26, respectively. Operation signals from the radio units 24 and 26 are received by the radio unit 30 in the input code output unit 28. The operation signals collected by the

data collection units

18 and 20 may be received by the input code output unit 28 via a wire such as a harness.

The input code output unit 28 includes an operation pattern dictionary unit 32 as a pattern information storage unit and an operation pattern determination unit 34 in addition to the radio unit 30.

The motion pattern dictionary unit 32 stores pattern information indicating a pattern of finger motion signals. As the pattern information, the pattern information related to the “pressing action” and the pattern information related to the “lifting action” are stored separately for the same key and finger 14.

On the other hand, the operation pattern determination unit 34 compares the operation signal corresponding to the pattern information stored in the operation pattern dictionary unit 32 with the operation signal supplied from the wireless unit 30. The operation pattern determination unit 34 outputs an input code corresponding to the detected operation signal.

The input code output from the operation pattern determination unit 34 is transmitted from the wireless unit 36 provided in the input code output unit 28 to the wireless unit 40 of the character display 38. The character display 38 has a display unit 42. For example, a character code 44 is displayed on the display unit 42 as an input code input by the operation of the finger. The input code output unit 28 and the character display 38 may be connected by wire and communicated.

Another example of the configuration of the virtual keyboard device will be described with reference to FIG. In the configuration of FIG. 2, no data collection unit is provided. The operation signals from the finger sensors 16-1 to 16-5 and 16-6 to 16-10 are transmitted to the operation of the input code output unit 28 via the harnesses 22-1 to 22-5 and 22-6 to 22-10. It is supplied to the pattern judgment unit 34.

In FIG. 3, a finger sensor 16 is a three-axis acceleration sensor, and detects acceleration due to finger movement on each of the X-axis, Y-axis, and Z-axis. The Z axis indicates the direction 54 of gravitational acceleration.

In FIG. 4, the output voltage in the Z-axis direction differs from the output voltage in the X-axis direction and the Y-axis direction by the gravitational acceleration as indicated by reference numeral 46.

When the finger of the left hand 10L is operated so as to press the key of the letter “Q” on the virtual keyboard according to the embodiment, the output voltage of each finger sensor 16 is as shown in FIG. The key layout of the virtual keyboard device according to the present invention employs a so-called JIS (Japanese Industrial Standard) layout. The output voltages in the X-axis direction, Y-axis direction, and Z-axis direction of the finger sensors 16 attached to the little finger 14-5, ring finger 14-4, and thumb 14-1 are, for example, the upper, middle, and lower stages in FIG. These are shown in the graph. The output voltages in the X-axis direction, the Y-axis direction, and the Z-axis direction of the finger sensor 16 attached to other fingers are not shown.

In FIG. 5, the little finger 14-5 moves greatly during the time when the key of the letter “Q” as indicated by reference numeral 48 is pressed. That is, as shown in the upper part of FIG. 5, the change in the output voltage in the X-axis direction, the Y-axis direction, and the Z-axis direction of the finger sensor 16 attached to the little finger 14-5 changes with the finger attached to the other finger. This is larger than the change in output voltage of the sensor 16 in the X-axis direction, Y-axis direction, and Z-axis direction.

In FIG. 6, for example, for the left hand 10 </ b> L, the finger sensor 16 is attached to each finger 14 as described above. One finger sensor 16 outputs three-axis operation signals of the X axis, the Y axis, and the Z axis. Therefore, 5 × 3 = 15 operation signals 50 are supplied to the operation pattern determination unit 34.

In the virtual keyboard device of the embodiment, the dictionary pattern in the motion pattern dictionary unit 32 is created or updated by learning to map the data of 15 motion signals 50 to each character 52 using a neural network.

In FIG. 7, when the power of the virtual keyboard device is turned on by the input operator in step S10, the operation pattern determination unit 34 proceeds to step S12. In step S12, if the learning mode is determined by the input operator, the operation pattern determination unit 34 proceeds to step S14. In step S14, the keyboard is connected to the input code output unit 28 by an input operator or the like.

In step S16, a keystroke input is received from an input operator or the like by a keyboard. In step S18, the motion pattern determination unit 34 reads acceleration vector data of the finger sensor 16 at the time of keystroke. In step S <b> 20, the motion pattern determination unit 34 performs data processing on necessary portions of the acceleration vector data. Data processing is performed, for example, at ± 500 ms from the time of change of acceleration vector data.

In step S22, the operation pattern determination unit 34 learns by using a neural network from the key pressed by the keyboard and the data processed data. In step S <b> 24, the operation pattern determination unit 34 constructs a new dictionary pattern in the operation pattern dictionary unit 32. If the end of learning is not instructed by the determination of the input operator in step S26, the operation pattern determination unit 34 returns to step S16 and repeats the process. On the other hand, when the end of learning is instructed by the input operator in step S26, the operation pattern determination unit 34 proceeds to step S28. If it is determined in step S12 that the input operator is not in the learning mode, the operation pattern determination unit 34 proceeds to step S28.

In step S28, the motion pattern determination unit 34 reads acceleration vector data of the finger sensor 16. In step S30, the motion pattern determination unit 34 compares the acceleration vector data with the data table value to determine whether or not the hand or finger has moved.

If “No” in step S30, the operation pattern determination unit 34 returns to step S28 and repeats the process. If “Yes” in the step S30, the process proceeds to a step S32, and the operation pattern determination unit 34 performs data processing of a necessary portion of the acceleration vector data as indicated by a reference numeral 48.

In step S34, the motion pattern determination unit 34 compares the finger motion pattern based on the acceleration vector data with a dictionary pattern held as a database. In step S36, the operation pattern determination unit 34 outputs an input code corresponding to the closest input code. In step S38, the input code is transmitted to the character output device such as a personal computer by the wireless unit 36 of the input code output unit 28, and the process proceeds to step S40.

If the input is not continued at the judgment of the input operator at step S40, the power is turned off at step S42. When the input is continued by the input operator's determination in step S40, the operation pattern determination unit 34 proceeds to step S44. In step S44, when the input operator views the display screen 60 and correct character input is performed based on the determination of the input operator, the operation pattern determination unit 34 proceeds to step S28. If the input operator sees the display screen 60 in step S44 and the input operator has not made an accurate character input, the operation pattern determination unit 34 proceeds to step S12. The display screen 60 is shown in FIG.

In the flowchart of FIG. 7, an operation button is provided in the

data collection unit

18 or 20 in the determination of the input operator in steps S12, S26, S40, and S44. The input operator performs an operation on the operation button according to the determination of the input operator. Thus, the virtual keyboard device makes a determination according to the operation performed on the operation button.

In FIG. 8, the motion signal 50 from the finger sensor 16 attached to each finger is supplied to the motion pattern determination unit 34. The motion pattern determination unit 34 compares the motion signal 50 from the finger sensor 16 with the motion signal corresponding to the pattern information stored in the motion pattern dictionary unit 32. The motion pattern determination unit 34 supplies an input code corresponding to the detected motion signal 50 to the personal computer 56.

The personal computer 56 outputs the input code to the display device 58. The display device 58 displays on the display screen 60 characters indicated by the input code, for example, a column 59 of “A”, “B”, “C”,.

(II) Configuration and Operation of Operation Pattern Determination Unit According to Embodiment In the operation pattern determination unit 34 of the embodiment described below, key input on each finger is performed based on the operation signal 50 output from each finger sensor 16. The operation is recognized by dividing it into a “pressing operation” and a “pushing operation” in the real key. The operation pattern determination unit 34 outputs input codes corresponding to each operation and different from each other.

The pressing operation is an operation corresponding to an operation of pressing a key vertically downward in a keyboard device that is installed horizontally and has real keys. The pulling-up operation is an operation corresponding to an operation of pulling up a finger, which is installed horizontally and presses a key in a real keyboard device, vertically upward. In a keyboard device having a real key, the pressed key usually returns to the original height by this lifting operation.

In the virtual keyboard device according to the embodiment, since the operation posture is not questioned, the operation of the finger that depresses the real key that is the pressing operation is actually the operation of the finger 14 pointing upward in the vertical direction, or the left or right direction. The movement of the finger 14 may be. When the pressing operation is actually a vertically upward motion of the finger 14, the pulling motion is actually a vertically downward motion of the finger 14. When the pressing operation is actually a horizontal leftward movement of the finger 14, the pulling operation is actually a horizontal rightward movement of the finger 14. Further, when the pressing operation is actually a horizontal rightward movement of the finger 14, the lifting operation is actually a horizontal leftward movement of the finger 14.

As illustrated in FIG. 9A, the operation pattern determination unit 34 according to the embodiment includes a sensor information buffer 340, an operation determination unit 341, and a pressed state holding unit 343. The operation determination unit 241 corresponds to an example of a first operation detection unit, an example of a first code output unit, an example of a second operation detection unit, and an example of a second code output unit. The pressed state holding unit 343 corresponds to an example of an operation storage unit.

The sensor information buffer 340 accumulates acceleration vector data corresponding to a total of 15 motion signals 50 transmitted from each finger sensor 16 for a predetermined time set in advance. The predetermined time set in advance is, for example, 1 second. The sensor information buffer 340 outputs the accumulated acceleration vector data to the motion determination unit 341 in time series. The predetermined time is a predetermined time corresponding to a necessary portion of the acceleration vector data to be processed in step S20. The necessary portion of the acceleration vector data is, for example, acceleration vector data at ± 500 ms from the time of change.

The pressed state holding unit 343 stores, for each key of the embodiment, whether or not the key is currently pressed as a key input operation. That is, after the pressing operation as the key input operation is executed, the pressed state holding unit 343 stores whether or not the lifting operation for the key has not been executed yet. In the following description, a state in which a pressing operation for a key is not yet executed after a pulling operation as a key input operation is executed is referred to as a “pickup state”.

In the operation of step S34 of the embodiment in the operation pattern determination unit 34, when the operation signal 50 starts to be input as the acceleration vector data to the operation pattern determination unit 34, the sensor information buffer 340 accumulates them for a predetermined time in time series. To do. The sensor information buffer 340 sequentially outputs the accumulated acceleration vector data to the motion determination unit 341.

In FIG. 9B, in parallel with the accumulation and output of the acceleration vector data by the sensor information buffer 340, the motion determination unit 341 initializes the stored contents of the pressed state holding unit 342 as step S340. In step S341, the motion determination unit 341 compares the pattern information in the acceleration vector data output from the sensor information buffer 340 with the pattern information stored in the motion pattern dictionary unit 32 for each key. . In the operation of step S341, the “push-up operation” and the “pull-up operation” for the key are separately compared.

In step S342, the operation determining unit 341 calculates a value indicating the degree of difference between the pattern information compared in step S341 as the “distance” between the pattern information. Next, in step S343, the operation determination unit 341 confirms whether the distance calculated in step S342 is less than a preset threshold value. In step S343, when the distance between the pattern information is greater than or equal to the threshold (step S343; NO), the operation determination unit 341 proceeds to step S352. Details of step S352 will be described later.

In the confirmation in step S343, when the distance between the pattern information is less than the threshold (step S343; YES), in step S344, the operation determination unit 341 indicates the finger 14 indicated by the pattern information whose distance is less than the threshold. It is confirmed whether or not the above operation is the above-mentioned pressing operation. This pattern information is pattern information input as acceleration vector data.

When the operation is a pressing operation (step S344; pressing), the operation determining unit 341 refers to the stored content of the pressed state holding unit 342 as step S345. The operation determination unit 341 checks whether or not it is stored that the key currently being determined for operation is in the pressed state. When it is stored that the key is in the pressed state (step S345; YES), the operation determining unit 341 repeats that the key confirmed to be in the pressed state in step S344 is repeatedly pressed. to decide. Thereafter, the operation determining unit 341 proceeds to step S352. Details of step S352 will be described later.

In the confirmation in step S345, when it is not stored that the key is in a pressed state (step S345; NO), a new pressing operation has been performed on the key confirmed in step S345. Therefore, the operation determination unit 341 determines an input code indicating that the operation is a pressing operation on a key in step S346. The input code indicating the pressing operation is an input start code.

The operation determination unit 341 initializes a timer (not shown) provided in the operation determination unit 341 as step S347. In step S348, the operation determination unit 341 stores in the pressed state holding unit 342 that the input start code indicating the pressing operation has been newly pressed for the newly determined key, and proceeds to the operation of step S353. .

In the confirmation in step S344, the movement determination unit 341 determines that the movement of the finger 14 is a lifting movement when the movement of the finger 14 indicated by the pattern information whose distance is less than the threshold is not a pressing movement (step S344; pulling up). It is. In step S349, the operation determination unit 341 refers to the stored content of the pressed state holding unit 342 and confirms whether or not the fact that the key currently being determined for operation is in the pressed state is stored. When it is stored that the key is in the pressed state (step S349; YES), the operation determination unit 341 determines that a new lifting operation has been performed for the key that has been confirmed to be the lifting operation in step S344. In step S350, an input code indicating that the key is being lifted is determined. The input code indicating that it is a pulling-up operation is an input end code.

In the operation of step S350, the operation determination unit 341 detects the lifting operation based only on the operation signal 50 output from the finger sensor 16 attached to the one finger 14 that performs the lifting operation.

In step S351, the operation determining unit 341 stores in the pressed state holding unit 342 that the input end code indicating that the operation is a lifting operation has been newly determined, and moves to the operation of step S353. To do. In other words, the fact that it is in the raised state means that it is no longer in the pressed state.

In the confirmation in step S349, when it is not stored that the key is in the pressed state (step S349; NO), the operation determination unit 341 executes a repeat process described later as step S352. The repeat process of step S352 is a process of continuously outputting the input code corresponding to the key when it is determined that the pressed state continues for the key that was the determination target of step 349. In other words, this is a process corresponding to a process in which an input code corresponding to a pressed key is continuously output when one key is continuously pressed in a real keyboard device. The operation determining unit 341 that has executed Step S352 proceeds to Step S353 and waits for a preset time. This preset time is, for example, 10 milliseconds. In step S354, the operation determination unit 341 is a timer (not shown) provided in the operation determination unit 341. The operation determination unit 341 measures the time during which the key whose input start code is determined by the operation in step S346 described later is in a pressed state. Count up the timer. If the acceleration vector data is continuously output as step 355 (step S355; NO), the operation determination unit 341 returns to the operation of step S341. If the output of new acceleration vector data is stopped as the operation of step S355 (step S355; YES), the operation determination unit 341 proceeds to the operation of step S36 shown in FIG. 7 as it is.

Regarding the repeat operation in step S352, as shown in FIG. 10, the operation determination unit 341 confirms in step S360 whether there is a key corresponding to the timer counted up as the operation in step S354. When there is a key whose corresponding timer value exceeds the predetermined value (step S360; YES), the operation determination unit 341 once determines an input end code as step S361. Next, in step S362, the operation determining unit 341 determines an input start code for a key whose corresponding timer value exceeds a predetermined value. As a result, repeat processing is realized.

In step S363, the operation determining unit 341 initializes a timer (not shown) and proceeds to the operation in step S360.

In the confirmation in step S360, when there is no key corresponding to the timer counted up as the operation in step S354 (step S360; NO), the operation determination unit 341 proceeds to the operation in step S353 as it is.
In addition, in the operation shown in FIG. 9B, it may be configured to move to step S352 after performing the operations of step S348 and step S351. In this case, for example, when the process proceeds from step S351 to step S352, the determination in step S360 of FIG. 10 is “NO”. As a result, the same result as the operation shown in FIG.
Furthermore, the operation of the embodiment shown in FIG. 9B and FIG. 10 is executed for each

hand

10L or 10R. The so-called “simultaneous pressing of a plurality of keys” in the actual keyboard device is performed for each

finger

10L or 10R by performing the operation shown in FIG. 9B and FIG. This is realized by determining the input code in the operation determining unit 341.

As described above, according to the operation of the operation pattern determination unit 34 of the embodiment, it is separately detected that the pressing operation has been performed and the pulling operation has been performed, and the corresponding input start code or Output the input end code. Therefore, by detecting separately the pressing operation and the pulling-up operation for the key by the operation pattern determination unit 34, an input code corresponding to a simultaneous operation of a plurality of keys or a repetitive operation of the same key in units of the finger 14 is obtained. It can output accurately. The simultaneous operation of a plurality of keys is a simultaneous pressing operation for a plurality of keys. The repeated operation of the same key is an operation that keeps pressing the key.

Therefore, even in a virtual keyboard device that does not have a real key and detects an action of the spatial finger 14 and outputs an input code, a plurality of keys can be operated simultaneously or the same key as in the real keyboard device. Can be realized.

In addition, the operation pattern determination unit 34 stores the pattern information corresponding to the pressing operation and the pattern information corresponding to the pulling operation separately in the operation pattern dictionary unit 32. Then, the motion pattern determination unit 34 detects the pressing operation and the pulling operation and identifies the corresponding key by comparing with the acceleration vector data corresponding to the motion signal 50. Accordingly, it is possible to detect the key input operation more accurately.

Further, when it is detected that the pressing operation has been performed, the operation determining unit 341 outputs an input end code without executing the pulling-up operation after the input start code indicating the key to be pressed is output. It is stored in the pressed state holding unit 342 that the state is not output. After the input start code indicating the key to be pressed is output, the state where the pulling operation has not been executed yet and the input end code has not been output is a pressed state. When it is detected that the pulling operation has been performed, the operation determining unit 341 outputs an input end code indicating the key that is the target of the pulling operation, and then does not execute the pressing operation yet, but enters the input start code. It is stored in the pressed state holding unit 342 that the state is not output. After the input end code indicating the key that is the target of the lifting operation is output, the state in which the pressing operation is not yet executed and the input start code is not output is the lifting state. The operation determining unit 341 identifies the key that is the target of the pressing operation only when it is detected that the pressing operation has been performed and the key that is the target of the detected pressing operation is stored in the raised state. And output the corresponding input start code. The operation determining unit 341 selects the key that is the target of the lifting operation only when it is detected that the lifting operation is further performed and it is stored that the key that is the target of the detected lifting operation is pressed. Identify and output the corresponding input end code. Therefore, it is possible to reduce the processing as the operation determination unit 341 by performing limited key identification processing.

Furthermore, the operation determination unit 341 stores in the pressed state holding unit 342 whether the pressed state or the raised state. When it is stored that the key to be detected is pressed in the case of detecting the lifting operation, the operation determining unit 341 is output from the finger sensor 16 attached to the one finger 14 performing the lifting operation. Based on only the operation signal 50, the pulling operation is detected. Therefore, it is possible to reduce the load of the pulling-up detection process in the case where the pressed state is stored.

(III) Modified Embodiment In the above-described embodiment, the finger sensor 16 is directly attached to the corresponding finger 14, but in addition to this, gloves are put on the left hand 10L and the right hand 10R, respectively. For example, the corresponding finger sensor 16 may be mounted on the outer side of the portion corresponding to the finger 14 in FIG. This outside is the back side of the hand.

In this case, it is not necessary to wear the finger sensor 16 corresponding to each finger 14 every time the virtual keyboard device according to the embodiment is to be operated. It is very convenient for the person who is.

In addition, a program corresponding to the flowcharts shown in FIGS. 7, 9B, and 10 is recorded on a recording medium such as a flexible disk or a hard disk, or is acquired via a network such as the Internet. It is also possible to utilize the microcomputer as the operation pattern determination unit 34 according to the embodiment or the modified embodiment by reading and executing with a general-purpose microcomputer.

As described above, the present invention can be used in the field of input devices, and particularly when applied to the field of input devices using a virtual keyboard device, a particularly remarkable effect can be obtained.

10L Left hand 10R Right hand 14, 14-1, 14-2, 14-3, 14-4, 14-5, 14-6, 14-7, 14-8, 14-9, 14-10 Fingers 16, 16- 1, 16-2, 16-3, 16-4, 16-5, 16-6, 16-7, 16-8, 16-9, 16-10

Finger sensor

18, 20 Data collection unit 22-1, 22 -2, 22-3, 22-4, 22-5, 22-6, 22-7, 22-8, 22-9, 22-10 Harness 24, 26 Radio unit 28 Input

code output unit

30, 40 Radio unit 32 operation pattern dictionary unit 34 operation pattern determination unit 42 display unit 44 character code 50 operation signal 52 character 58 display device 59 column 60 display screen 340 sensor information buffer 341 operation determination unit 342 pressed state holding unit

Claims

In an input device that detects a spatial input motion of each finger and outputs an input code indicating a key that is a target of the detected input motion,
A detection unit that is mounted on a mounting unit provided on at least one of a user's finger or hand and outputs a detection signal that changes in accordance with the input operation of the finger;
First motion detection means for detecting whether or not an input start operation of the finger for starting the input operation has been performed based on the output detection signal;
When it is detected that the input start operation has been performed, the input code for identifying the key that is the target of the detected input start operation and indicating that the input start operation has been performed for the identified key First code output means for outputting an input start code,
Second motion detection means for detecting, based on the output detection signal, the presence or absence of an input end operation of the finger that ends the input operation after it is detected that the input start operation has been performed;
When it is detected that the input end operation has been performed, the input code for identifying the key that is the target of the detected input end operation and indicating that the input end operation has been performed for the identified key Second code output means for outputting an input end code,
An input device comprising:
The input device according to claim 1,
Pattern information for separately storing input start operation pattern information indicating the pattern of the detection signal corresponding to the input start operation and input end operation pattern information indicating the pattern of the detection signal corresponding to the input end operation A storage means;
The first operation detection means and the first code output means compare the detected input start operation pattern indicated by the output detection signal with the storage input start operation pattern indicated by the input operation pattern information, and input the input. Detect the start operation and identify the key that is the target of the detected input start operation,
The second operation detecting unit and the second code output unit compare the detected input end operation pattern indicated by the output detection signal with the recording input end operation pattern indicated by the end operation pattern information, and perform the input. An input device that detects an end operation and identifies the key that is the target of the detected input end operation.
The input device according to claim 2,
When it is detected that the input start operation has been performed, it is stored that the key that is the target of the detected input start operation is in an input start state, and when it is detected that the input end operation has been performed, An operation storage means for storing that the input target state of the detected input end operation is in an input end state;
The first code output means detects that the input start operation has been performed, and stores in the operation storage means that the input target state of the detected input start operation is in the input end state. Only when the key that is the target of the detected input start operation is identified and output the input start code indicating the identified key,
The second code output means detects that the input end operation has been performed, and stores in the operation storage means that the input target state of the detected input end operation is in the input start state. Only when the input end code is detected, the input end code indicating the identified key is output by identifying the key that is the target of the detected input end operation.
The input device according to claim 3,
Each detection means is attached to each finger of the user,
The second motion detection means is worn on one finger that performs the input end operation when the input to the input end state is stored in the operation storage means with respect to the key that is the detection target of the input end operation. An input device that detects the input end operation based only on the detection signal output from the detection means.
The input device according to any one of claims 1 to 4,
The first operation detecting means detects that the input start operation is continued;
When the input start operation continued by the first operation detection unit is detected, the first code output unit and the second code output unit alternately output the input start code and output the input end code. An input device characterized by repetition.
An input device that detects a spatial input motion of a finger and outputs an input code indicating a key that is a target of the detected input motion, and is mounted on at least one of a user's finger or hand A computer included in an input device that includes a detection unit that is mounted on a section and outputs a detection signal that changes in accordance with the input operation of the finger;
First action detecting means for detecting whether or not an input start action of the finger for starting the input action has been performed based on the output detection signal;
When it is detected that the input start operation has been performed, the input code for identifying the key that is the target of the detected input start operation and indicating that the input start operation has been performed for the identified key First code output means for outputting an input start code,
Second motion detection means for detecting, based on the output detection signal, the presence or absence of an input end operation of the finger that ends the input operation after it is detected that the input start operation has been performed; and
When it is detected that the input end operation has been performed, the input code for identifying the key that is the target of the detected input end operation and indicating that the input end operation has been performed for the identified key Second code output means for outputting an input end code,
A program for an input device, characterized in that the program is made to function as: