JP2010231593A - Keyboard input device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To reduce key input errors of a user to a keyboard. <P>SOLUTION: A keyboard input device includes a sensation presentation means 110 which can present different sensation for every key of the keyboard 11. The keyboard input device has: a processing means 18 which, when the user inputs with the key of the keyboard, specifies predetermined keys available for inputting and determines the sensation presented to each key so that the sensation presented by the keys available for inputting and the sensation presented to the other keys should be different; and a drive means 19 which drives the sensation presentation means 110 based on the sensation determined by the processing means 18 and makes present the sensation of each key of the keyboard 11. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a keyboard input device capable of presenting a different feeling for each key of a keyboard.

  When you want to limit the user's keyboard input to only two of YES or NO in a scene where only specific input is possible, for example, a selection screen that selects either YES or NO, the character or character string once entered is normal In the case where the input is non-regular input, a method of displaying the non-regular input on the display device and prompting re-input is used. In the above example, “YES”, “NO”, “Yes”, “No”, “Y”, “y”, “N”, “n”, etc. are normal inputs, and other than these are non-normal inputs is there.

  As a scene where only such specific input is possible, for example, as described in Non-Patent Document 1, when the Linux command rm --interactive abcdef.tex is issued, the file abcdef.tex is deleted. Ask YES or NO whether to delete.

  Further, in learning keyboard input, a user learns keyboard input by using learning software or the like and taking time for learning. Non-patent document 2 is an example of software for learning keyboard input.

“Manpagerm of RM”, [online], [Search February 23, 2009], Internet <URL: http://www.linux.or.jp/JM/html/GNU_fileutils/man1/rm.1.html > “GNU Type”, [online], [Search February 23, 2009], Internet <URL: http://www.gnu.org/software/gtypist/>

  In the situation where only specific input is accepted, the method described in the background art determines whether or not the input is a regular input after input, so if an incorrect input is made, re-input is required, which increases the labor of input. There is a problem.

  In addition, when learning keyboard input, there is a problem that even if software for learning is used, a dedicated time for learning must be taken apart from practical work. Furthermore, in the learning process, only the teaching materials are traced, there are no deliverables that are directly related to the work, and the learner (employee) needs to be highly motivated to learn, and at the same time the company (employer) learns. Special considerations are needed to encourage it. For example, the learning itself is recognized as a result, consideration of working hours, payment of subsidy for learning, etc.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a keyboard input device that further reduces a user's key input mistake without requiring learning materials and learning time for keyboard input. There is to do.

  In order to achieve the above object, the present invention provides a keyboard input device including a sensation presentation unit capable of presenting a different sensation for each key of a keyboard, and a predetermined input when a user inputs the key of the keyboard. The processing means for identifying a possible key and determining a sense to be presented to each key so that a sense presented by the key that can be input differs from a sense presented by another key, and the processing means determines The gist of the present invention is to have driving means for driving the sensation presentation means based on a sensation and presenting the sense of each key of the keyboard.

  ADVANTAGE OF THE INVENTION According to this invention, a user's key input mistake can be reduced more, without requiring the learning material and learning time of a keyboard input.

It is explanatory drawing for demonstrating the principle of this invention. It is a block diagram of the keyboard input device which concerns on embodiment of this invention.

  Before describing the embodiment of the present invention, first, the principle of the present invention will be described.

  FIG. 1 is an explanatory diagram for explaining the principle of the present invention.

  The keyboard 11 has a plurality of keys. When a desired key is pressed, the key code 111 of the pressed key is input to the input unit 12. The key code 111 (scan code) is a code corresponding to the pressed key transmitted from the keyboard 11 to the input unit 12.

  The input unit 12 is for inputting a pressed character of the keyboard 11, converts the input key code 111 into a character code 112, and outputs the converted character code 112 to the branch unit 13. The character code 112 is a character code corresponding to the key code 111 converted by the input unit 12, and is transmitted from the input unit 12 to the branch unit 13.

  The branching unit 13 branches the character code 112 input from the input unit 12 into a plurality of processes. The branched character code 113 and character code 114 are the same as the character code 112 input to the branch unit 13.

  The external program 14 is a program such as a specific business application, a general word processor, or spreadsheet software. The external program 14 inputs the branched character code 113, executes predetermined processing, and outputs display information 116. The display information 116 is an execution result of the external program transmitted from the external program 14 to the output determination unit 15. Further, the external program 14 notifies the FB (feedback) information processing unit 18 of regular input information 115 indicating whether or not the input character or the input character string input from the keyboard 11 is a regular input.

  The output discriminating unit 15 inputs the display information 116 output from the external program 14, outputs the input display information 116 to the display unit 16 as it is, and the input display information 116 is YES or NO for the user. It is determined whether or not a specific keyboard input is prompted. The display information 117 output by the output determination unit 15 is display information transmitted from the output determination unit 15 to the display unit 16 and is the same as the display information 116. Further, the output determination unit 15 uses the display information 116 to generate normal input information 118 for determining whether or not the input is normal, and notifies the FB information processing unit 18 of the normal input information 118.

  The display information 116 and the display information 117 are character code strings when the external program 14 is an application using a serial terminal such as VT-100, and SVGA (Super Video Graphics Array) when the external program 14 is a word processor or the like. ) Signal.

  The display unit 16 displays display information 117 that is an execution result of the external program 14. The storage unit 17 stores the character code 114 (keyboard input series) output from the branch unit 13. Further, when the character code 114 is notified from the branching unit 13, the storage unit 17 transmits an input event 119 for notifying that there is a keyboard input to the FB information processing unit 18.

  The FB information processing unit 18 statistically and linguistically processes the keyboard input sequence stored in the storage unit 17 and accepts messages (regular input information 115 and 118) from the external program 14 or the output determination unit 15, Decide what kind of sensory feedback (ie what kind of feeling to present to the user). Then, the FB information processing unit 18 notifies the sensation FB drive unit 19 of the FB information 122. The sense is a general term for vision, hearing, touch, and warmth.

  Further, the FB information processing unit 18 sends a DB query 120 for inquiring stored data to the storage unit 17, and acquires a DB query result 121 processing unit 18 that is inquiry result information for the DB query 120 from the storage unit 17.

  The sensation FB drive unit 19 generates a sensation FB signal 123 for driving the sensation FB device 110 such as an LED (Light Emitting Diode) or a vibration element based on the FB information 122 determined by the FB information processing unit 18. The sensory FB signal 123 is an electrical signal that drives the sensory FB device 110.

  The sensory FB device 110 converts the electrical signal generated by the sensory FB drive unit 19 into physical sensations (visual, auditory, tactile, and warm). When the sensation FB device 110 includes an element for feeding back a sensation for each key, the keyboard 11 and the sensation FB device 110 are integrated devices. As an element for feeding back a sense for each key, for example, an LED that displays an image on the key top of each key of the keyboard 11, a vibration element that vibrates each key, a Peltier element that changes the temperature of each key, and the like are considered. It is done.

  On the other hand, when performing sensory feedback using audio, the sensory FB device 110 includes an audio board, an audio amplifier, a speaker, and the like, and may be a separate housing from the keyboard 11.

  Next, the operation principle will be described with reference to FIG.

  The flow from the normal keyboard input to the operation of the external program 14 and the display of the operation result will be described as the first operation (S01-S07), and the operation for preventing erroneous input will be described as the second operation. (S11-S16) The operation for keyboard input learning will be described as the third operation (S21-S24).

First, the first operation from the keyboard input to the operation result display of the external program will be described.
When the user presses the keyboard 11, a key code 111 corresponding to the pressed key is sent to the input unit 12 (S01). The input unit 12 converts the input key code 111 into a character code 112 and outputs it to the branch unit 13 (S02). The branching unit 13 branches the input character code 112 into two character codes 113 and 114 (S03). The character codes 112, 113, and 114 are the same character code.

  Then, the branch unit 13 outputs the character code 113 to the external program 14 (S04). The external program 14 executes predetermined processing based on the input character code 113, and outputs display information 116 as an execution result to the output determination unit 15 (S05). The output determination unit 15 outputs the same display information 117 as the display information 116 output by the external program 14 to the display unit 16 (S06). The display unit 16 displays the display information 117 (S07).

  Next, the flow of the second operation for preventing erroneous input will be described.

  The external program 14 uses the regular input information 115 that can be used to determine whether or not the input character code 113 is a regular input at the timing when the input information of the character code 113 is required in the processing in the external program 14. The information processing unit 18 is notified (S11). Alternatively, when the output determination unit 15 determines that the display information 116 is display information for requesting a specific input, the FB information processing unit 18 is notified of the regular input information 118 that can determine whether or not the display information 116 is a regular input. (S11).

  The character code 114 branched by the branch unit 13 in S03 of the first operation is input to the storage unit 17 and stored (accumulated) (S12). The accumulation unit 17 notifies the FB information processing unit 18 of an input event 119 that the character code 114 has been stored (S13). The input event 119 includes a character code 114.

  The FB information processing unit 18 uses the regular input information 115 or the regular input information 118 to determine whether each key of the keyboard 11 is a regular input key or a non-regular input key. The FB information 112 corresponding to each regular input is sent to the sensory FB drive unit 19 (S14). For the FB information 122, for example, a function that associates each key with a probability of 0 to 1 may be used.

  The sensory FB drive unit 19 generates a sensory FB signal 123 corresponding to the FB information 122 (S15). The sensation FB device 110 outputs a sensation according to the sensation FB signal 123 (S16). For example, when the sensory FB device 110 is a (micro) display device such as an LED, a liquid crystal, or an organic EL arranged on each key of the keyboard 11, according to the sensory FB signal 123 that performs different control and drive for each key. The contents displayed on each key (luminance, hue, chromaticity, pattern, video, etc.) are output with different contents for the key corresponding to the regular input and the key corresponding to the non-regular input. As a result, a normal input key is presented to the user, and erroneous input to the non-normal input key is prevented.

  An apparatus in which a display device is arranged on each key of the keyboard is, for example, an operation button of NTT DOCOMO P-01 (http://www.nttdocomo.co.jp/product/foma/prime/p01a/topics_01.html) and so on.

  Next, the keyboard input learning operation will be described.

  The character code 114 branched by the branch unit 13 in S03 of the first operation is sent to the storage unit 17 and stored in the storage unit 17 as a byte series or a Japanese character string (S21). After the character code 114 is accumulated in the accumulation unit 17, the accumulation unit 17 notifies the FB information processing unit 18 of the input event 119 including the character code 114 (S22).

   The FB information processing unit 18 issues a DB query 120 to the storage unit 17 and acquires a DB query result 121 corresponding to the DB query 120 as required for statistical processing, Japanese processing, and the like. Then, the FB information processing unit 18 performs statistical processing, Japanese processing, and the like, and estimates the probability of being pressed next for each key of the keyboard 11 (S23).

  As a probability estimation method, for example, the following document 1 is available for Japanese, and an N-gram method or the like is well known as a method that does not depend on the language used.

Reference 1: "Evaluation of ability of composite post-processing method in character recognition", Mikio Shintani, Michio Umeda, Nippon Telegraph and Telephone Corporation Musashino Electric Communication Laboratory, IEICE Transactions Vol.J68-D No.5 pp. 1118-1124, published on May 20, 1985 The FB information processing unit 18 sends a function representing the probability corresponding to each key, that is, the FB information 122 to the sensory FB drive unit 19, and the sensory FB drive unit 19 A sensory FB signal 123 is generated based on the FB signal 122, and the sensory FB device 110 is driven (S24). In this way, according to the contents of the key input so far, the user can feed back the feeling of each key according to the possibility of pressing, so that the user does not need special learning materials or learning time. Can learn keyboard input.

  The sensory FB device 110 that is a sensory feedback means includes, for example, a display device that changes the display content of the key top of each key, a vibration element that vibrates each key, the pitch and tone of the sound, the duration of the sound, Examples include an audio output device that changes the waveform, distortion, and the like, and a Peltier element that heats or cools the temperature of each key.

  In the case of an audio output device, an audio signal corresponding to a combination of an estimated probability and an actually input key may be output. For example, when a key with a high estimated probability is actually input, it may be possible to output a predetermined sound that informs the user that the input is correct.

  The audio output device may output an audio signal corresponding to a combination of a key that can be input and a key that is actually input. For example, if the key that can be input is different from the key that is actually input, it is conceivable to output an alarm that notifies an error.

  As described above, according to the apparatus of the present invention, it is possible to reduce the labor of confirmation of input normality and re-input during irregular input. For example, when a call center operator uses the apparatus of the present invention, the time required for each user can be reduced. In addition, the feedback method to the user can be based not only on a visual sense but also on a sense such as hearing, touch, and warm feeling.

In addition, as a keyboard input learning means as a keyboard input learning means, the user is encouraged to input correctly without using special learning materials, and learns keyboard input while creating a document required in practice. It is possible.
<Embodiment>
Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 2 is a configuration diagram of the keyboard input device according to the embodiment of the present invention.

  The keyboard input device of this embodiment includes a keyboard 21, a virtual device driver program 22, a storage unit 23 that stores information in the virtual device driver program 22, an external program 24 such as a predetermined terminal application, and an external program 24. A display unit 25 that displays display information output from the virtual device driver program 22, a sensory FB drive unit 26 that generates sensory signals corresponding to the FB information from the virtual device driver program 22, and a sensory FB signal 124 from the sensory FB drive unit 26. A sensory FB device A27 to be driven and a sensory FB device B28 driven by a sensory FB signal 125 from the sensory FB drive unit 26 are provided.

  Note that the keyboard input device shown in FIG. 2 can use, for example, a general-purpose computer system including at least a CPU and a memory. In this computer system, each function is realized by the CPU executing a predetermined program loaded on the memory.

  Next, messages and signals transmitted between the constituent elements 21-28 will be described.

  The key code 29 is a message generated on the keyboard 21 and transmitted to the virtual device driver program 22. The character code 210 is a message transmitted from the virtual device driver program 22 to the external program 24. This character code 210 is converted from the key code 29 to the character code by the virtual device driver program 22.

  The display information 211 is a telegram transmitted from the external program 24 to the virtual device driver program 22. The display information 212 is a message transmitted from the virtual device driver program 22 to the display unit 25. The FB information 213 is a message transmitted from the virtual device driver program 22 to the sensory FB drive unit 26.

  The sensory FB signal 214 is a signal transmitted from the sensory FB drive unit 26 to the sensory FB device A27. The sensory FB signal 215 is a signal transmitted from the sensory FB drive unit 26 to the sensory FB device B28.

  The character code 2A is a message converted from the key code 29 input to the virtual device driver program 22. The character codes 210 and 2A converted in the virtual device driver program 22 are branched and transmitted to the external program 24 and the storage unit 23 in the virtual device driver program 22. The display information 2 </ b> B is obtained by branching the display information 211 output from the external program 24 by the virtual device driver program 22, and is stored in the storage unit 23.

  Next, taking the console application as an example, the operation of this embodiment of FIG. 2 will be described.

  The key code 29 input from the keyboard 21 is converted and branched into character codes 210 and 2A by the virtual device driver program 22, and the character code 210 is transmitted to the external program 24. At the same time, the character code 2A is stored in the storage unit 23. Accumulated.

  The display information 211 output from the external program 24 is first transmitted to the virtual device driver program 22 and branched into display information 212 and display information 2B. These two pieces of display information 212 and 2B are the same. The display information 212 is transmitted to the display unit 25 and displayed by the display unit 25. The display information 2B is stored in the storage unit 23.

  The display information 2B is constantly monitored by the virtual device driver program 22, and when the display information 2B includes a specific pattern (for example, YES / NO), the virtual device driver program 22 transmits the FB information 213 to the sensory FB drive unit 26.

  Based on the FB information 213, the sensation FB drive unit 26 generates the sensation FB signal 214, the sensation FB signal 215, or both sensation FB signals 214 and 215. Thus, sensory feedback (presentation) is performed to the user from the sensory FB device A27, the sensory FB device B28, or both sensory FB devices 27 and 28.

  By this operation, before the user inputs YES / NO, appropriate sensory feedback, for example, the key tops of each of the “Y” key and “N” key (regular input key) are increased in brightness. By lowering the brightness of each key top of the key (non-regular input key), it is possible to alert the user to perform regular input and prevent erroneous input in advance.

  As a method of sensory feedback, there are the following methods including the above brightness.

(1) Lightness and brightness (2) Color and tone
(3) Moving image display, still image display, no display (4) Key and vibration element combination (eccentric motor, piezo element = small piezoelectric speaker, etc.)
(5) Combination of key and Peltier element Regarding the method of (5), a report example with a mouse is described in the following document 2.

Reference 2: "Human Interface Symposium 2008 (September 1 to 4, 2008)", Iizuka (NTT) and others, http://www.his.gr.jp/his2008/program.html, Specified Nonprofit Organization Human Interface Society (http://www.his.gr.jp/)
The virtual device driver program 22 performs statistical processing and Japanese processing on the character code 2A stored in the storage unit 23, estimates the next input probability for each key, and according to this probability Feedback the senses. As a result, sensory feedback for the next input key can be performed immediately before, during, or immediately after the key is pressed (keystroke), and the user can be prompted to input the correct key. Thus, in this embodiment, it is possible to perform keyboard input learning without using a special learning material.

  There are the following methods for effective sensory feedback in learning keyboard input.

(1) Lightness and brightness (2) Color and tone
(3) Moving image display, still image display, no display (4) Key and vibration element combination (eccentric motor, piezo element = small piezoelectric speaker, etc.)
(5) Combination of keys and Peltier elements (6) Pitch, volume and tone of audio output In the keyboard input device of the present embodiment described above, an output device capable of changing the display content of the key top of each key, and each key At least one sensation such as a vibrating element that vibrates, a Peltier element that heats or cools the temperature of each key, and an audio output device that changes the pitch and tone of the sound, the duration of the sound, the waveform of the sound, the distortion, etc. An FB device is used. Thereby, in a scene where only specific input is possible, it is possible to feed back (present) to the user whether or not the key can be input by at least one sensory FB device. Specifically, only the regular input key can be emphasized with a predetermined sensory feedback immediately before the key is pressed and presented to the user, and erroneous input to the non-regular input key can be prevented.

  Further, in the present embodiment, it is possible to perform assistance for inputting only limited input (regular input) from the keyboard, and for example, it is possible to reduce the operation time in call center operations.

  Further, in the present embodiment, by combining the character string input in the past with statistical processing and Japanese language processing, the next input probability is estimated for each key, and the sense for the high-probability key is changed, Give feedback to users. As a result, it is possible to reduce erroneous input, and to learn appropriate input candidate sensory feedback at any time while creating documents used in practice as OJT without requiring dedicated teaching materials and dedicated learning time. Keyboard input learning can be performed without time constraints.

  In addition, this invention is not limited to the said embodiment, Many deformation | transformation are possible within the range of the summary.

DESCRIPTION OF SYMBOLS 11 Keyboard 12 Input part 13 Branch part 14 External program 15 Output determination part 16 Display part 17 Storage part 18 FB information processing part 19 Sensory FB drive part 110 Sensory FB device 21 Keyboard 22 Virtual device driver program 23 Storage part 24 External program 25 Display unit 26 Sensory FB drive unit 27 Sensory FB device A
28 Sensory FB device B

Claims (10)

A keyboard input device provided with a sensation presentation means capable of presenting a different sensation for each key of the keyboard,
When a user inputs a key on the keyboard, a predetermined key that can be input is specified, and each key is set so that a sense presented by the key that can be entered differs from a sense presented by another key. A processing means for determining a sense of presentation;
A keyboard input device comprising: drive means for driving the sensation presentation means based on the sensation determined by the processing means and presenting the sense of each key of the keyboard. The keyboard input device according to claim 1,
The keyboard input device according to claim 1, wherein the processing means specifies the key that can be input based on regular input information notified from an external program that uses input information from a keyboard. The keyboard input device according to claim 1,
Based on the output information of the external program that uses the input information from the keyboard, it further has output determining means for generating regular input information indicating keys that can be input,
The keyboard input device according to claim 1, wherein the processing unit specifies the key that can be input based on the regular input information generated by the output determination unit. The keyboard input device according to any one of claims 1 to 3,
A keyboard input device, further comprising: audio output means for outputting an audio signal corresponding to a combination of a key that can be input and a key that is actually input. The keyboard input device according to any one of claims 1 to 4,
The processing means analyzes past key input information, estimates a probability of a key to be pressed next, and determines a sense to be presented to each key based on the estimated probability. The keyboard input device according to claim 5,
A keyboard input device, further comprising: audio output means for outputting an audio signal corresponding to a combination of the estimated probability and the actually input key. The keyboard input device according to any one of claims 1 to 6,
The keyboard input device, wherein the sensation presentation means is an element arranged on each key of a keyboard and displaying an image on a key top of the key. The keyboard input device according to any one of claims 1 to 6,
The keyboard input device, wherein the sensation presentation means is a vibration element that is arranged on each key of a keyboard and vibrates the key. The keyboard input device according to any one of claims 1 to 6,
The keyboard input device, wherein the sensation presentation means is an element arranged on each key of the keyboard and capable of changing the temperature of the key. The keyboard input device according to any one of claims 1 to 6,
The sensation presentation means is arranged on each key of the keyboard, and at least two of an element that displays an image on the key top of the key, a vibration element that vibrates the key, and an element that can change the temperature of the key A keyboard input device characterized by combining the above.

Images