JP2000250690A - Virtual keyboard system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a high-reliability virtual keyboard system in simple configuration. SOLUTION: This system is composed of a virtual keyboard 1, a computer 2 having a keyboard setting application module 21, a finger action detecting means 3, an input control means 4 and a storage means 5. A user previously sets a keyboard with a keyboard setting application and stores it in the storage means 5. When a finger performs the action of key pressing on the virtual keyboard 1, the finger action detecting means 3 detects the pressing position of the finger and the input control means 4 reads a key code corresponding to the pressing position out of the storage means 5 and transmits it to the computer 2.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to an information processing apparatus (data processing apparatus) such as a computer or a word processor.
The present invention relates to a virtual keyboard system capable of inputting information without having a physical key.

[0002]

2. Description of the Related Art A keyboard is most commonly used as an input device for inputting data to an information processing device such as a computer or a word processor. The keyboard has many keys (mechanical switches) for inputting Japanese characters, alphabets, numbers, various symbols, etc.
When the user presses a key, code data corresponding to the key is transmitted to the information processing device.

In such a keyboard, in order to improve the operability and the input efficiency, it is necessary to increase the size of the keys to some extent. This is because if the size of the keys is too small, a problem occurs that a plurality of keys are pressed at once. Also, space for the key layout is required.

[0004]

On the other hand, in the case of a portable terminal such as a PDA (Personal Digital Assistant), it is necessary to reduce the size of the device. There is a problem that data entry becomes difficult.

In addition, since the keyboard is conventionally uniquely determined depending on the information processing device used, there is a problem that the versatility is lacking. In other words, there are various users, such as those who mainly input numeric data, those who mainly input Japanese, and those who mainly input alphabets, and others who are accustomed to the JIS standard keyboard. If
Some people do not. Or the size of the hand varies from person to person. One keyboard cannot handle these various situations efficiently.

In view of the above, a virtual keyboard (virtual input device) has been proposed which can save space and can freely set a keyboard which is most user-friendly (see, for example, Japanese Patent Application Laid-Open No. HEI 4 (1994) -410). -772
4, JP-A-5-289792, JP-A-9-1989.
No. 54646, etc.).

It is an object of the present invention to provide a highly reliable virtual keyboard system with a simple configuration.

[0008]

According to one aspect of the present invention, a virtual keyboard, data processing means for processing data input from the virtual keyboard, and a virtual keyboard are provided. Finger movement detecting means for detecting a finger movement, storage means for storing data relating to a virtually set keyboard, receiving finger pressing position data from the finger movement detecting means, and the data processing means and finger movement detecting means And input control means for exchanging data. In order to achieve the above object, the data processing means is a computer, and has a keyboard setting application module.

In order to achieve the above object, the storage means includes a keyboard setting storage unit for storing keyboard setting information such as a key to be used, a key arrangement, a key pitch, and a whole keyboard shape, and a key corresponding to each key. A key code storage unit for storing codes and a keyboard setting list storage unit for storing a plurality of sets of keyboard setting information are provided.

Further, according to the present invention, there is provided a finger movement detecting means for detecting a movement of a finger, a storage means for storing data relating to a virtual key arrangement of a keyboard, and the finger movement detecting means. Converting means for comparing the detected finger movement with the key arrangement stored in the storage means to convert the detected finger movement into a signal to be supplied from a corresponding key; and a finger movement detected by the finger movement detecting means And a display means for displaying the information corresponding to the key arrangement stored in the storage means. The invention according to claim 5 is characterized in that the finger motion detecting means detects the position and size of an object on the virtual keyboard by detecting reflected ultrasonic waves. Further, the conversion means compares a finger size detected by the finger movement detection means with a reference value, and converts a finger movement detection signal into a key signal when there is a difference greater than a predetermined value. It is characterized as invalid.

[0011]

Embodiments of the present invention will be described below with reference to the accompanying drawings. FIG. 1 is a functional block diagram of the virtual keyboard system according to the embodiment of the present invention. This system is virtually set in a predetermined space, and data is input by a virtual keyboard 1 displayed on a display means or the like (a state sensed by the user's five senses), and a virtual keyboard 1. Computer 2, finger movement detection means 3 for detecting finger movement on virtual keyboard 1, input control means 4 for receiving finger press position data through finger movement detection means 3, storage means 5 for exchanging data with input control means 4. It has. The input control means 4 exchanges data with the computer 2.

The virtual keyboard 1 comprises, for example, a flat and rectangular LCD, PDP, or the like. Computer 2
Performs processing of data input by the virtual keyboard 1 and is shown independently in the figure, but actually includes the input control means 4 and the storage means 5. Further, the computer 2 has a keyboard setting application module 21
It has.

The finger motion detecting means 3 detects the presence or absence and position of a finger on the virtual keyboard 1, and uses ultrasonic waves in this example. When using ultrasonic waves, a plurality of transmitters and receivers are provided on the four sides of the rectangular virtual keyboard 1 so as to face each other, and the presence or absence of a finger between the paired transmitter and receiver is determined. It is common to detect. That is, if there is no finger between the two, the receiver receives the ultrasonic wave from the transmitter, and conversely, if the finger exists, the receiver does not receive the ultrasonic wave. The position can be detected. The ultrasonic wave reflected by the finger may be received by the receiver.

The input control means 4 receives from the finger movement detecting means 3 data on the position of the virtual keyboard 1 pressed by the finger. The input control means 4 performs key information collation and position data collation on the storage means 5. The input control means 4 writes the keyboard setting information in the storage means 5 in the operation of the keyboard setting application program. Further, the input control means 4 receives the key code from the storage means 5 and transmits it to the computer 2.

The storage means 5 includes a keyboard setting storage unit 5
1, a key code storage unit 52, and a keyboard setting list storage unit 53. In the keyboard setting storage unit 51,
The keyboard set by the user is stored. Specifically, keyboard setting information such as a key to be used, a key arrangement, a key pitch, a shape and a size of the entire keyboard, and keyboard position data are stored. Key code storage unit 52
Stores a key code corresponding to each key stored in the keyboard setting storage unit 51.

The keyboard setting list storage unit 53 stores the keyboard setting information stored in the keyboard setting storage unit 51 in a single file, for example. By storing some keyboard setting information in the keyboard setting list storage unit 53 in advance, the user can select an optimal keyboard. In the figure, two pieces of keyboard setting information A and B are shown, and two types of keyboard setting information are stored.

Next, the operation will be described. In order to operate the virtual keyboard 1 to perform key input to the computer 2, keyboard settings must be made before that. Therefore, first, an operation when performing a keyboard setting using a keyboard setting application stored in the computer 2 will be described.

When the keyboard setting application is started, a keyboard is displayed on the screen of the virtual keyboard 1. The user sets the keys to be used, the key layout, the key pitch, the shape and size of the entire keyboard, the position data of the keyboard, etc. while looking at the actual key layout on the screen of the virtual keyboard 1, and through the input control means 4. It is stored in the storage unit 5 (the keyboard setting storage unit 51 thereof). Then, after that, key input can be performed with the newly set keyboard at the time of keyboard operation. The keyboard is not limited to a keyboard used for the information processing means, and for example, a keyboard of a musical instrument can be displayed on the screen and set here.

Next, the operation at the time of key input operation using the virtual keyboard 1 will be described with reference to the flowchart of FIG. First, a keyboard to be called (displayed) is designated using a predetermined key on the virtual keyboard 1. For example, when the keyboard setting information A in the keyboard setting list storage unit 53 is designated, the content of the keyboard setting information A is called from the keyboard setting storage unit 51,
It is displayed on the screen of the virtual keyboard 1.

The user performs a key input operation while viewing the keyboard screen. Here, a reference for the size of the object (finger) for accepting a key input is provided in advance, and if the size of the recognized object is not within the reference value, the input is not accepted. As a result, the virtual keyboard 1 cannot be input with an object other than the finger. If the object recognized at this time greatly exceeds the reference value, for example, when a book or the like is placed on the virtual keyboard 1, an alarm is displayed on the screen to inform the user of an input error message. To

First, the finger movement detecting means 3 senses a position set by the virtual keyboard 1. When a finger performs a key pressing operation on the virtual keyboard 1, the finger operation detecting unit 3 detects the key pressing position (S 1 in FIG. 2) and transmits the pressing position data to the input control unit 4. Here, even if the finger remains stationary at the pressed position, the key press is not detected until the next press operation is performed.

The input control means 4 collates the received depression position data with the keyboard position, shape data and the like stored in the keyboard setting storage unit 51 (S in FIG. 2).
2). When the pressed position data does not correspond to the set key position of the virtual keyboard 1, the next pressed sense is performed ignoring the position data. When the position data corresponds to the set key position of the virtual keyboard 1, the key code of the corresponding key is read from the key code storage unit 52 (see FIG. 2).
(S3), and sends it to the computer 2 (S4 in FIG. 2).
Thus, the virtual keyboard 1 and the computer 2
Is entered.

[0023]

According to the present invention, the use of a virtual keyboard which detects a key press by the movement of a finger makes it possible to reduce the size of the input means as compared with the case of using a conventional keyboard in which mechanical keys are arranged. Can be In addition, since the keys to be used, the key layout, the key pitch, the size and shape of the keyboard, etc. can be freely set, a keyboard that is optimal for each user and optimal for the contents of work can be obtained. The versatility is improved. In particular, a plurality of sets of keyboard setting information including combinations of keys to be used, a key arrangement, a key pitch, a size and a shape of a keyboard, and the like are stored in the storage means, and any one of the keyboards is called up as needed. Usability is further improved. Further, since the size of the object on the virtual keyboard is detected by the finger motion detection and compared with the reference value, it is possible to prevent unnecessary key input by an object other than the finger. If this reference value is set to the size of a specific user's finger, it can be used for security management of a system using this keyboard.

[Brief description of the drawings]

FIG. 1 is a functional block diagram of a virtual keyboard system according to an embodiment of the present invention.

FIG. 2 is a flowchart showing an operation at the time of operating a virtual keyboard.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Virtual keyboard 2 Computer (data processing means) 21 Keyboard setting application module 3 Finger movement detecting means 4 Input control means 5 Storage means 51 Keyboard setting storage part 52 Key code storage part 53 Keyboard setting list storage part

────────────────────────────────────────────────── ───

[Procedure amendment]

[Submission date] February 7, 2000 (2000.2.7)

[Procedure amendment 1]

[Document name to be amended] Statement

[Correction target item name] Claims

[Correction method] Change

[Correction contents]

[Claims]

[Procedure amendment 2]

[Document name to be amended] Statement

[Correction target item name] 0008

[Correction method] Change

[Correction contents]

[0008]

In order to achieve the above object, the invention according to claim 1 processes a keyboard virtually set in a space and data input from the keyboard. Data processing means, finger movement detection means for detecting finger movement on the keyboard, storage means for storing data relating to the keyboard , and receiving finger press position data from the finger movement detection means, Data processing means and finger movement detection means and input control means for transmitting and receiving data , wherein the finger movement detection means is provided by a transmitter.
The presence or absence of a finger based on the presence or absence of the
And its position are detected .
In order to achieve the above object, the data processing means is a computer, and has a keyboard setting application module.

[Procedure amendment 3]

[Document name to be amended] Statement

[Correction target item name] 0010

[Correction method] Change

[Correction contents]

[0010] Further, the invention according to claim 4 provides a keyboard.
Finger movement detecting means for detecting movement of a finger in a space where the finger is virtually arranged ; storage means for storing data relating to a key arrangement of the keyboard; and movement of the finger detected by the finger movement detecting means. Conversion means for comparing the key arrangement stored in the storage means with a signal to be supplied from a corresponding key; and a movement of the finger detected by the finger movement detection means stored in the storage means. Display means for displaying corresponding to the key arrangement ,
The finger movement detecting means is configured to detect the ultrasonic wave transmitted from the transmitter.
The presence or absence of the finger and its position
Is detected . Further, the conversion means includes:
Comparing the size of the finger detected by the finger motion detection means with a reference, and invalidating the conversion of the finger motion detection signal into a key signal when there is a difference of not less than a predetermined size. I do.

Claims (6)

[Claims] 1. A virtual keyboard, data processing means for processing data input from the virtual keyboard, finger movement detection means for detecting finger movements on the virtual keyboard, and data relating to a virtually set keyboard. A virtual keyboard, comprising: a storage unit for storing a finger pressing position data from the finger movement detecting unit; and an input control unit for exchanging data with the data processing unit and the finger movement detecting unit. system. 2. The virtual keyboard system according to claim 1, wherein said data processing means is a computer and has a keyboard setting application module. 3. The method according to claim 1, wherein
A keyboard setting storage unit for storing keyboard setting information such as a key to be used, a key arrangement, a key pitch, and a keyboard overall shape; a key code storage unit for storing a key code corresponding to each key; A keyboard setting list storage unit for storing a plurality of sets of information. 4. A finger movement detecting means for detecting a movement of a finger,
Storage means for storing data relating to a virtual key arrangement of a keyboard, and a corresponding key by comparing a finger movement detected by the finger movement detection means with the key arrangement stored in the storage means And a display unit for displaying a finger movement detected by the finger movement detection unit in correspondence with the key arrangement stored in the storage unit. And a virtual keyboard system. 5. The apparatus according to claim 1, wherein the finger movement detecting means detects a position and a size of an object on the virtual keyboard by detecting reflected ultrasonic waves.
The virtual keyboard system according to any one of the above. 6. The conversion means compares a finger size detected by the finger movement detection means with a reference value, and detects a key signal of a finger movement detection signal when the difference is larger than a predetermined value. The virtual keyboard system according to any one of claims 1 to 5, wherein the conversion to (i) is invalidated.