JPH0954646A - Virtual keyboard device and key input control method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable key input operation as if keys were arrayed although a structure has no key by setting the positions of the key tops of the respective virtual keys on the virtual keyboard in a three-dimensional space. SOLUTION: A finger tip position detection part 2 receives signals from respective sensors of finger tip position input gloves 1L and 1R, detects the three-dimensional coordinate values of the respective finger tips of the left and right hands of a user at constant intervals of time, and informs a virtual keyboard control part 3 of information on them. The virtual keyboard control part 3 judges which position of the virtual keys is pressed from the positions (three dimensional coordinate value) of the respective finger tips of both the hands of the user detected at the constant intervals of time and generates and inputs the key code of the corresponding key to a main control part 8. The main control part 8 once inputting the key code from the virtual keyboard control part 3 handles the key code as if it were inputted from a keyboard device to perform the process corresponding to the key code.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a virtual keyboard device and a key input control method suitable for an input device of an information processing device such as a computer or a word processor, which realizes key input without having a physical key. .

[0002]

2. Description of the Related Art Conventionally, in an information processing device such as a computer or a word processor, an input device called a keyboard in which keys (as mechanical switches) corresponding to respective characters are arranged to input characters such as alphabet Was commonly used.

However, for portable information processing devices such as notebook personal computers and word processors, the keyboard occupies a large proportion of capacity and weight, which is a bottleneck for miniaturization.

On the other hand, in order to reduce the size of a portable information processing device, a handwriting input device for handwriting characters using a pen has been used instead of a keyboard. However, the handwriting input device has a remarkably low input speed as compared with the keyboard, and is far inferior to the keyboard in terms of operability. In particular, in order to raise the recognition rate of handwritten characters, it was necessary to carefully input the characters by handwriting, which was a problem.

[0005]

As described above, the conventional keyboard in which a large number of keys are arranged is excellent in operability, but it requires a space for the key arrangement. It was a bottleneck for smaller size and lighter weight.

The present invention has been made in consideration of the above circumstances, and an object thereof is a virtual keyboard device and a key input which can perform key input operation as if the keys are arranged even though the structure has no key. It is to provide a control method.

[0007]

According to a first aspect of the present invention, there is provided a fingertip position detecting means for detecting a position of each fingertip of a user's hand in a three-dimensional space, and a fingertip position detecting means on a virtual keyboard. The storage means for setting the position of the key top of the virtual key in the three-dimensional space, the position of each fingertip detected by the fingertip position detection means, and each virtual key set in the storage means A virtual keyboard control means for detecting a virtually pressed virtual key from the position of the key top and performing a corresponding key input is provided.

The configuration according to the second aspect of the present invention has the above-mentioned first feature in order to realize a virtual keyboard suitable for a user.
In the configuration according to the above aspect, a key is sequentially designated for each virtual key on the virtual keyboard to guide the user to the key input operation, and each time the guidance is given, the position of each fingertip detected by the fingertip position detecting means is detected. The virtual key position learning means for determining the key top position of the designated key based on the lowest fingertip position among the above and setting it in the storage means is added.

In the determination of the input key by the virtual keyboard control means, one of the fingertip positions detected by the fingertip position detection means is one of the virtual keys set in the storage means. It may be performed by detecting that the top surface is passed from top to bottom and then the key top surface is passed from bottom to top.

Further, the position of the key top of the virtual key set in the storage means is corrected based on the history of the fingertip position when it is judged that the virtual key has been pressed in the past. Good. This correction process is executed only for a virtual key for which a key input is performed at regular intervals and for a predetermined number of times or more during that period, and for key tops of other virtual keys, the virtual key from the original position of the corrected virtual key It is preferable to correct the shift and the original relative position of both virtual keys.

In the configuration according to the first aspect, the user envisions a virtual keyboard of a predetermined size and key arrangement, and uses his / her fingertip as if the virtual keyboard exists. Just by doing a virtual key-press operation (by so-called blind touch),
The virtually depressed key is detected from the position of the fingertip in the three-dimensional space and the position of the key top of each virtual key set in the storage means, and the corresponding key input is performed. As described above, according to the configuration of the first aspect, it is possible to realize key input without having a physical key.

In the configuration according to the second aspect, a virtual keyboard having a size and a key layout which the user thinks is easy to handle is envisioned, and the virtual key position learning means guides the virtual keyboard. By simply performing a key input operation, the position of each key of the virtual keyboard envisioned by the user is learned and set in the above-mentioned storage means. It can be realized without having a specific key.

Further, since the position of the key top of each virtual key set in the storage means is corrected on the basis of the history of the fingertip position when it is judged that the virtual key has been pressed in the past, It is possible to prevent an input error from occurring due to a deviation between the key position that the person thinks and the set key position with the passage of time.

[0014]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing the main configuration of an information processing apparatus such as a personal computer according to an embodiment of the present invention.

In FIG. 1, 1L and 1R are fingertip position input gloves which are used by being worn on the left and right hands of a user (operator), respectively. Fingertip position input gloves 1L, 1
At each fingertip of R, for example, a magnetic field generator (not shown) (here, a magnetic field generator configured by using three orthogonal oscillation coils)
A magnetic sensor that outputs a signal corresponding to a position on a three-dimensional rectangular coordinate of x, y, z preset in a three-dimensional space in response to a magnetic field for position detection applied by (Magnetic sensor composed of measuring coil)
11 are built in each. For the position detecting device of three-dimensional coordinates using such a magnetic sensor 11, for example, "Tate, Hirose supervision / work:" Virtual tech lab ", Industrial Research Society (1992), pp.37-39" It is described in.

Reference numeral 2 is a fingertip position detection unit that detects (calculates) each fingertip position (three-dimensional coordinate value) of the user's left hand and right hand in response to signals from the respective sensors 11 in the fingertip position input gloves 1L and 1R. Is. It should be noted that although the posture of the sensor (magnetic sensor) 11 can be detected in addition to the three-dimensional coordinates, the posture information is not used in this embodiment.

Reference numeral 3 is a virtual keyboard controller. The virtual keyboard control unit 3 determines the three-dimensional coordinates (x, x) of the fingertip positions of the respective fingers of the user detected by the fingertip position detection unit 2.
The virtual key detection function that monitors the movement of the finger based on (y, z) to determine which position of the virtual key (the key that does not actually exist) is pressed, and the virtual key that is determined to be pressed It has a virtual key input function of generating a code (key code) and inputting it to the main control unit 8 described later. The key layout of the virtual keyboard is based on the JIS keyboard layout.

Reference numeral 4 is a display unit realized by a CRT display or a liquid crystal display. The display unit 4 displays characters input by the virtual keyboard control unit 3, virtual keys, and predetermined key positions on the virtual keyboard (for example, the character "f", which is the home position of the left and right forefinger in the JIS keyboard layout). "Key positions of""and" j ") and the relative position of each fingertip.

Reference numeral 5 is a sounding unit for generating an alarm sound and a click sound. The sounding unit 5 outputs an alarm sound when the fingertip position detected by the virtual keyboard control unit 3 deviates from the position learned by the virtual key position learning process described later by a certain amount or more, and the virtual keyboard control unit 3 outputs the virtual key. Outputs a click sound when it is determined that was pressed.

Reference numeral 6 is an initialization button for requesting a process for determining the position of the virtual key (virtual key position learning process) before the keyboard input work, and 7 is for storing the learning result of the virtual key position and the like. The storage unit 8 is a main control unit. The main control unit 8 controls the entire apparatus and also executes various arithmetic operations and arithmetic operations such as data movement. Further, the main control unit 8 executes the virtual key position learning process by using the virtual keyboard control unit 3 when the initialization button 6 is pressed.

Next, the operation of the configuration shown in FIG. 1 will be described. First, when using the information processing apparatus of FIG. 1 in the present embodiment, the user wears the fingertip position input gloves 1L and 1R on his / her left and right hands, respectively, to perform virtual key input operation. ing. The device is intended for users who can perform so-called blind touch.

The sensor 11 provided at each fingertip of the fingertip position input gloves 1L and 1R has three-dimensional coordinate positions (and postures) of the sensor 11, that is, the fingertip position input gloves 1L and 1R.
The three-dimensional coordinate position (and posture) of each fingertip of the left and right hands of the user wearing the R is measured, and a corresponding signal is output.

The fingertip position detecting section 2 receives signals from the sensors 11 of the fingertip position input gloves 1L and 1R,
The three-dimensional coordinate values of the fingertips of the user's left and right hands are detected (calculated) at regular time intervals (for example, every few milliseconds), and the information is notified to the virtual keyboard control unit 3.

In the keyboard input mode, the virtual keyboard control unit 3 determines which virtual key position from the positions (three-dimensional coordinate values) of the fingertips of both hands of the user detected by the fingertip position detection unit 2 at regular intervals. The key code of the corresponding virtual key is generated by determining whether or not was pressed. In order to enable the virtual keyboard control unit 3 to make a determination, in the present embodiment, a virtual key position learning process for determining the position of the virtual key can be performed before the keyboard input work is started. .

The virtual key position learning process will be described below with reference to the flowchart of FIG. First, when starting the work of keyboard input, the user presses the initialization button 6 to request the virtual key position learning process.

When the main control unit 8 detects that the initialization button 6 has been pressed (step S1), the virtual key position learning mode is set, and the virtual key position learning process described below is performed by the virtual keyboard control unit 3. Run in concert.

First, the main control section 8 displays a message, for example, "put your hand at the home position" on the display section 4.
Is displayed on the screen (step S2) for a certain time (for example, 2, 3).
Second) Wait (step S3).

On the other hand, when the message "Please put your hand at the home position" is displayed, the user wears the fingertip position input gloves 1L, 1R, and the left and right forefinger of the JIS arrangement that they imagine. Position of the predetermined home position on the virtual keyboard (letter "f" and "j"
Key position).

The signals indicating the fingertip positions of both hands of the user are transmitted to the fingertip position detecting section 2 from the sensor 11 for each fingertip of the fingertip position input gloves 1L, 1R. The fingertip position detection unit 2 receives a signal from each sensor 11, detects (calculates) the three-dimensional coordinate value of each fingertip of both hands of the user at regular time intervals, and notifies the virtual keyboard control unit 3.

When the main controller 8 waits for a certain period of time in step S3, it gives an instruction to the virtual keyboard controller 3 to detect that the movement of the user's fingertip has stopped.

According to the instruction from the main control unit 8, the virtual keyboard control unit 3 determines whether the movement of the user's fingertip has stopped based on the three-dimensional coordinates notified from the fingertip position detection unit 2 at regular intervals. It is determined whether or not (step S4). This determination is performed by checking whether or not the change in the three-dimensional coordinate value of each fingertip notified from the fingertip position detection unit 2 at regular time intervals falls within a predetermined range.

Upon confirming that the movement of the user's fingertip has stopped, the virtual keyboard control section 3 notifies the main control section 8 to that effect. In response to this, the main control unit 8 selects the key to be learned first from the virtual key position learning order table (not shown) prepared in advance (step 5), and performs the operation of inputting the selected key. A message requesting the user to do so is displayed on the display unit 4, and the virtual keyboard control unit 3 is notified to that effect (step S6). Here, it is assumed that the input operation of the alphabetical letter "a" ([a] key) is requested.

In accordance with this message, the user operates to input the requested key (virtual key) on the virtual keyboard. This input operation (operation) is the position where the requested key should originally exist when the virtual home position is used as a reference, and the fingertip corresponding to that key will be pressed as if the key was depressed. Arrow 3 in FIG.
This is realized by moving downward as indicated by 1 and then returning to the original position as indicated by arrow 32.
Here, since the input operation of the [a] key is requested, by moving the fingertip of the little finger of the left hand corresponding to the [a] key downward at the position of the [a] key, [a] You will virtually press down the key and then restore your fingertip.

Upon receipt of the notification of step S6 from the main control unit 8, the virtual keyboard control unit 3 outputs the three-dimensional coordinates of the fingertip corresponding to the key requested by the main control unit 8 and output from the fingertip position detection unit 2. (X, y, z) is monitored, and the three-dimensional coordinate (x, y, z when the z value (vertical coordinate value) is the smallest
y, z), that is, the three-dimensional coordinates (x, y, z) when the user performs the deepest key depression (step S).
7).

Next, the virtual keyboard controller 3 determines the three-dimensional coordinate coordinates (x, y, when the z value becomes the smallest).
A little above z), that is, a three-dimensional coordinate (x, y, z + C) whose z value is larger by "C" is set as the center of the virtual key requested by the main control unit 8 and is stored in the storage unit 7 in combination with the key. Yes (step S8). Here, the center coordinates of the key are not (x, y, z) detected in step S7 but (x, y, z).
+ C) is the play of the key "C" as shown in FIG.
This is because of consideration. A constant of about 5 mm is used for the value of "C".

When the virtual keyboard control unit 3 stores the coordinate information of the center of the virtual key requested by the main control unit 8 in the storage unit 7, that is, when the key position is learned, it notifies the main control unit 8 of that fact. To do. In response to this, the main control unit 8 refers to the virtual key position learning order table and determines whether or not the key positions have been learned for all virtual keys registered in advance in the order table (step S9). . If the unlearned key remains, the main control unit 8 again gives an instruction to the virtual keyboard control unit 3 to detect that the movement of the user's fingertip has stopped.

When the virtual keyboard control unit 3 detects that the user's fingertip has stopped moving (step S4), the main control unit 8 should learn from the virtual key position learning order table next. Select a key (step 5). Then, the main control unit 8 displays a message requesting the user to perform the input operation of the selected key on the display unit 4, and notifies the virtual keyboard control unit 3 of the message (step S6). Here, it is assumed that the input operation of the alphabetical character "b" ([b] key) is requested.

Thereafter, in the same manner as when the input operation of the [a] key is requested, the center position of the [b] key is determined from the virtual depression operation of the [b] key by the user. A learning process of storing the key and the key in the storage unit 7 is performed. Then, such processing is sequentially performed for all virtual keys (for example, alphabets, numbers, main symbols, and function keys) required for the virtual keyboard according to the virtual key position learning order table.

As described above, the center coordinates of all virtual keys registered in the virtual key position learning order table are learned according to the corresponding key input operation by the user (step S9). The main control unit 83 determines the position (range) of the key top of each virtual key on the virtual keyboard suitable for the user based on (the learning result of) the center coordinates of the key calculated in the storage unit 7. And is set in the storage unit 7 (step S10). Here, the virtual key top has a certain spread in the directions of the X and Y planes, as shown in FIG. 4, with the center of the key as a reference. The shape and size of this spread are predefined for each key.

After defining the key top positions of the respective keys on the virtual keyboard and setting them in the storage unit 7, the main control unit 8
The display unit 4 displays a relative positional relationship between the predetermined keys on the keyboard and the current left and right fingertip positions.
Here, the positions of the left and right fingertips of the user, which are detected by the fingertip position detection unit 2 at regular intervals, are received from the virtual keyboard control unit 3, and the fingertip position and the character "," which is the home position of the left and right index fingers, are input. The planar position (X, Y plane) of the above-defined key top position of the f "and" j "keys ([f] key and [j] key) is used as a finger position guide 51 as shown in FIG. It is displayed in a partial area of the display unit 4. The finger position guide 51 is updated and displayed every detection cycle of the fingertip position detection unit 2 or every cycle longer than that (for example, a cycle which is an integral multiple of the detection cycle).

When the key top position of each key on the virtual keyboard is defined (set), the main control unit 8 switches from the virtual key position learning mode to the keyboard input mode. In this keyboard input mode, the virtual key input by the user's virtual keyboard operation becomes possible. Hereinafter, the key determination process by the virtual key input by the user operation will be described with reference to the flowchart of FIG.

In the keyboard input mode, the user can use the virtual key position learning mode as if the keyboard is present (due to the key input operation in accordance with the message displayed on the display section 4), and at the same state as if he / she holds his / her hands with his / her fingertips. By pressing down a virtual (pseudo) key, the input operation of the virtual key set at that position is performed. Although the key input operation in the virtual key position learning mode and the keyboard input mode can be performed in an arbitrary space, in order to prevent the vertical position of the key top that the user envisions from changing with time, It is preferable to perform it on a desk or the like where the wrist or elbow can be fixed.

The three-dimensional coordinates of the left and right fingertips of the user are determined by the fingertip position detection unit 2 for a predetermined time (based on the signals from the sensors 11 in the fingertip position input gloves 1L and 1R worn by the user). It is detected every time and input to the virtual keyboard control unit 3.

In the keyboard input mode, the virtual keyboard control section 3 controls the 3 of each fingertip from the fingertip position detection section 2.
The dimensional coordinate is monitored, and the coordinate is compared with the coordinate range of the key top of each virtual key set in the storage unit 7. Then, as a result of this comparison, the virtual keyboard control unit 3 detects that the tip of a certain finger has passed the surface of the virtual key top set in the storage unit 7 from top to bottom (step S
11) Then, when it is detected that the surface of the virtual key top is passed in the reverse direction from bottom to top (step S).
12, S13), and it is determined that the key has been pressed.

In this case, the virtual keyboard control section 3 generates a key code of the virtual key determined to be pressed and inputs it to the main control section 8 (step S14). The virtual keyboard control unit 3 also causes the sounding unit 5 to generate a click sound to notify the user that a key input has been performed.

When the key code is input from the virtual keyboard control section 3, the main control section 8 treats the key code as if it had been input from the keyboard device (keyboard controller thereof), and performs processing according to the key code. .

In this way, the user can perform the key input operation as if the keys are arranged under the fingertip even though the structure has no keys. By the way, when a key input operation is performed with the keyboard physically absent, the position of the center of the virtual key that the user virtually presses down, especially in the horizontal direction, is
(Regarding the virtual key) There is a possibility that the position is gradually deviated from the position set in the virtual key position learning mode.

Therefore, the virtual keyboard control unit 3 sets the coordinates of the fingertip position when the user depresses the virtual key (when the user's fingertip passes the surface of the keytop of the virtual key) in combination with the corresponding key. Processing for storing the average value of the fingertip positions pressed in the past for the same virtual key as the horizontal coordinate of the center of the key top of the virtual key. , For example, every fixed period.

However, there is a problem in terms of accuracy in averaging keys that have been input a small number of times. Therefore, in the present embodiment, only with respect to the virtual key for which the key input is performed a predetermined number of times or more within the most recent fixed period, the average value of the fingertip positions when the user's fingertip passes the surface of the keytop of the key. Is calculated and reset as the horizontal coordinate of the center of the key top of the virtual key. Then, the center positions of the key tops of the other virtual keys are reset (corrected) based on the horizontal shift from the original positions of the reset virtual keys and the original relative positions of both virtual keys. Note that, in addition to the horizontal shift, the vertical shift can be similarly corrected.

Further, the virtual keyboard controller 3 detects the fingertip position detected by the fingertip position detector 2 even when the fingertip position passes through the same horizontal plane as the keytop of the virtual key set in the memory 7. When the horizontal coordinate is not included in any (defined) coordinate range of each virtual key, the sounding unit 5 generates a warning sound to warn the user that the key is off the key. In addition to this, it is also possible to give a warning to the user by causing the display unit 4 to perform a screen flash or the like via the main control unit 8.

In order to prevent the virtual key tops from coming off from the keys, for example, the virtual key tops may be secured in a large size in the left-right direction, or the user may select and specify the shape and size of the virtual key tops. I do not care.

By the way, in keyboard input (especially keyboard input by blind touch), it is general that each finger presses a predetermined key. For example, the middle finger of the right hand is responsible for the "k", ",", "i" and "8" keys and is not used to press any other key.

Therefore, when the virtual keyboard control unit 3 determines the key virtually pressed by the user based on the position of the user's fingertip detected by the fingertip position detection unit 2 at regular intervals, It is determined which finger has pressed the key to be decided, and if the finger does not correspond to that key, the key input is not accepted.
For example, if the virtual key assigned to the middle finger of the right hand is pressed by another finger, the input is not accepted. By doing so, it is possible to reduce mistakes in key input.

In the above-described embodiment, in order to detect the fingertip positions (three-dimensional coordinates) of the left and right hands of the user, the sensor 11 has a fingertip position input glove 1 built in the fingertip portion.
The case of using L and 1R has been described, but the sensor 11
As long as it has a built-in element, it may be used by being attached only to each fingertip. In addition, the sensor 11
Is a magnetic sensor that measures the position (and posture) in a three-dimensional space by a magnetic field, but it may be one that uses an optical fiber such as a data globe for virtual reality, and the point is to use it. Anything can be used as long as it can measure the positions of the fingertips of the left and right hands of the person in the three-dimensional space.

[0055]

As described above in detail, according to the present invention, the virtual key input operation by the user is used to judge which virtual key is pressed and perform the corresponding key input. Therefore, the key input operation can be performed as if the keys are arranged even though the structure has no keys. As a result, the size and weight of the information processing device can be reduced.

[Brief description of drawings]

FIG. 1 is a block diagram showing a main configuration of an information processing apparatus such as a personal computer according to an embodiment of the present invention.

FIG. 2 is a flowchart for explaining virtual key position learning processing according to the same embodiment.

FIG. 3 is a diagram for explaining a movement of a fingertip during a virtual key input operation in a virtual key position learning mode and a method of determining a center coordinate (particularly a vertical direction coordinate) of a key top of a corresponding virtual key.

FIG. 4 is a diagram for explaining how to define a key top position of a virtual key.

FIG. 5 is a view showing an example of a finger position guide applied in the same embodiment.

FIG. 6 is a flowchart for explaining key determination processing according to the same embodiment.

[Description of Reference Signs] 1L, 1R ... Fingertip position input glove (fingertip position detecting means), 2 ... Fingertip position detecting section, 3 ... Virtual keyboard control section (virtual key position learning means), 4 ... Display section, 5 ... Sounding section , 6 ... initialization button, 7 ... storage section, 8 ... main control section (virtual key position learning means).

Claims (7)

[Claims] 1. A fingertip position detecting means for detecting the position of each fingertip of a user's hand in the three-dimensional space, and the position of the key top of each virtual key on the virtual keyboard in the three-dimensional space are set. A virtual key that is virtually pressed from the storage means for storing it, and the position of each fingertip detected by the fingertip position detection means and the position of the key top of each virtual key set in the storage means. Detect and
A virtual keyboard device comprising: a virtual keyboard control unit for performing corresponding key input. 2. A fingertip position detecting means for detecting the position of each fingertip of the user's hand in the three-dimensional space, and the position of the key top of each virtual key on the virtual keyboard in the three-dimensional space is set. Storage means for storing the information, and sequentially specifying keys for each virtual key on the virtual keyboard to guide the user to the key input operation, and each time the guidance is given, each fingertip detected by the fingertip position detection means In the keyboard input mode, the virtual key position learning means for performing the virtual key position learning process of determining the key top position of the designated key based on the lowest fingertip position among the positions Virtually pressed from the position of each fingertip detected by the fingertip position detection unit and the position of the key top of each virtual key set in the storage unit by the virtual key position learning unit. And a virtual keyboard control means for detecting a virtual key and performing a corresponding key input. 3. The virtual keyboard control means, wherein one of the fingertip positions detected by the fingertip position detection means is
By passing any one of the virtual keys set in the storage means from top to bottom, and then detecting passing the key top surface from bottom to top, 3. The method according to claim 1, wherein it is determined that a virtual key having the key top surface is pressed.
The described virtual keyboard device. 4. The virtual keyboard control means sets the virtual key set in the storage means based on a history of fingertip positions when it is determined that the same virtual key has been pressed in the past. 3. The virtual keyboard device according to claim 1 or 2, wherein the position of the key top is corrected. 5. The virtual keyboard control means sets the virtual key set in the storage means based on a history of fingertip positions when it is determined that the same virtual key has been pressed in the past. The correction processing for correcting the position of the key top of is executed only for the virtual key for which the key input is performed at regular intervals and during the predetermined number of times or more, and for the key tops of other virtual keys, the corrected virtual 3. The correction according to the deviation from the original position of the key and the original relative position of both virtual keys.
The described virtual keyboard device. 6. The position of the key top of each virtual key on the virtual keyboard in the three-dimensional space is set in advance, and in the keyboard input mode, the position of each fingertip of the user's hand in the three-dimensional space. Is detected, the virtual key pressed virtually is detected from the detected position of each fingertip and the position of the key top of each set virtual key, and the corresponding key input is performed. Characteristic key input control method. 7. A key input operation by a user is guided by sequentially specifying keys for each virtual key on the virtual keyboard, and the key input operation for the specified key performed by the user is performed each time the guidance is given. Monitoring is performed by detecting the position of each fingertip of the user in the three-dimensional space, the virtual key position learning process is executed in the detected position of each fingertip, and the keyboard input mode is executed after the virtual key position learning process. Is set, and the position of each fingertip of the user's hand in the three-dimensional space is detected in the mode, and from the detected position of each fingertip and the position of the keytop of each virtual key that has been set. A key input control method characterized by detecting a virtually pressed virtual key and performing a corresponding key input.