CN114138117A - Virtual keyboard input method and system based on virtual reality scene - Google Patents
Virtual keyboard input method and system based on virtual reality scene Download PDFInfo
- Publication number
- CN114138117A CN114138117A CN202111478452.7A CN202111478452A CN114138117A CN 114138117 A CN114138117 A CN 114138117A CN 202111478452 A CN202111478452 A CN 202111478452A CN 114138117 A CN114138117 A CN 114138117A
- Authority
- CN
- China
- Prior art keywords
- key
- virtual keyboard
- layer
- virtual
- response
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 31
- 230000004044 response Effects 0.000 claims abstract description 45
- 230000000694 effects Effects 0.000 claims abstract description 12
- 230000008569 process Effects 0.000 claims abstract description 9
- 238000001514 detection method Methods 0.000 claims description 8
- 238000005192 partition Methods 0.000 claims description 4
- 230000035484 reaction time Effects 0.000 claims description 4
- 230000000630 rising effect Effects 0.000 claims 1
- 230000000007 visual effect Effects 0.000 abstract description 2
- 238000005516 engineering process Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000001960 triggered effect Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 206010044565 Tremor Diseases 0.000 description 1
- 230000001174 ascending effect Effects 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000005282 brightening Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
- G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Abstract
The invention relates to the technical field of virtual reality input, in particular to a virtual keyboard input method and system based on a virtual reality scene. The virtual keyboard operation space is divided into a selection layer, a locking layer and a trigger layer from far to near according to the distance from the bottom surface of the keyboard, and the position of an operation device in the virtual reality space is detected; when the fact that the operating device reaches a selection layer of the virtual keyboard is detected, starting a first response by a key corresponding to the contact position of the operating device; judging whether the operation device leaves the selection layer or not; if the touch screen leaves the selection layer, the key at the contacted position starts a second response; if the key leaves the selection layer and then continues to reach the locking layer downwards, the key is locked; and judging whether the operating device continues to reach the trigger layer or not, and if so, triggering the key. The invention detects the level of the operating device through the spatial layered design of the virtual keyboard, triggers the corresponding response, effectively prevents the wrong selection of the keys, and enables the operating process to be more visual and convenient by setting the response effect.
Description
Technical Field
The invention relates to the technical field of virtual reality input, in particular to a virtual keyboard input method and system based on a virtual reality scene.
Background
With the progress of science and technology, virtual reality and augmented reality technologies are more mature, and the application fields are more and more extensive. There is also an increasing amount of research around various branches of this field of technology, particularly in the field of user interaction with virtual reality scenes. At present, a variety of interaction modes such as gesture recognition input, touch panel input, virtual keyboard input in a virtual reality scene, and the like have been implemented.
The virtual keyboard is used for inputting in a virtual reality scene, and the virtual keyboard is widely applied due to the advantages that hardware does not need to be configured, an input interface is more visual and the like. However, the existing virtual keyboard input mode has the problems that no obvious prompt is provided after the key is selected, the wrong selection is easy to occur due to the shaking of fingers, and the like, and the input accuracy is influenced.
Disclosure of Invention
Aiming at the problems, the virtual keyboard technology in the existing virtual reality scene is further improved, and the virtual keyboard is more convenient to operate and more accurate to execute by controlling the selection mode of the keys during the operation of the virtual keyboard, the response of the selected keys and the function execution process.
The specific technical scheme of the invention is as follows:
a virtual keyboard input method based on a virtual reality scene is characterized in that a virtual keyboard operation space is designed in a layered mode, the bottom surface of a keyboard is used as a reference surface, and a selection layer, a locking layer and a trigger layer are divided according to the distance between the bottom surface of the keyboard and the bottom surface of the keyboard from far to near; the input method based on the virtual keyboard comprises the following steps:
s1, displaying a virtual keyboard in the virtual reality space;
s2, detecting the operation device, and when detecting that the operation device reaches the selection layer of the virtual keyboard, starting a first response by a key corresponding to the contact position of the operation device;
s3, judging whether the operation device leaves the selection layer; if the touch screen leaves the selection layer, the key at the contacted position starts a second response, and the second response is the reverse operation process of the first response and restores the key state of the first response; if the key leaves the selection layer and then continues to reach the locking layer downwards, the key is locked;
s4, judging whether the operation device continues to reach the trigger layer or not, if so, triggering the key; if not, and if it is detected that the operation device is retreated to the selection level, the process returns to step S2, and if it is detected that the operation device is retreated from the selection level, the process returns to step S1.
In step S2, if the key for the system to activate the first response is not the key that the user wants to select, the user can reselect by moving the selection layer. And when the operating device is positioned on the selection layer, judging whether the operating device is translated on the selection layer, if the operating device is translated to other key positions, starting a second response by the key corresponding to the original position, and starting a first response by the key corresponding to the new position.
When the key input is performed, some keys need to be input repeatedly, especially function keys such as a delete key and a space key. If each input needs to be operated step by step according to the steps, the input efficiency is low. Therefore, the present invention designs an operation mode of automatic multi-triggering, that is, in step S5, after the operation device reaches the trigger layer, the time staying on the trigger layer is detected at the same time, and if the time exceeds the set time, the key is automatically triggered multiple times. A certain time interval can be set between multiple times of triggering, and key input is executed once at a certain time interval until the operating device is detected to leave the virtual keyboard triggering layer.
The invention also designs a function for preventing the operation device from shaking and false triggering, and specifically comprises the following two schemes:
the first scheme is as follows: and if the operating device is lifted to the judgment layer after leaving the selection layer, the key at the original contact position starts a second response.
The second scheme is as follows: a height threshold value is arranged on one side of the selection layer, which is far away from the bottom surface of the keyboard, the operation device is lifted upwards after contacting the selection layer, and when the lifting height is smaller than the height threshold value, the system does not react; and when the lifting height is greater than or equal to the height threshold value, the key at the original contact position starts a second response.
The scheme is that whether the operation device leaves the selection layer for a short time due to shaking is judged by judging the height of the operation device raised after leaving the selection layer, so that frequent triggering of a first response due to shaking is avoided.
In order to prevent the operating device from triggering a plurality of keys to respond when contacting the selection layer, the invention selects the keys according to the first contact principle, only selects one key which is contacted firstly, and sets the reaction time, the other key is contacted in the reaction time, and the system does not respond. Ensure that only one key can be selected at a time, prevent popping up more than two keys.
Further, in order to improve the display effect of key triggering, a layer of virtual keyboard is arranged below the bottom surface of the keyboard, keys on the virtual keyboard correspond to the keys on the bottom surface of the keyboard one by one, if the operation device is detected to reach the triggering layer in step S5, the keys at the contact position and the keys symmetrically arranged below the bottom surface of the keyboard synchronously move towards the bottom surface of the keyboard, and when the two keys are overlapped, a corresponding voice effect is given out, and the functions corresponding to the keys are executed.
In the method, the system starts the first response, namely the selected key and other unselected keys are in different states, so that whether the key selection identified by the system is correct or not is known in advance. The first response may be one or more of ascending, enlarging, and emitting light generated by the corresponding key.
In the method, the system starts the second response, namely the selected key is restored to the same state as other keys. The second response may be one or more of a decrease or a zoom or a dim of the corresponding key.
A virtual keyboard input system based on a virtual reality scene comprises an operation device, a virtual keyboard input device and a virtual keyboard input device, wherein the operation device is used for controlling operation icons to move in a virtual keyboard space and selecting and triggering virtual keys;
the detection module is used for detecting the relative position of the operating device and the virtual keyboard area and sending the relative position to the control module;
the virtual keyboard is characterized in that the bottommost surface displays a keyboard partition and key contents, and is divided into a selection layer, a locking layer and a trigger layer from far to near according to the bottom surface of the keyboard;
and the control module is used for controlling the response of the virtual keyboard according to the relative position of the operating device and the virtual keyboard area.
The data detected by the detection module comprises:
whether the distance between the operating device and the virtual keyboard is smaller than a set threshold value or not;
the operating device is translated at the level of the virtual keyboard space and at the selection level.
The input system also comprises a timing module which is used for calculating the staying time of the operating device on the selection layer or the locking layer of the virtual keyboard and sending the staying time to the control module.
The control module controls the virtual keyboard to respond by comprising the following steps:
when the distance between the operating device and the virtual keyboard is smaller than a set threshold value, lightening the virtual keyboard area and displaying an operating icon in the virtual reality space;
when the operating device is positioned on a selection layer of the virtual keyboard, controlling a key corresponding to the contact position of the operating device to start a first response;
when the operation device moves on the selection layer, the original position key is controlled to start a second response, and the new position key starts a first response;
when the operating device is positioned on the locking layer of the virtual keyboard, locking the key corresponding to the position;
when the operation device is positioned on the trigger layer of the virtual keyboard, the function of the position key is executed;
and when the stay time of the operating device on the trigger layer exceeds the set time, executing the function of the position key for multiple times.
Preferably, the operating device is a hand or hand-worn device.
The invention has the beneficial effects that:
(1) divide the virtual keyboard space into the multilayer, designed selection layer, locking layer and trigger layer, through the level that detection operating means located, when just contacting the virtual keyboard selection layer, learn in advance whether the button of selecting is correct, so that in time change, further push down the back locking button simultaneously, can not change again, until reaching the trigger layer, trigger the button, will trigger the button operation substep and realize, effectively prevent the button miscelection, and through setting up response effect, make the operation process more directly perceived more convenient.
(2) By setting the selection principle and the reaction time for the virtual keyboard selection layer, the first response is ensured to be carried out by only selecting one key at a time, and the final input error caused by popping up a plurality of keys at a time is avoided.
(3) By setting a height threshold value for the virtual keyboard selection layer, the phenomenon that the selection layer is frequently and mistakenly triggered due to hand trembling is prevented.
Drawings
FIG. 1 is a schematic diagram of embodiment 1 of the present invention;
FIG. 2 is a schematic diagram of a virtual keyboard hierarchical structure according to embodiment 1 of the present invention;
FIG. 3 is a flowchart of embodiment 2 of the present invention;
fig. 4 is a diagram illustrating the step S6 triggering key actuation in embodiment 4 of the present invention;
in the figure, the keyboard comprises a control module 1, a control module 2, an operating device 3, a detection module 4, a virtual keyboard 5, a timing module 6, a judgment layer 7, a selection layer 8, a locking layer 9, a trigger layer 10 and a keyboard bottom surface.
Detailed Description
The embodiments of the present invention will be described in detail below with reference to the drawings and examples.
Example 1
A virtual keyboard input system based on a virtual reality scene is shown in figures 1 and 2 and comprises an operating device 2, a virtual keyboard 4, a detection module 3, a control module 1 and a timing module 5, wherein the operating device 2 can be a hand or a device worn by the hand, and through movement of the operating device, an operation icon moves in a virtual keyboard space to select and trigger a virtual key. The detection module 3 may be an infrared sensor or a camera, and is used for detecting the position of the operating device and sending the position to the control module. The virtual keyboard 4 is characterized in that the bottommost surface displays keyboard partitions and key contents, the keyboard partitions are divided into a judgment layer 6, a selection layer 7, a locking layer 8 and a trigger layer 9 from far to near by referring to a keyboard bottom surface 10, and a certain distance is reserved between the layers. The timing module 5 is used for calculating the time of the operating device staying at the selection layer or the locking layer of the virtual keyboard and sending the time to the control module. The control module 1 is used for controlling the response of the virtual keyboard according to the relative position of the operating device and the virtual keyboard area.
Example 2
A virtual keyboard input method based on a virtual reality scene, as shown in fig. 3, includes the following steps:
and S1, initializing the system, and displaying the virtual keyboard in the virtual reality space.
And S2, when the finger is detected to be close to the virtual keyboard (the distance is smaller than the set threshold), displaying the finger icon in the virtual reality space, showing the position of the finger icon in the virtual keyboard area in real time, and lightening the keyboard of the finger close area.
And S3, when the finger reaches the selection layer of the virtual keyboard, the key corresponding to the finger contact position rises vertically and is tightly attached to the finger.
The selection layer determines the selected key according to the principle of first contact. The key at the position contacted by the finger firstly is lifted, and the key contacted again in a short time cannot respond, so that the effect that only one key can be selected at a time is achieved, and more than two keys are prevented from being ejected out at the same time.
Specifically, the response time of the system may be set to 0.2 second, for example, after one key is selected, only after an interval of 0.2 seconds or more, the next key is selected to be valid, and the selection made within 0.2 seconds is regarded as an invalid operation, and the system does not respond.
S4, after the finger selects the key on the selection layer, judging whether the finger translates to other key positions, if yes, returning to S3, descending the original position key, returning to the original position, and lifting and displaying the newly selected key; if the finger is not translated, the next step is entered.
S5, detecting whether the finger leaves the selection layer; if the key leaves the selection layer, the displayed key is lifted and lowered, and the key returns to the original position; if the finger is detected to leave the selection layer and then continuously downwards reach the locking layer, the key is also descended to the original position, the key is locked at the same time, and other keys cannot be replaced by translation after the key is locked.
S6, detecting whether the finger passes through the locking layer and continues to reach the triggering layer, if so, triggering the key, inputting the information corresponding to the key or executing the corresponding function; if not, and the finger is detected to retreat from the selection layer, returning to the step S3 to reselect the key; and if the finger is detected to exit the selection layer, returning to the initial state of the system.
Example 3
A virtual keyboard input method based on a virtual reality scene comprises the following steps:
and S1, initializing the system, and displaying the virtual keyboard in the virtual reality space.
And S2, when the finger is detected to be close to the virtual keyboard (the distance is smaller than the set threshold), displaying the finger icon in the virtual reality space, showing the position of the finger icon in the virtual keyboard area in real time, and lightening the keyboard of the finger close area.
And S3, when the finger reaches the selection layer of the virtual keyboard, the key corresponding to the finger contact position is enlarged.
The selection layer determines the selected key according to the principle of first contact. The key which is firstly contacted by the finger is enlarged, and the key which is contacted again in a short time cannot respond, so that the effect that only one key can be selected at a time is achieved, and more than two keys are prevented from being popped up at the same time.
Specifically, the response time of the system may be set to 0.2 second, for example, after one key is selected, only after an interval of 0.2 seconds or more, the next key is selected to be valid, and the selection made within 0.2 seconds is regarded as an invalid operation, and the system does not respond.
The system is provided with a function for preventing frequent triggering of the selection layer caused by finger shaking. The function is realized by the following scheme:
designing a judgment layer on one side of the virtual keyboard selection layer, which is far away from the bottom surface of the keyboard, at a certain distance, wherein when a finger reaches the judgment layer for the first time, the system does not react; when the finger reaches the selection layer and the selected key is enlarged, the finger slightly lifts, and if the finger does not reach the judgment layer, the system does not react; if the finger exceeds the height of the judgment layer, the user is considered that the finger leaves the keyboard for operation, and the key state is restored.
And (II) setting a height threshold value on the side of the virtual keyboard selection layer, which is far away from the bottom surface of the keyboard, raising the virtual keyboard selection layer after the fingers contact the selection layer, and if the raised height does not exceed the height threshold value, the system does not respond. Only when the height of the lifted finger exceeds the height threshold value, the system considers that the finger leaves the keyboard, and the selected key is recovered.
S4, after the finger selects the key on the selection layer, judging whether the finger translates to other key positions, if yes, returning to S3, reducing the original key position, and increasing the newly selected key; if the finger is not translated, the next step is entered.
S5, detecting whether the finger leaves the selection layer; if the mobile terminal leaves the selection layer, the key displayed in a larger size is restored in a smaller size; if the finger is detected to leave the selection layer and then continuously reach the locking layer downwards, the key is reduced and restored, the key is locked at the same time, and other keys cannot be replaced through translation after the key is locked.
S6, detecting whether the finger passes through the locking layer and continues to reach the triggering layer, if so, triggering the key, inputting the information corresponding to the key or executing the corresponding function; if not, and the finger is detected to retreat from the selection layer, returning to the step S3 to reselect the key; and if the finger is detected to exit the selection layer, returning to the initial state of the system.
S7, after the finger reaches the trigger layer, the stay time of the finger on the trigger layer is detected at the same time, a time threshold (such as 1 second) is set, if the stay time does not exceed the time, only one input is executed; if the set time is exceeded, the system starts to trigger the key operation for multiple times, a time interval is set among multiple times of input, for example, after the 2 nd input of the key, the finger moving-away is not detected within 0.1 second, the 3 rd input is continued, and after the finger moving-away is detected, the input is stopped.
For the multi-trigger implementation of step S7, it may also be determined whether to initiate multi-triggering by detecting whether the finger continues to be pressed down after contacting the trigger layer.
Example 4
A virtual keyboard input method based on a virtual reality scene is characterized in that a virtual keyboard operation space is designed in a layered mode, the bottom surface of a keyboard is used as a reference surface, and a selection layer, a locking layer and a trigger layer are divided according to the distance between the bottom surface of the keyboard and the bottom surface of the keyboard from far to near; the input method comprises the following steps:
and S1, initializing the system, and displaying the virtual keyboard in the virtual reality space.
And S2, when the finger is detected to be close to the virtual keyboard (the distance is smaller than the set threshold), displaying the finger icon in the virtual reality space, showing the position of the finger icon in the virtual keyboard area in real time, and lightening the keyboard of the finger close area.
And S3, when the finger reaches the selection layer of the virtual keyboard, the key corresponding to the finger contact position is lightened.
The selection layer determines the selected key according to the principle of first contact. The key at the position where the finger firstly contacts is lightened, and the key which is contacted again in a short time cannot respond, so that the effect that only one key can be selected at a time is achieved, and more than two keys are prevented from being popped up at the same time.
Specifically, the response time of the system may be set to 0.2 second, for example, after one key is selected, only after an interval of 0.2 seconds or more, the next key is selected to be valid, and the selection made within 0.2 seconds is regarded as an invalid operation, and the system does not respond.
The system is provided with a function for preventing frequent triggering of the selection layer caused by finger shaking. The function is realized by the following scheme:
designing a judgment layer on one side of the virtual keyboard selection layer, which is far away from the bottom surface of the keyboard, at a certain distance, wherein when a finger reaches the judgment layer for the first time, the system does not react; when the finger reaches the selection layer and the selected key becomes bright, the finger slightly lifts, and if the finger does not reach the judgment layer, the system does not react; if the finger exceeds the height of the judgment layer, the user is considered that the finger leaves the keyboard for operation, and the key state is restored.
And (II) setting a height threshold value on the side of the virtual keyboard selection layer, which is far away from the bottom surface of the keyboard, raising the virtual keyboard selection layer after the fingers contact the selection layer, and if the raised height does not exceed the height threshold value, the system does not respond. Only when the height of the lifted finger exceeds the height threshold value, the system considers that the finger leaves the keyboard, and the selected key is recovered.
S4, after the finger selects the key on the selection layer, judging whether the finger translates to other key positions, if yes, returning to S3, darkening the original key, and brightening the newly selected key; if the finger is not translated, the next step is entered.
S5, detecting whether the finger leaves the selection layer; if the user leaves the selection layer, the highlighted key is darkened and restored; if the finger is detected to leave the selection layer and then continuously reach the locking layer downwards, the key is darkened and restored, the key is locked, and other keys cannot be replaced through translation after the key is locked.
S6, detecting whether the finger passes through the locking layer and continues to reach the triggering layer, if so, triggering the key, inputting the information corresponding to the key or executing the corresponding function; if not, and the finger is detected to retreat from the selection layer, returning to the step S3 to reselect the key; and if the finger is detected to exit the selection layer, returning to the initial state of the system.
In order to improve the display effect of the trigger keys, a layer of virtual keyboard is arranged below the bottom surface of the keyboard, the keys on the virtual keyboard correspond to the keys on the bottom surface of the keyboard one by one, if the operating device is detected to reach the trigger layer, the keys at the contact positions and the keys symmetrically arranged below the bottom surface of the keyboard synchronously move towards the bottom surface of the keyboard, and when the two keys are superposed, a corresponding voice effect is sent out, and the functions corresponding to the keys are executed. (see fig. 4)
S7, after the finger reaches the trigger layer, the stay time of the finger on the trigger layer is detected at the same time, a time threshold (such as 1 second) is set, if the stay time does not exceed the time, only one input is executed; if the set time is exceeded, the system starts to trigger the key operation for multiple times, a time interval is set among multiple times of input, for example, after the 2 nd input of the key, the finger moving-away is not detected within 0.1 second, the 3 rd input is continued, and after the finger moving-away is detected, the input is stopped. When the trigger is triggered for many times, a certain sound effect can be set to prompt a user.
Claims (14)
1. A virtual keyboard input method based on a virtual reality scene is characterized in that a virtual keyboard operation space is designed in a layered mode, the bottom surface of a keyboard is used as a reference surface, and a selection layer, a locking layer and a trigger layer are divided from far to near according to the distance between the bottom surface of the keyboard and the selection layer; the input method based on the virtual keyboard comprises the following steps:
s1, displaying a virtual keyboard in the virtual reality space;
s2, detecting the operation device, and when detecting that the operation device reaches the selection layer of the virtual keyboard, starting a first response by a key corresponding to the contact position of the operation device;
s3, judging whether the operation device leaves the selection layer; if the touch screen leaves the selection layer, the key at the contacted position starts a second response, and the second response is the reverse operation process of the first response and restores the key state of the first response; if the key leaves the selection layer and then continues to reach the locking layer downwards, the key is locked;
s4, judging whether the operation device continues to reach the trigger layer or not, if so, triggering the key; if not, and if it is detected that the operation device is retreated to the selection level, the process returns to step S2, and if it is detected that the operation device is retreated from the selection level, the process returns to step S1.
2. The virtual keyboard input method based on the virtual reality scene according to claim 1, wherein: in step S2, it is determined whether the operation device has translated in the selection layer, and if the operation device has translated to another key position, the key corresponding to the original position initiates the second response, and the key corresponding to the new position initiates the first response.
3. The virtual keyboard input method based on the virtual reality scene according to claim 1, wherein: in step S5, the operation device reaches the trigger layer, and then the time of staying on the trigger layer is detected, and if the time exceeds a set time, the key is automatically activated a plurality of times.
4. The virtual keyboard input method based on the virtual reality scene according to claim 1, wherein: and if the operating device is lifted to the judgment layer after leaving the selection layer, the key at the original contact position starts a second response.
5. The virtual keyboard input method based on the virtual reality scene according to claim 1, wherein: a height threshold value is arranged on one side of the selection layer, which is far away from the bottom surface of the keyboard, the operation device is lifted upwards after contacting the selection layer, and when the lifting height is smaller than the height threshold value, the system does not react; and when the lifting height is greater than or equal to the height threshold value, the key at the original contact position starts a second response.
6. The virtual keyboard input method based on the virtual reality scene according to claim 1, wherein: in step S2, the selection layer selects the keys according to the principle of first contact, only selects one key which is first contacted, and sets the reaction time within which the other key is contacted, and the system does not respond.
7. The virtual keyboard input method based on the virtual reality scene according to claim 1, wherein: if the operation device is detected to reach the trigger layer in step S5, the keys at the contact positions and the keys symmetrically arranged below the bottom surface of the keyboard move synchronously towards the bottom surface of the keyboard, and when the two keys are overlapped, a corresponding voice effect is given out, and the functions corresponding to the keys are executed.
8. The virtual keyboard input method based on the virtual reality scene according to claim 1 or 2, wherein: the first response is that the corresponding key generates one or more effects of rising, increasing or emitting light.
9. The virtual keyboard input method based on the virtual reality scene according to claim 1, 2, 4 or 5, wherein: the second response is to generate one or more of descending, reducing or darkening for the corresponding key.
10. A virtual keyboard input system based on virtual reality scene, its characterized in that: the virtual keyboard comprises an operation device, a virtual keyboard and a virtual key, wherein the operation device is used for controlling an operation icon to move in a virtual keyboard space and selecting and triggering the virtual key;
the detection module is used for detecting the relative position of the operating device and the virtual keyboard area and sending the relative position to the control module;
the virtual keyboard is characterized in that the bottommost surface displays a keyboard partition and key contents, and is divided into a selection layer, a locking layer and a trigger layer from far to near according to the bottom surface of the keyboard;
and the control module is used for controlling the response of the virtual keyboard according to the relative position of the operating device and the virtual keyboard area.
11. The virtual keyboard input system based on virtual reality scenario of claim 10, wherein: the data detected by the detection module comprises:
whether the distance between the operating device and the virtual keyboard is smaller than a set threshold value or not;
the operating device is translated at the level of the virtual keyboard space and at the selection level.
12. The virtual keyboard input system based on virtual reality scenario of claim 11, wherein: the timing module is used for calculating the time of the operating device staying at the selection layer or the locking layer of the virtual keyboard and sending the time to the control module.
13. The virtual keyboard input system based on virtual reality scenario of claim 12, wherein: the control module controls the virtual keyboard to respond by comprising the following steps:
when the distance between the operating device and the virtual keyboard is smaller than a set threshold value, lightening the virtual keyboard area and displaying an operating icon in the virtual reality space;
when the operating device is positioned on a selection layer of the virtual keyboard, controlling a key corresponding to the contact position of the operating device to start a first response;
when the operation device moves on the selection layer, the original position key is controlled to start a second response, and the new position key starts a first response;
when the operating device is positioned on the locking layer of the virtual keyboard, locking the key corresponding to the position;
when the operation device is positioned on the trigger layer of the virtual keyboard, the function of the position key is executed;
and when the stay time of the operating device on the trigger layer exceeds the set time, executing the function of the position key for multiple times.
14. The virtual keyboard input system based on virtual reality scenario of claim 10, wherein: the operating device is a hand or hand-worn device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111478452.7A CN114138117B (en) | 2021-12-06 | 2021-12-06 | Virtual keyboard input method and system based on virtual reality scene |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111478452.7A CN114138117B (en) | 2021-12-06 | 2021-12-06 | Virtual keyboard input method and system based on virtual reality scene |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114138117A true CN114138117A (en) | 2022-03-04 |
| CN114138117B CN114138117B (en) | 2024-02-13 |
Family
ID=80384366
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111478452.7A Active CN114138117B (en) | 2021-12-06 | 2021-12-06 | Virtual keyboard input method and system based on virtual reality scene |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114138117B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117170505A (en) * | 2023-11-03 | 2023-12-05 | 南方科技大学 | Control method and system of virtual keyboard |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012084190A (en) * | 2012-02-02 | 2012-04-26 | Fujitsu Ltd | Character input device, character input method and character input program |
| CN106598249A (en) * | 2016-12-16 | 2017-04-26 | 广东欧珀移动通信有限公司 | Wrong touch prevention method and device for touch key, and mobile terminal |
| CN106775322A (en) * | 2016-12-23 | 2017-05-31 | 维沃移动通信有限公司 | A kind of method and mobile terminal for preventing virtual key false triggering |
| CN107077221A (en) * | 2014-09-29 | 2017-08-18 | 惠普发展公司有限责任合伙企业 | Dummy keyboard |
| CN107168541A (en) * | 2017-04-07 | 2017-09-15 | 北京小鸟看看科技有限公司 | The implementation method and device of a kind of input |
| WO2018012207A1 (en) * | 2016-07-12 | 2018-01-18 | 富士フイルム株式会社 | Image display system, head-mounted display control device, and operating method and operating program for same |
| CN108984087A (en) * | 2017-06-02 | 2018-12-11 | 腾讯科技（深圳）有限公司 | Social interaction method and device based on three-dimensional avatars |
| WO2019004686A1 (en) * | 2017-06-26 | 2019-01-03 | 서울대학교산학협력단 | Keyboard input system and keyboard input method using finger gesture recognition |
| CN109426334A (en) * | 2017-08-23 | 2019-03-05 | 北京京东尚科信息技术有限公司 | Information display method and device |
-
2021
- 2021-12-06 CN CN202111478452.7A patent/CN114138117B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012084190A (en) * | 2012-02-02 | 2012-04-26 | Fujitsu Ltd | Character input device, character input method and character input program |
| CN107077221A (en) * | 2014-09-29 | 2017-08-18 | 惠普发展公司有限责任合伙企业 | Dummy keyboard |
| WO2018012207A1 (en) * | 2016-07-12 | 2018-01-18 | 富士フイルム株式会社 | Image display system, head-mounted display control device, and operating method and operating program for same |
| US20190146653A1 (en) * | 2016-07-12 | 2019-05-16 | Fujifilm Corporation | Image display system, and control apparatus for head-mounted display and operation method therefor |
| CN106598249A (en) * | 2016-12-16 | 2017-04-26 | 广东欧珀移动通信有限公司 | Wrong touch prevention method and device for touch key, and mobile terminal |
| CN106775322A (en) * | 2016-12-23 | 2017-05-31 | 维沃移动通信有限公司 | A kind of method and mobile terminal for preventing virtual key false triggering |
| CN107168541A (en) * | 2017-04-07 | 2017-09-15 | 北京小鸟看看科技有限公司 | The implementation method and device of a kind of input |
| CN108984087A (en) * | 2017-06-02 | 2018-12-11 | 腾讯科技（深圳）有限公司 | Social interaction method and device based on three-dimensional avatars |
| WO2019004686A1 (en) * | 2017-06-26 | 2019-01-03 | 서울대학교산학협력단 | Keyboard input system and keyboard input method using finger gesture recognition |
| US20200117282A1 (en) * | 2017-06-26 | 2020-04-16 | Seoul National University R&Db Foundation | Keyboard input system and keyboard input method using finger gesture recognition |
| CN109426334A (en) * | 2017-08-23 | 2019-03-05 | 北京京东尚科信息技术有限公司 | Information display method and device |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117170505A (en) * | 2023-11-03 | 2023-12-05 | 南方科技大学 | Control method and system of virtual keyboard |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114138117B (en) | 2024-02-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9632698B2 (en) | Operation control device, operation control method and computer program | |
| EP1536316B1 (en) | Information display input device and information display input method, and information processing device | |
| JP5132028B2 (en) | User interface device | |
| JP2610114B2 (en) | Pointing system, computer system and force response method | |
| KR101087479B1 (en) | Multi display device and method for controlling the same | |
| KR101387270B1 (en) | Mobile terminal for displaying menu information accordig to trace of touch signal | |
| JP5625599B2 (en) | Information processing apparatus, information processing method, and program | |
| WO2011027611A1 (en) | Operation control device, operation control method and computer program | |
| US20120306740A1 (en) | Information input device using virtual item, control method therefor, and storage medium storing control program therefor | |
| US20090278806A1 (en) | Extended touch-sensitive control area for electronic device | |
| US20120113008A1 (en) | On-screen keyboard with haptic effects | |
| US20110057957A1 (en) | Information processing apparatus, information processing method, and program | |
| KR20170054503A (en) | Disambiguation of keyboard input | |
| CN102902471B (en) | Input interface switching method and input interface switching device | |
| GB2420479A (en) | Change of focus from mouse type cursor in a subwindow to block type cursor in a main window. | |
| KR20170078767A (en) | System and method of initiating elevator service by entering an elevator call | |
| US20180136837A1 (en) | Advanced virtual keyboard | |
| CN114138117A (en) | Virtual keyboard input method and system based on virtual reality scene | |
| CN112506415B (en) | Electronic device and method for electronic device | |
| CN111338554A (en) | Suspension ball operating system and method based on large-screen touch | |
| KR100984826B1 (en) | Portable terminal and user interface method thereof | |
| WO2016137839A1 (en) | Transparent full-screen text entry interface | |
| US20210064229A1 (en) | Control method of user interface and electronic device | |
| US10895969B2 (en) | Input apparatus acceptable of input through enlarged images in a display and computer-readable storage medium therefor | |
| KR101259297B1 (en) | Touch based mobile terminal and method for controlling soft keyboard in touch type mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |