CN114138117B - Virtual keyboard input method and system based on virtual reality scene - Google Patents
Virtual keyboard input method and system based on virtual reality scene Download PDFInfo
- Publication number
- CN114138117B CN114138117B CN202111478452.7A CN202111478452A CN114138117B CN 114138117 B CN114138117 B CN 114138117B CN 202111478452 A CN202111478452 A CN 202111478452A CN 114138117 B CN114138117 B CN 114138117B
- Authority
- CN
- China
- Prior art keywords
- layer
- virtual keyboard
- key
- virtual
- keyboard
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 29
- 230000004044 response Effects 0.000 claims abstract description 46
- 230000000694 effects Effects 0.000 claims abstract description 14
- 230000008569 process Effects 0.000 claims abstract description 5
- 230000001960 triggered effect Effects 0.000 claims abstract description 5
- 230000035484 reaction time Effects 0.000 claims description 8
- 238000001514 detection method Methods 0.000 claims description 7
- 238000005192 partition Methods 0.000 claims description 3
- 230000000630 rising effect Effects 0.000 claims 1
- 230000000007 visual effect Effects 0.000 abstract description 2
- 238000005516 engineering process Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000005282 brightening Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
- G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Abstract
The invention relates to the technical field of virtual reality input, in particular to a virtual keyboard input method and system based on a virtual reality scene. The method comprises the steps of dividing a virtual keyboard operation space into a selection layer, a locking layer and a triggering layer from far to near according to the distance between the virtual keyboard operation space and the bottom surface of the keyboard, and detecting the position of an operation device in a virtual reality space; when the operating device is detected to reach the selection layer of the virtual keyboard, starting a first response by a key corresponding to the contact position of the operating device; judging whether the operation device leaves the selection layer; if the user leaves the selection layer, the key at the contacted position starts a second response; if the key leaves the selection layer and then continues to downwards reach the locking layer, the key is locked; judging whether the operating device continues to reach the trigger layer downwards, and if so, triggering the key. According to the invention, the virtual keyboard space is designed in a layered manner, the level of the operating device is detected, the corresponding response is triggered, the wrong selection of keys is effectively prevented, and the response effect is set, so that the operating process is more visual and convenient.
Description
Technical Field
The invention relates to the technical field of virtual reality input, in particular to a virtual keyboard input method and system based on a virtual reality scene.
Background
With the progress of science and technology, virtual reality and augmented reality technologies are mature, and application fields are wider and wider. There is also increasing research around the branches of this technology field, especially in the field of user interaction with virtual reality scenes. At present, various interaction modes such as gesture recognition input, touch pad input, virtual keyboard input in a virtual reality scene and the like are realized.
The virtual keyboard is used for inputting in the virtual reality scene, so that the method has the advantages of no need of configuring hardware, more visual input interface and the like, and is widely applied. However, the existing virtual keyboard input mode has the problems that after key selection, no obvious prompt exists, the key is easy to be selected by mistake due to finger shake, and the input accuracy is affected.
Disclosure of Invention
Aiming at the problems, the invention further improves the virtual keyboard technology in the existing virtual reality scene, and controls the selection mode of keys and the response and function execution process of the selected keys when the virtual keyboard is operated, so that the virtual keyboard is more convenient to operate and more accurate to execute.
The specific technical scheme of the invention is as follows:
a virtual keyboard input method based on virtual reality scene designs the virtual keyboard operation space in a layered manner, takes the bottom surface of the keyboard as a reference surface, and is divided into a selection layer, a locking layer and a triggering layer from far to near according to the distance from the bottom surface of the keyboard; the input method based on the virtual keyboard comprises the following steps:
s1, displaying a virtual keyboard in a virtual reality space;
s2, detecting an operation device, and starting a first response by a key corresponding to the contact position of the operation device when the operation device is detected to reach a selection layer of the virtual keyboard;
s3, judging whether the operation device leaves the selection layer; if the key leaves the selection layer, the key at the contacted position starts a second response, wherein the second response is a reverse operation process of the first response, and the key state of the first response is restored; if the key leaves the selection layer and then continues to downwards reach the locking layer, the key is locked;
s4, judging whether the operating device continuously reaches the trigger layer downwards, and if so, triggering the key; if not, and detecting that the operating device returns to the selection layer, returning to the step S2, and if detecting that the operating device exits from the selection layer, returning to the step S1.
In step S2, if the system activates the first response button instead of the button to be selected by the user, the system may perform reselection by moving in the selection layer. When the operating device is positioned on the selection layer, judging whether the operating device translates on the selection layer, and if the operating device translates to other key positions, starting a second response by the key corresponding to the original position, and starting a first response by the key corresponding to the new position.
When key input is performed, some keys need to be input repeatedly, especially the function keys such as delete key and space key. If each input needs to be operated step by step, the input efficiency is low. Therefore, the invention designs an operation mode of automatic multiple triggering, namely in step S5, after the operation device reaches the triggering layer, the time of staying in the triggering layer is detected at the same time, and if the time exceeds the set time, the key is automatically triggered multiple times. A time interval can be set between the triggers, and key input is performed once every time interval until the operating device is detected to leave the virtual keyboard trigger layer.
The invention also designs a function for preventing the shaking false triggering of the operation device, which specifically comprises the following two schemes:
the first scheme is as follows: and a judging layer is further arranged on one side of the selecting layer, which is far away from the bottom surface of the keyboard, a certain distance is reserved between the judging layer and the selecting layer, and if the operating device is separated from the selecting layer and lifted to the judging layer, the key at the original contact position starts a second response.
The second scheme is as follows: setting a height threshold value on one side of the selection layer far away from the bottom surface of the keyboard, and lifting the operation device upwards after the operation device contacts the selection layer, wherein when the lifting height is smaller than the height threshold value, the system does not react; and when the lifting height is greater than or equal to the height threshold value, starting a second response by the key at the original contact position.
According to the scheme, whether the operation device briefly leaves the selection layer due to shaking is judged by judging the lifting height of the operation device after leaving the selection layer, so that frequent triggering of the first response due to shaking is avoided.
In order to prevent the operation device from triggering a plurality of key responses when contacting the selection layer, the invention selects keys according to the principle of first contact, only selects one key contacted first, sets the reaction time, contacts the other key in the reaction time, and the system does not respond. Ensuring that only one key can be selected at a time and preventing more than two keys from being popped up.
Further, in order to improve the display effect of key triggering, a layer of virtual keyboard is further arranged below the bottom surface of the keyboard, the keys on the virtual keyboard are in one-to-one correspondence with the keys on the bottom surface of the keyboard, if the operation device is detected to reach the triggering layer in the step S5, the keys at the contacted positions and the keys symmetrically arranged below the bottom surface of the keyboard synchronously move towards the bottom surface of the keyboard, and when the two keys are overlapped, a corresponding voice effect is emitted and the corresponding function of the keys is executed.
In the method, the system starts the first response to enable the selected key to be in different states from other unselected keys so as to know whether the key selection identified by the system is correct in advance. The first response may be one or more effects of the corresponding key being raised or enlarged or illuminated.
In the above method, the system starts the second response to restore the selected key to the same state as the other keys. The second response may be one or more of a decrease or a zoom out or a darkening of the corresponding key.
The virtual keyboard input system based on the virtual reality scene comprises an operation device, a virtual keyboard input device and a virtual keyboard input device, wherein the operation device is used for controlling an operation icon to move in a virtual keyboard space and selecting and triggering a virtual key;
the detection module is used for detecting the relative position of the operating device and the virtual keyboard area and sending the relative position to the control module;
the virtual keyboard comprises a virtual keyboard, wherein the bottommost surface displays a keyboard partition and key contents, and the virtual keyboard is divided into a selection layer, a locking layer and a triggering layer from far to near with reference to the bottom surface of the keyboard;
and the control module is used for controlling the response made by the virtual keyboard according to the relative position of the operating device and the virtual keyboard area.
The data detected by the detection module comprises:
whether the distance between the operating device and the virtual keyboard is smaller than a set threshold value or not;
the operating device translates at the level of the virtual keyboard space and at the selection level.
The input system of the invention also comprises a timing module which is used for calculating the stay time of the operating device at the selection layer or the locking layer of the virtual keyboard and sending the stay time to the control module.
The control module controlling the response of the virtual keyboard comprises:
when the distance between the operating device and the virtual keyboard is smaller than a set threshold value, the virtual keyboard area is lightened, and an operating icon is displayed in a virtual reality space;
when the operating device is positioned on the selection layer of the virtual keyboard, controlling a key corresponding to the contact position of the operating device to start a first response;
when the operation device moves in the selection layer, the original position key is controlled to start the second response, and the new position key starts the first response;
when the operating device is positioned on the locking layer of the virtual keyboard, locking a key corresponding to the position;
executing the function of the position key when the operating device is positioned on the triggering layer of the virtual keyboard;
and when the stay time of the operating device on the trigger layer exceeds the set time, executing the functions of the position keys for a plurality of times.
Preferably, the operating device is a hand or hand-worn device.
The invention has the beneficial effects that:
(1) Divide into the multilayer with virtual keyboard space, designed selection layer, locking layer and trigger layer, through the level that detects operating means and locate, just when touching virtual keyboard selection layer, know in advance whether the button of selecting is correct to in time change, lock the button after further pushing down simultaneously, can not change again, until reaching the trigger layer, trigger the button, will trigger button operation substep realization, effectively prevent the button misconnection, and through setting up response effect, make operation process more directly perceived more convenient.
(2) By setting selection principle and reaction time for the virtual keyboard selection layer, only one key can be selected at a time to perform first response, and final input errors caused by popping up a plurality of keys at a time are avoided.
(3) By setting the height threshold value for the virtual keyboard selection layer, the phenomenon that the selection layer is frequently triggered by hand shake is prevented from happening.
Drawings
FIG. 1 is a schematic diagram of embodiment 1 of the present invention;
FIG. 2 is a schematic diagram of a hierarchical structure of a virtual keyboard according to embodiment 1 of the present invention;
FIG. 3 is a flow chart of embodiment 2 of the present invention;
FIG. 4 is a diagram showing the triggering of the key in step S6 in embodiment 4 of the present invention;
in the figure, 1, a control module, 2, an operating device, 3, a detection module, 4, a virtual keyboard, 5, a timing module, 6, a judgment layer, 7, a selection layer, 8, a locking layer, 9, a triggering layer, 10 and a keyboard bottom surface.
Detailed Description
Embodiments of the present invention will be described in detail below with reference to the accompanying drawings and examples.
Example 1
The virtual keyboard input system based on the virtual reality scene comprises an operation device 2, a virtual keyboard 4, a detection module 3, a control module 1 and a timing module 5, wherein the operation device 2 can be a hand or hand-worn device, and an operation icon moves in a virtual keyboard space through movement of the operation device, so that virtual keys are selected and triggered. The detection module 3 may be an infrared sensor or a camera for detecting the position of the operating means and sending it to the control module. The bottommost surface of the virtual keyboard 4 displays the keyboard partition and key content, and is divided into a judging layer 6, a selecting layer 7, a locking layer 8 and a triggering layer 9 from far to near by referring to the keyboard bottom surface 10, and the layers are separated by a certain distance. The timing module 5 is used for calculating the stay time of the operating device at the selection layer or the locking layer of the virtual keyboard and sending the stay time to the control module. The control module 1 is used for controlling the response made by the virtual keyboard according to the relative positions of the operating device and the virtual keyboard area.
Example 2
A virtual keyboard input method based on a virtual reality scene, as shown in FIG. 3, comprises the following steps:
s1, initializing a system, and displaying a virtual keyboard in a virtual reality space.
And S2, when the finger is detected to be close to the virtual keyboard (the distance is smaller than the set threshold value), displaying the finger icon in the virtual reality space, reflecting the position of the finger icon in the virtual keyboard area in real time, and simultaneously lighting the keyboard of the finger close area.
And S3, when the finger is detected to reach the selection layer of the virtual keyboard, the key corresponding to the contact position of the finger is vertically lifted and is clung to the finger.
The selection layer determines the selected keys according to the principle of first contact. The key at the first contact position of the finger is lifted, and the key contacted again in a short time cannot respond, so that the effect that only one key can be selected at a time is achieved, and more than two keys are prevented from being popped up at the same time.
The system can be realized by setting the reaction time of the system to be 0.2 seconds, for example, after one key is selected, the next key is selected to be effective only at intervals of more than 0.2 seconds, and the selection made within 0.2 seconds is regarded as invalid operation, so that the system does not respond.
S4, after the finger selects the key at the selection layer, judging whether the finger translates to other key positions, if so, returning to S3, descending the original key, returning to the original position, and lifting and displaying the newly selected key; if the finger does not translate, the next step is entered.
S5, detecting whether the finger leaves the selection layer; if the user leaves the selection layer, lifting the displayed key to descend and return to the original position; if the finger is detected to leave the selection layer and then continuously reach the locking layer downwards, the key is also lowered to the original position, the key is locked at the same time, and other keys cannot be replaced through translation after the key is locked.
S6, detecting whether the finger passes through the locking layer and continuously reaches the triggering layer downwards, if so, triggering the key, inputting information corresponding to the key or executing corresponding functions; if not, returning to the step S3 and reselecting the key after detecting that the finger returns to the selection layer; if the finger is detected to exit the selection layer, the system returns to the initial state.
Example 3
A virtual keyboard input method based on a virtual reality scene comprises the following steps:
s1, initializing a system, and displaying a virtual keyboard in a virtual reality space.
And S2, when the finger is detected to be close to the virtual keyboard (the distance is smaller than the set threshold value), displaying the finger icon in the virtual reality space, reflecting the position of the finger icon in the virtual keyboard area in real time, and simultaneously lighting the keyboard of the finger close area.
And S3, when the finger is detected to reach the selection layer of the virtual keyboard, the key corresponding to the finger contact position is enlarged.
The selection layer determines the selected keys according to the principle of first contact. The key at the first contact position of the finger is enlarged, and the key contacted again in a short time cannot respond, so that the effect that only one key can be selected at a time is achieved, and more than two keys are prevented from being popped up at the same time.
The system can be realized by setting the reaction time of the system to be 0.2 seconds, for example, after one key is selected, the next key is selected to be effective only at intervals of more than 0.2 seconds, and the selection made within 0.2 seconds is regarded as invalid operation, so that the system does not respond.
The system provides for preventing finger jitter from causing frequent triggering of the select layer function. The function is realized by the following scheme:
firstly, designing a judging layer at one side of the virtual keyboard selecting layer far away from the bottom surface of the keyboard at a certain distance, wherein when a finger reaches the judging layer for the first time, the system does not react; when the finger reaches the selection layer, after the selected key is enlarged, the finger slightly lifts up again, and if the finger does not reach the judgment layer, the system does not react; if the finger exceeds the height of the judging layer, the user considers that the finger leaves the keyboard operation and the key state is restored.
And secondly, setting a height threshold value on one side of the virtual keyboard selection layer far away from the bottom surface of the keyboard, lifting the virtual keyboard after the finger contacts the selection layer, and if the height of the lifting does not exceed the height threshold value, not responding by the system. Only when the height of the finger is raised above the height threshold, the system considers that the finger is to leave the keyboard, and the selected key is restored.
S4, after the finger selects the key at the selection layer, judging whether the finger translates to other key positions, if so, returning to S3, wherein the original key is smaller, and the newly selected key is larger; if the finger does not translate, the next step is entered.
S5, detecting whether the finger leaves the selection layer; if the key leaves the selection layer, the key displayed in a larger size is reduced; if the finger is detected to leave the selection layer and then continuously reach the locking layer downwards, the key is reduced and restored, the key is locked at the same time, and other keys cannot be replaced through translation after the key is locked.
S6, detecting whether the finger passes through the locking layer and continuously reaches the triggering layer downwards, if so, triggering the key, inputting information corresponding to the key or executing corresponding functions; if not, returning to the step S3 and reselecting the key after detecting that the finger returns to the selection layer; if the finger is detected to exit the selection layer, the system returns to the initial state.
S7, after the finger reaches the trigger layer, detecting the stay time of the finger at the trigger layer, setting a time threshold (such as 1 second), and if the time is not exceeded, executing one input; if the set time is exceeded, the system starts to trigger the key operation for a plurality of times, and a time interval is set between the plurality of times of input, for example, after the 2 nd time of input of the key, no finger removal is detected at the interval of 0.1 second, the 3 rd time of input is continued, and after the finger removal is detected, the input is stopped.
For the multi-triggering implementation of step S7, it may also be determined whether to start the multi-triggering by detecting whether the finger continues to press down after touching the triggering layer.
Example 4
A virtual keyboard input method based on virtual reality scene designs the virtual keyboard operation space in a layered manner, takes the bottom surface of the keyboard as a reference surface, and is divided into a selection layer, a locking layer and a triggering layer from far to near according to the distance from the bottom surface of the keyboard; the input method comprises the following steps:
s1, initializing a system, and displaying a virtual keyboard in a virtual reality space.
And S2, when the finger is detected to be close to the virtual keyboard (the distance is smaller than the set threshold value), displaying the finger icon in the virtual reality space, reflecting the position of the finger icon in the virtual keyboard area in real time, and simultaneously lighting the keyboard of the finger close area.
And S3, when the finger is detected to reach the selection layer of the virtual keyboard, the key corresponding to the contact position of the finger is lightened.
The selection layer determines the selected keys according to the principle of first contact. The key at the first contact position of the finger is lightened, and the key contacted again in a short time cannot respond, so that the effect that only one key can be selected at a time is achieved, and more than two keys are prevented from being popped up at the same time.
The system can be realized by setting the reaction time of the system to be 0.2 seconds, for example, after one key is selected, the next key is selected to be effective only at intervals of more than 0.2 seconds, and the selection made within 0.2 seconds is regarded as invalid operation, so that the system does not respond.
The system provides for preventing finger jitter from causing frequent triggering of the select layer function. The function is realized by the following scheme:
firstly, designing a judging layer at one side of the virtual keyboard selecting layer far away from the bottom surface of the keyboard at a certain distance, wherein when a finger reaches the judging layer for the first time, the system does not react; when the finger reaches the selection layer, after the selected key is lightened, the finger slightly lifts up again, and if the finger does not reach the judgment layer, the system does not react; if the finger exceeds the height of the judging layer, the user considers that the finger leaves the keyboard operation and the key state is restored.
And secondly, setting a height threshold value on one side of the virtual keyboard selection layer far away from the bottom surface of the keyboard, lifting the virtual keyboard after the finger contacts the selection layer, and if the height of the lifting does not exceed the height threshold value, not responding by the system. Only when the height of the finger is raised above the height threshold, the system considers that the finger is to leave the keyboard, and the selected key is restored.
S4, after the finger selects the key at the selection layer, judging whether the finger translates to other key positions, if so, returning to S3, darkening the original key, and brightening the reselected new key; if the finger does not translate, the next step is entered.
S5, detecting whether the finger leaves the selection layer; if the user leaves the selection layer, the key which is highlighted is darkened and restored; if the finger is detected to leave the selection layer and then continuously reach the locking layer downwards, the key is darkened and restored, meanwhile, the key is locked, and other keys cannot be replaced through translation after the key is locked.
S6, detecting whether the finger passes through the locking layer and continuously reaches the triggering layer downwards, if so, triggering the key, inputting information corresponding to the key or executing corresponding functions; if not, returning to the step S3 and reselecting the key after detecting that the finger returns to the selection layer; if the finger is detected to exit the selection layer, the system returns to the initial state.
In order to improve the display effect of the triggering keys, a layer of virtual keyboard is arranged below the bottom surface of the keyboard, the keys on the virtual keyboard are in one-to-one correspondence with the keys on the bottom surface of the keyboard, if the operation device is detected to reach the triggering layer, the keys at the contacted positions and the keys symmetrically arranged below the bottom surface of the keyboard synchronously move towards the bottom surface of the keyboard, and when the two keys are overlapped, the corresponding voice effect is sent out, and the corresponding functions of the keys are executed. (as in FIG. 4)
S7, after the finger reaches the trigger layer, detecting the stay time of the finger at the trigger layer, setting a time threshold (such as 1 second), and if the time is not exceeded, executing one input; if the set time is exceeded, the system starts to trigger the key operation for a plurality of times, and a time interval is set between the plurality of times of input, for example, after the 2 nd time of input of the key, no finger removal is detected at the interval of 0.1 second, the 3 rd time of input is continued, and after the finger removal is detected, the input is stopped. When triggering for many times, a certain sound effect can be set to prompt the user.
Claims (14)
1. The virtual keyboard input method based on the virtual reality scene is characterized in that the virtual keyboard operation space is designed in a layered manner, the bottom surface of the keyboard is taken as a reference surface, and the virtual keyboard is divided into a selection layer, a locking layer and a triggering layer from far to near according to the distance between the keyboard and the bottom surface of the keyboard; the input method based on the virtual keyboard comprises the following steps:
s1, displaying a virtual keyboard in a virtual reality space;
s2, detecting an operation device, and starting a first response by a key corresponding to the contact position of the operation device when the operation device is detected to reach a selection layer of the virtual keyboard;
s3, judging whether the operation device leaves the selection layer; if the key leaves the selection layer, the key at the contacted position starts a second response, wherein the second response is a reverse operation process of the first response, and the key state of the first response is restored; if the key leaves the selection layer and then continues to downwards reach the locking layer, the key is locked;
s4, judging whether the operating device continuously reaches the trigger layer downwards, and if so, triggering the key; if not, and detecting that the operating device returns to the selection layer, returning to the step S2, and if detecting that the operating device exits from the selection layer, returning to the step S1.
2. The virtual reality scene-based virtual keyboard input method of claim 1, wherein: in step S2, it is determined whether the operation device translates in the selection layer, if translating to other key positions, the key corresponding to the home position starts the second response, and the key corresponding to the new position starts the first response.
3. The virtual reality scene-based virtual keyboard input method of claim 1, wherein: in step S5, after the operation device reaches the trigger layer, the time of stay in the trigger layer is detected at the same time, and if the time exceeds the set time, the key is automatically triggered multiple times.
4. The virtual reality scene-based virtual keyboard input method of claim 1, wherein: and a judging layer is further arranged on one side of the selecting layer, which is far away from the bottom surface of the keyboard, a certain distance is reserved between the judging layer and the selecting layer, and if the operating device is separated from the selecting layer and lifted to the judging layer, the key at the original contact position starts a second response.
5. The virtual reality scene-based virtual keyboard input method of claim 1, wherein: setting a height threshold value on one side of the selection layer far away from the bottom surface of the keyboard, and lifting the operation device upwards after the operation device contacts the selection layer, wherein when the lifting height is smaller than the height threshold value, the system does not react; and when the lifting height is greater than or equal to the height threshold value, starting a second response by the key at the original contact position.
6. The virtual reality scene-based virtual keyboard input method of claim 1, wherein: in step S2, the selection layer selects keys according to the principle of first contact, only one key in first contact is selected, the reaction time is set, the other key is contacted in the reaction time, and the system does not respond.
7. The virtual reality scene-based virtual keyboard input method of claim 1, wherein: and a layer of virtual keyboard is arranged below the bottom surface of the keyboard, keys on the virtual keyboard are in one-to-one correspondence with keys on the bottom surface of the keyboard, if the operation device is detected to reach the trigger layer in the step S5, the keys at the contacted positions and the keys symmetrically arranged below the bottom surface of the keyboard synchronously move towards the bottom surface of the keyboard, and when the two keys are overlapped, a corresponding voice effect is emitted and the corresponding functions of the keys are executed.
8. The virtual reality scene-based virtual keyboard input method of claim 1 or 2, characterized by: the first response generates one or more effects of rising, becoming larger or emitting light for the corresponding key.
9. The virtual reality scene-based virtual keyboard input method of claim 1 or 2 or 4 or 5, characterized by: and the second response generates one or more effects of descending, shrinking or darkening for the corresponding key.
10. A virtual keyboard input system based on a virtual reality scene is characterized in that: the virtual keyboard comprises an operation device, a virtual keyboard and a virtual keyboard, wherein the operation device is used for controlling an operation icon to move in a virtual keyboard space and selecting and triggering a virtual key;
the detection module is used for detecting the relative position of the operating device and the virtual keyboard area and sending the relative position to the control module;
the virtual keyboard comprises a virtual keyboard, wherein the bottommost surface displays a keyboard partition and key contents, the bottom surface of the virtual keyboard is divided into a selection layer, a locking layer and a triggering layer from far to near, and when an operating device is positioned on the selection layer of the virtual keyboard, keys corresponding to contact positions of the operating device start first responses; when the operating device is positioned on the locking layer of the virtual keyboard, locking a key corresponding to the position; executing the function of the position key when the operating device is positioned on the triggering layer of the virtual keyboard;
and the control module is used for controlling the response made by the virtual keyboard according to the relative position of the operating device and the virtual keyboard area.
11. The virtual reality scene-based virtual keyboard input system of claim 10, wherein: the data detected by the detection module comprises:
whether the distance between the operating device and the virtual keyboard is smaller than a set threshold value or not;
the operating device translates at the level of the virtual keyboard space and at the selection level.
12. The virtual reality scene-based virtual keyboard input system of claim 11, wherein: the control module is used for controlling the operation device to stop at the selection layer or the locking layer of the virtual keyboard according to the time of the operation device.
13. The virtual reality scenario-based virtual keyboard input system of claim 12, wherein: the control module controlling the response of the virtual keyboard comprises:
when the distance between the operating device and the virtual keyboard is smaller than a set threshold value, the virtual keyboard area is lightened, and an operating icon is displayed in a virtual reality space;
when the operating device is positioned on the selection layer of the virtual keyboard, controlling a key corresponding to the contact position of the operating device to start a first response;
when the operation device moves in the selection layer, the original position key is controlled to start the second response, and the new position key starts the first response;
when the operating device is positioned on the locking layer of the virtual keyboard, locking a key corresponding to the position;
executing the function of the position key when the operating device is positioned on the triggering layer of the virtual keyboard;
and when the stay time of the operating device on the trigger layer exceeds the set time, executing the functions of the position keys for a plurality of times.
14. The virtual reality scene-based virtual keyboard input system of claim 10, wherein: the operating device is a hand or hand-worn device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111478452.7A CN114138117B (en) | 2021-12-06 | 2021-12-06 | Virtual keyboard input method and system based on virtual reality scene |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111478452.7A CN114138117B (en) | 2021-12-06 | 2021-12-06 | Virtual keyboard input method and system based on virtual reality scene |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114138117A CN114138117A (en) | 2022-03-04 |
| CN114138117B true CN114138117B (en) | 2024-02-13 |
Family
ID=80384366
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111478452.7A Active CN114138117B (en) | 2021-12-06 | 2021-12-06 | Virtual keyboard input method and system based on virtual reality scene |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114138117B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117170505A (en) * | 2023-11-03 | 2023-12-05 | 南方科技大学 | Control method and system of virtual keyboard |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012084190A (en) * | 2012-02-02 | 2012-04-26 | Fujitsu Ltd | Character input device, character input method and character input program |
| CN106598249A (en) * | 2016-12-16 | 2017-04-26 | 广东欧珀移动通信有限公司 | Wrong touch prevention method and device for touch key, and mobile terminal |
| CN106775322A (en) * | 2016-12-23 | 2017-05-31 | 维沃移动通信有限公司 | A kind of method and mobile terminal for preventing virtual key false triggering |
| CN107077221A (en) * | 2014-09-29 | 2017-08-18 | 惠普发展公司有限责任合伙企业 | Dummy keyboard |
| CN107168541A (en) * | 2017-04-07 | 2017-09-15 | 北京小鸟看看科技有限公司 | The implementation method and device of a kind of input |
| WO2018012207A1 (en) * | 2016-07-12 | 2018-01-18 | 富士フイルム株式会社 | Image display system, head-mounted display control device, and operating method and operating program for same |
| CN108984087A (en) * | 2017-06-02 | 2018-12-11 | 腾讯科技（深圳）有限公司 | Social interaction method and device based on three-dimensional avatars |
| WO2019004686A1 (en) * | 2017-06-26 | 2019-01-03 | 서울대학교산학협력단 | Keyboard input system and keyboard input method using finger gesture recognition |
| CN109426334A (en) * | 2017-08-23 | 2019-03-05 | 北京京东尚科信息技术有限公司 | Information display method and device |
-
2021
- 2021-12-06 CN CN202111478452.7A patent/CN114138117B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012084190A (en) * | 2012-02-02 | 2012-04-26 | Fujitsu Ltd | Character input device, character input method and character input program |
| CN107077221A (en) * | 2014-09-29 | 2017-08-18 | 惠普发展公司有限责任合伙企业 | Dummy keyboard |
| WO2018012207A1 (en) * | 2016-07-12 | 2018-01-18 | 富士フイルム株式会社 | Image display system, head-mounted display control device, and operating method and operating program for same |
| CN106598249A (en) * | 2016-12-16 | 2017-04-26 | 广东欧珀移动通信有限公司 | Wrong touch prevention method and device for touch key, and mobile terminal |
| CN106775322A (en) * | 2016-12-23 | 2017-05-31 | 维沃移动通信有限公司 | A kind of method and mobile terminal for preventing virtual key false triggering |
| CN107168541A (en) * | 2017-04-07 | 2017-09-15 | 北京小鸟看看科技有限公司 | The implementation method and device of a kind of input |
| CN108984087A (en) * | 2017-06-02 | 2018-12-11 | 腾讯科技（深圳）有限公司 | Social interaction method and device based on three-dimensional avatars |
| WO2019004686A1 (en) * | 2017-06-26 | 2019-01-03 | 서울대학교산학협력단 | Keyboard input system and keyboard input method using finger gesture recognition |
| CN109426334A (en) * | 2017-08-23 | 2019-03-05 | 北京京东尚科信息技术有限公司 | Information display method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114138117A (en) | 2022-03-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP5132028B2 (en) | User interface device | |
| KR101589104B1 (en) | Providing keyboard shortcuts mapped to a keyboard | |
| JP5182260B2 (en) | Operation control device, operation control method, and computer program | |
| US20220261090A1 (en) | System and method for multi-mode command input | |
| JP4688007B2 (en) | Display control apparatus, display control method, and program | |
| JP5593655B2 (en) | Information processing apparatus, information processing method, and program | |
| CN102224483B (en) | Touch-sensitive display screen with absolute and relative input modes | |
| US20120113008A1 (en) | On-screen keyboard with haptic effects | |
| KR101617645B1 (en) | Method for controlling display and apparatus using the same | |
| EP1745456A2 (en) | An improved method for scrolling and edge motion on a touchpad | |
| RU2587416C2 (en) | Selecting objects on display device | |
| JP2011053974A (en) | Device and method for controlling operation, and computer program | |
| GB2411559A (en) | Change of focus from step type in one window to mouse type cursor in second window | |
| JP2012037978A (en) | Information processing device, information processing method, and program | |
| CN114138117B (en) | Virtual keyboard input method and system based on virtual reality scene | |
| KR20100030388A (en) | Touch screen | |
| US11847268B2 (en) | Reprogramable multi-host, multi-character set keyboard | |
| US20210064229A1 (en) | Control method of user interface and electronic device | |
| CN107665053B (en) | Wearable electronic equipment and man-machine interaction method suitable for same | |
| CN112218063A (en) | Method for controlling projection content and electronic device | |
| KR101204495B1 (en) | Method AND TERMINAL UNIT FOR CONTROLLING SCREEN USING POINTING DEVICE |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |