CN115113795A - Virtual keyboard calibration method, device, electronic equipment and medium - Google Patents
Virtual keyboard calibration method, device, electronic equipment and medium Download PDFInfo
- Publication number
- CN115113795A CN115113795A CN202210578609.1A CN202210578609A CN115113795A CN 115113795 A CN115113795 A CN 115113795A CN 202210578609 A CN202210578609 A CN 202210578609A CN 115113795 A CN115113795 A CN 115113795A
- Authority
- CN
- China
- Prior art keywords
- key
- keyboard
- target
- virtual
- virtual keyboard
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
- G06F3/0202—Constructional details or processes of manufacture of the input device
- G06F3/0219—Special purpose keyboards
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
- G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
- G06F3/0233—Character input methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
- G06V30/14—Image acquisition
- G06V30/1444—Selective acquisition, locating or processing of specific regions, e.g. highlighted text, fiducial marks or predetermined fields
- G06V30/1456—Selective acquisition, locating or processing of specific regions, e.g. highlighted text, fiducial marks or predetermined fields based on user interactions
Abstract
The present disclosure relates to a method, an apparatus, an electronic device and a medium for calibrating a virtual keyboard, and in particular, to the field of virtual reality technology; wherein, the method comprises the following steps: responding to a first trigger operation of a user on a target key of a target keyboard, and acquiring first induction data; acquiring a virtual key corresponding to the first sensing data based on the corresponding relation between the first sensing data and the virtual key in the virtual keyboard, wherein the virtual keyboard is displayed in a display interface of virtual reality head-mounted display equipment worn by a user; responding to a second trigger operation of the user on a target key of the target keyboard, and determining the target key; and calibrating the virtual keyboard based on whether the virtual keys are consistent with the target keys. The embodiment of the disclosure can calibrate the virtual keyboard, and is beneficial to improving the accuracy and efficiency of virtual keyboard input.
Description
Technical Field
The present disclosure relates to the field of virtual reality technologies, and in particular, to a method and an apparatus for calibrating a virtual keyboard, an electronic device, and a medium.
Background
With the development of science and technology, the meta universe is an important direction in the future, and Virtual Reality (VR) office is an important scene in the meta universe. The user can present a plurality of virtual display screens through virtual interaction, simulate a plurality of screen displays in a real physical environment, and the most common interactive device for the virtual screens is a virtual keyboard. However, in the prior art, a calibration process for the virtual keyboard is not involved, which easily causes misoperation, causes low accuracy and efficiency of virtual keyboard input, and affects user experience.
Disclosure of Invention
In order to solve the above technology or at least partially solve the above technical problem, the present disclosure provides a virtual keyboard calibration method, apparatus, electronic device, and medium, which can calibrate a virtual keyboard, thereby facilitating to improve accuracy and efficiency of virtual keyboard input, and improving user experience.
In order to achieve the above purpose, the technical solutions provided by the embodiments of the present disclosure are as follows:
in a first aspect, the present disclosure provides a virtual keyboard calibration method, including:
responding to a first trigger operation of a user on a target key of a target keyboard, and acquiring first induction data;
acquiring a virtual key corresponding to the first sensing data based on the corresponding relation between the first sensing data and the virtual key in a virtual keyboard, wherein the virtual keyboard is displayed in a display interface of virtual reality head-mounted display equipment worn by the user;
responding to a second triggering operation of the user on the target key of the target keyboard, and determining the target key;
calibrating the virtual keyboard based on whether the virtual keys are consistent with the target keys.
As an optional implementation manner of the embodiment of the present disclosure, the calibrating the virtual keyboard based on whether the virtual key is consistent with the target key includes:
if the virtual key is inconsistent with the target key, second induction data corresponding to the second trigger operation is acquired;
and calibrating the virtual keyboard according to the second sensing data and the target key until the virtual key is consistent with the target key.
As an optional implementation manner of the embodiment of the present disclosure, the calibrating the virtual keyboard based on whether the virtual key is consistent with the target key includes:
if the virtual key is inconsistent with the target key, responding to a second triggering operation of the user on a preset key in the target keyboard, and acquiring third induction data;
and calibrating the virtual keyboard according to the third sensing data and the virtual key corresponding to the third sensing data in the virtual keyboard.
As an optional implementation manner of the embodiment of the present disclosure, the virtual keyboard is obtained by:
acquiring a target image corresponding to the target keyboard;
modeling keys contained in the target image to obtain a virtual keyboard display model corresponding to the target keyboard;
performing character recognition on the keys contained in the target image, and determining character information corresponding to each key;
and displaying the character information on a corresponding key model in the virtual keyboard display model to obtain the virtual keyboard.
As an optional implementation manner of the embodiment of the present disclosure, the modeling the key included in the target image to obtain a virtual keyboard display model corresponding to the target keyboard includes:
performing image detection on the keys contained in the target image to obtain first coordinate data of edge feature points corresponding to each key and second coordinate data of a rectangular area containing all the keys;
and carrying out graphic modeling based on the first coordinate data and the second coordinate data to obtain a virtual keyboard display model corresponding to the target keyboard.
As an optional implementation manner of the embodiment of the present disclosure, the method further includes:
determining character prompt information corresponding to each key based on the type of the input method used by the user;
and displaying the character prompt information on a corresponding key model in the virtual keyboard display model to obtain a virtual keyboard corresponding to the input method type.
As an optional implementation manner of the embodiment of the present disclosure, a keyboard soft film with a built-in touch sensor is covered on the target keyboard;
the acquiring of the first sensing data in response to the first triggering operation of the user on the target key of the target keyboard comprises:
and responding to a first trigger operation of a user on a target key of the target keyboard, and acquiring first sensing data through a keyboard soft film with a built-in touch sensor.
In a second aspect, the present disclosure provides a virtual keyboard calibration apparatus, the apparatus comprising:
the first acquisition module is used for responding to a first trigger operation of a user on a target key of a target keyboard and acquiring first induction data;
a second obtaining module, configured to obtain a virtual key corresponding to the first sensing data based on a corresponding relationship between the first sensing data and a virtual key in a virtual keyboard, where the virtual keyboard is displayed in a display interface of a virtual reality head-mounted display device worn by the user;
the key determining module is used for responding to a second triggering operation of the user on the target key of the target keyboard and determining the target key;
and the calibration module is used for calibrating the virtual keyboard based on whether the virtual key is consistent with the target key or not.
As an optional implementation manner of the embodiment of the present disclosure, the calibration module is specifically configured to:
if the virtual key is inconsistent with the target key, second induction data corresponding to the second trigger operation is obtained;
and calibrating the virtual keyboard according to the second sensing data and the target key until the virtual key is consistent with the target key.
As an optional implementation manner of the embodiment of the present disclosure, the calibration module is further specifically configured to:
if the virtual key is inconsistent with the target key, responding to a second triggering operation of the user on a preset key in the target keyboard, and acquiring third induction data;
and calibrating the virtual keyboard according to the third induction data and the virtual key corresponding to the third induction data in the virtual keyboard.
As an optional implementation manner of the embodiment of the present disclosure, the apparatus further includes: a virtual keyboard determination module;
the virtual keyboard determination module comprises:
the image acquisition unit is used for acquiring a target image corresponding to the target keyboard;
the display model determining unit is used for modeling the keys contained in the target image to obtain a virtual keyboard display model corresponding to the target keyboard;
the character information determining unit is used for carrying out character recognition on the keys contained in the target image and determining character information corresponding to each key;
and the virtual keyboard determining unit is used for displaying the character information on a corresponding key model in the virtual keyboard display model to obtain the virtual keyboard.
As an optional implementation manner of the embodiment of the present disclosure, the display model determining unit is specifically configured to:
performing image detection on the keys contained in the target image to obtain first coordinate data of edge feature points corresponding to each key and second coordinate data of a rectangular area containing all the keys;
and carrying out graphic modeling based on the first coordinate data and the second coordinate data to obtain a virtual keyboard display model corresponding to the target keyboard.
As an optional implementation manner of the embodiment of the present disclosure, the virtual keyboard determining module further includes:
the prompt information determining unit is used for determining character prompt information corresponding to each key based on the type of the input method used by the user;
the virtual keyboard determining unit is specifically configured to: and displaying the character prompt information on a corresponding key model in the virtual keyboard display model to obtain a virtual keyboard corresponding to the input method type.
As an optional implementation manner of the embodiment of the present disclosure, a keyboard soft film with a built-in touch sensor is covered on the target keyboard;
the first obtaining module is specifically configured to: and responding to a first trigger operation of a user on a target key of the target keyboard, and acquiring first sensing data through a keyboard soft film with a built-in touch sensor.
In a third aspect, the present disclosure also provides an electronic device, including:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the virtual keyboard calibration method of any of the embodiments of the present disclosure.
In a fourth aspect, the present disclosure also provides a computer-readable storage medium, on which a computer program is stored, which when executed by a processor, implements the virtual keyboard calibration method according to any one of the embodiments of the present disclosure.
Compared with the prior art, the technical scheme provided by the embodiment of the disclosure has the following advantages: the method comprises the steps of firstly responding to a first trigger operation of a user on a target key of a target keyboard to obtain first induction data, then obtaining a virtual key corresponding to the first induction data based on the corresponding relation between the first induction data and the virtual key in the virtual keyboard, wherein the virtual keyboard is displayed in a display interface of virtual reality head-mounted display equipment worn by the user, then responding to a second trigger operation of the user on the target key of the target keyboard to determine the target key, and finally calibrating the virtual keyboard based on whether the virtual key is consistent with the target key.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present disclosure, the drawings used in the description of the embodiments or prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive exercise.
Fig. 1A is a block diagram of a hardware configuration of an electronic device according to one or more embodiments of the present disclosure;
fig. 1B is a software configuration diagram of an electronic device according to one or more embodiments of the present disclosure;
fig. 2A is a schematic flowchart of a virtual keyboard calibration method according to an embodiment of the present disclosure;
fig. 2B is a schematic diagram illustrating a virtual keyboard calibration method according to an embodiment of the disclosure;
fig. 3A is a schematic flowchart of another virtual keyboard calibration method according to an embodiment of the present disclosure;
FIG. 3B is a schematic diagram illustrating another virtual keyboard calibration method according to an embodiment of the present disclosure;
fig. 4A is a schematic flowchart of another virtual keyboard calibration method according to an embodiment of the present disclosure;
FIG. 4B is a schematic diagram illustrating another virtual keyboard calibration method according to an embodiment of the present disclosure;
fig. 5A is a schematic flowchart of a method for determining a virtual keyboard according to an embodiment of the present disclosure;
fig. 5B is a schematic diagram illustrating a virtual keyboard determining method according to an embodiment of the present disclosure;
fig. 5C is a schematic diagram of a virtual keyboard display model according to an embodiment of the disclosure;
fig. 5D is a schematic diagram of a virtual keyboard according to an embodiment of the disclosure;
fig. 6A is a schematic diagram illustrating a principle of obtaining a virtual keyboard display model according to an embodiment of the present disclosure;
fig. 6B is a schematic diagram of another schematic diagram for obtaining a virtual keyboard display model according to an embodiment of the present disclosure;
fig. 7A is a schematic diagram illustrating a principle of obtaining a virtual keyboard corresponding to an input method type according to an embodiment of the present disclosure;
fig. 7B is a schematic diagram of character prompt information based on a five-stroke input method according to an embodiment of the present disclosure;
fig. 7C is a schematic diagram of a virtual keyboard based on a foreign language input method according to an embodiment of the present disclosure;
fig. 8 is a schematic structural diagram of a virtual keyboard calibration apparatus provided in an embodiment of the present disclosure;
fig. 9 is a schematic structural diagram of an electronic device provided in an embodiment of the present disclosure.
Detailed Description
In order that the above objects, features and advantages of the present disclosure may be more clearly understood, aspects of the present disclosure will be further described below. It should be noted that the embodiments and features of the embodiments of the present disclosure may be combined with each other without conflict.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure, but the present disclosure may be practiced in other ways than those described herein; it is to be understood that the embodiments disclosed in the specification are only a few embodiments of the present disclosure, and not all embodiments.
The terms "first" and "second," etc. in this disclosure are used to distinguish between different objects, rather than to describe a particular order of objects. For example, the first sensing data, the second sensing data, and the like are used to distinguish different sensing data, not a specific order for the sensing data.
With the continuous development of science and technology and the diversified development of market demands, head-mounted display devices such as virtual reality devices are becoming more and more popular and are applied to many fields such as computer games, offices, health and safety, industry, education and training and the like. For example, hybrid virtual reality systems are being integrated into various corners of life such as mobile communication devices, game machines, personal computers, movie theaters, theme parks, laboratories, classrooms, and hospital exercise gyms.
Taking a VR head-mounted display device as an example, by simulating the positions of both eyes of a user, two color or black and white video cameras are fixed on the VR head-mounted display device according to the positions of both eyes of the user, an external real physical three-dimensional environment can be captured in real time, then images captured by the two color or black and white video cameras are processed in real time through a stereoscopic vision and image rendering technology of a computer, and finally the images are presented to the user through the VR head-mounted display device, and the user can view the external real physical three-dimensional environment in real time through the VR head-mounted display device, and the function is called as a perspective function of virtual reality.
In the perspective function of virtual reality, a typical application scenario is virtual office. Users have a great deal of keyboard input requirements during working with VR. If the physical keyboard is directly used for inputting, the user cannot clearly see the position of the physical keyboard when wearing the VR head-mounted display equipment, so that the error rate of keyboard input is high, even if part of keys in the physical keyboard have convex points for auxiliary positioning, English letters are easy to input, and other keys on the physical keyboard, including auxiliary keys such as 0-9 numbers, punctuation marks, deletion, backspacing and the like, are difficult to input; if the VR equipment with the gesture recognition function is used, although the positions of two hands can be captured by the VR equipment, the positions of a keyboard cannot be captured, and the fingers of a user can block the visual field of a camera of the VR equipment, so that keyboard keys under other fingers except a thumb and an index finger cannot be judged.
At present, the following methods are available for solving the problem of keyboard input in VR:
1. and opening a perspective window mode for the keyboard position in the VR virtual space so as to see the physical keyboard and the user's two-hand position collected by the camera from the window.
2. The method is characterized in that a special keyboard is customized, for example, markers (marks) are added at four corners of the keyboard, a virtual keyboard corresponding to the key layout and the real-time position of a physical keyboard is reconstructed in a virtual space in real time, and then the gesture recognition technology is combined to facilitate input.
However, in the mode 1, the camera of the VR device is required to clearly identify the outline of the physical keyboard, and high-definition acquisition and display are performed, the resolution requirement of the camera is high, and the current camera built in the VR device is difficult to meet; in the mode 2, a special keyboard with high cost needs to be customized, the keyboard is not easy to popularize, and the key position shielded by the finger of the user cannot be acquired by the camera, so that the error is still easy to occur.
To the problem that makes mistakes easily among the keyboard input process in above-mentioned VR, this problem of solution that virtual keyboard can be fine. In this embodiment, when a user operates with a target keyboard, a virtual keyboard is displayed in a display interface of a VR head-mounted display device worn by the user, and first, an operating system of the VR head-mounted display device can respond to a touch operation of the user on a target key of the target keyboard (the touch operation may be understood as a contact operation on the target key, but the target key is not pressed down), obtain first sensing data, and obtain a virtual key corresponding to the first sensing data based on a corresponding relationship between the first sensing data and the virtual key; then the operating system responds to key input operation (the key input operation can be understood as pressing down the target key) of the target key of the target keyboard by the user, and determines the target key; finally, the operating system can calibrate the virtual keyboard based on whether the virtual keys are consistent with the target keys, the virtual keyboard can be calibrated in the mode, the accuracy and the efficiency of virtual keyboard input are improved, a new keyboard does not need to be introduced, the existing keyboard interaction mode does not need to be changed, and the use experience of a user can be improved.
The virtual keyboard calibration method provided by the embodiment of the disclosure can be implemented based on electronic equipment, or a functional module or a functional entity in the electronic equipment.
The electronic device may be a Personal Computer (PC), a physical keyboard, a notebook computer, a physical keyboard, and the like, which are not specifically limited in this disclosure.
Fig. 1A is a block diagram of a hardware configuration of an electronic device according to one or more embodiments of the present disclosure. As shown in fig. 1A, the electronic apparatus includes: at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface 280. The controller 250 includes a central processing unit, a video processor, an audio processor, a graphic processor, a RAM, a ROM, a first interface to an nth interface for input/output, among others. The display 260 may be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and may also be a projection device and a projection screen. The tuner demodulator 210 receives a broadcast television signal through a wired or wireless reception manner, and demodulates an audio/video signal, such as an EPG audio/video data signal, from a plurality of wireless or wired broadcast television signals. The communicator 220 is a component for communicating with an external device or a server according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The electronic device may establish transmission and reception of control signals and data signals with the server 203 or the local control device 205 through the communicator 220. The detector 230 is used to collect signals of the external environment or interaction with the outside. The controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box. The user interface 280 may be used to receive control signals for controlling devices, such as infrared remote controls, etc.
In some embodiments, controller 250 controls the operation of the electronic device and responds to user actions through various software control programs stored in memory. The controller 250 controls the overall operation of the electronic device. A user may input a user command on a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.
In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operation and displayed in a graphical manner. It may be an interface element such as an icon, a window, and a control displayed in a display screen of the electronic device, where the control may include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, and other visual interface elements.
Fig. 1B is a schematic software configuration diagram of an electronic device according to one or more embodiments of the present disclosure, and as shown in fig. 1B, the system is divided into four layers, which are, from top to bottom, an Application (Applications) layer (referred to as an "Application layer"), an Application Framework (Application Framework) layer (referred to as a "Framework layer"), an Android runtime (Android runtime) and system library layer (referred to as a "system runtime library layer"), and a kernel layer.
In some embodiments, at least one application program runs in the application program layer, and the application programs may be windows (windows) programs carried by an operating system, system setting programs, clock programs or the like; or may be an application developed by a third party developer. In particular implementations, applications in the application layer include, but are not limited to, the above examples.
In some embodiments, the system runtime layer provides support for the upper layer, i.e., the framework layer, and when the framework layer is used, the android operating system runs the C/C + + library included in the system runtime layer to implement the functions to be implemented by the framework layer.
In some embodiments, the kernel layer is a layer between hardware and software, including at least one of the following drivers: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.) and power drive etc..
The virtual keyboard calibration method provided by the embodiment of the application can be realized based on the electronic equipment.
The virtual keyboard calibration process provided by the embodiment of the disclosure includes the steps of firstly responding to a first trigger operation of a user on a target key of a target keyboard, acquiring first induction data, then acquiring a virtual key corresponding to the first induction data based on a corresponding relation between the first induction data and the virtual key in the virtual keyboard, wherein the virtual keyboard is displayed in a display interface of virtual reality head-mounted display equipment worn by the user, then responding to a second trigger operation of the user on the target key of the target keyboard, determining the target key, and finally calibrating the virtual keyboard based on whether the virtual key is consistent with the target key.
For more detailed description of the present solution, the following description will be made with reference to fig. 2A by way of example, and it is understood that the steps involved in fig. 2A may include more steps or fewer steps in actual implementation, and the order between the steps may also be different, so as to enable the virtual keyboard calibration method provided in the embodiment of the present application.
Fig. 2A is a schematic flowchart of a virtual keyboard calibration method according to an embodiment of the present disclosure, and fig. 2B is a schematic diagram of a principle of the virtual keyboard calibration method according to the embodiment of the present disclosure. The embodiment can be applied to the condition of calibrating the virtual keyboard and facilitating key input of a user. The method of the embodiment may be performed by a virtual keyboard calibration apparatus, which may be implemented in hardware and/or software and may be configured in an electronic device.
As shown in fig. 2A, the method specifically includes the following steps:
s210, responding to a first trigger operation of a user on a target key of a target keyboard, and acquiring first induction data.
The target keyboard can be understood as a physical keyboard matched with a personal computer or a notebook computer and other devices used by a user. The first trigger operation may be understood as a contact operation on the target key, but the target key is not pressed, for example, a finger touch operation. The target key may be understood as any key in the target keyboard, which is not specifically limited in this embodiment. The first sensing data may be understood as coordinate position data obtained according to the first trigger operation, and the coordinate position data may be obtained based on a touch sensor built in the target key and may also be obtained in other manners, which is not specifically limited in this embodiment.
When a target key of a target keyboard receives a first trigger operation of a user, first sensing data corresponding to the first trigger operation can be acquired based on a touch sensor built in the target key, and correspondingly, an operating system of the VR head-mounted display device responds to the first operation and acquires the first sensing data by receiving the first sensing data sent by the target keyboard.
S220, acquiring a virtual key corresponding to the first sensing data based on the corresponding relation between the first sensing data and the virtual key in the virtual keyboard.
Wherein the virtual keyboard is displayed in a display interface of a virtual reality head-mounted display device worn by the user.
After the operating system of the VR head-mounted display device acquires the first sensing data, the first sensing data and the coordinate position data table corresponding to each virtual key in the virtual keyboard stored in the operating system are compared, and the corresponding relation between the first sensing data and the virtual key can be determined, namely: the first sensing data corresponds to the coordinate position data of the virtual key, so that the virtual key corresponding to the first sensing data in the virtual keyboard is obtained.
In some embodiments, after obtaining the virtual key corresponding to the first sensing data, the method may further include: the virtual key is displayed in a virtual keyboard in a first display mode.
The first display mode may be a first luminance value display mode, a blinking display mode, a display mode using different colors, and the like, which is not specifically limited in this embodiment. The first brightness value may be a preset value, or may be determined according to specific situations, which is not specifically limited in this embodiment.
In this embodiment, the virtual keys are displayed in the virtual keyboard in the first display mode, so that a user can conveniently see specific positions of the virtual keys corresponding to the first trigger operation in the virtual keyboard, and the keyboard input accuracy is improved.
And S230, responding to a second trigger operation of the user on the target key of the target keyboard, and determining the target key.
The second trigger operation may be understood as an operation of pressing a target key, such as a finger key input operation.
And the operating system of the VR head-mounted display equipment responds to second trigger operation of a user on a target key of the target keyboard, and can determine the target key corresponding to the second trigger operation through identification information which is sent by the target keyboard and corresponds to the target key. The identification information may include character information, position information, and the like of the target key, which is not specifically limited in this embodiment.
In some embodiments, after determining the target key, the method may further specifically include: and displaying the target virtual keys corresponding to the target keys in the virtual keyboard by adopting a second display mode.
The second display mode may be display using the second brightness value, or display using a color different from that in the first display mode, and the like, which is not specifically limited in this embodiment. The second brightness value may be a preset value, or may be determined according to specific situations, and the second brightness value is different from the first brightness value for distinguishing, which is not specifically limited in this embodiment.
In this embodiment, the target virtual key corresponding to the target key is displayed in the virtual keyboard in the second display mode, so that a prompt is facilitated for a user, and whether the target virtual key and the virtual key corresponding to the first sensing data are the same virtual key is determined, which is beneficial to improving the accuracy and efficiency of the keyboard input process.
S240, calibrating the virtual keyboard based on whether the virtual keys are consistent with the target keys.
After the operating system of the VR head-mounted display device acquires the virtual key corresponding to the first sensing data and determines the target key, whether the virtual key is consistent with the target key can be determined, and therefore the virtual keyboard is calibrated based on whether the virtual key is consistent with the target key. Specifically, if the virtual key is inconsistent with the target key, it is indicated that an error may occur in the mapping relationship between the virtual keyboard and the target keyboard, which results in an error occurring in the obtained virtual key, and at this time, the virtual keyboard needs to be calibrated; if the virtual key is consistent with the target key, the mapping relation between the virtual keyboard and the target keyboard is basically accurate, the virtual keyboard is not calibrated, second induction data corresponding to second trigger operation can be obtained, and coordinate position data corresponding to the virtual key corresponding to the first induction data in a coordinate position data table stored in an operating system are continuously corrected, fitted and finely adjusted according to the second induction data, so that the accuracy of the coordinate position data table is ensured.
In the embodiment, first sensing data are obtained in response to a first triggering operation of a user on a target key of a target keyboard, then a virtual key corresponding to the first sensing data is obtained based on a corresponding relation between the first sensing data and the virtual key in the virtual keyboard, wherein the virtual keyboard is displayed in a display interface of virtual reality head-mounted display equipment worn by the user, then the target key is determined in response to a second triggering operation of the user on the target key of the target keyboard, and finally the virtual keyboard is calibrated based on whether the virtual key is consistent with the target key.
In some embodiments, the target keyboard is covered with a keyboard soft film with a built-in touch sensor;
the acquiring of the first sensing data in response to the first triggering operation of the user on the target key of the target keyboard may specifically include:
and responding to a first trigger operation of a user on a target key of the target keyboard, and acquiring first sensing data through a keyboard soft film with a built-in touch sensor.
Specifically, under the condition that the target keyboard is covered with the keyboard soft film with the built-in touch sensor, the keyboard soft film can be connected to a device such as a personal computer or a notebook computer used by a user in a Universal Serial Bus (USB) manner, so that sensing data acquired by the touch sensor can be transmitted to the device such as the personal computer or the notebook computer, and the VR head-mounted display device is connected to the device such as the personal computer or the notebook computer, so that an operating system of the VR head-mounted display device can respond to a first trigger operation of the user on a target key of the target keyboard and acquire the first sensing data through the keyboard soft film with the built-in touch sensor.
In the embodiment, the first sensing data is obtained through the method, so that the method is simple and efficient, and the cost is not high.
Fig. 3A is a schematic flowchart of another virtual keyboard calibration method provided in the embodiment of the present disclosure, and fig. 3B is a schematic principle diagram of another virtual keyboard calibration method provided in the embodiment of the present disclosure. This embodiment mainly describes a process of one calibration method for calibrating a virtual keyboard.
As shown in fig. 3A, the method specifically includes the following steps:
s310, responding to a first trigger operation of a user on a target key of a target keyboard, and acquiring first sensing data.
S320, acquiring a virtual key corresponding to the first sensing data based on the corresponding relation between the first sensing data and the virtual key in the virtual keyboard.
And S330, responding to a second trigger operation of the user on the target key of the target keyboard, and determining the target key.
And S340, if the virtual key is inconsistent with the target key, acquiring second sensing data corresponding to the second trigger operation.
Specifically, when the finger of the user performs the second trigger operation on the target key, the sensing data generated in the finger pressing process may change, so that if the virtual key is inconsistent with the target key, the sensing data at this time can be acquired at the moment when the target keyboard receives the second trigger operation, that is: and acquiring second induction data corresponding to the second trigger operation, so that the virtual keyboard can be calibrated conveniently according to the second induction data and the target key.
And S350, calibrating the virtual keyboard according to the second sensing data and the target key until the virtual key is consistent with the target key.
After the second sensing data corresponding to the second trigger operation is acquired, since the target key is the accurate value at this time, the virtual keyboard can be calibrated through the second sensing data and the target key, and then the steps S310-S330 are executed again until the virtual key is consistent with the target key, and the calibration process is finished.
For example, assuming that a user performs a finger touch operation on an "a" key of a target keyboard, based on first sensing data corresponding to the finger touch operation, the obtained virtual key is an "S" virtual key, and in response to a finger key input operation performed on the "a" key of the target keyboard by the user, the determined target key is the "a" key, and the virtual key at this time is inconsistent with the target key, which indicates that an error has occurred in the determined virtual key, by obtaining second sensing data corresponding to the finger key input operation, since the second sensing data is real-time data for the target key, the virtual keyboard can be calibrated through the second sensing data and the target key, that is: and calibrating the mapping relation between the virtual keyboard and the target keyboard, wherein the mapping relation is mainly that the first sensing data corresponds to an 'S' virtual key, the second sensing data corresponds to an 'A' virtual key, and then the S310-S330 is executed again until the virtual key is consistent with the target key, and the calibration process is finished.
In this embodiment, if the virtual key is inconsistent with the target key, second sensing data corresponding to the second trigger operation is obtained, and the virtual keyboard is calibrated according to the second sensing data and the target key until the virtual key is consistent with the target key.
Fig. 4A is a schematic flowchart of another virtual keyboard calibration method provided in the embodiment of the present disclosure, and fig. 4B is a schematic principle diagram of another virtual keyboard calibration method provided in the embodiment of the present disclosure. This embodiment mainly describes a process of another calibration method for calibrating a virtual keyboard.
As shown in fig. 4A, the method specifically includes the following steps:
s410, responding to a first trigger operation of a user on a target key of a target keyboard, and acquiring first induction data.
S420, acquiring a virtual key corresponding to the first sensing data based on the corresponding relation between the first sensing data and the virtual key in the virtual keyboard.
And S430, responding to a second triggering operation of the user on the target key of the target keyboard, and determining the target key.
And S440, if the virtual key is inconsistent with the target key, responding to a second trigger operation of the user on a preset key in the target keyboard, and acquiring third induction data.
The preset keys may be a preset number of keys, for example, one key is respectively determined at four corners (upper left corner, upper right corner, lower left corner, and lower right corner) of the target keyboard, and the specific positions and the specific number of the preset keys may also be determined according to the specific circumstances.
If the virtual key is inconsistent with the target key, the calibration can be performed again, specifically: and responding to a second triggering operation of the user on a preset key in the target keyboard, and acquiring corresponding third induction data.
S450, calibrating the virtual keyboard according to the third sensing data and the virtual keys corresponding to the third sensing data in the virtual keyboard.
After the operating system of the VR head-mounted display device acquires the third sensing data, the coordinate position data table corresponding to each virtual key in the virtual keyboard stored in the operating system is queried, and the third sensing data is compared with the coordinate position data table, so that it can be determined which virtual key corresponds to the third sensing data, and thus the virtual key corresponding to the third sensing data in the virtual keyboard is acquired, and the virtual keyboard can be calibrated according to the virtual key corresponding to the third sensing data and the third sensing data in the virtual keyboard, that is: and determining the mapping relation between the virtual keyboard and the target keyboard.
In this embodiment, if the virtual key is inconsistent with the target key, third sensing data is obtained in response to a second trigger operation of the user on a preset key in the target keyboard, the virtual keyboard is calibrated according to the third sensing data and the virtual key corresponding to the third sensing data in the virtual keyboard, and the virtual keyboard is calibrated by returning to the calibration process, so that whether an error occurs in a mapping relationship between the virtual keyboard and the target keyboard can be determined, and the reason for the error is conveniently located.
In some embodiments, the calibration process for the virtual keyboard may include the steps of:
1. when a user wears VR head-mounted display equipment, a target keyboard is photographed through a binocular camera on the VR head-mounted display equipment to obtain a corresponding image, an operating system of the VR head-mounted display equipment identifies the image through an image algorithm, and coordinate position data corresponding to all keys in the target keyboard are determined;
2. under the condition that a user takes off the VR head-mounted display device, covering a keyboard soft film with a built-in touch sensor on a target keyboard, connecting the keyboard soft film with a personal computer or a notebook computer and other devices corresponding to the target keyboard through a USB, and starting calibration;
3. responding to a second trigger operation (for example, sequentially pressing 4 preset keys, namely a "Q" key, a "Z" key, a "P" key and an "M" key) on a preset key in a target keyboard by a user, acquiring third sensing data corresponding to the 4 preset keys respectively, and mapping 4 groups of the third sensing data and the 4 groups of the third sensing data on corresponding virtual keys in the virtual keyboard by an operating system of the VR head mounted display device to establish a mapping relation between the virtual keyboard and the target keyboard;
4. and completing the calibration.
It should be noted that: after the mapping relation between the virtual keyboard and the target keyboard is established, the sensor of the soft membrane part outside the key area of the target keyboard can be closed to reduce the misinduction operation; in case of movement of the keyboard membrane, the calibration needs to be performed again.
Fig. 5A is a schematic flowchart of a method for determining a virtual keyboard according to an embodiment of the present disclosure, and fig. 5B is a schematic diagram of a principle of the method for determining a virtual keyboard according to an embodiment of the present disclosure. The present embodiment mainly explains a process of constructing a virtual keyboard.
As shown in fig. 5A, the method specifically includes the following steps:
and S510, acquiring a target image corresponding to the target keyboard.
Specifically, the target keyboard can be photographed through a binocular camera on the VR head-mounted display device, so that a target image corresponding to the target keyboard is obtained.
And S520, modeling the keys contained in the target image to obtain a virtual keyboard display model corresponding to the target keyboard.
After the target image is obtained, 2D modeling is performed on all keys included in the target image by a corresponding modeling method, so that a virtual keyboard display model corresponding to the target keyboard can be obtained.
In some embodiments, since the target image collected by the binocular camera on the VR head-mounted display device is a colorless black-and-white image, when modeling the keys included in the target image, the obtained virtual keyboard display model is also displayed in a colorless manner, but the color style of the virtual keyboard display model can be adjusted through the keyboard skin, thereby improving the user experience and satisfaction.
S530, perform character recognition on the keys included in the target image, and determine character information corresponding to each key.
After the target image is obtained, Character Recognition is performed on all the keys included in the target image by a Character Recognition algorithm, for example, an Optical Character Recognition (OCR) algorithm, so that Character information corresponding to each key can be specified.
It should be noted that: in this embodiment, S520 may be performed first, and then S530 may be performed; or executing S530 first and then executing S520; s520 and S530 may also be executed simultaneously, and the execution sequence of S520 and S530 is not particularly limited in this embodiment.
And S540, displaying the character information on the corresponding key model in the virtual keyboard display model to obtain the virtual keyboard.
Specifically, after the virtual keyboard display model corresponding to the target keyboard and the character information corresponding to each key are obtained, the character information is displayed in a manner of being superimposed on the key model corresponding to the character information in the virtual keyboard display model, and then the virtual keyboard is obtained.
In the embodiment, the virtual keyboard is obtained through the method, so that the method is simple and efficient, no cost burden exists, and the operability is strong.
For example, fig. 5C is a schematic diagram of a virtual keyboard display model provided in an embodiment of the present disclosure, as shown in fig. 5C: the figure provides a virtual keyboard display model corresponding to a part of keys in a target keyboard (excluding the first row of keys in the target keyboard, namely, keys "Esc", … … and "F12").
For example, fig. 5D is a schematic diagram of a virtual keyboard provided by the embodiment of the present disclosure, and on the basis of fig. 5C, character information corresponding to keys in a target keyboard is displayed on a corresponding key model in the virtual keyboard display model in fig. 5C, so that the virtual keyboard shown in fig. 5D can be obtained.
In some embodiments, the modeling the key included in the target image to obtain the virtual keyboard display model corresponding to the target keyboard may specifically include:
performing image detection on the keys contained in the target image to obtain first coordinate data of edge feature points corresponding to each key and second coordinate data of a rectangular area containing all keys;
and carrying out graphic modeling based on the first coordinate data and the second coordinate data to obtain a virtual keyboard display model corresponding to the target keyboard.
Specifically, edge detection is performed on keys included in a target image through an image detection method, for example, through a brightness gradient, an edge of a closed curve is determined as a key, and a rectangular area including all keys is positioned as a keyboard; performing key shape identification on keys contained in a target image, wherein the key shapes can be generally divided into round corner rectangles, circles, quadrangles with one arc side and the like; and detecting and numbering all keys to obtain coordinate data of edge feature points corresponding to each key and determine second coordinate data of a rectangular area containing all keys. For the key with the round corner rectangle, the edge characteristic points can be four corners; for a circular key, the edge characteristic points can be four tangent points, namely an upper tangent point, a lower tangent point, a left tangent point and a right tangent point; for the quadrangular key with an arc-shaped side, the edge characteristic points can be four corners and arc-shaped lower tangent points. After the first coordinate data and the second coordinate data are obtained, the virtual keyboard display model corresponding to the target keyboard can be obtained by carrying out graphic modeling according to the first coordinate data and the second coordinate data.
In the implementation, the virtual keyboard display model is obtained by the method, so that the method is simple and rapid, no extra cost is added, and the operation and the use are convenient.
For example, fig. 6A is a schematic diagram illustrating a principle of obtaining a virtual keyboard display model according to an embodiment of the present disclosure, and steps corresponding to fig. 6A have been described in the foregoing embodiment, and are not repeated herein to avoid repetition.
In some embodiments, the performing graphical modeling based on the first coordinate data and the second coordinate data to obtain a virtual keyboard display model corresponding to the target keyboard may specifically include:
acquiring a difference value between the second coordinate data and each first coordinate data;
and drawing a key model corresponding to each key in the rectangular area based on the difference and the distance between the adjacent keys to obtain a virtual keyboard display model corresponding to the target keyboard.
Specifically, after the first coordinate data and the second coordinate data are obtained, the difference value between the second coordinate data and each first coordinate data is obtained, the position of each key relative to the whole keyboard can be determined according to the difference value, meanwhile, a key model corresponding to each key is drawn in a rectangular area based on the difference value and the distance between adjacent keys, and a virtual keyboard display model corresponding to a preset keyboard can be obtained until all keys in the target keyboard are drawn completely. The distance between the key models in the virtual keyboard display model can refer to the distance between corresponding keys in the target keyboard, so that the virtual keyboard display model is more fit with the target keyboard.
In this embodiment, the virtual keyboard display model is obtained by the above method, so that the accuracy of the virtual keyboard display model can be improved, and the virtual keyboard display model is more fit with the target keyboard.
For example, fig. 6B is another schematic diagram of a principle for obtaining a virtual keyboard display model according to an embodiment of the present disclosure, and steps corresponding to fig. 6B have been described in the foregoing embodiment, and are not repeated here to avoid repetition.
In some embodiments, the method may further specifically include:
determining character prompt information corresponding to each key based on the type of the input method used by the user;
and displaying the character prompt information on a corresponding key model in the virtual keyboard display model to obtain a virtual keyboard corresponding to the input method type.
Specifically, when the types of input methods used by the user are different, the character prompt information corresponding to each key is also different, the character prompt information corresponding to each key in the target keyboard is determined based on the types of input methods used by the user, and the character prompt information is displayed on the key model corresponding to the character prompt information in the virtual keyboard display model, so that the virtual keyboard corresponding to the type of input methods can be obtained.
In this embodiment, the virtual keyboard corresponding to the input method type is obtained by the method, so that the practicability of the virtual keyboard can be further expanded, and a better service is provided for a user.
For example, fig. 7A is a schematic diagram illustrating a principle of obtaining a virtual keyboard corresponding to an input method type according to an embodiment of the present disclosure, and steps corresponding to fig. 7A have been described in the foregoing embodiment, and are not repeated here to avoid repetition.
Fig. 7B is a schematic diagram of character prompt information based on a five-stroke input method according to an embodiment of the present disclosure, and fig. 7B shows character prompt information corresponding to a part of keys.
Fig. 7C is a schematic diagram of a virtual keyboard based on a foreign language input method according to an embodiment of the present disclosure, and fig. 7C shows a virtual keyboard display model corresponding to a part of keys based on a japanese input method.
Fig. 8 is a schematic structural diagram of a virtual keyboard calibration apparatus provided in an embodiment of the present disclosure, where the apparatus is configured in an electronic device, and can implement the virtual keyboard calibration method according to any embodiment of the present disclosure. The device specifically comprises the following steps:
a first obtaining module 801, configured to obtain first sensing data in response to a first trigger operation of a user on a target key of a target keyboard;
a second obtaining module 802, configured to obtain a virtual key corresponding to the first sensing data based on a corresponding relationship between the first sensing data and a virtual key in a virtual keyboard, where the virtual keyboard is displayed in a display interface of a virtual reality head-mounted display device worn by the user;
a key determining module 803, configured to determine the target key in response to a second trigger operation of the user on the target key of the target keyboard;
a calibration module 804, configured to calibrate the virtual keyboard based on whether the virtual key is consistent with the target key.
As an optional implementation manner of the embodiment of the present disclosure, the calibration module 804 is specifically configured to:
if the virtual key is inconsistent with the target key, second induction data corresponding to the second trigger operation is acquired;
and calibrating the virtual keyboard according to the second sensing data and the target key until the virtual key is consistent with the target key.
As an optional implementation manner of the embodiment of the present disclosure, the calibration module 804 is further specifically configured to:
if the virtual key is inconsistent with the target key, responding to a second triggering operation of the user on a preset key in the target keyboard, and acquiring third induction data;
and calibrating the virtual keyboard according to the third sensing data and the virtual key corresponding to the third sensing data in the virtual keyboard.
As an optional implementation manner of the embodiment of the present disclosure, the apparatus further includes: a virtual keyboard determination module;
the virtual keyboard determination module includes:
the image acquisition unit is used for acquiring a target image corresponding to the target keyboard;
the display model determining unit is used for modeling the keys contained in the target image to obtain a virtual keyboard display model corresponding to the target keyboard;
the character information determining unit is used for carrying out character recognition on the keys contained in the target image and determining character information corresponding to each key;
and the virtual keyboard determining unit is used for displaying the character information on a corresponding key model in the virtual keyboard display model to obtain the virtual keyboard.
As an optional implementation manner of the embodiment of the present disclosure, the display model determining unit is specifically configured to:
performing image detection on the keys contained in the target image to obtain first coordinate data of edge feature points corresponding to each key and second coordinate data of a rectangular area containing all keys;
and carrying out graphic modeling based on the first coordinate data and the second coordinate data to obtain a virtual keyboard display model corresponding to the target keyboard.
As an optional implementation manner of the embodiment of the present disclosure, the virtual keyboard determining module further includes:
the prompt information determining unit is used for determining character prompt information corresponding to each key based on the type of the input method used by the user;
the virtual keyboard determining unit is specifically configured to: and displaying the character prompt information on a corresponding key model in the virtual keyboard display model to obtain a virtual keyboard corresponding to the input method type.
As an optional implementation manner of the embodiment of the present disclosure, a keyboard soft film with a built-in touch sensor is covered on the target keyboard;
the first obtaining module 801 is specifically configured to: and responding to a first trigger operation of a user on a target key of the target keyboard, and acquiring first sensing data through a keyboard soft film with a built-in touch sensor.
The virtual keyboard calibration device provided by the embodiment of the present disclosure can execute the virtual keyboard calibration method provided by any embodiment of the present disclosure, has the corresponding functional modules and beneficial effects of the execution method, and is not repeated here to avoid repetition.
An embodiment of the present disclosure provides an electronic device, including: one or more processors; a storage device for storing one or more programs that, when executed by the one or more processors, cause the one or more processors to implement the virtual keyboard calibration method of any of the embodiments of the present disclosure.
Fig. 9 is a schematic structural diagram of an electronic device provided in an embodiment of the present disclosure. As shown in fig. 9, the electronic device includes a processor 910 and a storage 920; the number of the processors 910 in the electronic device may be one or more, and one processor 910 is taken as an example in fig. 9; the processor 910 and the storage 920 in the electronic device may be connected by a bus or other means, and fig. 9 illustrates the connection by the bus as an example.
The storage device 920 is a computer readable storage medium for storing software programs, computer executable programs, and modules, such as program instructions/modules corresponding to the virtual keyboard calibration method in the embodiments of the present disclosure. The processor 910 executes various functional applications and data processing of the electronic device by executing software programs, instructions and modules stored in the storage 920, that is, implements the virtual keyboard calibration method provided by the embodiment of the present disclosure.
The storage 920 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal, and the like. Additionally, the storage 920 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the storage 920 may further include memory located remotely from the processor 910, which may be connected to electronic devices over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The electronic device provided by the embodiment can be used for executing the virtual keyboard calibration method provided by any embodiment, and has corresponding functions and beneficial effects.
An embodiment of the present disclosure provides a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the computer program implements each process executed by the virtual keyboard calibration method, and can achieve the same technical effect, and in order to avoid repetition, the computer program is not described herein again.
The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the foregoing discussion in some embodiments is not intended to be exhaustive or to limit the implementations to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.
Claims (10)
1. A method for virtual keyboard calibration, the method comprising:
responding to a first trigger operation of a user on a target key of a target keyboard, and acquiring first induction data;
acquiring a virtual key corresponding to the first sensing data based on the corresponding relation between the first sensing data and the virtual key in a virtual keyboard, wherein the virtual keyboard is displayed in a display interface of virtual reality head-mounted display equipment worn by the user;
responding to a second triggering operation of the user on the target key of the target keyboard, and determining the target key;
calibrating the virtual keyboard based on whether the virtual keys are consistent with the target keys.
2. The method of claim 1, wherein calibrating the virtual keyboard based on whether the virtual key is consistent with the target key comprises:
if the virtual key is inconsistent with the target key, second induction data corresponding to the second trigger operation is acquired;
and calibrating the virtual keyboard according to the second sensing data and the target key until the virtual key is consistent with the target key.
3. The method of claim 1, wherein calibrating the virtual keyboard based on whether the virtual key is consistent with the target key comprises:
if the virtual key is inconsistent with the target key, responding to a second trigger operation of the user on a preset key in the target keyboard, and acquiring third induction data;
and calibrating the virtual keyboard according to the third sensing data and the virtual key corresponding to the third sensing data in the virtual keyboard.
4. The method of claim 1, wherein the virtual keyboard is obtained by:
acquiring a target image corresponding to the target keyboard;
modeling keys contained in the target image to obtain a virtual keyboard display model corresponding to the target keyboard;
performing character recognition on the keys contained in the target image, and determining character information corresponding to each key;
and displaying the character information on a corresponding key model in the virtual keyboard display model to obtain the virtual keyboard.
5. The method according to claim 4, wherein the modeling the keys included in the target image to obtain a virtual keyboard display model corresponding to the target keyboard comprises:
performing image detection on the keys contained in the target image to obtain first coordinate data of edge feature points corresponding to each key and second coordinate data of a rectangular area containing all the keys;
and carrying out graphic modeling based on the first coordinate data and the second coordinate data to obtain a virtual keyboard display model corresponding to the target keyboard.
6. The method of claim 4, further comprising:
determining character prompt information corresponding to each key based on the type of the input method used by the user;
and displaying the character prompt information on a corresponding key model in the virtual keyboard display model to obtain a virtual keyboard corresponding to the input method type.
7. The method of any one of claims 1-6, wherein the target keyboard is covered with a keyboard film with a built-in touch sensor;
the acquiring of the first sensing data in response to the first triggering operation of the user on the target key of the target keyboard comprises:
and responding to a first trigger operation of a user on a target key of the target keyboard, and acquiring first sensing data through a keyboard soft film with a built-in touch sensor.
8. An apparatus for virtual keyboard calibration, the apparatus comprising:
the first acquisition module is used for responding to a first trigger operation of a user on a target key of a target keyboard and acquiring first induction data;
a second obtaining module, configured to obtain a virtual key corresponding to the first sensing data based on a corresponding relationship between the first sensing data and a virtual key in a virtual keyboard, where the virtual keyboard is displayed in a display interface of a virtual reality head-mounted display device worn by the user;
the key determining module is used for responding to a second triggering operation of the user on the target key of the target keyboard and determining the target key;
and the calibration module is used for calibrating the virtual keyboard based on whether the virtual key is consistent with the target key or not.
9. An electronic device, comprising:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-7.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210578609.1A CN115113795A (en) | 2022-05-25 | 2022-05-25 | Virtual keyboard calibration method, device, electronic equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210578609.1A CN115113795A (en) | 2022-05-25 | 2022-05-25 | Virtual keyboard calibration method, device, electronic equipment and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115113795A true CN115113795A (en) | 2022-09-27 |
Family
ID=83327391
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210578609.1A Pending CN115113795A (en) | 2022-05-25 | 2022-05-25 | Virtual keyboard calibration method, device, electronic equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115113795A (en) |
-
2022
- 2022-05-25 CN CN202210578609.1A patent/CN115113795A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9933856B2 (en) | Calibrating vision systems | |
| KR101423536B1 (en) | System for constructiing mixed reality using print medium and method therefor | |
| EP2919104B1 (en) | Information processing device, information processing method, and computer-readable recording medium | |
| US10452155B2 (en) | Display method of on-screen keyboard and computer program product and non-transitory computer readable storage medium thereof | |
| JP2020530631A (en) | Interaction locating methods, systems, storage media, and smart devices | |
| US20130154913A1 (en) | Systems and methods for a gaze and gesture interface | |
| CN107479691B (en) | Interaction method, intelligent glasses and storage device thereof | |
| US11706485B2 (en) | Display device and content recommendation method | |
| US9544556B2 (en) | Projection control apparatus and projection control method | |
| JP2000298544A (en) | Input/output device and its method | |
| CN111970456B (en) | Shooting control method, device, equipment and storage medium | |
| US10621766B2 (en) | Character input method and device using a background image portion as a control region | |
| CN111527468A (en) | Air-to-air interaction method, device and equipment | |
| CN113190109A (en) | Input control method and device of head-mounted display equipment and head-mounted display equipment | |
| CN106200900A (en) | Based on identifying that the method and system that virtual reality is mutual are triggered in region in video | |
| CN111176425A (en) | Multi-screen operation method and electronic system using same | |
| CN114167997B (en) | Model display method, device, equipment and storage medium | |
| CN115113795A (en) | Virtual keyboard calibration method, device, electronic equipment and medium | |
| CN111752425B (en) | Method for selecting an interactive object on a display medium of a device | |
| CN112905007A (en) | Virtual reality equipment and voice-assisted interaction method | |
| EP3506261A1 (en) | Information processing program, information processing system and information processing method | |
| WO2022111005A1 (en) | Virtual reality (vr) device and vr scenario image recognition method | |
| CN112732088B (en) | Virtual reality equipment and monocular screen capturing method | |
| CN115348438B (en) | Control method and related device for three-dimensional display equipment | |
| CN116934841A (en) | Positioning method of hand area and display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |