CN112218134A - Input method and related equipment - Google Patents

Input method and related equipment Download PDF

Info

Publication number
CN112218134A
CN112218134A CN202010935439.9A CN202010935439A CN112218134A CN 112218134 A CN112218134 A CN 112218134A CN 202010935439 A CN202010935439 A CN 202010935439A CN 112218134 A CN112218134 A CN 112218134A
Authority
CN
China
Prior art keywords
key
data
sliding
display
virtual keyboard
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010935439.9A
Other languages
Chinese (zh)
Other versions
CN112218134B (en
Inventor
许强
达米安·马森
刘哲
爱德华·郎克
吴文昊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
University of Waterloo
Huawei Technologies Canada Co Ltd
Original Assignee
University of Waterloo
Huawei Technologies Canada Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by University of Waterloo, Huawei Technologies Canada Co Ltd filed Critical University of Waterloo
Priority to CN202010935439.9A priority Critical patent/CN112218134B/en
Publication of CN112218134A publication Critical patent/CN112218134A/en
Application granted granted Critical
Publication of CN112218134B publication Critical patent/CN112218134B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0489—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using dedicated keyboard keys or combinations thereof
    • G06F3/04892—Arrangements for controlling cursor position based on codes indicative of cursor displacements from one discrete location to another, e.g. using cursor control keys associated to different directions or using the tab key
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42208—Display device provided on the remote control

Abstract

The embodiment of the application discloses an input method and related equipment. The method is applied to display equipment, a virtual keyboard is displayed on a display screen of the display equipment, and the method comprises the following steps: receiving first data sent by an input device, wherein the first data is used for describing a sliding track of a first sliding operation on the input device; determining a display track from a second key to a first key on the virtual keyboard according to the first data, wherein the first key is a key on the virtual keyboard, and the second key is a predefined reference key on the virtual keyboard; and displaying the content of the first key through the display screen, or executing the operation triggered by the first key. One key can be selected through one-time sliding operation, the operation mode is simple, and the input speed is high; and one first sliding operation corresponds to one first key, so that the flexibility of the input process is reserved.

Description

Input method and related equipment
Technical Field
The present application relates to the field of computer technologies, and in particular, to an input method and a related device.
Background
The discrete input method (index method) can be applied to an input system in which an input device is separated from a display device. Inputs to smart televisions, Augmented Reality (AR) devices, and Virtual Reality (VR) devices are almost all split inputs.
Taking the smart television as an example, the split input method of the smart television is an input method based on cursor selection. The user uses the up, down, left and right direction keys on the remote control to control the cursor to jump within a row or between rows. When the cursor reaches the target key, the user presses a 'confirm' key on the remote controller to click for confirmation.
However, depending on the existing key input method, the user needs to move the cursor to the target key for many times when selecting one key, the operation times are too many, and the input speed is slow.
Disclosure of Invention
The embodiment of the application provides an input method and related equipment, one key can be selected through one-time sliding operation, the operation mode is simple, and the input speed is high; and one first sliding operation corresponds to one first key, so that the flexibility of the input process is reserved.
In order to solve the above technical problem, an embodiment of the present application provides the following technical solutions:
in a first aspect, an embodiment of the present application provides an input method, which can be used in the field of split input. The method is applied to display equipment, and a virtual keyboard is displayed on a display screen of the display equipment. The method comprises the following steps: the display device receives first data sent by the input device, wherein the first data is used for describing a sliding track of a first sliding operation on the input device. Wherein the first data includes operation type information corresponding to the first sliding operation and coordinates of each of a plurality of contact points corresponding to the first sliding operation. The display equipment determines a display track from a second key to a first key on the virtual keyboard according to the first data; the first key is a key on the virtual keyboard, the second key is a predefined reference key on the virtual keyboard, the predefined reference key is used in the process of mapping a first sliding operation on the input equipment to the display equipment to obtain the display track for the display equipment, and the coordinate position of the second key determines the coordinate position of the starting point of the display track. Further, the coordinate position of the second key may be used as the coordinate position of the starting point of the display track, or may be a preset position relationship between the coordinate position of the starting point configured on the display device and the coordinate position of the second key. I.e. the mapping of the first sliding operation onto the display device, is not an absolute mapping procedure but a relative mapping procedure with the second key as a predefined reference key. Further, when the different first data indicate that the initial contact points of the different first sliding operations on the input device are different, the mapping of the initial contact points of the different first sliding operations to the initial points in the display screen is the same. The display device displays the content of the first key through the display screen, or executes the operation triggered by the first key.
In the implementation mode, one first key can be obtained through one first sliding operation, namely, one key can be selected by a user through one sliding operation, the operation mode is simple, and the input speed is high; and one first sliding operation corresponds to one first key, so that the flexibility of the input process is reserved.
In one possible implementation manner of the first aspect, the determining, by the display device, a display trajectory from a second key to a first key on the virtual keyboard according to the first data includes: the display equipment acquires a display track corresponding to the sliding track of the first sliding operation according to the first data; the process of obtaining the display track corresponding to the sliding track of the first sliding operation refers to an internal conversion process executed by the display device. Specifically, a first coordinate system is configured on the input device, and the first coordinate system is established based on the touch screen; the display device is configured with a second coordinate system, the second coordinate system is established based on the display screen, and a first conversion relation between the first coordinate system and the second coordinate system (namely, a display control ratio between the input device and the display device) is stored in advance on the display device. The display equipment calculates a first sliding length and/or a sliding angle of the first sliding operation according to a first coordinate of a plurality of contact points corresponding to the first sliding operation in a first coordinate system; and converting the first sliding length according to the display control ratio between the display equipment and the input equipment to obtain a second sliding length of the first sliding operation mapped to a second coordinate system. The display device obtains the coordinates of the second key in the second coordinate system, determines to map the first sliding operation to the display track in the second coordinate system according to the coordinates of the second key in the second coordinate system, the second sliding length and/or the sliding angle, and further can obtain the coordinates of the end point of the display track in the second coordinate system. The display device takes the second key as a starting point and takes the end point of the display track as the first key. Specifically, a virtual keyboard and a one-to-one correspondence relationship between each key in the virtual keyboard and a third coordinate area in the second coordinate system are displayed on the display device. The display device matches the coordinates of the termination point of the display track in the second coordinate system with the coverage range of the plurality of third coordinate areas, and if the coordinates of the termination point in the second coordinate system are located in one target coordinate area of the plurality of third coordinate areas, the first key corresponding to the target coordinate area is obtained, wherein the target coordinate area is one coordinate area of the plurality of third coordinate areas.
In the implementation mode, the keyboard layout is always displayed in the display equipment, the predefined second key is taken as a starting point, and the position relation between the first key and the second key corresponds to the sliding length and the sliding angle of the first sliding operation, so that the user can conveniently learn.
In one possible implementation manner of the first aspect, the method further includes: the display device displays a display track corresponding to the sliding track of the first sliding operation through the display screen. In the implementation mode, the display track mapped to the display screen by the first sliding operation is displayed on the display screen in real time, so that the user can completely put the attention on the display screen, the user is ensured not to pay attention to the input equipment with head down, and the physiological burden and attention conversion caused by repeated head down and head up of the user are reduced.
In one possible implementation of the first aspect, the first transformation relationship depends on one or more of the following parameters: the size of the input device, the size of the display device, and the operating habits of the user.
In one possible implementation of the first aspect, the first data is indicative of one or more parameters of: and inputting a sliding length parameter and a sliding angle of a sliding track corresponding to the sliding operation on the equipment. In the implementation mode, the first keys in one-to-one correspondence are determined according to parameters of two dimensions of the sliding angle and/or the sliding length, so that the implementation flexibility of the scheme is enhanced.
In one possible implementation manner of the first aspect, the method further includes: the display device receives the second data sent by the input device. The second data is used to describe a first touch operation, the second data including operation type information of the first touch operation and coordinates of a plurality of contact points corresponding to the first touch operation, the first touch operation being a touch operation other than a slide operation. And the display equipment displays the content of the second key through the display screen according to the second data, or executes the operation triggered by the second key. Specifically, after determining that the operation type of the first touch operation is not the sliding operation according to the second data, the display device displays the content of the second key through the display screen, or executes an operation triggered by the second key.
In the implementation mode, the user can complete the selection of the second key by inputting other types of operations except the sliding operation, so that the vacancy of the second key is avoided, and the utilization rate of the virtual keyboard is improved.
In one possible implementation manner of the first aspect, the coordinates of the plurality of contact points corresponding to the first sliding operation carried in the first data indicate that the first sliding operation is obtained through the first area of the touch screen of the input device. The method further comprises the following steps: the display device receives the third data sent by the input device. Wherein the third data is used for describing a second touch operation, and the second touch operation may be any one of the following operations: click operation, slide operation, double click operation, and long press operation. The coordinates of the multiple contact points corresponding to the second touch operation, which are carried in the third data, indicate that the second touch operation is obtained through a second area of the touch screen, and the first area and the second area are different areas. And the display equipment determines the trigger operation corresponding to the third data.
In the implementation mode, a user can select the keys in one-to-one correspondence by inputting sliding operation in the first area and can select the keys in one-to-one correspondence by inputting second touch operation in the second area, so that the number of operations corresponding to the keys in the virtual keyboard is increased, and the implementation flexibility of the scheme is improved.
In a possible implementation manner of the first aspect, the plurality of second touch operations may be a plurality of different types of touch operations, and one trigger operation corresponding to each type of second touch operation may be configured on the display device. And the display equipment determines the operation type of the second touch operation as a second operation type according to the operation type information carried in the third data, and acquires trigger operations corresponding to the second operation type one by one. The triggering operation can be turning up the volume, turning down the volume, turning left, turning right, confirming, returning, deleting or displaying the preset characters, and the preset characters are characters with high utilization rate.
Or the plurality of second touch operations may be touch operations from different positions in the second area, and the preset relationship on the display device is one-to-one correspondence between the plurality of coordinate areas in the second area and the plurality of shortcut keys. The display device determines that the touch position of the second touch operation is located in a fourth coordinate area of the multiple coordinate areas included in the second area according to the first coordinates of the multiple contact points carried in the third data, and further determines a shortcut key corresponding to the fourth coordinate area, wherein the trigger operation corresponding to the third data refers to operation triggered by the shortcut key.
In a possible implementation manner of the first aspect, the keys in the virtual keyboard are distributed in a trapezoid, or the keys in the virtual keyboard are distributed in concentric circles. In this implementation manner, the keys in the virtual keyboard displayed on the display device are distributed in a trapezoidal shape, or the keys in the virtual keyboard are distributed in concentric circles, or the keys in the virtual keyboard are distributed in other shapes, which is not limited herein. The coverage areas of different keys do not coincide. In the embodiment of the application, two specific modes of virtual keyboard layout are provided, and the flexibility of user selection is improved.
In a second aspect, an embodiment of the present application provides an input method, which can be used in the field of split input. The method is applied to an input device, which is configured with a touch screen. The method comprises the following steps: the input device receives a first sliding operation through the touch screen; the input device generates first data for describing a first sliding operation; the input device sends first data to the display device, the display device is provided with a virtual keyboard, the first data is used for enabling the display device to determine a display track from a second key on the virtual keyboard to a first key, the first key is a key on the virtual keyboard, and the second key is a predefined reference key on the virtual keyboard.
In one possible implementation of the second aspect, the first data is indicative of one or more of the following parameters: and inputting a sliding length parameter and a sliding angle of a sliding track corresponding to the sliding operation on the equipment.
In one possible implementation manner of the second aspect, the method further includes: the input device receives a first touch operation through the display screen, wherein the first touch operation is a touch operation except for a sliding operation; the input device generates second data used for describing the first touch operation and sends the second data to the display device, and the second data is used for indicating the display device to display the content of the second key or indicating to execute the operation triggered by the second key.
In one possible implementation manner of the second aspect, the receiving, by the input device, the first sliding operation through the touch screen includes: the input device receives a first sliding operation through a first area of the touch screen, and the first data is further used for indicating that the first sliding operation is obtained through the first area. The method further comprises the following steps: the input device receives a second touch operation through a second area of the touch screen; the input device generates third data used for describing the second touch operation, and sends the third data to the display device, wherein the third data is used for indicating that the second touch operation is obtained through the second area, and is also used for enabling the display device to determine a trigger operation corresponding to the third data.
In one possible implementation manner of the second aspect, the first area is a central area of the touch screen, the second area is an edge area of the touch screen, and a width of the second area is smaller than or equal to a first threshold. The first threshold may be a relative value, for example, a preset percentage of the side length is taken; alternatively, the first threshold may also be an absolute preset value, such as 500 pixels, 600 pixels, 700 pixels; or, the first threshold may also be determined according to two dimensions, where when the size of the touch screen is smaller than or equal to a first preset size, the first threshold is a preset percentage of the side length, and when the size of the touch screen is larger than the first preset size, the first threshold is an absolute preset value.
In this implementation manner, the second area is disposed in the edge area of the touch screen, so that the user can position the second area by means of the frame of the input device, and thus the user can be guided to complete the input operation from the second area through touch and muscle memory, thereby reducing the difficulty of the user in inputting the operation from the second area and improving the viscosity of the user.
For the concept of the nouns, specific implementation steps, and beneficial effects brought by each possible implementation manner in the second aspect and part of possible implementation manners of the second aspect in the embodiment of the present application, reference may be made to descriptions in various possible implementation manners in the first aspect, and details are not repeated here.
In a third aspect, an embodiment of the present application provides an input method, which may be used in the field of split input. The method is applied to input equipment, the input equipment comprises a touch screen and a virtual keyboard, and the method comprises the following steps: receiving a first sliding operation through a touch screen; generating sliding track first data for describing a first sliding operation; determining a first key according to the first data and a second key, wherein the first key is a key on the virtual keyboard, and the second key is a predefined reference key on the virtual keyboard; and sending the key content corresponding to the first key or an operation instruction corresponding to the operation triggered by the first key to the display equipment.
In the implementation mode, a user can select one key in the display equipment by inputting one sliding operation to the input equipment, the operation mode is simple, and the input speed is high; one first sliding operation corresponds to one first key, so that the flexibility of the input process is reserved; in addition, the selection of the first key is completed on the input device, the content of the first key or the operation triggered by the first key is directly informed to the display device, namely, the input device completes the selection of the first key.
In a possible implementation manner of the third aspect, the input device determining a first key according to the first data and the second key includes: the input device acquires a display track corresponding to the sliding track according to the first data, takes the second key as a starting point, and takes an end point of the display track as the first key. Specifically, the input device may be pre-embedded with a virtual keyboard and a one-to-one correspondence between each key in the virtual keyboard and one coordinate region under the first coordinate system; a second key is also predefined from the virtual keyboard. After obtaining the first sliding length and/or the sliding angle of the first sliding operation in the first coordinate system, the input device uses the coordinate of the second key in the first coordinate system as the coordinate of the starting point of the sliding track, and generates the coordinate of the ending point of the sliding track of the first sliding operation in the first coordinate system according to the first sliding length and/or the sliding angle. And then the input device matches the coordinates of the termination point of the sliding track in the first coordinate system with the plurality of coordinate areas, so as to select a fifth coordinate area matched with the coordinates of the termination point in the first coordinate system from the plurality of coordinate areas, and then determine the key content corresponding to the first key corresponding to the fifth coordinate area or the operation triggered by the first key.
In one possible implementation of the third aspect, the first data is indicative of one or more parameters of: and inputting a sliding length parameter and a sliding angle of a sliding track corresponding to the sliding operation on the equipment.
In one possible implementation manner of the third aspect, the method further includes: receiving a first touch operation through the touch screen, wherein the first touch operation is a touch operation except for a sliding operation; and responding to the first touch operation, and sending the key content corresponding to the second key or an operation instruction corresponding to the operation triggered by the second key to the display equipment.
In one possible implementation manner of the third aspect, receiving, by the touch screen, the first sliding operation includes: a first sliding operation is received through a first area of the touch screen. The method further comprises the following steps: receiving a second touch operation through a second area of the touch screen; and generating third data for describing the second touch operation, determining a first trigger operation corresponding to the third data, and sending an operation instruction corresponding to the first trigger operation to the display device.
For concepts, specific implementation steps, and beneficial effects brought by each possible implementation manner in the third aspect and part of possible implementation manners of the third aspect in the embodiment of the present application, reference may be made to descriptions in various possible implementation manners in the first aspect and the second aspect, and details are not repeated here.
In a fourth aspect, embodiments of the present application provide a display device, which can be used in the field of split input. Display device is applied to display device, and the show has virtual keyboard on display device's the display screen, and display device includes: the device comprises a receiving module, a determining module and an executing module. The receiving module is used for receiving first data sent by the input equipment, and the first data is used for describing a sliding track of first sliding operation on the input equipment; the determining module is used for determining a display track from a second key to a first key on the virtual keyboard according to the first data, wherein the first key is a key on the virtual keyboard, and the second key is a predefined reference key on the virtual keyboard; and the execution module is used for displaying the content of the first key through the display screen or executing the operation triggered by the first key.
In a possible implementation manner of the fourth aspect, the determining module is specifically configured to obtain, according to the first data, a display track corresponding to the sliding track, use the second key as a starting point, and use an end point of the display track as the first key.
In one possible implementation of the fourth aspect, the first data is indicative of one or more parameters of: and inputting a sliding length parameter and a sliding angle of a sliding track corresponding to the sliding operation on the equipment.
In a possible implementation manner of the fourth aspect, the receiving module is further configured to receive second data sent by the input device, where the second data is used to describe a first touch operation, and the first touch operation is a touch operation other than a sliding operation; and the execution module is also used for displaying the content of the second key through the display screen according to the second data or executing the operation triggered by the second key.
In one possible implementation of the fourth aspect, the first data indicates that the first sliding operation was obtained through a first area of a touchscreen of the input device. The receiving module is further used for receiving third data sent by the input device, the third data is used for describing a second touch operation, the third data indicates that the second touch operation is obtained through a second area of the touch screen, and the first area and the second area are different areas; and the determining module is further used for determining the trigger operation corresponding to the third data.
In a possible implementation manner of the fourth aspect, the keys in the virtual keyboard are distributed in a trapezoid, or the keys in the virtual keyboard are distributed in concentric circles.
For specific implementation steps of the fourth aspect and various possible implementation manners of the fourth aspect in the embodiment of the present application and beneficial effects brought by each possible implementation manner, reference may be made to descriptions in various possible implementation manners in the first aspect, and details are not described here any more.
In a fifth aspect, embodiments of the present application provide an input device, which can be used in the field of split input. The input device is applied to input equipment, the input equipment is provided with a touch screen, and the device comprises a receiving module, a generating module and a sending module. The receiving module is used for receiving a first sliding operation through the touch screen; a generation module for generating first data describing a first sliding operation; the display device comprises a sending module and a display device, wherein the sending module is used for sending first data to the display device, the display device is provided with a virtual keyboard, the first data is used for enabling the display device to determine a display track from a second key on the virtual keyboard to a first key, the first key is a key on the virtual keyboard, and the second key is a predefined reference key on the virtual keyboard.
In one possible implementation of the fifth aspect, the first data is indicative of one or more of the following parameters: and inputting a sliding length parameter and a sliding angle of a sliding track corresponding to the sliding operation on the equipment.
In a possible implementation manner of the fifth aspect, the receiving module is further configured to receive a first touch operation through the display screen, where the first touch operation is a touch operation other than a sliding operation; and the generating module is further used for generating second data for describing the first touch operation and sending the second data to the display device, wherein the second data is used for indicating the display device to display the content of the second key or indicating to execute the operation triggered by the second key.
In a possible implementation manner of the fifth aspect, the receiving module is specifically configured to receive a first sliding operation through a first area of the touch screen, and the first data is further used to indicate that the first sliding operation is obtained through the first area; the receiving module is further used for receiving a second touch operation through a second area of the touch screen; and the generating module is further configured to generate third data used for describing the second touch operation, and send the third data to the display device, where the third data is used for indicating that the second touch operation is obtained through the second area, and is also used for the display device to determine a trigger operation corresponding to the third data.
In one possible implementation manner of the fifth aspect, the first area is a central area of the touch screen, the second area is an edge area of the touch screen, and a width of the second area is smaller than or equal to the first threshold.
For specific implementation steps of the fifth aspect and various possible implementation manners of the fifth aspect in the embodiment of the present application, and beneficial effects brought by each possible implementation manner, reference may be made to descriptions in various possible implementation manners in the second aspect, and details are not described here any more.
In a sixth aspect, embodiments of the present application provide an input device, which can be used in the field of split input. The input device is applied to input equipment, the input equipment comprises a touch screen and a virtual keyboard, and the device comprises a receiving module, a generating module, a determining module and a sending module. The receiving module is used for receiving a first sliding operation through the touch screen; the generating module is used for generating sliding track first data for describing a first sliding operation; the determining module is used for determining a first key according to the first data and a second key, wherein the first key is a key on the virtual keyboard, and the second key is a predefined reference key on the virtual keyboard; and the sending module is used for sending the key content corresponding to the first key or an operation instruction corresponding to the operation triggered by the first key to the display equipment.
In a possible implementation manner of the sixth aspect, the determining module is specifically configured to use the second key as a starting point of the sliding track, and use an end point of the sliding track as the first key.
In one possible implementation of the sixth aspect, the first data is indicative of one or more parameters of: and inputting a sliding length parameter and a sliding angle of a sliding track corresponding to the sliding operation on the equipment.
In a possible implementation manner of the sixth aspect, the receiving module is further configured to receive a first touch operation through the touch screen, where the first touch operation is a touch operation other than a sliding operation; the sending module is further used for responding to the first touch operation and sending the key content corresponding to the second key or an operation instruction corresponding to the operation triggered by the second key to the display device.
In a possible implementation manner of the sixth aspect, the receiving module is specifically configured to receive a first sliding operation through a first area of the touch screen; the receiving module is further used for receiving a second touch operation through a second area of the touch screen; the generating module is further used for generating third data for describing the second touch operation; the determining module is further used for determining a first trigger operation corresponding to the third data; and the sending module is further used for sending the operation instruction corresponding to the first trigger operation to the display equipment.
For specific implementation steps of the sixth aspect and various possible implementation manners of the sixth aspect of the embodiment of the present application, and beneficial effects brought by each possible implementation manner, reference may be made to descriptions in various possible implementation manners of the third aspect, and details are not described here any more.
In a seventh aspect, an embodiment of the present application provides an input method, which may be used in the field of split input. The method is applied to display equipment, a virtual keyboard is displayed on a display screen of the display equipment, and the method comprises the following steps: the display device receives first data sent by the input device. The first data is used for describing a sliding track of a first sliding operation on the input device, the first data comprises a sliding length parameter and/or a sliding angle of the sliding track, and the first data also comprises a region position parameter of the sliding track in the input device; the display equipment determines a first key on the virtual keyboard according to the first data; the display device displays the content of the first key through the display screen, or executes the operation triggered by the first key.
In a possible implementation manner of the seventh aspect, the determining, by the display device, a first key on the virtual keyboard according to the first data includes: and determining a display track from a second key to a first key on the virtual keyboard according to the first data, wherein the second key is a predefined reference key on the virtual keyboard.
In a possible implementation manner of the seventh aspect, the determining, by the display device, a first key on the virtual keyboard according to the first data includes: and taking the second key as a starting point, acquiring a display track corresponding to the sliding track according to the first data, and taking the end point of the display track as the first key.
In one possible implementation manner of the seventh aspect, the method further includes: the display device receives second data sent by the input device, wherein the second data is used for describing a first touch operation, and the first touch operation is a touch operation except for a sliding operation; and displaying the content of the second key through the display screen according to the second data, or executing the operation triggered by the second key.
In one possible implementation of the seventh aspect, the first data indicates that the first sliding operation is obtained through a first area of a touch screen of the input device, and the method further includes: the display device receives third data sent by the input device, the third data is used for describing a second touch operation, the third data indicates that the second touch operation is obtained through a second area of the touch screen, and the first area and the second area are different areas; and determining the trigger operation corresponding to the third data.
In a possible implementation manner of the seventh aspect, the keys in the virtual keyboard are distributed in a trapezoid, or the keys in the virtual keyboard are distributed in concentric circles.
For specific implementation steps of the seventh aspect and various possible implementation manners of the seventh aspect in the embodiment of the present application and beneficial effects brought by each possible implementation manner, reference may be made to descriptions in various possible implementation manners in the first aspect, and details are not repeated here.
In an eighth aspect, embodiments of the present application provide a display device, which can be used in the field of split input. The display device is applied to display equipment, a virtual keyboard is displayed on a display screen of the display equipment, and the device comprises a receiving module, a determining module and an executing module. The device comprises a receiving module, a judging module and a display module, wherein the receiving module is used for receiving first data sent by input equipment, the first data is used for describing a sliding track of first sliding operation on the input equipment, and the first data comprises a sliding length parameter and/or a sliding angle of the sliding track; the determining module is used for determining a first key on the virtual keyboard according to the first data; and the execution module displays the content of the first key through the display screen, or executes the operation triggered by the first key.
In a possible implementation manner of the eighth aspect, the determining module is specifically configured to determine, according to the first data, a display trajectory from a second key to a first key on the virtual keyboard, where the second key is a predefined reference key on the virtual keyboard.
In a possible implementation manner of the eighth aspect, the determining module is specifically configured to use the second key as a starting point, obtain a display track corresponding to the sliding track according to the first data, and use an end point of the display track as the first key.
In a possible implementation manner of the eighth aspect, the receiving module is further configured to receive second data sent by the input device, where the second data is used to describe a first touch operation, and the first touch operation is a touch operation other than a sliding operation; and the execution module is also used for displaying the content of the second key through the display screen according to the second data or executing the operation triggered by the second key.
In one possible implementation of the eighth aspect, the first data indicates that the first sliding operation is obtained through a first area of a touch screen of the input device. The receiving module is further used for receiving third data sent by the input device, the third data is used for describing a second touch operation, the third data indicates that the second touch operation is obtained through a second area of the touch screen, and the first area and the second area are different areas; and the determining module is further used for determining the trigger operation corresponding to the third data.
In a possible implementation manner of the eighth aspect, the keys in the virtual keyboard are distributed in a trapezoid, or the keys in the virtual keyboard are distributed in concentric circles.
For specific implementation steps of the eighth aspect and various possible implementation manners of the eighth aspect of the embodiment of the present application and beneficial effects brought by each possible implementation manner, reference may be made to descriptions in various possible implementation manners in the first aspect, and details are not described here any more.
In a ninth aspect, an embodiment of the present application provides an input system, where the input system includes a display device and an input device, the display device is the display device according to the fourth aspect, or the display device according to the eighth aspect is the display device according to the fifth aspect, and the input device is the input device according to the fifth aspect.
In a tenth aspect, embodiments of the present application provide a computer program, which, when run on a computer, causes the computer to execute the input method of the first aspect, or causes the computer to execute the input method of the second aspect, or causes the computer to execute the input method of the third aspect, or causes the computer to execute the input method of the seventh aspect.
In an eleventh aspect, an embodiment of the present application provides an execution device, including a processor, coupled with the memory; the memory is used for storing programs; the processor is configured to execute the program in the memory, to cause the execution apparatus to execute the input method according to the first aspect, to cause the execution apparatus to execute the input method according to the second aspect, to cause the execution apparatus to execute the input method according to the third aspect, or to cause the execution apparatus to execute the input method according to the seventh aspect.
In a twelfth aspect, embodiments of the present application provide a computer-readable storage medium, in which a computer program is stored, which, when run on a computer, causes the computer to execute the input method according to the first aspect, or causes the computer to execute the input method according to the second aspect, or causes the computer to execute the input method according to the third aspect, or causes the computer to execute the input method according to the seventh aspect.
In a thirteenth aspect, embodiments of the present application provide a circuit system, which includes a processing circuit configured to execute the input method according to the first aspect, or execute the input method according to the second aspect, or execute the input method according to the third aspect, or execute the input method according to the seventh aspect.
In a fourteenth aspect, the present application provides a chip system, which includes a processor, and is configured to support implementing the functions referred to in the above aspects, for example, sending or processing data and/or information referred to in the above methods. In one possible design, the system-on-chip further includes a memory for storing program instructions and data necessary for the server or the communication device. The chip system may be formed by a chip, or may include a chip and other discrete devices.
Drawings
FIG. 1 is a system diagram of an input system provided by an embodiment of the present application;
fig. 2 is a schematic flowchart of an input method according to an embodiment of the present application;
fig. 3 is a schematic distribution diagram of a first area and a second area provided in an embodiment of the present application;
fig. 4 is a schematic diagram of a second key in the input method according to the embodiment of the present disclosure;
fig. 5 is a schematic diagram illustrating a second key acquired in the input method according to the embodiment of the present application;
fig. 6 is a schematic diagram illustrating two different distributions of a virtual keyboard in an input method according to an embodiment of the present application;
fig. 7 is a schematic distribution diagram of each key in a virtual keyboard in an input method according to an embodiment of the present application;
fig. 8 is another schematic flow chart of an input method provided in the embodiment of the present application;
fig. 9 is a schematic structural diagram of an input method according to an embodiment of the present application;
fig. 10 is a schematic structural diagram of a display device according to an embodiment of the present application;
FIG. 11 is a schematic structural diagram of an input device according to an embodiment of the present disclosure;
FIG. 12 is a schematic structural diagram of an input device according to an embodiment of the present disclosure;
fig. 13 is a schematic structural diagram of another display device according to an embodiment of the present disclosure;
fig. 14 is a schematic structural diagram of an execution device according to an embodiment of the present application;
fig. 15 is a schematic structural diagram of an input system according to an embodiment of the present application.
Detailed Description
The embodiment of the application provides an input method and related equipment, one key can be selected through one-time sliding operation, the operation mode is simple, and the input speed is high; and one first sliding operation corresponds to one first key, so that the flexibility of the input process is reserved.
The terms "first," "second," and the like in the description and in the claims of the present application and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the terms so used are interchangeable under appropriate circumstances and are merely descriptive of the various embodiments of the application and how objects of the same nature can be distinguished. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of elements is not necessarily limited to those elements, but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
Embodiments of the present application are described below with reference to the accompanying drawings. As can be known to those skilled in the art, with the development of technology and the emergence of new scenarios, the technical solution provided in the embodiments of the present application is also applicable to similar technical problems.
The embodiment of the application can be applied to various separated input application scenes. As an example, in an application scenario of a smart television, for example, a remote controller is an input device, a screen of the smart television is a display device, the two devices are separated, and a virtual keyboard is shown on a display screen of the display device. When a user selects a target key in the virtual keyboard by using the remote controller, the cursor needs to be controlled to jump in a line or between lines of the virtual keyboard by the up-down and left-right keys of the remote controller, and when the cursor reaches the target key, the user presses a confirmation key on the remote controller to click for confirmation. As another example, for example in a VR application scenario, the handheld controller is an input device, the head mounted device is a display device, and a virtual keyboard is shown on the display screen of the head mounted device, with the two devices separated. The mode that the user selects the target key in the virtual keyboard through the up-down left-right keys on the handheld controller is similar to the operation mode in the application scene of the smart television, and the detailed description is omitted here. It should be understood that the embodiments of the present application may also be applied to other application scenarios of split input, which are not exhaustive here. In the foregoing various scenarios, the user needs to move the cursor to the target key many times when selecting one key, which results in excessive operation times and slow input speed.
In order to solve the above problems, an embodiment of the present application provides an input method, where a user receives a first sliding operation input by the user through an input device, and sends first data for describing the first sliding operation to a display device, and the display device obtains first keys corresponding to the first data one by one, and further displays the content of the first keys or executes an operation triggered by the first keys, that is, in the embodiment of the present application, the user executes the first sliding operation once to select one key, so that the operation mode is simple, and the input speed is high; and one first sliding operation corresponds to one first key, so that the flexibility of the input process is reserved.
Referring to fig. 1, fig. 1 is a schematic system diagram of an input system provided in an embodiment of the present application, where the input method provided in the embodiment of the present application may be applied to the input system shown in fig. 1. The input system 100 comprises an input device 101 and a display device 102, and the input device 101 and the display device 102 need to be connected to the same local area network. The input device 101 is provided with a touch screen, and the display device 102 is provided with a display screen.
The input device 101 is configured to receive a first sliding operation input by a user through the touch screen and generate first data describing the first sliding operation. The input device 101 is further configured to send the first data to the display device 102 through the local area network, and the display device 102 obtains the first keys corresponding to the first data one by one, and displays the content of the first keys through a display screen of the display device 102, or executes an operation triggered by the first keys.
The input device 101 may be embodied as a mobile phone, tablet, or other mobile device with a touch screen and supporting local area network communication. The display device 102 may be specifically embodied as a smart television, a projector, an AR device, a VR device, or other device that has a display screen and supports local area network communication, and the expression forms of the specific input device 101 and the display device 102 may be determined in combination with an actual application scenario.
In an embodiment of the present application, please refer to fig. 2, where fig. 2 is a schematic flowchart of an input method provided in the embodiment of the present application, and the input method provided in the embodiment of the present application may include:
201. the input device receives a first sliding operation through the touch screen.
In the embodiment of the application, when a user wants to input characters, operation instructions or other information to the display device through the input device, the first sliding operation can be input through the touch screen. Correspondingly, the input device can receive a first sliding operation input by a user through the touch screen. The first sliding operation may be input by a user with a hand, a touch pen, or other devices.
Optionally, the touch screen of the input device is divided into a first area and a second area. The first area and the second area are different in that the display device processes different modes in the two cases that the input device receives the sliding operation from the first area and the input device receives the sliding operation from the second area. The specific processing manner can be referred to the following description.
Step 201 may include: the input device receives a first sliding operation through a first area of the touch screen. In one implementation, the first area may be located on the left side of the touch screen, and the second area may be located on the right side of the touch screen. In another implementation, the first area may be located at an upper side of the touch screen and the second area is located at a lower side of the touch screen. In another implementation manner, the first area is a central area of the touch screen, the second area is an edge area of the touch screen, and the width of the second area is smaller than or equal to the first threshold. In this case, the second area may also be referred to as a half-finger area, that is, when the user touches the second area, half of the user's finger is on the touch screen, half of the user's finger is in the touch screen, and the finger belly touches the edge of the screen. In the embodiment of the application, the second area is arranged in the edge area of the touch screen, so that a user can position the second area by means of the frame of the input device, and the user can be guided to complete input operation from the second area through touch and muscle memory, so that the difficulty of the user in the input operation from the second area is reduced, and the viscosity of the user is improved.
Further, the touch screen includes four edge regions near the boundary, i.e., up, down, left, and right, and the second region may include any one or a combination of any plurality of the four edge regions near the boundary.
In one implementation, the first threshold may be a relative value, such as taking a preset percentage of the side length. As an example, for example, if the preset percentage is twenty percent and the long side is 2400 pixels, the width of the edge region near the wide side boundary needs to be less than or equal to 480 Pixels (PX). In another implementation, the first threshold may also be an absolute preset value, such as 500 pixels, 600 pixels, or 700 pixels. In yet another implementation, the first threshold may also be determined according to two dimensions, where the first threshold is a preset percentage of the side length when the size of the touch screen is smaller than or equal to a first preset size, and the first threshold is an absolute preset value when the size of the touch screen is larger than the first preset size. The division of the first area and the second area can be flexibly set by the operation habit of the user, and is not limited herein.
For a more intuitive understanding of the present disclosure, please refer to fig. 3, and fig. 3 is a schematic distribution diagram of the first region and the second region according to an embodiment of the present disclosure. The area where a1 is located is a first area, the areas where a2, A3, a4 and a5 are second areas, and the widths of a2, A3, a4 and a5 are all 500 pixels, it should be understood that fig. 3 is only an example, in other implementations, only the areas where a2 and A3 are located may be determined as the second areas, only a4 and a5 may be set as the second areas, and the like, which are not limited herein.
Further optionally, the first region may be a whole, or may be divided into a first sub-region and a second sub-region, where the first sub-region is a left half of the first region, and the second sub-region is a right half of the first region. Step 201 may include: the input device receives a first sliding operation through the first sub-area of the touch screen, or the input device receives a first sliding operation through the second sub-area of the touch screen.
202. The input device generates first data describing a slide trajectory of a first slide operation.
In the embodiment of the application, the input device generates first data for describing the sliding track of the first sliding operation while receiving the first sliding operation. Specifically, the input device collects and generates coordinates of each contact point at a preset frequency. The preset frequency may be 40 times per second, 50 times per second, 60 times per second, or other frequencies, etc.
The first data includes description information of a plurality of contact points on a sliding track of the first sliding operation, and the first data includes operation type information corresponding to the first sliding operation and coordinates of each of the plurality of contact points corresponding to the first sliding operation.
Further, taking the android system installed in the input device as an example, the operation type information may be embodied by Touch identification information (Touch ID), that is, the description information of each contact point includes a contact point coordinate and a Touch ID corresponding to the contact point. When the Touch screen of the input device detects a new Touch operation input by a user, the system allocates a new Touch ID, and acquires coordinates of a plurality of contact points in real time at a preset frequency, if the Touch screen of the input device detects that the user maintains the Touch operation, the Touch ID will not change, that is, if the user maintains the Touch operation all the time, the Touch IDs of the plurality of contact points are the same. And if the Touch screen of the input device detects that the user inputs a new Touch operation again, assigning a new Touch ID to the new Touch operation.
Furthermore, the plurality of successive contact points corresponding to the sliding operation are characterized by: the coordinates of the plurality of consecutive contact points are different, but the plurality of consecutive contact points all correspond to the same Touch ID. Since the duration of a swipe operation is generally longer, the number of consecutive contact points corresponding to a swipe operation (i.e., corresponding to the same Touch ID as described above) is greater than the first number threshold. As an example, for example, the information of the first contact point may be (1, 1, 000001), the coordinates indicating the contact point are (1, 1), the Touch ID corresponding to the contact point is 000001; as another example, for example, the information of the second contact point may be (10, 10, 000001), the coordinates indicating the contact point are (10, 10), the Touch ID corresponding to the contact point is 000001, and it is proved that the first contact point and the second contact point belong to the same Touch operation, it should be understood that the example is merely for convenience of understanding the present solution.
The plurality of consecutive contact points corresponding to the one-click operation are characterized in that: the coordinates of a plurality of consecutive contact points are the same, and the plurality of consecutive contact points also correspond to the same Touch ID. Since the duration of one click operation is generally short, the number of consecutive contact points corresponding to one click operation is less than or equal to the second number threshold.
The characteristics of a plurality of continuous contact points corresponding to the long press operation are as follows: the coordinates of the multiple continuous contact points are the same, the multiple continuous contact points also correspond to the same Touch ID, the number of the multiple continuous contact points corresponding to one click operation is larger than a third number threshold, and values of the third number threshold and the second number threshold can be the same or different.
The multiple successive contact points corresponding to the double-click operation are characterized by: the Touch screen comprises two groups of continuous contact points, the two groups of continuous contact points correspond to different Touch IDs, and the characteristics of each group of continuous contact points are the same as those of contact points of single click operation.
In the above, only the android system is installed in the input device, and one method for identifying the operation type is described, it should be understood that there are other methods for identifying the operation type in the android system, and other methods for identifying the operation type in other types of operation systems are also possible, for example, the operation type information corresponding to the sliding operation may be hand touch (hands touch), sliding, hand lift (hands off), and the like, and the description is not exhaustive here.
More specifically, a first coordinate system is configured on the input device, and the first coordinate system is established based on the touch screen; the display device is provided with a second coordinate system, and the second coordinate system is established based on the display screen. The origin of the first coordinate system may be a center point of the touch screen, an upper left corner vertex, a lower left corner vertex, an upper right corner vertex, a lower right corner vertex, or a point outside the touch screen, and is not limited herein. The origin of the second coordinate system may be a center point of the display screen, an upper left corner vertex, a lower left corner vertex, an upper right corner vertex, a lower right corner vertex, or a point outside the touch screen, and the like, which is not limited herein.
A first coordinate for a contact point in the first data. Since the screen sizes of the input device and the display device may be different, in one case, the input device does not store a first conversion relationship between the first coordinate system and the second coordinate system (i.e., a display control ratio between the input device and the display device) in advance, the display device stores the display control ratio, and the unit lengths in the first coordinate system and the second coordinate system are the same. The input device may acquire coordinates of a contact point in the first coordinate system, and directly determine the coordinates of the contact point in the first coordinate system as the first coordinates of the contact point, that is, the first coordinates included in the first data are coordinates in the first coordinate system established based on the touch screen. And then the display device aligns the first sliding operation described by the first data to a display screen of the display device according to the coordinates of the plurality of contact points included in the first data and the display control ratio between the input device and the display device.
In another case, a first conversion relationship between a first coordinate system and a second coordinate system (i.e., a display control ratio between the input device and the display device) is stored in advance on the input device, and the unit lengths in the first coordinate system and the second coordinate system are the same. The input device may acquire coordinates of a contact point in a first coordinate system, and convert the coordinates of the contact point in the first coordinate system into first coordinates of the contact point in a second coordinate system according to a display control ratio (i.e., a first conversion relationship) between the input device and the display device, where the first coordinates are coordinates of the contact point in the second coordinate system established based on the display screen.
Further, the unit length of the first coordinate system and the second coordinate system may be one pixel. The display control ratio (control display gain) between the input device and the display device may be reconfigured each time the input system of the input device and the display device is established. The display control ratio is related to factors such as the size of the input device, the size of the display device, and the operation habit of the user.
Further, the operation habit of the user is configured in advance in the input device or the display device. If the display control ratio is generated by the display device, the input device sends the size of the input device to the display device when an input system composed of the input device and the display device is established each time, and the display device generates the display control ratio between the input device and the display device (i.e. obtains the first conversion relation between the first coordinate system and the second coordinate system) according to the size of the input device, the size of the display device, the operation habit of a user and other factors. If the display control ratio is generated by the input equipment, the display equipment sends the size of the display equipment to the input equipment when an input system consisting of the input equipment and the display equipment is established each time, and the display control ratio between the input equipment and the display equipment is generated by the input equipment according to the size of the input equipment, the size of the display equipment, the operation habit of a user and other factors.
It should be noted that step 201 and step 202 are performed simultaneously, that is, the input device generates the first data while receiving the first sliding operation through the display screen.
203. The input device transmits the first data to the display device.
In the embodiment of the application, the input device and the display device are located in the same local area network, and the input device sends the first data to the display device through the local area network. Specifically, the input device may determine whether the duration of the entire operation exceeds a first duration threshold in the process of generating the first data, and when the duration of the first sliding operation reaches the first duration threshold, the input device may package, within the first duration threshold, the generated first data for describing a part of the first sliding operation, and send the first data to the display device; the input device performs a first data transmission operation every first time length threshold to transmit all first data describing a first sliding operation to the display device. The value of the first time threshold may be 0.5 second, 1 second, 1.5 seconds, or other time, and is not limited herein.
And if the duration of the whole first sliding operation does not reach the first duration threshold, immediately sending first data for describing the whole first sliding operation to the display device when the input device determines that the whole first sliding operation is finished. That is, if the total duration of the first sliding operation does not reach the first duration threshold, the end of the first sliding operation is taken as a trigger point of the sending operation.
For example, if the value of the first time threshold is 1 second, the user starts to input the first sliding operation as a timing starting point, and if the total time of the first sliding operation is within 1 second, the input device sends first data describing the first sliding operation to the display device when the user completes the first sliding operation. If the total duration of the first sliding operation is 3 seconds, the input equipment sends first data for describing the first sliding operation within 1 second to the input equipment when the timing reaches 1 second; when the timing reaches 2 seconds, sending first data for describing a first sliding operation in the 2 nd second to the input device; when the timing reaches 3 seconds, first data for describing the first sliding operation in the 3 rd second is sent to the input device, and it should be understood that the example is only for convenience of understanding the scheme and is not used for limiting the scheme.
204. The display device determines whether the first sliding operation is located in the first area according to the first data, if so, the process proceeds to step 205, and if not, the process proceeds to step 218.
In some embodiments of the present application, if the touch screen of the input device is divided into a first area and a second area, a first coordinate area and a second coordinate area may be configured in the display device, where the first coordinate area is a coordinate area of the first area, and the second coordinate area is a coordinate area of the second area. After the display device acquires the first data, the first coordinate of the starting point of the first sliding operation is acquired from the first data, and whether the first coordinate is located in the first coordinate area is judged. If the first coordinate is located in the first coordinate region, determining that the first sliding operation is acquired through the first region of the touch screen, and entering step 205; if the first coordinate is located in the second coordinate region, it is determined that the first sliding operation is acquired through the second region of the touch screen, and then the processing is performed in the subsequent step 218.
205. The display device determines whether the first sliding operation is a sliding operation based on the first data, if so, the process proceeds to step 206, and if not, the process proceeds to step 213.
In this embodiment of the application, the display device determines whether the operation described by the first data is a sliding operation according to the operation type information carried in the first data, if so, the process goes to step 206, and if not, the process goes to step 213. The specific representation form of the operation type information and the corresponding relationship between the operation type information and the operation type are already described in step 202, and are not described herein again.
It should be noted that, in the embodiment of the present application, the execution order between step 204 and step 205 is not limited, and step 204 may be executed first, step 205 may be executed first, or steps 204 and 205 may be executed simultaneously.
206. The display device determines a display track from a second key to a first key on the virtual keyboard according to the first data.
In the embodiment of the application, after the display device receives all or part of the first data, it can be known that the current operation is a sliding operation according to the operation type information carried in the first data, and the first sliding operation is obtained through the first area of the input device. The display device determines a display track from a second key to a first key on the virtual keyboard according to the first data. Wherein the first data is for indicating one or more parameters of: a sliding length parameter and a sliding angle; the first data may also be used to indicate a location area of the first sliding operation. In the embodiment of the application, the first keys corresponding to one another are determined according to the parameters of two dimensions of the sliding angle and/or the sliding length, so that the realization flexibility of the scheme is enhanced.
The second key is a predefined reference key, the predefined reference key is used for the display device to execute the process of mapping the first sliding operation on the input device to the display device to obtain the display track, and the coordinate position of the second key determines the coordinate position of the starting point of the display track. Further, the coordinate position of the second key may be used as the coordinate position of the starting point of the display track, or may be a preset position relationship between the coordinate position of the starting point configured on the display device and the coordinate position of the second key. I.e. the mapping of the first sliding operation onto the display device, is not an absolute mapping procedure but a relative mapping procedure with the second key as a predefined reference key. Further, when the different first data indicate that the initial contact points of the different first sliding operations on the input device are different, the mapping of the initial contact points of the different first sliding operations to the initial points in the display screen is the same.
The second key may be a key with a high utilization rate in the virtual keyboard, or may be a key located at a central position in the virtual keyboard, and the second key may also be determined based on other factors, and the like. Further, the display device may predefine one or at least two second keys. If the first area is divided into a first sub-area and a second sub-area, the first coordinate area includes a first sub-coordinate area and a second sub-coordinate area, two second keys corresponding to the first sub-coordinate area and the second sub-coordinate area one to one are configured in the display device, and each second key may be a key with the highest utilization rate in each sub-area, or a key located at the center position in each sub-area.
Specifically, the display device uses the second key as a starting point of the display track, obtains the display track corresponding to the sliding track of the first sliding operation according to the first data, and uses the end point of the display track as the first key. The process of obtaining the display track corresponding to the sliding track of the first sliding operation refers to an internal conversion process executed by the display device.
After the display device obtains the display track corresponding to the sliding track of the first sliding operation, the display device may not display the display track corresponding to the sliding track of the first sliding operation on the display screen; or a second key on the display screen can be used as a starting point of the display track, and the display track corresponding to the sliding track of the first sliding operation is displayed on the display screen.
More specifically, a process of acquiring, for the display device, a display trajectory corresponding to the slide trajectory of the first slide operation. After the display device obtains a data packet carrying first data, no matter whether the first data describe all the first sliding operations or part of the first sliding operations, the display device starts to analyze the first data to acquire a display track corresponding to the sliding track. In one case, the plurality of first coordinates included in the first data are in a first coordinate system. The display apparatus is capable of obtaining first coordinates of a plurality of contact points corresponding to the first sliding operation included in the first data after obtaining the first data. The display equipment can calculate a first sliding length and/or a sliding angle of the first sliding operation according to the first coordinates of the contact points; and converting the first sliding length according to a display control ratio (namely a first conversion relation) between the display equipment and the input equipment to obtain a second sliding length of which the first sliding operation is mapped to a second coordinate system. And the display equipment takes the coordinates of the second key in the second coordinate system as the starting point of the display track, and generates a display track mapped to the display track of the first sliding operation according to the second sliding length and/or the sliding angle of the first sliding operation. That is, the coordinates of the second key in the second coordinate system are used as the coordinates of the starting point, and the coordinates of the ending point of the display track corresponding to the whole first sliding operation in the second coordinate system (that is, the coordinates of the ending point of the first sliding operation mapped to the display screen) are calculated according to the second sliding length and/or the sliding angle of the first sliding operation.
Optionally, after the display device obtains the display track corresponding to the sliding track of the first sliding operation from the first data, the display device may display the display track corresponding to the sliding track of the first sliding operation on the display screen in real time. In the embodiment of the application, the display track mapped to the display screen by the first sliding operation is displayed on the display screen in real time, so that the user can completely put the attention on the display screen, the user is ensured not to pay attention to the input equipment with head down, and the physiological burden and attention conversion caused by repeated head lowering and head up of the user are reduced.
To further understand the present embodiment, the unit lengths of the first coordinate system and the second coordinate system are both pixels, and the display control ratio is 10, for example, if the coordinates of the initial contact point corresponding to the first sliding operation in the first data in the first coordinate system are (0, 0), and the coordinates of the end contact point corresponding to the first sliding operation in the first coordinate system are (10, 10), the first sliding length of the first sliding operation indicated by the first data is 10 times the root 2 pixels, and the sliding angle is 45 degrees. And if the display control ratio is 10, the second sliding length after the first sliding operation is mapped to the display screen is 100 times the root number of 2 pixels, and the sliding angle is 45 degrees. If the coordinates of the second key in the second coordinate system are (100 ), the coordinates after mapping the middle point or the ending contact point of the first sliding operation to the second coordinate system are (200 ), and it should be understood that the foregoing examples are only for convenience of understanding the present solution.
In another case, the coordinates of the plurality of contact points included in the first data are in the second coordinate system, that is, the first coordinates of the plurality of contact points included in the first data are adjusted by the input device in advance according to the display control ratio. And after the display device acquires the first data, directly calculating to obtain a second sliding length and/or a sliding angle according to the first coordinates of the multiple contact points. The subsequent step of generating the display trajectory according to the second sliding length and/or the sliding angle is described above.
It should be noted that, if the execution device executes one sending operation in step 203 to send the entire first data for describing the complete first sliding operation to the display device, in step 206, the display device can acquire the coordinates of the termination point of the display track in the second coordinate system by executing one obtaining operation of the display track. If the executing device executes multiple sending operations in step 203, and then sends all the first data describing the complete first sliding operation to the display device, in step 206, the display device needs to repeatedly execute multiple obtaining operations of the display trajectory to obtain the coordinates of the termination point of the display trajectory in the second coordinate system.
For a more intuitive understanding of the present disclosure, please refer to fig. 4, where fig. 4 is a schematic diagram of a second key in the input method according to the embodiment of the present disclosure. Fig. 4 includes two sub-diagrams, an upper sub-diagram and a lower sub-diagram, where the upper sub-diagram refers to a virtual keyboard displayed in a display screen, the lower sub-diagram reflects a distribution of a touch screen, the meanings of a1 to a4 can be referred to above in reference to fig. 3, B1 refers to a first sub-region, a selection operation of a key in a B1 region of the virtual keyboard is input through a B1 region of the touch screen, and a selection operation of a key in a B2 region of the virtual keyboard is input through a B2 region of the touch screen. Corresponding to the two areas B1 and B2 are a key d and a key j (i.e., two predefined second keys), respectively, and when the display device determines that the initial contact point of the first sliding operation is located in the first sub-area, the display device takes the key d (i.e., one second key) as the initial point of the first sliding operation; when the display device determines that the initial contact point of the first sliding operation is located in the second sub-area, the display device takes the key j (i.e., another second key) as the initial point of the first sliding operation. It should be understood that the example in fig. 4 is only for convenience of understanding the present solution and is not intended to limit the present solution.
A process of determining a first key for a display device. And a virtual keyboard is displayed on the display equipment, and the display equipment is provided with a one-to-one correspondence relationship between each key in the virtual keyboard and a third coordinate area under the second coordinate system. That is, the display device is configured with a plurality of third coordinate regions, each third coordinate region corresponds to one key of the virtual keyboard and is used for indicating the coverage area of one key of the virtual keyboard. For example, the third coordinate region corresponding to the key representing the character a is [ 480-.
The display device matches the coordinates of the termination point of the display track in the second coordinate system with the coverage range of the plurality of third coordinate areas, and if the coordinates of the termination point in the second coordinate system are located in one target coordinate area of the plurality of third coordinate areas, the first key corresponding to the target coordinate area is obtained, wherein the target coordinate area is one coordinate area of the plurality of third coordinate areas.
If the coordinate of the termination point in the second coordinate system does not exist in any one of the plurality of third coordinate regions, the display device may feed back prompt information indicating that the key selection fails to the user, so as to prompt the user to input the first sliding operation through the touch screen of the input device. Specifically, the display device may display the "key selection failure" through the display screen, or output a prompt sound of "key selection failure, please re-select" through the speaker, or the display device may also feed back a prompt message of the key selection failure to the user through other manners, and the like, which is not limited herein. In the embodiment of the application, the keyboard layout is always displayed in the display device, the predefined second key is used as a starting point, and the position relationship between the first key and the second key corresponds to the sliding length and the sliding angle of the first sliding operation, so that the user can conveniently learn.
For a more intuitive understanding of the present disclosure, please refer to fig. 5, and fig. 5 is a schematic diagram illustrating obtaining a second key in an input method provided in an embodiment of the present disclosure. In fig. 5, for example, the touch screen includes a first area and a second area, the first area is divided into the first sub-area and the second sub-area, C1 is a first sliding operation received by the input device through the first sub-area, and first data used for describing the first sliding operation is sent to the display device, a sliding track obtained by the display device and used for projecting the first sliding operation onto the display screen is a sliding track from a key d (a predefined second key) to a key a, and a coordinate of a termination point obtained by the display device and projected by the first sliding operation onto the display screen is located in a coordinate range corresponding to the key a, and then the first key corresponding to the first data one to one is determined to be the key a.
Each key in the virtual keyboard displayed on the display device is distributed in a trapezoid shape, or each key in the virtual keyboard is distributed in a concentric circle shape, or each key in the virtual keyboard is distributed in other shapes, which is not limited herein. The coverage areas of different keys do not coincide. In the embodiment of the application, two specific modes of virtual keyboard layout are provided, and the flexibility of user selection is improved.
For a more intuitive understanding of the present disclosure, please refer to fig. 6, and fig. 6 is a schematic diagram illustrating two different distributions of a virtual keyboard in an input method according to an embodiment of the present disclosure. Fig. 6 includes an upper sub-diagram and a lower sub-diagram, where the upper sub-diagram shows that each key in the virtual keyboard is distributed in a trapezoid shape, and the lower sub-diagram shows that each key in the virtual keyboard is distributed in concentric circles. It should be understood that the example in fig. 6 is only for convenience of understanding the present solution and is not intended to limit the present solution.
Optionally, the distance between the key with higher frequency of use and the second key is closer, and the difference of the direction angles of the two adjacent keys is not less than 30 degrees.
To prove the feasibility of the present solution, please refer to fig. 7, and fig. 7 is a schematic distribution diagram of each key in the virtual keyboard in the input method according to the embodiment of the present application. In fig. 7, taking the user holding the input device with both hands and using two thumbs to input the sliding operation as an example, the touch screen is naturally divided into left and right half screens. Meanwhile, the conventional QWERTY keyboard is conceptually divided into left and right portions. The virtual keyboard is divided into two parts in fig. 7 with character Y, character H and character B as boundaries. And taking the character D and the character K as central points of the left half screen and the right half screen respectively, and taking other characters as characters which are outwards arranged by taking the character D and the character K as centers. As shown in fig. 7, the sliding operation input by the user may provide parameters of two dimensions of the sliding length and the sliding angle for the display device to distinguish characters. For example, the character F, G, H and the character D, K are in the same horizontal row, and in the left sub-diagram of FIG. 7, we can see that the sliding from character D to character F, G, H is horizontal, but the sliding lengths are significantly different. As another example, the characters E and R are substantially the same distance from the character D on the keyboard layout, but unlike the relative position of the character D, E is biased to the upper left and R is biased to the upper right. It should be understood that the example in fig. 7 is only for demonstrating the feasibility of the present solution and is not intended to limit the present solution.
207. The display device displays the content of the first key through the display screen, or executes the operation triggered by the first key.
In the embodiment of the application, after the display device determines the first key, the display device displays the content of the first key through the display screen, or executes an operation triggered by the first key. The content of the first key may be characters, radicals, numbers, spaces, symbols or other content, and the like, and the operation triggered by the first key includes, but is not limited to, selecting, deleting, canceling, returning, and the like.
208. The input device receives a first touch operation through the touch screen, the first touch operation being a touch operation other than a slide operation.
In this embodiment, the input device may further receive a first touch operation through the touch screen, where the first touch operation is a touch operation other than a sliding operation. As an example, the first touch operation may be any one of the following: a click operation, a double click operation, a long press operation, or other touch operations other than a slide operation.
Optionally, if the touch screen of the input device includes a first area and a second area, step 207 includes: the input device receives a first touch operation through a first area of the touch screen.
209. The input device generates second data describing the first touch operation.
210. The input device sends the second data to the display device.
211. The display device determines whether the first touch operation is located in the first area according to the second data, if so, step 212 is performed, and if not, step 218 is performed.
212. The display device determines whether the first touch operation is a sliding operation according to the second data, if so, the process proceeds to step 206, and if not, the process proceeds to step 213.
In the embodiment of the present application, the specific implementation process of steps 209 to 212 may refer to the description of steps 202 to 205, which is not described herein again. The meaning of the second data is similar to that of the first data, and the second data includes operation type information and coordinates of a contact point corresponding to the operation, and for the expression manner of the operation type information of the non-sliding operation, reference may be made to the description in step 202, which is not described herein again.
213. And the display equipment displays the content of the second key through the display screen according to the second data, or executes the operation triggered by the second key.
In the embodiment of the application, after the display device acquires the second data, and according to the operation type information carried in the second data, after the first touch operation is determined not to be the sliding operation, the content of the second key can be displayed through the display screen, or the operation triggered by the second key is executed. As an example, for example, when the first touch operation may be a double-click operation, a single-click operation, a long-press operation, or other types of operations. The second key may be a key located at the center of the virtual keyboard, a space key, a character case change key, or other types of keys, and it should be understood that the examples herein are only for convenience of understanding the present solution and are not used to limit the present solution.
Further optionally, if the first area is divided into a first sub-area and a second sub-area, one second key matched with the first sub-area and another second key matched with the second sub-area may be pre-configured on the display device. The display device further needs to determine whether the first touch operation is obtained through the first sub-area or the second sub-area according to the coordinates of the contact point carried in the second data. The touch operations of the same type acquired through the first sub-area and the second sub-area correspond to different second keys. For example, when the first touch operation is a single-click operation and the second data indicates that the first touch operation is from the first sub-region, the key corresponding to the single-click operation from the first sub-region is a character d; when the first touch operation is a click operation and the second data indicates that the first touch operation is from the second sub-area, the keys corresponding to the click operations from the second sub-area one by one are characters j.
In the embodiment of the application, the user can select the second key by inputting other types of operations except sliding operation, so that the vacancy of the second key is avoided, and the utilization rate of the virtual keyboard is improved.
It should be noted that steps 208 to 213 are optional steps, and if steps 208 to 213 are executed, the execution sequence between steps 208 to 213 and steps 201 to 208 is not limited. Steps 208 to 213 may be performed first, or steps 201 to 208 may be performed first. If steps 208 to 213 are not performed, step 205 does not need to be performed either.
214. The input device receives a second touch operation through a second area of the touch screen.
In the embodiment of the present application, the specific implementation process of step 214 may refer to the description of step 201, which is not described herein again.
215. The input device generates third data describing the second touch operation.
In the embodiment of the application, after receiving the second touch operation through the second area, the input device generates third data for describing the second touch operation. The second touch operation may be any type of operation, including but not limited to a click operation, a slide operation, a double click operation, a long press operation, and the like.
The third data is used to describe a second touch operation, the first data indicating that the first sliding operation is achieved through a first area of a touch screen of the input device, and the third data indicating that the second touch operation is achieved through a second area of the touch screen. The first area and the second area are different areas, and the second area may be referred to as an absolute position area. Since the coordinates of the plurality of contact points corresponding to the second touch operation are carried in the third data, it is possible to indicate that the second touch operation is obtained through the second area. The meaning of the third data is similar to that of the first data, and both the third data and the first data include operation type information and coordinates of a contact point corresponding to the operation, which are described in step 202 and are not described herein again.
216. The input device transmits the third data to the display device.
217. The display device determines whether the second touch operation is located in the first area according to the third data, if so, the process proceeds to step 205, and if not, the process proceeds to step 218.
In this embodiment of the application, the specific implementation process of steps 216 and 217 may refer to the description of steps 203 and 204, which is not described herein again.
218. The display device determines a trigger operation corresponding to the third data.
In the embodiment of the application, the display device determines the trigger operation corresponding to the third data after determining that the second touch operation is obtained from the second area of the input device according to the third data.
Specifically, in one case, since the second touch operations may represent different types of touch operations, one trigger operation may be configured on the display device in one-to-one correspondence with each type of second touch operation, and the second touch operation is different from the first touch operation in that the first touch operation is obtained through the first area of the input device and the second touch operation is obtained through the second area of the input device. After the third data is acquired, the display device may determine that the second touch operation described by the third data is acquired through the second area of the input device according to the coordinates of the plurality of contact points included in the third data. And then determining that the operation type of the second touch operation is the second operation type according to the operation type information carried in the third data, wherein the second operation type is one of all possible operation types of the second touch operation. The display device obtains trigger operations corresponding to the second operation types one by one.
As an example, when the second touch operation is an upward slide operation, for example, the trigger operation in one-to-one correspondence with the upward slide operation is turning up the volume; for example, when the second touch operation is a downward sliding operation, the trigger operation corresponding to the downward sliding operation one to one is to turn down the volume; for example, when the second touch operation is a leftward sliding operation, the trigger operation corresponding to the leftward sliding operation one to one is to turn a page leftward; for example, when the second touch operation is a rightward sliding operation, the trigger operation corresponding to the leftward sliding operation one by one is a rightward page turning; for example, when the second touch operation is a click operation, the trigger operation corresponding to the click operation one to one is confirmation; for example, when the second touch operation is a double-click operation, the trigger operation corresponding to the double-click operation one by one is deletion or return; in addition, the triggering operation may also be to display a preset character, where the preset character is a word with a high utilization rate, and it should be understood that the example is only for convenience of understanding the scheme, and is not used for limiting the scheme.
In another case, the second touch operation may be touch operation from different positions in the second area, that is, the second area is further divided, the one-to-one correspondence relationship between the plurality of coordinate areas and the plurality of shortcut keys in the second area is pre-configured on the display device, and the triggering operation is an operation triggered by a shortcut key. The display device determines, according to first coordinates of a plurality of contact points corresponding to the second touch operation carried in the third data in the first coordinate system, that the touch position of the second touch operation is located in a fourth coordinate area of the plurality of coordinate areas included in the second area, and acquires a trigger operation corresponding to the fourth coordinate area, where the fourth coordinate area is one of the plurality of coordinate areas included in the second area. The implementation manner of the display device determining the position of the second touch operation in the input device according to the first coordinate of the contact point carried in the third data may refer to the description in the above step, which is not described herein again.
As an example, for example, the user may divide the left edge area into two upper and lower key positions, two trigger operations corresponding to the two keys are respectively used for adjusting the screen brightness, the user may divide the left edge area into two upper and lower key positions, two trigger operations corresponding to the two keys are respectively used for adjusting the sound size, the lower edge area is divided into three left, middle and right key positions, and two trigger operations corresponding to the three keys are respectively a submit key, a blank key, a delete key, and the like.
It should be noted that steps 214 to 218 are optional steps, and if the touch screen of the input device is not divided into the first area and the second area, steps 214 to 218 do not need to be executed, and steps 204 and 211 do not need to be executed.
In the embodiment of the application, a user can select the keys in one-to-one correspondence by inputting sliding operation in the first area and can select the keys in one-to-one correspondence by inputting second touch operation in the second area, so that the number of operations corresponding to the keys in the virtual keyboard is increased, and the realization flexibility of the scheme is improved.
In the embodiment of the application, one first key can be obtained through one first sliding operation, namely, one key can be selected by a user through one sliding operation, the operation mode is simple, and the input speed is high; and one first sliding operation corresponds to one first key, so that the flexibility of the input process is reserved.
For a more intuitive experience of the embodiment of the present application, please refer to fig. 8, and fig. 8 is a schematic flowchart of an input method provided by the embodiment of the present application. In fig. 8, the user wants to input a character DOG as an example. Fig. 8 includes three sub-diagrams respectively corresponding to the input processes of the character D, the character O, and the character G, and each sub-diagram includes a display screen of a display device (i.e., a keyboard shown in the figure) and a touch screen of an input device (i.e., a handheld device shown in the figure). The first area of the touch screen is divided into a left half area and a right half area, the predefined reference key of the first sub area (namely the left half area) is the key corresponding to the character D, and the predefined reference key of the second sub area (namely the right half area) is the key corresponding to the character K.
The first step is as follows: inputting character D
The method comprises the steps that a user holds an input device with hands, in order to input a character D according to a virtual keyboard displayed on a display screen of a display device, the user inputs a click operation in a first sub-area of a touch screen of the input device, correspondingly, in the process that the input device receives the click operation, second data used for describing the click operation is generated, and the second data are sent to the display device. After the display device receives the second data, it is known that the input device receives a click operation through the first sub-region, and it can be determined that the keys corresponding to the click operation of the first sub-region one by one are keys whose contents are the characters D, and the characters D are highlighted, and the characters D are displayed in the input box.
The second step is that: inputting character O
To input the character O, the user inputs a first sliding operation in the second sub-area of the touch screen of the input device, and as shown in the second sub-diagram of fig. 8, the first sliding operation input by the user through the second sub-area is a sliding operation to the upper right. Correspondingly, in the process that the input device receives the sliding operation towards the upper right, first data used for describing the sliding operation towards the upper right are generated, and the first data are sent to the display device.
After the display device receives the first data, it is known that the input device receives a sliding operation to the upper right through the second sub-area, the key with the content of the character K can be used as a starting point of a sliding track, the sliding operation to the upper right input by the user is mapped to a display screen of the display device according to the sliding length, the sliding angle and the display control ratio of the sliding operation to the upper right indicated by the first data, that is, the sliding track from the key with the content of the character K to the key with the content of the character O shown in the second sub-diagram, the sliding operation to the upper right is mapped to the end point of the sliding track in the display screen in the coverage range of the key with the content of O, that is, the keys corresponding to the first data one by one are the keys with the content of O, the keys of the character O are highlighted, and the character DO is displayed in the input box.
The third step: inputting character G
In order to input the character G, the user inputs a first sliding operation in the first sub-area of the touch screen of the input device, and as shown in the third sub-diagram of fig. 8, the first sliding operation input by the user through the first sub-area is a sliding operation to the left. Correspondingly, in the process that the input device receives the leftward sliding operation, first data used for describing the leftward sliding operation is generated, and the first data is sent to the display device.
After the display device receives the first data, it is known that the input device receives a leftward sliding operation through the first sub-region, the key with the content of the character D can be used as a starting point of a sliding track, according to the sliding length, the sliding angle and the display control ratio of the leftward sliding operation indicated by the first data, the leftward sliding operation input by the user is mapped onto a display screen of the display device, that is, the sliding track between the key with the content of the character D and the key with the content of the character G shown in the third sub-diagram is obtained, the end point of the sliding track mapped into the display screen by the leftward sliding operation is within a coverage range of the key with the content of G, that is, the keys one-to-one corresponding to the first data are the keys with the content of G, the keys of the character G are highlighted, and the character DOG is displayed in an input frame, so that the input of the character DOG is completed.
It should be understood that the example in fig. 8 is only one example for more intuitive understanding of the present solution, and is not intended to limit the present solution.
An input method is further provided in an embodiment of the present application, please refer to fig. 9, where fig. 9 is a schematic flowchart of the input method provided in the embodiment of the present application, and the input method provided in the embodiment of the present application may include:
901. the input device receives a first sliding operation through the touch screen.
902. The input device generates a slide trajectory first data describing a first slide operation.
In the embodiment of the present application, the specific implementation processes of steps 901 and 902 may refer to the descriptions of steps 201 and 202, which are not described herein again.
903. The input device determines a first key according to the first data and a second key, wherein the first key is a key on the virtual keyboard, and the second key is a predefined reference key on the virtual keyboard.
In some embodiments of the present application, a virtual keyboard and a one-to-one correspondence relationship between each key in the virtual keyboard and one coordinate region in a first coordinate system may be pre-built in the input device; a second key is also predefined from the virtual keyboard. Similar to the embodiments corresponding to fig. 2, in fig. 9, the number of the second keys may be one or at least two, and the detailed representation may refer to the description in the embodiments corresponding to fig. 2. It should be noted that the display screen of the input device may or may not display the virtual keys.
After obtaining the first data, the input device can know the first sliding length and/or the sliding angle of the first sliding operation in the first coordinate system. The input device takes the coordinates of the second key in the first coordinate system as the coordinates of the starting point of the sliding track in the first coordinate system, and generates the coordinates of the ending point of the sliding track of the first sliding operation in the first coordinate system according to the first sliding length and/or the sliding angle. And then the input device matches the coordinates of the termination point of the sliding track in the first coordinate system with the plurality of coordinate areas, and if the coordinates of the termination point of the sliding track in the first coordinate system are matched with a fifth coordinate area in the plurality of coordinate areas, the first key corresponding to the fifth coordinate area is determined, so that the key content corresponding to the first key or the operation triggered by the first key can be determined.
If the coordinate of the termination point of the sliding track in the first coordinate system is not matched with any coordinate region in the plurality of coordinate regions, the indication information of 'selection failure' may be output through the display screen of the input device, and the specific implementation manner may refer to the description in the embodiment corresponding to fig. 2.
904. The input device sends the key content corresponding to the first key or an operation instruction corresponding to the operation triggered by the first key to the display device.
905. The input device displays the content of the first key through the display screen, or executes the operation triggered by the first key.
In the embodiment of the present application, the specific implementation process of step 905 may refer to the description of step 207, which is not described herein again.
906. The input device receives a first touch operation through the touch screen, the first touch operation being a touch operation other than a slide operation.
In this embodiment of the application, the specific implementation process of step 906 may refer to the description of step 208, which is not described herein again.
907. The input device responds to the first touch operation and sends the key content corresponding to the second key or an operation instruction corresponding to the operation triggered by the second key to the display device.
In some embodiments of the present application, after receiving the first touch operation through the touch screen, the input device may generate second data for describing the first touch operation, and a specific implementation manner may refer to the description of step 209 in the embodiment corresponding to fig. 2.
After determining that the first touch operation is not a sliding operation according to the second data, the input device may acquire key content corresponding to the second key, or acquire an operation instruction corresponding to an operation triggered by the second key, and send the key content corresponding to the second key or the operation instruction corresponding to the operation triggered by the second key to the display device. The explanation of the first touch operation and the second key can be referred to the description of step 213 in the corresponding embodiment of fig. 2.
908. The input device displays the content of the second key through the display screen, or executes the operation triggered by the second key.
909. The input device receives a second touch operation through a second area of the touch screen.
910. The input device generates third data describing the second touch operation.
In this embodiment of the application, the specific implementation process of steps 909 and 910 may refer to the description of steps 214 and 215 in each embodiment corresponding to fig. 2, which is not described herein again.
911. The input device determines a first trigger operation corresponding to the third data.
In the embodiment of the present application, similar to step 218 in the corresponding embodiment of fig. 2, in one case, since the second touch operation may represent different types of touch operations, one trigger operation may be configured on the input device in one-to-one correspondence with each type of second touch operation, and the difference between the second touch operation and the first touch operation is that the first touch operation is obtained through the first area of the input device, and the second touch operation is obtained through the second area of the input device. After the input device acquires the third data, it may be determined that the second touch operation described by the third data is acquired through the second area of the input device according to the coordinates of the plurality of contact points included in the third data. And then determining that the operation type of the second touch operation is the second operation type according to the operation type information carried in the third data, wherein the second operation type is one of all possible operation types of the second touch operation. The input equipment acquires first trigger operation corresponding to the second operation type one by one, and sends an operation instruction corresponding to the first trigger operation to the display equipment.
In another case, the second touch operation may be touch operation from different positions in the second area, that is, the second area is further divided, the one-to-one correspondence relationship between the plurality of coordinate areas and the plurality of shortcut keys in the second area is pre-configured on the input device, and the first trigger operation is an operation triggered by a shortcut key. The input device determines that the touch position of the second touch operation is located in a fourth coordinate area of a plurality of coordinate areas included in the second area according to the first coordinates of the plurality of contact points corresponding to the second touch operation in the first coordinate system carried in the third data, acquires a first trigger operation corresponding to the fourth coordinate area, and sends an operation instruction corresponding to the first trigger operation to the display device.
For the concrete expression form of the second touch operation and the concrete expression form of the first trigger operation, refer to the description in step 218 in the corresponding embodiment of fig. 2, which is not described herein again.
912. And the input equipment sends an operation instruction corresponding to the first trigger operation to the display equipment.
913. The display device performs a first trigger operation.
In the embodiment of the present application, the specific expression of the first trigger operation may refer to the description of the trigger operation corresponding to the third data in the embodiment corresponding to fig. 2, and details thereof are not repeated here.
In the embodiment of the application, a user can select one key in the display equipment by inputting one sliding operation to the input equipment, the operation mode is simple, and the input speed is high; one first sliding operation corresponds to one first key, so that the flexibility of the input process is reserved; in addition, the selection of the first key is completed on the input device, the content of the first key or the operation triggered by the first key is directly informed to the display device, namely, the input device completes the selection of the first key.
In order to more intuitively recognize the advantageous effects of the embodiments of the present application, the advantageous effects of the embodiments of the present application are described below with reference to the data shown in table 1.
Figure BDA0002671749560000221
TABLE 1
As can be seen from table 1, with the input method provided in the embodiment of the present application, the new user input speed can reach 13 characters (WPM) input per minute, which is much higher than 8WPM when the current input method is adopted. By adopting the input method provided by the embodiment of the application, the input speed of a professional user can reach 30WPM, and is far higher than 10WPM when the current input method is adopted. Obviously, the input method provided by the embodiment of the application has higher input efficiency.
On the basis of the embodiments corresponding to fig. 1 to 9, in order to better implement the above-mentioned scheme of the embodiments of the present application, the following also provides related equipment for implementing the above-mentioned scheme. Specifically, fig. 10 and 10 are schematic structural diagrams of a display device according to an embodiment of the present disclosure. The display apparatus 1000 is applied to a display device, a virtual keyboard is shown on a display screen of the display device, and the display apparatus 1000 may include a receiving module 1001, a determining module 1002, and an executing module 1003. A receiving module 1001, configured to receive first data sent by an input device, where the first data is used to describe a sliding track of a first sliding operation on the input device; a determining module 1002, configured to determine, according to the first data, a display trajectory from a second key to a first key on the virtual keyboard, where the first key is a key on the virtual keyboard, and the second key is a predefined reference key on the virtual keyboard; the executing module 1003 is configured to display the content of the first key through the display screen, or execute an operation triggered by the first key.
In a possible design, the determining module 1002 is specifically configured to use the second key as a starting point, obtain a display track corresponding to the sliding track according to the first data, and use an end point of the display track as the first key.
In one possible design, the first data is indicative of one or more of the following parameters: and inputting a sliding length parameter and a sliding angle of a sliding track corresponding to the sliding operation on the equipment.
In one possible design, the receiving module 1001 is further configured to receive second data sent by the input device, where the second data is used to describe a first touch operation, and the first touch operation is a touch operation other than a sliding operation; the executing module 1003 is further configured to display the content of the second key through the display screen according to the second data, or execute an operation triggered by the second key.
In one possible design, the first data indicates that the first sliding operation was obtained through a first area of a touchscreen of the input device. The receiving module 1001 is further configured to receive third data sent by the input device, where the third data is used to describe a second touch operation, and the third data indicates that the second touch operation is obtained through a second area of the touch screen, and the first area and the second area are different areas; the determining module 1002 is further configured to determine a trigger operation corresponding to the third data.
In one possible design, the keys in the virtual keyboard are distributed in a trapezoidal shape, or the keys in the virtual keyboard are distributed in concentric circles.
It should be noted that, the contents of information interaction, execution process, and the like between the modules/units in the display device 1000 are based on the same concept as the method embodiments corresponding to fig. 2 to fig. 8 in the present application, and specific contents may refer to the description in the foregoing method embodiments in the present application, and are not described herein again.
Fig. 11 shows a schematic structural diagram of an input device according to an embodiment of the present application. The input apparatus 1100 is applied to an input device configured with a touch screen, and the input apparatus 1100 includes: a receiving module 1101, a generating module 1102 and a sending module 1103. A receiving module 1101, configured to receive a first sliding operation through a touch screen; a generating module 1102 for generating first data describing a first sliding operation; the sending module 1103 is configured to send first data to the display device, where the display device is configured with a virtual keyboard, the first data is used for the display device to determine a display trajectory from a second key on the virtual keyboard to a first key, the first key is a key on the virtual keyboard, and the second key is a predefined reference key on the virtual keyboard.
In one possible design, the first data is indicative of one or more of the following parameters: and inputting a sliding length parameter and a sliding angle of a sliding track corresponding to the sliding operation on the equipment.
In one possible design, the receiving module 1101 is further configured to receive a first touch operation through the display screen, where the first touch operation is a touch operation other than a sliding operation; the generating module 1102 is further configured to generate second data used for describing the first touch operation, and send the second data to the display device, where the second data is used for instructing the display device to display the content of the second key, or instructing to execute an operation triggered by the second key.
In one possible design, the receiving module 1101 is specifically configured to receive a first sliding operation through a first area of the touch screen, and the first data is further configured to indicate that the first sliding operation is obtained through the first area; the receiving module 1101 is further configured to receive a second touch operation through a second area of the touch screen; the generating module 1102 is further configured to generate third data used for describing the second touch operation, and send the third data to the display device, where the third data is used for indicating that the second touch operation is obtained through the second area, and is also used for the display device to determine a trigger operation corresponding to the third data.
In one possible design, the first area is a central area of the touch screen, the second area is an edge area of the touch screen, and the width of the second area is smaller than or equal to the first threshold.
It should be noted that, the information interaction, execution process, and other contents between the modules/units in the input device 1100 are based on the same concept as the method embodiments corresponding to fig. 2 to 8 in the present application, and specific contents may refer to the description in the foregoing method embodiments in the present application, and are not described herein again.
Fig. 12 shows a schematic structural diagram of an input device according to an embodiment of the present application. The input device 1200 is applied to an input device, the input device includes a touch screen and a virtual keyboard, and the device includes a receiving module 1201, a generating module 1202, a determining module 1203 and a sending module 1204. A receiving module 1201, configured to receive a first sliding operation through a touch screen; a generating module 1202, configured to generate sliding track first data for describing a first sliding operation; a determining module 1203, configured to determine a first key according to the first data and the second key, where the first key is a key on the virtual keyboard, and the second key is a predefined reference key on the virtual keyboard; a sending module 1204, configured to send key content corresponding to the first key or an operation instruction corresponding to an operation triggered by the first key to the display device.
In one possible design, the determining module 1203 is specifically configured to use the second key as a starting point of the sliding track, and use an end point of the sliding track as the first key.
In one possible design, the first data is indicative of one or more of the following parameters: and inputting a sliding length parameter and a sliding angle of a sliding track corresponding to the sliding operation on the equipment.
In one possible design, the receiving module 1201 is further configured to receive a first touch operation through the touch screen, where the first touch operation is a touch operation other than a sliding operation; the sending module 1204 is further configured to send, in response to the first touch operation, key content corresponding to the second key or an operation instruction corresponding to an operation triggered by the second key to the display device.
In one possible design, the receiving module 1201 is specifically configured to receive a first sliding operation through a first area of the touch screen; the receiving module 1201 is further configured to receive a second touch operation through a second area of the touch screen; a generating module 1202, further configured to generate third data describing the second touch operation; a determining module 1203, further configured to determine a first trigger operation corresponding to the third data; the sending module 1204 is further configured to send an operation instruction corresponding to the first trigger operation to the display device.
It should be noted that, the information interaction, execution process, and other contents between the modules/units in the input device 1200 are based on the same concept as that of the method embodiments corresponding to fig. 9 in the present application, and specific contents may refer to the description in the foregoing method embodiments in the present application, and are not described herein again.
Fig. 13 shows a schematic structural diagram of a display device according to an embodiment of the present application, where fig. 13 is a schematic structural diagram of the display device according to the embodiment of the present application. The display apparatus 1300 is applied to a display device, a virtual keyboard is displayed on a display screen of the display device, and the display apparatus 1300 may include a receiving module 1301, a determining module 1302, and an executing module 1303. A receiving module 1301, configured to receive first data sent by an input device, where the first data is used to describe a sliding track of a first sliding operation on the input device, and the first data includes a sliding length parameter and/or a sliding angle of the sliding track; a determining module 1302, configured to determine a first key on the virtual keyboard according to the first data; the executing module 1303 displays the content of the first key through the display screen, or executes an operation triggered by the first key.
In a possible design, the determining module 1302 is specifically configured to determine, according to the first data, a display trajectory from a second key to a first key on the virtual keyboard, where the second key is a predefined reference key on the virtual keyboard.
In a possible design, the determining module 1302 is specifically configured to use the second key as a starting point, obtain a display track corresponding to the sliding track according to the first data, and use an end point of the display track as the first key.
In one possible design, the receiving module 1301 is further configured to receive second data sent by the input device, where the second data is used to describe a first touch operation, and the first touch operation is a touch operation other than a sliding operation; the executing module 1303 is further configured to display the content of the second key through the display screen according to the second data, or execute an operation triggered by the second key.
In one possible design, the first data indicates that the first sliding operation was obtained through a first area of a touchscreen of the input device. The receiving module 1301 is further configured to receive third data sent by the input device, where the third data is used to describe a second touch operation, the third data indicates that the second touch operation is obtained through a second area of the touch screen, and the first area and the second area are different areas; the determining module 1302 is further configured to determine a trigger operation corresponding to the third data.
In one possible design, the keys in the virtual keyboard are distributed in a trapezoidal shape, or the keys in the virtual keyboard are distributed in concentric circles.
It should be noted that, the contents of information interaction, execution process, and the like between the modules/units in the display device 1300 are based on the same concept as the method embodiments corresponding to fig. 2 to fig. 8 in the present application, and specific contents may refer to the description in the foregoing method embodiments in the present application, and are not described herein again.
Referring to fig. 14, fig. 14 is a schematic structural diagram of an execution device provided in the embodiment of the present application, and the execution device 1400 may be embodied as a smart television, a VR device, an AR device, a desktop computer, a mobile phone, a tablet, a laptop, an intelligent wearable device, or a radar data processing device, which is not limited herein. The display device described in the embodiment corresponding to fig. 2 to fig. 8 may be disposed on the execution device 1400, so as to implement the function of the display apparatus 1000 in the embodiment corresponding to fig. 10. Alternatively, the execution device 1400 may be disposed with the input device described in the corresponding embodiment of fig. 2 to fig. 8, so as to implement the function of the input apparatus 1100 in the corresponding embodiment of fig. 11. Alternatively, the execution device 1400 may be disposed with the input device described in the embodiment corresponding to 9, for implementing the function of the input apparatus 1200 in the embodiment corresponding to fig. 12. Alternatively, the execution device 1400 may be disposed with the input device described in the embodiment corresponding to fig. 2 to 8, so as to implement the function of the display apparatus 1300 in the embodiment corresponding to fig. 13.
In particular, the execution device 1400 may vary widely due to configuration or performance, and may include one or more Central Processing Units (CPUs) 1422 (e.g., one or more processors) and memory 1432, one or more storage media 1430 (e.g., one or more mass storage devices) that store applications 1442 or data 1444. Memory 1432 and storage media 1430, among other things, may be transient or persistent storage. The program stored on storage medium 1430 may include one or more modules (not shown), each of which may include a sequence of instructions for execution by the device. Still further, a central processor 1422 may be provided in communication with storage medium 1430 for executing a series of instruction operations in storage medium 1430 on execution device 1400.
The execution apparatus 1400 may also include one or more power supplies 1426, one or more wired or wireless network interfaces 1450, one or more input-output interfaces 1458, and/or one or more operating systems 1441, such as Windows Server, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc.
In this embodiment, in one case, the central processing unit 1422 is configured to implement the functions of the display device in the embodiment corresponding to fig. 2 to 8. Specifically, the central processing unit 1422 is configured to receive first data sent by the input device, where the first data is used to describe a sliding track of a first sliding operation on the input device; determining a display track from a second key to a first key on the virtual keyboard according to the first data, wherein the first key is a key on the virtual keyboard, and the second key is a predefined reference key on the virtual keyboard; and displaying the content of the first key through the display screen, or executing the operation triggered by the first key.
It should be noted that the central processing unit 1422 is further configured to execute other steps executed by the display device in the embodiment corresponding to fig. 2 to fig. 8, and for specific implementation manners and advantageous effects brought by the central processing unit 1422 executing the functions of the display device in the embodiment corresponding to fig. 2 to fig. 8, reference may be made to descriptions in each method embodiment corresponding to fig. 2 to fig. 8, which is not described herein again.
In this embodiment, in another case, the central processing unit 1422 is configured to implement the functions of the input device in the embodiments corresponding to fig. 2 to fig. 8. Specifically, the central processing unit 1422 is configured to receive a first sliding operation through the touch screen; generating sliding track first data for describing a first sliding operation; the method comprises the steps of sending first data to display equipment, wherein the display equipment is provided with a virtual keyboard, the first data is used for determining a display track from a second key on the virtual keyboard to a first key, the first key is a key on the virtual keyboard, and the second key is a predefined reference key on the virtual keyboard.
It should be noted that the central processing unit 1422 is further configured to execute other steps executed by the input device in the embodiment corresponding to fig. 2 to fig. 8, and for specific implementation manners and advantageous effects brought by the central processing unit 1422 executing the functions of the input device in the embodiment corresponding to fig. 2 to fig. 8, reference may be made to descriptions in each method embodiment corresponding to fig. 2 to fig. 8, which is not described herein again.
In this embodiment, in another case, the central processing unit 1422 is configured to implement the function of the input device in the embodiment corresponding to fig. 9. Specifically, the central processing unit 1422 is configured to receive a first sliding operation through the touch screen; generating sliding track first data for describing a first sliding operation; determining a first key according to the first data and a second key, wherein the first key is a key on the virtual keyboard, and the second key is a predefined reference key on the virtual keyboard; and sending the key content corresponding to the first key or an operation instruction corresponding to the operation triggered by the first key to the display equipment.
It should be noted that the central processing unit 1422 is further configured to execute other steps executed by the input device in the embodiment corresponding to fig. 9, and for specific implementation manners and advantageous effects brought by the central processing unit 1422 executing the functions of the input device in the embodiment corresponding to fig. 9, reference may be made to descriptions in each method embodiment corresponding to fig. 9, which are not repeated herein.
In this embodiment, in another case, the central processing unit 1422 is configured to implement the function of the display device in the embodiment corresponding to fig. 2 to 8. Specifically, the central processing unit 1422 is configured to receive first data sent by the input device, where the first data is used to describe a sliding track of a first sliding operation on the input device, and the first data includes a sliding length parameter and/or a sliding angle of the sliding track; determining a first key on the virtual keyboard according to the first data; and displaying the content of the first key through the display screen, or executing the operation triggered by the first key.
It should be noted that the central processing unit 1422 is further configured to execute other steps executed by the display device in the embodiment corresponding to fig. 2 to fig. 8, and for specific implementation manners and advantageous effects brought by the central processing unit 1422 executing the functions of the input device in the embodiment corresponding to fig. 2 to fig. 8, reference may be made to descriptions in each method embodiment corresponding to fig. 2 to fig. 8, which is not described herein again.
Fig. 15 shows a schematic structural diagram of an input system according to an embodiment of the present application. In one case, the input system 1500 is disposed with the display device described in the corresponding embodiment of fig. 2 to 8, so as to implement the function of the display apparatus 1000 in the corresponding embodiment of fig. 10. The input system 1500 is also disposed with the input device described in the corresponding embodiments of fig. 2 to 8, and is used to implement the function of the input device 1100 in the corresponding embodiment of fig. 11.
In another case, the input system 1500 is disposed with the display device described in the corresponding embodiment of fig. 2 to 8, so as to implement the function of the display apparatus 1300 in the corresponding embodiment of fig. 13. The input system 1500 is also disposed with the input device described in the corresponding embodiments of fig. 2 to 8, and is used to implement the function of the input device 1100 in the corresponding embodiment of fig. 11.
In another case, the input system 1500 is disposed with the display device described in the embodiment corresponding to fig. 9 and the input device described in the embodiment corresponding to fig. 9.
Also provided in an embodiment of the present application is a computer-readable storage medium having stored therein a program for generating a running speed of a vehicle, which, when run on a computer, causes the computer to perform the steps performed by a display device in the method described in the aforementioned embodiment shown in fig. 2 to 8, or the steps performed by an input device in the method described in the aforementioned embodiment shown in fig. 9.
Further, in the embodiments of the present application, there is provided a computer program, which, when running on a computer, causes the computer to execute the steps executed by the display device in the method described in the foregoing embodiments shown in fig. 2 to 8, or execute the steps executed by the input device in the method described in the foregoing embodiments shown in fig. 9.
Further provided in embodiments of the present application is a circuit system, including a processing circuit, configured to perform steps performed by a display device in the method described in the foregoing embodiments shown in fig. 2 to 8, or perform steps performed by an input device in the method described in the foregoing embodiments shown in fig. 9.
The input method or the data processing system provided by the embodiment of the application can be specifically a chip, and the chip comprises: a processing unit, which may be for example a processor, and a communication unit, which may be for example an input/output interface, a pin or a circuit, etc. The processing unit may execute the computer executable instructions stored in the storage unit to enable the chip to perform the steps performed by the display device in the method described in the foregoing embodiments shown in fig. 2 to 8, or perform the steps performed by the input device in the method described in the foregoing embodiments shown in fig. 2 to 8. Optionally, the storage unit is a storage unit in the chip, such as a register, a cache, and the like, and the storage unit may also be a storage unit located outside the chip in the wireless access device, such as a read-only memory (ROM) or another type of static storage device that can store static information and instructions, a Random Access Memory (RAM), and the like.
Wherein any of the aforementioned processors may be a general purpose central processing unit, a microprocessor, an ASIC, or one or more integrated circuits configured to control the execution of the programs of the method of the first aspect.
It should be noted that the above-described embodiments of the apparatus are merely schematic, where the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. In addition, in the drawings of the embodiments of the apparatus provided in the present application, the connection relationship between the modules indicates that there is a communication connection therebetween, and may be implemented as one or more communication buses or signal lines.
Through the above description of the embodiments, those skilled in the art will clearly understand that the present application can be implemented by software plus necessary general hardware, and certainly can also be implemented by special hardware including application specific integrated circuits, special CLUs, special memories, special components and the like. Generally, functions performed by computer programs can be easily implemented by corresponding hardware, and specific hardware structures for implementing the same functions may be various, such as analog circuits, digital circuits, or dedicated circuits. However, for the present application, the implementation of a software program is more preferable. Based on such understanding, the technical solutions of the present application may be substantially embodied in the form of a software product, which is stored in a readable storage medium, such as a floppy disk, a usb disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk of a computer, and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute the methods described in the embodiments of the present application.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, it may be implemented in whole or in part in the form of a computer program.
The computer program includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that a computer can store or a data storage device, such as a server, a data center, etc., that is integrated with one or more available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.

Claims (26)

1. An input method is applied to a display device, a virtual keyboard is displayed on a display screen of the display device, and the method comprises the following steps:
receiving first data sent by an input device, wherein the first data is used for describing a sliding track of a first sliding operation on the input device;
determining a display track from a second key on the virtual keyboard to a first key according to the first data, wherein the first key is a key on the virtual keyboard, and the second key is a predefined reference key on the virtual keyboard;
and displaying the content of the first key through the display screen, or executing the operation triggered by the first key.
2. The method of claim 1, wherein said determining a trajectory of a presentation of a second key to a first key on said virtual keyboard based on said first data comprises:
and taking the second key as a starting point, acquiring a display track corresponding to the sliding track according to the first data, and taking an end point of the display track as the first key.
3. The method of claim 2, wherein the first data is indicative of one or more of the following: and inputting a sliding length parameter and a sliding angle of a sliding track corresponding to the sliding operation on the equipment.
4. The method according to any one of claims 1 to 3, further comprising:
receiving second data sent by the input device, wherein the second data is used for describing a first touch operation, and the first touch operation is a touch operation except for a sliding operation;
and displaying the content of the second key through the display screen according to the second data, or executing the operation triggered by the second key.
5. The method of any of claims 1-3, wherein the first data indicates that the first swipe operation was obtained through a first area of a touchscreen of the input device, the method further comprising:
receiving third data sent by the input device, wherein the third data is used for describing a second touch operation, the third data indicates that the second touch operation is obtained through a second area of the touch screen, and the first area and the second area are different areas;
and determining the trigger operation corresponding to the third data.
6. The method according to any one of claims 1 to 3, wherein the keys in the virtual keyboard are distributed in a trapezoid shape, or the keys in the virtual keyboard are distributed in concentric circles.
7. An input method, applied to an input device configured with a touch screen, the method comprising:
receiving a first sliding operation through the touch screen;
generating sliding track first data for describing the first sliding operation;
sending the first data to a display device, wherein a virtual keyboard is configured on the display device, the first data is used for the display device to determine a display track from a second key to a first key on the virtual keyboard, the first key is a key on the virtual keyboard, and the second key is a predefined reference key on the virtual keyboard.
8. The method of claim 7, wherein the first data is indicative of one or more of the following parameters: and inputting a sliding length parameter and a sliding angle of a sliding track corresponding to the sliding operation on the equipment.
9. The method according to claim 7 or 8, characterized in that the method further comprises:
receiving a first touch operation through the touch screen, wherein the first touch operation is a touch operation except for a sliding operation;
and generating second data for describing the first touch operation, and sending the second data to the display device, wherein the second data is used for indicating the display device to display the content of the second key or indicating to execute the operation triggered by the second key.
10. The method according to claim 7 or 8, wherein the receiving a first sliding operation through the touch screen comprises:
receiving a first sliding operation through a first area of the touch screen, wherein the first data is further used for indicating that the first sliding operation is obtained through the first area;
the method further comprises the following steps:
receiving a second touch operation through a second area of the touch screen;
and generating third data for describing the second touch operation, and sending the third data to the display device, where the third data is used to indicate that the second touch operation is obtained through the second area, and is also used for the display device to determine a trigger operation corresponding to the third data.
11. The method of claim 10, wherein the first area is a center area of the touch screen, wherein the second area is an edge area of the touch screen, and wherein a width of the second area is less than or equal to a first threshold.
12. An input method is applied to an input device, wherein the input device comprises a touch screen and a virtual keyboard, and the method comprises the following steps:
receiving a first sliding operation through the touch screen;
generating sliding track first data for describing the first sliding operation;
determining a first key according to the first data and a second key, wherein the first key is a key on a virtual keyboard, and the second key is a predefined reference key on the virtual keyboard;
and sending the key content corresponding to the first key or an operation instruction corresponding to the operation triggered by the first key to display equipment.
13. The method of claim 12, wherein said determining a first key based on said first data and a second key comprises:
and taking the second key as the starting point of the sliding track, and taking the end point of the sliding track as the first key.
14. The method of claim 13, wherein the first data is indicative of one or more of the following: and inputting a sliding length parameter and a sliding angle of a sliding track corresponding to the sliding operation on the equipment.
15. The method according to any one of claims 12 to 14, further comprising:
receiving a first touch operation through the touch screen, wherein the first touch operation is a touch operation except for a sliding operation;
and responding to the first touch operation, and sending the key content corresponding to the second key or an operation instruction corresponding to the operation triggered by the second key to a display device.
16. The method according to any one of claims 12 to 14, wherein the receiving, by the touch screen, a first sliding operation comprises:
receiving a first sliding operation through a first area of the touch screen;
the method further comprises the following steps:
receiving a second touch operation through a second area of the touch screen;
generating third data for describing the second touch operation, and determining a first trigger operation corresponding to the third data;
and sending an operation instruction corresponding to the first trigger operation to the display equipment.
17. An input method is applied to a display device, a virtual keyboard is displayed on a display screen of the display device, and the method comprises the following steps:
receiving first data sent by an input device, wherein the first data is used for describing a sliding track of a first sliding operation on the input device, and the first data comprises a sliding length parameter and/or a sliding angle of the sliding track;
determining a first key on the virtual keyboard according to the first data;
and displaying the content of the first key through the display screen, or executing the operation triggered by the first key.
18. The method of claim 17, wherein said determining a first key on said virtual keyboard based on said first data comprises:
and determining a display track from a second key on the virtual keyboard to the first key according to the first data, wherein the second key is a predefined reference key on the virtual keyboard.
19. The method according to claim 17 or 18, further comprising:
receiving second data sent by the input device, wherein the second data is used for describing a first touch operation, and the first touch operation is a touch operation except for a sliding operation;
and displaying the content of the second key through the display screen according to the second data, or executing the operation triggered by the second key.
20. A display device is applied to a display device, a virtual keyboard is displayed on a display screen of the display device, and the device comprises:
the device comprises a receiving module, a display module and a control module, wherein the receiving module is used for receiving first data sent by input equipment, and the first data is used for describing a sliding track of a first sliding operation on the input equipment;
a determining module, configured to determine, according to the first data, a display trajectory from a second key to a first key on the virtual keyboard, where the first key is a key on the virtual keyboard, and the second key is a predefined reference key on the virtual keyboard;
and the execution module is used for displaying the content of the first key through the display screen or executing the operation triggered by the first key.
21. An input apparatus, applied to an input device provided with a touch screen, the apparatus comprising:
the receiving module is used for receiving a first sliding operation through the touch screen;
a generating module, configured to generate sliding track first data for describing the first sliding operation;
the sending module is configured to send the first data to a display device, the display device is configured with a virtual keyboard, the first data is used for the display device to determine a display track from a second key to a first key on the virtual keyboard, the first key is a key on the virtual keyboard, and the second key is a predefined reference key on the virtual keyboard.
22. An input apparatus, applied to an input device configured with a touch screen and a virtual keyboard, the apparatus comprising:
the receiving module is used for receiving a first sliding operation through the touch screen;
a generating module, configured to generate sliding track first data for describing the first sliding operation;
the determining module is used for determining a first key according to the first data and a second key, wherein the first key is a key on a virtual keyboard, and the second key is a predefined reference key on the virtual keyboard;
and the sending module is used for sending the key content corresponding to the first key or an operation instruction corresponding to the operation triggered by the first key to the display equipment.
23. A display device is applied to a display device, a virtual keyboard is displayed on a display screen of the display device, and the device comprises:
the device comprises a receiving module, a judging module and a display module, wherein the receiving module is used for receiving first data sent by an input device, the first data is used for describing a sliding track of a first sliding operation on the input device, and the first data comprises a sliding length parameter and/or a sliding angle of the sliding track;
the determining module is used for determining a first key on the virtual keyboard according to the first data;
and the execution module is used for displaying the content of the first key through the display screen or executing the operation triggered by the first key.
24. An input system, characterized in that the system comprises a display device and an input device, the display device being the display device of claim 20 or claim 23, the input device being the input device of claim 21.
25. A computer program, which, when run on a computer, causes the computer to perform the method of any one of claims 1 to 6, or causes the computer to perform the method of any one of claims 7 to 11, or causes the computer to perform the method of any one of claims 12 to 16, or causes the computer to perform the method of any one of claims 17 to 19.
26. An execution device comprising a processor, the processor coupled with the memory;
the memory is used for storing programs;
the processor, configured to execute the program in the memory, to cause the execution apparatus to perform the method according to any one of claims 1 to 6, or to cause the execution apparatus to perform the method according to any one of claims 7 to 11, or to cause the execution apparatus to perform the method according to any one of claims 12 to 16, or to cause the execution apparatus to perform the method according to any one of claims 17 to 19.
CN202010935439.9A 2020-09-08 2020-09-08 Input method and related equipment Active CN112218134B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010935439.9A CN112218134B (en) 2020-09-08 2020-09-08 Input method and related equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010935439.9A CN112218134B (en) 2020-09-08 2020-09-08 Input method and related equipment

Publications (2)

Publication Number Publication Date
CN112218134A true CN112218134A (en) 2021-01-12
CN112218134B CN112218134B (en) 2023-06-02

Family

ID=74049153

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010935439.9A Active CN112218134B (en) 2020-09-08 2020-09-08 Input method and related equipment

Country Status (1)

Country Link
CN (1) CN112218134B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114168063A (en) * 2021-12-13 2022-03-11 杭州灵伴科技有限公司 Virtual key display method, head-mounted display device, and computer-readable medium
CN114327127A (en) * 2021-11-27 2022-04-12 荣耀终端有限公司 Method and apparatus for sliding frame loss detection
WO2022198012A1 (en) * 2021-03-18 2022-09-22 Innopeak Technology, Inc. Multi-layer text input method for augmented reality devices
WO2023236830A1 (en) * 2022-06-06 2023-12-14 华为技术有限公司 Device control method and electronic device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102023792A (en) * 2009-09-14 2011-04-20 上海怡鼎信息科技有限公司 Input method of virtual keyboard of handheld device
US20130082929A1 (en) * 2011-09-29 2013-04-04 Hon Hai Precision Industry Co., Ltd. Touch-sensitive device and method for controlling display of virtual keyboard
CN105955453A (en) * 2016-04-15 2016-09-21 北京小鸟看看科技有限公司 Information input method in 3D immersion environment

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102023792A (en) * 2009-09-14 2011-04-20 上海怡鼎信息科技有限公司 Input method of virtual keyboard of handheld device
US20130082929A1 (en) * 2011-09-29 2013-04-04 Hon Hai Precision Industry Co., Ltd. Touch-sensitive device and method for controlling display of virtual keyboard
CN105955453A (en) * 2016-04-15 2016-09-21 北京小鸟看看科技有限公司 Information input method in 3D immersion environment

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022198012A1 (en) * 2021-03-18 2022-09-22 Innopeak Technology, Inc. Multi-layer text input method for augmented reality devices
CN114327127A (en) * 2021-11-27 2022-04-12 荣耀终端有限公司 Method and apparatus for sliding frame loss detection
CN114327127B (en) * 2021-11-27 2022-12-23 荣耀终端有限公司 Method and apparatus for sliding frame loss detection
CN114168063A (en) * 2021-12-13 2022-03-11 杭州灵伴科技有限公司 Virtual key display method, head-mounted display device, and computer-readable medium
WO2023236830A1 (en) * 2022-06-06 2023-12-14 华为技术有限公司 Device control method and electronic device

Also Published As

Publication number Publication date
CN112218134B (en) 2023-06-02

Similar Documents

Publication Publication Date Title
CN112218134A (en) Input method and related equipment
US20230152962A1 (en) Techniques for image-based search using touch controls
CA2872512C (en) Method of operating a display unit and a terminal supporting the same
JP6274682B2 (en) Method and user equipment for displaying interface content
CN110531920B (en) Display method and device of sidebar, terminal and storage medium
US9910584B2 (en) Method for manipulating folders and apparatus thereof
WO2021203821A1 (en) Page manipulation method and device, storage medium, and terminal
CN111475097B (en) Handwriting selection method and device, computer equipment and storage medium
CN109635261A (en) Online document content edition method, device, storage medium and electronic equipment
CN107704157B (en) Multi-screen interface operation method and device and storage medium
US9582094B2 (en) Information processing device, display device with touch panel, information processing method, and program
WO2021203815A1 (en) Page operation method and apparatus, and terminal and storage medium
CN108920070B (en) Screen splitting method and device based on special-shaped display screen, storage medium and mobile terminal
CN110928614B (en) Interface display method, device, equipment and storage medium
CN112114734A (en) Online document display method and device, terminal and storage medium
CN108693997B (en) Touch control method and device of intelligent interaction panel and intelligent interaction panel
CN111061409A (en) Function triggering method and device, electronic equipment and storage medium
CN108492349B (en) Processing method, device and equipment for writing strokes and storage medium
EP4268913A1 (en) Position adjustment method and apparatus for operation controls, and terminal, and storage medium
US20230280837A1 (en) Interaction method, display device, and non-transitory storage medium
JP7413513B2 (en) Human-computer interaction methods, devices, and systems
CN111913639B (en) Virtual content interaction method, device, system, terminal equipment and storage medium
CN109002293B (en) UI element display method and device, electronic equipment and storage medium
CN110806830A (en) User interaction method and electronic equipment
CN110888581A (en) Element transfer method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant