CN110456922B - Input method, input device, input system and electronic equipment - Google Patents

Input method, input device, input system and electronic equipment Download PDF

Info

Publication number
CN110456922B
CN110456922B CN201910756846.0A CN201910756846A CN110456922B CN 110456922 B CN110456922 B CN 110456922B CN 201910756846 A CN201910756846 A CN 201910756846A CN 110456922 B CN110456922 B CN 110456922B
Authority
CN
China
Prior art keywords
input
sliding track
sliding
user
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910756846.0A
Other languages
Chinese (zh)
Other versions
CN110456922A (en
Inventor
喻纯
史元春
杨志灿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tsinghua University
Original Assignee
Tsinghua University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tsinghua University filed Critical Tsinghua University
Priority to CN201910756846.0A priority Critical patent/CN110456922B/en
Publication of CN110456922A publication Critical patent/CN110456922A/en
Priority to PCT/CN2020/093162 priority patent/WO2021031650A1/en
Application granted granted Critical
Publication of CN110456922B publication Critical patent/CN110456922B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0233Character input methods
    • G06F3/0236Character input methods using selection techniques to select from displayed items
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0238Programmable keyboards

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Input From Keyboards Or The Like (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

An input method, an input device, an input system and an electronic apparatus are provided. The input method is applied to a first device with a display unit, and comprises the following steps: receiving a first sliding track input by a user from the second device, wherein the first sliding track is generated by a first sliding touch operation performed on an input unit of the second device by the user; displaying the first sliding track and a soft keyboard for text input on the display unit while receiving the first sliding track; matching the first sliding track with at least one candidate word in a word bank according to a matching algorithm; and displaying at least one candidate word on the display unit; wherein the first sliding track is displayed as the starting point of the first sliding track is at a fixed position, such as the center, of the soft keyboard. In this way, a sliding trajectory and candidate words can be displayed on the display plane suitable for a sliding touch input of a user on the input plane, thereby improving user input efficiency and having a high fault tolerance rate.

Description

Input method, input device, input system and electronic equipment
Technical Field
The present application relates generally to the field of text input, and more particularly, to an input method, an input apparatus, an input system, and an electronic device.
Background
The interactive mode of indirect input often occurs in the case where the input plane and the display plane are separated. A typical scenario is that a user holds a mobile phone, a remote controller or a handle, and interacts with a smart television, a large screen, a Virtual Reality (VR) head-mounted display, Augmented Reality (AR) smart glasses, and the like. In these scenarios, the display screen and the input device are on two separate planes that are decoupled.
There are many search and chat using requirements in these scenarios, and the text input in these scenarios still has many defects.
For example, one scheme is to display a 26-key keyboard on a screen, move a cursor in units of keys using direction keys or a jog dial (up, down, left, and right) of a remote controller or a handle, and input one character by pressing a confirmation key. The scheme has the defects that the input is carried out by taking letters as units, the input efficiency is low, and the operation times are more when the keys are moved.
Another solution is to display a 26-key keyboard on the screen, move the cursor by shaking (gyro), and press the enter key to enter a character. The scheme has the defects that the input is carried out by taking letters as units, the input efficiency is low, the accuracy rate of operating the cursor in a shaking mode is low, the efficiency is low, and the learning cost is high.
In another scheme, a 26-key keyboard is displayed on a screen, a cursor is moved through a touch screen, and a character is input by pressing a confirmation key. The disadvantage of this scheme is that the input is performed in units of letters, the input efficiency is low, and two operations of moving and pause confirmation are required between the input of each character, and the input efficiency is low.
In addition, schemes for speech input have also been developed. However, this scheme has a disadvantage that the recognition accuracy of speech recognition is limited (support for accents, noisy environments, confusable words is not good), and further, it is not suitable for use in some cases (silent environments, private information). Also, the voice input scheme requires a microphone and requires more computing resources than other schemes.
It is therefore desirable to provide an improved input scheme for the case where the input plane and the display plane are decoupled, separate planes.
Disclosure of Invention
The present application is proposed to solve the above-mentioned technical problems. Embodiments of the present application provide an input method, an input apparatus, an input system, and an electronic device, which are capable of generating candidate words based on a sliding trajectory of a user on an input plane and displaying the candidate words on a display plane, thereby improving user input efficiency and having a high fault tolerance rate.
According to an aspect of the present application, there is provided an input method applied to a first device having a display unit, the input method including: receiving a first sliding track input by a user from a second device, wherein the first sliding track is generated by the user performing a first sliding touch operation on an input unit of the second device; displaying the first sliding track and a soft keyboard for text input on the display unit while receiving the first sliding track; matching the first sliding track with at least one candidate word in a word bank according to a preset matching algorithm; and displaying the at least one candidate word on the display unit; wherein the first sliding track is displayed as a fixed position of a starting point of the first sliding track on the soft keyboard.
Optionally, the fixed position is a central position.
In the above input method, the at least one candidate word includes a plurality of candidate words, and displaying the candidate words on the display unit specifically includes: displaying a word selection interface for selecting the plurality of candidate words on the display unit, wherein the interface comprises a plurality of positions, and each of the plurality of positions respectively displays a corresponding one of the plurality of candidate words.
In the above input method, after displaying the candidate word on the display unit, the method further includes: receiving a second sliding track input by a user from a second device, wherein the second sliding track is generated through a second sliding touch operation of the user; determining a selection position pointed by the second sliding track; and selecting one of the plurality of candidate words displayed at the corresponding position based on the selection position.
In the above input method, further comprising: displaying a second sliding track input by a user on the display unit while receiving the second sliding track from a second device, wherein the second sliding track is displayed such that a starting point of the second sliding track is in the center of the word selection interface.
In the above input method, the soft keyboard is displayed with a first cursor that identifies the first sliding track; and automatically resetting the first cursor to the center of the word selection interface or the soft keyboard after the first sliding track is displayed.
In the above input method, after selecting one candidate word of the plurality of candidate words displayed at the corresponding position based on the selection position, the method further includes: the word selection interface is displayed as a second cursor with the second sliding track marked; and the second cursor automatically resets to the center of the soft keyboard or the word selection interface after the second sliding track is displayed.
In the input method, the soft keyboard is a 26-key keyboard with a key width-height ratio of 1: 3.
In the above input method, further comprising: receiving a single-click operation of a user from the second device; and in response to the single-click operation, respectively displaying other candidate words in the plurality of candidate words at each of a plurality of positions on the display unit.
In the above input method, further comprising: receiving a double-click operation of a user from the second device; and responding to the double-click operation, and ending the display of the word selection interface.
In the above input method, before receiving the first sliding trajectory input by the user from the second device, the method further includes: receiving a double-click operation or a quick left-stroke operation of a user from the second device; and deleting the last input word in response to the double-click operation or the quick left-stroke operation.
According to another aspect of the present application, there is provided an input apparatus applied to a first device having a display unit, the input apparatus including: an operation receiving unit configured to receive a first sliding trajectory input by a user from a second device, the first sliding trajectory being generated by the user performing a first sliding touch operation on an input unit of the second device; the word matching unit is used for matching the first sliding track with at least one candidate word in a word bank according to a preset matching algorithm; and a display control unit for controlling to display the first sliding trajectory and a soft keyboard for text input on the display unit and to display the at least one candidate word on the display unit while receiving the first sliding trajectory; wherein the first sliding track is displayed such that the starting point of the first sliding track is at the center of the soft keyboard.
In the above input device, the at least one candidate word includes a plurality of candidate words, and the display control unit is specifically configured to: controlling to display a word selection interface for selecting the plurality of candidate words on the display unit, the interface including a plurality of positions, and each of the plurality of positions displaying a corresponding one of the plurality of candidate words, respectively.
In the above-mentioned input apparatus, the operation receiving unit is further configured to receive a second sliding trajectory input by a user from a second device, the second sliding trajectory being generated by a second sliding touch operation by the user; the input device further includes: a word selecting unit, configured to determine a selection position pointed by the second sliding track, and select one of the candidate words displayed at the corresponding position based on the selection position.
In the above input device, the display control unit is further configured to: and controlling to display the second sliding track on the display unit, wherein the display of the second sliding track is that the starting point of the second sliding track is in the center of the word selection interface.
In the above input device, the display control unit is further configured to: displaying the soft keyboard as having a first cursor identifying the first sliding track; and displaying the cursor to automatically reset to the center of the word selection interface or the soft keyboard after displaying the first sliding track.
In the above input device, the display control unit is further configured to: displaying the word selection interface as a second cursor having the second sliding track identified; and displaying the second cursor to automatically reset to the center of the soft keyboard or the word selection interface after displaying the second sliding track.
In the input device, the soft keyboard is a 26-key keyboard with a key width-height ratio of 1: 3.
In the above input apparatus, the operation receiving unit is further configured to receive a single-click operation of a user from the second device; and the display control unit is further used for responding to the single-click operation and controlling to respectively display other candidate words in the plurality of candidate words at each of a plurality of positions on the display unit.
In the above input apparatus, the operation receiving unit is further configured to receive a double-click operation of a user from the second device; and the display control unit is further used for responding to the double-click operation and controlling to end the display of the word selection interface.
In the above input apparatus, the operation receiving unit is further configured to receive a double-click operation or a quick left-stroke operation of the user from the second device; and the display control unit is further used for responding to the double-click operation or the quick left-stroke operation and controlling to delete the displayed last input word.
According to yet another aspect of the present application, there is provided an input system comprising: a first device having a display unit; a second device having an input unit; and an input device connected to the first device and the second device, including: an operation receiving unit configured to receive a first sliding trajectory input by a user from an input unit of the second device, the first sliding trajectory being generated by the user performing a first sliding touch operation on the input unit of the second device; the word matching unit is used for matching the first sliding track with at least one candidate word in a word bank according to a preset matching algorithm; and a display control unit for controlling to display the first sliding trajectory and a soft keyboard for text input on the display unit and to display the at least one candidate word on the display unit while receiving the first sliding trajectory; wherein the first sliding track is displayed such that the starting point of the first sliding track is at the center of the soft keyboard.
According to still another aspect of the present application, there is provided an electronic apparatus including: a memory for storing computer executable instructions; and a processor for executing the computer-executable instructions stored by the memory to perform the input method as described above.
According to yet another aspect of the application, there is provided a computer readable storage medium having stored thereon computer program instructions operable, when executed by a computing device, to perform an input method as described above.
Compared with the prior art, the input method, the input device, the input system and the electronic device according to the application can be applied to a first device with a display unit, and receive a first sliding track input by a user from a second device, wherein the first sliding track is generated by the user performing a first sliding touch operation on an input unit of the second device; displaying the first sliding track and a soft keyboard for text input on the display unit while receiving the first sliding track; matching the first sliding track with at least one candidate word in a word bank according to a preset matching algorithm; and displaying the at least one candidate word on the display unit; wherein the first sliding track is displayed such that the starting point of the first sliding track is at the center of the soft keyboard. Accordingly, an input method, an input apparatus, an input system, and an electronic device are provided that are capable of displaying a sliding trajectory and candidate words on a display plane suitable for a sliding touch input by a user on an input plane, thereby improving user input efficiency and having a high error tolerance rate.
Drawings
The above and other objects, features and advantages of the present application will become more apparent by describing in more detail embodiments of the present application with reference to the attached drawings. The accompanying drawings are included to provide a further understanding of the embodiments of the application and are incorporated in and constitute a part of this specification, illustrate embodiments of the application and together with the description serve to explain the principles of the application. In the drawings, like reference numbers generally represent like parts or steps.
FIG. 1 is a schematic flow diagram of an input method according to an embodiment of the present application;
FIG. 2 is a schematic diagram of a candidate word selection operation of an input method according to an embodiment of the application;
FIG. 3 is a schematic diagram showing an exemplary keyboard layout on a smartphone;
FIG. 4 is a schematic block diagram of an input device according to an embodiment of the present application;
FIG. 5 is a schematic block diagram of an input system according to an embodiment of the present application;
fig. 6 is a schematic block diagram of an electronic device according to an embodiment of the application.
Detailed Description
Hereinafter, example embodiments according to the present application will be described in detail with reference to the accompanying drawings. It should be understood that the described embodiments are only some embodiments of the present application and not all embodiments of the present application, and that the present application is not limited by the example embodiments described herein.
Exemplary method
Fig. 1 is a schematic flow diagram of an input method according to an embodiment of the application. As shown in fig. 1, an input method according to an embodiment of the present application is applied to a first device having a display unit, including: s101, receiving a first sliding track input by a user from a second device, wherein the first sliding track is generated by the user performing a first sliding touch operation on an input unit of the second device; s102, displaying the first sliding track and a soft keyboard for text input on the display unit while receiving the first sliding track; s103, matching the first sliding track with at least one candidate word in a word bank according to a preset matching algorithm; and S104, displaying the at least one candidate word on the display unit; wherein the first sliding track is displayed such that the starting point of the first sliding track is at the center of the soft keyboard.
In the input method according to the embodiment of the application, the input is performed in units of words, but not in units of letters, so that the input efficiency is improved, and the fault tolerance rate is high.
Moreover, by adopting the input method according to the embodiment of the application, when a user inputs a text, eyes can always watch the display unit of the first device without watching the input unit of the second device, so that the visual angle does not need to be switched back and forth between the input device and the display device during the input, the input efficiency of the user is improved, and the user experience is improved.
Here, the first sliding touch operation performed by the user on the input unit of the second device may be a sliding touch operation performed by a finger of the user, or may be a sliding touch operation performed by another input device for touch operation, such as a touch pen.
In the input method according to the embodiment of the present application, the first device displays a first slide trajectory input by a user on the display unit in real time while receiving the first slide trajectory from the second device, so that the user can recognize a trajectory of a slide input on the input unit of the second device, for example, a touch screen, on the display screen. For example, in the input method according to the embodiment of the present application, a 26-key keyboard is displayed on a screen, and a cursor is moved using a touch screen, and the cursor is moved correspondingly on each key of the 26-key keyboard. In this way, a cursor on a virtual keyboard displayed on the display screen can continuously provide visual feedback, enabling a user to input more accurately and quickly.
The user draws a trajectory by a gesture on, for example, a touch screen by a sliding touch operation on the input unit of the second device, passing through each letter of the input word in turn. Then, the algorithm provides a plurality of candidate words according to the comparison of the sliding track and the standard tracks of all the words in the word bank. Here, those skilled in the art will appreciate that various matching algorithms may be employed to determine one or more candidate words based on the sliding trajectory of the user, and the present application is not intended to be limited to any particular method.
As described above, since the matching algorithm may determine a plurality of candidate words based on the sliding trajectory of the user, the user needs to select a desired one of the plurality of candidate words.
The plurality of candidate words may be selected in a list, but in the input method according to the embodiment of the present application, a vote interface is displayed on the display screen, and the plurality of candidate words are displayed in a tiled layout on the vote interface, thereby facilitating a user to select one of the plurality of candidate words through a specific gesture on the input unit of the second device, for example, a sliding touch operation in a specific direction.
Fig. 2 is a schematic diagram of a candidate word selection operation of an input method according to an embodiment of the present application. As shown in fig. 2, a ring menu is used for word selection, and under the word selection menu, the user can type a word by moving the cursor in four directions and releasing, and then enter the track input stage of the next word. Of course, it will be understood by those skilled in the art that although four words are shown in a ring in fig. 2, more words may be shown in a similar layout and candidate words may be selected by a sliding operation in the corresponding direction.
That is to say, in the input method, the at least one candidate word includes a plurality of candidate words, and displaying the candidate words on the display unit specifically includes: displaying a word selection interface for selecting the plurality of candidate words on the display unit, wherein the interface comprises a plurality of positions, and each of the plurality of positions respectively displays a corresponding one of the plurality of candidate words.
Also, in the above input method, after displaying the candidate word on the display unit, further comprising: receiving a second sliding track input by a user from a second device, wherein the second sliding track is generated through a second sliding touch operation of the user; determining a selection position pointed by the second sliding track; and selecting one of the plurality of candidate words displayed at the corresponding position based on the selection position.
Also, a trajectory of the second sliding touch operation by the user may be displayed on the display screen, thereby continuously providing visual feedback to the user so that the user can input more accurately and quickly.
Therefore, in the above input method, further comprising: displaying a second sliding track input by a user on the display unit while receiving the second sliding track from a second device, wherein the second sliding track is displayed such that a starting point of the second sliding track is in the center of the word selection interface.
Here, since the user always looks at the display unit of the first device without looking at the input unit of the second device when performing input in the input method according to the embodiment of the present application, the user cannot actually know the start of input position on the input unit of the second device with certainty. For example, when a user holds a smartphone having a touch screen for input, although the user can see the trajectory of the slide input on the display screen, the position where the slide input starts, that is, the position where the finger starts to contact the touch screen of the smartphone, cannot be known with certainty at the start of the slide input.
Therefore, if the user needs to look at the touch position of the finger on the smartphone at this time, the input efficiency of the user is obviously reduced, and great inconvenience is brought to the user.
Fig. 3 is a schematic diagram illustrating an exemplary keyboard layout on a smartphone. The layout of a keyboard on a touch screen of a smartphone suitable for single-handed thumb operation is shown in fig. 3. However, fig. 3 illustrates that, in practice, in the input method according to the embodiment of the present application, the user does not need any display on the touch screen when actually using the input method, and the user's eyesight and attention will be focused on the display screen completely without switching between the display screen and the touch screen in the hand (e.g., VR immersive experience, etc.).
Moreover, it should be noted that, since the operation of the user on the touch screen of the smartphone is displayed on the display screen, the keyboard layout of the touch screen and the aspect ratio on the display screen are preferably the same, and the operation of the user on the touch screen is also proportionally mapped to the cursor on the display screen.
In addition, in order to solve the above problem, it is arranged to always display the start point of the first slide locus on the display unit at the center of the keyboard, for example, at the position of the letter G on the keyboard. That is, the touch position of the user's finger, i.e., the cursor position, is displayed on the display screen at the center of the keyboard, e.g., at the position of the letter G, no matter where the user's finger is actually on the touch screen. Thus, the trajectory of the on-screen gesture keyboard starts from the midpoint of the keyboard, no matter from which position on the touch screen the user starts to slide the trajectory. Therefore, the problem that the first drop point of the user is not accurately clicked under the blind input condition is completely solved because the track starting point is fixed at the center of the keyboard. Therefore, the input method of the embodiment of the application has the advantages of low learning cost, small psychological burden, increased input efficiency and accuracy and improved user experience.
In addition, the track starting point is fixed at the center of the keyboard and is combined with the annular menu for word selection as shown in fig. 2, so that the switching cost of the user in two modes of track input and word selection is extremely low.
Therefore, in the input method according to the embodiment of the present application, the second slide trajectory is similar to the first slide trajectory, and the start point thereof is also displayed at the center position of the ring menu. That is, the second sliding track is displayed such that the starting point of the second sliding track is at the center of the vote interface.
Of course, in this case, when the user selects a word through the sliding trajectories, each sliding trajectory starts from substantially the center of the keyboard, and thus the sliding trajectory of the user passes more letters than the letters of the word to be input substantially. For example, if the word the user wants to enter is "the," its corresponding standard trajectory should pass through "gthe" for each letter in turn.
After the user inputs the first sliding track for inputting letters, the display unit displays a word selection interface, and at the moment, a first cursor for marking the first sliding track is automatically reset to the center of the word selection interface, so that the user can conveniently select words next. Also, after the user inputs the second sliding track for word selection, the display unit displays the soft keyboard for letter input again, and at this time, the second cursor for identifying the second sliding track should also be automatically reset to the center of the soft keyboard, for example, the cursor is automatically reset to "G" to facilitate the input of the next word.
Of course, it will be understood by those skilled in the art that the first cursor may also be reset to the center of the soft keyboard after the first sliding track, and likewise, the second cursor may also be reset to the center of the vote interface after the second sliding track.
That is, regardless of whether the first cursor that identifies the first slide trajectory or the second cursor that identifies the second slide trajectory, after the input of the first slide trajectory and the second slide trajectory is ended, it is automatically reset to the center of the soft keyboard interface for text input or the vote interface for vote, thereby facilitating the next input.
Therefore, in the above input method, the soft keyboard is displayed with a first cursor that identifies the first sliding trajectory; and automatically resetting the first cursor to the center of the word selection interface or the soft keyboard after the first sliding track is displayed.
And, in the above input method, after selecting one candidate word of the plurality of candidate words displayed at the corresponding position based on the selection position, further comprising: the word selection interface is displayed as a second cursor with the second sliding track marked; and the second cursor automatically resets to the center of the soft keyboard or the word selection interface after the second sliding track is displayed.
As described above, in order to adapt to the size of a touch screen of, for example, a smartphone, in the input method according to the embodiment of the present application, it is preferable that the keyboard shape is closer to a square (the aspect ratio of each key is close to 1:3), and is more suitable for one-handed thumb operation and higher in accuracy and comfort than a general physical keyboard and a soft keyboard (the aspect ratio of each key is close to 1: 1).
Therefore, in the above input method, the soft keyboard is a 26-key keyboard with a key aspect ratio of 1: 3.
In addition, in the input process, the user can also realize other functions through common single-click or double-click input, such as switching candidate words, quitting the word selection interface and the like. Furthermore, if the user wants to delete a word that has been entered, it can also be done by a specific operation, such as a double-click operation or a quick left-stroke operation.
That is, in the above input method, further comprising: receiving a single-click operation of a user from the second device; and in response to the single-click operation, respectively displaying other candidate words in the plurality of candidate words at each of a plurality of positions on the display unit.
Further, in the input method, the method further includes: receiving a double-click operation of a user from the second device; and responding to the double-click operation, and ending the display of the word selection interface.
Further, in the above input method, before receiving the first sliding trajectory input by the user from the second device, the method further includes: receiving a double-click operation or a quick left-stroke operation of a user from the second device; and deleting the last input word in response to the double-click operation or the quick left-stroke operation.
In summary, the input method according to the embodiment of the present application supports text input based on indirect touch input, and a user can input words by moving a cursor on a touch screen and sliding out a track of the words while holding a device (such as a mobile phone, a handle, a remote controller, etc.) with the touch screen, thereby having high input efficiency and fault tolerance.
Exemplary devices
Next, an input device according to an embodiment of the present application will be described with reference to fig. 4.
FIG. 4 is a schematic block diagram of an input device according to an embodiment of the present application.
As shown in fig. 4, an input apparatus 200 according to an embodiment of the present application is applied to a first device 210 having a display unit 211, the input apparatus including 200: an operation receiving unit 231 configured to receive a first sliding trajectory input by a user from the second device 220, the first sliding trajectory being generated by the user performing a first sliding touch operation on the input unit 221 of the second device 220; a word matching unit 232, configured to match the first sliding trajectory received by the operation receiving unit 231 with at least one candidate word in a lexicon according to a predetermined matching algorithm; and a display control unit 233 for controlling to display the first slide trajectory and a soft keyboard for text input on the display unit 211 and to display the at least one candidate word on the display unit 211 while receiving the first slide trajectory; wherein the first sliding track is displayed such that the starting point of the first sliding track is at the center of the soft keyboard.
In an example, in the input apparatus 200, the at least one candidate word includes a plurality of candidate words, and the display control unit 233 is specifically configured to: control to display a word selection interface for selecting the plurality of candidate words on the display unit 211, where the interface includes a plurality of positions, and each of the plurality of positions displays a corresponding one of the plurality of candidate words, respectively.
In one example, in the input apparatus 200 described above, the operation receiving unit 231 is further configured to receive a second sliding track input by a user from the second device 220, where the second sliding track is generated by a second sliding touch operation of the user; the input device 200 further includes: a word selecting unit, configured to determine a selection position pointed by the second sliding track, and select one of the candidate words displayed at the corresponding position based on the selection position.
In one example, in the input device 200 described above, the display control unit 233 is further configured to: controlling to display the second sliding trajectory on the display unit 211, the second sliding trajectory being displayed such that a starting point of the second sliding trajectory is at the center of the vote interface.
In one example, in the input device 200 described above, the display control unit 233 is further configured to: displaying the soft keyboard as having a first cursor identifying the first sliding track; and displaying the cursor to automatically reset to the center of the word selection interface or the soft keyboard after displaying the first sliding track.
In one example, in the input device 200 described above, the display control unit 233 is further configured to: displaying the word selection interface as a second cursor having the second sliding track identified; and displaying the second cursor to automatically reset to the center of the soft keyboard or the word selection interface after displaying the second sliding track.
In one example, in the input device 200 described above, the soft keyboard is a 26-key keyboard with a 1:3 key aspect ratio.
In one example, in the input apparatus 200 described above, the operation receiving unit 231 is further configured to receive a single-click operation of a user from the second device 220; and the display control unit 233 is further configured to control to display other candidate words among the plurality of candidate words, respectively, in each of a plurality of positions on the display unit 211 in response to the one-click operation.
In one example, in the input apparatus 200 described above, the operation receiving unit 231 is further configured to receive a double-click operation of a user from the second device 220; and the display control unit 233 is further configured to control to end the display of the word selection interface on the display unit 211 in response to the double-click operation.
In one example, in the input apparatus 200 described above, the operation receiving unit 231 is further configured to receive a double-click operation or a quick left-stroke operation of a user from the second device 220; and, the display control unit 233 is further configured to control to delete the last input word displayed on the display unit 211 in response to the double-click operation or the quick left-stroke operation.
Here, it can be understood by those skilled in the art that other details of the input device according to the embodiment of the present application are exactly the same as the corresponding details described previously with respect to the input method according to the embodiment of the present application, and thus, are not described again in order to avoid redundancy.
Exemplary System
Next, an input system according to an embodiment of the present application will be described with reference to fig. 5.
FIG. 5 is a schematic block diagram of an input system according to an embodiment of the present application.
As shown in fig. 5, an input system 300 according to an embodiment of the present application includes: a first device 310 having a display unit 311; a second device 320 having an input unit 321; an input device 330, connected to the first device 310 and the second device 320, includes: an operation receiving unit 331 configured to receive a first sliding trajectory input by a user from the input unit 321 of the second device 320, the first sliding trajectory being generated by the user performing a first sliding touch operation on the input unit 321 of the second device 320; a word matching unit 332, configured to match the first sliding trajectory received by the operation receiving unit 331 with at least one candidate word in a lexicon according to a predetermined matching algorithm; and a display control unit 333 for controlling to display the first slide trajectory and a soft keyboard for text input on a display unit 311 on the first device 310 and to display the at least one candidate word on the display unit 311 while receiving the first slide trajectory; wherein the first sliding track is displayed such that the starting point of the first sliding track is at the center of the soft keyboard.
In an example, in the input system 300, the at least one candidate word includes a plurality of candidate words, and the display control unit 333 is specifically configured to: control to display a word selection interface for selecting the plurality of candidate words on the display unit 311, the interface including a plurality of positions, and each of the plurality of positions respectively displaying a corresponding one of the plurality of candidate words.
In one example, in the above input system 300, the operation receiving unit 331 is further configured to receive a second sliding track input by a user from the second device 320, where the second sliding track is generated by a second sliding touch operation of the user on the input unit 321 of the second device 320; the input device 330 further comprises: a word selecting unit, configured to determine a selection position pointed by the second sliding track, and select one of the candidate words displayed at the corresponding position based on the selection position.
In one example, in the input system 300, the display control unit 333 is further configured to: controlling to display the second sliding trajectory on the display unit 311, the second sliding trajectory being displayed such that a starting point of the second sliding trajectory is at the center of the word selection interface.
In one example, in the input system 300, the display control unit 333 is further configured to: displaying the soft keyboard as having a first cursor identifying the first sliding track; and displaying the cursor to automatically reset to the center of the word selection interface or the soft keyboard after displaying the first sliding track.
In one example, in the input system 300, the display control unit 333 is further configured to: displaying the word selection interface as a second cursor having the second sliding track identified; and displaying the second cursor to automatically reset to the center of the soft keyboard or the word selection interface after displaying the second sliding track.
In one example, in the input system 300 described above, the soft keyboard is a 26-key keyboard with a 1:3 key aspect ratio.
In one example, in the input system 300, the operation receiving unit 331 is further configured to receive a single-click operation of a user from the second device 320; and the display control unit 333 is further configured to control to display, in response to the single-click operation, other candidate words of the plurality of candidate words respectively at each of a plurality of positions on the display unit 311.
In one example, in the input system 300, the operation receiving unit 331 is further configured to receive a double-click operation of a user from the second device 320; and the display control unit 333 is further configured to control to end the display of the word selection interface on the display unit 311 in response to the double-click operation.
In one example, in the input system 300, the operation receiving unit 331 is further configured to receive a double-click operation or a fast left-stroke operation of a user from the second device 320; and, the display control unit 333 is further configured to control to delete the last input word displayed on the display unit 311 in response to the double-click operation or the quick left-stroke operation.
Compared to the input apparatus shown in fig. 4, the configuration of the input system shown in fig. 5 is substantially the same, except that the input system 300 includes a first device 310, a second device 320, and an input apparatus 330, which constitute a system as a whole, thereby achieving high efficiency of user input and high fault tolerance.
Here, it can be understood by those skilled in the art that other details of the input device in the input system according to the embodiment of the present application are completely the same as the corresponding details described previously with respect to the input method according to the embodiment of the present application, and thus, the descriptions thereof are omitted to avoid redundancy.
Exemplary electronic device
Next, an electronic apparatus according to an embodiment of the present application is described with reference to fig. 6. The electronic device may be an electronic device integrated in the first device for displaying or the second device for inputting, or a stand-alone device independent of the first device for displaying or the second device for inputting, which may communicate with the first device for displaying or the second device for inputting, etc. to implement the input method according to an embodiment of the present application.
Fig. 6 is a schematic block diagram of an electronic device according to an embodiment of the application.
As shown in fig. 6, electronic device 400 includes one or more processors 410 and memory 420.
The processor 410 may be a Central Processing Unit (CPU) or other form of processing unit having data processing capabilities and/or instruction execution capabilities, and may control other components in the electronic device 300 to perform desired functions.
Memory 420 may include one or more computer program products that may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include, for example, Random Access Memory (RAM), cache memory (cache), and/or the like. The non-volatile memory may include, for example, Read Only Memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium and executed by processor 410 to implement the input methods of the various embodiments of the application described above and/or other desired functions. Various contents such as a matching algorithm, a thesaurus, etc. may also be stored in the computer-readable storage medium.
In one example, the electronic device 400 may further include: an input device 430 and an output device 440, which are interconnected by a bus system and/or other form of connection mechanism (not shown).
For example, the input device 430 may be a microphone or a microphone array for receiving a voice input of a user, a keyboard for receiving a text input of a user (including a touch screen soft keyboard where a user receives a slide input of a user), or a camera for receiving an image input or a gesture input of a user.
The output device 440 may directly output various information to the outside, or control a smart phone or a computer to output various information. The output devices 340 may include, for example, a display, speakers, a printer, and a communication network and its connected remote output devices, among others.
Of course, for simplicity, only some of the components of the electronic device 400 relevant to the present application are shown in fig. 6, and components such as buses, input/output interfaces, and the like are omitted. In addition, electronic device 400 may include any other suitable components depending on the particular application.
Exemplary computer program product and computer-readable storage Medium
In addition to the above-described methods and apparatus, embodiments of the present application may also be a computer program product comprising computer program instructions that, when executed by a processor, cause the processor to perform the steps in the input method according to various embodiments of the present application described in the "exemplary methods" section of this specification, supra.
The computer program product may be written with program code for performing the operations of embodiments of the present application in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server.
Furthermore, embodiments of the present application may also be a computer-readable storage medium having stored thereon computer program instructions that, when executed by a processor, cause the processor to perform steps in an input method according to various embodiments of the present application described in the "exemplary methods" section above of this specification.
The computer-readable storage medium may take any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may include, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The foregoing describes the general principles of the present application in conjunction with specific embodiments, however, it is noted that the advantages, effects, etc. mentioned in the present application are merely examples and are not limiting, and they should not be considered essential to the various embodiments of the present application. Furthermore, the foregoing disclosure of specific details is for the purpose of illustration and description and is not intended to be limiting, since the foregoing disclosure is not intended to be exhaustive or to limit the disclosure to the precise details disclosed.
The block diagrams of devices, apparatuses, systems referred to in this application are only given as illustrative examples and are not intended to require or imply that the connections, arrangements, configurations, etc. must be made in the manner shown in the block diagrams. These devices, apparatuses, devices, systems may be connected, arranged, configured in any manner, as will be appreciated by those skilled in the art. Words such as "including," "comprising," "having," and the like are open-ended words that mean "including, but not limited to," and are used interchangeably therewith. The words "or" and "as used herein mean, and are used interchangeably with, the word" and/or, "unless the context clearly dictates otherwise. The word "such as" is used herein to mean, and is used interchangeably with, the phrase "such as but not limited to".
It should also be noted that in the devices, apparatuses, and methods of the present application, the components or steps may be decomposed and/or recombined. These decompositions and/or recombinations are to be considered as equivalents of the present application.
The previous description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the scope of the application. Thus, the present application is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The foregoing description has been presented for purposes of illustration and description. Furthermore, the description is not intended to limit embodiments of the application to the form disclosed herein. While a number of example aspects and embodiments have been discussed above, those of skill in the art will recognize certain variations, modifications, alterations, additions and sub-combinations thereof.

Claims (16)

1. An input method applied to a first device having a display unit, the input method comprising:
receiving a first sliding track input by a user from a second device, wherein the first sliding track is generated by the user performing a first sliding touch operation on an input unit of the second device;
displaying the first sliding track and a soft keyboard for text input on the display unit while receiving the first sliding track;
matching the first sliding track with at least one candidate word in a word bank according to a preset matching algorithm; and
displaying the at least one candidate word on the display unit;
wherein the first sliding track is displayed as a fixed position of a starting point of the first sliding track on the soft keyboard,
the at least one candidate word comprises a plurality of candidate words, an
Displaying the candidate word on the display unit specifically includes:
displaying a word selection interface for selecting the plurality of candidate words on the display unit, the interface including a plurality of positions, and each of the plurality of positions displaying a corresponding one of the plurality of candidate words respectively,
the soft keyboard is displayed as a first cursor with a first sliding track; and
the first cursor automatically resets to the fixed position of the word selection interface or the soft keyboard after displaying the first sliding track,
the input method further comprises:
receiving a second sliding track input by a user from a second device, wherein the second sliding track is generated through a second sliding touch operation of the user;
determining a selection position pointed by the second sliding track; and
selecting one of the plurality of candidate words displayed at a respective location based on the selection location;
displaying a second sliding track input by a user on the display unit while receiving the second sliding track from a second device, the second sliding track being displayed with a fixed position of a start point of the second sliding track on the vote interface,
after selecting one of the plurality of candidate words displayed at the respective location based on the selection location, further comprising:
the word selection interface is displayed as a second cursor with the second sliding track marked;
and the second cursor automatically resets to the fixed position of the soft keyboard or the word selection interface after the second sliding track is displayed.
2. The input method of claim 1, further comprising:
receiving a single-click operation of a user from the second device; and
in response to the single-click operation, displaying other candidate words of the plurality of candidate words respectively at each of a plurality of positions on the display unit.
3. The input method of claim 1, further comprising:
receiving a double-click operation of a user from the second device; and
and responding to the double-click operation, and ending the display of the word selection interface.
4. The input method of claim 1, further comprising, prior to receiving the first sliding trajectory of the user input from the second device:
receiving a double-click operation or a quick left-stroke operation of a user from the second device; and
and deleting the last input word in response to the double-click operation or the quick left-stroke operation.
5. The input method of any one of claims 1 to 4, wherein the soft keyboard is a 26-key QWERTY keyboard with a 1:3 key aspect ratio.
6. The input method of any one of claims 1 to 4, said fixed location being a central location.
7. An input apparatus applied to a first device having a display unit, the input apparatus comprising:
an operation receiving unit configured to receive a first sliding trajectory input by a user from a second device, the first sliding trajectory being generated by the user performing a first sliding touch operation on an input unit of the second device;
the word matching unit is used for matching the first sliding track with at least one candidate word in a word bank according to a preset matching algorithm; and
a display control unit for controlling to display the first sliding trajectory and a soft keyboard for text input on the display unit and to display the at least one candidate word on the display unit while receiving the first sliding trajectory;
wherein the first sliding track is displayed as a fixed position of a starting point of the first sliding track on the soft keyboard,
wherein,
the at least one candidate word comprises a plurality of candidate words, an
The display control unit is specifically configured to:
control to display a word selection interface for selecting the plurality of candidate words on the display unit, the interface including a plurality of locations, and each of the plurality of locations displaying a respective one of the plurality of candidate words,
the display control unit is further configured to: displaying the soft keyboard as having a first cursor identifying the first sliding track; and displaying the cursor to automatically reset to a fixed position of the word selection interface or the soft keyboard after displaying the first sliding track,
the operation receiving unit is further used for receiving a second sliding track input by a user from a second device, wherein the second sliding track is generated through a second sliding touch operation of the user;
the input device further includes:
a word selection unit for
Determining a selection position to which the second sliding trajectory is directed, an
Selecting one of the plurality of candidate words displayed at a corresponding position based on the selection position,
wherein the display control unit is further configured to:
controlling to display the second sliding track on the display unit, wherein the display of the second sliding track is a fixed position of a starting point of the second sliding track on the word selection interface,
the display control unit is further configured to:
displaying the word selection interface as a second cursor having the second sliding track identified;
displaying the second cursor as automatically resetting to a fixed position of the soft keyboard or the word selection interface after displaying the second sliding track.
8. The input device of claim 7,
the operation receiving unit is further used for receiving the single-click operation of the user from the second device; and
the display control unit is further used for responding to the single-click operation and controlling to display other candidate words in the plurality of candidate words respectively at each of a plurality of positions on the display unit.
9. The input device of claim 7,
the operation receiving unit is further used for receiving a double-click operation of a user from the second device; and
the display control unit is further used for responding to the double-click operation and controlling to end the display of the word selection interface.
10. The input device of claim 7,
the operation receiving unit is further used for receiving a double-click operation or a quick left-stroke operation of a user from the second equipment; and
the display control unit is further configured to control to delete the displayed last input word in response to the double-click operation or the quick left-stroke operation.
11. The input device of any one of claims 7 to 10, wherein the soft keyboard is a 26-key keyboard with a 1:3 key aspect ratio.
12. An input device as claimed in any one of claims 7 to 10, wherein the fixed position is a central position.
13. An input system, comprising:
a first device having a display unit;
a second device having an input unit;
an input device connected with the first apparatus and the second apparatus, comprising:
an operation receiving unit configured to receive a first sliding trajectory input by a user from an input unit of the second device, the first sliding trajectory being generated by the user performing a first sliding touch operation on the input unit of the second device;
the word matching unit is used for matching the first sliding track with at least one candidate word in a word bank according to a preset matching algorithm; and
a display control unit for controlling to display the first sliding trajectory and a soft keyboard for text input on the display unit and to display the at least one candidate word on the display unit while receiving the first sliding trajectory;
wherein the first sliding track is displayed as a fixed position of a starting point of the first sliding track on the soft keyboard,
wherein,
the at least one candidate word comprises a plurality of candidate words, an
The display control unit is specifically configured to:
control to display a word selection interface for selecting the plurality of candidate words on the display unit, the interface including a plurality of locations, and each of the plurality of locations displaying a respective one of the plurality of candidate words,
the display control unit is further configured to: displaying the soft keyboard as having a first cursor identifying the first sliding track; and displaying the cursor to automatically reset to a fixed position of the word selection interface or the soft keyboard after displaying the first sliding track,
the operation receiving unit is further used for receiving a second sliding track input by a user from a second device, wherein the second sliding track is generated through a second sliding touch operation of the user;
the input device further includes:
a word selection unit for
Determining a selection position to which the second sliding trajectory is directed, an
Selecting one of the plurality of candidate words displayed at a corresponding position based on the selection position,
wherein the display control unit is further configured to:
controlling to display the second sliding track on the display unit, wherein the display of the second sliding track is a fixed position of a starting point of the second sliding track on the word selection interface,
the display control unit is further configured to:
displaying the word selection interface as a second cursor having the second sliding track identified;
displaying the second cursor as automatically resetting to a fixed position of the soft keyboard or the word selection interface after displaying the second sliding track.
14. The input system of claim 13, said fixed location being a central location.
15. An electronic device, comprising:
a memory for storing computer executable instructions; and
a processor for executing computer executable instructions stored by the memory to perform the input method of any one of claims 1 to 6.
16. A computer readable storage medium having stored thereon computer program instructions operable, when executed by a computing device, to perform an input method as claimed in any one of claims 1 to 6.
CN201910756846.0A 2019-08-16 2019-08-16 Input method, input device, input system and electronic equipment Active CN110456922B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201910756846.0A CN110456922B (en) 2019-08-16 2019-08-16 Input method, input device, input system and electronic equipment
PCT/CN2020/093162 WO2021031650A1 (en) 2019-08-16 2020-05-29 Input method, input apparatus, input system and electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910756846.0A CN110456922B (en) 2019-08-16 2019-08-16 Input method, input device, input system and electronic equipment

Publications (2)

Publication Number Publication Date
CN110456922A CN110456922A (en) 2019-11-15
CN110456922B true CN110456922B (en) 2021-07-20

Family

ID=68487068

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910756846.0A Active CN110456922B (en) 2019-08-16 2019-08-16 Input method, input device, input system and electronic equipment

Country Status (2)

Country Link
CN (1) CN110456922B (en)
WO (1) WO2021031650A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110456922B (en) * 2019-08-16 2021-07-20 清华大学 Input method, input device, input system and electronic equipment
WO2021208965A1 (en) * 2020-04-14 2021-10-21 Oppo广东移动通信有限公司 Text input method, mobile device, head-mounted display device, and storage medium
US11681370B2 (en) * 2021-09-16 2023-06-20 Htc Corporation Handheld controller and control method

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102880302A (en) * 2012-07-17 2013-01-16 重庆优腾信息技术有限公司 Word identification method, device and system on basis of multi-word continuous input
CN107656693A (en) * 2013-02-28 2018-02-02 联想(北京)有限公司 A kind of method and device that cursor position is determined in touch-screen

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7199786B2 (en) * 2002-11-29 2007-04-03 Daniel Suraqui Reduced keyboards system using unistroke input and having automatic disambiguating and a recognition method using said system
CN102111582B (en) * 2009-12-25 2015-06-17 康佳集团股份有限公司 Remote control device for television, television and remote control method
CN102625010B (en) * 2012-03-06 2014-05-14 清华大学 Eye-Free control method of television by using touch screen phone
CN104007832B (en) * 2013-02-25 2017-09-01 上海触乐信息科技有限公司 Continuous method, system and the equipment for sliding input text
CN103634641A (en) * 2013-11-29 2014-03-12 乐视致新电子科技(天津)有限公司 Method and system for performing gesture control on smart television through mobile terminal
CN104363495A (en) * 2014-11-27 2015-02-18 北京奇艺世纪科技有限公司 Method and device for conducting focus switching control through remote control of terminal device
CN107272881B (en) * 2017-04-26 2020-06-09 北京新美互通科技有限公司 Information input method and device, input method keyboard and electronic equipment
CN109426355B (en) * 2017-08-31 2022-12-30 华为终端有限公司 Input method and input device of electronic equipment and electronic equipment
CN109542244B (en) * 2017-09-21 2022-04-26 北京搜狗科技发展有限公司 Input method, device and medium
CN110456922B (en) * 2019-08-16 2021-07-20 清华大学 Input method, input device, input system and electronic equipment

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102880302A (en) * 2012-07-17 2013-01-16 重庆优腾信息技术有限公司 Word identification method, device and system on basis of multi-word continuous input
CN107656693A (en) * 2013-02-28 2018-02-02 联想(北京)有限公司 A kind of method and device that cursor position is determined in touch-screen

Also Published As

Publication number Publication date
CN110456922A (en) 2019-11-15
WO2021031650A1 (en) 2021-02-25

Similar Documents

Publication Publication Date Title
CN110456922B (en) Input method, input device, input system and electronic equipment
US9002714B2 (en) Method for controlling electronic apparatus based on voice recognition and motion recognition, and electronic apparatus applying the same
KR101587625B1 (en) The method of voice control for display device, and voice control display device
US20150331557A1 (en) Selector to coordinate experiences between related applications
KR102249054B1 (en) Quick tasks for on-screen keyboards
US20130263013A1 (en) Touch-Based Method and Apparatus for Sending Information
US20150026619A1 (en) User Interface Method and Apparatus Using Successive Touches
US20110304649A1 (en) Character selection
JP2005509973A (en) Method and apparatus for gesture-based user interface
CN106796495A (en) The switching of merging and window are placed
JP2008282092A (en) Information processor allowing user to learn gesture command during operation
JP2017521692A (en) Audio control video display device and audio control method for video display device
US20230009807A1 (en) Text entry method and mobile device
EP2965181B1 (en) Enhanced canvas environments
KR102311268B1 (en) Method and apparatus for moving an input field
US11978252B2 (en) Communication system, display apparatus, and display control method
CN110427138A (en) Translation information processing method, device, electronic equipment and storage medium
JP2013097535A (en) Electronic apparatus and display control method
JP7161824B2 (en) How to navigate the display content panel
JP5752759B2 (en) Electronic device, method, and program
US20180077343A1 (en) Interaction method, interaction apparatus, and user equipment
KR20210015348A (en) Dialogue management method based on dialogue management framework and apparatus thereof
CN110688011A (en) Dynamic list composition based on modalities of multimodal client devices
US20240248544A1 (en) Method of calling applications, device, and medium
CN114578966A (en) Interaction method and device, head-mounted display equipment, electronic equipment and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant