CN109739425B - Virtual keyboard, voice input method and device and electronic equipment - Google Patents
Virtual keyboard, voice input method and device and electronic equipment Download PDFInfo
- Publication number
- CN109739425B CN109739425B CN201810356267.2A CN201810356267A CN109739425B CN 109739425 B CN109739425 B CN 109739425B CN 201810356267 A CN201810356267 A CN 201810356267A CN 109739425 B CN109739425 B CN 109739425B
- Authority
- CN
- China
- Prior art keywords
- content
- input
- editing area
- area
- editing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
- Input From Keyboards Or The Like (AREA)
Abstract
The invention discloses a virtual keyboard, which is applied to electronic equipment, wherein the electronic equipment is provided with a display area, and the virtual keyboard comprises: a voice input control; the editing area is used for displaying the recognition result of the voice signal acquired through the voice input control, receiving input operation and displaying an input result generated based on the input operation; wherein the content in the display area corresponds to the content in the editing area. According to the method and the device, the editing area is arranged in the keyboard, so that after the recognition result of the voice signal is recognized, the recognition result is displayed in the editing area, the input operation is carried out through the editing area, the recognition result can be edited by receiving the input operation, the input result can be generated based on the input operation without switching to other keyboard modes such as a key mode, operation processes such as switching are saved, and the efficiency of voice input is improved.
Description
Technical Field
The invention relates to the technical field of virtual keyboards, in particular to a virtual keyboard, a voice input method and device and electronic equipment.
Background
With the wide use of touch screens, the development of virtual keyboard technology is driven. In the virtual keyboard technology, a common input method keyboard is realized through a key mode or a voice input mode, and for the voice input mode, contents are displayed according to a voice recognition structure.
However, the characters in the recognition result need to be edited for the second time due to the influence of noise, etc., and at this time, the key mode needs to be switched, for example, the voice input interface is switched to the Chinese input interface, and then the characters in the recognition result are edited. Therefore, the input efficiency of the voice input is made low.
Disclosure of Invention
In view of the above problems, the present application provides a virtual keyboard, a voice input method, a voice input device and an electronic device, so as to solve the technical problem of low voice input efficiency in the prior art.
The application provides a virtual keyboard is applied to electronic equipment, electronic equipment has the display area, virtual keyboard includes:
a voice input control;
the editing area is used for displaying the recognition result of the voice signal acquired through the voice input control, receiving input operation and displaying an input result generated based on the input operation;
wherein the content in the display area corresponds to the content in the editing area.
Preferably, the virtual keyboard further comprises: editing the recognition result, and/or performing voice input operation on the voice input control.
The virtual keyboard, preferably, the keyboard further comprises:
at least one keypad for triggering a corresponding function.
The virtual keyboard, preferably, the keyboard further comprises:
and the candidate area is used for displaying the candidate content of the target content when the target content in the input result is selected.
The application also provides a voice input method, which is applied to electronic equipment, wherein the electronic equipment is provided with a display area and a virtual keyboard, the virtual keyboard comprises a voice input control and an editing area, and the method comprises the following steps:
recognizing the voice signal collected by the voice input control to obtain a recognition result;
displaying the recognition result in the editing area;
receiving an input operation through the editing area;
generating an input result based on the input operation;
displaying the input result in the editing area, wherein the content in the display area corresponds to the content in the editing area.
The method preferably further comprises the step of: editing the recognition result, and/or performing voice input operation on the voice input control.
The method preferably generates an input result based on the input operation, and includes:
and editing the recognition result in the editing area based on the editing operation and/or the voice input operation to obtain an input result.
The above method, preferably, further comprises:
responding to the selection operation of the target content of the input result, and displaying the candidate content of the target content in the candidate area of the virtual keyboard;
and in response to the selected operation of the target candidate content in the candidate contents, replacing the target candidate content with the target content.
The method preferably, the displaying the candidate content of the target content in the candidate area of the virtual keyboard includes:
respectively displaying the candidate objects of all content objects in the target content in the candidate area of the virtual keyboard;
the operation of selecting the target candidate content in the candidate contents comprises the following steps: and selecting the target candidate object of each content object.
The application also provides a voice input device, which is applied to electronic equipment, wherein the electronic equipment is provided with a display area and a virtual keyboard, the virtual keyboard comprises a voice input control and an editing area, and the method comprises the following steps:
the recognition module is used for recognizing the voice signal acquired by the voice input control to obtain a recognition result;
the display module is used for displaying the identification result in the editing area;
the receiving module is used for receiving input operation through the editing area;
and the generating module is used for generating an input result based on the input operation, and the display module displays the input result in the editing area, wherein the display content in the display area corresponds to the content in the editing area.
The present application further provides an electronic device, including:
the display is used for displaying a display area and a virtual keyboard, and the virtual keyboard comprises a voice input control and an editing area;
the memory is used for storing the application program and data generated by the running of the application program;
a processor for executing the application program to implement the following functions: recognizing the voice signal collected by the voice input control to obtain a recognition result; displaying the recognition result in the editing area; receiving an input operation through the editing area; generating an input result based on the input operation; and displaying the input result in the editing area, wherein the display content in the display area corresponds to the content in the editing area.
By means of the technical scheme, the virtual keyboard provided by the application has the advantages that the editing area is arranged in the keyboard, so that after the recognition result of the voice signal is recognized, the recognition result is displayed in the editing area, the input operation is carried out through the editing area, the recognition result can be edited by receiving the input operation, the input result can be generated based on the input operation without switching to other keyboard modes such as a key mode, the operation processes such as switching are saved, and the voice input efficiency is improved.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
fig. 1 is a schematic layout diagram of a virtual keyboard according to an embodiment of the present application;
FIGS. 2 to 6, 7a, 7b, and 8 to 15 are diagrams illustrating examples of applications of an embodiment of the present application, respectively;
fig. 16 is a flowchart of a voice input method according to the second embodiment of the present application;
FIG. 17 is a partial flow chart of the second embodiment of the present application;
fig. 18 is a schematic structural diagram of a voice input device according to a third embodiment of the present application;
fig. 19 is a schematic structural diagram of an electronic device according to a fourth embodiment of the present application;
fig. 20 and 21 are diagrams illustrating other examples of applications of the embodiment of the present application, respectively.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
Referring to fig. 1, a layout diagram of a virtual keyboard according to an embodiment of the present disclosure is shown, where the virtual keyboard refers to an input method keyboard capable of performing voice input, and is applied to an electronic device, such as a mobile phone, a pad, or a computer, and the electronic device has a display area, and the display area may be understood as an area displaying an input result of the virtual keyboard, such as an area where input content in a dialog box is located, as shown in fig. 2.
In this embodiment, the virtual keyboard may include:
and the voice input control 101 is configured to receive a voice input operation of a user, so as to trigger a voice signal acquisition device on the electronic device to acquire a voice signal.
The voice input operation may be an operation in which the user presses the voice input control for a long time to start voice input and leaves the voice input control to end voice input, or the voice input operation may be an operation in which the user clicks the voice input control to start voice input and clicks the voice input control again to end voice input, and so on.
It should be noted that the voice signal collecting device may be a sound receiving device, such as a microphone, disposed on the electronic device.
The electronic device may further include a filter and other components to perform filtering, denoising, and other processing on the voice signal.
And an editing area 102 for displaying a recognition result of the voice signal acquired through the voice input control 101, receiving an input operation, and displaying an input result generated based on the input operation.
Wherein the content in the display area corresponds to the content in the editing area.
After the user performs the voice input operation on the voice input control 101, the electronic device acquires the voice signal by the voice signal acquisition device and recognizes the voice signal to obtain the recognition result, and then displays the recognition result in the editing area 102, and the editing area 102 can receive the user's input operation for the recognition result, such as selection, deletion, cursor movement, voice input, and the like, so that the electronic device can edit the recognition result on the editing area 102 based on the input operation to generate the input result, and further display the input result generated after editing on the editing area 102.
The recognition result or the input result in the editing region 102 may be a character string composed of characters, including at least one character, where the character may be a chinese character, an english character, a punctuation mark, and the like, as shown in fig. 2. Accordingly, the content of the display area in the electronic device is consistent with the content in the editing area 102.
A certain space interval may be set between characters in the character string in the editing area 102, so as to facilitate the user to perform operations of a single character or multiple characters, such as selecting a single character or moving a cursor, as shown in fig. 3, that is, the character string in the recognition result displayed in the editing area 102 is displayed in a big-explosion manner, so that the user can perform editing operations.
The content in the display area corresponds to the content in the editing area, and means: the content in the display area completely matches the content in the editing area, or the content in the display area includes content before editing in the editing area and content after editing, for example, the content in the display area includes a recognition result and an input result generated based on an input operation.
In one implementation, the greatly exploded form of the editing area 102 may have a normal mode, and may also have an editing mode, for example, after the user operates the voice input control, the editing area 102 is triggered to wake up or pop up to enter the normal mode by default, after the user performs a cursor selection operation in the editing area 102, the editing area 102 may enter the editing mode to perform editing processing, and when the user clicks a corresponding completion keypad, the editing area 102 may push out the editing mode to perform the normal mode, or directly push out the current virtual keyboard to switch to another input mode.
According to the above technical solution, in the virtual keyboard provided in the first embodiment of the present application, the editing area is set in the keyboard, so that after the recognition result of the voice signal is recognized, the recognition result is displayed in the editing area, and then an input operation is performed through the editing area, the recognition result can be edited by receiving the input operation, and an input result can be generated based on the input operation without switching to other keyboard modes such as a key mode, so that operation procedures such as switching are saved, and the efficiency of voice input is improved.
In one implementation, the input operation received in the editing area 102 may be: editing operations on the recognition results, and/or voice input operations on voice input controls.
The editing operation on the recognition result may be a character selection operation on a single character or a plurality of characters, a cursor movement operation before and after the character, a deletion operation on the selected character, a replacement operation on the selected character, an addition character operation, and the like. And the voice input operation to the voice input control may be: and carrying out long-time pressing or two continuous clicks on the voice input control to carry out voice input operation.
Accordingly, after the electronic device in this embodiment receives the input operation on the editing area 102, the electronic device edits the recognition result based on the input operation, thereby obtaining an input result.
For example, a character string of the recognition result is displayed in the editing area 102, the user selects one or more characters in the character string and performs a long-press voice input operation on the voice input control, in this embodiment, the selected character is replaced by the character string corresponding to the acquired voice signal, so as to generate an input result, and the content in the display area of the electronic device is consistent with the input result, as shown in fig. 4.
For another example, an identification result character string is displayed in the editing area 102, the user performs a replacement operation on the cursor position in the character string, at this time, the editing area 102 enters an editing mode in a large explosion mode, and performs a voice input operation by clicking the voice input control twice, in this embodiment, the character string corresponding to the collected voice signal is added to the position where the cursor is located, so as to generate an input result, and the content in the display area of the electronic device is consistent with the input result, as shown in fig. 5.
The user can select the character string by sliding or double-click.
In an implementation manner, the virtual keyboard in this embodiment may further include: at least one keypad that can be used to trigger a corresponding function.
The keypad can be used for inputting corresponding characters, for example, the keypad can be a punctuation keypad, a space keypad, a line feed keypad, other special symbol keypads, and the like.
For example, an identification structure character string is displayed in the editing area 102, the user moves the cursor position in the character string and clicks the punctuation mark key area to perform the input operation of the punctuation mark, in this embodiment, the punctuation mark is added at the cursor position in the identification result character string, so as to generate the input result, and the content in the electronic device display area is consistent with the input result, as shown in fig. 6.
As another example, the editing area 102 displays the recognition structure character string, and the user clicks a space key region or a line break key region on the position of the cursor in the character string to perform space input or line break input operation, in this embodiment, space is added to the position of the cursor in the recognition result character string or line break editing is performed, so as to generate an input result, and the content in the display area of the electronic device is consistent with the input result, as shown in fig. 7a and 7 b.
The keypad may also be a delete symbol keypad for deleting a selected character or deleting a character before the cursor.
For example, an identification result character string is displayed in the editing area 102, a user selects one or more characters in the character string and performs a deletion operation, or the user clicks a delete symbol key area after selecting a cursor position, in this embodiment, the selected characters or characters before the cursor position are deleted, so as to generate an input result, and the content in the display area of the electronic device is consistent with the content of the input result, as shown in fig. 8.
The keypad may also be a switch keypad for switching to a corresponding input mode, such as a chinese character input mode, an english character input mode, a japanese character input mode, and the like.
For example, the character string of the recognition result is displayed in the editing area 102, the user selects the cursor position in the character string, clicks the switching keypad to switch to the english character input mode, performs the english character input operation, and then switches back to the editing area 102, in this embodiment, the input english character is added to the position of the cursor in the character string in the editing area 102, so as to generate the input result, and the content in the display area of the electronic device is consistent with the content of the input result, as shown in fig. 9.
In an implementation manner, the virtual keyboard in this embodiment may further include a candidate region, and the candidate region may appear or pop up when the target content in the input result or the recognition result is selected, and displays the candidate content of the target content.
The candidate area may be set in a free position in the virtual keyboard, such as a navigation bar area, as shown in fig. 10, or may be another free position in a display screen of the electronic device, such as a display area or another area, as shown in fig. 11.
It should be noted that the selected target content may be a character string composed of one or more characters in the input result or the recognition result.
In one implementation, the candidate content displayed in the candidate region may include: at least one target content as a whole candidate object, for example, the selected target content is "background", and accordingly, the candidate content of the target content may include: "Beijing", "Back-to-the-rest", etc., as shown in FIG. 12. The user may select these candidate contents to select one of the target candidate contents, replace the target candidate content with the target content selected before, as shown in fig. 13, an identification result character string is displayed in the editing area 102, the user performs a selection operation on the "background" in the character string, and performs a selection operation on the candidate content after the candidate content of the "background" is displayed in the candidate area, such as an operation of selecting "beijing" as the target candidate content of the target content "background", in this embodiment, "beijing" replaces the "background" in the identification result to generate an input result, and the content in the electronic device display area is consistent with the input result content.
Alternatively, the candidate contents displayed in the candidate area may include: the selected target content is "background", and correspondingly, the candidate content of the target content may include "background" candidate objects: "by", "north", "bei", also include candidates for "scenery": "via", "jing", "net", and the display mode of the candidate object of each character can be displayed individually in a row and column manner, or displayed in combination in any word forming manner, as shown in fig. 14. The user may individually select candidate content of each character, so as to select a target candidate object of each character to form target candidate content, replace the target candidate content with the previously selected target content, as shown in fig. 15, an identification result character string is displayed in the editing region 102, the user performs a selection operation on "background" in the character string, and performs a selection operation on the candidate content after displaying respective candidate content of "back" and "scene" in the candidate region, such as an operation of selecting target candidate content of "north" and "jing" to form target content "background", in this embodiment, "beijing" replaces "background" in the identification result to generate an input result, and the content in the electronic device display region is consistent with the input result content.
Referring to fig. 16, which is a flowchart illustrating an implementation of a voice input method according to a second embodiment of the present disclosure, the method in this embodiment may be applied to an electronic device, such as a mobile phone, a pad, or a computer, which has a display area and a virtual keyboard, where the virtual keyboard may be as shown in fig. 1 to 15, and includes a voice input control and an editing area.
In this embodiment, the method may include the steps of:
step 1601: and recognizing the voice signal acquired through the voice input control to obtain a recognition result.
In this embodiment, the voice signal acquisition device may start to acquire the voice signal after the voice input control is triggered by the voice input operation of the user, and the voice signal may be identified by the processor, so as to obtain an identification result.
It should be noted that the voice input operation may be an operation in which the user long-presses the voice input control to start voice input and leaves the voice input control to end voice input, or the voice input operation may be an operation in which the user clicks the voice input control to start voice input and clicks the voice input control again to end voice input, and so on.
It should be noted that the voice signal collecting device may be a sound receiving device, such as a microphone, disposed on the electronic device.
The electronic device may further include a filter and other components to perform filtering, denoising, and other processing on the voice signal.
Step 1602: the recognition result is displayed in the editing area.
The recognition result in this embodiment may be a character string composed of characters, including at least one character, where the character may be a chinese character, an english character, a punctuation mark, and the like, as shown in fig. 2. And a certain space interval can be set between the characters in the character string when the editing area displays the recognition result, so that the user can conveniently perform the operation of a single character or a plurality of characters, such as the operation of selecting a single character or moving a cursor and the like, as shown in fig. 3, that is, the character string in the recognition result displayed in the editing area is displayed in a big explosion mode, so that the user can conveniently perform the editing operation.
Step 1603: an input operation is received through the edit area.
The input operation is an operation performed by the user on the editing area, such as selecting, deleting, cursor moving, voice inputting, and the like, so that the user can edit the recognition result based on the editing area.
Step 1604: based on the input operation, an input result is generated.
In the present embodiment, the recognition result in the editing area is edited based on the input operation, so as to generate the input result.
Step 1605: the input result is displayed in the editing area.
Wherein the content in the display area corresponds to the content in the editing area.
According to the second voice input method provided by the second embodiment of the present application, after the recognition result of the voice signal is recognized, the recognition result is displayed in the editing area through the virtual keyboard including the voice input control and the editing area, and then the input operation is performed through the editing area, so that the recognition result can be edited by receiving the input operation, and the input result can be generated based on the input operation without switching to other keyboard modes such as a key mode, thereby saving operation procedures such as switching and improving the efficiency of voice input.
In one implementation, the input operation of the user on the editing area may be: editing the recognition result, and/or inputting voice to the voice input control.
The editing operation on the recognition result may be a character selection operation on a single character or a plurality of characters, a cursor movement operation before and after the character, a deletion operation on the selected character, a replacement operation on the selected character, an addition character operation, and the like. And the voice input operation to the voice input control may be: and carrying out long-time pressing or two continuous clicks on the voice input control to carry out voice input operation.
Accordingly, after the electronic device in this embodiment receives an input operation on the editing area, the electronic device edits the recognition result in the editing area based on the editing operation and/or the voice input operation in the input operation, so as to obtain an input result.
In an implementation manner, in this embodiment, an operation of the user on a keypad on the virtual keyboard may also be received, for example, a click operation on a keypad capable of triggering a corresponding function on the virtual keyboard, such as an edit symbol keypad, a space keypad, a linefeed keypad, another special symbol keypad, a delete symbol keypad, a switch keypad, and the like. The user clicks a keypad on the virtual keyboard and/or performs input operations on the editing area, so that the present embodiment responds to these operations, implements editing of the recognition result in the editing area, thereby generating an input result, and displays it in the display area and the editing area.
In one implementation, the virtual keyboard may further include a candidate area, and the candidate area may appear or pop up when the target content in the input result or the recognition result is selected, or may be displayed all the time, and accordingly, when the target content is selected by the user, the candidate content of the target content is displayed in the candidate area, as shown in fig. 17, the method in this embodiment may further include the following steps:
step 1701: and receiving a selected operation of the target content in the input result or the recognition result.
The selected target content can be a character string formed by one or more characters in the input result or the recognition result.
Step 1702: and displaying the candidate content of the target content in the candidate area of the virtual keyboard.
The candidate area may be set in a free position in the virtual keyboard, such as a navigation bar area, as shown in fig. 10, or may be another free position in a display screen of the electronic device, such as a display area or another area, as shown in fig. 11.
Step 1703: and receiving a selected operation of target candidate contents in the candidate contents.
Step 1704: and replacing the target candidate content with the target content.
In one implementation, the candidate content displayed in the candidate region may include: at least one target content as a whole candidate object, for example, the selected target content is "background", and accordingly, the candidate content of the target content may include: "Beijing", "Back-to-the-rest", etc., as shown in FIG. 12. The user may select these candidate contents to select one of the target candidate contents, replace the target candidate content with the target content selected before, as shown in fig. 13, an identification result character string is displayed in the editing area 102, the user performs a selection operation on the "background" in the character string, and performs a selection operation on the candidate content after the candidate content of the "background" is displayed in the candidate area, such as an operation of selecting "beijing" as the target candidate content of the target content "background", in this embodiment, "beijing" replaces the "background" in the identification result to generate an input result, and the content in the electronic device display area is consistent with the input result content.
Alternatively, the candidate contents displayed in the candidate area may include: the selected target content is "background", and correspondingly, the candidate content of the target content may include "background" candidate objects: "by", "north", "bei", also include candidates for "scenery": "via", "jing", "net", and the display mode of the candidate object of each character can be displayed individually in a row and column manner, or displayed in combination in any word forming manner, as shown in fig. 14. The user may individually select candidate content of each character, so as to select a target candidate object of each character to form target candidate content, replace the target candidate content with the previously selected target content, as shown in fig. 15, an identification result character string is displayed in the editing region 102, the user performs a selection operation on "background" in the character string, and performs a selection operation on the candidate content after displaying respective candidate content of "back" and "scene" in the candidate region, such as an operation of selecting target candidate content of "north" and "jing" to form target content "background", in this embodiment, "beijing" replaces "background" in the identification result to generate an input result, and the content in the electronic device display region is consistent with the input result content.
Referring to fig. 18, which is a schematic structural diagram of a voice input device according to a third embodiment of the present disclosure, the device in this embodiment may be applied to an electronic device, a mobile phone, a pad, a computer, or the like having a display area and a virtual keyboard, where the virtual keyboard may be as shown in fig. 1 to 15, and includes a voice input control and an editing area.
In this embodiment, the apparatus may include the following structure:
and the recognition module 1801 is configured to recognize the voice signal acquired through the voice input control, and obtain a recognition result.
In this embodiment, the voice signal acquisition device may start to acquire the voice signal after the voice input control is triggered by the voice input operation of the user, and the voice signal may be identified by the processor, so as to obtain an identification result.
It should be noted that the voice input operation may be an operation in which the user long-presses the voice input control to start voice input and leaves the voice input control to end voice input, or the voice input operation may be an operation in which the user clicks the voice input control to start voice input and clicks the voice input control again to end voice input, and so on.
It should be noted that the voice signal collecting device may be a sound receiving device, such as a microphone, disposed on the electronic device.
The electronic device may further include a filter and other components to perform filtering, denoising, and other processing on the voice signal.
A display module 1802, configured to display the recognition result in the editing area.
The recognition result in this embodiment may be a character string composed of characters, including at least one character, where the character may be a chinese character, an english character, a punctuation mark, and the like, as shown in fig. 2. And a certain space interval can be set between the characters in the character string when the editing area displays the recognition result, so that the user can conveniently perform the operation of a single character or a plurality of characters, such as the operation of selecting a single character or moving a cursor and the like, as shown in fig. 3, that is, the character string in the recognition result displayed in the editing area is displayed in a big explosion mode, so that the user can conveniently perform the editing operation.
A receiving module 1803, configured to receive an input operation through the editing area.
The input operation is an operation performed by the user on the editing area, such as selecting, deleting, cursor moving, voice inputting, and the like, so that the user can edit the recognition result based on the editing area.
A generating module 1804, configured to generate an input result based on the input operation, and display the input result in the editing area by the display module, wherein display content in the display area corresponds to content in the editing area.
In the present embodiment, the recognition result in the editing area is edited based on the input operation, so as to generate the input result.
According to the voice input device provided by the third embodiment of the present invention, after the recognition result of the voice signal is recognized, the recognition result is displayed in the editing area through the virtual keyboard including the voice input control and the editing area, and then the input operation is performed through the editing area, so that the recognition result can be edited by receiving the input operation, and the input result can be generated based on the input operation without switching to other keyboard modes such as a key mode, thereby saving operation procedures such as switching and improving the efficiency of voice input.
In one implementation, the input operation of the user on the editing area may be: editing the recognition result, and/or inputting voice to the voice input control.
In an implementation manner, in this embodiment, an operation of the user on a keypad on the virtual keyboard may also be received, for example, a click operation on a keypad capable of triggering a corresponding function on the virtual keyboard, such as an edit symbol keypad, a space keypad, a linefeed keypad, another special symbol keypad, a delete symbol keypad, a switch keypad, and the like. The user clicks a keypad on the virtual keyboard and/or performs input operations on the editing area, so that the present embodiment responds to these operations, implements editing of the recognition result in the editing area, thereby generating an input result, and displays it in the display area and the editing area.
In one implementation, the virtual keyboard may further include a candidate area, and the candidate area may appear or pop up or be displayed all the time when the target content in the input result or the recognition result is selected.
Referring to fig. 19, a schematic structural diagram of an electronic device according to a fourth embodiment of the present disclosure is shown, where the electronic device may be a mobile phone, a pad, a computer, or the like.
In this embodiment, the electronic device may include:
the display 1901 is configured to display a display area and a virtual keyboard, where the virtual keyboard includes a voice input control and an editing area.
Wherein the virtual keyboard may be as shown in the virtual keyboards of fig. 1 to 15.
The memory 1902 is used for storing applications and data generated by the applications.
The memory 1902 may include volatile memory in a computer-readable medium, Random Access Memory (RAM) and/or nonvolatile memory such as Read Only Memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip.
A processor 1903 configured to execute the application program to implement the following functions: recognizing the voice signal collected by the voice input control to obtain a recognition result; displaying the recognition result in the editing area; receiving an input operation through the editing area; generating an input result based on the input operation; and displaying the input result in the editing area, wherein the display content in the display area corresponds to the content in the editing area.
According to the above technical solution, in the electronic device provided by the fourth embodiment of the present invention, the virtual keyboard including the voice input control and the editing area is used, so that after the recognition result of the voice signal is recognized, the recognition result is displayed in the editing area, and then the input operation is performed through the editing area, the recognition result can be edited by receiving the input operation, and the input result can be generated based on the input operation without switching to other keyboard modes such as a key mode, thereby saving operation procedures such as switching, and improving the efficiency of voice input.
The following describes specific implementations of embodiments of the present application:
the electronic device in this embodiment displays the editing area in the virtual keyboard in a large explosion form to form a display form of a large explosion keyboard, such as the editing frame and the voice button shown in fig. 20 and 21.
Firstly, when the electronic equipment needs to input characters when starting a certain application or function, namely a system input control is activated, an operating system sends a signal for displaying a common keyboard to an input method keyboard application, and the keyboard displays, such as a Chinese input keyboard or an English input keyboard lamp;
then, the user performs voice recognition by long pressing a voice button in the ordinary keyboard, finishes voice input after hands are released, directly screens the result content on the editing frame after the content of the recognition result is obtained, namely, the result content is displayed, meanwhile, the ordinary keyboard is automatically switched to the large explosion keyboard in the embodiment, and the voice recognition content is displayed in a large explosion mode. The navigation bar in the large explosion keyboard can directly display the common punctuation marks.
Specifically, the method comprises the following steps:
first, the user can add content through the big explosion keyboard in this embodiment:
(1) the voice button is pressed for a long time in the large explosion keyboard, and the result of voice recognition is automatically inserted at the cursor. At the moment, the cursor in the edit box can automatically display the result of the voice recognition.
(2) The space key/line feed key (keypad) is clicked in the large explosion keyboard, and the space/line feed character is automatically inserted at the cursor. At the moment, the cursor in the edit box can be automatically displayed with a blank space or changed.
(3) When the content of the large explosion keyboard is not selected, the common punctuation marks are displayed in the navigation bar, and the punctuation marks are clicked, so that the punctuation marks can be directly inserted into the cursor.
(4) The Chinese button or English button (key area) is directly clicked in the large explosion keyboard, the Chinese or English keyboard is directly switched to, the key is clicked, the Chinese and English result is returned and inserted to the cursor of the large explosion keyboard, and the returned Chinese and English result is automatically inserted to the cursor in the edit box.
Secondly, the user can replace the content by the large explosion keyboard in the embodiment:
(1) after a single character is selected by clicking in the large explosion keyboard or a plurality of characters are selected by long-time pressing and sliding. In the selected state, the long-press language key is used for voice recognition, and the recognition result can replace the selected contents in the explosion. Simultaneously, the contents corresponding to the characters selected by the large explosion keyboard in the input edit box are automatically replaced;
(2) after a single character is clicked or a plurality of characters, words and sentences are selected by long-time pressing and sliding in a large explosion keyboard, the recognition engine automatically recognizes again, and the result candidate words are directly displayed in a navigation bar or a candidate word interface. Then any candidate word or combined candidate words can be clicked to replace the selected character, and simultaneously, the content corresponding to the selection of the large explosion keyboard in the input edit box is automatically replaced;
thirdly, the user can delete the content through the large explosion keyboard in the embodiment:
(1) and clicking a delete key in the large explosion keyboard to delete the content before the cursor, and automatically deleting the content just deleted from the large explosion in the edit box.
(2) And clicking a selected sentence or a long-pressed selected sentence in the large explosion keyboard, clicking a delete key to delete the selected content in the large explosion, and automatically deleting the content which is just deleted from the large explosion in the edit box.
Therefore, the large explosion keyboard in the embodiment comprises a Chinese keyboard, an English keyboard, deletion, line feed, blank space and voice input in a common keyboard. The large explosion keyboard can randomly add or delete and modify the contents of the edit box, and when a plurality of words or sentences are selected in the large explosion keyboard, the contents selected in the large explosion keyboard can be replaced by the random combination of single or a plurality of words in the candidate words.
In addition, the large explosion keyboard contains common punctuations, punctuations can be quickly replaced or inserted, and can also be switched to a Chinese or English keyboard at will, so that the Chinese and English contents in the large explosion can be mixed and modified, and the content in the large explosion keyboard can be added, deleted and modified synchronously with the content in the editing frame.
An embodiment of the present invention provides a storage medium on which a program is stored, the program implementing the voice input method when executed by a processor.
The embodiment of the invention provides a processor, which is used for running a program, wherein the voice input method is executed when the program runs.
The present application further provides a computer program product adapted to perform a program for initializing the following method steps when executed on a data processing device: recognizing the voice signal collected by the voice input control to obtain a recognition result; displaying the recognition result in the editing area; receiving an input operation through the editing area; generating an input result based on the input operation; and displaying the input result in the editing area, wherein the display content in the display area corresponds to the content in the editing area.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (8)
1. A virtual keyboard applied to an electronic device, the electronic device having a display area, the virtual keyboard comprising:
a voice input control;
the editing area is used for displaying the recognition result of the voice signal acquired by the voice input control;
performing an input operation through the editing area, the editing area receiving the input operation and displaying an input result generated based on the input operation, the input operation including: editing the recognition result and/or performing voice input operation on the voice input control;
wherein the content in the display area corresponds to the content in the editing area.
2. The virtual keyboard of claim 1, wherein the keyboard further comprises:
at least one keypad for triggering a corresponding function.
3. The virtual keyboard of claim 1, wherein the keyboard further comprises:
and the candidate area is used for displaying the candidate content of the target content when the target content in the input result is selected.
4. A voice input method is applied to an electronic device, the electronic device is provided with a display area and a virtual keyboard, the virtual keyboard comprises a voice input control and an editing area, and the method comprises the following steps:
recognizing the voice signal collected by the voice input control to obtain a recognition result;
displaying the recognition result in the editing area;
performing input operation through the editing area, and receiving the input operation through the editing area;
editing the recognition result in the editing area based on the input operation to generate an input result, wherein the input operation comprises: editing the recognition result and/or performing voice input operation on the voice input control;
displaying the input result in the editing area, wherein the content in the display area corresponds to the content in the editing area.
5. The method of claim 4, further comprising:
responding to the selection operation of the target content of the input result, and displaying the candidate content of the target content in the candidate area of the virtual keyboard;
and in response to the selected operation of the target candidate content in the candidate contents, replacing the target candidate content with the target content.
6. The method of claim 5, wherein displaying the candidate content of the target content in the candidate area of the virtual keyboard comprises:
respectively displaying the candidate objects of all content objects in the target content in the candidate area of the virtual keyboard;
the operation of selecting the target candidate content in the candidate contents comprises the following steps: and selecting the target candidate object of each content object.
7. A voice input device is applied to an electronic device, the electronic device is provided with a display area and a virtual keyboard, the virtual keyboard comprises a voice input control and an editing area, and the voice input device comprises:
the recognition module is used for recognizing the voice signal acquired by the voice input control to obtain a recognition result;
the display module is used for displaying the identification result in the editing area;
a receiving module, configured to perform an input operation through the editing area, and receive the input operation through the editing area, where the input operation includes: editing the recognition result and/or performing voice input operation on the voice input control;
and the generating module is used for generating an input result based on the input operation, and the display module displays the input result in the editing area, wherein the display content in the display area corresponds to the content in the editing area.
8. An electronic device, comprising:
the display is used for displaying a display area and a virtual keyboard, and the virtual keyboard comprises a voice input control and an editing area;
the memory is used for storing the application program and data generated by the running of the application program;
a processor for executing the application program to implement the following functions: recognizing the voice signal collected by the voice input control to obtain a recognition result; displaying the recognition result in the editing area; the method comprises the following steps of carrying out input operation through the editing area, and receiving the input operation through the editing area, wherein the input operation comprises the following steps: editing the recognition result and/or performing voice input operation on the voice input control; generating an input result based on the input operation; and displaying the input result in the editing area, wherein the display content in the display area corresponds to the content in the editing area.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810356267.2A CN109739425B (en) | 2018-04-19 | 2018-04-19 | Virtual keyboard, voice input method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810356267.2A CN109739425B (en) | 2018-04-19 | 2018-04-19 | Virtual keyboard, voice input method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109739425A CN109739425A (en) | 2019-05-10 |
| CN109739425B true CN109739425B (en) | 2020-02-18 |
Family
ID=66354429
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810356267.2A Active CN109739425B (en) | 2018-04-19 | 2018-04-19 | Virtual keyboard, voice input method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109739425B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110289024B (en) * | 2019-06-26 | 2021-03-02 | 北京字节跳动网络技术有限公司 | Audio editing method and device, electronic equipment and storage medium |
| CN111176532B (en) * | 2019-11-29 | 2022-04-15 | 腾讯科技（深圳）有限公司 | Text processing method, information processing method and device based on voice recognition |
| CN111161735A (en) * | 2019-12-31 | 2020-05-15 | 安信通科技（澳门）有限公司 | Voice editing method and device |
| CN111899732A (en) * | 2020-06-17 | 2020-11-06 | 北京百度网讯科技有限公司 | Voice input method and device and electronic equipment |
| CN112230811A (en) * | 2020-10-15 | 2021-01-15 | 科大讯飞股份有限公司 | Input method, device, equipment and storage medium |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1115057A (en) * | 1994-04-25 | 1996-01-17 | 株式会社日立制作所 | Method and apparatus for processing mis-inputting in compound inputting informating processing device |
| CN1397866A (en) * | 2002-08-02 | 2003-02-19 | 北京南山高科技有限公司 | Method and device for inputting Chinese characters by speech and equipment with simplified keyboard |
| CN1717717A (en) * | 2003-06-02 | 2006-01-04 | 国际商业机器公司 | Architecture for a speech input method editor for handheld portable devices |
| CN103366742A (en) * | 2012-03-31 | 2013-10-23 | 盛乐信息技术（上海）有限公司 | Voice input method and system |
| CN103941959A (en) * | 2013-01-23 | 2014-07-23 | Lg电子株式会社 | Electronic device and method of controlling the same |
| CN104346515A (en) * | 2013-08-09 | 2015-02-11 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN204229302U (en) * | 2014-11-17 | 2015-03-25 | 联想(北京)有限公司 | Electronic equipment |
| CN105786204A (en) * | 2014-12-26 | 2016-07-20 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN106775349A (en) * | 2016-11-29 | 2017-05-31 | 珠海市魅族科技有限公司 | A kind of speech modification method and device of word content |
| CN106814879A (en) * | 2017-01-03 | 2017-06-09 | 北京百度网讯科技有限公司 | A kind of input method and device |
| CN106940595A (en) * | 2017-03-16 | 2017-07-11 | 北京云知声信息技术有限公司 | A kind of information edit method and device |
| CN107835305A (en) * | 2017-10-26 | 2018-03-23 | 北京百度网讯科技有限公司 | Data inputting method and device for the terminal device with screen |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200733059A (en) * | 2006-02-17 | 2007-09-01 | Inventec Appliances Corp | Method of using voice recognition measure to input characters and its hand-held apparatus |
| CN101976173A (en) * | 2010-11-24 | 2011-02-16 | 广州市久邦数码科技有限公司 | Multi-language hybrid input method used on embedded touch screen virtual keyboard |
| US11209976B2 (en) * | 2016-04-29 | 2021-12-28 | Myscript | System and method for editing input management |
-
2018
- 2018-04-19 CN CN201810356267.2A patent/CN109739425B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1115057A (en) * | 1994-04-25 | 1996-01-17 | 株式会社日立制作所 | Method and apparatus for processing mis-inputting in compound inputting informating processing device |
| CN1397866A (en) * | 2002-08-02 | 2003-02-19 | 北京南山高科技有限公司 | Method and device for inputting Chinese characters by speech and equipment with simplified keyboard |
| CN1717717A (en) * | 2003-06-02 | 2006-01-04 | 国际商业机器公司 | Architecture for a speech input method editor for handheld portable devices |
| CN103366742A (en) * | 2012-03-31 | 2013-10-23 | 盛乐信息技术（上海）有限公司 | Voice input method and system |
| CN103941959A (en) * | 2013-01-23 | 2014-07-23 | Lg电子株式会社 | Electronic device and method of controlling the same |
| CN104346515A (en) * | 2013-08-09 | 2015-02-11 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN204229302U (en) * | 2014-11-17 | 2015-03-25 | 联想(北京)有限公司 | Electronic equipment |
| CN105786204A (en) * | 2014-12-26 | 2016-07-20 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN106775349A (en) * | 2016-11-29 | 2017-05-31 | 珠海市魅族科技有限公司 | A kind of speech modification method and device of word content |
| CN106814879A (en) * | 2017-01-03 | 2017-06-09 | 北京百度网讯科技有限公司 | A kind of input method and device |
| CN106940595A (en) * | 2017-03-16 | 2017-07-11 | 北京云知声信息技术有限公司 | A kind of information edit method and device |
| CN107835305A (en) * | 2017-10-26 | 2018-03-23 | 北京百度网讯科技有限公司 | Data inputting method and device for the terminal device with screen |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109739425A (en) | 2019-05-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109739425B (en) | Virtual keyboard, voice input method and device and electronic equipment | |
| KR101586890B1 (en) | Input processing method and apparatus | |
| WO2018176977A1 (en) | Text editing method and device, and electronic apparatus | |
| JP6427559B2 (en) | Permanent synchronization system for handwriting input | |
| CN107368511B (en) | Information display method and device | |
| CN104750378B (en) | The input pattern automatic switching method and device of input method | |
| CN106020700B (en) | Interpretation method and terminal device | |
| CN101295313A (en) | Display control apparatus and display control method | |
| CN105373236B (en) | Word learning method and device | |
| CN104133815A (en) | Input and search method and system | |
| CN112230811A (en) | Input method, device, equipment and storage medium | |
| JP2024064941A (en) | Display method, apparatus, pen type electronic dictionary, electronic equipment, and recording medium | |
| US8922492B2 (en) | Device and method of inputting characters | |
| WO2024109699A1 (en) | Display method and apparatus, electronic device, and medium | |
| CN103941979A (en) | Method and device for inputting characters into mobile device | |
| CN106168880B (en) | A kind of method and terminal of input control | |
| CN107977089B (en) | Input method and device and input device | |
| CN108920241B (en) | Display state adjusting method, device and equipment | |
| CN114745585A (en) | Subtitle display method, device, terminal and storage medium | |
| CN102945137A (en) | Handwriting input method of touch-type mobile terminal | |
| CN113407099A (en) | Input method, device and machine readable medium | |
| CN104850237A (en) | Method for generating and processing derived candidate item in input method | |
| JP2010015515A (en) | Electronic apparatus provided with dictionary function | |
| CN104793963A (en) | Message transcription method and device | |
| CN112882629A (en) | Input method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |