CN111324213A - Information input method of terminal and terminal - Google Patents
Information input method of terminal and terminal Download PDFInfo
- Publication number
- CN111324213A CN111324213A CN201811527378.1A CN201811527378A CN111324213A CN 111324213 A CN111324213 A CN 111324213A CN 201811527378 A CN201811527378 A CN 201811527378A CN 111324213 A CN111324213 A CN 111324213A
- Authority
- CN
- China
- Prior art keywords
- text box
- terminal
- target text
- input method
- display interface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
- G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
- G06F3/0233—Character input methods
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/221—Announcement of recognition results
Abstract
The application discloses an information input method of a terminal and the terminal, relates to the field of intelligent terminals, and is used for realizing that characters do not need to be manually input. The information input method of the terminal comprises the following steps: recognizing the received first voice signal to obtain a recognition result; if the recognition result comprises an input instruction, searching a target text box on a display interface of the terminal; and inputting information except the input instruction in the recognition result into the target text box. The embodiment of the application is applied to text input of the intelligent terminal.
Description
Technical Field
The application relates to the field of intelligent terminals, in particular to an information input method of a terminal and the terminal.
Background
An Android operating system is usually installed on an existing intelligent terminal, when characters are to be input, an input method needs to be firstly manually operated to call the input method, and then voice or characters and the like are input through the manually operated input method. Such a manual input method is not efficient, and is not safe and convenient for a scene (e.g., driving a vehicle) where manual operation is inconvenient.
Disclosure of Invention
The embodiment of the application provides an information input method of a terminal and the terminal, which are used for realizing the purpose that characters do not need to be input manually.
In order to achieve the above purpose, the embodiment of the present application adopts the following technical solutions:
in a first aspect, an embodiment of the present application provides an information input method for a terminal, where the information input method for the terminal includes:
recognizing the received first voice signal to obtain a recognition result;
if the identification result comprises an input instruction, searching a target text box on a display interface of the terminal;
and inputting information except the input instruction in the recognition result into the target text box.
In a second aspect, there is provided a computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a computer, cause the computer to perform the information input method of the first aspect.
In a third aspect, there is provided a computer program product containing instructions which, when run on a computer, cause the computer to perform the information input method according to the first aspect.
In a fourth aspect, a terminal is provided, including: the information input method comprises a processor and a memory, wherein the memory is used for storing programs, and the processor calls the programs stored in the memory to execute the information input method of the first aspect.
According to the information input method and the terminal of the terminal, the received first voice signal is identified to obtain an identification result; if the recognition result comprises an input instruction, searching a target text box on a display interface of the terminal; and inputting information except the input instruction in the recognition result into the target text box. The complicated process that a user clicks a text box on a screen, calls an input method and inputs characters through the input method can be omitted, and the characters do not need to be input manually.
Drawings
Fig. 1 is a schematic flowchart of an information input method of a terminal according to an embodiment of the present application;
fig. 2 is a schematic diagram of a target text box determination provided in an embodiment of the present application.
Detailed Description
The embodiment of the application provides an information input method for a terminal, which can be applied to operating systems such as apple (iOS), Android (Android), Windows (Windows) and the like. The embodiment of the present application takes an Android (Android) operating system as an example for explanation, but is not limited thereto.
The information input method of the terminal can be applied to the terminal, and the terminal can be a mobile phone, a television, a computer, an intelligent watch and other devices. For example, text is generally input on a television through a remote controller at present, so that the operation is very inconvenient, and through the information input method of the terminal provided by the embodiment of the application, characters can be quickly input through voice, and the purpose of inputting the characters without manual operation is achieved.
As shown in fig. 1, the information input method of the terminal includes:
s101, carrying out voice recognition on the received first voice signal to obtain a recognition result.
Specifically, the device such as a microphone of the terminal may be controlled by the speech recognition application to detect and receive the first speech signal, and the speech recognition application performs speech recognition on the first speech signal to obtain a recognition result.
The speech recognition application may run continuously in the background or be invoked by receiving preset instructions. For example, the manner of receiving the preset instruction may include: for example, whether a voice button is pressed, whether a HOME key is pressed for a long time or double-clicked, and the like are detected.
The speech recognition application may be displayed over all applications. The following description is based on the window display principle of the Android operating system. In an Android operating system, all windows (windows) are displayed hierarchically, an application display interface is positioned on one layer, and a screen locking interface display layer, a startup and shutdown dialog box display layer and the like are arranged on the application display interface. The service can be started to start the voice recognition application, then a small window is added in a mode of adding a view (addview) by service call, and a layer where the small window is displayed is arranged on a layer where a display interface of the application is arranged, so that the voice recognition application can be guaranteed to be displayed on all the applications.
For example, the received first voice signal may be a continuous voice signal, and voice recognition may be performed on the continuous voice signal to obtain a recognition result, and the recognition result may include the input instruction and information other than the input instruction. For example for the following recognition results: "start input XXXX", "help me input XXXX", "input XXXX in the first text box", and the like, wherein the input instruction is "start input", "help me input", "input in the first text box", and the like. The information other than the input instruction is "XXXX".
Alternatively, the received first speech signal may comprise a plurality of segments of speech signal, for example, by interacting with a user. For example, a first recognition result obtained by performing voice recognition on a received first segment voice signal, such as "start input", "help input", and the like, is used as an input instruction. The user is prompted by voice or a display interface to speak the text to be entered, e.g. the user is prompted by voice "what you want to enter". Then, the received second speech signal is subjected to speech recognition to obtain a second recognition result, for example, "XXXX", "i want to input XXXX", etc., and "XXXX" is taken as information other than the input instruction.
The information in the recognition result other than the input instruction may include at least one of: chinese characters, numbers, letters, etc.
And S102, if the identification result comprises an input instruction, searching a target text box on a display interface of the terminal.
The display interface of the terminal can be an information interface, a login interface and other display interfaces needing to input texts.
For an Android operating system, an accessibility service (accessibility service) may be utilized to find a target textbox on a display interface. The service is an auxiliary interface which is realized by an Android operating system for auditory or visual handicapped people, and the content displayed on the current display interface, including what type of control, what text exists, what position on the screen and the like, can be acquired through the interface. And the acquired control can be operated, including clicking, sliding, characters to be input and the like.
For an Android operating system, the textbox is an editable text (EditText) control, so that all editable text (EditText) controls displayed on the current display interface can be traversed.
Firstly, whether the number of text boxes on a display interface is larger than one is judged.
If not, step S103 is executed.
If so, the target text box can be found from all the text boxes in the following ways.
And in the first mode, the target text box is searched from all the text boxes according to the input instruction.
For example, the coordinate positions of the left boundary, the right boundary, the upper boundary, and the lower boundary of the text box may be obtained through the code, so as to determine the position of the text box on the display interface, and the text boxes may be sorted according to a preset rule and the position of the text box on the display interface.
The order of the text boxes may be included in the input instruction. For example, the input command is: enter in the first text box. The first text box may be determined to be the target text box.
Receiving a second voice signal for representing the position of the target text box; recognizing the second voice signal to obtain the position of a target text box; and searching the target text box from all the text boxes according to the position of the target text box.
For example, if the order of the text boxes is not included in the input instruction, the user may be prompted in which text box to enter text. And after the user speaks the second voice signal, the terminal performs voice recognition on the received second voice signal to obtain the position of the target text box. For example, if the recognition result of the second speech signal is "first text box", "left text box", etc., it may be determined that the first text box is the target text box, or the text box located at the leftmost side is the target text box.
And thirdly, matching the contents displayed in all the text boxes with the information except the input instruction in the recognition result respectively, and taking the text box where the successfully matched contents are located as a target text box.
Illustratively, as shown in fig. 2, a method getText () or getContentDescription () in the List class may be called, and the contents displayed in each text box are respectively obtained from the three text boxes, so that "0.00", "1", and "congratulations for prosperity, great profits" may be respectively obtained. If the information other than the input instruction in the recognition result is "one" or "1", the second text box may be determined to be the target text box.
And S103, inputting information except the input instruction in the recognition result into the target text box.
Specifically, the information other than the input instruction in the recognition result obtained in step S101 is input to the target text box obtained in step S102.
According to the information input method of the terminal, the received first voice signal is identified to obtain an identification result; if the recognition result comprises an input instruction, searching a target text box on a display interface of the terminal; and inputting information except the input instruction in the recognition result into the target text box. The complicated process that a user clicks a text box on a screen, calls an input method and inputs characters through the input method can be omitted, and the characters do not need to be input manually.
Embodiments of the present application provide a computer-readable storage medium storing one or more programs, the one or more programs including instructions, which when executed by a computer, cause the computer to perform an information input method of a terminal as described in fig. 1.
Embodiments of the present application provide a computer program product containing instructions which, when run on a computer, cause the computer to perform the information input method of the terminal as described in fig. 1.
An embodiment of the present application provides a terminal, including: a processor and a memory for storing a program, the processor calling the program stored in the memory to perform the information input method of the terminal as described in fig. 1.
Since the terminal, the computer-readable storage medium, and the computer program product in the embodiments of the present application may be applied to the information input method of the terminal, the technical effect obtained by the method may also refer to the method embodiments, and the embodiments of the present application are not described herein again.
The above units may be individually configured processors, or may be implemented by being integrated into one of the processors of the controller, or may be stored in a memory of the controller in the form of program codes, and the functions of the above units may be called and executed by one of the processors of the controller. The processor described herein may be a Central Processing Unit (CPU), or an Application Specific Integrated Circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present Application.
It should be understood that, in the various embodiments of the present application, the sequence numbers of the above-mentioned processes do not mean the execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus, and method may be implemented in other ways. For example, the above-described device embodiments are merely illustrative, and for example, the division of the units is only one logical functional division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
Claims (9)
1. An information input method of a terminal, comprising:
recognizing the received first voice signal to obtain a recognition result;
if the identification result comprises an input instruction, searching a target text box on a display interface of the terminal;
and inputting information except the input instruction in the recognition result into the target text box.
2. The information input method according to claim 1, wherein the searching for the target text box on the display interface of the terminal specifically includes:
judging whether the number of the text boxes on the display interface is greater than one;
and if so, searching the target text box from all the text boxes according to the input instruction.
3. The information input method according to claim 1, wherein the searching for the target text box on the display interface of the terminal specifically includes:
judging whether the number of the text boxes on the display interface is greater than one;
if so, receiving a second voice signal for representing the position of the target text box;
recognizing the second voice signal to obtain the position of the target text box;
and searching the target text box from all the text boxes according to the position of the target text box.
4. The information input method according to claim 1, wherein the searching for the target text box on the display interface of the terminal specifically includes:
judging whether the number of the text boxes on the display interface is greater than one;
and if so, respectively matching the contents displayed in all the text boxes with the information except the input instruction in the identification result, and taking the text box where the successfully matched contents are located as the target text box.
5. The information input method according to any one of claims 1 to 4, wherein the searching for the target text box on the display interface of the terminal specifically includes:
and searching the target text box on the display interface by using the accessibility service.
6. The information input method according to claim 1, wherein the information other than the input instruction includes at least one of: chinese characters, numbers, letters.
7. A computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a computer, cause the computer to perform the information input method of any of claims 1-6.
8. A computer program product comprising instructions which, when run on a computer, cause the computer to perform the information input method of any one of claims 1-6.
9. A terminal, comprising: a processor and a memory, the memory for storing a program, the processor calling the program stored in the memory to perform the information input method of any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811527378.1A CN111324213A (en) | 2018-12-13 | 2018-12-13 | Information input method of terminal and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811527378.1A CN111324213A (en) | 2018-12-13 | 2018-12-13 | Information input method of terminal and terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111324213A true CN111324213A (en) | 2020-06-23 |
Family
ID=71163020
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811527378.1A Pending CN111324213A (en) | 2018-12-13 | 2018-12-13 | Information input method of terminal and terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111324213A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112073785A (en) * | 2020-09-07 | 2020-12-11 | 深圳创维－Rgb电子有限公司 | Character input method and device, smart television and computer readable storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080201151A1 (en) * | 2007-02-20 | 2008-08-21 | Canon Kabushiki Kaisha | Information-processing device and information-processing method |
| US8255218B1 (en) * | 2011-09-26 | 2012-08-28 | Google Inc. | Directing dictation into input fields |
| US20170046320A1 (en) * | 2013-05-10 | 2017-02-16 | D.R. Systems, Inc. | Voice commands for report editing |
| CN107077319A (en) * | 2016-12-22 | 2017-08-18 | 深圳前海达闼云端智能科技有限公司 | Location positioning method, device, user equipment and computer program product based on Voice command |
| US20170372700A1 (en) * | 2015-01-27 | 2017-12-28 | Yandex Europe Ag | Method of entering data in an electronic device |
| CN107608957A (en) * | 2017-09-06 | 2018-01-19 | 百度在线网络技术（北京）有限公司 | Text modification method, apparatus and its equipment based on voice messaging |
| CN108027665A (en) * | 2015-10-30 | 2018-05-11 | 大陆汽车有限公司 | The method and apparatus for improving alphanumeric character and the handwriting input accuracy of identification of gesture |
-
2018
- 2018-12-13 CN CN201811527378.1A patent/CN111324213A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080201151A1 (en) * | 2007-02-20 | 2008-08-21 | Canon Kabushiki Kaisha | Information-processing device and information-processing method |
| US8255218B1 (en) * | 2011-09-26 | 2012-08-28 | Google Inc. | Directing dictation into input fields |
| US20170046320A1 (en) * | 2013-05-10 | 2017-02-16 | D.R. Systems, Inc. | Voice commands for report editing |
| US20170372700A1 (en) * | 2015-01-27 | 2017-12-28 | Yandex Europe Ag | Method of entering data in an electronic device |
| CN108027665A (en) * | 2015-10-30 | 2018-05-11 | 大陆汽车有限公司 | The method and apparatus for improving alphanumeric character and the handwriting input accuracy of identification of gesture |
| CN107077319A (en) * | 2016-12-22 | 2017-08-18 | 深圳前海达闼云端智能科技有限公司 | Location positioning method, device, user equipment and computer program product based on Voice command |
| CN107608957A (en) * | 2017-09-06 | 2018-01-19 | 百度在线网络技术（北京）有限公司 | Text modification method, apparatus and its equipment based on voice messaging |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112073785A (en) * | 2020-09-07 | 2020-12-11 | 深圳创维－Rgb电子有限公司 | Character input method and device, smart television and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101295711B1 (en) | Mobile communication terminal device and method for executing application with voice recognition | |
| KR20130136167A (en) | Method for providing voice recognition service and an electronic device thereof | |
| CN103955393A (en) | Method and device for starting application program | |
| CN110620844B (en) | Program starting method, device, equipment and storage medium | |
| US11482218B2 (en) | Voice control method, voice control device, and computer-executable non-volatile storage medium | |
| CN112311795B (en) | Account management method and device and electronic equipment | |
| US20170277917A1 (en) | Method for operating soft keyboard, terminal and computer readable storage medium | |
| US10628031B2 (en) | Control instruction identification method and apparatus, and storage medium | |
| CN107835305B (en) | Information input method and device for terminal equipment with screen | |
| US20180088766A1 (en) | Folder creating and cancelling method and system applied on touch screen | |
| CN112286485B (en) | Method and device for controlling application through voice, electronic equipment and storage medium | |
| CN111324213A (en) | Information input method of terminal and terminal | |
| CN107291460B (en) | Television terminal, compiling server code control method and storage medium | |
| CN104778003A (en) | Input track identification method and wearable equipment thereof | |
| CN103984888A (en) | Method and device for helping user to activate application program binding with fingerprint | |
| CN106775249A (en) | A kind of method and electronic equipment that communication shortcut is set | |
| WO2018113751A1 (en) | Method for setting communication shortcut and electronic device | |
| US11126347B2 (en) | Object batching method and apparatus | |
| US9613311B2 (en) | Receiving voice/speech, replacing elements including characters, and determining additional elements by pronouncing a first element | |
| CN113791689A (en) | Control method and device of intelligent equipment, storage medium and electronic device | |
| EP3537341A1 (en) | Character input device, character input method, and character input program | |
| CN115691505A (en) | Control method, device, equipment, medium and program product of intelligent voice equipment | |
| US10412572B2 (en) | Device discovering method, apparatus and computer storage medium thereof | |
| CN111796736A (en) | Application sharing method and device and electronic equipment | |
| CN112764551A (en) | Vocabulary display method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |