CN110570846A - Voice control method and device and mobile phone - Google Patents
Voice control method and device and mobile phone Download PDFInfo
- Publication number
- CN110570846A CN110570846A CN201810569218.7A CN201810569218A CN110570846A CN 110570846 A CN110570846 A CN 110570846A CN 201810569218 A CN201810569218 A CN 201810569218A CN 110570846 A CN110570846 A CN 110570846A
- Authority
- CN
- China
- Prior art keywords
- control
- identification code
- preset
- voice
- screen information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2201/00—Electronic components, circuits, software, systems or apparatus used in telephone systems
- H04M2201/40—Electronic components, circuits, software, systems or apparatus used in telephone systems using speech recognition
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/74—Details of telephonic subscriber devices with voice recognition means
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
the application provides a voice control method, a voice control device and a mobile phone, wherein the voice control method comprises the following steps: acquiring voice containing a control instruction, and analyzing the control instruction contained in the voice; acquiring a preset identification code of a control matched with the control instruction; acquiring screen information of a current operation interface of the terminal, and judging whether a control identical to the preset identification code is found from the screen information; if finding out the control which is the same as the preset identification code from the screen information, simulating to click the control; and if the control which is the same as the preset identification code cannot be found from the screen information, updating the preset identification code according to the identification code of the control clicked in the user operation process. According to the voice control method, the voice control device and the mobile phone, when the identification codes such as the text or the ID of the control change, the self-updating of the local preset identification codes is achieved, and the problem that simulated clicking cannot be completed due to the change of the identification codes such as the text or the ID of the control is solved.
Description
Technical Field
The present application relates to the field of mobile communications technologies, and in particular, to a voice control method, an apparatus, and a mobile phone.
Background
at present, along with the development of voice recognition technology, mobile phone voice control based on a voice recognition function is more and more favored by mobile phone users. The mobile phone voice control means that a user simulates human operation through voice control, so that the mobile phone can be operated instead of keys, touch and the like, the mobile phone can be used for liberating the hands of the user, and the mobile phone is more convenient to use.
In the existing mobile phone voice control, identification codes such as text or ID representing the attributes of a control need to be preset in an intelligent voice database, the text is the value of the control, the ID is a unique identifier for identifying the control, and the identification codes such as the text or the ID are used for unique identification of the corresponding control. When the intelligent voice control system is used, input voice of a user is received, the voice is analyzed to obtain a control instruction in the voice, the intelligent voice database is searched according to the control instruction, identification codes such as text or ID of a control matched with the control instruction are obtained, the corresponding control is searched in a current screen according to the obtained identification codes such as the text or ID, clicking is simulated, and voice control is completed. If the user inputs voice, the third party sends a third party WeChat to explain a meeting every day, receives the voice, analyzes the voice to obtain control instructions of opening the WeChat, finding the third party of a contact person, inputting ' meeting together in the tomorrow ' and sending ', and the like, when sending, searching and obtaining a text or an ID related to sending in an intelligent voice database according to the control instructions, searching a control which is the same as the text or the ID in the current screen according to the obtained text or the ID, simulating and clicking the control, and executing sending.
However, as the application software is upgraded, the identification code such as text or ID of the control may be changed. If the identification codes such as the text, the ID and the like of the control change, when the identification codes such as the text, the ID and the like of the corresponding control in the intelligent voice database are searched according to the acquired control instruction, the identification codes such as the text, the ID and the like of the control before the change are preset and stored in the intelligent voice database. Therefore, when the control in the current screen is searched according to the obtained identification codes of the control such as text or ID, the control matched with the identification codes of the control before change such as text or ID cannot be found, the simulated click cannot be completed, and the voice control cannot be further executed.
Disclosure of Invention
The application provides a voice control method, a voice control device and a mobile phone, when identification codes such as text or ID of a control change, the identification codes such as the text or ID of the control can be updated autonomously, and the problem that simulated click cannot be completed due to the fact that the identification codes such as the text or ID of the control change is solved.
in a first aspect, the present application provides a method for voice control, the method comprising:
acquiring voice containing a control instruction, and analyzing the control instruction contained in the voice;
Acquiring a preset identification code of a control matched with the control instruction according to the control instruction;
acquiring screen information of a current operation interface of the terminal, and searching the screen information according to the preset identification code;
Judging whether a control identical to the preset identification code is found from the screen information;
if finding out the control which is the same as the preset identification code from the screen information, simulating to click the control;
And if the control which is the same as the preset identification code cannot be found from the screen information, acquiring the identification code of the control clicked in the manual operation process of the user, and updating the preset identification code according to the identification code of the control clicked in the operation process of the user.
in a second aspect, the present application further provides a voice control apparatus, comprising a processor and a memory;
The memory for storing program code;
the processor is used for reading the program codes stored in the memory and executing the voice control method as a specific component.
In a third aspect, the present application further provides a mobile phone, where the mobile phone includes a voice control device, and the voice control device is the above-mentioned voice control device.
The voice control method, the voice control device and the mobile phone are used for achieving voice control of the terminal. Specifically, the method comprises the following steps: acquiring a preset identification code of a control matched with the control instruction according to the analyzed control instruction, acquiring screen information of a current operation interface of the terminal, searching a control identical to the preset identification code in the screen information, and if the control identical to the preset identification code can be searched, simulating to click the control; and if the control same as the preset identification code cannot be found, acquiring the identification code of the control clicked in the manual operation process of the user, and updating the preset identification code according to the identification code. Therefore, according to the voice control method provided by the application, when the identification code of the control changes, the self-updating of the local preset identification code is realized, and the problem that the simulated click cannot be completed due to the change of the identification code of the control is solved. The voice control method provided by the application realizes the self-learning of the voice control, and can effectively and autonomously extend the identification code of the required control.
The voice control device is used for specifically executing the voice control method. The voice control device can be used for terminal equipment such as smart phones and televisions.
Drawings
in order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without any creative effort.
fig. 1 is a flow chart illustrating a structure of a voice control method according to an embodiment of the present application;
Fig. 2 is a flow chart illustrating a structure of a voice control method according to a second embodiment of the present application;
FIG. 3 is a usage state diagram of a voice control method according to an embodiment of the present application;
Fig. 4 is a schematic structural diagram of a voice control apparatus according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
when an intelligent voice database is established, the identification codes such as text or ID of the control which can be acquired at that time are preset in the intelligent voice database. If the operated control updates the identification code such as text or ID at a later stage, the operation function of the control controlled by the intelligent voice will be disabled, and in order to facilitate the use of voice recognition, the intelligent voice database is usually updated regularly, for example, the identification code such as text or ID of the control is updated. And the updating of the intelligent voice database mainly passes through an operator, the terminal needs to be upgraded to adapt to new applications continuously, the updating period of the operator is usually relatively long and indefinite, and the voice control cannot be executed normally easily.
Fig. 1 is a flowchart of a voice control method according to an embodiment of the present application. As shown in fig. 1, a voice control method provided in an embodiment of the present application includes:
S100: and acquiring voice containing a control instruction, and analyzing the control instruction contained in the voice.
And after the voice control is started, acquiring the voice containing the control instruction given by the user. The voice control is started by receiving a starting signal, and the starting signal can be generated by long-pressing a certain physical key of the terminal equipment, such as a Home key of a mobile phone. After receiving voice which is given by a user and contains a control instruction, analyzing the voice to obtain the control instruction contained in the voice. The control instruction contained in the voice is analyzed, and the keywords in the received voice are generally intercepted by combining an intelligent voice library and spliced.
s200: and acquiring a preset identification code of the control matched with the control instruction according to the control instruction.
And after the acquired voice is analyzed, a control instruction is obtained, the intelligent voice database is searched according to the control instruction, the intelligent voice database is matched with a control which is preset with an identification code in the intelligent voice database, and the preset identification code of the control matched with the control instruction is obtained. The identification code is a characteristic value representing the control attribute, such as text or ID.
s300: and acquiring screen information of a current operation interface of the terminal, and searching the screen information according to the preset identification code.
And reading the current operation interface of the terminal, and acquiring the screen information of the current operation interface of the terminal. In the specific embodiment of the application, the screen information of the current operation interface of the terminal is acquired based on the auxiliary function. And searching a preset identification code from the acquired screen information of the current operation interface, namely searching a control matched with the preset identification code from the screen information of the current operation interface.
The assistant function (accessibility) is used for assisting a person with physical inconvenience or inflexible operation to operate the mobile phone application by Android officials. The screen information of the current operation interface of the terminal is obtained through the auxiliary function, and specifically, the screen information of the current operation interface can be obtained by calling an interface provided by the accessibility. Such as:
Acquiring screen information of the current operation interface by calling getROOTInActiveWindow
AccessibilityNodeInfo nodeInfo＝getRootInActiveWindow()；
the NodeInfo is a collection class of current screen information.
The screen information of the current operation interface comprises characters, pictures, controls Text, ID, Clickable and the like on the interface, which are all attributes of the controls. Text is the value of the control; the ID is a unique identifier for identifying the control, Clickable indicates whether the control is Clickable, and when Clickable is false, the control cannot be clicked.
S400: and judging whether the control identical to the preset identification code is found from the screen information.
Searching a preset identification code of a control matched with the control instruction from the acquired screen information of the current operation interface of the terminal, and judging whether the control same as the preset identification code is found from the screen information. If yes, searching preset text or preset ID of the control matched with the control instruction from the acquired screen information of the current operation interface of the terminal, and judging whether the control same as the preset text or preset ID is found from the screen information
Specifically, according to the preset text or ID of the control matched with the control instruction, a public interface of an auxiliary function is called, the control matched with the preset text or ID in the screen information of the front operation interface is searched, and the search list is returned after the search. The search list is a table generated by searching the screen information of the operation interface before the search according to the obtained preset text or ID. And when the control matched with the preset text or the ID is not found, the returned search list is empty. And judging whether the returned search list is empty or not, namely knowing whether the control which is the same as the preset text or ID is found from the screen information or not.
taking the control for finding text as "send" as an example:
List<AccessibilityNodeInfo>list＝nodeInfo
findAccessibirityNodeInfosByText ("Send")
Taking the search for a control with ID "aac" as an example:
List<AccessibilityNodeInfo>content＝nodeInfo2
.findAccessibilityNodeInfosByViewId("com.tencent.mm:id/aac")
when finding the control which is the same as the preset text or ID from the screen information, executing step S401; when the control identical to the preset text or ID is not found from the screen information, step S402 is performed.
S401: and if finding the control which is the same as the preset identification code from the screen information, simulating to click the control.
and when finding the control which is the same as the identification code from the screen information, simulating and clicking the control found from the screen information, namely completing the voice control.
For example, when a control identical to the preset text or preset ID is found from the screen information, a simulated click on the control found from the screen information is performed, and then the voice control is completed.
the simulated click process is as follows:
n.performAction(AccessibilityNodeInfo.ACTION_CLICK)
n represents a List < AccessabilityNodeInfo > object found by text or id
s402: and if the control which is the same as the preset identification code cannot be found from the screen information, acquiring the identification code of the control clicked in the manual operation process of the user, and updating the preset identification code according to the identification code of the control clicked in the operation process of the user.
If the control which is the same as the preset text or preset ID is not found from the screen information, the text or ID of the control is changed and is not the text or ID preset in the intelligent voice database. Therefore, the voice control can not be realized by continuously executing the simulated click, and the user needs to perform manual operation to continuously execute the operation control.
And when the user continues to execute by adopting manual operation, acquiring the text or the ID of the control clicked in the manual operation process of the user, and updating the preset text or the preset ID according to the text or the ID of the control clicked in the operation process of the user to realize the self-learning of the voice control. Therefore, local preset text or preset ID is updated through self-learning of voice control. When the control instruction with the same voice is encountered subsequently, the text or the ID of the updated control is found from the local intelligent voice database, the control which is the same as the preset text or the ID can be found from the screen information of the current operation interface according to the updated text or the ID of the control, the control can be clicked in a simulation mode, and the phenomenon that the click cannot be simulated due to the change of the preset text or the ID of the control can be avoided.
For example, a user inputs voice to 'three times of WeChat to explain a meeting every day', receives the voice, analyzes the voice to obtain 'open WeChat, finds the third contact, inputs' meeting together in tomorrow 'and sends' and other control instructions, and then sequentially executes the control instructions of opening WeChat, finding the third contact, inputting 'meeting together in tomorrow', and sending according to the control instructions. If the ID of the control "send" is changed, the ID preset by the control "send" to the intelligent voice database is "[ 204,187] [104,361 ]", and the ID of the changed control "send" is "[ 216,187] [104,257 ]". Thus, when the sending is executed, the ID of the control sending matched with the sending control command is searched from the intelligent voice database, namely, the sending [204,187] [104,361] ", and the sending [204,187] [104,361 ]", is searched in the screen information of the current operation interface, because the ID of the control sending is changed into the sending [216,187] [104,257] ", the sending [204,187] [104,361 ]", and the control sending can not be simulated to be clicked. And when the user continues to click to send by adopting manual operation, acquiring the sending [216,187] [104,257] clicked by the user, updating the preset sending [204,187] [104,361] according to the sending [216,187] [104,257] clicked by the user, namely replacing the sending [204,187] [104,361] by the sending [216,187] [104,257], completing the updating of the ID of the sending of the control, and realizing the self-learning of the voice operation. When a ' sending ' control command of the same voice is encountered subsequently, a control ' sending [216,187] [104,257] matched with the sending control command is found out from the intelligent voice database, a ' sending [216,187] [104,257] can be found out from the screen information of the current operation interface, and the control ' sending [216,187] [104,257] found out from the screen information is clicked in a simulated mode, so that the voice control is completed.
The voice control method provided by the embodiment of the application comprises the steps of obtaining a preset identification code of a control matched with a control instruction according to the analyzed control instruction, obtaining screen information of a current operation interface of a terminal, searching for the control identical to the preset identification code in the screen information, and if the control identical to the preset identification code can be found, simulating to click the control; and if the control same as the preset identification code cannot be found, acquiring the identification code of the control clicked in the manual operation process of the user, and updating the preset identification code according to the identification code. The voice control method provided by the embodiment of the application is used for realizing the voice control of the terminal, can realize the autonomous updating of the local preset identification code when the identification code of the control changes, and solves the problem that the simulated click cannot be completed due to the change of the identification code of the control. The voice control method provided by the application realizes the self-learning of the voice control, and can effectively and autonomously extend the identification code of the required control.
Fig. 2 is a flowchart of a voice control method according to a second embodiment of the present application. As shown in fig. 2, in a specific implementation manner of the present application, before acquiring, according to the control instruction, a preset identification code of a control matched with the control instruction, the method according to the voice control method provided in the embodiment of the present application further includes:
S500: and matching the analyzed control instruction with the preset entries, and judging whether the analyzed control instruction conforms to the preset entries.
S501: and when the analyzed control instruction accords with a preset entry, the analyzed control instruction is split according to the preset entry to obtain a plurality of corresponding control instructions.
The preset entry is a preset entry, is generally used for representing a plurality of control commands, and records the control commands of each relevant step. For example, the control instructions of three steps of 'checking friend circle' recording 'entering WeChat', 'clicking to find' and 'clicking to friend circle' are preset.
after a voice instruction contained in the voice is analyzed, matching the voice instruction with a preset entry is firstly carried out, whether the analyzed control instruction accords with the preset entry or not is judged, namely whether the analyzed control instruction is contained in the preset entry or not is judged, when the analyzed control instruction accords with the preset entry or the analyzed control instruction is contained in the preset entry, a plurality of corresponding control instructions analyzed are split according to the preset entry, preset identification codes of controls matched with the control instruction are sequentially obtained according to the split control instruction, screen information of corresponding operation interfaces is sequentially obtained, the screen information is searched according to the corresponding preset identification codes, and each split control instruction is sequentially executed. When a certain control instruction corresponding to the preset entry cannot be found from the screen information, updating of the preset identification code corresponding to the control instruction is carried out, and self-learning of voice control is achieved.
Based on the voice control method provided by the embodiment, a user can directly say 'view friend circles' on the current operation interface of the desktop, the voice control system respectively obtains the preset identification codes of 'WeChat', 'found' and 'friend circles' according to the control instructions of 'enter WeChat', 'click-to-find' and 'friend circle' steps recorded by the preset entry 'view friend circles', then obtains the screen information of the current desktop, searches for a control corresponding to the preset identification code of 'WeChat' from the screen information of the desktop, and simulates clicking the control; after entering the WeChat interface, acquiring screen information of the WeChat interface, searching a control corresponding to the found preset identification code from the screen information of the WeChat interface, and simulating to click the control; and after entering the discovery interface, acquiring screen information of the discovery interface, searching a control corresponding to the preset identification code of the friend circle from the screen information of the discovery interface, simulating and clicking the control, completing entering the friend circle, and achieving the operation of checking the friend circle. The specific process of viewing friend circle is shown in figure 3.
When the identification code corresponding to any one control instruction of 'enter WeChat', 'click discovery' and 'click friend circle' changes, the corresponding matching preset identification code of the control instruction is updated, and then the subsequent control instruction is continuously executed until the voice control is finished. If the identification code of the control member 'found' in the screen information of the WeChat interface changes, when the identification code is searched in the screen information of the WeChat interface according to the 'found' preset identification code, the identification code of the control member clicked in the manual operation process of the user can not be searched, self-learning of the control instruction operation corresponding to 'click found' is started, and the preset identification code is updated according to the identification code of the control member clicked in the user operation process; and continuing to execute the voice operation of clicking the friend circle on the discovery interface, clicking if the preset identification code of the corresponding friend circle can be found, and self-learning of the control instruction operation corresponding to the friend circle by repeating the operation if the preset identification code of the corresponding friend circle cannot be found.
further, in a specific embodiment of the application, if a control identical to the preset text or preset ID cannot be found from the screen information, prompting a user to perform manual operation, obtaining the text or ID of the control clicked in the user manual operation process according to the user manual operation, and updating the preset text or preset ID according to the text or ID of the control clicked in the user operation process.
For example, when the sending [204,187] [104,361] cannot be found in the current operation interface of the terminal, the user is prompted to "please click to send" manually, so that the user is reminded that the control "sending" cannot be found normally, and the user can timely know that the voice control cannot simulate the click of the control "sending" and timely click the control "sending" manually.
Therefore, the method is beneficial to giving a warning to the user, the user can further execute control conveniently, and the control efficiency is improved; meanwhile, the user is prompted to perform manual operation, so that the user can conveniently perform the manual operation aiming at the prompted manual operation, and the accuracy of updating the preset text or the preset ID is improved.
In a specific embodiment of the application, when the preset text or the preset ID is updated according to the text or the ID of the control clicked in the user operation process, the user is reminded of whether to update the preset text or the preset ID, when a signal for updating the preset text or the preset ID is received, the text or the ID of the control clicked in the user operation process is obtained, and the preset text or the preset ID is updated according to the text or the ID of the control clicked in the user operation process.
And before updating the preset text or the preset ID according to the text or the ID of the clicked control in the user operation process, reminding the user whether to update, and improving the autonomy of updating the preset text or the preset ID. And if the content of the control clicked by the user through manual operation is not the control clicked by the voice control, the prompt is firstly carried out, the preset text or the preset ID which are not matched with each other can be prevented from being updated, and the updating accuracy of the preset text or the preset ID is improved.
specifically, a window for judging whether to update the XX control preset text (preset ID) can be popped up, when the user clicks the yes, a signal for updating the XX control preset text (preset ID) is received, the text or the ID of the clicked control in the user operation process is obtained, and the XX control preset text or the preset ID is updated according to the text or the ID of the clicked control in the user operation process; when the user clicks 'no', a signal for updating the preset text or the preset ID of the control 'XX' cannot be received, and the text or the ID of the clicked control in the operation process of the user and the updating cannot be acquired.
if yes, a signal for updating the preset text or the preset ID sent by the control is received, the text or the ID information sent by the control is acquired from the screen information (sending [216,187] [104,257]), the text or the ID information acquired from the screen information replaces the preset text or the ID sent by the original control, and the updating of the preset text or the preset ID sent by the control is realized; if the user clicks 'no', the preset text or the preset ID of the control 'sent' is not updated.
Further, in the specific embodiment of the present application, obtaining a text or an ID of a control clicked by a user in a manual operation process includes: and acquiring the text or the ID of the control clicked in the manual operation process of the user based on a window management (Windows Manager) service. Namely, the ID or the text of the control clicked in the operation process of the user is obtained through the Windows Manager service of the terminal operation system. Windows Manager is a service of the terminal operating system, which is actually the direct Manager of View, so the ID or text of the clicked control can be obtained through Windows Manager.
in a specific embodiment of the present application, the voice control method further includes reminding the user that the text or ID of the control is updated. Specifically, after the preset text or the preset ID is updated according to the text or the ID of the control clicked in the user operation process, the user is reminded that the text or the ID of the control is updated.
Corresponding to the voice control method provided by the above embodiment, the embodiment of the present application further provides an embodiment of a voice control apparatus, and the structure of the voice control apparatus is shown in fig. 4. The voice control device provided by the embodiment of the application can be used for terminal equipment such as smart phones and televisions.
the voice control apparatus 600 provided by the embodiment of the application includes a processor 601 and a memory 602;
the memory 602 for storing program code;
The processor 601 is configured to read the program code stored in the memory 602, and perform, as a specific component, any one of the voice control methods provided in the foregoing embodiments.
The processor 601 is provided with a micro memory inside, and is used for storing programs, and the programs may include program codes including computer operation instructions. The micro memory may include a Random Access Memory (RAM), and may further include a non-volatile memory (non-volatile memory), such as at least one disk memory. The micro memory can be one, and certainly, the micro memory can also be a plurality of micro processors according to the requirement. And the microprocessor is used for reading the program codes stored in the micro memory. The micro memory is used for temporarily storing the voice control program, and when the voice control is started, the voice control program in the memory is released immediately.
Based on the voice control device provided by the embodiment of the application, the embodiment of the application also provides a mobile phone, the mobile phone comprises the voice control device, and the voice control device is the voice control device provided by the embodiment.
It should be noted that, in the present specification, all the embodiments are described in a progressive manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment is mainly described as a difference from the other embodiments, and related parts may be referred to the part of the description of the method embodiment. Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
It will be understood that the present application is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the application is limited only by the appended claims.
Claims (10)
1. A method for voice control, the method comprising:
Acquiring voice containing a control instruction, and analyzing the control instruction contained in the voice;
Acquiring a preset identification code of a control matched with the control instruction according to the control instruction;
Acquiring screen information of a current operation interface of the terminal, and searching the screen information according to the preset identification code;
judging whether a control identical to the preset identification code is found from the screen information;
If finding out the control which is the same as the preset identification code from the screen information, simulating to click the control;
And if the control which is the same as the preset identification code cannot be found from the screen information, acquiring the identification code of the control clicked in the manual operation process of the user, and updating the preset identification code according to the identification code of the control clicked in the operation process of the user.
2. The voice control method of claim 1, wherein the preset identification code is a preset text or a preset ID.
3. The voice control method according to claim 1, wherein the acquiring of the screen information of the current operation interface of the terminal comprises:
and acquiring screen information of the current operation interface of the terminal based on the auxiliary function.
4. the voice control method according to claim 1, wherein before the obtaining of the preset identification code of the control matching the control instruction according to the control instruction, the method further comprises:
Matching the analyzed control instruction with a preset entry, and judging whether the analyzed control instruction conforms to the preset entry;
And when the analyzed control instruction accords with a preset entry, the analyzed control instruction is split according to the preset entry to obtain a plurality of corresponding control instructions.
5. The voice control method according to claim 1, wherein the obtaining of the identification code of the control clicked by the user in the manual operation process comprises:
and prompting a user for manual operation, and acquiring the identification code of the control clicked in the manual operation process of the user according to the manual operation of the user.
6. The voice control method according to claim 1, wherein the updating the preset identification code according to the identification code of the control clicked in the user operation process includes:
Reminding a user whether to update the preset identification code;
And when a signal for updating the preset identification code is received, acquiring the identification code of the clicked control in the user operation process, and updating the preset identification code according to the identification code of the clicked control in the user operation process.
7. The voice control method according to claim 1, wherein the searching for the screen information according to the preset identification code, and determining whether to find a control identical to the preset identification code from the screen information comprises:
and searching the screen information according to the preset identification code, returning to a search list, and judging whether the returned search list is empty.
8. the voice control method according to claim 1, wherein the obtaining of the identification code of the control clicked by the user in the manual operation process comprises:
and acquiring the identification code of the control clicked in the manual operation process of the user based on the window management service.
9. A voice control apparatus, characterized in that the control apparatus comprises a processor and a memory;
the memory for storing program code;
The processor is configured to read the program code stored in the memory and execute the voice control method according to any one of claims 1 to 8 as a specific component.
10. A handset, characterized in that it comprises voice control means, said voice control means being as claimed in claim 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810569218.7A CN110570846B (en) | 2018-06-05 | 2018-06-05 | Voice control method and device and mobile phone |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810569218.7A CN110570846B (en) | 2018-06-05 | 2018-06-05 | Voice control method and device and mobile phone |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110570846A true CN110570846A (en) | 2019-12-13 |
| CN110570846B CN110570846B (en) | 2022-04-22 |
Family
ID=68772198
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810569218.7A Active CN110570846B (en) | 2018-06-05 | 2018-06-05 | Voice control method and device and mobile phone |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110570846B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111475241A (en) * | 2020-04-02 | 2020-07-31 | 深圳创维－Rgb电子有限公司 | Interface operation method and device, electronic equipment and readable storage medium |
| CN112017656A (en) * | 2020-08-11 | 2020-12-01 | 博泰车联网(南京)有限公司 | Voice control method and device and computer storage medium |
| CN113539255A (en) * | 2021-06-03 | 2021-10-22 | 深圳市艾特智能科技有限公司 | Offline voice control method and system, readable storage medium and computer equipment |
| CN115328347A (en) * | 2022-08-09 | 2022-11-11 | 青岛海信移动通信技术股份有限公司 | Interface display method and device, terminal equipment and storage medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040230637A1 (en) * | 2003-04-29 | 2004-11-18 | Microsoft Corporation | Application controls for speech enabled recognition |
| CN102541438A (en) * | 2010-11-01 | 2012-07-04 | 微软公司 | Integrated voice command modal user interface |
| CN103869931A (en) * | 2012-12-10 | 2014-06-18 | 三星电子（中国）研发中心 | Method and device for controlling user interface through voice |
| CN104102704A (en) * | 2014-07-08 | 2014-10-15 | 深圳市深信服电子科技有限公司 | System control displaying method and system control displaying device |
| CN105161106A (en) * | 2015-08-20 | 2015-12-16 | 深圳Tcl数字技术有限公司 | Voice control method of intelligent terminal, voice control device and television system |
| CN105791931A (en) * | 2016-02-26 | 2016-07-20 | 深圳Tcl数字技术有限公司 | Smart television and voice control method of the smart television |
| CN106098061A (en) * | 2016-06-01 | 2016-11-09 | Tcl集团股份有限公司 | A kind of voice interactive method based on Android system and device |
| CN106373570A (en) * | 2016-09-12 | 2017-02-01 | 深圳市金立通信设备有限公司 | Voice control method and terminal |
| US20180367654A1 (en) * | 2017-06-19 | 2018-12-20 | Cal-Comp Big Data, Inc. | Display apparatus having ability of voice control and method of instructing voice control timing |
| CN109471678A (en) * | 2018-11-07 | 2019-03-15 | 苏州思必驰信息科技有限公司 | Voice midpoint controlling method and device based on image recognition |
-
2018
- 2018-06-05 CN CN201810569218.7A patent/CN110570846B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040230637A1 (en) * | 2003-04-29 | 2004-11-18 | Microsoft Corporation | Application controls for speech enabled recognition |
| CN102541438A (en) * | 2010-11-01 | 2012-07-04 | 微软公司 | Integrated voice command modal user interface |
| CN103869931A (en) * | 2012-12-10 | 2014-06-18 | 三星电子（中国）研发中心 | Method and device for controlling user interface through voice |
| CN104102704A (en) * | 2014-07-08 | 2014-10-15 | 深圳市深信服电子科技有限公司 | System control displaying method and system control displaying device |
| CN105161106A (en) * | 2015-08-20 | 2015-12-16 | 深圳Tcl数字技术有限公司 | Voice control method of intelligent terminal, voice control device and television system |
| CN105791931A (en) * | 2016-02-26 | 2016-07-20 | 深圳Tcl数字技术有限公司 | Smart television and voice control method of the smart television |
| CN106098061A (en) * | 2016-06-01 | 2016-11-09 | Tcl集团股份有限公司 | A kind of voice interactive method based on Android system and device |
| CN106373570A (en) * | 2016-09-12 | 2017-02-01 | 深圳市金立通信设备有限公司 | Voice control method and terminal |
| US20180367654A1 (en) * | 2017-06-19 | 2018-12-20 | Cal-Comp Big Data, Inc. | Display apparatus having ability of voice control and method of instructing voice control timing |
| CN109471678A (en) * | 2018-11-07 | 2019-03-15 | 苏州思必驰信息科技有限公司 | Voice midpoint controlling method and device based on image recognition |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111475241A (en) * | 2020-04-02 | 2020-07-31 | 深圳创维－Rgb电子有限公司 | Interface operation method and device, electronic equipment and readable storage medium |
| CN112017656A (en) * | 2020-08-11 | 2020-12-01 | 博泰车联网(南京)有限公司 | Voice control method and device and computer storage medium |
| CN113539255A (en) * | 2021-06-03 | 2021-10-22 | 深圳市艾特智能科技有限公司 | Offline voice control method and system, readable storage medium and computer equipment |
| CN115328347A (en) * | 2022-08-09 | 2022-11-11 | 青岛海信移动通信技术股份有限公司 | Interface display method and device, terminal equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110570846B (en) | 2022-04-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110570846B (en) | Voice control method and device and mobile phone | |
| US11582337B2 (en) | Electronic device and method of executing function of electronic device | |
| KR102373905B1 (en) | Shortened voice user interface for assistant applications | |
| CN108279931B (en) | Context-pasted object prediction | |
| CN112074898A (en) | Machine generation of context-free grammars for intent inference | |
| CN110046227B (en) | Configuration method, interaction method, device, equipment and storage medium of dialogue system | |
| EP1866750B1 (en) | Methods and apparatus for providing on-demand assistance for a wireless device | |
| CN110691160A (en) | Voice control method and device and mobile phone | |
| CN110060679B (en) | Whole-course voice control interaction method and system | |
| CN110462647B (en) | Electronic device and method for executing functions of electronic device | |
| US11749278B2 (en) | Recommending automated assistant action for inclusion in automated assistant routine | |
| KR20180058476A (en) | A method for processing various input, an electronic device and a server thereof | |
| CN111753064B (en) | Man-machine interaction method and device | |
| CN111052079B (en) | Systems/methods and apparatus for providing multi-function links for interacting with assistant agents | |
| CN110992937B (en) | Language off-line identification method, terminal and readable storage medium | |
| CN106790895A (en) | A kind of fault handling method and device | |
| KR20200063886A (en) | Natural language processing based call center support system and method | |
| CN110136700B (en) | Voice information processing method and device | |
| CN116541536B (en) | Knowledge-enhanced content generation system, data generation method, device, and medium | |
| CN112286486A (en) | Operation method of application program on intelligent terminal, intelligent terminal and storage medium | |
| CN112416751A (en) | Processing method and device for interface automation test and storage medium | |
| CN113360590B (en) | Method and device for updating interest point information, electronic equipment and storage medium | |
| CN112581957B (en) | Computer voice control method, system and related device | |
| CN114090738A (en) | Method, device and equipment for determining scene data information and storage medium | |
| CN113591495A (en) | Speech translation method, device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 266071 Shandong city of Qingdao province Jiangxi City Road No. 11 Patentee after: Qingdao Hisense Mobile Communication Technology Co.,Ltd. Address before: 266071 Shandong city of Qingdao province Jiangxi City Road No. 11 Patentee before: HISENSE MOBILE COMMUNICATIONS TECHNOLOGY Co.,Ltd. |
|
| CP01 | Change in the name or title of a patent holder |