CN110572514A

CN110572514A - method and terminal for controlling application by voice

Info

Publication number: CN110572514A
Application number: CN201910775112.7A
Authority: CN
Inventors: 孟庆霞; 李凯; 王德中; 赵云
Original assignee: Hisense Mobile Communications Technology Co Ltd
Current assignee: Hisense Mobile Communications Technology Co Ltd
Priority date: 2019-08-21
Filing date: 2019-08-21
Publication date: 2019-12-13

Abstract

The invention discloses a method and a terminal for controlling application by voice, which relate to the technical field of communication and are used for solving the problems that the application by the body cannot be controlled by voice at present, manual operation is needed and the speed is low, and the method comprises the following steps: receiving and analyzing a voice control instruction, and determining a keyword in the voice control instruction; after the application in the keyword has the main application and the separate application, matching a target contact in the keyword with a contact of the main application and a contact of the separate application; according to the method, the main application or the body-separated application is started according to the matching result, and the method for controlling the application through voice is provided because the keywords in the voice are extracted, the contact persons in the keywords are matched with the main application of the application and the contact persons in the body-separated application, and the main application or the body-separated application is started according to the matching result.

Description

method and terminal for controlling application by voice

Technical Field

The present invention relates to the field of communications technologies, and in particular, to a method and a terminal for controlling an application by using voice.

Background

when the third-party application has the separate application, the voice assistant is required to control the main application and the separate application respectively. Taking application a as an example, the conventional method is based on the method of assistant control by small voice assistant to operate only the main application of application a; when a user wants to operate the personal application, for example, a voice control instruction is that the main application is still started when the user sends a message to Zhang III through the application A, and when the user wants to operate the personal application, the user can only operate the personal application manually and cannot use voice control.

For example, in an android mobile phone, a certain operation is performed on a third-party application having a split application, and it is first determined whether the split application exists, and if the split application exists, a dialog box is popped up to allow a user to select a main application or the split application for voice control. And if the body-separating application does not exist, directly carrying out voice control on the main application. In the mode, a person is required to wait for the dialog box to pop up for selection in the whole voice control process, the speed is influenced by the speed of user operation, the user cannot be fooled, and complete intelligence cannot be achieved.

in summary, the body-separated application cannot be controlled through voice at present, manual operation is needed, and the speed is low.

disclosure of Invention

The invention provides a method and a terminal for controlling application by voice, which are used for solving the problems that the prior art cannot control the application by voice and needs manual operation and has lower speed.

In a first aspect, a method for controlling an application by using voice according to an embodiment of the present invention includes:

Receiving and analyzing a voice control instruction, and determining a keyword in the voice control instruction;

After the application in the keyword has a main application and an individual application, matching a target contact in the keyword with a contact of the main application and a contact of the individual application;

and starting the main application or the body-divided application according to the matching result.

According to the method, the keywords in the voice are extracted, the contact persons in the keywords are matched with the main application of the application and the contact persons of the separate application in the keywords, and the main application or the separate application is started according to the matching result.

In an alternative embodiment, the contacts of the host application are stored in a first database for storing contacts, the contacts of the host application being determined by:

In the running process of the main application, adjusting the contact of the main application stored in the local database according to the contact in the contact list of the main application; and/or

the contact persons of the separate application are stored in a second database for storing contact persons, and the contact persons of the separate application are determined by the following method:

and in the running process of the body-separating application, adjusting the contact persons of the body-separating application stored in the local database according to the contact persons in the contact person list of the body-separating application.

According to the method, the contact person updating method is provided, when the contact person of the main application matched with the target contact person is stored in the first database, the contact person stored in the first database can be updated according to the contact person in the current contact person list of the main application in each main application running process, the contact person in the first database can be updated synchronously after the contact person is added or deleted by the main application through the updating method, the personal application is the same, and the application starting is accurate and efficient.

in an optional implementation manner, the starting the main application or the separate application according to the matching result includes:

If the target contact person is included in the contact persons of the main application and the target contact person is not included in the contact persons of the separate application, starting the main application; or

If the target contact person is included in at least one contact person of the body-separating application and the target contact person is not included in the contact person of the main application, starting one body-separating application of the body-separating application including the target contact person; or

If the contact person of the main application and at least one contact person of the body-separating application comprise the target contact person, starting one body-separating application of the main application or the body-separating application comprising the target contact person; or

And if the contact person of the main application and the contact persons of all the separate applications do not comprise the target contact person, starting the main application.

the method introduces different starting conditions corresponding to different matching results, introduces several optional starting modes aiming at different matching results, and can be suitable for more application scenes.

In an optional implementation manner, if the contact of the main application and the contacts of all the self-body-splitting applications do not include the target contact, after the starting of the main application, the method further includes:

executing corresponding operation on the main application according to the voice control instruction;

And if the operation is successfully executed, adding the target contact person into the contact person of the main application.

according to the method, when the contact persons of the main application and the self-body application do not comprise the target contact person, the main application can be started, response operation is executed through the main application, and if the execution is successful, the target contact person is added into the contact person of the main application, so that a method for updating the contact person of the main application is provided, and the contact person can be updated in time.

in an optional embodiment, the method further comprises:

and if the operation execution fails, sequentially starting an un-started one of the split applications, and executing corresponding operations until the operation execution is successful or the split applications are all started.

according to the method, the process of selecting the split application to start and execute the corresponding operation after the main application is started and the execution operation fails is provided, and the split application can be started to execute the corresponding operation after the main application fails to execute, so that the scheme in the invention is more perfect, manual operation of a user is avoided as much as possible, and the method is more convenient and efficient.

In a second aspect, a terminal for controlling an application by using voice according to an embodiment of the present invention includes: a processor and a memory, wherein the memory stores program code that, when executed by the processor, causes the terminal to perform the following:

in an alternative embodiment, the contacts of the host application are stored in a first database for storing contacts, and the processor is further configured to determine the contacts of the host application by:

The contacts of the avatar application are stored in a second database for storing contacts, and the processor is further configured to determine the contacts of the avatar application by:

in an alternative embodiment, the processor is specifically configured to:

in an alternative embodiment, if the target contact is not included in the contacts of the main application and the contacts of all the self-service applications, the processor is further configured to:

After the main application is started, corresponding operation is executed on the main application according to the voice control instruction;

In an optional embodiment, the processor is further configured to:

in a third aspect, an embodiment of the present invention further provides a terminal for controlling an application by using voice, where the terminal includes a determining module, a matching module, and a starting module:

The determining module is used for receiving and analyzing a voice control instruction and determining a keyword in the voice control instruction;

The matching module is used for matching a target contact person in the keyword with a contact person of the main application and a contact person of the body-separated application after the main application and the body-separated application exist in the application in the keyword;

and the starting module is used for starting the main application or the body-divided application according to the matching result.

In an alternative embodiment, the contact of the host application is stored in a first database for storing contacts, and the determining module is further configured to determine the contact of the host application by:

The contact of the avatar application is stored in a second database for storing contacts, and the determining module is further configured to determine the contact of the avatar application by:

in an optional implementation manner, the starting module is specifically configured to:

In an optional implementation manner, if the contact of the main application and the contacts of all the self-service applications do not include the target contact, the starting module is further configured to:

In an optional implementation manner, the terminal further includes:

And the processing module is used for sequentially starting an un-started one of the body-divided applications and executing corresponding operation if the operation execution fails, until the operation execution is successful or the body-divided applications are all started.

In a fourth aspect, the present application also provides a computer storage medium having a computer program stored thereon, which when executed by a processor, performs the steps of the method of the first aspect.

In addition, for technical effects brought by any one implementation manner of the second aspect to the fourth aspect, reference may be made to technical effects brought by different implementation manners of the first aspect, and details are not described here.

drawings

in order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.

fig. 1 is a schematic diagram of a method for controlling an application by voice according to an embodiment of the present invention;

Fig. 2 is a schematic interface diagram for implementing application differentiation according to an embodiment of the present invention;

FIG. 3A is a schematic diagram of an application interface according to an embodiment of the present invention;

fig. 3B is a schematic diagram of a corresponding relationship provided in the embodiment of the present invention;

Fig. 3C is a schematic diagram of another corresponding relationship provided in the embodiment of the present invention;

Fig. 4A is a schematic diagram of a terminal for operation execution success prompt according to an embodiment of the present invention;

Fig. 4B is a schematic diagram of a terminal for operation execution failure prompt according to an embodiment of the present invention;

FIG. 5 is a diagram illustrating a recommendation function provided by an embodiment of the present invention;

FIG. 6 is a flowchart of a complete method for controlling an application by voice according to an embodiment of the present invention;

FIG. 7 is a flow chart of another method for controlling application of voice in accordance with the present invention;

Fig. 8 is a schematic diagram of a terminal of a first voice control application according to an embodiment of the present invention;

Fig. 9 is a schematic diagram of a terminal of a second voice control application according to an embodiment of the present invention;

Fig. 10 is a schematic diagram of a terminal for a third voice control application according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention clearer, the present invention will be described in further detail with reference to the accompanying drawings, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Some of the words that appear in the text are explained below:

1. The term "and/or" in the embodiments of the present invention describes an association relationship of associated objects, and indicates that three relationships may exist, for example, a and/or B may indicate: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.

2. the term "terminal" in the embodiments of the present invention refers to a mobile communication device, such as a mobile phone, a tablet, a computer, a wearable device, and the like.

3. The term "third-party application" in the embodiment of the present invention is related to the functional deficiency of a certain software or application, and related software developed by other organizations or individuals than the software-editing party is usually developed and released by an independent technology company or an individual.

4. the term "multiple applications open" in the embodiment of the present invention refers to that multiple identical application software is started on the same device, and the multiple identical application software can be used simultaneously, for example, three application a applications are started on a mobile terminal to log in different three application a accounts.

5. the terms "main application" and "body-separated application" in the embodiment of the present invention are the same-name applications respectively running in different spaces of the electronic device; wherein the split application is a split of the master application obtained by copying the master application. The expression form of the current application body-separating is to create another body-separating icon on the desktop, the body-separating application and the body-separated application (main application) are the same application, but the body-separating application and the body-separated application are regarded as two applications by the system to perform function processing, and the two applications can independently run without mutual influence.

the application scenario described in the embodiment of the present invention is for more clearly illustrating the technical solution of the embodiment of the present invention, and does not form a limitation on the technical solution provided in the embodiment of the present invention, and it can be known by a person skilled in the art that with the occurrence of a new application scenario, the technical solution provided in the embodiment of the present invention is also applicable to similar technical problems. In the description of the present invention, the term "plurality" means two or more unless otherwise specified.

With the development of technology, the types and forms of applications on the mobile terminal are increasing, and many applications become an indispensable part of life, work and entertainment of people, so that better experience is brought to users. The various demands of the user on the application are also increasing.

However, the voice control third-party application is based on the auxiliary control of the voice assistant, since the voice assistant cannot judge whether the application and the personal application exist in the mobile phone, therefore, the user wants to still start the main application when operating the personal application, and based on the problem, the invention provides a new scheme of the method and the device for controlling the application by voice, the method realizes the voice control of third-party application based on semi-autonomous learning, and through the learning function of a background, the common contacts for the main application and the separate applications may be stored in a database, which is traversed first when it is determined that the separate application is locally present, starting the main application or the separate application according to the traversal result, when the contact is not found in the database, the main application is started by default, and when the voice control instruction is successfully executed, the contact person is written into a main application database for the next query; if the execution is unsuccessful, the body-separated application is started, and if the body-separated application successfully executes the voice control instruction, the contact person is written into a database of the body-separated application. And the voice assistant controls the main application and the separate application through gradual learning. Similarly, the semi-autonomous learning mode can be used for controlling third-party applications such as payment applications and social applications with separate applications.

With respect to the above scenario, the following describes an embodiment of the present invention in further detail with reference to the drawings of the specification.

As shown in fig. 1, a method for controlling an application by voice according to an embodiment of the present invention specifically includes the following steps:

Step 100: receiving and analyzing a voice control instruction, and determining a keyword in the voice control instruction;

Step 101: after the application in the keyword has a main application and an individual application, matching a target contact in the keyword with a contact of the main application and a contact of the individual application;

Step 102: and starting the main application or the body-divided application according to the matching result.

According to the scheme, the keywords in the voice are extracted, the contact persons in the keywords are matched with the main application of the application in the keywords and the contact persons of the individual application, the main application or the individual application is started according to the matching result, the method for controlling the application through the voice is provided, the main application and the individual application can be controlled through the voice, the user does not need to manually select the application, and the method is efficient and convenient.

in the embodiment of the present invention, it may be determined whether the application has an affiliate application according to userid (user identification), for example, in order to distinguish between a main application and an affiliate application, taking application a as an example, assuming that application a has only one main application (application a) and one affiliate application (application AII), userid of the main application and the affiliate application is set, where 0 represents the main application and 881 represents the affiliate application; if the userid of the body-separated application is read, the application has the body-separated application, and if the userid of the body-separated application is not read, only the userid of the main application is read, the application does not have the body-separated application.

for example, if the read userid contains 881 and 0, it indicates that both the master and the avatar applications exist; if only 0 is read, only the main application exists; if 881 is read only, this indicates that there is only a separate application.

In an alternative embodiment, if the host application is refrigerated or placed into a private space, the host application may be considered to be absent (in fact both the host application and the avatar application are present, but only in a non-private space location, the host application may be considered to be absent), in which case the userid of the host application cannot be read; if the application differentiation is not started for a certain application, for example, as shown in fig. 2, where the application a starts the differentiation function and the application B does not start the differentiation function, the userid of the differentiation application can be read by the application a having the differentiation, and the userid of the differentiation application cannot be read by the application B having no differentiation.

In an alternative embodiment, if there is at least one sub-application among multiple applications, it is also possible to distinguish different main applications of the applications or different sub-applications of the applications according to the userid + application package name, for example, there are 3 different main applications, where the main application 1 is: 0(userid) + app package name 1; the main applications 2 are: 0+ application package name 2; the main applications 3 are: 0+ application package name 3.

If 3 separate applications exist in the main application 1, assuming that the main application 1, the separate application 2 and the separate application 3 are respectively the separate application 1, the separate application 1 is; 881+ application package name 1; the application for the individual body 2 is as follows: 882+ app package name 2; the application for dividing the body 3 is as follows: 883+ application package name 3.

in this disclosure, if the terminal receives a voice control instruction triggered by a user, the terminal parses the received voice control instruction to determine a keyword therein, which mainly includes: name of the application that needs to be started, target contact. If the application in the keyword only has the main application, the main application is started by default; if the fact that only the split application exists is determined, the split application is started by default; if the main application and the separate application exist, the target contact person can be matched with the contact persons of the main application and the separate application, and the main application or the separate application is started according to a matching result.

For example, the voice control command is: sending a message to the Xiaoming through the application B; then the keywords can be extracted: and an application B and a Xiaoming, wherein the target contact is the Xiaoming, and if the application B only has one sub-body application (application BII) and the obtained userid of the application B contains 0 and 881, the main application and the sub-body application can be determined to exist through the userid, and the target contact is matched with the contacts of the main application and the sub-body application at the moment.

in this embodiment of the application, if an application has an individual application, common contacts of the main application and the individual application may be respectively stored in the databases through learning in the background, specifically, a contact database of the main application and the individual application is newly created, contact lists of the main application and the individual application are traversed, contacts in the contact list of the main application are added to the contact database of the main application, and contacts in the contact list of the individual application are added to the contact database of the individual application.

the newly-built database is used for storing the contact persons, and different from the database of the application itself, the user can browse the newly-built database when the application is not started, so that the newly-built database used for storing the contact persons can be compared with the target contact person when the application is not started.

In an alternative embodiment, the contact of the main application is stored in a first database for storing the contact, and the contact of the separate application is stored in a second database for storing the contact, wherein the first database and the second database may be the same database or different databases.

Taking the application shown in fig. 3A as an example, the terminal has two applications, namely application a and application B, which have two separate applications, namely application AII, application AIII, application BII, and application BIII, respectively, and when storing the contacts of these applications, there are many storage ways, which are listed below:

The storage mode I is distinguished aiming at the application, and the contacts of the main application and the sub-body application of the same application are stored in the same database.

For example, contacts of application a, application AII, application AIII are added to database a, contacts of application B, application BII, application BIII are added to database B.

a second storage mode is that a database is created locally for storing the contacts of each main application, and another database is created locally for storing the contacts of each sub-body application;

For example, contacts of application a, application B are added to database C, contacts of application AII, application AIII, application BII, application BIII are added to database D.

And a third storage mode, namely respectively storing the different main applications or the different body-separated applications into different databases.

For example, contacts of application a, application AII, application AIII, application B, application BII, and application BIII are stored in databases E to G, respectively.

And adding the data into the same database in a storage mode IV.

for example, contacts of application a, application AII, application AIII, application B, application BII, application BIII are added to database K, respectively.

in the embodiment of the application, when the contacts of the main application and the separate application exist in the same database, or the contacts of a plurality of main applications exist in the same database, or the contacts of a plurality of separate applications exist in the same database, under several conditions, such as the storage conditions of the first, second and fourth, the corresponding relationship between the applications and the contacts needs to be established, and it is ensured that when the contacts are searched in the same database, the comparison can be accurately performed from the contacts of the applications needing to be started.

As shown in fig. 3B and fig. 3C, an optional mapping relationship diagram provided for the embodiment of the present application is, for an example of a storage situation, where contacts of the application a and the application B are stored in the database C, so that a mapping relationship between the application a and the application a contact and between the application B and the application B contact is established, and similarly in fig. 3C, contacts of the application AII and the application AIII and between the application BII and the application B are stored in the database D, so that a mapping relationship between the application and the application contact is also established, and the application contacts can be accurately searched in the database through the mapping relationship for comparison.

Aiming at the third storage mode, the contact persons of all applications are stored in different databases, and when the application contact persons change and the databases need to be adjusted, the application contact persons do not need to be modified according to the corresponding relation, so that the method is more convenient and accurate.

In an alternative embodiment, if the contacts of the primary application are stored in the first database for storing contacts, the first database may be updated aperiodically, specifically:

In the running process of the main application (for example, when the main application is started or in the running process after the main application is started), the contacts of the main application stored in the first database are adjusted according to the contacts in the contact list of the main application, and the specific adjustment process is as follows: and comparing the contact persons in the contact person list of the main application with the contact persons of the main application stored in the first database, and if the comparison result is inconsistent, adding the excessive contact persons in the contact person list into the first database, and/or deleting the excessive contact persons in the first database.

For example, there are 10 contacts of a certain main application currently stored in the first database, which are contacts 1, 2, 3, 4, 5, 6, 7, 8, 9, 10; there are 12 contacts in the current master application contact list, which are contacts 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, and 12, respectively, where the extra contacts in the contact list are contact 11 and contact 12, so that the two contacts are added to the first database, where the extra contact in the first database is contact 1, so that contact 1 is deleted in the first database, and the contact of the application in the adjusted first database is consistent with the contact in the application contact list.

Or, directly adding the extra contacts in the contact list into the first database, so that the adjusted contacts of the application in the first database have the following functions: 1. 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12.

similarly, if the contact of the avatar application is stored in the second database for storing the contact, the second database of the avatar application may be updated irregularly, specifically:

in the running process of the self-body application (for example, when the self-body application is started or in the running process after the self-body application is started), the contact persons of the self-body application stored in the second database are adjusted according to the contact persons in the contact person list of the self-body application, and the specific adjusting process is as follows: and comparing the contact persons in the contact person list of the self-identification application with the contact persons of the self-identification application stored in the second database, and if the comparison result is inconsistent, adding the excessive contact persons in the contact person list into the second database and/or deleting the excessive contact persons in the second database.

For example, there are 10 contacts of a particular avatar application currently stored in the second database, which are contacts 11, 12, 13, 14, 15, 16, 17, 18, 19, 20; there are 8 contacts in the current personal application contact list, which are contacts 12, 13, 14, 15, 16, 17, 18, and 20, respectively, wherein the more contacts in the second database are contact 11 and contact 19, so that the contacts 11 and 19 are deleted in the second database, and the contact of the application in the adjusted second database is consistent with the contact in the application contact list.

According to the method, the first database is adjusted according to the current contact list of the main application in the application running process, so that the first database can be updated, the contacts in the first database can be ensured to be more accurate, the situation that the application is not started due to the fact that the contacts are newly added to the contact list or the situation that the application is started but the operation execution fails due to the fact that the contacts are reduced to the contact list is reduced, and the application is started and the operation execution is more accurate and efficient.

in the embodiment of the present disclosure, there are many results of matching the target contact in the keyword with the contacts of the main application and the personal application, and the starting conditions are different for different matching results:

Taking application a as an example, there are one main application (application a) and two separate applications (application AII, application AIII), where:

The contacts contained in the contact database of application a are: 1-10 of contacts; the contacts contained in the contact database applying the AII are: 10-19 of a contact; the contacts contained in the contact database applying AIII are: contacts 19-28.

Wherein the contact may be determined by a nickname, remark, account number, etc., e.g. representing the contact by a nickname, contact 1 (fairy),.. the contact 10 (popsicle),.. the contact 19 (popsicle),. the contact 20 (late at night),. the contact is identified by a nickname.

in case one, if the contact person of the main application includes the target contact person and the contact person of the self-body-separating application does not include the target contact person, the main application is started.

for example, the voice control command is: and B, making a video call to the fairy through the application A, wherein the target contact person is the fairy, the contact person database of the application A (main application) comprises the target contact person, and the contact person database of the application AII and the contact person database of the application AIII do not comprise the target contact person, so that the application A is started, and the video call is made to the fairy through the application A after the application A is started.

And secondly, if the contact persons of at least one of the body-separating applications comprise the target contact person and the contact persons of the main application do not comprise the target contact person, starting any one of the body-separating applications comprising the target contact person.

For example, the voice control command is: and (3) making a video call to the ice-lolly through the application A, wherein the target contact person is the ice-lolly, the contact person database of the application A does not comprise the target contact person, the contact person database of the application AII and the contact person database of the application AIII comprise the target contact person, so that any one of the application AII and the application AIII can be started, for example, the application AIII is started, and the video call to the ice-lolly is made through the application AIII after the application AIII is started.

And in case that the contact person of the main application and the contact person of the at least one body-separated application comprise the target contact person, starting any one of the main application and the body-separated application comprising the target contact person.

for example, the voice control command is: and (3) making a video call to the ice-lolly through the application A, wherein the target contact is the ice-lolly, the contact database of the application A and the contact database of the application AII comprise the target contact, and the contact database of the application AIII does not comprise the target contact, so that any one of the application AII and the application A can be started, for example, the application AII is started, and the video call to the ice-lolly is made through the application AII after the application AII is started.

And fourthly, if the contact person of the main application and the contact persons of all the separate applications do not comprise the target contact person, starting the main application.

For example, the voice control command is: and if the application A makes a video call to the Xiaoming classmate, the target contact person is the Xiaoming classmate, wherein the contact person database of the application A, the contact person database of the application AII and the contact person database of the application AIII do not comprise the target contact person, so that the application A can be started by default.

in the embodiment of the disclosure, the mode which is not based on user selection improves the operation efficiency, and the user experience is good and more intelligent.

In an optional implementation manner, if the contact of the main application and the contacts of all the separate applications do not include the target contact (which may occur if the target contact is a new contact in the main application or the separate application contact list in general), after the main application is started, corresponding operation is performed on the main application according to the voice control instruction; and if the operation is successfully executed, adding the target contact person into the contact person of the main application.

For example, the voice control command is: sending a message to Xiaoming student through application A, and executing corresponding operation after opening application A, wherein the execution operation is successful in two cases: one means that a samson student is found in an application A (main application), and the content to be generated is input into an application A dialog box, and a user is prompted whether to send the content; the other means that the xiaoming student is found in application a (the main application) and the content to be generated is sent directly to the xiaoming student. After the operation is successfully executed, adding the Xiaoming classmates to the contact of the application A (for example, to a main application contact database of the application A); failure to perform an operation means: the contact is not found in application a (the master application).

As shown in fig. 4A, the schematic diagram that the main application successfully executes the operation and prompts the user provided in the embodiment of the present application shows that the main application of application a is opened, and a xiaominggangzhi is found in the main application, a message "hello" to be sent is input into the dialog box, and whether to send is prompted to the user, if the user selects "yes", the message is sent to the xiaominggangzhi ", and this prompting method requires the user to confirm, and a double confirmation is added before sending the message, so that a situation of a contact search error can be reduced, and the voice operation can be executed more accurately and reliably.

In an optional implementation manner, if the main application operation fails to be executed, one application which is not started is sequentially selected from the body-divided applications of the main application to be started, and corresponding operation is executed on the body-divided application which is started this time according to the voice control instruction; and judging whether the operation is successfully executed. If yes, adding the target contact person into the contact person of the self-body-separating application started at this time; otherwise, judging whether the individual application has an application which is not started, if so, returning to the step of selecting one application which is not started to start in the individual application; otherwise, prompting the user that the execution of the voice control instruction fails.

For example, if the application AII is selected, the application AII is started, a message is sent to the Xiaoming classmate through the application AII, and if the application AII is successfully operated (the Xiaoming classmate is an additional contact of the application AII), the Xiaoming classmate is added into a contact database of the application AII; if the application AII fails to execute the operation, selecting and starting the application AIII, sending a message to Xiaoming classmates through the application AIII, and if the application AIII succeeds in executing the operation (indicating that the Xiaoming classmates are new contacts of the application AIII), adding the Xiaoming classmates into a contact database of the application AIII; and if the AIII is failed to execute the operation, prompting the user that the voice control instruction fails to execute.

as shown in fig. 4B, for a prompting method in a case that both the main application and the avatar application cannot successfully execute the operation, according to the text "sorry", the contact is not found in the application a, and you can only go here "to prompt the user.

alternatively, the prompting method described in fig. 4A and 4B is only one example, and besides, voice prompt may be directly performed to the user.

According to the method, under the condition that the main application and the body-separating application cannot successfully execute the operation, the prompt is given to the user, and the user can be prevented from waiting for time waste all the time.

In an alternative embodiment, if multiple self-body applications exist in an application and the main application of the application is refrigerated or placed in a private space, the target contact in the keyword can be matched with the contacts of the multiple self-body applications by the method, and the started self-body application is determined according to the matching result.

if the contact persons of at least one of the split application comprise the target contact person, starting any one of the split application comprising the target contact person, such as the contact persons applying the BII and the BIII comprise the target contact person, such as starting the application BII, and executing corresponding operation of the voice control instruction through the application BII.

if the target contact person is not included in all the contacts of the split application, randomly starting one split application, for example, randomly starting application BIII, executing corresponding operation of the voice control instruction by using the BIII, and if the execution is successful, adding the target contact person into the contact person to which the BIII is applied; if the execution fails, starting the application BII, executing the operation corresponding to the voice control instruction through the application BII, if the execution succeeds, adding the target contact person into the contact person applying the BII, and if the execution fails, prompting the user that the voice operation execution fails.

In an optional implementation manner, the terminal may further record applications commonly used by the user through learning, and when the voice assistant is started, pop up function buttons commonly used by the user on the voice assistant interface, for example, open application a, send a message to zhang through application a, open application B, and call lie four through application B; the user can enter the application by clicking the button on the interface without speaking by voice, and as shown in fig. 5, the user can directly open the application B to call three by clicking the button of 'calling to lie four through the application B'.

according to the method, the terminal learns the conventional operations of some users, and the users can perform some conventional operations more quickly and conveniently based on some recommendations of the users when the users start voice.

As shown in fig. 6, a complete method for controlling an application by voice according to an embodiment of the present invention includes:

Step 600, the terminal receives a voice control instruction for controlling the third-party application;

601, the terminal analyzes the voice control instruction and determines a keyword in the voice control instruction;

Step 602, the terminal judges whether the application needing to be started in the keyword has the personal application, if so, the step 603 is executed, otherwise, the step 604 is executed;

Step 603, the terminal traverses the contact database of the main application and the contact database of the separate application, and matches a target keyword in the keywords with contacts in the contact database of the main application and the contact database of the separate application;

step 604, the terminal starts the main application and executes corresponding operation to the main application according to the voice control instruction;

Step 605, the terminal judges whether the operation is executed successfully, if so, step 606 is executed, otherwise, step 607 is executed;

step 606, the terminal adds the target contact in the keyword to a contact database of the main application;

step 607, the terminal prompts the user that the execution of the voice control instruction fails;

Step 608, the terminal starts the main application or the individual application according to the matching result;

it should be noted that there may be multiple situations in the matching result in step 608, and the applications started for different matching results are different, and the following description is given by the sub-situations of steps 608 ', 608 "' and 608" ":

step 608', if the contact database of the main application includes the target contact and the contact database of the self-service application does not include the target contact, the terminal starts the main application;

step 608', if the contact database of at least one of the body-separating applications includes the target contact and the contact database of the main application does not include the target contact, the terminal starts any one of the body-separating applications including the target contact;

Step 608' ″, if the contact person database of the main application and the contact person database of the at least one affiliate application comprise the target contact person, the terminal starts any one of the main application and the affiliate application comprising the target contact person;

step 608', if the contact database of the main application and the contact databases of all the separate applications do not include the target contact, the terminal starts the main application.

since the main application does not always have the avatar application, and only the avatar function is not currently turned on, the contact database of the main application may be created in advance. S604 to S606 may be applicable to a case where the new contact is added to the application list, but the contact database of the primary application is not updated, and when the separate application does not exist, the primary application is directly started without traversing the database, and the new target contact is added to the contact database of the primary application after the primary application is successfully executed.

it should be noted that, in steps 608 ', 608 "' and 608" ", no matter whether the main application is started, the avatar application is started, or any one of the main application and the avatar application is started, after the application is started, the corresponding operation is executed on the application started this time according to the voice control instruction, and since the contact database of the started application has the target contact, the corresponding operation is successfully executed in general.

if the contact of the main application and the contacts of all the self-service applications do not include the target contact, the main application is started by default, and after the main application is started, the following steps are further executed, which is specifically shown in fig. 7:

700, the terminal executes corresponding operation on the main application according to the voice control instruction;

step 701, the terminal judges whether the operation is executed successfully, if so, step 702 is executed, otherwise, step 703 is executed;

Step 702, the terminal adds the target contact in the keyword to a contact database of the main application;

Step 703, the terminal selects one application which is not started to start in the split application;

Step 704, the terminal executes corresponding operation on the self-body-divided application started at this time according to the voice control instruction;

step 705, the terminal judges whether the operation is executed successfully, if so, step 706 is executed, otherwise, step 707 is executed;

step 706, the terminal adds the target contact in the keyword to the contact database of the self-identification application started at this time;

Step 707, the terminal determines whether there is any application that is not started in the split application, if yes, the step 703 is returned, otherwise, the step 708 is executed;

step 708, the terminal prompts the user that the execution of the voice control instruction fails.

Based on the same inventive concept, the embodiment of the present invention further provides a terminal for voice control application, and since the terminal is the terminal in the method in the embodiment of the present invention, and the principle of the terminal to solve the problem is similar to the method, the implementation of the terminal may refer to the implementation of the method, and repeated details are not repeated.

As shown in fig. 8, an embodiment of the present invention further provides a terminal for controlling an application by using voice, where the terminal includes: a processor 800, and a memory 801, wherein the memory 801 stores program code that, when executed by the processor 800, causes the terminal to perform the following:

in an alternative embodiment, the contacts of the host application are stored in a first database for storing contacts, and the processor 800 is further configured to determine the contacts of the host application by:

the contacts of the avatar application are stored in a second database for storing contacts, and the processor 800 is further configured to determine the contacts of the avatar application by:

in an alternative embodiment, the processor 800 is specifically configured to:

In an alternative embodiment, if the target contact is not included in the contacts of the main application and the contacts of all the self-service applications, the processor 800 is further configured to:

In an alternative embodiment, the processor 800 is further configured to:

As shown in fig. 9, an embodiment of the present invention further provides a terminal for controlling an application by using voice, where the terminal includes: determination module 900, matching module 901 and start module 902:

The determining module 900 is configured to receive and analyze a voice control instruction, and determine a keyword in the voice control instruction;

the matching module 901 is configured to match a target contact in the keyword with a contact of the main application and a contact of the separate application after the main application and the separate application exist in the application in the keyword;

The starting module 902 is configured to start the main application or the body-separated application according to a matching result.

In an alternative embodiment, the contact of the host application is stored in a first database for storing contacts, and the determining module 900 is further configured to determine the contact of the host application by:

The contact of the avatar application is stored in a second database for storing contacts, and the determining module 900 is further configured to determine the contact of the avatar application by:

in an optional implementation manner, the starting module 902 is specifically configured to:

in an optional implementation manner, if the target contact is not included in the contacts of the main application and the contacts of all the self-service applications, the starting module 902 is further configured to:

in an optional implementation manner, the terminal further includes:

A processing module 903, configured to, if the operation execution fails, sequentially start an un-started one of the split applications, and execute a corresponding operation until the operation execution is successful or the split applications are all started.

as shown in fig. 10, a terminal 1000 for processing an application according to an embodiment of the present disclosure includes: radio Frequency (RF) circuit 1010, power supply 1020, processor 1030, memory 1040, input unit 1050, display unit 1060, camera 1070, communication interface 1080, and WiFi module 1090. Those skilled in the art will appreciate that the configuration of the terminal shown in fig. 10 is not intended to be limiting, and that the terminal provided by the embodiments of the present application may include more or less components than those shown, or some components may be combined, or a different arrangement of components may be provided.

the various components of terminal 1000 are described in detail below with reference to fig. 10:

The RF circuit 1010 may be used for receiving and transmitting data during a communication or conversation. Specifically, the RF circuit 1010 sends downlink data of the base station to the processor 1030 for processing; and in addition, sending the uplink data to be sent to the base station. In general, the RF circuit 1010 includes, but is not limited to, an antenna, at least one Amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like.

In addition, the RF circuit 1010 may also communicate with networks and other terminals through wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to Global System for mobile communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Messaging Service (SMS), and the like.

The WiFi technology belongs to a short-distance wireless transmission technology, and the terminal 1000 may connect to an Access Point (AP) through the WiFi module 1090, thereby implementing Access to a data network. The WiFi module 1090 may be used for receiving and transmitting data during communication.

the terminal 1000 can be physically connected to other terminals through the communication interface 1080. In some embodiments, the communication interface 1080 is connected to a communication interface of the other terminal through a cable, so as to realize data transmission between the terminal 1000 and the other terminal.

In the embodiment of the present application, the terminal 1000 can implement a communication service and send information to other contacts, so that the terminal 1000 needs to have a data transmission function, that is, the terminal 1000 needs to include a communication module inside. Although fig. 10 illustrates communication modules such as the RF circuit 1010, the WiFi module 1090, and the communication interface 1080, it can be understood that at least one of the above components or other communication modules (such as a bluetooth module) for implementing communication exist in the terminal 1000 for data transmission.

For example, when the terminal 1000 is a mobile phone, the terminal 1000 can include the RF circuit 1010 and can further include the WiFi module 1090; when the terminal 1000 is a computer, the terminal 1000 can include the communication interface 1080 and can further include the WiFi module 1090; when the terminal 1000 is a tablet computer, the terminal 1000 can include the WiFi module.

The memory 1040 may be used to store software programs and modules. The processor 1030 executes various functional applications and data processing of the terminal 1000 by executing the software programs and modules stored in the memory 1040, and after the processor 1030 executes the program codes in the memory 1040, part or all of the processes in fig. 1 of the embodiments of the present disclosure can be implemented.

in some embodiments, the memory 1040 may mainly include a program storage area and a data storage area. The storage program area can store an operating system, various application programs (such as communication application), a face recognition module and the like; the storage data area may store data (such as various multimedia files like pictures, video files, etc., and face information templates) created according to the use of the terminal, etc.

Further, the memory 1040 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The input unit 1050 may be used to receive numeric or character information input by a user and generate key signal inputs related to user settings and function control of the terminal 1000.

in some embodiments, the input unit 1050 may include a touch panel 1051 and other input terminals 1052.

The touch panel 1051, also called a touch screen, can collect touch operations of a user (for example, operations of a user on or near the touch panel 1051 by using any suitable object or accessory such as a finger or a stylus) and drive the corresponding connection device according to a preset program. In some embodiments, the touch panel 1051 may include two portions, a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 1030, and can receive and execute commands sent by the processor 1030. In addition, the touch panel 1051 may be implemented by various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave.

in some embodiments, the other input terminals 1052 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

The display unit 1060 may be used to display information input by a user or information provided to the user and various menus of the terminal 1000. The display unit 1060 is a display system of the terminal 1000, and is used for presenting an interface and realizing human-computer interaction.

Further, the touch panel 1051 may cover the display panel 1061, and when the touch panel 1051 detects a touch operation on or near the touch panel 1051, the touch panel 1051 transmits the touch operation to the processor 1030 to determine the type of the touch event, and then the processor 1030 provides a corresponding visual output on the display panel 1061 according to the type of the touch event.

although in FIG. 10, the touch panel 1051 and the display panel 1061 are shown as two separate components to implement the input and output functions of the terminal 1000, in some embodiments, the touch panel 1051 and the display panel 1061 can be integrated to implement the input and output functions of the terminal 1000.

The processor 1030 is a control center of the terminal 1000, connects various components using various interfaces and lines, and performs various functions of the terminal 1000 and processes data by operating or executing software programs and/or modules stored in the memory 1040 and calling data stored in the memory 1040, thereby implementing various services based on the terminal.

In some implementations, the processor 1030 can include one or more processors. In some embodiments, the processor 1030 may integrate an application processor, which handles primarily operating systems, user interfaces, applications, etc., and a modem processor, which handles primarily wireless communications. It is to be appreciated that the modem processor described above may not be integrated into the processor 1030.

the camera 1070 is configured to implement a shooting function of the terminal 1000, and shoot pictures or videos. The camera 1070 can also be used to implement a scanning function of the terminal 1000, and scan a scanned object (two-dimensional code/barcode).

the terminal 1000 can also include a power supply 1020 (e.g., a battery) for powering the various components. In some embodiments, the power supply 1020 may be logically connected to the processor 1030 through a power management system, so that the power management system performs functions of managing charging, discharging, and power consumption.

Although not shown, the terminal 1000 can further include at least one sensor, audio circuit, etc., which are not described herein.

Wherein the memory 1030 may store the same program code as the memory 820, which when executed by the processor 1020, causes the processor 1020 to implement all functions of the processor 810.

an embodiment of the present invention further provides a computer-readable non-volatile storage medium, which includes program code, and when the program code runs on a computing terminal, the program code is configured to enable the computing terminal to execute the steps of the method for controlling a voice application according to the embodiment of the present invention.

The present application is described above with reference to block diagrams and/or flowchart illustrations of methods, apparatus (systems) and/or computer program products according to embodiments of the application. It will be understood that one block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, and/or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer and/or other programmable data processing apparatus, create means for implementing the functions/acts specified in the block diagrams and/or flowchart block or blocks.

Accordingly, the subject application may also be embodied in hardware and/or in software (including firmware, resident software, micro-code, etc.). Furthermore, the present application may take the form of a computer program product on a computer-usable or computer-readable storage medium having computer-usable or computer-readable program code embodied in the medium for use by or in connection with an instruction execution system. In the context of this application, a computer-usable or computer-readable medium may be any medium that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or terminal.

it will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims

1. A method for controlling an application using speech, the method comprising:

2. The method of claim 1, wherein the contacts of the host application are stored in a first database for storing contacts, the contacts of the host application being determined by:

in the running process of the main application, adjusting the contact of the main application stored in the first database according to the contact in the contact list of the main application; and/or

And in the running process of the body-separating application, adjusting the contact persons of the body-separating application stored in the second database according to the contact persons in the contact person list of the body-separating application.

3. The method of claim 1, wherein the launching the primary application or the avatar application based on the matching result comprises:

4. The method of claim 3, wherein if the target contact is not included in the contacts of the host application and the contacts of all of the avatar applications, after launching the host application, further comprising:

5. The method of claim 4, wherein the method further comprises:

6. a terminal for voice-controlled applications, the terminal comprising: a processor, a memory, wherein the memory stores program code that, when executed by the processor, causes the terminal to perform the following:

7. The terminal of claim 6, wherein the contacts of the primary application are stored in a first database for storing contacts, the processor further configured to determine the contacts of the primary application by:

8. the terminal of claim 6, wherein the processor is further specifically configured to:

9. The terminal of claim 8, wherein if the target contact is not included in the contacts of the master application and the contacts of all of the avatar applications, the processor is further configured to:

10. The terminal of claim 9, wherein the processor is further configured to: