CN110597480B

CN110597480B - Custom voice instruction implementation method and terminal

Info

Publication number: CN110597480B
Application number: CN201910883587.8A
Authority: CN
Inventors: 赵云; 李凯; 王德中; 王明宇
Original assignee: Hisense Mobile Communications Technology Co Ltd
Current assignee: Hisense Mobile Communications Technology Co Ltd
Priority date: 2019-09-18
Filing date: 2019-09-18
Publication date: 2023-08-11
Anticipated expiration: 2039-09-18
Also published as: CN110597480A

Abstract

The application discloses a custom voice instruction implementation method and a terminal, relates to the field of voice assistants, and aims to solve the problem that in the prior art, the use of the voice assistants is complex in operation. The method comprises the following steps: collecting voice input by a user through a microphone, and recognizing the voice input by the user; if a corresponding voice instruction is selected from preset voice instructions according to the recognition result, determining an instruction set corresponding to the selected voice instruction according to the corresponding relation between the voice instruction and the instruction set; wherein the instruction set comprises at least two instructions; executing instructions in the instruction set. After recognizing that the voice input by the user is a preset voice command, executing the command in the command set corresponding to the voice command. Therefore, the user can execute a plurality of instructions by inputting the voice instruction once, so that the user wants to complete things, the operation of the user is simplified, and the use experience of the user is improved.

Description

Custom voice instruction implementation method and terminal

Technical Field

The application relates to the field of voice assistants, in particular to a custom voice instruction implementation method and a terminal.

Background

The voice assistant is a function of the intelligent terminal, and can receive voice input by a user and help the user execute instructions to be completed by the voice. If the user downloads more application software in the terminal, when the user wants to use the application software, the user needs to find the application software which the user wants to use from the downloaded application software, which is very time-consuming. When the application software is found by the voice assistant, the terminal can automatically find the application software only by inputting the voice corresponding to the application software, so that the operation of a user is simplified.

However, in many situations, the user needs to input the instruction to the voice assistant multiple times to realize what the user wants to do, so in the prior art, the use of the voice assistant has a problem of complex operation.

Disclosure of Invention

The application provides a custom voice instruction implementation method and a terminal, which are used for solving the problem of complex operation in the use of a voice assistant in the prior art.

In a first aspect, an embodiment of the present application provides a method for implementing a custom voice command, where the method includes:

collecting voice input by a user through a microphone, and recognizing the voice input by the user;

If a corresponding voice instruction is selected from preset voice instructions according to the recognition result, determining an instruction set corresponding to the selected voice instruction according to the corresponding relation between the voice instruction and the instruction set; wherein the instruction set comprises at least two instructions;

executing instructions in the instruction set.

After recognizing that the voice input by the user is a preset voice command, executing the command in the command set corresponding to the voice command. Therefore, the user can execute a plurality of instructions by inputting the voice instruction once, so that the user wants to complete things, the operation of the user is simplified, and the use experience of the user is improved.

In one possible implementation, the correspondence between the voice command and the command set is established by:

responding to an instruction for establishing the corresponding relation between the voice instruction and the instruction set, and taking information input by a user as the voice instruction; a kind of electronic device with high-pressure air-conditioning system;

and taking at least two instructions selected by a user from a preset instruction set and/or a custom instruction set as an instruction set corresponding to the voice instruction.

According to the method, the voice command and the command set corresponding to the voice command are input by the user, so that the voice assistant is more in line with the use habit of the user. Simultaneously, the user selects the voice command and the command set corresponding to the voice command, so that the user can realize the things which the user wants to complete through one voice command.

In one possible implementation manner, the selecting, according to the recognition result, a corresponding voice command from preset voice commands includes:

determining characteristic information of the voice according to the recognition result;

matching the similarity between the characteristic information of the voice and a preset voice instruction;

and taking the voice command with the similarity larger than a preset threshold value as the voice command corresponding to the recognition result.

According to the method, the voice instruction is determined by matching the similarity between the characteristic information of the voice input by the user and the preset voice instruction. Therefore, even if the voice input by the user is not identical with the preset voice command, the voice of the user can be still recognized, so that the voice input by the user is not required to be high, the voice recognition is more humanized, and the user experience is improved.

In one possible implementation, the method further includes:

responding to an editing instruction of a user, and editing a voice instruction specified by the editing instruction and/or an instruction set specified by the editing instruction; and/or;

and deleting the voice command designated by the deleting command and the command set corresponding to the voice command in response to the deleting command of the user.

According to the method, the user can edit or delete the voice command and the command set corresponding to the voice command, so that the preset voice command and the command set corresponding to the voice command are more in line with the requirements of the user, and the things to be completed by the user are realized.

In one possible implementation, the executing the instructions in the instruction set includes:

and executing the instructions in the instruction set sequentially according to the order of the instructions in the instruction set.

By the method, the instructions in the instruction set are executed sequentially, so that things to be completed by a user can be accurately completed, and the accuracy of a completion event is ensured.

In one possible implementation manner, the sequentially executing the instructions in the instruction set according to the order of the instructions in the instruction set includes:

checking whether the operation corresponding to the next instruction is mutually influenced with the operation being executed or not after the operation corresponding to the instruction is executed according to the sequence of the instructions in the instruction set;

if the operation corresponding to the next instruction and the operation being executed are mutually influenced, and the priority of the operation corresponding to the next instruction is lower than that of the operation being executed, waiting for the operation corresponding to the next instruction to be executed after the operation being executed is completed;

If the operation corresponding to the next instruction and the operation being executed are mutually influenced, and the priority of the operation corresponding to the next instruction is higher than that of the operation being executed, interrupting the operation being executed, executing the operation corresponding to the next instruction, and recovering the interrupted operation after the operation corresponding to the next instruction is completed;

if the operation corresponding to the next instruction and the operation being executed are mutually influenced, and the priority of the operation corresponding to the next instruction is equal to the priority of the operation being executed, the operation being executed is stopped, and the operation corresponding to the next instruction is executed;

if the operation corresponding to the next instruction interacts with the operation being performed, the operation corresponding to the next instruction is performed.

According to the method, whether the instructions in the instruction set are mutually influenced or not is judged to execute the corresponding operation, and the instructions in the instruction set can be completed in sequence while the operation corresponding to the instructions is accurately executed.

In one possible implementation, if the operations corresponding to the two instructions cannot be executed simultaneously, it is determined that the operations corresponding to the two instructions affect each other.

The method determines whether operations of two instructions affect each other by determining whether operations corresponding to the two instructions can be executed simultaneously, thereby determining how to execute the instructions in the instruction set in sequence.

In a second aspect, an embodiment of the present application provides a customized voice command implementation terminal, including: a processor, a memory, and a camera, wherein the memory stores program code that, when executed by the processor, causes the terminal to perform the following:

executing instructions in the instruction set.

In one possible implementation, the processor is specifically configured to:

In one possible implementation manner, the terminal further includes:

In one possible implementation, the processor is specifically configured to:

In a third aspect, an embodiment of the present application further provides a terminal for implementing a customized voice command, where the terminal includes an identification module, a determining instruction set module, and an execution module:

the recognition module is used for collecting the voice input by the user through the microphone and recognizing the voice input by the user;

The instruction set determining module is used for determining an instruction set corresponding to the selected voice instruction according to the corresponding relation between the voice instruction and the instruction set if the corresponding voice instruction is selected from preset voice instructions according to the recognition result; wherein the instruction set comprises at least two instructions;

and the execution module is used for executing the instructions in the instruction set.

In one possible implementation, the correspondence between the voice command and the command set is established by the following modules:

the response module is used for responding to the instruction for establishing the corresponding relation between the voice instruction and the instruction set and taking the information input by the user as the voice instruction; a kind of electronic device with high-pressure air-conditioning system;

and the selection module is used for taking at least two instructions selected by a user from a preset instruction set and/or a custom instruction set as an instruction set corresponding to the voice instruction.

In one possible implementation, determining the instruction set module includes:

a feature information determining unit for determining feature information of the voice according to the recognition result;

the matching unit is used for matching the similarity between the characteristic information of the voice and a preset voice instruction;

and the voice instruction determining unit is used for taking the voice instruction with the similarity larger than a preset threshold value as the voice instruction corresponding to the recognition result.

In one possible implementation manner, the terminal further includes:

the editing module is used for responding to an editing instruction of a user and editing a voice instruction specified by the editing instruction and/or an instruction set specified by the editing instruction; and/or;

and the deleting module is used for responding to the deleting instruction of the user and deleting the voice instruction designated by the deleting instruction and the instruction set corresponding to the voice instruction.

In one possible implementation, the execution module includes:

and the sequential execution unit is used for sequentially executing the instructions in the instruction set according to the order of the instructions in the instruction set.

In one possible implementation, the sequential execution element includes:

the interaction sub-unit is used for checking whether the operation corresponding to the next instruction interacts with the executing operation or not after executing the operation corresponding to the instruction according to the sequence of the instructions in the instruction set;

a first interaction subunit, configured to, if an operation corresponding to a next instruction interacts with an operation being executed and a priority of the operation corresponding to the next instruction is lower than a priority of the operation being executed, wait for the operation corresponding to the next instruction to be executed after the operation being executed is completed;

A second interaction subunit, configured to interrupt the operation being executed if the operation corresponding to the next instruction interacts with the operation being executed and the priority of the operation corresponding to the next instruction is higher than the priority of the operation being executed, and execute the operation corresponding to the next instruction, and resume the interrupted operation after the operation corresponding to the next instruction is completed;

a third interaction subunit, configured to, if the operation corresponding to the next instruction interacts with the operation being executed and the priority of the operation corresponding to the next instruction is equal to the priority of the operation being executed, suspend the operation being executed and execute the operation corresponding to the next instruction;

and the non-interaction subunit is used for executing the operation corresponding to the next instruction if the operation corresponding to the next instruction interacts with the operation being executed.

In a fourth aspect, the present application also provides a computer storage medium having stored thereon a computer program which when executed by a processor performs the steps of the method of the first aspect.

In addition, the technical effects caused by any implementation manner of the second aspect to the third aspect may refer to the technical effects caused by different implementation manners of the first aspect, which are not described herein.

Additional features and advantages of the application will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the application. The objectives and other advantages of the application will be realized and attained by the structure particularly pointed out in the written description and claims thereof as well as the appended drawings.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly described below, it will be apparent that the drawings in the following description are only some embodiments of the present application, and that other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a flowchart for establishing a correspondence between a voice command and a command set according to an embodiment of the present application;

FIG. 2 is a schematic diagram of an input voice command window according to an embodiment of the present application;

FIG. 3 is a schematic diagram of a default instruction set according to an embodiment of the present application;

FIG. 4 is a diagram illustrating a custom instruction set according to an embodiment of the present application;

FIG. 5 is a schematic diagram of a response instruction according to an embodiment of the present application;

FIG. 6 is a schematic diagram of an operation instruction according to an embodiment of the present application;

FIG. 7 is a schematic diagram of establishing a correspondence between a voice command and a command set according to an embodiment of the present application;

FIG. 8 is a schematic diagram of a correspondence relationship between a voice command and a command set after selecting a command according to an embodiment of the present application;

FIG. 9 is a schematic diagram of an established correspondence provided by an embodiment of the present application;

FIG. 10 is a flowchart of a method for implementing a custom voice command according to an embodiment of the present application;

FIG. 11 is a flowchart illustrating an instruction in an execution instruction set according to an embodiment of the present application;

fig. 12 is a schematic diagram of a terminal of a first processing application according to an embodiment of the present application;

fig. 13 is a schematic diagram of a terminal of a second processing application according to an embodiment of the present application;

fig. 14 is a schematic diagram of a terminal of a third processing application according to an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be described in further detail below with reference to the accompanying drawings, and it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.

Some words appearing hereinafter are explained:

1. in the embodiment of the application, the term "and/or" describes the association relation of the association objects, which means that three relations can exist, for example, a and/or B can be expressed as follows: a exists alone, A and B exist together, and B exists alone. The character "/" generally indicates that the context-dependent object is an "or" relationship.

2. The term "terminal" in the embodiments of the present application refers to a computer device that may be used in mobile, i.e. a mobile phone, a tablet, etc.

The application scenario described in the embodiment of the present application is for more clearly describing the technical solution of the embodiment of the present application, and does not constitute a limitation on the technical solution provided by the embodiment of the present application, and as a person of ordinary skill in the art can know that the technical solution provided by the embodiment of the present application is applicable to similar technical problems as the new application scenario appears. In the description of the present application, unless otherwise indicated, the meaning of "a plurality" is two or more.

In order to better understand the technical scheme provided by the embodiment of the application, the following is a simple description of the basic principle of the scheme:

voice is becoming more and more interesting as a new interactive technology, and one of the most important development directions is to help users to use mobile phones more conveniently and rapidly by means of voice. In particular, the current smart phones have more and more functions, and more application software is downloaded by users, so that sometimes, it takes tens of seconds to find an application from a desktop or find a function from a setting, even if some functions cannot be found at all by users because the entrance is too deep. The voice assistant provides an operation mode of direct function, and only one or two seconds are needed for opening application software, operating functions and the like through the voice assistant, so that the operation of a user is greatly simplified.

However, at present, a technical problem with using a voice assistant is that a user inputs a voice command, and a terminal performs a certain task according to the voice command input by the user. For example: the voice command input by the user is as follows: the terminal tells the current time to the user in a voice broadcasting mode; if the voice command input by the user is: if music is played, the terminal opens music application software to play the music; if the voice command input by the user is: and closing the alarm clock, and closing the alarm clock by the terminal. In many scenarios, however, the user needs to input instructions to the voice assistant multiple times to achieve what the user wants to do, for example: when the user goes home from work, he/she wants to navigate to determine the home-returning route, and informs the home of the home-coming time, and plays music while on the road. If the user wants to complete the requirements, the user needs to input three instructions of 'navigation home', 'call home' and 'play music' to the terminal, so that the user can complete the requirements, and the user operation is complex.

In view of this, the present application provides a method for implementing a customized voice command, in which a user firstly sets and stores a voice command and an operation set corresponding to the voice command according to his own needs. Thus, when the user wants to complete the own requirement, the stored voice command is input to the terminal, and after recognizing that the voice input by the user is the preset voice command, the terminal executes the command in the command set corresponding to the voice command. Therefore, the user can execute a plurality of instructions by inputting the voice instruction once, so that the user wants to complete things, the operation of the user is simplified, and the use experience of the user is improved.

With respect to the above-mentioned scenario, embodiments of the present application are described in further detail below with reference to the accompanying drawings.

In the embodiment of the application, the implementation method of the custom voice command can be divided into two parts, including a setting part and an executing part. The setting part is used for setting the voice command and the command executed in the command set corresponding to the voice command; the executing section is used for recognizing the voice of the user and executing the instruction in the instruction set corresponding to the voice instruction according to the recognized voice instruction, and the setting section and the executing section are respectively described below.

1. The setting part:

in the embodiment of the present application, in order to achieve the needs of the user, the user needs to set a voice command and an operation set corresponding to the voice command, as shown in fig. 1, which is a flow chart for establishing a correspondence between the voice command and the command set, and includes the following steps:

step 101: responding to the instruction for establishing the corresponding relation between the voice instruction and the instruction set, and taking the information input by the user as the voice instruction.

In the embodiment of the application, the user can input voice information, and can also input text information as voice instructions through typing. As shown in fig. 2, a schematic diagram of an input voice command window is shown. Wherein, a voice command is input in the input field of "i say".

Step 102: and taking at least two instructions selected by a user from a preset instruction set and/or a custom instruction set as an instruction set corresponding to the voice instruction.

In an embodiment of the present application, the instruction set includes a preset instruction set and a custom instruction set. The preset instruction set is an instruction stored in advance by the terminal, and the user-defined instruction set is an instruction set by a user. The user selects the instruction needed by the user from the preset instruction set and the user-defined instruction set, and correspondingly stores the instruction and the input voice instruction, so that the corresponding relation between the voice instruction and the instruction set is established. As shown in fig. 3, it is a schematic diagram of a preset instruction set, where a user selects an instruction that the user needs by clicking an instruction in the preset instruction set, that is, the user clicks an instruction of "broadcast date and time", so as to determine to use the instruction.

In the embodiment of the present application, the user sets the instructions in the custom instruction set by means of a screen recording, as shown in fig. 4, which is a schematic diagram of the custom instruction set, and if the user completes the custom instruction, the instructions are displayed in the custom instruction set, as "instruction 1" in the figure. In a specific operation, the user clicks the adding instruction ("+" in fig. 4), the terminal starts recording the operation of the user, the operation executed by the user on the terminal is recorded by the terminal, and when the user clicks the finishing instruction, the recording and the storing are finished. For example: if the user 1 wants to send the information of 'I get home' to the user 2 through the communication application software, after clicking the adding instruction, the terminal will display the desktop state, the user 1 opens the communication application software, searches the name of the user 2 in the communication application software, and finally sends the information of 'I get home' to the user 2, and clicks the finishing instruction. Thus, the user-defined instruction is completed, the terminal records the operation of the user and repeatedly executes the operation completed by the user during recording. Thus, even if no instruction is needed by the user in the operation instruction preset by the terminal, the user can complete the operation which the user wants to complete through the custom instruction. Of course, the application can edit the custom instruction name, so that the operation completed by the custom instruction can be known according to the name of the instruction.

In an embodiment of the present application, the instructions in the instruction set include response instructions and operation instructions. The response instruction is a voice output by the terminal according to a voice instruction input by a user, for example: "good morning", "evening", etc. respond to the user's utterance. And the operation instruction is an operation performed according to a voice instruction input by the user, for example: operations such as "open application software", "broadcast date and time", etc. In order to refine the instruction, the response instruction and the operation instruction are classified, as shown in fig. 5, which is a schematic diagram of the response instruction, where there is a response instruction preset by the terminal, for example: "good morning, good day started", click the microphone in the response instruction, and can listen on trial. Of course, the response command may be added by clicking the add command ("+" in fig. 5), and the voice input may be performed by typing or by clicking a microphone in the add command. The instruction may also be deleted by clicking on the delete after instruction ("-" in FIG. 5). If multiple response instructions are selected, one of the multiple response instructions can be randomly selected for playing when the instructions are executed, and the multiple response instructions can be played in sequence according to the selected sequence. As shown in fig. 6, the operation instruction is a schematic diagram of an operation instruction, where the instruction in the operation instruction is an instruction preset by the terminal, for example: "broadcast weather", "make a call", etc., and the instruction in the operation instruction cannot be added or deleted.

As shown in fig. 7, which is a schematic diagram for establishing a correspondence between a voice command and a command set, an input voice command window is displayed above, through which a voice command is set; the lower part is a selection instruction, which is respectively a personality reply (a response instruction), an official skill (a preset operation instruction) and a teaching instruction (a custom operation instruction). By clicking on each instruction set, the appropriate instruction is selected. As shown in fig. 8, the correspondence between the voice command and the command set after the command is selected is shown. Wherein, the voice instruction is arranged above, the instruction set corresponding to the voice instruction is arranged in the middle, and the selection instruction is arranged below. The correspondence is saved by saving. In fig. 8, the voice command is set to "morning good", and the selected command set is the response command "morning good", the good day starts, the operation command "broadcast date and time", and the custom command "command 1". Thus, when recognizing that the user inputs a voice command of "morning good", the corresponding command set, i.e., "morning good, good day started", "broadcast date and time", and "command 1" is executed.

The execution order of steps 101 and 102 is not limited. That is, the voice command may be input first, or the command may be selected first. Therefore, the voice assistant can be more in line with the use habit of the user by the user inputting the voice command and the command set corresponding to the voice command. Simultaneously, the user selects the voice command and the command set corresponding to the voice command, so that the user can realize the things which the user wants to complete through one voice command.

In the embodiment of the application, besides establishing the corresponding relation between the voice command and the command set, the established corresponding relation can be modified or deleted. If the user selects one of the established corresponding relations to modify, the terminal responds to an editing instruction of the user and edits the voice instruction specified by the editing instruction and/or the instruction set specified by the editing instruction. If the user wants to delete one of the established corresponding relations, the terminal responds to a deleting instruction of the user, and deletes the voice instruction designated by the deleting instruction and the instruction set corresponding to the voice instruction.

As shown in fig. 9, which is a schematic diagram of an established correspondence, if the user clicks "add" in the first correspondence, the user enters an editing state, where the editing state is shown in fig. 8, the user may modify a voice command, add or delete a command in the command set, and may also adjust the sequence of the commands in the command set by clicking an icon for adjusting the sequence. If the user presses the first corresponding relation for a long time, the deleting state is carried out, and if the user clicks the deleting state, the first corresponding relation is deleted.

Therefore, the user can edit or delete the voice command and the command set corresponding to the voice command, so that the preset voice command and the command set corresponding to the voice command are more in line with the requirements of the user, and the things to be completed by the user are realized.

2. The execution part:

in the embodiment of the application, after the corresponding relation between the voice command and the command set is set, the command in the operation set corresponding to the voice command can be executed through the voice command input by the user. As shown in fig. 10, the method specifically comprises the following steps:

step 1001: the voice input by the user is collected through the microphone, and the voice input by the user is recognized.

Step 1002: if a corresponding voice instruction is selected from preset voice instructions according to the recognition result, determining an instruction set corresponding to the selected voice instruction according to the corresponding relation between the voice instruction and the instruction set; wherein the instruction set comprises at least two instructions.

Step 1003: executing instructions in the instruction set.

In the embodiment of the application, in order to accurately complete the things to be completed by the user, the accuracy of the completion event is ensured, and when the instructions in the set are executed, the instructions are executed according to the order of the instructions in the corresponding relation, and the method can be concretely implemented as follows: and executing the instructions in the instruction set sequentially according to the order of the instructions in the instruction set.

In the embodiment of the present application, when executing the instructions in the instruction set, if the operations corresponding to the instructions in the instruction set affect each other, each instruction is executed according to the priority of the operation corresponding to each instruction. The method can be concretely implemented as steps A1-A5:

step A1: and checking whether the operation corresponding to the next instruction is mutually influenced with the operation being executed or not after the operation corresponding to the instruction is executed according to the order of the instructions in the instruction set.

In the embodiment of the application, whether the operations corresponding to the two instructions mutually affect can be determined according to whether the operations corresponding to the instructions can be executed simultaneously. The method can be concretely implemented as follows: if the operations corresponding to the two instructions cannot be executed simultaneously, determining that the operations corresponding to the two instructions are mutually influenced.

In one embodiment, if the operations corresponding to the two instructions occupy audio or are both video, then it is determined that the operations corresponding to the two instructions affect each other. Such as: one instruction corresponds to an operation of playing a song, the other instruction corresponds to an operation of replying by voice, and the two instructions both need to use a microphone to occupy an audio channel, so that the operations corresponding to the two instructions mutually affect.

Step A2: if the operation corresponding to the next instruction interacts with the operation being executed and the priority of the operation corresponding to the next instruction is lower than the priority of the operation being executed, the operation corresponding to the next instruction is executed after the operation being executed is completed.

In the embodiment of the present application, the priority of the operation corresponding to each instruction is preset, and of course, the priority of the operation may also be modified according to specific situations, which is not limited in the present application.

In one embodiment, if there are 2 instructions in the instruction set, instruction 1 and instruction 2, respectively. If the operation corresponding to the instruction 1 and the operation corresponding to the instruction 2 are mutually affected and the priority of the instruction 1 is high, no other operation is executed when the operation corresponding to the instruction 1 is executed, and after the execution of the operation corresponding to the instruction 1 is completed, the operation corresponding to the instruction 2 is executed.

For example: the instructions in the instruction set are respectively a response instruction of broadcasting date and time and an operation instruction of broadcasting songs. When the terminal executes the instruction in the instruction set, firstly executing the response instruction broadcast date and time, judging whether the response instruction broadcast date and time and the operation instruction broadcast song are mutually influenced, judging the priority of the two instruction operations after determining that the two instruction operations are mutually influenced, and continuously executing the response instruction broadcast date and time when determining that the priority of the response instruction broadcast date and time is higher than the priority of the operation instruction broadcast song, and executing the operation instruction broadcast song after the execution of the response instruction broadcast date and time is completed.

Step A3: if the operation corresponding to the next instruction and the operation being executed are mutually influenced, and the priority of the operation corresponding to the next instruction is higher than that of the operation being executed, interrupting the operation being executed, executing the operation corresponding to the next instruction, and recovering the interrupted operation after the operation corresponding to the next instruction is completed.

In one embodiment, if there are 2 instructions in the instruction set, instruction 1 and instruction 2, respectively. If the operation corresponding to the instruction 1 and the operation corresponding to the instruction 2 are mutually affected and the priority of the instruction 2 is high, when the operation corresponding to the instruction 1 is executed, the operation corresponding to the instruction 1 is interrupted and the operation corresponding to the instruction 2 is executed, and after the operation corresponding to the instruction 2 is executed, the operation of the instruction 1 is resumed to be executed continuously.

For example: the instructions in the instruction set are an operation instruction of playing songs and a response instruction of broadcasting date and time respectively. When the terminal executes the instruction in the instruction set, firstly executing the operation instruction 'play song', judging whether the response instruction 'play date and time' and the operation instruction 'play song' are mutually influenced, judging the priority of the two instruction operations after confirming that the two instruction operations are mutually influenced, stopping executing the operation instruction 'play song' when confirming that the priority of the response instruction 'play date and time' is higher than the priority of the operation instruction 'play song', executing the response instruction 'play song', and continuing executing the operation instruction 'play song' after the execution of the response instruction 'play date and time' is completed.

Step A4: if the operation corresponding to the next instruction interacts with the operation being executed and the priority of the operation corresponding to the next instruction is equal to the priority of the operation being executed, the operation being executed is aborted and the operation corresponding to the next instruction is executed.

In one embodiment, if there are 2 instructions in the instruction set, instruction 1 and instruction 2, respectively. If the operation corresponding to the instruction 1 and the operation corresponding to the instruction 2 are mutually affected and the priorities of the instruction 1 and the instruction 2 are the same, when the operation corresponding to the instruction 1 is executed, the operation corresponding to the instruction 1 is suspended and the operation corresponding to the instruction 2 is executed.

For example: the instructions in the instruction set are an operation instruction of "play song 1" and an operation instruction of "play song 2", respectively. When the terminal executes the instructions in the instruction set, firstly executing the operation instruction 'play song 1', judging whether the operation instruction 'play song 1' and the operation instruction 'play song 2' are mutually influenced, judging the priority of the two instruction operations after determining that the two instruction operations are mutually influenced, and stopping playing song 1 and playing song 2 after determining that the priority of the two operation instructions is the same.

Step A5: if the operation corresponding to the next instruction interacts with the operation being performed, the operation corresponding to the next instruction is performed.

In one embodiment, if there are 2 instructions in the instruction set, instruction 1 and instruction 2, respectively. If the operation corresponding to the instruction 1 and the operation corresponding to the instruction 2 do not affect each other, the operation of the instruction 2 is executed simultaneously when the operation corresponding to the instruction 1 is executed.

For example: the instructions in the instruction set are an operation instruction of 'play song' and an operation instruction of 'open communication application software', respectively. When the terminal executes the instructions in the instruction set, firstly executing the operation instruction 'play song', judging whether the operation instruction 'play song' and the operation instruction 'open communication application software' are mutually influenced, and executing the operation instruction 'open communication application software' after determining that the two instruction operations are not mutually influenced.

It should be noted that, steps A2-A5 are different situations occurring in the implementation of the present application, and the execution sequence is not limited.

As shown in fig. 11, which is a flowchart of executing instructions in an instruction set. Wherein, instruction 1 and instruction 2 are shared in the instruction set. The execution steps are as follows:

Step 1101: instruction 1 is executed.

Step 1102: judging whether the instruction 2 and the instruction 1 affect each other; if yes, go to step 1103; if not, step 1107 is performed.

Step 1103: judging the priority of the instruction 2 and the instruction 1; if the priority of instruction 1 is higher than the priority of instruction 2, then step 1104 is performed; if the priority of instruction 1 is lower than the priority of instruction 2, then step 1106 is performed; if the priority of instruction 1 is the same as the priority of instruction 2, then step 1105 is performed.

Step 1104: after waiting for execution of the completion instruction 1, the instruction 2 is executed.

Step 1105: execution of instruction 1 is terminated and instruction 2 is executed.

Step 1106: interrupt execution of instruction 1 and execute instruction 2, wait for execution of completion instruction 2, and continue instruction 1.

Step 1107: instruction 2 is executed simultaneously.

In one embodiment, if there are 4 instructions in the instruction set, instruction 1, instruction 2, instruction 3, and instruction 4, respectively. The operation corresponding to the instruction 1 and the operation corresponding to the instruction 2 do not affect each other, the operation corresponding to the instruction 1, the operation corresponding to the instruction 3 and the operation corresponding to the instruction 4 affect each other, the priority of the instruction 1 is higher than the priorities of the instruction 3 and the instruction 4, and the priority of the instruction 3 is the same as the priority of the instruction 4. When executing the instructions in the instruction set, the terminal firstly executes the instruction 1, judges whether the instruction 2 and the instruction 1 are mutually influenced, and executes the instruction 2 simultaneously after determining that the instructions are not mutually influenced; judging whether the instruction 3 is mutually influenced by the instruction 1 and the instruction 2, determining that the instruction 3 is mutually influenced by the instruction 1, judging the priority of the instruction 3 and the instruction 1, determining that the priority of the instruction 3 is lower than the priority of the instruction 1, and executing the instruction 3 after the execution of the instruction 1 is completed; judging whether the instruction 4 is mutually influenced by the instruction 2 and the instruction 3, determining that the instruction 3 is mutually influenced by the instruction 4, judging the priority of the instruction 3 and the instruction 4, determining that the priority of the instruction 3 is the same as the priority of the instruction 4, terminating executing the instruction 3 and executing the instruction 4.

In this way, by judging whether the instructions in the instruction set are mutually influenced or not to execute the corresponding operation, the instructions in the instruction set can be completed in sequence while the operation corresponding to the instruction is accurately executed.

The method for implementing the customized voice command is described above, and the following further describes how to determine the voice input by the user as the preset voice command, which may be implemented in steps B1-B3:

step B1: and determining the characteristic information of the voice according to the recognition result.

Step B2: and matching the similarity between the characteristic information of the voice and a preset voice instruction.

Step B3: and taking the voice command with the similarity larger than a preset threshold value as the voice command corresponding to the recognition result.

In the embodiment of the application, if the voice input by the user is 'I get home soon', the characteristic information of the voice is determined to be 'get home'. And matching the 'home-returning' with a preset voice instruction, and if the matching degree of the 'navigation home-returning' in the voice instruction is larger than a preset threshold value, taking the 'navigation home-returning' as the voice instruction corresponding to the 'home-returning'.

In the embodiment of the application, if the matching degree of the recognition result and the plurality of voice instructions is greater than the preset threshold, the voice instruction with the highest matching degree is taken as the voice instruction corresponding to the recognition result.

In the embodiment of the application, if the voice command corresponding to the command in the execution command set is the same as the voice command for executing only one command, the voice command corresponding to the command in the execution command set is selected for executing the operation.

Thus, the voice command is determined by performing similarity matching on the feature information of the voice input by the user and the preset voice command. Therefore, even if the voice input by the user is not identical with the preset voice command, the voice of the user can be still recognized, so that the voice input by the user is not required to be high, the voice recognition is more humanized, and the user experience is improved.

As shown in fig. 12, an embodiment of the present application provides a terminal for implementing a customized voice command, where the terminal includes: a processor 1210, and a memory 1220, wherein the memory 1220 stores program code which, when executed by the processor 1210, causes the terminal to perform the following process:

Executing instructions in the instruction set.

Optionally, the processor 1210 is specifically configured to:

responding to an instruction for establishing the corresponding relation between the voice instruction and the instruction set, and taking information input by a user as the voice instruction; the method comprises the steps of,

Optionally, the processor 1210 is specifically configured to:

Optionally, the terminal further includes:

responding to an editing instruction of a user, and editing a voice instruction specified by the editing instruction and/or an instruction set specified by the editing instruction; and/or the number of the groups of groups,

Optionally, the processor 1210 is specifically configured to:

Optionally, if the operations corresponding to the two instructions cannot be executed simultaneously, it is determined that the operations corresponding to the two instructions affect each other.

As shown in fig. 13, the embodiment of the present application further provides a customized voice command implementation terminal, where the terminal includes an identification module 1301, a determining command set module 1302, and an execution module 1303:

the recognition module 1301 is configured to collect a voice input by a user through a microphone, and recognize the voice input by the user;

the determining instruction set module 1302 is configured to determine, if a corresponding voice instruction is selected from preset voice instructions according to the recognition result, an instruction set corresponding to the selected voice instruction according to a correspondence between the voice instruction and the instruction set; wherein the instruction set comprises at least two instructions;

the execution module 1303 is configured to execute an instruction in the instruction set.

the response module is used for responding to the instruction for establishing the corresponding relation between the voice instruction and the instruction set and taking the information input by the user as the voice instruction; the method comprises the steps of,

In one possible implementation, the determine instruction set module 1302 includes:

In one possible implementation manner, the terminal further includes:

the editing module is used for responding to an editing instruction of a user and editing a voice instruction specified by the editing instruction and/or an instruction set specified by the editing instruction; and/or the number of the groups of groups,

In one possible implementation, the executing module 1303 includes:

In one possible implementation, the sequential execution element includes:

As shown in fig. 14, an embodiment of the present disclosure provides a customized voice command implementation terminal 1400 including: radio Frequency (RF) circuitry 1410, a power supply 1420, a processor 1430, a memory 1440, an input unit 1450, a display unit 1460, a camera 1470, a communication interface 1480, and a WiFi module 1490. It will be appreciated by those skilled in the art that the structure of the terminal shown in fig. 14 is not limiting of the terminal, and that the terminal provided by the embodiments of the present application may include more or less components than those illustrated, or may combine some components, or may be arranged in different components.

The following describes the components of the terminal 1400 in detail with reference to fig. 14:

the RF circuitry 1410 may be used for receiving and transmitting data during a communication or session. Specifically, the RF circuit 1410 receives downlink data of a base station and sends the downlink data to the processor 1430 for processing; in addition, uplink data to be transmitted is transmitted to the base station. Typically, the RF circuitry 1410 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (Low Noise Amplifier, LNA), a duplexer, and the like.

In addition, the RF circuit 1410 may also communicate with networks and other terminals through wireless communication. The wireless communication may use any communication standard or protocol including, but not limited to, global system for mobile communications (Global System of Mobile communication, GSM), general packet radio service (General Packet Radio Service, GPRS), code division multiple access (Code Division Multiple Access, CDMA), wideband code division multiple access (Wideband Code Division Multiple Access, WCDMA), long term evolution (Long Term Evolution, LTE), email, short message service (Short Messaging Service, SMS), and the like.

The WiFi technology belongs to a short-distance wireless transmission technology, and the terminal 1400 may be connected to an Access Point (AP) through a WiFi module 1490, so as to implement Access to a data network. The WiFi module 1490 may be used for receiving and transmitting data during a communication process.

The terminal 1400 may be physically connected to other terminals through the communication interface 1480. In some embodiments, the communication interface 1480 is connected to the communication interface of the other terminal through a cable, so as to implement data transmission between the terminal 1400 and the other terminal.

Since the terminal 1400 is capable of implementing a communication service and transmitting information to other contacts in the embodiment of the present application, the terminal 1400 needs to have a data transmission function, that is, the terminal 1400 needs to include a communication module inside. While fig. 14 shows communication modules such as the RF circuit 1410, the WiFi module 1490, and the communication interface 1480, it is to be understood that at least one of the foregoing components or other communication modules (e.g., bluetooth modules) for enabling communication are present in the terminal 1400 for data transmission.

For example, when the terminal 1400 is a mobile phone, the terminal 1400 may include the RF circuit 1410 and may further include the WiFi module 1490; when the terminal 1400 is a computer, the terminal 1400 may include the communication interface 1480 and may also include the WiFi module 1490; when the terminal 1400 is a tablet computer, the terminal 1400 may include the WiFi module.

The memory 1440 may be used to store software programs and modules. The processor 1430 executes various functional applications and data processing of the terminal 1400 by running software programs and modules stored in the memory 1440, and when the processor 1430 executes the program code in the memory 1440, some or all of the processes in fig. 10 of the disclosed embodiments can be implemented.

In some embodiments, the memory 1440 may include primarily a stored program area and a stored data area. The storage program area can store an operating system, various application programs (such as communication application), a face recognition module and the like; the storage data area may store data created according to the use of the terminal (such as multimedia files such as various pictures, video files, and the like, and face information templates), etc.

In addition, the memory 1440 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.

The input unit 1450 may be used to receive numeric or character information input by a user and to generate key signal inputs related to user settings and function control of the terminal 1400.

In some embodiments, the input unit 1450 may include a touch panel 1451 and other input terminals 1452.

The touch panel 1451, also referred to as a touch screen, may collect touch operations thereon or nearby (such as operations on the touch panel 1451 or nearby the touch panel 1451 by a user using any suitable object or accessory such as a finger, a stylus, etc.), and drive the corresponding connection device according to a preset program. In some embodiments, the touch panel 1451 may include two parts, a touch detecting device and a touch controller. The touch detection device detects the touch azimuth of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device and converts it into coordinates of touch points, which are then sent to the processor 1430, and can receive commands from the processor 1430 and execute them. In addition, the touch panel 1451 may be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave.

In some embodiments, the other input terminals 1452 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, mouse, joystick, etc.

The display unit 1460 may be used to display information input by a user or information provided to the user and various menus of the terminal 1400. The display unit 1460 is a display system of the terminal 1400, and is used for presenting an interface to implement man-machine interaction.

Further, the touch panel 1451 may cover the display panel 1461, and after the touch panel 1451 detects a touch operation thereon or thereabout, the touch panel 1451 may be transferred to the processor 1430 to determine a type of touch event, and then the processor 1430 may provide a corresponding visual output on the display panel 1461 according to the type of touch event.

Although in fig. 14, the touch panel 1451 and the display panel 1461 are two independent components to implement the input and output functions of the terminal 1400, in some embodiments, the touch panel 1451 may be integrated with the display panel 1461 to implement the input and output functions of the terminal 1400.

The processor 1430 is a control center of the terminal 1400, connects respective components using various interfaces and lines, and performs various functions of the terminal 1400 and processes data by running or executing software programs and/or modules stored in the memory 1440 and calling data stored in the memory 1440, thereby realizing various services based on the terminal.

In some implementations, the processor 1430 can include one or more processors. In some embodiments, the processor 1430 may integrate an application processor that primarily processes operating systems, user interfaces, applications, etc., with a modem processor that primarily processes wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 1430.

The camera 1470 is configured to implement a photographing function of the terminal 1400, and photograph pictures or videos. The camera 1470 may also be used to implement a scanning function of the terminal 1400 to scan a scanned object (two-dimensional code/bar code).

The terminal 1400 also includes a power source 1420 (e.g., a battery) for powering the various components. In some embodiments, the power source 1420 may be logically connected to the processor 1430 through a power management system, so as to perform functions of managing charging, discharging, and power consumption through the power management system.

Although not shown, the terminal 1400 may further include at least one sensor, audio circuit, etc., which are not described herein.

Wherein memory 1430 may store the same program code as memory 1220 that when executed by processor 1420 causes processor 1420 to perform all the functions of processor 1210.

The embodiment of the application also provides a computer readable nonvolatile storage medium, which comprises program codes, wherein the program codes are used for enabling the computing terminal to execute the steps of the method for realizing the customized voice instruction.

The present application is described above with reference to block diagrams and/or flowchart illustrations of methods, apparatus (systems) and/or computer program products according to embodiments of the application. It will be understood that one block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, and/or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer and/or other programmable data processing apparatus, create means for implementing the functions/acts specified in the block diagrams and/or flowchart block or blocks.

Accordingly, the present application may be embodied in hardware and/or in software (including firmware, resident software, micro-code, etc.). Still further, the present application may take the form of a computer program product on a computer-usable or computer-readable storage medium having computer-usable or computer-readable program code embodied in the medium for use by or in connection with an instruction execution system. In the context of the present application, a computer-usable or computer-readable medium may be any medium that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.

It will be apparent to those skilled in the art that various modifications and variations can be made to the present application without departing from the spirit or scope of the application. Thus, it is intended that the present application also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.

Claims

1. The method for realizing the custom voice command is characterized by being applied to a terminal, and comprises the following steps:

executing instructions in the instruction set, wherein if the instruction set comprises a plurality of response instructions, when executing the plurality of response instructions, executing one response instruction randomly selected from the plurality of response instructions, or executing the plurality of response instructions according to the selection sequence of the plurality of response instructions; the response instruction is used for playing the voice output according to the voice instruction.

2. The method of claim 1, wherein the correspondence between voice commands and command sets is established by:

3. The method according to claim 1, wherein selecting a corresponding voice command from preset voice commands according to the recognition result comprises:

4. The method according to claim 1, wherein the method further comprises:

responding to an editing instruction of a user, and editing a voice instruction specified by the editing instruction and/or an instruction set specified by the editing instruction, wherein the editing instruction is triggered when the user executes modification operation on the corresponding relation between one established voice instruction and the instruction set; and/or the number of the groups of groups,

and deleting the voice command designated by the deleting command and the command set corresponding to the voice command in response to the deleting command of the user, wherein the deleting command is triggered when the user executes deleting operation on the corresponding relation between one established voice command and the command set.

5. The method of any of claims 1-4, wherein said executing instructions in said set of instructions comprises:

6. The method of claim 5, wherein sequentially executing the instructions of the set of instructions in the order of the instructions of the set of instructions comprises:

If the operation corresponding to the next instruction does not affect the operation being executed, the operation being executed and the operation corresponding to the next instruction are executed simultaneously.

7. A self-defined voice instruction implementation terminal is characterized in that the terminal comprises: a processor and a memory, wherein the memory stores program code that, when executed by the processor, causes the terminal to perform the following:

executing instructions in the instruction set, wherein if the instruction set comprises a plurality of response instructions, when executing the plurality of response instructions, executing a response instruction selected randomly from the plurality of response instructions, or executing the plurality of response instructions according to the selection sequence of the plurality of response instructions; the response instruction is used for playing the voice output according to the voice instruction.

8. The terminal of claim 7, wherein the processor is specifically configured to:

9. The terminal of claim 7, wherein the processor is specifically configured to:

10. The terminal of claim 7, wherein the processor is further configured to: