WO2023000698A1

WO2023000698A1 - Method for controlling program by means of speech, and device and program product

Info

Publication number: WO2023000698A1
Application number: PCT/CN2022/082104
Authority: WO
Inventors: 刘俊启
Original assignee: 北京百度网讯科技有限公司
Priority date: 2021-07-23
Filing date: 2022-03-21
Publication date: 2023-01-26
Also published as: CN113496703A

Abstract

A method for controlling a third-party program by means of speech, and a device and a program product. The method comprises: in response to a speech instruction, which is initiated by a user, determining instruction information corresponding to the speech instruction, wherein instruction information of a third-party program is stored in a speech recognition program (201); if it is determined that there are a plurality of pieces of instruction information corresponding to the speech instruction, then generating prompt information, wherein the plurality of pieces of instruction information corresponding to the speech instruction are respectively of different third-party programs, and the prompt information is used for prompting the user to specify a third-party program (202); and in response to a specifying instruction, which is initiated by the user, determining, from among the plurality of pieces of instruction information corresponding to the speech instruction, target instruction information corresponding to a third-party program indicated by the specifying instruction, and sending an operable instruction, which is in the target instruction information, to the third-party program indicated by the specifying instruction for response processing (203). By means of the method, a user can control, by means of speech, a third-party program that does not have a speech recognition function.

Description

Method, device and program product for controlling program by voice

This disclosure claims the priority of the Chinese patent application with application number 2021108397546 and titled "Method, device and program product for controlling program by voice" filed with China Patent Office on July 23, 2021, the entire contents of which are incorporated by reference incorporated in this disclosure.

technical field

The present disclosure relates to voice technology in computer technology, in particular to a method, device and program product for controlling programs by voice.

Background technique

At present, a large number of Apps are installed in the mobile terminal, and the user can operate the user terminal to start the App, and use the started APP.

In the prior art, a user can operate a mobile terminal in various ways to make it run a specified App, for example, the mobile terminal can be operated by touch to make it run an App, or a certain App can be invoked through a voice assistant.

Under normal circumstances, when the user is inconvenient to directly operate the mobile phone, the APP will be called up by voice. However, after the APP is started, if the APP itself does not have the voice recognition function, the user can only operate the APP by touch. Therefore, in the prior art, when the user is inconvenient to directly operate the mobile terminal with hands, it is impossible to truly control the APP by voice.

Contents of the invention

The present disclosure provides a method, device and program product for controlling a program by voice, so as to solve the technical problem in the prior art that it is impossible to control an APP by voice when it is inconvenient for the user to directly operate the mobile terminal by hand.

According to the first aspect of the present disclosure, a method for controlling a program by voice is provided, the method is applied to a voice recognition program of an electronic device, and the electronic device runs a voice recognition program and a plurality of third-party programs, so that The methods described include:

In response to a voice command initiated by the user, determine command information corresponding to the voice command, wherein the voice recognition program stores the command information of the third-party program;

If it is determined that there are multiple instruction information corresponding to the voice instruction, prompt information is generated, wherein the plurality of instruction information corresponding to the voice instruction respectively belong to different third-party programs, and the prompt information is used to prompt the user to specify third party programs;

In response to a specified instruction initiated by the user, determine the target instruction information corresponding to the third-party program indicated by the specified instruction among the plurality of instruction information corresponding to the voice instruction, and set the operable target instruction information in the target instruction information to The instruction is sent to the third-party program indicated by the specified instruction for response processing.

According to the second aspect of the present disclosure, there is provided a method for controlling a program by voice, the method is applied to a third-party program of an electronic device, and the electronic device runs a voice recognition program and multiple third-party programs, so The methods described include:

Receive the operable instruction sent by the voice recognition program; wherein, the operable instruction is determined in a plurality of instruction information based on the user's designated instruction, and the plurality of instruction information are determined according to the user's voice instruction and belong to different The information of the third-party program; the instruction information of the third-party program is stored in the speech recognition program;

According to the operable instruction, the response processing is completed.

According to a third aspect of the present disclosure, there is provided a device for controlling programs by voice, the device is applied to a voice recognition program of an electronic device, and the electronic device runs a voice recognition program and a plurality of third-party programs, so Said devices include:

a determining unit, configured to determine instruction information corresponding to the voice instruction in response to the voice instruction initiated by the user, wherein the instruction information of the third-party program is stored in the voice recognition program;

A prompting unit, configured to generate prompt information if it is determined that there are multiple command information corresponding to the voice command, wherein the multiple command information corresponding to the voice command respectively belong to different third-party programs, and the prompt information Used to prompt the user to specify a third-party program;

a control unit, configured to, in response to a designated instruction initiated by a user, determine, among a plurality of instruction information corresponding to the voice instruction, target instruction information corresponding to the third-party program indicated by the designated instruction, and send the target instruction to The operable instruction in the information is sent to the third-party program indicated by the specified instruction for response processing.

According to a fourth aspect of the present disclosure, there is provided an apparatus for controlling a program by voice, the apparatus is applied to a third-party program of an electronic device, and a speech recognition program and multiple third-party programs run in the electronic device, so Said devices include:

The receiving unit is configured to receive the operable instruction sent by the speech recognition program; wherein, the operable instruction is determined in a plurality of instruction information based on the user's designated instruction, and the plurality of instruction information is based on the user's voice instruction The determined information respectively belongs to different third-party programs; the instruction information of the third-party programs is stored in the speech recognition program;

A response unit, configured to complete response processing according to the operable instruction.

According to a fifth aspect of the present disclosure, there is provided an electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein,

The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can execute the method described in the first aspect or the second aspect. method.

According to a sixth aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to make the computer execute the method as described in the first aspect or the second aspect .

According to a seventh aspect of the present disclosure, there is provided a computer program product, the computer program product comprising: a computer program stored in a readable storage medium, at least one processor of an electronic device can read from the The computer program is read by reading the storage medium, and the at least one processor executes the computer program so that the electronic device executes the method described in the first aspect or the second aspect.

The method, device, and program product provided by the present disclosure can store instruction information of a third-party program in the voice recognition program. The instruction information corresponding to the user's voice instruction is determined in the instruction information, and if a plurality of instruction information corresponding to the user's voice instruction is determined, then based on the user's specified instruction, the instruction information corresponding to the user's voice instruction can also be selected. The instruction information determines the target instruction information, so that the operable instructions in the target instruction information can be sent to the third-party program designated by the user through the voice recognition program, so that the third-party program can respond to the user's voice instruction. Through this implementation, the user Third-party programs that do not have voice recognition functions can be controlled by voice.

It should be understood that what is described in this section is not intended to identify key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will be readily understood through the following description.

Description of drawings

The accompanying drawings are used to better understand the present solution, and do not constitute a limitation to the present disclosure. in:

Fig. 1 is a schematic diagram of a wake-up program using voice mode shown in an exemplary embodiment;

FIG. 2 is a schematic flowchart of a method for controlling a program by voice according to the first exemplary embodiment of the present disclosure;

Fig. 3 is a schematic interface diagram of an exemplary embodiment of the present disclosure;

Fig. 4 is a schematic flowchart of a method for controlling a program by voice according to a second exemplary embodiment of the present disclosure;

FIG. 5 is a schematic flowchart of a method for controlling a program by voice according to a third exemplary embodiment of the present disclosure;

FIG. 6 is a schematic flowchart of a method for controlling a program by voice according to a fourth exemplary embodiment of the present disclosure;

FIG. 7 is a schematic flowchart of a method for controlling a program by voice according to a fifth exemplary embodiment of the present disclosure;

Fig. 8 is a schematic structural diagram of an apparatus for controlling a program by voice according to the first exemplary embodiment of the present disclosure;

FIG. 9 is a schematic structural diagram of an apparatus for controlling a program by voice according to a second exemplary embodiment of the present disclosure;

FIG. 10 is a schematic structural diagram of an apparatus for controlling a program by voice according to a third exemplary embodiment of the present disclosure;

Fig. 11 is a schematic structural diagram of an apparatus for controlling a program by voice according to a fourth exemplary embodiment of the present disclosure;

FIG. 12 is a block diagram of an electronic device for implementing the method for controlling a program by voice according to an embodiment of the present disclosure.

detailed description

Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

Fig. 1 is a schematic diagram of an exemplary embodiment showing a procedure for waking up by voice.

As shown in FIG. 1 , the user 11 can speak a voice command, and the mobile terminal 12 can be provided with a voice recognition program. The mobile terminal 12 can use a built-in voice recognition program to recognize the content of the voice command, and perform corresponding operations according to the content of the voice command.

For example, when the content of the voice instruction is "start program A", the mobile terminal 12 can run program A, and its interface is updated from state 13 to state 14.

If program A has voice recognition function, the user can continue to control program A based on voice control; if program A does not have voice recognition function, program A cannot respond when the user continues to control program A based on voice control.

Especially when the user is inconvenient to use both hands to control the mobile terminal, the mobile terminal can only start an application program based on the user's voice command, but cannot continue to control the application program based on the user's voice command.

In order to solve the above technical problems, in the solution provided by the present disclosure, the instruction information of the third-party program is stored in the speech recognition program, and when the electronic device receives the user's voice instruction for controlling the third-party program, the speech recognition program can determine the The instruction information corresponding to the voice instruction, and send an operable instruction to the third-party program according to the instruction information, so that the third-party program can respond to the user's voice instruction. Through this implementation, the user can not only wake up the third-party program by voice, but also control the started third-party program.

Fig. 2 is a schematic flowchart of a method for controlling a program by voice according to an exemplary embodiment of the present disclosure.

The method for controlling a program by voice in the present disclosure is applied to a voice recognition program of an electronic device, and the electronic device can execute the method of the present disclosure based on the function of the voice recognition program.

Fig. 3 is a schematic diagram of an interface according to an exemplary embodiment of the present disclosure.

As shown in FIG. 3 , a speech recognition program 31 and multiple third-party programs 32 are running in the electronic device. After the electronic device receives the voice command, the voice recognition program 31 provided therein can process the voice command.

Wherein, the third-party program is a program different from the speech recognition program.

Please continue to refer to FIG. 2 , the method for controlling programs by voice provided by the present disclosure includes:

Step 201, in response to a voice command initiated by a user, determine command information corresponding to the voice command, wherein the voice recognition program stores command information of a third-party program.

Specifically, instruction information of any one or more third-party programs is stored in the speech recognition program. For example, during the running of the third-party program, instruction registration information may be sent to the speech recognition program, and then the speech recognition program may store the instruction information of the third-party program. In actual application, the speech recognition program can store multiple instruction information of any third-party program.

Further, the voice command initiated by the user may be an command for controlling any third-party program, and the electronic device may process the voice command through a built-in voice recognition program after receiving the voice command.

In an optional implementation, each piece of instruction information may include instruction content, and the voice recognition program may determine the instruction corresponding to the voice instruction according to the content included in the voice instruction and the instruction content included in each piece of instruction information. information. The content of the instruction may be, for example, "previous page", "next page", "turn up the sound", "turn down the sound" and so on.

In practical application, the voice recognition program can determine the instruction information corresponding to the voice instruction initiated by the current user according to the pre-stored instruction information of the third-party program. For example, if the voice recognition program stores the instruction information of program A, program B, and program C, the instruction information matching the voice instruction initiated by the user can be determined from the instruction information of these three programs.

For example, if the voice instruction initiated by the user includes "turn up the voice a little bit", the speech recognition program may search the stored instruction information for the instruction information corresponding to "turn up the voice a little bit". For example, program A is an audio player program, then program A may have instruction information corresponding to "turn up the volume". In this embodiment, the speech recognition program can directly obtain the operable instruction in the instruction information corresponding to "turn up the voice" of program A, and send it to program A, so that program A executes the operable instruction.

In an optional implementation, for example, if program B is a communication program, it may also have instruction information corresponding to "turn up the voice a little bit", then the voice recognition program can determine the two instructions corresponding to the voice instruction information. In this case, step 202 may be performed.

Step 202, if it is determined that there are a plurality of instruction information corresponding to the voice instruction, generate prompt information, wherein the plurality of instruction information corresponding to the voice instruction belong to different third-party programs, and the prompt information is used to prompt the user to specify a third-party program .

If there are multiple command information corresponding to voice commands, and the multiple command information corresponding to voice commands belong to different third-party programs, the voice recognition program needs to determine the third-party program that the user wants to control, and The instruction information of the third-party program is screened out, and then the third-party program is controlled based on the instruction information.

In actual application, the voice recognition program may generate prompt information for prompting the user to specify a third-party program. The prompt information may be prompt information in the form of voice, or prompt information in the form of graphics and text, which is not limited in this embodiment of the present disclosure.

Wherein, the user may designate the third-party program by means of voice or touch. For example, the user can name a specific third-party program. For another example, when the prompt information is displayed in the form of graphics and text, icons of multiple third-party programs may be displayed, and the user may specify the third-party program among them by touch.

For example, the voice command initiated by the user includes "turn up the voice a little bit", and the voice recognition program determines that both program A and program B have command information corresponding to the voice command. Then the speech recognition program can generate prompt information for formulating programs in program A and program B. Thereafter, the user can formulate a third-party program based on the prompt information, for example, program A can be specified.

Step 203, in response to the designated instruction initiated by the user, determine the target instruction information corresponding to the third-party program indicated by the designated instruction among the plurality of instruction information corresponding to the voice instruction, and send the operable instruction in the target instruction information to The third-party program indicated by the specified command performs response processing.

Specifically, the speech recognition program can respond to a specified instruction initiated by the user, thereby determining the third-party program specified by the user. The target instruction information corresponding to the third-party program specified by the user may also be determined among the plurality of determined instruction information corresponding to the voice instruction.

For example, two pieces of instruction information corresponding to the user's voice instruction determined by the speech recognition program, one of which is the instruction information of program A, and the other is the instruction information of program B. If the third-party program designated by the user is program A, the speech recognition program uses the instruction information of program A among the pieces of instruction information as the target instruction information.

Further, the instruction information may include specific operable instructions. For example, when the instruction content in a piece of instruction information is "previous page", the operable instruction in the instruction information is "back", and the instruction information may also include program information, such as program A.

In actual application, the voice recognition program may send the operable instructions in the target instruction information to the third-party program indicated by the specified instruction, for example, send the operable instructions in the target instruction information to program A.

In one embodiment, the speech recognition program can directly send the operable instructions to program A, and can also send the operable instructions to the system of the electronic device, and then the system forwards the operable instructions to program A.

After receiving the operable instruction, the third-party program indicated by the specified instruction can execute the corresponding instruction to respond. Since the operable instruction corresponds to the user's voice instruction, when the third-party program executes the operable instruction, it can achieve the effect of responding to the user's voice instruction, so that the user can control the third-party computer without voice recognition function by voice. tripartite procedure.

The method for controlling a program by voice provided by the present disclosure is applied to a voice recognition program of an electronic device, and the electronic device runs a voice recognition program and multiple third-party programs. The method includes: responding to a voice command initiated by a user, determining and The instruction information corresponding to the voice instruction, wherein, the instruction information of the third-party program is stored in the voice recognition program; if it is determined that there are multiple instruction information corresponding to the voice instruction, prompt information is generated, wherein the multiple The instruction information respectively belongs to different third-party programs, and the prompt information is used to prompt the user to specify the third-party program; in response to the specified instruction initiated by the user, the third-party program indicated by the specified instruction is determined in multiple instruction information corresponding to the voice instruction corresponding target instruction information, and send the operable instructions in the target instruction information to the third-party program indicated by the specified instruction for response processing. In the method for controlling a program by voice provided in the present disclosure, the voice recognition program can store instruction information of a third-party program, and when the user manipulates a third-party program by voice, the voice recognition program determines the The instruction information corresponding to the user's voice instruction is obtained, and if a plurality of instruction information corresponding to the user's voice instruction is determined, then the target can also be determined based on the user's designated instruction among the plurality of instruction information corresponding to the user's voice instruction. Instruction information, so that the operable instructions in the target instruction information can be sent to the third-party program specified by the user through the voice recognition program, so that the third-party program can respond to the user's voice instructions. way to control third-party programs that do not have speech recognition.

Fig. 4 is a schematic flowchart of a method for controlling a program by voice according to a second exemplary embodiment of the present disclosure.

The method for controlling a program by voice in the present disclosure is applied to a voice recognition program of an electronic device, and the electronic device can execute the method of the present disclosure based on the function of the voice recognition program. A speech recognition program and multiple third-party programs run in the electronic device.

Please continue to refer to FIG. 4 , the method for controlling a program by voice provided by the present disclosure includes:

Step 401: Start the third-party program in response to the start instruction for starting the third-party program.

Wherein, the user may send an activation instruction for activating the third-party program to the electronic device, and the activation instruction may be, for example, an instruction in voice form. For example, the user can say "start program A", then the voice command can be processed by the voice recognition program set in the electronic device.

In an optional implementation manner, the voice recognition program can directly start the corresponding program after receiving the start instruction in voice form. For example, the third-party program may be provided with an interface, so that the speech recognition program can start the third-party program through the interface.

In another embodiment, after the voice recognition program receives the start command in the voice form, it can convert the start command in the voice form into a control command, and send the control command to the system of the electronic device, and then the system of the electronic device based on the The control instruction starts a third-party program.

In this embodiment, the user can start the third-party program by voice, and when it is inconvenient for the user to touch the electronic device by hand, the third-party program can be started by voice control.

Step 402: Determine the voice content in response to the voice instruction initiated by the user.

Among them, the user can control the third-party program through the voice command, for example, can say the voice content "previous page", and the voice recognition program can determine the voice content included in the voice command spoken by the user based on the voice recognition algorithm, for example, can recognize The voice content in the voice command spoken by the user is "previous page".

Step 403, in the stored correspondence, determine instruction information including voice content; wherein, the instruction information includes voice content and operable instructions.

Wherein, instruction information of the third-party program is stored in the speech recognition program.

For example, the speech recognition program may receive instruction registration information sent by a third-party program for registering operable instructions.

In actual application, after the third-party program is started, the started third-party program may send instruction registration information for registering operable instructions to the speech recognition program.

Wherein, the third-party program can determine the instruction registration information according to the operable instructions that can be supported during the running process, and send the registration instruction to the voice recognition program.

Specifically, the third-party program can also determine the operable instructions that can be supported in the current interface of the program according to the operable controls included in the current interface of the program, and send the instruction registration information for registering these operable instructions to the voice recognition program . For example, if the current interface of the program supports the operable instructions of "next page", "previous page" and "OK", then the third-party program can send a voice recognition program to register "next page, previous page, The instruction registration information of the operable instruction of "OK".

Furthermore, the speech recognition program may be provided with an interface, so that a third-party program may send instruction registration information to the speech recognition program through the interface. The third-party program can also send instruction registration information to the system of the electronic device, and the system forwards the instruction registration information to the voice recognition program.

The speech recognition program can also store the corresponding relationship between the third-party program and the instruction information according to the instruction registration information.

In practical applications, after receiving the instruction registration information, the speech recognition program may store the correspondence between the third-party program and the instruction information according to the instruction registration information. For example, if program A sends instruction registration information to the speech recognition program, the speech recognition program can determine the instruction information according to the instruction registration information, and store the relationship between program A and the instruction information.

Through this implementation, the speech recognition program can store the correspondence between the third-party program and the instruction information according to the instruction registration information sent by the third-party program, so that the speech recognition program can control the third-party program according to the user's voice instruction, thereby reaching the user's The effects of third-party programs that do not have voice recognition can be controlled by voice.

In one embodiment, the instruction registration information sent by the third-party program to the voice recognition program may include operable instructions. In this embodiment, the voice recognition program may determine the instruction content corresponding to each operable instruction, so as to obtain the The instruction information of the operation instruction and its corresponding instruction content may also store the association relationship between the third-party program and the instruction information.

In another embodiment, the instruction registration information sent by the third-party program to the voice recognition program may include operable instructions and their corresponding instruction content, and the voice recognition program may directly store the relationship between the third-party program and the instruction information, The instruction information includes operable instructions and corresponding instruction content.

For example, the speech recognition program may store the association relationship between instruction information and third-party programs in the form of an instruction configuration table. The instruction configuration table may include three columns of content, one column is the content of the instruction, the other column is the program to which it belongs, and the other column is the instruction format of the operable instruction. For example, a line of information in the command configuration table may include command content "previous page", command format "back", and the program it belongs to is app1.

Specifically, the voice recognition program stores correspondences between instruction information and third-party programs, and the voice recognition program may specifically determine, among these correspondences, that the instruction information includes the above-mentioned voice content correspondence.

For example, the stored correspondence includes two correspondences, correspondence 1 includes the correspondence between instruction information 1 and app1; correspondence 2 includes the correspondence between instruction information 2 and app2. The voice content included in the command information 1 is "previous page", and the voice content included in the command information 2 is "previous page".

Further, if the voice instruction made by the user includes the voice content "previous page", the voice recognition program can determine the instruction information 1 and the instruction information 2 including the voice content.

In this embodiment, the voice recognition program can determine the command information corresponding to the voice command made by the user based on the correspondence between the pre-stored command information and the third-party program, and then convert the voice command into command information to The purpose of using the determined instruction information to control the third-party program is realized.

Step 404, if it is determined that there are a plurality of instruction information corresponding to the voice instruction, generate prompt information, wherein the plurality of instruction information corresponding to the voice instruction belong to different third-party programs, and the prompt information is used to prompt the user to specify a third-party program .

Step 405, in response to the specified instruction initiated by the user, determine the target instruction information corresponding to the third-party program indicated by the specified instruction among the plurality of instruction information corresponding to the voice instruction, and send the operable instruction in the target instruction information to The third-party program indicated by the specified command performs response processing.

Steps

404, 405 are implemented in a similar manner to

steps

202, 203, and will not be repeated here.

Step 406, receiving interface change information sent by a third-party program.

Specifically, if the third-party program sends instruction registration information to the speech recognition program according to the operable instructions supported in the program interface, the third-party program can send interface change information to the speech recognition instruction every time the interface changes.

For example, when the interface of the third-party program is switched, the third-party program may send interface change information to the speech recognition program.

In one embodiment, after the interface of the third-party program is switched, it may continue to send instruction registration information to the speech recognition program, and the information may carry interface change information.

In another implementation manner, when the third-party program exits, it may send interface change information to the speech recognition program.

Step 407: Update the stored correspondence between the third-party program and the instruction information according to the interface change information.

Further, after the speech recognition program receives the interface change information sent by the third-party program, it can update the stored correspondence between the third-party program and the instruction information.

Since the instruction information stored in the speech recognition program is the information of the operable instructions that can be supported in the current interface of the third-party program, when the interface of the third-party program changes, the instructions of the third-party program stored in the speech recognition program The information should also be updated, so that the voice recognition program can find the corresponding instruction information according to the voice instruction made by the user.

In one embodiment, if the speech recognition program receives interface change information sent by a third-party program, the speech recognition program may directly delete the instruction information of the third-party program.

Thereafter, the voice recognition program may continue to receive instruction registration information sent by the third-party program, and then store instruction information corresponding to the operable instructions supported in the current interface of the third-party program.

Further, if the third-party program sends interface change information to the speech recognition program when it exits, the third-party program will not send instruction registration information to the speech recognition program again until the third-party program is started again.

In actual application, after the interface of the third-party program is changed, the voice recognition program can delete the voice information of the third-party program, so as to prevent the voice recognition program from processing the user's voice command according to the command information in the history interface of the third-party program, resulting in misoperation The problem.

In an optional embodiment, the method provided by the present disclosure also includes:

Step 408, if a piece of instruction information corresponding to the voice instruction is determined, send an operable instruction to the third-party program to which the instruction information belongs according to the voice instruction.

If only one command information corresponding to the voice command is determined in the pre-stored command information, the voice recognition program can directly obtain the operable command in the command information, and can also send the operable command to the command corresponding to the voice command The third-party program to which the information belongs enables the third-party program to respond to the operable instruction.

After step 408,

steps

406 and 407 may also be performed.

Fig. 5 is a schematic flowchart of a method for controlling a program by voice according to a third exemplary embodiment of the present disclosure.

The method for controlling a program by voice in the present disclosure is applied to a third-party program of an electronic device, and the electronic device can execute the method of the present disclosure based on the functions of the third-party program.

A speech recognition program and multiple third-party programs run in the electronic device. Any third-party program can execute the method provided by the present disclosure.

Please continue to refer to FIG. 5 , the method for controlling a program by voice provided by the present disclosure includes:

Step 501, receiving the operable instruction sent by the speech recognition program; wherein, the operable instruction is determined in a plurality of instruction information based on the user's specified instruction, and the plurality of instruction information is determined according to the user's voice instruction and belongs to different Information of the third-party program; instruction information of the third-party program is stored in the speech recognition program.

Wherein, instruction information of any one or more third-party programs is stored in the speech recognition program. For example, during the running of the third-party program, instruction registration information may be sent to the speech recognition program, and then the speech recognition program may store the instruction information of the third-party program. In actual application, the speech recognition program can store multiple instruction information of any third-party program.

Wherein, if the speech recognition program determines that there are multiple instruction information corresponding to the voice instruction, prompt information is generated, wherein the plurality of instruction information corresponding to the voice instruction respectively belong to different third-party programs, and the prompt information is used to prompt the user to specify the first tripartite procedure.

For example, the voice command initiated by the user includes "turn up the voice a little bit", and the voice recognition program determines that both program A and program B have command information corresponding to the voice command. Then the speech recognition program can generate prompt information for formulating programs in program A and program B. Thereafter, the user can formulate a third-party program based on the prompt information, for example, program A can be designated.

In response to a specified instruction initiated by the user, determine the target instruction information corresponding to the third-party program indicated by the specified instruction among the plurality of instruction information corresponding to the voice command, and send the operable instructions in the target instruction information to the specified instruction. The indicated third-party program performs response processing, so that the third-party program can receive the operable instruction.

The operable instruction is sent by the voice recognition program to the third-party program according to the voice instruction initiated by the user. Even if the third-party program does not have the voice recognition function, the operable instruction can be transmitted to the third-party program through voice control.

For example, two pieces of instruction information corresponding to the user's voice instruction determined by the speech recognition program, one of which is the instruction information of program A, and the other is the instruction information of program B. If the third-party program designated by the user is program A, the speech recognition program uses the instruction information of program A among the pieces of instruction information as the target instruction information. Thereafter, the voice recognition program can send the operable instructions in the target instruction information to program A.

Specifically, the speech recognition program may send an operable instruction to a third-party program according to the method shown in the embodiment shown in FIG. 2 .

Step 502, complete response processing according to the operable instruction.

Fig. 6 is a schematic flowchart of a method for controlling a program by voice according to a fourth exemplary embodiment of the present disclosure.

Please continue to refer to FIG. 6, the method for controlling a program by voice provided by an embodiment of the present disclosure includes:

Step 601, determine operable instructions according to the current interface of the program.

Wherein, after the third-party program is started, operable instructions can be determined according to the current interface of the program. Specifically, the operable instructions supported in the program can be determined according to the current interface of the program.

Specifically, the third-party program can obtain information about the operable controls included in the current interface of the program; and then determine the operable instructions corresponding to the operable controls.

In an optional implementation manner, the third-party program may also determine instruction content according to the operable instruction, so as to obtain instruction information including the operable instruction and its corresponding instruction content.

Step 602, sending registration information for registering operable instructions to the speech recognition program.

The third-party program can also send instruction registration information for registering these operable instructions to the speech recognition program. For example, if the current interface of the program supports the operable instructions of "next page", "previous page" and "OK", then the third-party program can send a voice recognition program to register "next page, previous page, The instruction registration information of the operable instruction of "OK".

Further, the third-party program may send registration information for registering instruction information to the system of the electronic device, so that the system sends the registration information to the voice recognition program.

In another implementation manner, the speech recognition program may be provided with an interface, so that a third-party program may send instruction registration information to the speech recognition program through the interface. The third-party program can also send instruction registration information to the system of the electronic device, and the system forwards the instruction registration information to the voice recognition program.

Specifically, after receiving the instruction registration information, the speech recognition program may store the correspondence between the third-party program and the instruction information according to the instruction registration information. For example, if program A sends instruction registration information to the speech recognition program, the speech recognition program can determine the instruction information according to the instruction registration information, and store the relationship between program A and the instruction information.

Step 603, receiving the operable instruction sent by the speech recognition program; wherein, the operable instruction is determined among multiple operable instructions based on the specified instruction of the user, and the plurality of operable instructions are determined according to the user's voice instruction and respectively belong to Instructions of different third-party programs; the operable instructions of each third-party program are stored in the speech recognition program.

Step 604, complete response processing according to the operable instruction.

Steps

603 and 604 are implemented in a similar manner to steps 501 and 502, and will not be repeated here.

Step 605, when the program interface is switched, send interface change information including interface switching information to the voice recognition program; and/or, when the program exits, send interface change information including program exit information to the voice recognition program.

The voice recognition program can update the stored correspondence between the third-party program and the instruction information according to the interface change information. Since the instruction information stored in the speech recognition program is the information of the operable instructions that can be supported by the current interface of the third-party program, when the interface of the third-party program changes, the instructions of the third-party program stored in the speech recognition program The information should also be updated, so that the voice recognition program can find the corresponding instruction information according to the voice instruction made by the user.

Fig. 7 is a schematic flowchart of a method for controlling a program by voice according to a fifth exemplary embodiment of the present disclosure.

As shown in FIG. 7 , the method for controlling a program by voice provided in the present disclosure may specifically include:

In step a, the user issues a starting instruction for starting the third-party program.

Step b, the speech recognition program starts the third-party program according to the start instruction.

In step c, the third-party program determines operable instructions according to the current interface of the program.

In step d, the third-party program sends registration information for registering operable instructions to the speech recognition program.

In step e, the speech recognition program stores the corresponding relationship between the third-party program and the instruction information according to the instruction registration information.

Step f, the user initiates a voice command for controlling the third-party program.

In step g, the voice recognition program determines the instruction information corresponding to the voice instruction, and generates prompt information if it is determined that there are multiple instruction information corresponding to the voice instruction.

In step h, the user can initiate a specified command based on the above prompt information, thereby specifying a third-party program to be controlled.

Step i, the speech recognition program responds to the specified instruction initiated by the user, and determines the target instruction information corresponding to the third-party program indicated by the specified instruction among the plurality of instruction information corresponding to the voice instruction.

In step j, the voice recognition program sends the operable instructions included in the target instruction information to the third-party program indicated by the specified instruction.

In step k, after receiving the operable instruction, the third-party program may execute the corresponding operable instruction, thereby responding to the operable instruction.

Through the above process, the user can control the third-party program through voice control, even if the third-party program does not have a voice recognition function, this effect can still be achieved.

Fig. 8 is a schematic structural diagram of an apparatus for controlling a program by voice according to the first exemplary embodiment of the present disclosure.

As shown in FIG. 8 , the device 800 for controlling a program by voice provided by the present disclosure is applied to a voice recognition program of an electronic device, and the electronic device runs a voice recognition program and multiple third-party programs. The device 800 includes :

The determining unit 810 is configured to determine instruction information corresponding to the voice instruction in response to the voice instruction initiated by the user, wherein the instruction information of the third-party program is stored in the voice recognition program;

The prompt unit 820 is configured to generate prompt information if it is determined that there are multiple command information corresponding to the voice command, wherein the multiple command information corresponding to the voice command respectively belong to different third-party programs, and the prompt The information is used to prompt the user to specify a third-party program;

The control unit 830 is configured to, in response to a specified instruction initiated by the user, determine, among a plurality of instruction information corresponding to the voice instruction, target instruction information corresponding to the third-party program indicated by the specified instruction, and set the target The operable instructions in the instruction information are sent to the third-party program indicated by the specified instruction for response processing.

The implementation, principle, and effect of the device for controlling a program by voice provided in the present disclosure are similar to those of the embodiment shown in FIG. 2 , and will not be repeated here.

Fig. 9 is a schematic structural diagram of an apparatus for controlling a program by voice according to a second exemplary embodiment of the present disclosure.

In the device 900 for controlling programs by voice provided in the present disclosure, the determination unit 910 is similar to the determination unit 810 in FIG. 8 , the prompt unit 920 is similar to the prompt unit 820 in FIG. 8 , and the control unit 930 is similar to the control unit 830 in FIG. 8 similar.

On the basis of the embodiment shown in FIG. 8 , the present disclosure provides an apparatus 900 for controlling a program in voice mode,

In an optional implementation manner, the determining unit 910 includes:

A content determining module 911, configured to determine the voice content in response to the voice instruction initiated by the user;

The information determining module 912 is configured to determine instruction information including the voice content in the stored correspondence; wherein, the instruction information includes voice content and operable instructions.

In an optional implementation manner, a changing unit 940 is also included, configured to:

Receive interface change information sent by third-party programs;

The stored correspondence between the third-party program and the instruction information is updated according to the interface change information.

In an optional implementation manner, the changing unit 940 includes:

The deletion module 941 is configured to delete the instruction information corresponding to the third-party program sending the interface change information in the corresponding relationship.

In an optional implementation manner, an activation unit 950 is also included, configured to: before the determining unit 910 responds to the voice command initiated by the user, and determines the instruction information corresponding to the voice command:

The third-party program is started in response to the start instruction for starting the third-party program.

In an optional implementation manner, the correspondence between the third-party program and the instruction information is determined according to instruction registration information, and the instruction registration information is sent by the third-party program.

The implementation, principle, and effect of the device for controlling a program by voice provided by the present disclosure are similar to those of the embodiment shown in FIG. 4 , and will not be repeated here.

Fig. 10 is a schematic structural diagram of an apparatus for controlling a program by voice according to a third exemplary embodiment of the present disclosure.

As shown in FIG. 10 , the device 1000 is applied to a third-party program of an electronic device, and a speech recognition program and multiple third-party programs run in the electronic device, and the device includes:

The receiving unit 1010 is configured to receive an operable instruction sent by a speech recognition program; wherein, the operable instruction is determined in a plurality of instruction information based on a specified instruction of the user, and the plurality of instruction information are determined according to the user's voice The information determined by the instruction belongs to different third-party programs; the instruction information of the third-party program is stored in the speech recognition program;

The response unit 1020 is configured to complete response processing according to the operable instruction.

The implementation, principle, and effect of the device for controlling a program by voice provided in the present disclosure are similar to those of the embodiment shown in FIG. 5 , and will not be repeated here.

Fig. 11 is a schematic structural diagram of an apparatus for controlling a program by voice according to a fourth exemplary embodiment of the present disclosure.

As shown in FIG. 11 , in the device 1100 for controlling programs in voice mode provided by the present disclosure, the receiving unit 1110 is similar to the receiving unit 1010 in FIG. 10 , and the response unit 1120 is similar to the response unit 1020 in FIG. 10 .

On the basis of the embodiment shown in FIG. 10 , the device for controlling programs by voice provided by the present disclosure further includes a registration unit 1130 for:

Determine operable instructions according to the current interface of the program;

and sending registration information for registering the operable instruction to the speech recognition program.

In an optional implementation manner, the registration unit 1130 includes:

The sending module 1131 is configured to send registration information for registering the operable instruction to a system of the electronic device, so that the system sends the registration information to the speech recognition program.

In an optional implementation manner, the registration unit 1130 includes an instruction determination module 1131, configured to:

Obtain information about the operable controls included in the current interface of the program;

An operable instruction corresponding to the operable control is determined.

In an optional implementation manner, an update unit 1140 is also included, configured to:

When the program interface is switched, send interface change information including interface switching information to the speech recognition program;

And/or, when the program exits, send interface change information including program exit information to the speech recognition program.

This disclosure provides a method, device and program product for controlling a program by voice, which is applied to the voice technology in computer technology to solve the problem that in the prior art, when it is inconvenient for the user to directly operate the mobile terminal by hand, it is impossible to truly realize the control by voice. How to control the technical problems of APP.

In the technical solution of the present disclosure, the acquisition, storage and application of the user's personal information involved are in compliance with relevant laws and regulations, and do not violate public order and good customs.

According to the embodiments of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium, and a computer program product.

According to an embodiment of the present disclosure, the present disclosure also provides a computer program product. The computer program product includes: a computer program, the computer program is stored in a readable storage medium, and at least one processor of an electronic device can read the program from the readable storage medium. Taking a computer program, at least one processor executes the computer program so that the electronic device executes the solution provided by any one of the above embodiments.

FIG. 8 shows a schematic block diagram of an example electronic device 800 that may be used to implement embodiments of the present disclosure. Electronic device is intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers. Electronic devices may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are by way of example only, and are not intended to limit implementations of the disclosure described and/or claimed herein.

As shown in FIG. 12 , the device 1200 includes a computing unit 1201 that can execute according to a computer program stored in a read-only memory (ROM) 1202 or loaded from a storage unit 1208 into a random-access memory (RAM) 1203. Various appropriate actions and treatments. In the RAM 1203, various programs and data necessary for the operation of the device 1200 can also be stored. The computing unit 1201, ROM 1202, and RAM 1203 are connected to each other through a bus 1204. An input/output (I/O) interface 1205 is also connected to the bus 1204 .

Multiple components in the device 1200 are connected to the I/O interface 1205, including: an input unit 1206, such as a keyboard, a mouse, etc.; an output unit 1207, such as various types of displays, speakers, etc.; a storage unit 1208, such as a magnetic disk, an optical disk, etc. ; and a communication unit 1209, such as a network card, a modem, a wireless communication transceiver, and the like. The communication unit 1209 allows the device 1200 to exchange information/data with other devices over a computer network such as the Internet and/or various telecommunication networks.

The computing unit 1201 may be various general-purpose and/or special-purpose processing components with processing and computing capabilities. Some examples of computing units 1201 include, but are not limited to, central processing units (CPUs), graphics processing units (GPUs), various dedicated artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, digital signal processing processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 1201 executes various methods and processes described above, for example, a method of controlling a program by voice. For example, in some embodiments, the method of controlling a program by voice may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 1208 . In some embodiments, part or all of the computer program may be loaded and/or installed on the device 1200 via the ROM 1202 and/or the communication unit 1209. When the computer program is loaded into the RAM 1203 and executed by the computing unit 1201, one or more steps of the above-described method of controlling the program by voice can be performed. Alternatively, in other embodiments, the computing unit 1201 may be configured in any other suitable way (for example, by means of firmware) to execute the method of controlling the program by voice.

Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips Implemented in a system of systems (SOC), load programmable logic device (CPLD), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include being implemented in one or more computer programs executable and/or interpreted on a programmable system including at least one programmable processor, the programmable processor Can be special-purpose or general-purpose programmable processor, can receive data and instruction from storage system, at least one input device, and at least one output device, and transmit data and instruction to this storage system, this at least one input device, and this at least one output device an output device.

Program codes for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special purpose computer, or other programmable data processing devices, so that the program codes, when executed by the processor or controller, make the functions/functions specified in the flow diagrams and/or block diagrams Action is implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include one or more wire-based electrical connections, portable computer discs, hard drives, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.

To provide for interaction with the user, the systems and techniques described herein can be implemented on a computer having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user. ); and a keyboard and pointing device (eg, a mouse or a trackball) through which a user can provide input to the computer. Other kinds of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and can be in any form (including Acoustic input, speech input or, tactile input) to receive input from the user.

The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., as a a user computer having a graphical user interface or web browser through which a user can interact with embodiments of the systems and techniques described herein), or including such backend components, middleware components, Or any combination of front-end components in a computing system. The components of the system can be interconnected by any form or medium of digital data communication, eg, a communication network. Examples of communication networks include: Local Area Network (LAN), Wide Area Network (WAN) and the Internet.

A computer system may include clients and servers. Clients and servers are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also known as cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the problem of traditional physical host and VPS service ("Virtual Private Server", or "VPS") Among them, there are defects such as difficult management and weak business scalability. The server can also be a server of a distributed system, or a server combined with a blockchain.

It should be understood that steps may be reordered, added or deleted using the various forms of flow shown above. For example, each step described in the present disclosure may be executed in parallel, sequentially, or in a different order, as long as the desired result of the technical solution disclosed in the present disclosure can be achieved, no limitation is imposed herein.

The specific implementation manners described above do not limit the protection scope of the present disclosure. It should be apparent to those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made depending on design requirements and other factors. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present disclosure shall be included within the protection scope of the present disclosure.

Claims

A method for controlling a program by voice, the method is applied to a voice recognition program of an electronic device, the electronic device runs a voice recognition program and a plurality of third-party programs, and the method includes:

In response to a voice command initiated by the user, determine command information corresponding to the voice command, wherein the voice recognition program stores the command information of the third-party program;

If it is determined that there are multiple instruction information corresponding to the voice instruction, prompt information is generated, wherein the plurality of instruction information corresponding to the voice instruction respectively belong to different third-party programs, and the prompt information is used to prompt the user to specify third party programs;

In response to a specified instruction initiated by the user, determine the target instruction information corresponding to the third-party program indicated by the specified instruction among the plurality of instruction information corresponding to the voice instruction, and set the operable target instruction information in the target instruction information to The instruction is sent to the third-party program indicated by the specified instruction for response processing.
The method according to claim 1, wherein, in response to the voice command initiated by the user, determining the command information corresponding to the voice command comprises:

determining voice content in response to a voice command initiated by the user;

In the stored corresponding relationship, determine instruction information including the voice content; wherein, the instruction information includes voice content and operable instructions.
The method according to claim 1 or 2, further comprising:

Receive interface change information sent by third-party programs;

The stored correspondence between the third-party program and the instruction information is updated according to the interface change information.
The method according to claim 3, wherein updating the stored correspondence between the third-party program and the instruction information according to the interface change information comprises:

In the corresponding relationship, the instruction information corresponding to the third-party program sending the interface change information is deleted.
According to the method according to any one of claims 1-4, in response to the voice command initiated by the user, before determining the command information corresponding to the voice command, further comprising:

The third-party program is started in response to the start instruction for starting the third-party program.
The method according to any one of claims 1-5, further comprising:

If a piece of instruction information corresponding to the voice instruction is determined, an operable instruction is sent to the third-party program to which the instruction information belongs according to the voice instruction.
According to the method according to any one of claims 1-6, the corresponding relationship between the third-party program and the instruction information is determined according to instruction registration information, and the instruction registration information is sent by the third-party program.
A method for controlling a program by voice, the method is applied to a third-party program of an electronic device, the electronic device runs a voice recognition program and multiple third-party programs, and the method includes:

Receive the operable instruction sent by the voice recognition program; wherein, the operable instruction is determined in a plurality of instruction information based on the user's designated instruction, and the plurality of instruction information are determined according to the user's voice instruction and belong to different The information of the third-party program; the instruction information of the third-party program is stored in the speech recognition program;

According to the operable instruction, the response processing is completed.
The method of claim 8, further comprising:

Determine operable instructions according to the current interface of the program;

and sending registration information for registering the operable instruction to the speech recognition program.
The method according to claim 9, wherein the sending registration information for registering the operable instruction to the voice recognition program comprises:

sending registration information for registering the operable instruction to a system of the electronic device, so that the system sends the registration information to the speech recognition program.
The method according to claim 9, wherein determining the operable instruction according to the current interface of the program comprises:

Obtain information about the operable controls included in the current interface of the program;

An operable instruction corresponding to the operable control is determined.
The method according to any one of claims 8-11, further comprising:

When the program interface is switched, send interface change information including interface switching information to the speech recognition program;

And/or, when the program exits, send interface change information including program exit information to the speech recognition program.
A device for controlling a program by voice, the device is applied to a voice recognition program of an electronic device, the electronic device runs a voice recognition program and multiple third-party programs, and the device includes:

a determining unit, configured to determine instruction information corresponding to the voice instruction in response to the voice instruction initiated by the user, wherein the instruction information of the third-party program is stored in the voice recognition program;

A prompting unit, configured to generate prompt information if it is determined that there are multiple command information corresponding to the voice command, wherein the multiple command information corresponding to the voice command respectively belong to different third-party programs, and the prompt information Used to prompt the user to specify a third-party program;

a control unit, configured to, in response to a designated instruction initiated by a user, determine, among a plurality of instruction information corresponding to the voice instruction, target instruction information corresponding to the third-party program indicated by the designated instruction, and send the target instruction to The operable instruction in the information is sent to the third-party program indicated by the specified instruction for response processing.
The device according to claim 13, wherein the determining unit comprises:

A content determining module, configured to determine the voice content in response to the voice command initiated by the user;

The information determining module is configured to determine instruction information including the voice content in the stored correspondence; wherein, the instruction information includes voice content and operable instructions.
The device according to claim 13 or 14, further comprising a modification unit for:

Receive interface change information sent by third-party programs;

The stored correspondence between the third-party program and the instruction information is updated according to the interface change information.
The device according to claim 15, wherein the changing unit comprises:

A deletion module, configured to delete instruction information corresponding to the third-party program sending the interface change information in the corresponding relationship.
The device according to any one of claims 13-16, further comprising an activation unit, configured to: before the determination unit determines the instruction information corresponding to the voice instruction in response to the voice instruction initiated by the user:

The third-party program is started in response to the start instruction for starting the third-party program.
According to the device according to any one of claims 13-17, if the prompting unit determines a piece of instruction information corresponding to the voice instruction, the control unit is further configured to send the voice instruction to the first instruction information to which the instruction information belongs. The tripartite program sends operable instructions.
According to the device according to any one of claims 13-18, the corresponding relationship between the third-party program and the instruction information is determined according to instruction registration information, and the instruction registration information is sent by the third-party program.
A device for controlling a program by voice, the device is applied to a third-party program of an electronic device, and a voice recognition program and multiple third-party programs run in the electronic device, and the device includes:

The receiving unit is configured to receive the operable instruction sent by the speech recognition program; wherein, the operable instruction is determined in a plurality of instruction information based on the user's designated instruction, and the plurality of instruction information is based on the user's voice instruction The determined information respectively belongs to different third-party programs; the instruction information of the third-party programs is stored in the speech recognition program;

A response unit, configured to complete response processing according to the operable instruction.
The device according to claim 20, further comprising a registration unit configured to:

Determine operable instructions according to the current interface of the program;

and sending registration information for registering the operable instruction to the speech recognition program.
The device according to claim 21, wherein the registration unit comprises:

A sending module, configured to send registration information for registering the operable instruction to a system of the electronic device, so that the system sends the registration information to the speech recognition program.
The device according to claim 22, wherein the registration unit comprises an instruction determination module configured to:

Obtain information about the operable controls included in the current interface of the program;

An operable instruction corresponding to the operable control is determined.
The device according to any one of claims 21-23, further comprising an updating unit, configured to:

When the program interface is switched, send interface change information including interface switching information to the speech recognition program;

And/or, when the program exits, send interface change information including program exit information to the speech recognition program.
An electronic device comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein,

The memory stores instructions executable by the at least one processor, the instructions are executed by the at least one processor, so that the at least one processor can perform any of claims 1-7 or 8-12 one of the methods described.
A non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause the computer to execute the method according to any one of claims 1-7 or 8-12.
A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1-7 or 8-12.