WO2023000697A1 - 通过语音方式控制程序的方法、设备及程序产品 - Google Patents

通过语音方式控制程序的方法、设备及程序产品 Download PDF

Info

Publication number
WO2023000697A1
WO2023000697A1 PCT/CN2022/082103 CN2022082103W WO2023000697A1 WO 2023000697 A1 WO2023000697 A1 WO 2023000697A1 CN 2022082103 W CN2022082103 W CN 2022082103W WO 2023000697 A1 WO2023000697 A1 WO 2023000697A1
Authority
WO
WIPO (PCT)
Prior art keywords
software
instruction
voice
information
party software
Prior art date
Application number
PCT/CN2022/082103
Other languages
English (en)
French (fr)
Inventor
刘俊启
Original Assignee
北京百度网讯科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京百度网讯科技有限公司 filed Critical 北京百度网讯科技有限公司
Publication of WO2023000697A1 publication Critical patent/WO2023000697A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223—Execution procedure of a spoken command

Definitions

  • the present disclosure relates to voice technology in computer technology, in particular to a method, device and program product for controlling programs by voice.
  • the user can operate the mobile terminal in various ways to make it start the software, for example, the software can be started by touch, or a certain software can be invoked by using the voice assistant set in the terminal.
  • the terminal will be controlled by voice to make it run the software.
  • the software is started, if the software itself does not have the voice recognition function, the user can only use touch way to operate the software. Therefore, in the prior art, when it is inconvenient for the user to control the software by touch, it is impossible to control the software by voice.
  • the present disclosure provides a method, device and program product for controlling a program by voice, so as to solve the technical problem in the prior art that it is impossible to control an APP by voice when it is inconvenient for the user to directly operate the mobile terminal by hand.
  • a method for controlling software by voice is provided, the method is applied to voice processing software of an electronic device, and the electronic device runs voice processing software and multiple third-party software, so
  • the methods described include:
  • a plurality of instruction information corresponding to the voice instruction is determined, wherein the plurality of instruction information corresponding to the voice instruction respectively belong to different third-party software, and the different third-party software includes active
  • the operable instruction is sent to the active third-party software for response processing.
  • a method for controlling software by voice is provided, the method is applied to third-party software of an electronic device, and the electronic device runs voice processing software and multiple third-party software, so
  • the methods described include:
  • operable instructions sent by voice processing software wherein, the operable instructions are determined in a plurality of instruction information according to the active third-party software, and the plurality of instruction information are determined in accordance with the user's voice instructions Information belonging to different third-party software; instruction information of the third-party software is stored in the voice processing software;
  • the response processing is completed.
  • a device for controlling software by voice the device is applied to the voice processing software of electronic equipment, and the voice processing software and multiple third-party software are running in the electronic equipment, so Said devices include:
  • An information determining unit configured to receive a voice command initiated by a user for controlling third-party software, and determine command information corresponding to the voice command, wherein the voice processing software stores the command information of the third-party software ;
  • An instruction determining unit configured to determine a plurality of instruction information corresponding to the voice instruction, wherein the plurality of instruction information corresponding to the voice instruction respectively belong to different third-party software, and the different third-party software If the third-party software in the active state is included in the voice instruction, the operable instruction corresponding to the third-party software in the active state is determined in a plurality of instruction information corresponding to the voice instruction;
  • the control unit is configured to send the operable instruction to the active third-party software for response processing.
  • a device for controlling software by voice the device is applied to third-party software of an electronic device, and the electronic device runs voice processing software and multiple third-party software, so Said devices include:
  • the receiving unit is configured to receive the operable instruction sent by the voice processing software; wherein, the operable instruction is determined in a plurality of instruction information according to the active third-party software, and the plurality of instruction information are determined according to the user
  • the information determined by the voice command belongs to different third-party software respectively; the command information of the third-party software is stored in the voice processing software;
  • a response unit configured to complete response processing according to the operable instruction.
  • an electronic device comprising:
  • the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can execute the method described in the first aspect or the second aspect. method.
  • a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to make the computer execute the method as described in the first aspect or the second aspect .
  • a computer program product comprising: a computer program stored in a readable storage medium, at least one processor of an electronic device can read from the The computer program is read by reading the storage medium, and the at least one processor executes the computer program so that the electronic device executes the method described in the first aspect or the second aspect.
  • the method, device, and program product provided by the present disclosure for controlling a program by voice can store instruction information of third-party software in the voice processing software.
  • the instruction information corresponding to the user's voice instruction is determined in the instruction information, and if a plurality of instruction information corresponding to the user's voice instruction is determined, the third party currently active can also be determined in the plurality of instruction information.
  • the operable instructions corresponding to the software and then send the operable instructions to the active third-party software, so that the third-party software can respond to the user's voice instructions.
  • the user can control the device that does not have Third-party software for voice processing functions.
  • Fig. 1 is a schematic diagram of waking up software using voice mode shown in an exemplary embodiment
  • Fig. 2 is a schematic flowchart of a method for controlling software by voice according to the first exemplary embodiment of the present disclosure
  • FIG. 3 is a schematic flowchart of a method for controlling software by voice according to a second exemplary embodiment of the present disclosure
  • Fig. 4 is a schematic flowchart of a method for controlling software by voice according to a third exemplary embodiment of the present disclosure
  • Fig. 5 is a schematic flowchart of a method for controlling software by voice according to a fourth exemplary embodiment of the present disclosure
  • FIG. 6 is a schematic flowchart of a method for controlling a program by voice according to a fifth exemplary embodiment of the present disclosure
  • Fig. 7 is a schematic structural diagram of an apparatus for controlling a program by voice according to the first exemplary embodiment of the present disclosure
  • Fig. 8 is a schematic structural diagram of an apparatus for controlling a program by voice according to a second exemplary embodiment of the present disclosure
  • FIG. 9 is a schematic structural diagram of an apparatus for controlling a program by voice according to a third exemplary embodiment of the present disclosure.
  • FIG. 10 is a schematic structural diagram of an apparatus for controlling a program by voice according to a fourth exemplary embodiment of the present disclosure.
  • FIG. 11 is a block diagram of an electronic device for implementing the method for controlling a program by voice according to an embodiment of the present disclosure.
  • Fig. 1 is a schematic diagram of waking up software by voice in an exemplary embodiment.
  • the user 11 can speak a voice command
  • the electronic device 12 can be provided with voice recognition software.
  • the electronic device 12 can use the set voice recognition software to recognize the content of the voice command, and perform corresponding operations according to the content of the voice command.
  • the electronic device 12 may run the first program, and its interface is updated from state 13 to state 14 .
  • the user can continue to control the first software based on voice control; if the first software does not have the voice recognition function, then when the user continues to control the first software based on voice, the first software cannot out response.
  • the electronic device can only start an application software based on the user's voice command, but cannot continue to control the application software based on the user's voice command.
  • the instruction information of the third-party software is stored in the voice processing software, and when the electronic device receives a voice instruction initiated by the user to control the third-party software, the voice processing software can determine instruction information corresponding to the voice instruction, and send an operable instruction to the third-party software according to the instruction information, so that the third-party software can respond to the user's voice instruction.
  • the user can not only wake up the third-party software by voice, but also control the started third-party software.
  • Fig. 2 is a schematic flowchart of a method for controlling software by voice according to the first exemplary embodiment of the present disclosure.
  • the method for controlling software by voice in the present disclosure is applied to the voice processing program of the electronic device, and the electronic device can execute the method of the present disclosure based on the function of the voice processing software.
  • Speech processing software and various third-party software run in the electronic device. After the electronic device receives the voice command, the voice command can be processed by the voice processing software running therein.
  • the third-party program is software different from voice processing software.
  • the method for controlling software by voice includes:
  • Step 201 Receive a voice command initiated by a user for controlling third-party software, and determine command information corresponding to the voice command, wherein the voice processing software stores the command information of the third-party software.
  • instruction information of any one or more third-party software is stored in the voice processing software.
  • registration information for registering instructions may be sent to the voice processing software, so that the voice processing software stores the instruction information of the third-party software.
  • the speech processing software can store multiple instruction information of any third-party software.
  • the stored piece of information may include instruction information and identification information of the third-party software to which it belongs.
  • it may be the first software and a piece of instruction information of the first software.
  • the voice instruction initiated by the user may be an instruction for controlling any third-party software, and after the electronic device receives the voice instruction, it may be processed by the running voice processing software.
  • each piece of instruction information may include instruction content
  • the voice processing software may determine the instruction corresponding to the voice instruction according to the content included in the voice instruction and the instruction content included in each piece of instruction information. information.
  • the instruction content may be, for example, "previous page”, “next page”, “turn up the voice”, “turn down the voice” and so on.
  • the voice processing software can determine the command information corresponding to the voice command initiated by the current user according to the pre-stored command information of the third-party software. For example, if the voice processing software stores the instruction information of the first software, the second software, and the third software, the instruction information matching the voice instruction initiated by the user can be determined among the instruction information of the three software.
  • the voice processing software may search the stored instruction information for instruction information corresponding to "previous page”. For example, if the first software is browser software, the first software may have instruction information corresponding to "previous page”. In this embodiment, the voice processing software can directly obtain the operable instruction in the instruction information corresponding to "previous page" of the first software, and send it to the first software, so that the first software executes the operable instruction .
  • the second software is e-book software, which may also have instruction information corresponding to "previous page", then the voice processing software can determine the two information corresponding to the voice instruction. command information. In this case, step 202 may be performed.
  • Step 202 if a plurality of instruction information corresponding to the voice instruction is determined, wherein the plurality of instruction information corresponding to the voice instruction respectively belong to different third-party software, and the different third-party software includes the active third-party software , the operable instruction corresponding to the active third-party software is determined in the plurality of instruction information corresponding to the voice instruction.
  • the voice processing software needs to determine the third-party software that the user wishes to control, and The instruction information of the third-party software is screened out from the information, and then the third-party software is controlled based on the instruction information.
  • the software controlled by the general user is the third-party software that is currently in the active state. Therefore, when the third-party software to which the determined multiple instruction information belongs includes the third-party software that is in the active state, the active state can be directly The third-party software identified as the third-party software that the user wishes to manipulate.
  • the voice processing software can filter out the instruction information of the active third-party software from the determined plurality of instruction information, and obtain the operable instructions in the instruction information.
  • the active third-party software refers to the software displayed on the display interface of the electronic device.
  • the browser software is the first active Third-party software.
  • the voice command initiated by the user includes "next page", the voice processing software determines that both the first software and the second software have instruction information corresponding to the voice command, and the first software is in an active state, then the voice The processing software may obtain the operable instruction in the instruction information of the first software from the determined two pieces of instruction information, and use it as the operable instruction matching the user's real control intention.
  • step 203 the operable instruction is sent to the active third-party software for response processing.
  • the voice processing software may send the operable instructions of the active third-party software to the active third-party software.
  • the voice processing software can directly send operable instructions to the active third-party software, and can also send operable instructions to the system of the electronic device, and then the system forwards the operable instructions to the active third-party software .
  • the third-party software in the active state can execute the corresponding instruction to respond. Since the operable instruction corresponds to the user's voice instruction, when the third-party software executes the operable instruction, it can achieve the effect of responding to the user's voice instruction, and then the user can control the third-party device without voice processing function by voice. Third-party software.
  • the method for controlling software by voice is applied to the voice processing software of an electronic device, and the electronic device runs voice processing software and multiple third-party software, and the method includes: receiving a user-initiated voice control software voice command, determine the command information corresponding to the voice command, wherein, the command information of the third-party software is stored in the voice processing software; if a plurality of command information corresponding to the voice command is determined, wherein, multiple The command information of the voice command belongs to different third-party software, and the different third-party software includes the third-party software in the active state, then determine the number corresponding to the active third-party software among the multiple command information corresponding to the voice command.
  • Actionable instructions send actionable instructions to active third-party software for response processing.
  • the voice processing software can store the command information of the third-party software, and when the user controls the third-party software by voice, the voice processing software determines the The instruction information corresponding to the user's voice instruction is obtained, and if a plurality of instruction information corresponding to the user's voice instruction is determined, the available third-party software corresponding to the currently active third-party software can also be determined in the plurality of instruction information. Operation instructions, and then send the operable instructions to the active third-party software, so that the third-party software can respond to the user's voice instructions.
  • the user can control the device without voice processing function by voice. third-party software.
  • Fig. 3 is a schematic flowchart of a method for controlling software by voice according to a second exemplary embodiment of the present disclosure.
  • the method for controlling software by voice in the present disclosure is applied to the voice processing program of the electronic device, and the electronic device can execute the method of the present disclosure based on the function of the voice processing software.
  • Speech processing software and various third-party software run in the electronic device. After the electronic device receives the voice command, the voice command can be processed by the voice processing software running therein.
  • the method for controlling software by voice includes:
  • Step 301 Start the third-party program in response to the start instruction for starting the third-party program.
  • the user may send an activation instruction for activating the third-party software to the electronic device, and the activation instruction may be, for example, an instruction in the form of voice.
  • the user can say "open the first software", then the voice instruction can be processed by the voice processing software set in the electronic device.
  • the voice processing software can directly start the corresponding software after receiving the start instruction in voice form.
  • the third-party software may be provided with an interface, so that the voice processing software can run the third-party software through the interface.
  • the voice processing software after the voice processing software receives the start command in the voice form, it can convert the start command in the voice form into a control command, and send the control command to the system of the electronic device, and then the system of the electronic device The control command starts third-party software.
  • the user can start the third-party software by voice, and when it is inconvenient for the user to touch the electronic device by hand, the third-party software can be started by voice control.
  • Step 302 receiving a voice command initiated by the user for controlling the third-party software, and determining the voice content according to the voice command.
  • Instruction information of a third-party program is stored in the voice recognition software.
  • voice recognition software may receive registration information sent by third-party software, and the registration information is used to register operable instructions.
  • the third-party software may send registration information for registering operable instructions to the voice processing software.
  • the third-party software can determine the registration information according to the operable instructions that can be supported during the running process, and send the registration instructions to the voice processing software.
  • the third-party software can also determine the operable instructions that can be supported in the current interface of the software according to the operable controls included in the current interface of the software, and send the registration information for registering these operable instructions to the voice processing software. For example, if the current interface of the software supports the operable instructions of "next page", "previous page” and "OK", then the third-party software can send a message to the voice processing software for registering "next page, previous page, Confirm" the registration information of the operational instruction.
  • the voice processing software can be provided with an interface, so that the third-party software can send registration information to the voice processing software through the interface.
  • the third-party software can also send registration information to the system of the electronic device, and the system forwards the instruction registration information to the voice processing software.
  • the speech recognition software can also store the corresponding relationship between third-party software and instruction information according to the registration information.
  • the voice processing software after the voice processing software receives the registration information, it can store the corresponding relationship between the third-party software and the instruction information according to the registration information. For example, if the first software sends registration information to the voice processing software, the voice processing software can determine the instruction information according to the registration information, and store the association between the first software and the instruction information.
  • the voice processing software can store the correspondence between the third-party software and the instruction information according to the registration information sent by the third-party software, so that the voice processing software can control the third-party software according to the user's voice instructions, so that the user can Control the effects of third-party software that does not have voice processing capabilities by voice.
  • the registration information sent by the third-party software to the voice processing software may include operable instructions.
  • the voice processing software may determine the instruction content corresponding to each operable instruction, so as to obtain the The instruction information of the instruction and its corresponding instruction content may also store the association relationship between the third-party software and the instruction information.
  • the registration information sent by the third-party software to the voice processing software may include operable instructions and corresponding instruction content, and the voice processing software may directly store the association between the third-party software and the instruction information, and the instruction The information includes operable instructions and their corresponding instruction content.
  • the voice processing software may store the relationship between instruction information and third-party software in the form of an instruction configuration table.
  • the instruction configuration table may include three columns of content, one column is the instruction content, one column is the associated software, and the other column is the instruction format of the operable instruction.
  • a line of information in the command configuration table may include command content "previous page", command format "back”, and the associated software is the first software.
  • the user can control the third-party software through voice commands, for example, can say the voice content "previous page", and the voice processing software can determine the voice content included in the voice command spoken by the user based on the voice processing algorithm, for example, can process The voice content in the voice command spoken by the user is "previous page”.
  • Step 303 in the stored correspondence, determine instruction information including voice content; wherein, the instruction information includes voice content and operable instructions.
  • the voice processing software stores the corresponding relationship between the instruction information and the third-party software, and the voice processing software may specifically determine the corresponding relationship between the above-mentioned voice content included in the instruction information among these corresponding relationships.
  • the stored correspondence includes two correspondences, correspondence 1 includes the correspondence between instruction information 1 and the first software; correspondence 2 includes the correspondence between instruction information 2 and the second software.
  • the voice content included in the command information 1 is "previous page", and the voice content included in the command information 2 is "previous page”.
  • the voice processing software can determine the instruction information 1 and the instruction information 2 including the voice content.
  • the voice processing software can determine the command information corresponding to the voice command made by the user based on the correspondence between the pre-stored command information and the third-party software, and then convert the voice command into command information to Realize the purpose of using the determined instruction information to control the third-party software.
  • Step 304 if a plurality of instruction information corresponding to the voice instruction is determined, wherein the plurality of instruction information corresponding to the voice instruction belong to different third-party software, and the different third-party software includes the active third-party software , then among the plurality of instruction information corresponding to the voice instruction, determine the target instruction information belonging to the active third-party software.
  • the voice processing software needs to determine the third-party software that the user wishes to control, and The instruction information of the third-party software is screened out from the information, and then the third-party software is controlled based on the instruction information.
  • the software controlled by the general user is the third-party software that is currently in the active state. Therefore, when the third-party software to which the determined multiple instruction information belongs includes the third-party software that is in the active state, the active state can be directly The third-party software identified as the third-party software that the user wishes to manipulate.
  • the voice processing software may determine the command information corresponding to the active third-party software as the target command information among the plurality of command information corresponding to the voice commands. For example, if it is determined that two pieces of instruction information correspond to voice instructions, and the first piece of instruction information belongs to an active third-party software, then the first piece of instruction information may be determined as the target instruction information.
  • Step 305 determining the operable instruction in the target instruction information as the operable instruction of the active third-party software.
  • the voice processing software may acquire the operable instructions included in the target instruction information, and use them as operable instructions of the active third-party software.
  • the voice processing software can filter out the operable instruction that meets the user's control intention, and then can respond to the user according to the operable instruction. voice commands.
  • step 306 the operable instruction is sent to the active third-party software for response processing.
  • step 306 is similar to that of step 203 and will not be repeated here.
  • Step 307 receiving interface change information sent by the third-party software.
  • the third-party software can send interface change information to the voice processing instruction every time the interface changes.
  • the third-party software can send interface change information to the voice processing software.
  • the interface of the third-party software may continue to send instruction registration information to the voice processing software, and the information may carry interface change information.
  • the third-party software when it exits, it may send interface change information to the voice processing software.
  • Step 308 updating the stored correspondence between third-party software and instruction information according to the interface change information.
  • the speech processing software can update the stored correspondence between the third-party software and the instruction information.
  • the instruction information stored by the voice processing software is the information of operable instructions that can be supported by the current interface of the third-party software, when the interface of the third-party software changes, the instructions of the third-party software stored in the voice processing software The information should also be updated, so that the voice processing software can find the corresponding command information according to the voice command made by the user.
  • the voice processing software can directly delete the instruction information of the third-party software.
  • the voice processing software may continue to receive the registration information sent by the third-party software, and then store instruction information corresponding to the operable instructions supported in the current interface of the third-party software.
  • the third-party software sends interface change information to the voice processing software when exiting, the third-party software will not send instruction registration information to the voice processing software again until it is started again.
  • the voice processing software can delete the voice information of the third-party software, so as to prevent the voice processing software from processing the user's voice commands according to the command information in the history interface of the third-party software, resulting in misoperation The problem.
  • Fig. 4 is a schematic flowchart of a method for controlling software by voice according to a third exemplary embodiment of the present disclosure.
  • the method for controlling software by voice in the present disclosure is applied to third-party software of the electronic device, and the electronic device can execute the method of the present disclosure based on the functions of the third-party software.
  • Speech processing software and various third-party software run in the electronic device. Any third-party software can execute the method provided by the present disclosure.
  • the method for controlling software by voice includes:
  • Step 401 receiving the operable instruction sent by the voice processing software; wherein, the operable instruction is determined in a plurality of instruction information according to the active third-party software, and the plurality of instruction information are determined according to the user's voice
  • the information determined by the instruction respectively belongs to different third-party software; the instruction information of the third-party software is stored in the voice processing software.
  • instruction information of any one or more third-party software is stored in the voice processing software.
  • instruction registration information can be sent to the voice processing software, and then the voice processing software can store the instruction information of the third-party software.
  • the speech processing software can store multiple instruction information of any third-party software.
  • the voice command initiated by the user may be an command for controlling any third-party software, and the electronic device may process it through built-in voice processing software after receiving the voice command.
  • the voice processing software can determine the command information corresponding to the voice command initiated by the current user according to the pre-stored command information of the third-party software. For example, if the voice processing software stores instruction information of the first software, the second software, and the third software, the instruction information matching the voice instruction initiated by the user may be determined among the instruction information of the three software.
  • the voice processing software determines that there are a plurality of instruction information corresponding to the voice instruction, and the different third-party software includes the third-party software in an active state, then it is determined among the plurality of instruction information corresponding to the voice instruction that it is active.
  • the operational instructions corresponding to the third-party software of the state are included in the voice processing software.
  • the voice command initiated by the user includes "next page”
  • the voice processing software determines that both the first software and the second software have instruction information corresponding to the voice command, and the first software is in an active state, then the voice processing software can Among the determined two pieces of instruction information, the operable instruction in the instruction information of the first software is obtained, and used as the operable instruction matching the real control intention of the user.
  • the voice processing software can send operable instructions to the active third-party software for response processing, and then respond to the user's voice instructions.
  • the speech processing software may send operable instructions to third-party software according to the method shown in the embodiment shown in FIG. 2 .
  • Step 402 complete response processing according to the operable instruction.
  • the third-party software indicated by the specified instruction can execute the corresponding instruction to respond. Since the operable instruction corresponds to the user's voice instruction, when the third-party software executes the operable instruction, it can achieve the effect of responding to the user's voice instruction, and then the user can control the third-party device without voice processing function by voice. Third-party software.
  • Fig. 5 is a schematic flowchart of a method for controlling software by voice according to a fourth exemplary embodiment of the present disclosure.
  • the method for controlling software by voice in the present disclosure is applied to third-party software of the electronic device, and the electronic device can execute the method of the present disclosure based on the functions of the third-party software.
  • Speech processing software and various third-party software run in the electronic device. Any third-party software can execute the method provided by the present disclosure.
  • the method for controlling software by voice includes:
  • Step 501 determine operable instructions according to the current interface of the software.
  • operable instructions can be determined according to the current interface of the program. Specifically, the operable instructions supported in the program can be determined according to the current interface of the program.
  • the third-party software can acquire information about the operable controls included in the current interface of the software; and then determine the operable instructions corresponding to the operable controls.
  • the third-party software may also determine instruction content according to the operable instruction, so as to obtain instruction information including the operable instruction and its corresponding instruction content.
  • Step 502 sending registration information for registering operable instructions to the voice processing software.
  • the third-party software can also send registration information for registering these operable instructions to the voice processing software. For example, if the current interface of the software supports the operable instructions of "next page”, "previous page” and "OK", then the third-party software can send a message to the voice processing software for registering "next page, previous page, Confirm" the registration information of the operational instruction.
  • the registration information sent by the third-party software to the voice processing software may include operable instructions.
  • the voice processing software may determine the instruction content corresponding to each operable instruction, so as to obtain the The instruction information of the instruction and its corresponding instruction content may also store the association relationship between the third-party software and the instruction information.
  • the registration information sent by the third-party software to the voice processing software may include operable instructions and corresponding instruction content, and the voice processing software may directly store the association between the third-party software and the instruction information, and the instruction The information includes operable instructions and their corresponding instruction content.
  • the third-party software may send registration information for registering instruction information to the system of the electronic device, so that the system sends the registration information to the voice processing software.
  • the voice processing software may be provided with an interface, so that third-party software can send registration information to the voice processing software through the interface.
  • the third-party software can also send registration information to the system of the electronic device, and the system forwards the registration information to the voice processing software.
  • the voice processing software may store the correspondence between the third-party software and the instruction information according to the registration information. For example, if the first software sends registration information to the voice processing software, the voice processing software can determine the instruction information according to the registration information, and store the association between the first software and the instruction information.
  • Step 503 receiving the operable instruction sent by the voice processing software; wherein, the operable instruction is determined in a plurality of instruction information according to the active third-party software, and the plurality of instruction information is determined in accordance with the user's voice instruction respectively Information belonging to different third-party software; instruction information of the third-party software is stored in the voice processing software.
  • Step 504 complete response processing according to the operable instruction.
  • steps 503 and 504 are similar to those of steps 401 and 402 and will not be repeated here.
  • Step 505 when the software interface is switched, send interface change information including interface switching information to the voice processing software; and/or, when the software exits, send interface change information including software exit information to the voice processing software.
  • the third-party software can send interface change information to the voice processing instruction every time the interface changes.
  • the third-party software may send interface change information to the voice processing software.
  • the interface of the third-party software may continue to send registration information to the voice processing software, and the information may carry interface change information.
  • the third-party software when it exits, it may send interface change information to the voice processing software.
  • the voice processing software can update the stored correspondence between third-party software and instruction information according to the interface change information. Since the instruction information stored by the voice processing software is the information of operable instructions that can be supported by the current interface of the third-party software, when the interface of the third-party software changes, the instructions of the third-party software stored in the voice processing software The information should also be updated, so that the voice processing software can find the corresponding command information according to the voice command made by the user.
  • Fig. 6 is a schematic flowchart of a method for controlling a program by voice according to a fifth exemplary embodiment of the present disclosure.
  • the method for controlling a program by voice may specifically include:
  • step a the user issues a starting instruction for starting the third-party software.
  • step b the voice recognition software starts the third-party software according to the start instruction.
  • step c the third-party software determines operable instructions according to the current interface of the software.
  • step d the third-party software sends registration information for registering operable instructions to the speech recognition software.
  • step e the speech recognition software stores the corresponding relationship between the third-party software and the instruction information according to the registration information.
  • Step f the user initiates a voice command for controlling the third-party software.
  • Step g the voice recognition software determines the instruction information corresponding to the voice instruction, if it is determined that there are multiple instruction information corresponding to the voice instruction, then it is determined among the multiple instruction information corresponding to the voice instruction that it corresponds to the active third-party software actionable instructions.
  • step i the voice recognition software sends the determined operable instructions to the active third-party software.
  • step j after receiving the operable instruction, the third-party software can execute the corresponding operable instruction, thereby responding to the operable instruction.
  • the user can control the above-mentioned third-party software through voice control, even if the third-party software does not have a voice recognition function, this effect can still be achieved.
  • Fig. 7 is a schematic structural diagram of an apparatus for controlling a program by voice according to the first exemplary embodiment of the present disclosure.
  • the device 700 for controlling programs by voice provided by the present disclosure is applied to the voice processing software of electronic equipment, and the voice processing software and multiple third-party software are running in the electronic equipment.
  • the device 700 includes :
  • An information determining unit 710 configured to receive a voice command initiated by a user for controlling third-party software, and determine command information corresponding to the voice command, wherein the voice processing software stores the command of the third-party software information;
  • the instruction determination unit 720 is configured to determine a plurality of instruction information corresponding to the voice instruction, wherein the plurality of instruction information corresponding to the voice instruction respectively belong to different third-party software, and the different third-party software If the software includes third-party software in an active state, the operable instruction corresponding to the third-party software in an active state is determined in a plurality of instruction information corresponding to the voice instruction;
  • the control unit 730 is configured to send the operable instruction to the active third-party software for response processing.
  • Fig. 8 is a schematic structural diagram of an apparatus for controlling a program by voice according to a second exemplary embodiment of the present disclosure.
  • the information determination unit 810 is similar to the information determination unit 710 in FIG. 7
  • the instruction determination unit 820 is similar to the instruction determination unit 720 in FIG.
  • Unit 830 is similar to control unit 730 in FIG. 7 .
  • the information determining unit 810 includes:
  • a content determination module 811 configured to determine the voice content included in the voice instruction
  • the information determining module 812 is configured to determine instruction information including the voice content in the stored correspondence; wherein, the instruction information includes voice content and operable instructions.
  • the instruction determination unit 820 includes:
  • a target information determining module 821 configured to determine target instruction information corresponding to the active third-party software among multiple instruction information corresponding to the voice instruction;
  • the instruction determining module 822 is configured to determine the operable instruction in the target instruction information as an operable instruction corresponding to the active third-party software.
  • a changing unit 840 is also included, configured to:
  • the stored correspondence between third-party software and instruction information is updated according to the interface change information.
  • the changing unit 840 includes:
  • the deletion module 841 is configured to delete the instruction information corresponding to the third-party software that sends the interface change information in the corresponding relationship.
  • the correspondence between the third-party software and the instruction information is determined according to registration information, and the registration information is sent by the third-party software.
  • Fig. 9 is a schematic structural diagram of an apparatus for controlling a program by voice according to a third exemplary embodiment of the present disclosure.
  • the apparatus 900 is applied to third-party software of electronic equipment, and voice processing software and multiple third-party software are running in the electronic equipment, and the apparatus includes:
  • the receiving unit 910 is configured to receive the operable instruction sent by the voice processing software; wherein, the operable instruction is determined in a plurality of instruction information according to the active third-party software, and the plurality of instruction information are determined according to The information determined by the user's voice instruction belongs to different third-party software; the instruction information of the third-party software is stored in the voice processing software;
  • the response unit 920 is configured to complete response processing according to the operable instruction.
  • Fig. 10 is a schematic structural diagram of an apparatus for controlling a program by voice according to a fourth exemplary embodiment of the present disclosure.
  • the receiving unit 1010 is similar to the receiving unit 910 in FIG. 9
  • the response unit 1020 is similar to the response unit 920 in FIG. 9 .
  • a registration unit 1030 is also included for:
  • the registration unit 1030 includes a sending module 1031, configured to:
  • the registration unit 1030 includes an instruction determination module 1032, configured to:
  • An operable instruction corresponding to the operable control is determined.
  • a changing unit 1040 is also included, configured to:
  • This disclosure provides a method, device and program product for controlling a program by voice, which is applied to the voice technology in computer technology to solve the problem that in the prior art, when it is inconvenient for the user to directly operate the mobile terminal by hand, it is impossible to truly realize the control by voice. How to control the technical problems of APP.
  • the acquisition, storage and application of the user's personal information involved are in compliance with relevant laws and regulations, and do not violate public order and good customs.
  • the present disclosure also provides an electronic device, a readable storage medium, and a computer program product.
  • the present disclosure also provides a computer program product.
  • the computer program product includes: a computer program, the computer program is stored in a readable storage medium, and at least one processor of an electronic device can read the program from the readable storage medium. Taking a computer program, at least one processor executes the computer program so that the electronic device executes the solution provided by any one of the above embodiments.
  • FIG. 11 shows a schematic block diagram of an example electronic device 1100 that may be used to implement embodiments of the present disclosure.
  • Electronic device is intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers.
  • Electronic devices may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smart phones, wearable devices, and other similar computing devices.
  • the components shown herein, their connections and relationships, and their functions, are by way of example only, and are not intended to limit implementations of the disclosure described and/or claimed herein.
  • the device 1100 includes a computing unit 1101 that can be executed according to a computer program stored in a read-only memory (ROM) 1102 or loaded from a storage unit 1108 into a random-access memory (RAM) 1103. Various appropriate actions and treatments. In the RAM 1103, various programs and data necessary for the operation of the device 1100 can also be stored.
  • the computing unit 1101, ROM 1102, and RAM 1103 are connected to each other through a bus 1104.
  • An input/output (I/O) interface 1105 is also connected to the bus 1104 .
  • the I/O interface 1105 Multiple components in the device 1100 are connected to the I/O interface 1105, including: an input unit 1106, such as a keyboard, a mouse, etc.; an output unit 1107, such as various types of displays, speakers, etc.; a storage unit 1108, such as a magnetic disk, an optical disk, etc. ; and a communication unit 1109, such as a network card, a modem, a wireless communication transceiver, and the like.
  • the communication unit 1109 allows the device 1100 to exchange information/data with other devices through a computer network such as the Internet and/or various telecommunication networks.
  • the computing unit 1101 may be various general-purpose and/or special-purpose processing components having processing and computing capabilities. Some examples of computing units 1101 include, but are not limited to, central processing units (CPUs), graphics processing units (GPUs), various dedicated artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, digital signal processing processor (DSP), and any suitable processor, controller, microcontroller, etc.
  • the computing unit 1101 executes various methods and processes described above, for example, the method of controlling software by voice.
  • the method of controlling software by voice may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 1108 .
  • part or all of the computer program may be loaded and/or installed on the device 1100 via the ROM 1102 and/or the communication unit 1109.
  • the computer program When the computer program is loaded into the RAM 1103 and executed by the computing unit 1101, one or more steps of the above-described method of controlling software by voice may be performed.
  • the computing unit 1101 may be configured in any other suitable way (for example, by means of firmware) to execute the method of controlling software by voice.
  • Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips Implemented in a system of systems (SOC), load programmable logic device (CPLD), computer hardware, firmware, software, and/or combinations thereof.
  • FPGAs field programmable gate arrays
  • ASICs application specific integrated circuits
  • ASSPs application specific standard products
  • SOC system of systems
  • CPLD load programmable logic device
  • computer hardware firmware, software, and/or combinations thereof.
  • programmable processor can be special-purpose or general-purpose programmable processor, can receive data and instruction from storage system, at least one input device, and at least one output device, and transmit data and instruction to this storage system, this at least one input device, and this at least one output device an output device.
  • Program codes for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special purpose computer, or other programmable data processing devices, so that the program codes, when executed by the processor or controller, make the functions/functions specified in the flow diagrams and/or block diagrams Action is implemented.
  • the program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.
  • a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device.
  • a machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium.
  • a machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing.
  • machine-readable storage media would include one or more wire-based electrical connections, portable computer discs, hard drives, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.
  • RAM random access memory
  • ROM read only memory
  • EPROM or flash memory erasable programmable read only memory
  • CD-ROM compact disk read only memory
  • magnetic storage or any suitable combination of the foregoing.
  • the systems and techniques described herein can be implemented on a computer having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user. ); and a keyboard and pointing device (eg, a mouse or a trackball) through which a user can provide input to the computer.
  • a display device e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor
  • a keyboard and pointing device eg, a mouse or a trackball
  • Other kinds of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and can be in any form (including Acoustic input, speech input or, tactile input) to receive input from the user.
  • the systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., as a a user computer having a graphical user interface or web browser through which a user can interact with embodiments of the systems and techniques described herein), or including such backend components, middleware components, Or any combination of front-end components in a computing system.
  • the components of the system can be interconnected by any form or medium of digital data communication, eg, a communication network. Examples of communication networks include: Local Area Network (LAN), Wide Area Network (WAN) and the Internet.
  • a computer system may include clients and servers.
  • Clients and servers are generally remote from each other and typically interact through a communication network.
  • the relationship of client and server arises by computer programs running on the respective computers and having a client-server relationship to each other.
  • the server can be a cloud server, also known as cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the problem of traditional physical host and VPS service ("Virtual Private Server", or "VPS”) Among them, there are defects such as difficult management and weak business scalability.
  • the server can also be a server of a distributed system, or a server combined with a blockchain.
  • steps may be reordered, added or deleted using the various forms of flow shown above.
  • each step described in the present disclosure may be executed in parallel, sequentially, or in a different order, as long as the desired result of the technical solution disclosed in the present disclosure can be achieved, no limitation is imposed herein.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Telephonic Communication Services (AREA)

Abstract

一种通过语音方式控制软件的方法、装置、电子设备、计算机可读存储介质及计算机程序产品，涉及语音技术，方法包括：接收用户发起的用于控制第三方软件的语音指令，确定与语音指令对应的指令信息，其中，在语音处理软件中存储有第三方软件的指令信息（201）；若确定出多个与语音指令对应的指令信息，其中，多个与语音指令对应的指令信息分别属于不同的第三方软件，且不同的第三方软件中包括处于活动状态的第三方软件，则在多个与语音指令对应的指令信息中确定与处于活动状态的第三方软件对应的可操作指令（202）；将可操作指令发送给处于活动状态的第三方软件进行响应处理（203）。通过该方法，用户可以通过语音的方式控制不具有语音处理功能的第三方软件。

Description

通过语音方式控制程序的方法、设备及程序产品
本公开要求于2021年7月23日提交中国专利局、申请号为202110838410.3、申请名称为“通过语音方式控制程序的方法、设备及程序产品”的中国专利申请的优先权，其全部内容通过引用结合在本公开中。
技术领域
本公开涉及计算机技术中的语音技术，尤其涉及一种通过语音方式控制程序的方法、设备及程序产品。
背景技术
目前，移动终端中设置有大量的软件，用户可以操作终端中的软件，从而使用软件提供的功能。
现有技术中，用户可以通过多种方式操作移动终端，使其启动软件，比如可以通过触控的方式启动软件，再比如可以利用终端中设置的语音助手调起某一个软件。
一般情况下，在用户不方便直接操作终端时，会通过语音方式控制终端，使其运行软件，但是，在软件启动后，若该软件本身不具备语音识别功能，则用户只能采用触控的方式操作该软件。因此，现有技术中在用户不方便通过触控方式操控软件时，也无法真正通过语音方式操控软件。
发明内容
本公开提供了一种通过语音方式控制程序的方法、设备及程序产品，以解决现有技术中在用户不方便用手直接操作移动终端时，无法真正实现通过语音方式操控APP的技术问题。
根据本公开的第一方面，提供了一种通过语音方式控制软件的方法，所述方法应用于电子设备的语音处理软件，所述电子设备中运行有语音处理软件和多个第三方软件，所述方法包括：
接收用户发起的用于控制第三方软件的语音指令，确定与所述语音指令对应的指令信息，其中，在所述语音处理软件中存储有所述第三方软件的指令信息；
若确定出多个与所述语音指令对应的指令信息，其中，多个与所述语音指令对应 的指令信息分别属于不同的第三方软件，且所述不同的第三方软件中包括处于活动状态的第三方软件，则在多个与所述语音指令对应的指令信息中确定与所述处于活动状态的第三方软件对应的可操作指令；
将所述可操作指令发送给处于活动状态的第三方软件进行响应处理。
根据本公开的第二方面，提供了一种通过语音方式控制软件的方法，所述方法应用于电子设备的第三方软件，所述电子设备中运行有语音处理软件和多个第三方软件，所述方法包括：
接收语音处理软件发送的可操作性指令；其中，所述可操作指令是根据处于活动状态的第三方软件在多个指令信息中确定的，多个所述指令信息是根据用户的语音指令确定的分别属于不同的第三方软件的信息；在所述语音处理软件中存储有第三方软件的指令信息；
根据所述可操作指令，完成响应处理。
根据本公开的第三方面，提供了一种通过语音方式控制软件的装置，所述装置应用于电子设备的语音处理软件，所述电子设备中运行有语音处理软件和多个第三方软件，所述装置包括：
信息确定单元，用于接收用户发起的用于控制第三方软件的语音指令，确定与所述语音指令对应的指令信息，其中，在所述语音处理软件中存储有所述第三方软件的指令信息；
指令确定单元，用于若确定出多个与所述语音指令对应的指令信息，其中，多个与所述语音指令对应的指令信息分别属于不同的第三方软件，且所述不同的第三方软件中包括处于活动状态的第三方软件，则在多个与所述语音指令对应的指令信息中确定与所述处于活动状态的第三方软件对应的可操作指令；
控制单元，用于将所述可操作指令发送给处于活动状态的第三方软件进行响应处理。
根据本公开的第四方面，提供了一种通过语音方式控制软件的装置，所述装置应用于电子设备的第三方软件，所述电子设备中运行有语音处理软件和多个第三方软件，所述装置包括：
接收单元，用于接收语音处理软件发送的可操作性指令；其中，所述可操作指令是根据处于活动状态的第三方软件在多个指令信息中确定的，多个所述指令信息是根据用户的语音指令确定的分别属于不同的第三方软件的信息；在所述语音处理软件中存储有第三方软件的指令信息；
响应单元，用于根据所述可操作指令，完成响应处理。
根据本公开的第五方面，提供了一种电子设备，包括：
至少一个处理器；以及
与所述至少一个处理器通信连接的存储器；其中，
所述存储器存储有可被所述至少一个处理器执行的指令，所述指令被所述至少一个处理器执行，以使所述至少一个处理器能够执行如第一方面或第二方面所述的方法。
根据本公开的第六方面，提供了一种存储有计算机指令的非瞬时计算机可读存储介质，其中，所述计算机指令用于使所述计算机执行如第一方面或第二方面所述的方法。
根据本公开的第七方面，提供了一种计算机程序产品，所述计算机程序产品包括：计算机程序，所述计算机程序存储在可读存储介质中，电子设备的至少一个处理器可以从所述可读存储介质读取所述计算机程序，所述至少一个处理器执行所述计算机程序使得电子设备执行第一方面或第二方面所述的方法。
本公开提供的通过语音方式控制程序的方法、设备及程序产品，语音处理软件中可以存储第三方软件的指令信息，当用户通过语音的方式操控第三方软件时，语音处理软件在存储的多个指令信息中确定出与用户的语音指令对应的指令信息，并且，若确定出多个与用户的语音指令对应的指令信息，则还可以在多个指令信息中确定与当前处于活动状态的第三方软件对应的可操作指令，再将该可操作指令发送给处于活动状态的第三方软件，使得该第三方软件能够响应用户的语音指令，通过这种实施方式，用户可以通过语音的方式控制不具有语音处理功能的第三方软件。
应当理解，本部分所描述的内容并非旨在标识本公开的实施例的关键或重要特征，也不用于限制本公开的范围。本公开的其它特征将通过以下的说明书而变得容易理解。
附图说明
附图用于更好地理解本方案，不构成对本公开的限定。其中：
图1为一示例性实施例示出的使用语音方式唤醒软件的示意图；
图2为本公开第一示例性实施例示出的通过语音方式控制软件的方法的流程示意图；
图3为本公开第二示例性实施例示出的通过语音方式控制软件的方法的流程示意图；
图4为本公开第三示例性实施例示出的通过语音方式控制软件的方法的流程示意 图；
图5为本公开第四示例性实施例示出的通过语音方式控制软件的方法的流程示意图；
图6为本公开第五示例性实施例示出的通过语音方式控制程序的方法的流程示意图；
图7为本公开第一示例性实施例示出的通过语音方式控制程序的装置的结构示意图；
图8为本公开第二示例性实施例示出的通过语音方式控制程序的装置的结构示意图；
图9为本公开第三示例性实施例示出的通过语音方式控制程序的装置的结构示意图；
图10为本公开第四示例性实施例示出的通过语音方式控制程序的装置的结构示意图；
图11为用来实现本公开实施例的通过语音方式控制程序的方法的电子设备的框图。
具体实施方式
以下结合附图对本公开的示范性实施例做出说明，其中包括本公开实施例的各种细节以助于理解，应当将它们认为仅仅是示范性的。因此，本领域普通技术人员应当认识到，可以对这里描述的实施例做出各种改变和修改，而不会背离本公开的范围和精神。同样，为了清楚和简明，以下的描述中省略了对公知功能和结构的描述。
图1为一示例性实施例示出的使用语音方式唤醒软件的示意图。
如图1所示，用户11可以说出语音指令，电子设备12中可以设置有语音识别软件。电子设备12可以利用设置的语音识别软件识别语音指令的内容，并根据语音指令的内容执行响应的操作。
例如，当语音指令的内容为“启动第一软件”时，电子设备12可以运行第一程序，其界面从状态13更新为状态14。
若第一软件具备语音识别功能，则用户可以继续基于语音控制的方式控制第一软件，若第一软件不具备语音识别功能，则用户继续基于语音方式控制第一软件时，第一软件无法做出响应。
尤其是在用户不方便使用双手控制电子设备时，电子设备只能基于用户的语音指令启动一个应用软件，但是无法继续基于用户的语音指令操控该应用软件。
为了解决上述技术问题，本公开提供的方案中，在语音处理软件中存储第三方软件的指令信息，当电子设备接收到用户发起的用于控制第三方软件的语音指令时，语音处理软件能够确定与该语音指令对应的指令信息，并根据指令信息向第三方软件发送可操作指令，使得第三方软件能够响应用户的语音指令。通过这种实施方式，用户不仅能够通过语音方式唤醒第三方软件，还能够控制启动的第三方软件。
图2为本公开第一示例性实施例示出的通过语音方式控制软件的方法的流程示意图。
本公开提供的通过语音方式控制软件的方法应用于电子设备的语音处理程序，电子设备可以基于该语音处理软件的功能执行本公开的方法。
在电子设备中运行有语音处理软件和多个第三方软件。电子设备接收到语音指令后，可以由其中运行的语音处理软件对语音指令进行处理。
其中，第三方程序是不同于语音处理软件的软件。
请继续参考图2，本公开提供的通过语音方式控制软件的方法，包括：
步骤201，接收用户发起的用于控制第三方软件的语音指令，确定与语音指令对应的指令信息，其中，在语音处理软件中存储有第三方软件的指令信息。
具体的，在语音处理软件中存储有任一个或多个第三方软件的指令信息。比如，在第三方软件运行过程中，可以向语音处理软件发送用于注册指令的注册信息，进而使语音处理软件存储该第三方软件的指令信息。实际应用时，语音处理软件可以存储任一个第三方软件的多个指令信息。
比如，存储的一条信息中可以包括指令信息及其所属的第三方软件的标识信息。例如可以是第一软件以及第一软件的一条指令信息。
进一步的，用户发起的语音指令可以是用于控制任一个第三方软件的指令，电子设备接收到该语音指令后，可以通过运行的语音处理软件对其进行处理。
一种可选的实施方式中，每条指令信息中可以包括指令内容，语音处理软件可以根据语音指令中包括的内容，以及每条指令信息中包括的指令内容，确定与该语音指令对应的指令信息。指令内容例如可以是“上一页”、“下一页”、“声音调大一点”、“声音调小一点”等等。
实际应用时，语音处理软件可以根据预存的第三方软件的指令信息，确定与当前用户发起的语音指令对应的指令信息。比如，语音处理软件存储有第一软件、第二软 件、第三软件的指令信息，则可以在这三个软件的指令信息中，确定出与用户发起的语音指令匹配的指令信息。
例如，用户发起的语音指令中包括“上一页”，则语音处理软件可以在存储的指令信息中查找与“上一页”对应的指令信息。比如第一软件为浏览器软件，则第一软件可以具有与“上一页”对应的指令信息。这种实施方式中，语音处理软件可以直接获取第一软件的与“上一页”对应的指令信息中的可操作指令，并将其发送给第一软件，使得第一软件执行该可操作指令。
在一种可选的实施方式中，再比如第二软件为电子书软件，其也可以具有与“上一页”对应的指令信息，则语音处理软件能够确定出这两个与语音指令对应的指令信息。在这种情况下，可以执行步骤202。
步骤202，若确定出多个与语音指令对应的指令信息，其中，多个与语音指令对应的指令信息分别属于不同的第三方软件，且不同的第三方软件中包括处于活动状态的第三方软件，则在多个与语音指令对应的指令信息中确定与处于活动状态的第三方软件对应的可操作指令。
若确定出多个与语音指令对应的指令信息，这多个与语音指令对应的指令信息分别属于不同的第三方软件，则语音处理软件需要确定用户希望操控的第三方软件，并在多个指令信息中筛选出该第三方软件的指令信息，进而基于该指令信息控制第三方软件。
实际应用时，一般用户操控的软件为当前处于活动状态的第三方软件，因此，当确定的多个指令信息所属的第三方软件中包括处于活动状态的第三方软件时，可以直接将该活动状态的第三方软件确定为用户希望操控的第三方软件。
其中，语音处理软件可以在确定的多个指令信息中筛选出处于活动状态的第三方软件的指令信息，并获取该指令信息中的可操作指令。
具体的，处于活动状态的第三方软件是指在电子设备的显示界面中显示的软件，比如，电子设备的界面中当前显示一个浏览器软件的界面，则该浏览器软件为处于活动状态的第三方软件。
一个实施例中，用户发起的语音指令中包括“下一页”，语音处理软件确定出第一软件、第二软件均具有与该语音指令对应的指令信息，第一软件处于活动状态，则语音处理软件可以在确定的两条指令信息中，获取第一软件的指令信息中的可操作指令，将其作为与用户的真实控制意图匹配的可操作指令。
步骤203，将可操作指令发送给处于活动状态的第三方软件进行响应处理。
实际应用时，语音处理软件可以将活动状态的第三方软件的可操作指令发送给该处于活动状态的第三方软件。
一种实施方式中，语音处理软件可以直接将可操作指令发送给处于活动状态的第三方软件，还可以将可操作指令发送给电子设备的系统，再由系统向处于活动状态的第三方软件转发。
处于活动状态的第三方软件接收到可操作指令后，可以执行相应的指令，从而做出响应。由于该可操作指令与用户的语音指令对应，因此，第三方软件执行该可操作指令时，能够达到响应用户的语音指令的效果，进而使用户可以通过语音的方式控制不具有语音处理功能的第三方软件。
本公开提供的通过语音方式控制软件的方法，方法应用于电子设备的语音处理软件，电子设备中运行有语音处理软件和多个第三方软件，方法包括：接收用户发起的用于控制第三方软件的语音指令，确定与语音指令对应的指令信息，其中，在语音处理软件中存储有第三方软件的指令信息；若确定出多个与语音指令对应的指令信息，其中，多个与语音指令对应的指令信息分别属于不同的第三方软件，且不同的第三方软件中包括处于活动状态的第三方软件，则在多个与语音指令对应的指令信息中确定与处于活动状态的第三方软件对应的可操作指令；将可操作指令发送给处于活动状态的第三方软件进行响应处理。本公开提供的通过语音方式控制软件的方法中，语音处理软件中可以存储第三方软件的指令信息，当用户通过语音的方式操控第三方软件时，语音处理软件在存储的多个指令信息中确定出与用户的语音指令对应的指令信息，并且，若确定出多个与用户的语音指令对应的指令信息，则还可以在多个指令信息中确定与当前处于活动状态的第三方软件对应的可操作指令，再将该可操作指令发送给处于活动状态的第三方软件，使得该第三方软件能够响应用户的语音指令，通过这种实施方式，用户可以通过语音的方式控制不具有语音处理功能的第三方软件。
图3为本公开第二示例性实施例示出的通过语音方式控制软件的方法的流程示意图。
本公开提供的通过语音方式控制软件的方法应用于电子设备的语音处理程序，电子设备可以基于该语音处理软件的功能执行本公开的方法。
在电子设备中运行有语音处理软件和多个第三方软件。电子设备接收到语音指令后，可以由其中运行的语音处理软件对语音指令进行处理。
请继续参考图3，本公开提供的通过语音方式控制软件的方法，包括：
步骤301，响应用于启动第三方程序的启动指令，启动第三方程序。
其中，用户可以向电子设备发送用于启动第三方软件的启动指令，该启动指令例如可以是语音形式的指令。比如，用户可以说出“打开第一软件”，则可以由电子设备中设置的语音处理软件处理该语音指令。
一种可选的实施方式中，语音处理软件接收到语音形式的启动指令后，可以直接启动相应的软件。比如，第三方软件可以设置有接口，使得语音处理软件能够通过该接口运行第三方软件。
另一种实施方式中，语音处理软件接收到语音形式的启动指令后，可以将语音形式的启动指令转换为控制指令，并将控制指令发送给电子设备的系统，再由电子设备的系统基于该控制指令启动第三方软件。
通过这种实施方式中，用户可以通过语音的方式启动第三方软件，在用户不方便用手触控电子设备时，可以通过语音控制的方式启动第三方软件。
步骤302，接收用户发起的用于控制第三方软件的语音指令，根据语音指令确定语音内容。
在语音识别软件中存储有第三方程序的指令信息。
例如，语音识别软件可以接收第三方软件发送的注册信息，注册信息用于注册可操作指令。
实际应用时，电子设备中的第三方软件启动之后，该第三方软件可以向语音处理软件发送用于注册可操作指令的注册信息。
其中，第三方软件可以根据运行过程中可以支持的可操作指令确定注册信息，并将注册指令发送给语音处理软件。
具体的，第三方软件还可以根据软件当前界面中包括的可操作控件，确定在软件当前界面中可以支持的可操作指令，并将用于注册这些可操作指令的注册信息发送给语音处理软件。例如，软件当前界面中支持“下一页”、“上一页”、“确定”的可操作指令，则该第三方软件可以向语音处理软件发送用于注册“下一页、上一页、确定”的可操作指令的注册信息。
进一步的，语音处理软件可以设置有接口，使得第三方软件可以通过该接口向语音处理软件发送注册信息。第三方软件还可以向电子设备的系统发送注册信息，由系统向语音处理软件转发该指令注册信息。
语音识别软件还可以根据注册信息存储第三方软件与指令信息间的对应关系。
实际应用时，语音处理软件接收到注册信息之后，可以根据注册信息存储第三方软件与指令信息间的对应关系。比如，第一软件向语音处理软件发送了注册信息，则 语音处理软件可以根据该注册信息确定指令信息，并存储第一软件与指令信息之间的关联关系。
通过这种实施方式，语音处理软件可以根据第三方软件发送的注册信息存储第三方软件与指令信息间的对应关系，进而使得语音处理软件能够根据用户的语音指令控制第三方软件，从而达到用户可以通过语音方式控制不具有语音处理功能的第三方软件的效果。
一种实施方式中，第三方软件向语音处理软件发送的注册信息中可以包括可操作指令，这种实施方式中，语音处理软件可以确定与各可操作指令对应的指令内容，从而得到包括可操作指令及其对应的指令内容的指令信息，还可以存储第三方软件与指令信息之间的关联关系。
另一种实施方式中，第三方软件向语音处理软件发送的注册信息中可以包括可操作指令及其对应的指令内容，语音处理软件可以直接存储第三方软件与指令信息之间的关联关系，指令信息包括可操作指令及其对应的指令内容。
例如，语音处理软件可以通过指令配置表的形式存储指令信息与第三方软件间的关联关系。该指令配置表中可以包括三列内容，一列为指令内容，一列为所属软件，另一列为可操作指令的指令格式。例如，在指令配置表的一行信息中可以包括指令内容“上一页”、指令格式“back”，所属软件为第一软件。
其中，用户可以通过语音指令控制第三方软件，比如，可以说出语音内容“上一页”，语音处理软件可以基于语音处理算法确定用户说出的语音指令中包括的语音内容，比如，可以处理出用户说出的语音指令中的语音内容为“上一页”。
步骤303，在存储的对应关系中，确定包括语音内容的指令信息；其中，指令信息中包括语音内容、可操作指令。
具体的，语音处理软件中存储有指令信息和第三方软件间的对应关系，语音处理软件具体可以在这些对应关系中，确定指令信息中包括上述语音内容的对应关系。
比如，在存储的对应关系中包括两条对应关系，对应关系1中包括指令信息1与第一软件之间的对应关系；对应关系2中包括指令信息2与第二软件之间的对应关系。在指令信息1中包括的语音内容为“上一页”，在指令信息2中包括的语音内容为“上一页”。
进一步的，若用户做出的语音指令中包括语音内容“上一页”，则语音处理软件可以确定包括该语音内容的指令信息1和指令信息2。
通过这种实施方式中，语音处理软件能够基于预先存储的指令信息与第三方软件 间的对应关系，确定与用户做出的语音指令对应的指令信息，进而可以将语音指令转换为指令信息，以实现利用确定的指令信息控制第三方软件的目的。
步骤304，若确定出多个与语音指令对应的指令信息，其中，多个与语音指令对应的指令信息分别属于不同的第三方软件，且不同的第三方软件中包括处于活动状态的第三方软件，则在多个与语音指令对应的指令信息中，确定属于处于活动状态的第三方软件的目标指令信息。
若确定出多个与语音指令对应的指令信息，这多个与语音指令对应的指令信息分别属于不同的第三方软件，则语音处理软件需要确定用户希望操控的第三方软件，并在多个指令信息中筛选出该第三方软件的指令信息，进而基于该指令信息控制第三方软件。
实际应用时，一般用户操控的软件为当前处于活动状态的第三方软件，因此，当确定的多个指令信息所属的第三方软件中包括处于活动状态的第三方软件时，可以直接将该活动状态的第三方软件确定为用户希望操控的第三方软件。
其中，语音处理软件可以在多个与语音指令对应的指令信息中，将与处于活动状态的第三方软件对应的指令信息确定为目标指令信息。比如，确定出两条指令信息与语音指令对应，其中第一条指令信息属于处于活动状态的第三方软件，则可以将第一条指令信息确定为目标指令信息。
步骤305，将目标指令信息中的可操作指令确定为处于活动状态的第三方软件的可操作指令。
具体的，语音处理软件可以获取目标指令信息中包括的可操作指令，将其作为处于活动状态的第三方软件的可操作指令。
在这种实施方式中，当确定出多个与用户发起的语音指令对应的指令信息时，语音处理软件可以在其中筛选出符合用户控制意图的可操作指令，进而可以根据该可操作指令响应用户的语音指令。
步骤306，将可操作指令发送给处于活动状态的第三方软件进行响应处理。
步骤306与步骤203的实现方式类似，不再赘述。
步骤307，接收第三方软件发送的界面变更信息。
具体的，若第三方软件根据软件界面中支持的可操作指令向语音处理软件发送指令注册信息，则第三方软件在每次发生了界面变更时，都可以向语音处理指令发送界面变更信息。
例如，在第三方软件的界面发生了切换时，该第三方软件可以向语音处理软件发 送界面变更信息。
在一种实施方式中，第三方软件的界面切换后，其可以继续向语音处理软件发送指令注册信息，该信息中可以携带界面变更信息。
在另一种实施方式中，第三方软件退出时，其可以向语音处理软件发送界面变更信息。
步骤308，根据界面变更信息更新存储的第三方软件与指令信息间的对应关系。
进一步的，语音处理软件接收到了第三方软件发送的界面变更信息后，可以更新存储的该第三方软件与指令信息间的对应关系。
由于语音处理软件存储的指令信息是第三方软件的当前界面中可以支持的可操作指令的信息，因此，当第三方软件的界面发生了变化后，语音处理软件中存储的该第三方软件的指令信息也应当被更新，从而使语音处理软件能够根据用户做出的语音指令查找到与之对应的指令信息。
一种实施方式中，若语音处理软件接收到第三方软件发送的界面变更信息，则语音处理软件可以直接删除该第三方软件的指令信息。
此后，语音处理软件可以继续接收该第三方软件发送的注册信息，进而存储与该第三方软件当前界面中支持的可操作指令对应的指令信息。
进一步的，若第三方软件是在退出时向语音处理软件发送的界面变更信息，则第三方软件再次启动前，不会再次向语音处理软件发送指令注册信息。
实际应用时，第三方软件的界面变更后，语音处理软件能够删除该第三方软件的语音信息，从而避免语音处理软件根据第三方软件历史界面的指令信息对用户的语音指令进行处理，造成误操作的问题。
图4为本公开第三示例性实施例示出的通过语音方式控制软件的方法的流程示意图。
本公开提供的通过语音方式控制软件的方法应用于电子设备的第三方软件，电子设备可以基于该第三方软件的功能执行本公开的方法。
在电子设备中运行有语音处理软件和多个第三方软件。任一个第三方软件都可以执行本公开提供的方法。
请继续参考图4，本公开提供的通过语音方式控制软件的方法，包括：
步骤401，接收语音处理软件发送的可操作性指令；其中，所述可操作指令是根据处于活动状态的第三方软件在多个指令信息中确定的，多个所述指令信息是根据用 户的语音指令确定的分别属于不同的第三方软件的信息；在所述语音处理软件中存储有第三方软件的指令信息。
其中，在语音处理软件中存储有任一个或多个第三方软件的指令信息。比如，在第三方软件运行过程中，可以向语音处理软件发送指令注册信息，进而使语音处理软件存储该第三方软件的指令信息。实际应用时，语音处理软件可以存储任一个第三方软件的多个指令信息。
进一步的，用户发起的语音指令可以是用于控制任一个第三方软件的指令，电子设备接收到该语音指令后，可以通过内置的语音处理软件对其进行处理。
实际应用时，语音处理软件可以根据预存的第三方软件的指令信息，确定与当前用户发起的语音指令对应的指令信息。比如，语音处理软件存储有第一软件、第二软件、第三软件的指令信息，则可以在这三个软件的指令信息中，确定出与用户发起的语音指令匹配的指令信息。
其中，若语音处理软件确定具有多个与语音指令对应的指令信息，且不同的第三方软件中包括处于活动状态的第三方软件，则在多个与语音指令对应的指令信息中确定与处于活动状态的第三方软件对应的可操作指令。
例如，用户发起的语音指令中包括“下一页”，语音处理软件确定出第一软件、第二软件均具有与该语音指令对应的指令信息，第一软件处于活动状态，则语音处理软件可以在确定的两条指令信息中，获取第一软件的指令信息中的可操作指令，将其作为与用户的真实控制意图匹配的可操作指令。
语音处理软件可以将可操作指令发送给处于活动状态的第三方软件进行响应处理，进而响应用户的语音指令。
语音处理软件具体可以根据图2所示实施例示出的方法，向第三方软件发送可操作指令。
步骤402，根据可操作指令，完成响应处理。
指定指令指示的第三方软件接收到可操作指令后，可以执行相应的指令，从而做出响应。由于该可操作指令与用户的语音指令对应，因此，第三方软件执行该可操作指令时，能够达到响应用户的语音指令的效果，进而使用户可以通过语音的方式控制不具有语音处理功能的第三方软件。
图5为本公开第四示例性实施例示出的通过语音方式控制软件的方法的流程示意图。
本公开提供的通过语音方式控制软件的方法应用于电子设备的第三方软件，电子 设备可以基于该第三方软件的功能执行本公开的方法。
在电子设备中运行有语音处理软件和多个第三方软件。任一个第三方软件都可以执行本公开提供的方法。
请继续参考图5，本公开提供的通过语音方式控制软件的方法，包括：
步骤501，根据软件当前界面确定可操作指令。
其中，第三方程序在启动后，可以根据程序当前界面确定可操作指令。具体可以根据程序当前界面，确定其中支持的可操作指令。
具体的，第三方软件可以获取软件当前界面中包括的可操作控件的信息；再确定与可操作控件对应的可操作指令。
在一种可选的实施方式中，第三方软件还可以根据可操作指令确定指令内容，从而得到包括可操作指令及其对应的指令内容的指令信息。
步骤502，向语音处理软件发送用于注册可操作指令的注册信息。
第三方软件还可以将用于注册这些可操作指令的注册信息发送给语音处理软件。例如，软件当前界面中支持“下一页”、“上一页”、“确定”的可操作指令，则该第三方软件可以向语音处理软件发送用于注册“下一页、上一页、确定”的可操作指令的注册信息。
一种实施方式中，第三方软件向语音处理软件发送的注册信息中可以包括可操作指令，这种实施方式中，语音处理软件可以确定与各可操作指令对应的指令内容，从而得到包括可操作指令及其对应的指令内容的指令信息，还可以存储第三方软件与指令信息之间的关联关系。
另一种实施方式中，第三方软件向语音处理软件发送的注册信息中可以包括可操作指令及其对应的指令内容，语音处理软件可以直接存储第三方软件与指令信息之间的关联关系，指令信息包括可操作指令及其对应的指令内容。
进一步的，第三方软件可以向电子设备的系统发送用于注册指令信息的注册信息，以使系统向语音处理软件发送注册信息。
另一种实施方式中，语音处理软件可以设置有接口，使得第三方软件可以通过该接口向语音处理软件发送注册信息。第三方软件还可以向电子设备的系统发送注册信息，由系统向语音处理软件转发该注册信息。
具体的，语音处理软件接收到注册信息之后，可以根据注册信息存储与第三方软件与指令信息间的对应关系。比如，第一软件向语音处理软件发送了注册信息，则语音处理软件可以根据该注册信息确定指令信息，并存储第一软件与指令信息之间的关 联关系。
步骤503，接收语音处理软件发送的可操作性指令；其中，可操作指令是根据处于活动状态的第三方软件在多个指令信息中确定的，多个指令信息是根据用户的语音指令确定的分别属于不同的第三方软件的信息；在语音处理软件中存储有第三方软件的指令信息。
步骤504，根据可操作指令，完成响应处理。
步骤503、504的实现方式与步骤401、402类似，不再赘述。
步骤505，在软件界面切换时，向语音处理软件发送包括界面切换信息的界面变更信息；和/或，在软件退出时，向语音处理软件发送包括软件退出信息的界面变更信息。
具体的，若第三方软件根据软件界面中支持的可操作指令向语音处理软件发送指令注册信息，则第三方软件在每次发生了界面变更时，都可以向语音处理指令发送界面变更信息。
例如，在第三方软件的界面发生了切换时，该第三方软件可以向语音处理软件发送界面变更信息。
在一种实施方式中，第三方软件的界面切换后，其可以继续向语音处理软件发送注册信息，该信息中可以携带界面变更信息。
在另一种实施方式中，第三方软件退出时，其可以向语音处理软件发送界面变更信息。
语音处理软件可以根据界面变更信息更新存储的第三方软件与指令信息间的对应关系。由于语音处理软件存储的指令信息是第三方软件的当前界面中可以支持的可操作指令的信息，因此，当第三方软件的界面发生了变化后，语音处理软件中存储的该第三方软件的指令信息也应当被更新，从而使语音处理软件能够根据用户做出的语音指令查找到与之对应的指令信息。
图6为本公开第五示例性实施例示出的通过语音方式控制程序的方法的流程示意图。
如图6所示，在本公开提供的通过语音方式控制程序的方法中，具体可以包括：
步骤a，用户发出用于启动第三方软件的启动指令。
步骤b，语音识别软件根据该启动指令，启动第三方软件。
步骤c，第三方软件根据软件当前界面确定可操作指令。
步骤d，第三方软件向语音识别软件发送用于注册可操作指令的注册信息。
步骤e，语音识别软件根据注册信息存储第三方软件与指令信息间的对应关系。
步骤f，用户发起用于控制第三方软件的语音指令。
步骤g，语音识别软件确定与语音指令对应的指令信息，若确定具有多个与语音指令对应的指令信息，则在多个与语音指令对应的指令信息中确定与处于活动状态的第三方软件对应的可操作指令。
步骤i，语音识别软件将确定的可操作指令发送给处于活动状态的第三方软件。
步骤j，第三方软件接收到可操作指令后，可以执行相应的可操作指令，从而响应可操作指令。
通过上述流程，可以实现用户通过语音控制的方式控制上述第三方软件，即使该第三方软件不具备语音识别功能，依然可以实现该效果。
图7为本公开第一示例性实施例示出的通过语音方式控制程序的装置的结构示意图。
如图7所示，本公开提供的通过语音方式控制程序的装置700，应用于电子设备的语音处理软件，所述电子设备中运行有语音处理软件和多个第三方软件，所述装置700包括：
信息确定单元710，用于接收用户发起的用于控制第三方软件的语音指令，确定与所述语音指令对应的指令信息，其中，在所述语音处理软件中存储有所述第三方软件的指令信息；
指令确定单元720，用于若确定出多个与所述语音指令对应的指令信息，其中，多个与所述语音指令对应的指令信息分别属于不同的第三方软件，且所述不同的第三方软件中包括处于活动状态的第三方软件，则在多个与所述语音指令对应的指令信息中确定与所述处于活动状态的第三方软件对应的可操作指令；
控制单元730，用于将所述可操作指令发送给处于活动状态的第三方软件进行响应处理。
本公开提供的通过语音方式控制程序的装置与图2所示实施例的实现方式、原理及效果类似，不再赘述。
图8为本公开第二示例性实施例示出的通过语音方式控制程序的装置的结构示意图。
如图8所示，本公开提供的通过语音方式控制程序的装置800，信息确定单元810与图7中的信息确定单元710类似，指令确定单元820与图7中的指令确定单元720类似，控制单元830与图7中的控制单元730类似。
在图7所示实施例的基础上，本公开提供的语音方式控制程序的装置800中，所述信息确定单元810，包括：
内容确定模块811，用于确定所述语音指令中包括的语音内容；
信息确定模块812，用于在存储的所述对应关系中，确定包括所述语音内容的指令信息；其中，所述指令信息中包括语音内容、可操作指令。
一种可选的实施方式中，所述指令确定单元820，包括：
目标信息确定模块821，用于在多个与所述语音指令对应的指令信息中，确定与所述处于活动状态的第三方软件对应的目标指令信息；
指令确定模块822，用于将所述目标指令信息中的可操作指令确定为与所述处于活动状态的第三方软件对应的可操作指令。
一种可选的实施方式中，还包括变更单元840，用于：
接收第三方软件发送的界面变更信息；
根据所述界面变更信息更新存储的第三方软件与指令信息间的对应关系。
一种可选的实施方式中，变更单元840包括：
删除模块841，用于删除所述对应关系中，与发送所述界面变更信息的第三方软件对应的指令信息。
一种可选的实施方式中，所述第三方软件与所述指令信息间的对应关系是根据注册信息确定的，所述注册信息是第三方软件发送的。
本公开提供的通过语音方式控制程序的装置与图3所示实施例的实现方式、原理及效果类似，不再赘述。
图9为本公开第三示例性实施例示出的通过语音方式控制程序的装置的结构示意图。
如图9所示，所述装置900应用于电子设备的第三方软件，所述电子设备中运行有语音处理软件和多个第三方软件，所述装置包括：
接收单元910，用于接收语音处理软件发送的可操作性指令；其中，所述可操作指令是根据处于活动状态的第三方软件在多个指令信息中确定的，多个所述指令信息 是根据用户的语音指令确定的分别属于不同的第三方软件的信息；在所述语音处理软件中存储有第三方软件的指令信息；
响应单元920，用于根据所述可操作指令，完成响应处理。
本公开提供的通过语音方式控制程序的装置与图4所示实施例的实现方式、原理及效果类似，不再赘述。
图10为本公开第四示例性实施例示出的通过语音方式控制程序的装置的结构示意图。
如图10所示，本公开提供的语音方式控制程序的装置1000中，接收单元1010与图9中的接收单元910类似，响应单元1020与图9中的响应单元920类似。
在图9所示实施例基础上，还包括注册单元1030，用于：
根据软件当前界面确定可操作指令；
向所述语音处理软件发送用于注册所述可操作指令的注册信息。
一种可选的实施方式中，所述注册单元1030，包括发送模块1031，用于：
向所述电子设备的系统发送用于注册所述可操作指令的注册信息，以使所述系统向所述语音处理软件发送所述注册信息。
一种可选的实施方式中，所述注册单元1030，包括指令确定模块1032，用于：
获取软件当前界面中包括的可操作控件的信息；
确定与所述可操作控件对应的可操作指令。
一种可选的实施方式中，还包括变更单元1040，用于：
在软件界面切换时，向所述语音处理软件发送包括界面切换信息的界面变更信息；
和/或，在软件退出时，向所述语音处理软件发送包括软件退出信息的界面变更信息。
本公开提供的通过语音方式控制程序的装置与图5所示实施例的实现方式、原理及效果类似，不再赘述。
本公开提供一种通过语音方式控制程序的方法、设备及程序产品，应用于计算机技术中的语音技术，以解决现有技术中在用户不方便用手直接操作移动终端时，无法真正实现通过语音方式操控APP的技术问题。
本公开的技术方案中，所涉及的用户个人信息的获取，存储和应用等，均符合相 关法律法规的规定，且不违背公序良俗。
根据本公开的实施例，本公开还提供了一种电子设备、一种可读存储介质和一种计算机程序产品。
根据本公开的实施例，本公开还提供了一种计算机程序产品，计算机程序产品包括：计算机程序，计算机程序存储在可读存储介质中，电子设备的至少一个处理器可以从可读存储介质读取计算机程序，至少一个处理器执行计算机程序使得电子设备执行上述任一实施例提供的方案。
图11示出了可以用来实施本公开的实施例的示例电子设备1100的示意性框图。电子设备旨在表示各种形式的数字计算机，诸如，膝上型计算机、台式计算机、工作台、个人数字助理、服务器、刀片式服务器、大型计算机、和其它适合的计算机。电子设备还可以表示各种形式的移动装置，诸如，个人数字处理、蜂窝电话、智能电话、可穿戴设备和其它类似的计算装置。本文所示的部件、它们的连接和关系、以及它们的功能仅仅作为示例，并且不意在限制本文中描述的和/或者要求的本公开的实现。
如图11所示，设备1100包括计算单元1101，其可以根据存储在只读存储器(ROM)1102中的计算机程序或者从存储单元1108加载到随机访问存储器(RAM)1103中的计算机程序，来执行各种适当的动作和处理。在RAM 1103中，还可存储设备1100操作所需的各种程序和数据。计算单元1101、ROM 1102以及RAM 1103通过总线1104彼此相连。输入/输出(I/O)接口1105也连接至总线1104。
设备1100中的多个部件连接至I/O接口1105，包括：输入单元1106，例如键盘、鼠标等；输出单元1107，例如各种类型的显示器、扬声器等；存储单元1108，例如磁盘、光盘等；以及通信单元1109，例如网卡、调制解调器、无线通信收发机等。通信单元1109允许设备1100通过诸如因特网的计算机网络和/或各种电信网络与其他设备交换信息/数据。
计算单元1101可以是各种具有处理和计算能力的通用和/或专用处理组件。计算单元1101的一些示例包括但不限于中央处理单元(CPU)、图形处理单元(GPU)、各种专用的人工智能(AI)计算芯片、各种运行机器学习模型算法的计算单元、数字信号处理器(DSP)、以及任何适当的处理器、控制器、微控制器等。计算单元1101执行上文所描述的各个方法和处理，例如通过语音方式控制软件的方法。例如，在一些实施例中，通过语音方式控制软件的方法可被实现为计算机软件程序，其被有形地包含于机器可读介质，例如存储单元1108。在一些实施例中，计算机程序的部分或者全部可以经由ROM 1102和/或通信单元1109而被载入和/或安装到设备1100上。当计 算机程序加载到RAM 1103并由计算单元1101执行时，可以执行上文描述的通过语音方式控制软件的方法的一个或多个步骤。备选地，在其他实施例中，计算单元1101可以通过其他任何适当的方式(例如，借助于固件)而被配置为执行通过语音方式控制软件的方法。
本文中以上描述的系统和技术的各种实施方式可以在数字电子电路系统、集成电路系统、场可编程门阵列(FPGA)、专用集成电路(ASIC)、专用标准产品(ASSP)、芯片上系统的系统(SOC)、负载可编程逻辑设备(CPLD)、计算机硬件、固件、软件、和/或它们的组合中实现。这些各种实施方式可以包括：实施在一个或者多个计算机程序中，该一个或者多个计算机程序可在包括至少一个可编程处理器的可编程系统上执行和/或解释，该可编程处理器可以是专用或者通用可编程处理器，可以从存储系统、至少一个输入装置、和至少一个输出装置接收数据和指令，并且将数据和指令传输至该存储系统、该至少一个输入装置、和该至少一个输出装置。
用于实施本公开的方法的程序代码可以采用一个或多个编程语言的任何组合来编写。这些程序代码可以提供给通用计算机、专用计算机或其他可编程数据处理装置的处理器或控制器，使得程序代码当由处理器或控制器执行时使流程图和/或框图中所规定的功能/操作被实施。程序代码可以完全在机器上执行、部分地在机器上执行，作为独立软件包部分地在机器上执行且部分地在远程机器上执行或完全在远程机器或服务器上执行。
在本公开的上下文中，机器可读介质可以是有形的介质，其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的程序。机器可读介质可以是机器可读信号介质或机器可读储存介质。机器可读介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备，或者上述内容的任何合适组合。机器可读存储介质的更具体示例会包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或快闪存储器)、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何合适组合。
为了提供与用户的交互，可以在计算机上实施此处描述的系统和技术，该计算机具有：用于向用户显示信息的显示装置(例如，CRT(阴极射线管)或者LCD(液晶显示器)监视器)；以及键盘和指向装置(例如，鼠标或者轨迹球)，用户可以通过该键盘和该指向装置来将输入提供给计算机。其它种类的装置还可以用于提供与用户的交互；例如，提供给用户的反馈可以是任何形式的传感反馈(例如，视觉反馈、听 觉反馈、或者触觉反馈)；并且可以用任何形式(包括声输入、语音输入或者、触觉输入)来接收来自用户的输入。
可以将此处描述的系统和技术实施在包括后台部件的计算系统(例如，作为数据服务器)、或者包括中间件部件的计算系统(例如，应用服务器)、或者包括前端部件的计算系统(例如，具有图形用户界面或者网络浏览器的用户计算机，用户可以通过该图形用户界面或者该网络浏览器来与此处描述的系统和技术的实施方式交互)、或者包括这种后台部件、中间件部件、或者前端部件的任何组合的计算系统中。可以通过任何形式或者介质的数字数据通信(例如，通信网络)来将系统的部件相互连接。通信网络的示例包括：局域网(LAN)、广域网(WAN)和互联网。
计算机系统可以包括客户端和服务器。客户端和服务器一般远离彼此并且通常通过通信网络进行交互。通过在相应的计算机上运行并且彼此具有客户端-服务器关系的计算机程序来产生客户端和服务器的关系。服务器可以是云服务器，又称为云计算服务器或云主机，是云计算服务体系中的一项主机产品，以解决了传统物理主机与VPS服务("Virtual Private Server"，或简称"VPS")中，存在的管理难度大，业务扩展性弱的缺陷。服务器也可以为分布式系统的服务器，或者是结合了区块链的服务器。
应该理解，可以使用上面所示的各种形式的流程，重新排序、增加或删除步骤。例如，本发公开中记载的各步骤可以并行地执行也可以顺序地执行也可以不同的次序执行，只要能够实现本公开公开的技术方案所期望的结果，本文在此不进行限制。
上述具体实施方式，并不构成对本公开保护范围的限制。本领域技术人员应该明白的是，根据设计要求和其他因素，可以进行各种修改、组合、子组合和替代。任何在本公开的精神和原则之内所作的修改、等同替换和改进等，均应包含在本公开保护范围之内。

Claims (25)

  1. 一种通过语音方式控制软件的方法，所述方法应用于电子设备的语音处理软件，所述电子设备中运行有语音处理软件和多个第三方软件，所述方法包括：
    接收用户发起的用于控制第三方软件的语音指令，确定与所述语音指令对应的指令信息，其中，在所述语音处理软件中存储有所述第三方软件的指令信息；
    若确定出多个与所述语音指令对应的指令信息，其中，多个与所述语音指令对应的指令信息分别属于不同的第三方软件，且所述不同的第三方软件中包括处于活动状态的第三方软件，则在多个与所述语音指令对应的指令信息中确定与所述处于活动状态的第三方软件对应的可操作指令；
    将所述可操作指令发送给处于活动状态的第三方软件进行响应处理。
  2. 根据权利要求1所述的方法，其中，所述确定与所述语音指令对应的指令信息，包括：
    根据所述语音指令确定语音内容；
    在存储的所述对应关系中，确定包括所述语音内容的指令信息；其中，所述指令信息中包括语音内容、可操作指令。
  3. 根据权利要求1或2所述的方法，其中，所述在多个与所述语音指令对应的指令信息中确定与处于活动状态的第三方软件对应的可操作指令，包括：
    在多个与所述语音指令对应的指令信息中，确定属于处于活动状态的第三方软件的目标指令信息；
    将所述目标指令信息中的可操作指令确定为处于活动状态的第三方软件的可操作指令。
  4. 根据权利要求1-3任一项所述的方法，还包括：
    接收第三方软件发送的界面变更信息；
    根据所述界面变更信息更新存储的第三方软件与指令信息间的对应关系。
  5. 根据权利要求4所述的方法，其中，根据所述界面变更信息更新存储的第三方软件与所述指令信息间的对应关系，包括：
    删除所述对应关系中，与发送所述界面变更信息的第三方软件对应的指令信息。
  6. 根据权利要求1-5任一项所述的方法，所述第三方软件与所述指令信息间的对应关系是根据注册信息确定的，所述注册信息是第三方软件发送的。
  7. 一种通过语音方式控制软件的方法，所述方法应用于电子设备的第三方软件， 所述电子设备中运行有语音处理软件和多个第三方软件，所述方法包括：
    接收语音处理软件发送的可操作性指令；其中，所述可操作指令是根据处于活动状态的第三方软件在多个指令信息中确定的，多个所述指令信息是根据用户的语音指令确定的分别属于不同的第三方软件的信息；在所述语音处理软件中存储有第三方软件的指令信息；
    根据所述可操作指令，完成响应处理。
  8. 根据权利要求7所述的方法，还包括：
    根据软件当前界面确定可操作指令；
    向所述语音处理软件发送用于注册所述可操作指令的注册信息。
  9. 根据权利要求8所述的方法，其中，所述向所述语音处理软件发送用于注册所述可操作指令的注册信息，包括：
    向所述电子设备的系统发送用于注册所述可操作指令的注册信息，以使所述系统向所述语音处理软件发送所述注册信息。
  10. 根据权利要求8所述的方法，其中，根据软件当前界面确定可操作指令包括：
    获取软件当前界面中包括的可操作控件的信息；
    确定与所述可操作控件对应的可操作指令。
  11. 根据权利要求7-10任一项所述的方法，还包括：
    在软件界面切换时，向所述语音处理软件发送包括界面切换信息的界面变更信息；
    和/或，在软件退出时，向所述语音处理软件发送包括软件退出信息的界面变更信息。
  12. 一种通过语音方式控制软件的装置，所述装置应用于电子设备的语音处理软件，所述电子设备中运行有语音处理软件和多个第三方软件，所述装置包括：
    信息确定单元，用于接收用户发起的用于控制第三方软件的语音指令，确定与所述语音指令对应的指令信息，其中，在所述语音处理软件中存储有所述第三方软件的指令信息；
    指令确定单元，用于若确定出多个与所述语音指令对应的指令信息，其中，多个与所述语音指令对应的指令信息分别属于不同的第三方软件，且所述不同的第三方软件中包括处于活动状态的第三方软件，则在多个与所述语音指令对应的指令信息中确定与所述处于活动状态的第三方软件对应的可操作指令；
    控制单元，用于将所述可操作指令发送给处于活动状态的第三方软件进行响应处理。
  13. 根据权利要求12所述的装置，其中，所述信息确定单元，包括：
    内容确定模块，用于确定所述语音指令中包括的语音内容；
    信息确定模块，用于在存储的所述对应关系中，确定包括所述语音内容的指令信息；其中，所述指令信息中包括语音内容、可操作指令。
  14. 根据权利要求12或13所述的装置，其中，所述指令确定单元，包括：
    目标信息确定模块，用于在多个与所述语音指令对应的指令信息中，确定与所述处于活动状态的第三方软件对应的目标指令信息；
    指令确定模块，用于将所述目标指令信息中的可操作指令确定为与所述处于活动状态的第三方软件对应的可操作指令。
  15. 根据权利要求12-14任一项所述的装置，还包括变更单元，用于：
    接收第三方软件发送的界面变更信息；
    根据所述界面变更信息更新存储的第三方软件与指令信息间的对应关系。
  16. 根据权利要求15所述的装置，其中，变更单元包括：
    删除模块，用于删除所述对应关系中，与发送所述界面变更信息的第三方软件对应的指令信息。
  17. 根据权利要求12-16任一项所述的装置，所述第三方软件与所述指令信息间的对应关系是根据注册信息确定的，所述注册信息是第三方软件发送的。
  18. 一种通过语音方式控制软件的装置，所述装置应用于电子设备的第三方软件，所述电子设备中运行有语音处理软件和多个第三方软件，所述装置包括：
    接收单元，用于接收语音处理软件发送的可操作性指令；其中，所述可操作指令是根据处于活动状态的第三方软件在多个指令信息中确定的，多个所述指令信息是根据用户的语音指令确定的分别属于不同的第三方软件的信息；在所述语音处理软件中存储有第三方软件的指令信息；
    响应单元，用于根据所述可操作指令，完成响应处理。
  19. 根据权利要求18所述的装置，还包括注册单元，用于：
    根据软件当前界面确定可操作指令；
    向所述语音处理软件发送用于注册所述可操作指令的注册信息。
  20. 根据权利要求19所述的装置，其中，所述注册单元，包括发送模块，用于：
    向所述电子设备的系统发送用于注册所述可操作指令的注册信息，以使所述系统向所述语音处理软件发送所述注册信息。
  21. 根据权利要求19所述的装置，其中，所述注册单元，包括指令确定模块，用 于：
    获取软件当前界面中包括的可操作控件的信息；
    确定与所述可操作控件对应的可操作指令。
  22. 根据权利要求18-21任一项所述的装置，还包括变更单元，用于：
    在软件界面切换时，向所述语音处理软件发送包括界面切换信息的界面变更信息；
    和/或，在软件退出时，向所述语音处理软件发送包括软件退出信息的界面变更信息。
  23. 一种电子设备，包括：
    至少一个处理器；以及
    与所述至少一个处理器通信连接的存储器；其中，
    所述存储器存储有可被所述至少一个处理器执行的指令，所述指令被所述至少一个处理器执行，以使所述至少一个处理器能够执行权利要求1-6或7-11中任一项所述的方法。
  24. 一种存储有计算机指令的非瞬时计算机可读存储介质，其中，所述计算机指令用于使所述计算机执行根据权利要求1-6或7-11中任一项所述的方法。
  25. 一种计算机程序产品，包括计算机程序，所述计算机程序在被处理器执行时实现根据权利要求1-6或7-11中任一项所述的方法。
PCT/CN2022/082103 2021-07-23 2022-03-21 通过语音方式控制程序的方法、设备及程序产品 WO2023000697A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110838410.3 2021-07-23
CN202110838410.3A CN113593555A (zh) 2021-07-23 2021-07-23 通过语音方式控制程序的方法、设备及程序产品

Publications (1)

Publication Number Publication Date
WO2023000697A1 true WO2023000697A1 (zh) 2023-01-26

Family

ID=78249304

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/082103 WO2023000697A1 (zh) 2021-07-23 2022-03-21 通过语音方式控制程序的方法、设备及程序产品

Country Status (2)

Country Link
CN (1) CN113593555A (zh)
WO (1) WO2023000697A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113496703A (zh) * 2021-07-23 2021-10-12 北京百度网讯科技有限公司 通过语音方式控制程序的方法、设备及程序产品
CN113593555A (zh) * 2021-07-23 2021-11-02 北京百度网讯科技有限公司 通过语音方式控制程序的方法、设备及程序产品

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102566961A (zh) * 2010-12-31 2012-07-11 上海博泰悦臻电子设备制造有限公司 基于车载设备的应用程序的语音执行方法及装置
JP2014071449A (ja) * 2012-09-28 2014-04-21 Samsung Electronics Co Ltd 電子装置、サーバー及びその制御方法
CN106023994A (zh) * 2016-04-29 2016-10-12 杭州华橙网络科技有限公司 一种语音处理的方法、装置以及系统
CN110058835A (zh) * 2019-02-26 2019-07-26 百度国际科技（深圳）有限公司 设备控制方法、装置及设备
CN110580904A (zh) * 2019-09-29 2019-12-17 百度在线网络技术（北京）有限公司 通过语音控制小程序的方法、装置、电子设备及存储介质
CN110782889A (zh) * 2019-08-22 2020-02-11 腾讯科技（深圳）有限公司 一种语音操作方法及相关设备
CN112863512A (zh) * 2021-01-18 2021-05-28 深圳创维－Rgb电子有限公司 一种语音交互调用处理方法、装置、终端设备及存储介质
CN113593555A (zh) * 2021-07-23 2021-11-02 北京百度网讯科技有限公司 通过语音方式控制程序的方法、设备及程序产品

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20180060328A (ko) * 2016-11-28 2018-06-07 삼성전자주식회사 멀티 모달 입력을 처리하는 전자 장치, 멀티 모달 입력을 처리하는 방법 및 멀티 모달 입력을 처리하는 서버
CN110647305B (zh) * 2019-09-29 2023-10-31 阿波罗智联(北京)科技有限公司 应用程序的语音交互方法、装置、设备和介质
CN110853645A (zh) * 2019-12-02 2020-02-28 三星电子（中国）研发中心 一种识别语音命令的方法及装置
CN112634896B (zh) * 2020-12-30 2023-04-11 智道网联科技(北京)有限公司 智能终端上应用程序的运行方法和智能终端

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102566961A (zh) * 2010-12-31 2012-07-11 上海博泰悦臻电子设备制造有限公司 基于车载设备的应用程序的语音执行方法及装置
JP2014071449A (ja) * 2012-09-28 2014-04-21 Samsung Electronics Co Ltd 電子装置、サーバー及びその制御方法
CN106023994A (zh) * 2016-04-29 2016-10-12 杭州华橙网络科技有限公司 一种语音处理的方法、装置以及系统
CN110058835A (zh) * 2019-02-26 2019-07-26 百度国际科技（深圳）有限公司 设备控制方法、装置及设备
CN110782889A (zh) * 2019-08-22 2020-02-11 腾讯科技（深圳）有限公司 一种语音操作方法及相关设备
CN110580904A (zh) * 2019-09-29 2019-12-17 百度在线网络技术（北京）有限公司 通过语音控制小程序的方法、装置、电子设备及存储介质
CN112863512A (zh) * 2021-01-18 2021-05-28 深圳创维－Rgb电子有限公司 一种语音交互调用处理方法、装置、终端设备及存储介质
CN113593555A (zh) * 2021-07-23 2021-11-02 北京百度网讯科技有限公司 通过语音方式控制程序的方法、设备及程序产品

Also Published As

Publication number Publication date
CN113593555A (zh) 2021-11-02

Similar Documents

Publication Publication Date Title
WO2023000697A1 (zh) 通过语音方式控制程序的方法、设备及程序产品
US10986214B2 (en) Local persisting of data for selectively offline capable voice action in a voice-enabled electronic device
EP3926548A1 (en) Method and apparatus for pre-training graph neural network
JP7258994B2 (ja) 画面投影方法、装置、機器及び記憶媒体
WO2022134428A1 (zh) 小程序页面渲染方法、装置、电子设备及存储介质
JP7258932B2 (ja) 車載多音域に基づくノイズ低減方法、装置、電子機器及び記憶媒体
US11372965B2 (en) Application with self-configuring accessibility settings
US20210365285A1 (en) Voice data procession method, apparatus, device and storage medium
WO2023221406A1 (zh) 深度学习编译器的运行方法、装置及电子设备
WO2023221416A1 (zh) 信息生成方法、装置、设备以及存储介质
WO2023000698A1 (zh) 通过语音方式控制程序的方法、设备及程序产品
US20220300301A1 (en) Method and apparatus for controlling interface focus on interface
JP2022088585A (ja) 音声ブロードキャスト方法、音声ブロードキャスト装置、電子機器、記憶媒体及びコンピュータプログラム
US11842726B2 (en) Method, apparatus, electronic device and storage medium for speech recognition
JP2023510450A (ja) アプレットページレンダリング方法、装置、電子機器、および記憶媒体
CN116866661A (zh) 一种视频预渲染方法、装置、设备及存储介质
CN114443197B (zh) 界面处理方法、装置、电子设备及存储介质
US20220269659A1 (en) Method, device and storage medium for deduplicating entity nodes in graph database
CN112966201B (zh) 对象处理方法、装置、电子设备以及存储介质
US20220101216A1 (en) Business Content Output Method, Apparatus, Storage Medium and Program Product
CN113518088B (zh) 数据处理方法、装置、服务器、客户端和介质
CN113253938B (zh) 数据处理方法、装置、设备、存储介质及计算机程序产品
US11570306B2 (en) Call processing method, electronic device and storage medium
US20220358931A1 (en) Task information management
WO2023070454A1 (zh) 终端控制方法、装置、介质与电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22844869

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE