CN111880875A - Multimedia playing control method, device, equipment, storage medium and system - Google Patents

Multimedia playing control method, device, equipment, storage medium and system Download PDF

Info

Publication number
CN111880875A
CN111880875A CN202010681983.5A CN202010681983A CN111880875A CN 111880875 A CN111880875 A CN 111880875A CN 202010681983 A CN202010681983 A CN 202010681983A CN 111880875 A CN111880875 A CN 111880875A
Authority
CN
China
Prior art keywords
application program
running state
control instruction
playing
application
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010681983.5A
Other languages
Chinese (zh)
Other versions
CN111880875B (en
Inventor
梁霄
董昊
邢仁泰
熊雷
蒋峰
胡文波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Baidu Online Network Technology Beijing Co Ltd
Shanghai Xiaodu Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN202010681983.5A priority Critical patent/CN111880875B/en
Publication of CN111880875A publication Critical patent/CN111880875A/en
Application granted granted Critical
Publication of CN111880875B publication Critical patent/CN111880875B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223Execution procedure of a spoken command

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • User Interface Of Digital Computer (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The application discloses a method, a device, equipment, a storage medium and a system for controlling multimedia playing, and relates to the technical field of natural language processing and voice interaction. The specific implementation scheme is as follows: determining a playing control instruction according to user voice information acquired by a first application program; if the running state information of the first application program is a background running state, controlling a multimedia playing process of a second application program through an operating system according to the playing control instruction; wherein the second application is in a foreground running state. The multimedia playing efficiency can be improved.

Description

Multimedia playing control method, device, equipment, storage medium and system
Technical Field
The present application relates to the field of computer technologies, and in particular, to a method, an apparatus, a device, a storage medium, and a system for controlling multimedia playing
Background
With the rapid development of computer technology, smart terminals such as smart phones and tablet computers are widely used in various fields of work and life. Multimedia playing has become the basic application function of intelligent terminals.
The voice assistant meets the requirements of users through intelligent interaction of intelligent conversation and instant question and answer. How to play multimedia by the voice assistant is an important issue.
Disclosure of Invention
The present disclosure provides a control method, apparatus, device, storage medium, and system for multimedia playback.
According to an aspect of the present disclosure, there is provided a method for controlling multimedia playback, including:
determining a playing control instruction according to user voice information acquired by a first application program;
if the running state information of the first application program is a background running state, controlling a multimedia playing process of a second application program through an operating system according to the playing control instruction; wherein the second application is in a foreground running state.
According to another aspect of the present disclosure, there is provided a method for controlling multimedia playback, including:
if the running state information of the first application program is a background running state, acquiring a play control instruction; the playing control instruction is determined according to user voice information collected by the first application program;
controlling the multimedia playing process of the second application program according to the playing control instruction; wherein the second application is in a foreground running state.
According to still another aspect of the present disclosure, there is provided a method for controlling multimedia playback, including:
acquiring a play control instruction and running state information of a first application program from the first application program; the playing control instruction is determined according to user voice information collected by the first application program;
if the first application program is detected to be in a background running state according to the running state information, controlling a multimedia playing process of the second application program through the operating system according to the playing control instruction; wherein the second application is in a foreground running state.
According to an aspect of the present disclosure, there is provided a control apparatus for multimedia playback, including:
the instruction determining module is used for determining a playing control instruction according to the user voice information acquired by the first application program;
the second application control module is used for controlling the multimedia playing process of the second application program through the operating system according to the playing control instruction if the running state information of the first application program is a background running state; wherein the second application is in a foreground running state.
According to another aspect of the present disclosure, there is provided a control apparatus for multimedia playback, including:
the instruction acquisition module is used for acquiring a play control instruction if the running state information of the first application program is a background running state; the playing control instruction is determined according to user voice information collected by the first application program;
the foreground application control module is used for controlling the multimedia playing process of the second application program according to the playing control instruction; wherein the second application is in a foreground running state.
According to still another aspect of the present disclosure, there is provided a control apparatus for multimedia playback, including:
the information acquisition module is used for acquiring a play control instruction and running state information of a first application program from the first application program; the playing control instruction is determined according to user voice information collected by the first application program;
the instruction transfer module is used for controlling the multimedia playing process of the second application program through the operating system according to the playing control instruction if the first application program is detected to be in a background running state according to the running state information; wherein the second application is in a foreground running state.
According to a seventh aspect, there is provided an electronic device comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor, the instructions being executable by the at least one processor to enable the at least one processor to perform a method of controlling multimedia playback as described in any one of embodiments of the present application.
According to an eighth aspect, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing a computer to execute the method of controlling multimedia playback as described in any one of the embodiments of the present application.
According to a ninth aspect, there is provided a control system for multimedia playing, comprising a first application program, an operating system and a second application program;
the first application program is used for determining a playing control instruction according to the collected user voice information;
the first application program is also used for sending the play control instruction to the operating system if the running state information of the first application program is a background running state;
the operating system is used for controlling the multimedia playing process of the second application program according to the playing control instruction; wherein the second application is in a foreground running state.
According to the technology of the application, the multimedia playing efficiency can be improved.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.
Drawings
The drawings are included to provide a better understanding of the present solution and are not intended to limit the present application. Wherein:
fig. 1 is a schematic flowchart of a method for controlling multimedia playing according to an embodiment of the present application;
fig. 2 is a schematic flowchart of another control method for multimedia playing according to an embodiment of the present application;
fig. 3 is a schematic flowchart of another method for controlling multimedia playing according to an embodiment of the present application;
fig. 4 is a schematic flowchart of another method for controlling multimedia playing according to an embodiment of the present application;
fig. 5 is a flowchart illustrating a control method for multimedia playing according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of a control device for multimedia playing according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of another control device for multimedia playing provided in an embodiment of the present application;
fig. 8 is a schematic structural diagram of another control device for multimedia playing provided in an embodiment of the present application;
fig. 9 is a block diagram of an electronic device for implementing a method for controlling multimedia playback according to an embodiment of the present application;
fig. 10 is a schematic structural diagram of a control system for multimedia playing according to an embodiment of the present application.
Detailed Description
The following description of the exemplary embodiments of the present application, taken in conjunction with the accompanying drawings, includes various details of the embodiments of the application for the understanding of the same, which are to be considered exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
Fig. 1 is a flowchart illustrating a method for controlling multimedia playback according to an embodiment of the present application. The embodiment can be applied to the case that the first application voice assistant controls the multimedia playing process of the second application. The method for controlling multimedia playing disclosed in this embodiment may be executed by a first application program, and specifically may be executed by a control device for multimedia playing, where the control device may be implemented by software and/or hardware and configured in an electronic device. Referring to fig. 1, the method for controlling multimedia playing provided by this embodiment includes:
s110, determining a playing control instruction according to the user voice information collected by the first application program.
The first application program is a multimedia playing application program with a voice assistant function, and the playing control instruction is an instruction for controlling the multimedia playing application program. Specifically, the voice information of the user is collected through the first application program, and the voice information of the user is identified to determine the playing control instruction.
In an alternative embodiment, S110 includes: collecting user voice information; sending the user voice information to a server, and indicating the server to determine a playing control instruction according to the user voice information; and acquiring the play control instruction from the server. Specifically, the user voice information is identified through the server, for example, the user voice information may be converted into user text information, a control instruction is identified based on the user text information, or the control instruction may be directly matched according to the user voice information and instruction voice information associated with the candidate control instruction, and the play control instruction is determined according to a matching result. The voice assistant function of the first application program is matched with the server to interact with the user, so that the interaction convenience of the user is improved, and the accuracy of playing the control instruction is improved. It should be noted that the control instruction may also be identified by the first application program or the intelligent terminal to which the first application program belongs.
In an alternative embodiment, the playback control command is pause, play, previous or next. Namely, the voice assistant supports the basic control instruction in the multimedia playing process.
S120, if the running state information of the first application program is a background running state, controlling a multimedia playing process of a second application program through an operating system according to the playing control instruction; wherein the second application is in a foreground running state.
The first application program can detect self running state information, and the self running state information can be a background running state or a foreground running state. Specifically, if the user cannot perform play control and is in a play pause state, the application program is in a background running state; if the user can perform playing control and is in the playing state, the application program is in the foreground running state.
Specifically, if the first application program is in the background running state, the first application program sends a play control instruction to the operating system, and the operating system controls the second application program in the foreground running state according to the play control instruction, so that the multimedia playing state of the second application program is controlled by the voice assistant of the first application program, the interaction convenience of the second application program is improved, and the multimedia playing efficiency is improved. The instruction transfer is carried out through the operating system, so that the situation that the first application program and the second application program cannot be directly communicated can be avoided, and the application range of the voice assistant in the first application program is improved. It should be noted that the first application program may directly interact with the operating system, or may interact with the operating system through other devices.
The voice assistant at the operating system level in the intelligent terminal may be in a non-available state, or the voice assistant at the operating system level is limited by a chip in the intelligent terminal, and there may be problems of protocol conflict or unable communication with a second application program to be controlled. In the above case, it is important that the voice assistant through the first application controls the second application.
According to the technical scheme of the embodiment of the application, if the first application program is in the background running state, the multimedia playing state of the second application program is controlled through the voice assistant of the first application program, the interaction convenience of the second application program is improved, and therefore the multimedia playing efficiency is improved.
In an alternative embodiment, S110 further includes: and if the running state information of the first application program is a foreground running state, controlling the multimedia playing process of the first application program according to the control instruction. If the first application program is in the foreground running state, the first application program directly controls the self playing process according to the playing control instruction, and the second application program does not need to be controlled by the operating system according to the playing control instruction, namely the S120 does not need to be executed. The first application program or the second application program is controlled by decision according to the running state of the first application program, so that abnormal multimedia playing is avoided, and the playing stability is maintained.
Fig. 2 is a flowchart illustrating a method for controlling multimedia playing according to an embodiment of the present application. The present embodiment is an alternative proposed on the basis of the above-described embodiments. Referring to fig. 2, the method for controlling multimedia playing provided by this embodiment includes:
s210, determining a playing control instruction according to the user voice information acquired by the first application program.
And S220, if the running state information of the first application program is in a background running state, sending the playing control instruction and the running state information to an intermediate device, and controlling a multimedia playing process of the second application program through the operating system according to the playing control instruction if the intermediate device detects that the first application program is in the background running state according to the running state information.
In the embodiment of the application, the first application program and the operating system interact through the intermediate device, the problem that communication cannot be performed between the first application program and the operating system due to the lack of an interactive interface or protocol conflict is avoided, the limitation of the operating system is avoided, and the application range is further widened.
The intermediate device may have a native interaction function with the first application program, for example, the first application program may adjust a working state or a parameter of the intermediate device, in addition to forwarding the play control instruction. The intermediate device performs logic judgment according to the running state of the first application program, and can avoid conflict between the forwarding and playing control instruction and the native function of the intermediate device.
Specifically, when the first application program is in a foreground running state, if the intermediate device needs to be controlled, running state information and a native control instruction can be sent to the intermediate device; and in the process that the first application program is in the background running state, if the second application program is required to control, the running state information and the playing control instruction can be sent to the intermediate device.
After acquiring the running state information and the playing control instruction from the first application program, the intermediate device sends the playing control instruction to the operating system if detecting that the first application program is in the background running state according to the running state information. It should be noted that, if the intermediate device detects that the first application program is in the foreground operating state according to the operating state information, the intermediate device may respond based on the native function, or feed back information to the first application program, instead of forwarding the play control instruction to the operating system.
In an alternative embodiment, the intermediary device connects to the first application based on a bluetooth protocol. For example, the intermediary device may be a wireless bluetooth headset that is pre-bound to the first application and is in a connected state (i.e., in an online state). The intermediate device communicates with the first application program and the operating system based on the bluetooth protocol, and the application range can be widened.
According to the technical scheme, the first application program and the operating system interact through the intermediate device, the intermediate device performs logic judgment according to the running state of the first application program, the intermediate device is not limited by the operating system, the application range is further widened, and conflict between forwarding and playing control instructions and the original functions of the intermediate device can be avoided.
Fig. 3 is a flowchart illustrating a method for controlling multimedia playing according to an embodiment of the present application. The embodiment can be applied to the case that the first application voice assistant controls the multimedia playing process of the second application. The method for controlling multimedia playing disclosed in this embodiment may be executed by an operating system, and specifically may be executed by a control apparatus for multimedia playing, where the apparatus may be implemented by software and/or hardware and configured in an electronic device. Referring to fig. 3, the method for controlling multimedia playing provided by this embodiment includes:
s310, if the running state information of the first application program is a background running state, acquiring a play control instruction; and the playing control instruction is determined according to the user voice information acquired by the first application program.
The first application program is a multimedia playing application program with a voice assistant function, and the playing control instruction is an instruction for controlling the multimedia playing application program.
The first application program can detect self running state information, and the self running state information can be a background running state or a foreground running state. Specifically, if the user cannot perform play control and is in a play pause state, the application program is in a background running state; if the user can perform playing control and is in the playing state, the application program is in the foreground running state.
Specifically, if the first application program is in a background running state, the operating system acquires a play control instruction; if the first application program is in the foreground running state, the playing state of the first application program can be controlled, and the operating system can not participate.
In an alternative embodiment, the playback control command is pause, play, previous or next. Namely, the voice assistant supports the basic control instruction in the multimedia playing process.
S320, controlling the multimedia playing process of the second application program according to the playing control instruction; wherein the second application is in a foreground running state.
The voice assistant of the first application program controls the multimedia playing state of the second application program, so that the interaction convenience of the second application program is improved, and the multimedia playing efficiency is improved. And the instruction transfer is carried out through the operating system, so that the situation that the first application program and the second application program cannot be directly communicated can be avoided, and the application range of the voice assistant in the first application program is improved.
According to the technical scheme of the embodiment of the application, if the first application program is in the background running state, the operating system receives the playing control instruction and controls the multimedia playing state of the second application program according to the playing control instruction, so that the interaction convenience of the second application program is improved, and the multimedia playing efficiency is improved.
Fig. 4 is a flowchart illustrating a method for controlling multimedia playing according to an embodiment of the present application. The present embodiment is an alternative proposed on the basis of the above-described embodiments. Referring to fig. 4, the method for controlling multimedia playing provided by this embodiment includes:
and S410, if the first application program is detected to be in the background running state through the intermediate equipment according to the running state information, acquiring the play control instruction from the intermediate equipment.
And the playing control instruction is determined according to the user voice information acquired by the first application program. The first application program and the operating system are interacted through the intermediate device, the problem that communication cannot be conducted between the first application program and the operating system due to the fact that an interaction interface is lacked or the protocol conflicts and the like is avoided, the first application program and the operating system are not limited by the operating system, and the application range is further widened.
The intermediate device can transmit the playing control instruction and also has a native interaction function with the first application program, and the intermediate device performs logic judgment according to the running state of the first application program, so that the conflict between the transmitting playing control instruction and the native function of the intermediate device can be avoided.
Specifically, if the intermediate device detects that the first application program is in a background running state, the operating system acquires a play control instruction from the intermediate device; if the intermediate device detects that the first application program is in the foreground running state, the operating system may not need to receive the play control instruction.
In an alternative embodiment, the intermediary device connects to the first application based on a bluetooth protocol. The intermediate device communicates with the first application program and the operating system based on the bluetooth protocol, and the application range can be widened.
S420, controlling the multimedia playing process of the second application program according to the playing control instruction; wherein the second application is in a foreground running state.
According to the technical scheme, the first application program and the operating system interact through the intermediate device, the intermediate device performs logic judgment according to the running state of the first application program, the intermediate device is not limited by the operating system, the application range is further widened, and conflict between forwarding and playing control instructions and the original functions of the intermediate device can be avoided.
Fig. 5 is a flowchart illustrating a method for controlling multimedia playing according to an embodiment of the present application. The embodiment can be applied to the case that the first application voice assistant controls the multimedia playing process of the second application. The method for controlling multimedia playing disclosed in this embodiment may be executed by an intermediate device, and specifically may be executed by a control apparatus for multimedia playing, where the apparatus may be implemented by software and/or hardware and configured in an electronic device. Referring to fig. 5, the method for controlling multimedia playing provided by this embodiment includes:
s510, acquiring a play control instruction and running state information of a first application program from the first application program; and the playing control instruction is determined according to the user voice information acquired by the first application program.
The first application program is a multimedia playing application program with a voice assistant function, and the playing control instruction is an instruction for controlling the multimedia playing application program.
The first application program can detect self running state information, and the self running state information can be a background running state or a foreground running state. Specifically, if the user cannot perform play control and is in a play pause state, the application program is in a background running state; if the user can perform playing control and is in the playing state, the application program is in the foreground running state. Specifically, if the first application program is in the background running state, the intermediate device obtains the play control instruction and the running state information from the first application program.
S520, if the first application program is detected to be in the background running state according to the running state information, controlling the multimedia playing process of the second application program through the operating system according to the playing control instruction; wherein the second application is in a foreground running state.
The intermediate device may have a native interaction function with the first application program, for example, the first application program may adjust a working state or a parameter of the intermediate device, in addition to forwarding the play control instruction. The intermediate device performs logic judgment according to the running state of the first application program, and can avoid conflict between the forwarding and playing control instruction and the native function of the intermediate device. It should be noted that, in the process that the first application program is in the foreground operating state, if the intermediate device needs to be controlled, the operating state information and the native control instruction may be sent to the intermediate device, and at this time, the intermediate device does not need to send the native control instruction to the operating system.
In an alternative embodiment, the intermediary device connects to the first application based on the bluetooth protocol. The intermediate device communicates with the first application program and the operating system based on the bluetooth protocol, and the application range can be widened.
According to the technical scheme, in the process of controlling the second application program through the voice assistant of the first application program, the first application program and the operating system interact through the intermediate device, and the intermediate device performs logic judgment according to the running state of the first application program, so that the application range is further widened without being limited by the operating system, and the conflict of forwarding and playing control instructions and the original functions of the intermediate device can be avoided.
Fig. 6 is a schematic structural diagram of a control device for multimedia playing according to an embodiment of the present application. Referring to fig. 6, a control apparatus 600 for multimedia playing provided in an embodiment of the present application may include:
the instruction determining module 601 is configured to determine a play control instruction according to user voice information acquired by a first application;
a second application control module 602, configured to control, by an operating system according to the play control instruction, a multimedia playing process of a second application program if the running state information of the first application program is a background running state; wherein the second application is in a foreground running state.
Optionally, the second application control module 602 is specifically configured to:
and sending the playing control instruction and the running state information to an intermediate device, and being used for indicating the intermediate device to control the multimedia playing process of the second application program according to the playing control instruction through the operating system if the intermediate device detects that the first application program is in a background running state according to the running state information.
Optionally, the intermediate device is connected to the first application program based on a bluetooth protocol.
Optionally, the apparatus 600 further includes:
and the first application control module is used for controlling the multimedia playing process of the first application program according to the control instruction if the running state information of the first application program is the foreground running state.
Optionally, the instruction determining module 601 includes:
the voice acquisition unit is used for acquiring voice information of a user;
the voice sending unit is used for sending the user voice information to a server and indicating the server to determine a playing control instruction according to the user voice information;
and the instruction receiving unit is used for acquiring the playing control instruction from the server.
Optionally, the play control instruction is pause, play, previous or next.
According to the technical scheme, in the process of controlling the second application program through the voice assistant of the first application program, the first application program and the operating system interact through the intermediate device, and the intermediate device performs logic judgment according to the running state of the first application program, so that the application range is further widened without being limited by the operating system, and the conflict of forwarding and playing control instructions and the original functions of the intermediate device can be avoided.
Fig. 7 is a schematic structural diagram of a control device for multimedia playing according to an embodiment of the present application. Referring to fig. 7, a control apparatus 700 for multimedia playing provided in an embodiment of the present application may include:
an instruction obtaining module 701, configured to obtain a play control instruction if the running state information of the first application is a background running state; the playing control instruction is determined according to user voice information collected by the first application program;
a foreground application control module 702, configured to control a multimedia playing process of the second application according to the playing control instruction; wherein the second application is in a foreground running state.
Optionally, the instruction obtaining module 701 is specifically configured to:
and if the first application program is detected to be in a background running state through the intermediate equipment according to the running state information, acquiring the play control instruction from the intermediate equipment.
Optionally, the intermediate device is connected to the first application program based on a bluetooth protocol.
Optionally, the play control instruction is pause, play, previous or next.
According to the technical scheme, in the process of controlling the second application program through the voice assistant of the first application program, the first application program and the operating system interact through the intermediate device, and the intermediate device performs logic judgment according to the running state of the first application program, so that the application range is further widened without being limited by the operating system, and the conflict of forwarding and playing control instructions and the original functions of the intermediate device can be avoided.
Fig. 8 is a schematic structural diagram of a control device for multimedia playing according to an embodiment of the present application. Referring to fig. 8, a control apparatus 800 for multimedia playing provided in an embodiment of the present application may include:
an information obtaining module 801, configured to obtain a play control instruction and running state information of a first application from the first application; the playing control instruction is determined according to user voice information collected by the first application program;
an instruction transfer module 802, configured to control, by the operating system according to the play control instruction, a multimedia playing process of the second application program if it is detected that the first application program is in a background running state according to the running state information; wherein the second application is in a foreground running state.
Optionally, the intermediate device is connected to the first application program based on a bluetooth protocol.
Optionally, the play control instruction is pause, play, previous or next.
According to the technical scheme, in the process of controlling the second application program through the voice assistant of the first application program, the first application program and the operating system interact through the intermediate device, and the intermediate device performs logic judgment according to the running state of the first application program, so that the application range is further widened without being limited by the operating system, and the conflict of forwarding and playing control instructions and the original functions of the intermediate device can be avoided.
According to an embodiment of the present application, an electronic device and a readable storage medium are also provided.
As shown in fig. 9, it is a block diagram of an electronic device of a method for controlling multimedia playing according to an embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application that are described and/or claimed herein.
As shown in fig. 9, the electronic apparatus includes: one or more processors 901, memory 902, and interfaces for connecting the various components, including a high-speed interface and a low-speed interface. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions for execution within the electronic device, including instructions stored in or on the memory to display graphical information of a GUI on an external input/output apparatus (such as a display device coupled to the interface). In other embodiments, multiple processors and/or multiple buses may be used, along with multiple memories and multiple memories, as desired. Also, multiple electronic devices may be connected, with each device providing portions of the necessary operations (e.g., as a server array, a group of blade servers, or a multi-processor system). Fig. 9 illustrates an example of a processor 901.
Memory 902 is a non-transitory computer readable storage medium as provided herein. Wherein the memory stores instructions executable by at least one processor to cause the at least one processor to perform the method of controlling multimedia playback provided herein. The non-transitory computer-readable storage medium of the present application stores computer instructions for causing a computer to perform the method of controlling multimedia playback provided by the present application.
The memory 902 is used as a non-transitory computer readable storage medium, and can be used to store non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules corresponding to the method for controlling multimedia playing in the embodiment of the present application (for example, the instruction determining module 601 and the second application control module 602 shown in fig. 6; also, for example, the instruction obtaining module 701 and the foreground application control module 702 shown in fig. 7; and also, for example, the information obtaining module 801 and the instruction relay module 802 shown in fig. 8). The processor 901 executes various functional applications of the server and control of multimedia playback, that is, a method of implementing control of multimedia playback in the above-described method embodiments, by executing non-transitory software programs, instructions, and modules stored in the memory 902.
The memory 902 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the electronic device for the control of multimedia playback, and the like. Further, the memory 902 may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory 902 may optionally include a memory remotely located from the processor 901, which may be connected to an electronic device for control of multimedia playback over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The electronic device of the method of controlling multimedia playback may further include: an input device 903 and an output device 904. The processor 901, the memory 902, the input device 903 and the output device 904 may be connected by a bus or other means, and fig. 9 illustrates the connection by a bus as an example.
The input device 903 may receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device for control of multimedia playback, such as an input device like a touch screen, a keypad, a mouse, a track pad, a touch pad, a pointing stick, one or more mouse buttons, a track ball, a joystick, etc. The output devices 904 may include a display device, auxiliary lighting devices (e.g., LEDs), tactile feedback devices (e.g., vibrating motors), and the like. The display device may include, but is not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, and a plasma display. In some implementations, the display device can be a touch screen.
Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, integrated circuitry, application specific ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
These computer programs (also known as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, Programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), blockchain networks, and the internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
According to the technical scheme, in the process of controlling the second application program through the voice assistant of the first application program, the first application program and the operating system interact through the intermediate device, and the intermediate device performs logic judgment according to the running state of the first application program, so that the application range is further widened without being limited by the operating system, and the conflict of forwarding and playing control instructions and the original functions of the intermediate device can be avoided.
Fig. 10 is a schematic structural diagram of a control system for multimedia playing provided in an embodiment of the present application. Referring to fig. 10, the system may include a first application program, an operating system, and a second application program;
the first application program is used for determining a playing control instruction according to the collected user voice information;
the first application program is also used for sending the play control instruction to the operating system if the running state information of the first application program is a background running state;
the operating system is used for controlling the multimedia playing process of the second application program according to the playing control instruction; wherein the second application is in a foreground running state.
The first application program, the operating system and the second application program may be deployed in the same intelligent terminal, the first application program may be a multimedia application program supporting voice assistance, and the second application program may be a multimedia application program not supporting voice assistance. The voice assistant function of the first application program can serve the second application program, and a user can control the multimedia playing process of the second application program through voice interaction, so that the multimedia playing efficiency of the second application program is improved. The first application may communicate directly with the operating system over the first communication link.
Optionally, the system may further include an intermediate device; the first application program is specifically configured to send the running state information and the play control instruction to the intermediate device if the running state information of the first application program is a background running state; and the intermediate device is used for sending the play control instruction to the operating system if the first application program is detected to be in a background running state according to the running state information. The first application may communicate with the operating system over a second link that is in transit through the intermediary.
The intermediate device may have a native interaction function with the first application program, for example, the first application program may adjust a working state or a parameter of the intermediate device, in addition to forwarding the play control instruction. The intermediate device performs logic judgment according to the running state of the first application program, and can avoid conflict between the forwarding and playing control instruction and the native function of the intermediate device.
Optionally, the intermediate device is connected to the first application program based on a bluetooth protocol. The intermediate device communicates with the first application program and the operating system based on the Bluetooth protocol, is not limited by the operating system, and can widen the application range.
According to the technical scheme, in the process of controlling the second application program through the voice assistant of the first application program, the first application program and the operating system interact through the intermediate device, and the intermediate device performs logic judgment according to the running state of the first application program, so that the application range is further widened without being limited by the operating system, and the conflict of forwarding and playing control instructions and the original functions of the intermediate device can be avoided.
The above-described embodiments should not be construed as limiting the scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims (26)

1. A control method for multimedia playing comprises the following steps:
determining a playing control instruction according to user voice information acquired by a first application program;
if the running state information of the first application program is a background running state, controlling a multimedia playing process of a second application program through an operating system according to the playing control instruction; wherein the second application is in a foreground running state.
2. The method of claim 1, wherein the controlling, by the operating system, the multimedia playing process of the second application according to the playing control instruction comprises:
and sending the playing control instruction and the running state information to an intermediate device, and being used for indicating the intermediate device to control the multimedia playing process of the second application program according to the playing control instruction through the operating system if the intermediate device detects that the first application program is in a background running state according to the running state information.
3. The method of claim 2, wherein the intermediary device connects with the first application based on a bluetooth protocol.
4. The method of claim 1, after determining the playing control instruction according to the user voice information collected by the first application program, further comprising:
and if the running state information of the first application program is a foreground running state, controlling the multimedia playing process of the first application program according to the control instruction.
5. The method of claim 1, wherein the determining the play control instruction according to the user voice information collected by the first application program comprises:
collecting user voice information;
sending the user voice information to a server, and indicating the server to determine a playing control instruction according to the user voice information;
and acquiring the play control instruction from the server.
6. The method of claim 1, wherein the playback control command is pause, play, previous or next.
7. A control method for multimedia playing comprises the following steps:
if the running state information of the first application program is a background running state, acquiring a play control instruction; the playing control instruction is determined according to user voice information collected by the first application program;
controlling the multimedia playing process of the second application program according to the playing control instruction; wherein the second application is in a foreground running state.
8. The method of claim 7, wherein the obtaining the play control instruction if the running state information of the first application program is the background running state comprises:
and if the first application program is detected to be in a background running state through the intermediate equipment according to the running state information, acquiring the play control instruction from the intermediate equipment.
9. The method of claim 8, wherein the intermediary device connects with the first application based on a bluetooth protocol.
10. A control method for multimedia playing comprises the following steps:
acquiring a play control instruction and running state information of a first application program from the first application program; the playing control instruction is determined according to user voice information collected by the first application program;
if the first application program is detected to be in a background running state according to the running state information, controlling a multimedia playing process of the second application program through the operating system according to the playing control instruction; wherein the second application is in a foreground running state.
11. The method of claim 10, wherein an executing agent of the method connects with the first application based on a bluetooth protocol.
12. A control apparatus for multimedia playback, comprising:
the instruction determining module is used for determining a playing control instruction according to the user voice information acquired by the first application program;
the second application control module is used for controlling the multimedia playing process of the second application program through the operating system according to the playing control instruction if the running state information of the first application program is a background running state; wherein the second application is in a foreground running state.
13. The apparatus of claim 12, wherein the second application control module is specifically configured to:
and sending the playing control instruction and the running state information to an intermediate device, and being used for indicating the intermediate device to control the multimedia playing process of the second application program according to the playing control instruction through the operating system if the intermediate device detects that the first application program is in a background running state according to the running state information.
14. The apparatus of claim 13, wherein the intermediary device connects with the first application based on a bluetooth protocol.
15. The apparatus of claim 12, the apparatus further comprising:
and the first application control module is used for controlling the multimedia playing process of the first application program according to the control instruction if the running state information of the first application program is the foreground running state.
16. The apparatus of claim 12, wherein the instruction determination module comprises:
the voice acquisition unit is used for acquiring voice information of a user;
the voice sending unit is used for sending the user voice information to a server and indicating the server to determine a playing control instruction according to the user voice information;
and the instruction receiving unit is used for acquiring the playing control instruction from the server.
17. The apparatus of claim 12, wherein the playback control command is pause, play, previous or next.
18. A control apparatus for multimedia playback, comprising:
the instruction acquisition module is used for acquiring a play control instruction if the running state information of the first application program is a background running state; the playing control instruction is determined according to user voice information collected by the first application program;
the foreground application control module is used for controlling the multimedia playing process of the second application program according to the playing control instruction; wherein the second application is in a foreground running state.
19. The apparatus of claim 18, wherein the instruction fetch module is specifically configured to:
and if the first application program is detected to be in a background running state through the intermediate equipment according to the running state information, acquiring the play control instruction from the intermediate equipment.
20. The apparatus of claim 19, wherein the intermediary device connects with the first application based on a bluetooth protocol.
21. A control apparatus for multimedia playback, comprising:
the information acquisition module is used for acquiring a play control instruction and running state information of a first application program from the first application program; the playing control instruction is determined according to user voice information collected by the first application program;
the instruction transfer module is used for controlling the multimedia playing process of the second application program through the operating system according to the playing control instruction if the first application program is detected to be in a background running state according to the running state information; wherein the second application is in a foreground running state.
22. The apparatus of claim 21, wherein an executing agent of the method connects with the first application based on a bluetooth protocol.
23. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-11.
24. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-11.
25. A control system for multimedia playing comprises a first application program, an operating system and a second application program;
the first application program is used for determining a playing control instruction according to the collected user voice information;
the first application program is also used for sending the play control instruction to the operating system if the running state information of the first application program is a background running state;
the operating system is used for controlling the multimedia playing process of the second application program according to the playing control instruction; wherein the second application is in a foreground running state.
26. The system of claim 25, further comprising an intermediary device;
the first application program is specifically configured to send the running state information and the play control instruction to the intermediate device if the running state information of the first application program is a background running state;
and the intermediate device is used for sending the play control instruction to the operating system if the first application program is detected to be in a background running state according to the running state information.
CN202010681983.5A 2020-07-15 2020-07-15 Control method, device, equipment, storage medium and system for multimedia playing Active CN111880875B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010681983.5A CN111880875B (en) 2020-07-15 2020-07-15 Control method, device, equipment, storage medium and system for multimedia playing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010681983.5A CN111880875B (en) 2020-07-15 2020-07-15 Control method, device, equipment, storage medium and system for multimedia playing

Publications (2)

Publication Number Publication Date
CN111880875A true CN111880875A (en) 2020-11-03
CN111880875B CN111880875B (en) 2023-12-22

Family

ID=73155434

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010681983.5A Active CN111880875B (en) 2020-07-15 2020-07-15 Control method, device, equipment, storage medium and system for multimedia playing

Country Status (1)

Country Link
CN (1) CN111880875B (en)

Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110252423A1 (en) * 2010-04-07 2011-10-13 Apple Inc. Opportunistic Multitasking
CN102622176A (en) * 2012-02-24 2012-08-01 青岛海信移动通信技术股份有限公司 Processing method and device of application program operation interface
US8296783B1 (en) * 2010-05-28 2012-10-23 Adobe Systems Incorporated Media player instance managed resource reduction
CN102779070A (en) * 2011-02-14 2012-11-14 微软公司 Background audio on mobile devices
CN103593230A (en) * 2012-08-13 2014-02-19 百度在线网络技术(北京)有限公司 Background task control method of mobile terminal and mobile terminal
WO2016023319A1 (en) * 2014-08-12 2016-02-18 广州华多网络科技有限公司 Method and device for controlling multimedia player, and terminal
CN105957541A (en) * 2016-04-22 2016-09-21 北京金山安全软件有限公司 Music operation control method and device and mobile device
CN106157955A (en) * 2015-03-30 2016-11-23 阿里巴巴集团控股有限公司 A kind of sound control method and device
US20190004673A1 (en) * 2017-06-28 2019-01-03 Samsung Electronics Co., Ltd. Method for controlling display and electronic device supporting the same
CN109584879A (en) * 2018-11-23 2019-04-05 华为技术有限公司 A kind of sound control method and electronic equipment
GB201907710D0 (en) * 2019-05-31 2019-07-17 Continental Automotive Gmbh Multimedia system with optimiszed performance
US20190286480A1 (en) * 2018-03-19 2019-09-19 Samsung Electronics Co., Ltd. Electronic device and server for processing data received from electronic device
CN110321201A (en) * 2018-03-29 2019-10-11 努比亚技术有限公司 A kind of background program processing method, terminal and computer readable storage medium
CN110647305A (en) * 2019-09-29 2020-01-03 百度在线网络技术(北京)有限公司 Voice interaction method, device, equipment and medium of application program
US20200097097A1 (en) * 2018-09-21 2020-03-26 Samsung Electronics Co., Ltd. Electronic device and method for capturing multimedia content
US20200168215A1 (en) * 2018-11-27 2020-05-28 Lg Electronics Inc. Multimedia device for processing voice command
CN111341315A (en) * 2020-03-06 2020-06-26 腾讯科技(深圳)有限公司 Voice control method, device, computer equipment and storage medium
CN111354360A (en) * 2020-03-17 2020-06-30 北京百度网讯科技有限公司 Voice interaction processing method and device and electronic equipment

Patent Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110252423A1 (en) * 2010-04-07 2011-10-13 Apple Inc. Opportunistic Multitasking
US8296783B1 (en) * 2010-05-28 2012-10-23 Adobe Systems Incorporated Media player instance managed resource reduction
CN102779070A (en) * 2011-02-14 2012-11-14 微软公司 Background audio on mobile devices
CN102622176A (en) * 2012-02-24 2012-08-01 青岛海信移动通信技术股份有限公司 Processing method and device of application program operation interface
CN103593230A (en) * 2012-08-13 2014-02-19 百度在线网络技术(北京)有限公司 Background task control method of mobile terminal and mobile terminal
WO2016023319A1 (en) * 2014-08-12 2016-02-18 广州华多网络科技有限公司 Method and device for controlling multimedia player, and terminal
CN106157955A (en) * 2015-03-30 2016-11-23 阿里巴巴集团控股有限公司 A kind of sound control method and device
CN105957541A (en) * 2016-04-22 2016-09-21 北京金山安全软件有限公司 Music operation control method and device and mobile device
US20190004673A1 (en) * 2017-06-28 2019-01-03 Samsung Electronics Co., Ltd. Method for controlling display and electronic device supporting the same
US20190286480A1 (en) * 2018-03-19 2019-09-19 Samsung Electronics Co., Ltd. Electronic device and server for processing data received from electronic device
CN110321201A (en) * 2018-03-29 2019-10-11 努比亚技术有限公司 A kind of background program processing method, terminal and computer readable storage medium
US20200097097A1 (en) * 2018-09-21 2020-03-26 Samsung Electronics Co., Ltd. Electronic device and method for capturing multimedia content
CN109584879A (en) * 2018-11-23 2019-04-05 华为技术有限公司 A kind of sound control method and electronic equipment
US20200168215A1 (en) * 2018-11-27 2020-05-28 Lg Electronics Inc. Multimedia device for processing voice command
GB201907710D0 (en) * 2019-05-31 2019-07-17 Continental Automotive Gmbh Multimedia system with optimiszed performance
CN110647305A (en) * 2019-09-29 2020-01-03 百度在线网络技术(北京)有限公司 Voice interaction method, device, equipment and medium of application program
CN111341315A (en) * 2020-03-06 2020-06-26 腾讯科技(深圳)有限公司 Voice control method, device, computer equipment and storage medium
CN111354360A (en) * 2020-03-17 2020-06-30 北京百度网讯科技有限公司 Voice interaction processing method and device and electronic equipment

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
梁昌银;雒江涛;周丽娴;: "基于Android平台声控应用的研究与开发", 电声技术, no. 12 *

Also Published As

Publication number Publication date
CN111880875B (en) 2023-12-22

Similar Documents

Publication Publication Date Title
CN110647305B (en) Voice interaction method, device, equipment and medium of application program
CN111586128B (en) Method, device, equipment and storage medium for acquiring applet data
CN111276139A (en) Voice wake-up method and device
CN111753997A (en) Distributed training method, system, device and storage medium
CN112235417B (en) Method and device for sending debugging instruction
CN112908318A (en) Awakening method and device of intelligent sound box, intelligent sound box and storage medium
CN111522701A (en) Test method, test system, electronic device and storage medium
CN110933227A (en) Assistance method, device, equipment and medium for intelligent terminal
CN112382292A (en) Voice-based control method and device
CN112346612B (en) Page display method and device
CN112382294B (en) Speech recognition method, device, electronic equipment and storage medium
CN111638787B (en) Method and device for displaying information
CN111880875B (en) Control method, device, equipment, storage medium and system for multimedia playing
CN110781824A (en) Target detection and tracking method and device, electronic equipment and storage medium
CN113655906A (en) Folding screen control method and device
CN112489659B (en) Data processing method, system, server and terminal equipment based on input method
CN111708477B (en) Key identification method, device, equipment and storage medium
CN110609671B (en) Sound signal enhancement method, device, electronic equipment and storage medium
CN111986682A (en) Voice interaction method, device, equipment and storage medium
CN111352685A (en) Input method keyboard display method, device, equipment and storage medium
CN112346512A (en) Time synchronization method and device
CN111639116A (en) Data access connection session protection method and device
CN111177558A (en) Channel service construction method and device
CN112579032A (en) Intelligent equipment guiding method and device
CN111862568B (en) Instruction transmission method, device, system, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20210513

Address after: 100085 Baidu Building, 10 Shangdi Tenth Street, Haidian District, Beijing

Applicant after: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) Co.,Ltd.

Applicant after: Shanghai Xiaodu Technology Co.,Ltd.

Address before: 100085 Baidu Building, 10 Shangdi Tenth Street, Haidian District, Beijing

Applicant before: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) Co.,Ltd.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant