CN111880875B - Control method, device, equipment, storage medium and system for multimedia playing - Google Patents
Control method, device, equipment, storage medium and system for multimedia playing Download PDFInfo
- Publication number
- CN111880875B CN111880875B CN202010681983.5A CN202010681983A CN111880875B CN 111880875 B CN111880875 B CN 111880875B CN 202010681983 A CN202010681983 A CN 202010681983A CN 111880875 B CN111880875 B CN 111880875B
- Authority
- CN
- China
- Prior art keywords
- application program
- running state
- control instruction
- application
- playing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 100
- 230000008569 process Effects 0.000 claims abstract description 48
- 230000015654 memory Effects 0.000 claims description 19
- 238000012546 transfer Methods 0.000 claims description 5
- 230000003993 interaction Effects 0.000 abstract description 16
- 238000003058 natural language processing Methods 0.000 abstract description 2
- 230000006870 function Effects 0.000 description 27
- 238000010586 diagram Methods 0.000 description 10
- 238000004891 communication Methods 0.000 description 8
- 238000004590 computer program Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000001404 mediated effect Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application discloses a control method, a device, equipment, a storage medium and a system for multimedia playing, and relates to the technical field of natural language processing and voice interaction. The specific implementation scheme is as follows: determining a play control instruction according to user voice information acquired by a first application program; if the running state information of the first application program is the background running state, controlling the multimedia playing process of the second application program through an operating system according to the playing control instruction; and the second application program is in a foreground running state. The method and the device can improve the multimedia playing efficiency.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to the field of natural language processing and voice interaction technologies, and in particular, to a method, an apparatus, a device, a storage medium, and a system for controlling multimedia playing
Background
With the rapid development of computer technology, intelligent terminals such as smartphones and tablet computers are widely used in various fields of work and life. Multimedia play has become a fundamental application function of intelligent terminals.
The voice assistant can interact with the instant questions and answers through the intelligent dialogue, so as to meet the requirements of users. How to play multimedia by a voice assistant is an important issue.
Disclosure of Invention
The present disclosure provides a control method, apparatus, device, storage medium and system for multimedia playing.
According to an aspect of the present disclosure, there is provided a control method of multimedia playing, including:
determining a play control instruction according to user voice information acquired by a first application program;
if the running state information of the first application program is the background running state, controlling the multimedia playing process of the second application program through an operating system according to the playing control instruction; and the second application program is in a foreground running state.
According to another aspect of the present disclosure, there is provided a control method of multimedia playing, including:
if the running state information of the first application program is the background running state, acquiring a playing control instruction; the play control instruction is determined according to the user voice information collected by the first application program;
controlling the multimedia playing process of the second application program according to the playing control instruction; and the second application program is in a foreground running state.
According to still another aspect of the present disclosure, there is provided a control method of multimedia playing, including:
acquiring a play control instruction and running state information of a first application program from the first application program; the play control instruction is determined according to the user voice information collected by the first application program;
if the first application program is detected to be in a background running state according to the running state information, controlling a multimedia playing process of the second application program through the operating system according to the playing control instruction; wherein the second application is in a foreground operating state.
According to an aspect of the present disclosure, there is provided a control device for multimedia playing, including:
the instruction determining module is used for determining a play control instruction according to the user voice information acquired by the first application program;
the second application control module is used for controlling the multimedia playing process of the second application program through the operating system according to the playing control instruction if the running state information of the first application program is the background running state; and the second application program is in a foreground running state.
According to another aspect of the present disclosure, there is provided a control apparatus for multimedia playing, including:
the instruction acquisition module is used for acquiring a play control instruction if the running state information of the first application program is a background running state; the play control instruction is determined according to the user voice information collected by the first application program;
the foreground application control module is used for controlling the multimedia playing process of the second application program according to the playing control instruction; and the second application program is in a foreground running state.
According to still another aspect of the present disclosure, there is provided a control apparatus for multimedia playing, including:
the information acquisition module is used for acquiring a play control instruction and running state information of the first application program from the first application program; the play control instruction is determined according to the user voice information collected by the first application program;
the instruction transfer module is used for controlling the multimedia playing process of the second application program according to the playing control instruction through the operating system if the first application program is detected to be in the background running state according to the running state information; wherein the second application is in a foreground operating state.
According to a seventh aspect, there is provided an electronic device comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform a method of controlling multimedia playback as in any one of the embodiments of the present application.
According to an eighth aspect, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing the computer to execute the control method of multimedia playing according to any one of the embodiments of the present application.
According to a ninth aspect, there is provided a control system for multimedia playing, including a first application program, an operating system, and a second application program;
the first application program is used for determining a play control instruction according to the collected user voice information;
the first application program is further configured to send the play control instruction to the operating system if the running state information of the first application program is a background running state;
The operating system is used for controlling the multimedia playing process of the second application program according to the playing control instruction; and the second application program is in a foreground running state.
According to the technology, the multimedia playing efficiency can be improved.
It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the disclosure, nor is it intended to be used to limit the scope of the disclosure. Other features of the present disclosure will become apparent from the following specification.
Drawings
The drawings are for better understanding of the present solution and do not constitute a limitation of the present application. Wherein:
fig. 1 is a flow chart of a control method for multimedia playing according to an embodiment of the present application;
fig. 2 is a flowchart of another method for controlling multimedia playing according to an embodiment of the present application;
fig. 3 is a flowchart of another control method for multimedia playing according to an embodiment of the present application;
fig. 4 is a flowchart of another control method for multimedia playing according to an embodiment of the present application;
fig. 5 is a flowchart of another control method for multimedia playing according to an embodiment of the present application;
Fig. 6 is a schematic structural diagram of a control device for multimedia playing according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of another multimedia playing control device according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of another multimedia playing control device according to an embodiment of the present application;
fig. 9 is a block diagram of an electronic device for implementing a control method of multimedia playing according to an embodiment of the present application;
fig. 10 is a schematic structural diagram of a control system for multimedia playing according to an embodiment of the present application.
Detailed Description
Exemplary embodiments of the present application are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present application to facilitate understanding, and should be considered as merely exemplary. Accordingly, one of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
Fig. 1 is a flowchart of a control method for multimedia playing according to an embodiment of the present application. The embodiment can be applied to the situation that the voice assistant of the first application program controls the multimedia playing process of the second application program. The method for controlling multimedia playing disclosed in this embodiment may be executed by the first application program, and in particular, may be executed by a control device for multimedia playing, where the device may be implemented by software and/or hardware, and configured in an electronic device. Referring to fig. 1, the method for controlling multimedia playing provided in this embodiment includes:
S110, determining a play control instruction according to the user voice information acquired by the first application program.
The first application program is a multimedia playing application program with a voice assistant function, and the playing control instruction is an instruction for controlling the multimedia playing application program. Specifically, user voice information is collected through a first application program, and the user voice information is identified to determine a play control instruction.
In an alternative embodiment, S110 includes: collecting voice information of a user; the user voice information is sent to a server side, and the user voice information is used for indicating the server side to determine a play control instruction according to the user voice information; and acquiring the play control instruction from the server. Specifically, the server identifies the user voice information, for example, the user voice information can be converted into user text information, the control instruction is identified based on the user text information, or the control instruction can be directly matched according to the user voice information and the instruction voice information associated with the candidate control instruction, and the play control instruction is determined according to the matching result. The voice assistant function of the first application program and the server cooperate to interact with the user, so that convenience of user interaction and accuracy of playing control instructions are improved. It should be noted that, the first application program or the intelligent terminal to which the first application program belongs may also perform the control instruction identification.
In an alternative embodiment, the play control instruction is pause, play, previous or next. I.e. the voice assistant supports basic control instructions during multimedia play.
S120, if the running state information of the first application program is a background running state, controlling a multimedia playing process of the second application program through an operating system according to the playing control instruction; and the second application program is in a foreground running state.
The first application program can detect self-running state information, and the self-running state information can be a background running state or a foreground running state. Specifically, if the user cannot perform play control and is in a play pause state, the application program is in a background running state; if the user can perform the play control and is in the playing state, the application program is in the foreground running state.
Specifically, if the first application program is in the background running state, the first application program sends a play control instruction to the operating system, and the operating system controls the second application program in the foreground running state according to the play control instruction, so that the control of the multimedia playing state of the second application program by the voice assistant of the first application program is realized, the interaction convenience of the second application program is improved, and the multimedia playing efficiency is improved. Through instruction transfer by the operating system, the situation that the first application program and the second application program cannot be directly communicated can be avoided, and therefore the application range of a voice assistant in the first application program is improved. It should be noted that, the first application program may interact with the operating system directly, or may interact with the operating system through other devices.
The voice assistant at the operating system level in the intelligent terminal may be in a non-usable state, or the voice assistant at the operating system level is limited by the chip in the intelligent terminal, and may have problems of protocol conflict or incapacity of communication with the second application program to be controlled. In the above case, it is particularly important that the second application is controlled by the voice assistant of the first application.
According to the technical scheme, if the first application program is in the background running state, the voice assistant of the first application program controls the multimedia playing state of the second application program, so that the interaction convenience of the second application program is improved, and the multimedia playing efficiency is improved.
In an alternative embodiment, S110 further includes: and if the running state information of the first application program is the foreground running state, controlling the multimedia playing process of the first application program according to the control instruction. If the first application is in the foreground running state, the first application directly controls the playing process according to the playing control instruction, and the operating system does not need to control the second application according to the playing control instruction, that is, S120 is not required to be executed. And the first application program or the second application program is decided to be controlled according to the running state of the first application program, so that abnormal multimedia playing is avoided, and the playing stability is maintained.
Fig. 2 is a flowchart of a control method for multimedia playing according to an embodiment of the present application. This embodiment is an alternative to the embodiments described above. Referring to fig. 2, the method for controlling multimedia playing provided in this embodiment includes:
s210, determining a play control instruction according to the user voice information acquired by the first application program.
And S220, if the running state information of the first application program is a background running state, sending the playing control instruction and the running state information to an intermediate device, wherein the playing control instruction and the running state information are used for indicating the intermediate device to control the multimedia playing process of the second application program through the operating system according to the playing control instruction if the intermediate device detects that the first application program is in the background running state according to the running state information.
In the embodiment of the application, the first application program and the operating system interact through the intermediate device, so that the problem that communication cannot be performed between the first application program and the operating system due to lack of an interaction interface or protocol conflict and the like is avoided, the first application program and the operating system are not limited by the operating system, and the application range is further widened.
In addition to forwarding the play control command, the intermediate device may also have a native interaction function with the first application, for example, the first application may adjust an operating state or a parameter of the intermediate device. The intermediate device performs logic judgment according to the running state of the first application program, so that the conflict between the forwarding play control instruction and the original function of the intermediate device can be avoided.
Specifically, if the first application program is in a foreground running state process and the intermediate equipment needs to be controlled, running state information and a native control instruction can be sent to the intermediate equipment; in the background running state process of the first application program, if the second application program is required to control, running state information and a playing control instruction can be sent to the intermediate equipment.
After the intermediate device obtains the running state information and the playing control instruction from the first application program, if the first application program is detected to be in the background running state according to the running state information, the intermediate device sends the playing control instruction to the operating system. It should be noted that, if the intermediate device detects that the first application program is in the foreground running state according to the running state information, the intermediate device may respond based on the native function, or feed back information to the first application program, instead of forwarding the play control instruction to the operating system.
In an alternative embodiment, the intermediate device is connected to the first application program based on a bluetooth protocol. For example, the intermediate device may be a wireless bluetooth headset that is pre-tied to the first application and in a connected state (i.e., in an online state). The intermediate device communicates with the first application program and the operating system based on the Bluetooth protocol, so that the application range can be widened.
According to the technical scheme, the first application program and the operating system interact through the intermediate device, and the intermediate device performs logic judgment according to the running state of the first application program, so that the application range is further widened without being limited by the operating system, and the conflict between the forwarding play control instruction and the original function of the intermediate device can be avoided.
Fig. 3 is a flowchart of a control method for multimedia playing according to an embodiment of the present application. The embodiment can be applied to the situation that the voice assistant of the first application program controls the multimedia playing process of the second application program. The method for controlling multimedia playing disclosed in this embodiment may be executed by an operating system, and in particular, may be executed by a control device for multimedia playing, where the device may be implemented by software and/or hardware, and configured in an electronic device. Referring to fig. 3, the method for controlling multimedia playing provided in this embodiment includes:
s310, if the running state information of the first application program is the background running state, a play control instruction is obtained; the play control instruction is determined according to the user voice information collected by the first application program.
The first application program is a multimedia playing application program with a voice assistant function, and the playing control instruction is an instruction for controlling the multimedia playing application program.
The first application may detect self-running state information, which may be a background running state or a foreground running state. Specifically, if the user cannot perform play control and is in a play pause state, the application program is in a background running state; if the user can perform the play control and is in the playing state, the application program is in the foreground running state.
Specifically, if the first application program is in a background running state, the operating system acquires a play control instruction; if the first application is in the foreground running state, the playing state of the first application can be controlled, and the operating system can not participate.
In an alternative embodiment, the play control instruction is pause, play, previous or next. I.e. the voice assistant supports basic control instructions during multimedia play.
S320, controlling the multimedia playing process of the second application program according to the playing control instruction; and the second application program is in a foreground running state.
The voice assistant of the first application program is used for controlling the multimedia playing state of the second application program, so that the interaction convenience of the second application program is improved, and the multimedia playing efficiency is improved. In addition, the instruction transfer is performed through the operating system, so that the situation that the first application program and the second application program cannot directly communicate can be avoided, and the application range of a voice assistant in the first application program is improved.
According to the technical scheme, if the first application program is in the background running state, the operating system receives the play control instruction and controls the multimedia play state of the second application program according to the play control instruction, so that the interaction convenience of the second application program is improved, and the multimedia play efficiency is improved.
Fig. 4 is a flowchart of a control method for multimedia playing according to an embodiment of the present application. This embodiment is an alternative to the embodiments described above. Referring to fig. 4, the method for controlling multimedia playing provided in this embodiment includes:
and S410, if the intermediate device detects that the first application program is in the background running state according to the running state information, acquiring the play control instruction from the intermediate device.
The play control instruction is determined according to the user voice information collected by the first application program. The first application program and the operating system interact through the intermediate device, so that the problem that communication cannot be performed between the first application program and the operating system due to the lack of an interaction interface or protocol conflict and the like is avoided, the limitation of the operating system is avoided, and the application range is further widened.
Besides forwarding the play control instruction, the intermediate device can also have a native interaction function with the first application program, and the intermediate device performs logic judgment according to the running state of the first application program, so that the conflict between the play control instruction and the native function of the intermediate device can be avoided.
Specifically, if the intermediate device detects that the first application program is in a background running state, the operating system acquires a play control instruction from the intermediate device; if the intermediate device detects that the first application program is in the foreground running state, the operating system may not need to receive the play control instruction.
In an alternative embodiment, the intermediate device is connected to the first application program based on a bluetooth protocol. The intermediate device communicates with the first application program and the operating system based on the Bluetooth protocol, so that the application range can be widened.
S420, controlling the multimedia playing process of the second application program according to the playing control instruction; and the second application program is in a foreground running state.
According to the technical scheme, the first application program and the operating system interact through the intermediate device, and the intermediate device performs logic judgment according to the running state of the first application program, so that the application range is further widened without being limited by the operating system, and the conflict between the forwarding play control instruction and the original function of the intermediate device can be avoided.
Fig. 5 is a flowchart of a control method for multimedia playing according to an embodiment of the present application. The embodiment can be applied to the situation that the voice assistant of the first application program controls the multimedia playing process of the second application program. The method for controlling multimedia playing disclosed in this embodiment may be executed by an intermediate device, and in particular, may be executed by a control apparatus for multimedia playing, where the apparatus may be implemented by software and/or hardware, and configured in an electronic device. Referring to fig. 5, the method for controlling multimedia playing provided in this embodiment includes:
s510, acquiring a play control instruction and running state information of a first application program from the first application program; the play control instruction is determined according to the user voice information collected by the first application program.
The first application program is a multimedia playing application program with a voice assistant function, and the playing control instruction is an instruction for controlling the multimedia playing application program.
The first application may detect self-running state information, which may be a background running state or a foreground running state. Specifically, if the user cannot perform play control and is in a play pause state, the application program is in a background running state; if the user can perform the play control and is in the playing state, the application program is in the foreground running state. Specifically, if the first application program is in the background running state, the intermediate device obtains a play control instruction and running state information from the first application program.
S520, if the first application program is detected to be in a background running state according to the running state information, controlling the multimedia playing process of the second application program through the operating system according to the playing control instruction; wherein the second application is in a foreground operating state.
In addition to forwarding the play control command, the intermediate device may also have a native interaction function with the first application, for example, the first application may adjust an operating state or a parameter of the intermediate device. The intermediate device performs logic judgment according to the running state of the first application program, so that the conflict between the forwarding play control instruction and the original function of the intermediate device can be avoided. It should be noted that, if the intermediate device needs to be controlled during the foreground running state of the first application program, the running state information and the native control instruction may be sent to the intermediate device, where the intermediate device does not need to send the native control instruction to the operating system.
In an alternative embodiment, the intermediate device is connected to the first application program based on the bluetooth protocol. The intermediate device communicates with the first application program and the operating system based on the Bluetooth protocol, so that the application range can be widened.
According to the technical scheme, in the process of controlling the second application program through the voice assistant of the first application program, the first application program and the operating system interact through the intermediate device, and the intermediate device carries out logic judgment according to the running state of the first application program, so that the application range is further widened without being limited by the operating system, and the conflict between the forwarding and playing control instruction and the original function of the intermediate device can be avoided.
Fig. 6 is a schematic structural diagram of a control device for multimedia playing according to an embodiment of the present application. Referring to fig. 6, a control device 600 for multimedia playing provided in an embodiment of the present application may include:
the instruction determining module 601 is configured to determine a play control instruction according to user voice information collected by the first application program;
the second application control module 602 is configured to control, by using an operating system, a multimedia playing process of the second application according to the playing control instruction if the running state information of the first application is a background running state; and the second application program is in a foreground running state.
Optionally, the second application control module 602 is specifically configured to:
and sending the play control instruction and the running state information to an intermediate device, wherein the play control instruction and the running state information are used for indicating the intermediate device to control the multimedia play process of the second application program through the operating system according to the play control instruction if the intermediate device detects that the first application program is in a background running state according to the running state information.
Optionally, the intermediate device is connected to the first application program based on a bluetooth protocol.
Optionally, the apparatus 600 further includes:
and the first application control module is used for controlling the multimedia playing process of the first application program according to the control instruction if the running state information of the first application program is the foreground running state.
Optionally, the instruction determining module 601 includes:
the voice acquisition unit is used for acquiring voice information of a user;
the voice sending unit is used for sending the user voice information to the server and indicating the server to determine a play control instruction according to the user voice information;
and the instruction receiving unit is used for acquiring the play control instruction from the server.
Optionally, the play control instruction is pause, play, previous or next.
According to the technical scheme, in the process of controlling the second application program through the voice assistant of the first application program, the first application program and the operating system interact through the intermediate device, and the intermediate device carries out logic judgment according to the running state of the first application program, so that the application range is further widened without being limited by the operating system, and the conflict between the forwarding and playing control instruction and the original function of the intermediate device can be avoided.
Fig. 7 is a schematic structural diagram of a control device for multimedia playing according to an embodiment of the present application. Referring to fig. 7, a control device 700 for multimedia playing provided in an embodiment of the present application may include:
the instruction obtaining module 701 is configured to obtain a play control instruction if the running state information of the first application program is a background running state; the play control instruction is determined according to the user voice information collected by the first application program;
a foreground application control module 702, configured to control a multimedia playing process of the second application program according to the playing control instruction; and the second application program is in a foreground running state.
Optionally, the instruction acquisition module 701 is specifically configured to:
and if the intermediate equipment detects that the first application program is in the background running state according to the running state information, acquiring the playing control instruction from the intermediate equipment.
Optionally, the intermediate device is connected to the first application program based on a bluetooth protocol.
Optionally, the play control instruction is pause, play, previous or next.
According to the technical scheme, in the process of controlling the second application program through the voice assistant of the first application program, the first application program and the operating system interact through the intermediate device, and the intermediate device carries out logic judgment according to the running state of the first application program, so that the application range is further widened without being limited by the operating system, and the conflict between the forwarding and playing control instruction and the original function of the intermediate device can be avoided.
Fig. 8 is a schematic structural diagram of a control device for multimedia playing according to an embodiment of the present application. Referring to fig. 8, a control device 800 for multimedia playing provided in an embodiment of the present application may include:
an information obtaining module 801, configured to obtain a play control instruction and running state information of a first application program from the first application program; the play control instruction is determined according to the user voice information collected by the first application program;
The instruction transfer module 802 is configured to control, by using the operating system, a multimedia playing process of the second application program according to the playing control instruction if the first application program is detected to be in a background running state according to the running state information; wherein the second application is in a foreground operating state.
Optionally, the intermediate device is connected to the first application program based on a bluetooth protocol.
Optionally, the play control instruction is pause, play, previous or next.
According to the technical scheme, in the process of controlling the second application program through the voice assistant of the first application program, the first application program and the operating system interact through the intermediate device, and the intermediate device carries out logic judgment according to the running state of the first application program, so that the application range is further widened without being limited by the operating system, and the conflict between the forwarding and playing control instruction and the original function of the intermediate device can be avoided.
According to embodiments of the present application, an electronic device and a readable storage medium are also provided.
As shown in fig. 9, there is a block diagram of an electronic device according to a method of controlling multimedia play according to an embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the application described and/or claimed herein.
As shown in fig. 9, the electronic device includes: one or more processors 901, memory 902, and interfaces for connecting the components, including high-speed interfaces and low-speed interfaces. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions executing within the electronic device, including instructions stored in or on memory to display graphical information of the GUI on an external input/output device, such as a display device coupled to the interface. In other embodiments, multiple processors and/or multiple buses may be used, if desired, along with multiple memories and multiple memories. Also, multiple electronic devices may be connected, each providing a portion of the necessary operations (e.g., as a server array, a set of blade servers, or a multiprocessor system). In fig. 9, a processor 901 is taken as an example.
Memory 902 is a non-transitory computer-readable storage medium provided herein. Wherein the memory stores instructions executable by the at least one processor to cause the at least one processor to perform a method of controlling multimedia playback provided herein. The non-transitory computer readable storage medium of the present application stores computer instructions for causing a computer to perform a method of controlling multimedia playback provided by the present application.
The memory 902 is used as a non-transitory computer readable storage medium, and may be used to store non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules (e.g., the instruction determining module 601 and the second application control module 602 shown in fig. 6, the instruction acquiring module 701 and the foreground application control module 702 shown in fig. 7, and the information acquiring module 801 and the instruction relay module 802 shown in fig. 8) corresponding to the method of controlling multimedia playback in the embodiments of the present application. The processor 901 executes various functional applications of the server and control of multimedia playback, i.e., a method of implementing control of multimedia playback in the above-described method embodiment, by running non-transitory software programs, instructions, and modules stored in the memory 902.
The memory 902 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, at least one application program required for a function; the storage data area may store data created according to the use of the electronic device for control of multimedia playback, and the like. In addition, the memory 902 may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid-state storage device. In some embodiments, memory 902 optionally includes memory remotely located relative to processor 901, which may be connected to the controlling electronics of the multimedia presentation via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The electronic device of the method of controlling multimedia play may further include: an input device 903 and an output device 904. The processor 901, memory 902, input devices 903, and output devices 904 may be connected by a bus or other means, for example in fig. 9.
The input device 903 may receive input numeric or character information as well as key signal inputs related to user settings and function controls of the electronic device that control multimedia playback, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, a joystick, one or more mouse buttons, a track ball, a joystick, and the like. The output means 904 may include a display device, auxiliary lighting means (e.g., LEDs), tactile feedback means (e.g., vibration motors), and the like. The display device may include, but is not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, and a plasma display. In some implementations, the display device may be a touch screen.
Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, integrated circuitry, application specific ASIC (application specific integrated circuit), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
These computing programs (also referred to as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented in a high-level procedural and/or object-oriented programming language, and/or in assembly/machine language. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the internet.
The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
According to the technical scheme, in the process of controlling the second application program through the voice assistant of the first application program, the first application program and the operating system interact through the intermediate device, and the intermediate device carries out logic judgment according to the running state of the first application program, so that the application range is further widened without being limited by the operating system, and the conflict between the forwarding and playing control instruction and the original function of the intermediate device can be avoided.
Fig. 10 is a schematic structural diagram of a control system for multimedia playing according to an embodiment of the present application. Referring to FIG. 10, the system may include a first application, an operating system, and a second application;
the first application program is used for determining a play control instruction according to the collected user voice information;
the first application program is further configured to send the play control instruction to the operating system if the running state information of the first application program is a background running state;
the operating system is used for controlling the multimedia playing process of the second application program according to the playing control instruction; and the second application program is in a foreground running state.
The first application program, the operating system and the second application program can be deployed on the same intelligent terminal, the first application program can be a multimedia application program supporting the voice assistant, and the second application program can be a multimedia application program not supporting the voice assistant. The voice assistant function of the first application program can serve the second application program, and the user can control the multimedia playing process of the second application program through voice interaction, so that the multimedia playing efficiency of the second application program is improved. The first application may communicate directly with the operating system over a first communication link.
Optionally, the system may further comprise an intermediary device; the first application program is specifically configured to send the running state information and the play control instruction to the intermediate device if the running state information of the first application program is a background running state; and the intermediate equipment is used for sending the play control instruction to the operating system if the first application program is detected to be in the background running state according to the running state information. The first application may communicate with the operating system over a second link that is mediated by the intermediary device.
In addition to forwarding the play control command, the intermediate device may also have a native interaction function with the first application, for example, the first application may adjust an operating state or a parameter of the intermediate device. The intermediate device performs logic judgment according to the running state of the first application program, so that the conflict between the forwarding play control instruction and the original function of the intermediate device can be avoided.
Optionally, the intermediate device is connected to the first application program based on a bluetooth protocol. The intermediate device communicates with the first application program and the operating system based on the Bluetooth protocol, is not limited by the operating system, and can widen the application range.
According to the technical scheme, in the process of controlling the second application program through the voice assistant of the first application program, the first application program and the operating system interact through the intermediate device, and the intermediate device carries out logic judgment according to the running state of the first application program, so that the application range is further widened without being limited by the operating system, and the conflict between the forwarding and playing control instruction and the original function of the intermediate device can be avoided.
The above embodiments do not limit the scope of the application. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present application are intended to be included within the scope of the present application.
Claims (19)
1. A method for controlling multimedia playing, comprising:
determining a play control instruction according to user voice information acquired by a first application program;
if the running state information of the first application program is a background running state, sending the playing control instruction and the running state information to an intermediate device, wherein the playing control instruction and the running state information are used for indicating the intermediate device to control the multimedia playing process of the second application program through an operating system according to the playing control instruction if the intermediate device detects that the first application program is in the background running state according to the running state information; wherein the second application is in a foreground running state;
And if the running state information of the first application program is the foreground running state, controlling the multimedia playing process of the first application program according to the playing control instruction.
2. The method of claim 1, wherein the intermediary device is connected to the first application based on a bluetooth protocol.
3. The method of claim 1, wherein the determining the play control command according to the user voice information collected by the first application program comprises:
collecting voice information of a user;
the user voice information is sent to a server side, and the user voice information is used for indicating the server side to determine a play control instruction according to the user voice information;
and acquiring the play control instruction from the server.
4. The method of claim 1, wherein the play control instruction is pause, play, previous or next.
5. A method for controlling multimedia playing, comprising:
if the intermediate device detects that the first application program is in a background running state according to running state information of the first application program, a play control instruction is acquired from the intermediate device; the play control instruction is determined according to the user voice information collected by the first application program;
Controlling the multimedia playing process of the second application program according to the playing control instruction; wherein the second application is in a foreground running state;
and if the running state information of the first application program is the foreground running state, the playing control instruction is used for controlling the multimedia playing process of the first application program.
6. The method of claim 5, wherein the intermediary device is connected to the first application based on a bluetooth protocol.
7. A control method for multimedia playing is applied to an intermediate device and comprises the following steps:
acquiring a play control instruction and running state information of a first application program from the first application program; the play control instruction is determined according to the user voice information collected by the first application program;
if the first application program is detected to be in a background running state according to the running state information, controlling a multimedia playing process of a second application program through an operating system according to the playing control instruction; wherein the second application is in a foreground operating state;
and if the running state information of the first application program is the foreground running state, the playing control instruction is used for controlling the multimedia playing process of the first application program.
8. The method of claim 7, wherein an execution subject of the method interfaces with the first application based on a bluetooth protocol.
9. A control device for multimedia playing, comprising:
the instruction determining module is used for determining a play control instruction according to the user voice information acquired by the first application program;
the second application control module is used for sending the play control instruction and the running state information to the intermediate equipment if the running state information of the first application program is a background running state, and used for indicating the intermediate equipment to control the multimedia play process of the second application program through the operating system according to the play control instruction if the intermediate equipment detects that the first application program is in the background running state according to the running state information; wherein the second application is in a foreground running state;
and the first application control module is used for controlling the multimedia playing process of the first application program according to the control instruction if the running state information of the first application program is the foreground running state.
10. The apparatus of claim 9, wherein the intermediary device is coupled to the first application based on a bluetooth protocol.
11. The apparatus of claim 9, wherein the instruction determination module comprises:
the voice acquisition unit is used for acquiring voice information of a user;
the voice sending unit is used for sending the user voice information to the server and indicating the server to determine a play control instruction according to the user voice information;
and the instruction receiving unit is used for acquiring the play control instruction from the server.
12. The apparatus of claim 9, wherein the play control instruction is pause, play, previous or next.
13. A control device for multimedia playing, comprising:
the instruction acquisition module is used for acquiring a play control instruction from the intermediate equipment if the intermediate equipment detects that the first application program is in a background running state according to running state information of the first application program; the play control instruction is determined according to the user voice information collected by the first application program;
the foreground application control module is used for controlling the multimedia playing process of the second application program according to the playing control instruction; wherein the second application is in a foreground running state;
And if the running state information of the first application program is the foreground running state, the playing control instruction is used for controlling the multimedia playing process of the first application program.
14. The apparatus of claim 13, wherein the intermediary device is coupled to the first application based on a bluetooth protocol.
15. A control device for multimedia playing is applied to an intermediate device and comprises:
the information acquisition module is used for acquiring a play control instruction and running state information of the first application program from the first application program; the play control instruction is determined according to the user voice information collected by the first application program;
the instruction transfer module is used for controlling the multimedia playing process of the second application program according to the playing control instruction through the operating system if the first application program is detected to be in the background running state according to the running state information; wherein the second application is in a foreground operating state;
and if the running state information of the first application program is the foreground running state, the playing control instruction is used for controlling the multimedia playing process of the first application program.
16. The apparatus of claim 15, wherein the intermediary device is coupled to the first application based on a bluetooth protocol.
17. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-8.
18. A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method of any one of claims 1-8.
19. A control system for multimedia playing comprises a first application program, an operating system, an intermediate device and a second application program;
the first application program is used for determining a play control instruction according to the collected user voice information;
the first application program is further configured to send the play control instruction to the operating system if the running state information of the first application program is a background running state;
The operating system is used for controlling the multimedia playing process of the second application program according to the playing control instruction; wherein the second application is in a foreground running state;
the first application program is specifically configured to send the running state information and the play control instruction to the intermediate device if the running state information of the first application program is a background running state;
the intermediate device is used for sending the play control instruction to the operating system if the first application program is detected to be in a background running state according to the running state information;
the first application program is further configured to control a multimedia playing process of the first application program according to the playing control instruction if the running state information of the first application program is a foreground running state.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010681983.5A CN111880875B (en) | 2020-07-15 | 2020-07-15 | Control method, device, equipment, storage medium and system for multimedia playing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010681983.5A CN111880875B (en) | 2020-07-15 | 2020-07-15 | Control method, device, equipment, storage medium and system for multimedia playing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111880875A CN111880875A (en) | 2020-11-03 |
| CN111880875B true CN111880875B (en) | 2023-12-22 |
Family
ID=73155434
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010681983.5A Active CN111880875B (en) | 2020-07-15 | 2020-07-15 | Control method, device, equipment, storage medium and system for multimedia playing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111880875B (en) |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102622176A (en) * | 2012-02-24 | 2012-08-01 | 青岛海信移动通信技术股份有限公司 | Processing method and device of application program operation interface |
| US8296783B1 (en) * | 2010-05-28 | 2012-10-23 | Adobe Systems Incorporated | Media player instance managed resource reduction |
| CN102779070A (en) * | 2011-02-14 | 2012-11-14 | 微软公司 | Background audio on mobile devices |
| CN103593230A (en) * | 2012-08-13 | 2014-02-19 | 百度在线网络技术（北京）有限公司 | Background task control method of mobile terminal and mobile terminal |
| WO2016023319A1 (en) * | 2014-08-12 | 2016-02-18 | 广州华多网络科技有限公司 | Method and device for controlling multimedia player, and terminal |
| CN105957541A (en) * | 2016-04-22 | 2016-09-21 | 北京金山安全软件有限公司 | Music operation control method and device and mobile device |
| CN106157955A (en) * | 2015-03-30 | 2016-11-23 | 阿里巴巴集团控股有限公司 | A kind of sound control method and device |
| CN109584879A (en) * | 2018-11-23 | 2019-04-05 | 华为技术有限公司 | A kind of sound control method and electronic equipment |
| GB201907710D0 (en) * | 2019-05-31 | 2019-07-17 | Continental Automotive Gmbh | Multimedia system with optimiszed performance |
| CN110321201A (en) * | 2018-03-29 | 2019-10-11 | 努比亚技术有限公司 | A kind of background program processing method, terminal and computer readable storage medium |
| CN110647305A (en) * | 2019-09-29 | 2020-01-03 | 百度在线网络技术（北京）有限公司 | Voice interaction method, device, equipment and medium of application program |
| CN111341315A (en) * | 2020-03-06 | 2020-06-26 | 腾讯科技（深圳）有限公司 | Voice control method, device, computer equipment and storage medium |
| CN111354360A (en) * | 2020-03-17 | 2020-06-30 | 北京百度网讯科技有限公司 | Voice interaction processing method and device and electronic equipment |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9104476B2 (en) * | 2010-04-07 | 2015-08-11 | Apple Inc. | Opportunistic multitasking of VOIP applications |
| KR102365649B1 (en) * | 2017-06-28 | 2022-02-22 | 삼성전자주식회사 | Method for controlling display and electronic device supporting the same |
| KR102508863B1 (en) * | 2018-03-19 | 2023-03-10 | 삼성전자 주식회사 | A electronic apparatus and a server for processing received data from the apparatus |
| KR102629139B1 (en) * | 2018-09-21 | 2024-01-26 | 삼성전자주식회사 | Apparatus and method for capturing multimedia content |
| US10796695B2 (en) * | 2018-11-27 | 2020-10-06 | Lg Electronics Inc. | Multimedia device for processing voice command |
-
2020
- 2020-07-15 CN CN202010681983.5A patent/CN111880875B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8296783B1 (en) * | 2010-05-28 | 2012-10-23 | Adobe Systems Incorporated | Media player instance managed resource reduction |
| CN102779070A (en) * | 2011-02-14 | 2012-11-14 | 微软公司 | Background audio on mobile devices |
| CN102622176A (en) * | 2012-02-24 | 2012-08-01 | 青岛海信移动通信技术股份有限公司 | Processing method and device of application program operation interface |
| CN103593230A (en) * | 2012-08-13 | 2014-02-19 | 百度在线网络技术（北京）有限公司 | Background task control method of mobile terminal and mobile terminal |
| WO2016023319A1 (en) * | 2014-08-12 | 2016-02-18 | 广州华多网络科技有限公司 | Method and device for controlling multimedia player, and terminal |
| CN106157955A (en) * | 2015-03-30 | 2016-11-23 | 阿里巴巴集团控股有限公司 | A kind of sound control method and device |
| CN105957541A (en) * | 2016-04-22 | 2016-09-21 | 北京金山安全软件有限公司 | Music operation control method and device and mobile device |
| CN110321201A (en) * | 2018-03-29 | 2019-10-11 | 努比亚技术有限公司 | A kind of background program processing method, terminal and computer readable storage medium |
| CN109584879A (en) * | 2018-11-23 | 2019-04-05 | 华为技术有限公司 | A kind of sound control method and electronic equipment |
| GB201907710D0 (en) * | 2019-05-31 | 2019-07-17 | Continental Automotive Gmbh | Multimedia system with optimiszed performance |
| CN110647305A (en) * | 2019-09-29 | 2020-01-03 | 百度在线网络技术（北京）有限公司 | Voice interaction method, device, equipment and medium of application program |
| CN111341315A (en) * | 2020-03-06 | 2020-06-26 | 腾讯科技（深圳）有限公司 | Voice control method, device, computer equipment and storage medium |
| CN111354360A (en) * | 2020-03-17 | 2020-06-30 | 北京百度网讯科技有限公司 | Voice interaction processing method and device and electronic equipment |
Non-Patent Citations (1)
| Title |
|---|
| 基于Android平台声控应用的研究与开发;梁昌银;雒江涛;周丽娴;;电声技术(第12期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111880875A (en) | 2020-11-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110647305B (en) | Voice interaction method, device, equipment and medium of application program | |
| US20210210091A1 (en) | Method, device, and storage medium for waking up via speech | |
| CN110660390B (en) | Intelligent device wake-up method, intelligent device and computer readable storage medium | |
| CN111586128B (en) | Method, device, equipment and storage medium for acquiring applet data | |
| CN111984476B (en) | Test method and device | |
| CN111866567B (en) | Multimedia playing method, device, equipment and storage medium | |
| CN112235417B (en) | Method and device for sending debugging instruction | |
| CN112382294B (en) | Speech recognition method, device, electronic equipment and storage medium | |
| CN111443801B (en) | Man-machine interaction method, device, equipment and storage medium | |
| JP2021101364A (en) | Vehicle calling command transmission method, device, and electronic device | |
| CN112346612B (en) | Page display method and device | |
| CN110501918A (en) | Intelligent electrical appliance control, device, electronic equipment and storage medium | |
| CN111862975A (en) | Intelligent terminal control method, device, equipment, storage medium and system | |
| CN110718221A (en) | Voice skill control method, voice equipment, client and server | |
| CN110933227A (en) | Assistance method, device, equipment and medium for intelligent terminal | |
| CN111369999A (en) | Signal processing method and device and electronic equipment | |
| CN111638787B (en) | Method and device for displaying information | |
| CN111880857B (en) | Method, device, equipment and storage medium for issuing small program | |
| CN112382292A (en) | Voice-based control method and device | |
| CN110517079B (en) | Data processing method and device, electronic equipment and storage medium | |
| CN111880875B (en) | Control method, device, equipment, storage medium and system for multimedia playing | |
| CN112489659B (en) | Data processing method, system, server and terminal equipment based on input method | |
| CN111352685B (en) | Display method, device, equipment and storage medium of input method keyboard | |
| CN110609671B (en) | Sound signal enhancement method, device, electronic equipment and storage medium | |
| CN113655906A (en) | Folding screen control method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20210513 Address after: 100085 Baidu Building, 10 Shangdi Tenth Street, Haidian District, Beijing Applicant after: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) Co.,Ltd. Applicant after: Shanghai Xiaodu Technology Co.,Ltd. Address before: 100085 Baidu Building, 10 Shangdi Tenth Street, Haidian District, Beijing Applicant before: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |