WO2015196571A1

WO2015196571A1 - Method, system, server and storing medium for playing multimedia

Info

Publication number: WO2015196571A1
Application number: PCT/CN2014/086320
Authority: WO
Inventors: 陈俊霖; 张徐瑜; 张华强; 汪翼; 梁亮
Original assignee: 中兴通讯股份有限公司
Priority date: 2014-06-26
Filing date: 2014-09-11
Publication date: 2015-12-30
Also published as: CN105227527A

Abstract

Disclosed in embodiments of the present invention is a method for playing multi-media, which is applied to a server; the method includes: obtaining a pre-played multimedia stream; obtaining data information corresponding to the multimedia stream according to the multimedia stream, and transmitting the data information corresponding to the multimedia stream by multicasting. A system, server and storing medium for playing multi-media are also disclosed in the embodiments of the present invention.

Description

Method and system for playing multimedia, server, storage medium

Technical field

The present invention relates to cloud computing technologies, and in particular, to a method and system for playing multimedia, a server, and a storage medium.

Background technique

The remote virtual interface adopts a client-server mode, and virtualizes a set of virtual interfaces required by the user on the server in the cloud, that is, the remote data center, and displays the virtual interface on the client. The client and the virtual interface are the same as the operation interface on the general host; in the case where the Internet is becoming more and more popular, the remote virtual interface technology can save resources and flexibly allocate hardware resources.

In many application scenarios, such as education, conferences, etc., the virtual interface needs to be shared with many users at the same time. In this scenario, the user corresponding to the demo is typically accessed by a user who needs to demonstrate. The virtual interface system performs relevant operations, and then pushes the virtual interface to other clients through the server corresponding to the virtual interface system for other users to view.

In the existing solution, the virtual interface that needs to be shared is directly mirrored to the presentation client, and the audio and video that are finally presented on the virtual interface are respectively encoded into a stream in a fixed format and sent to the viewing client. Presented on. The above solution can meet the needs of users for general demonstration operations; however, for playing multimedia information, especially high-definition multimedia information, the user experience is greatly reduced due to insufficient fluency of audio and video; As shown, in the existing virtual interface system 18, the multimedia player 12 first reads the pre-played original multimedia source 11 and decodes the data corresponding to the original multimedia source 11 and presents it to the virtual interface 13 corresponding to the presenter. On, then on the virtual interface corresponding to the server 19 The audio and video in the entire virtual interface in which the original multimedia source is played are once again encoded into one stream, and the streams are sent to the decoding modules 16 of the viewing clients 10 through the communication module 15 in the encoder 14 . After being decoded by each encoding module 16, it is displayed on the virtual interface 17 of each client; thus, the original multimedia source is encoded and decoded multiple times in the virtual interface system and the server corresponding to the virtual interface system, resulting in final rendering. The fluency of the multimedia information on the virtual interface of the client is greatly reduced; and, because the frame rate of the multimedia stream is higher, the frame rate in the virtual interface system is lower, and if the multimedia information corresponding to the multimedia stream is presented more smoothly, then The frequency of the multimedia stream needs to be increased, which will increase the unnecessary and repeated desktop image encoding transmission process, which will increase the overhead of the server, and thus the fluency of the multimedia information presented on the virtual interface of the client is reduced; The frequency of the multimedia stream is presented in the stream of multimedia information on the virtual interface of the client. Degree will be greatly reduced.

Summary of the invention

In order to solve the existing technical problems, the embodiments of the present invention provide a method and system for playing multimedia, a server, and a storage medium, which can overcome the problem that the multimedia information presented on the client is not smooth due to excessive server overhead.

To achieve the above objective, the technical solution of the embodiment of the present invention is implemented as follows:

The embodiment of the invention provides a method for playing multimedia, which is applied to a server; the method includes:

Obtain a pre-played multimedia stream;

Acquiring the data information corresponding to the multimedia stream according to the multimedia stream, and transmitting the data information corresponding to the multimedia stream by using a multicast manner.

In the foregoing solution, before the acquiring the multimedia stream, the method further includes:

Setting a virtual interaction interface; the virtual interaction interface can be displayed on each client corresponding to the preset multicast group;

Obtaining an identifier corresponding to the multimedia stream by using the virtual interaction interface;

Correspondingly, the acquiring the pre-played multimedia stream includes:

A pre-played multimedia stream is determined based on the identification.

The embodiment of the invention further provides a method for playing multimedia, the method relates to a server and N clients; the method includes:

Obtaining, by the server, the pre-played multimedia stream, and acquiring the data information corresponding to the multimedia stream, and transmitting the data information corresponding to the multimedia stream to the N clients corresponding to the preset multicast group by using a multicast manner;

The N clients respectively receive data information corresponding to the multimedia stream, decode the data information, and present the decoded data information corresponding to the multimedia stream.

In the above solution, before the server obtains the pre-played multimedia stream, the method further includes:

The server sets a virtual interaction interface, and presents the virtual interaction interface on the N clients;

Determining, by the virtual interaction interface, the identifier of the pre-played multimedia stream by using any one of the N clients;

The server acquires the identifier, and determines a pre-played multimedia stream corresponding to the identifier.

In the above solution, the method further includes:

The N clients corresponding to the preset multicast group display the data information received by themselves on their own virtual interactive interface.

The embodiment of the invention further provides a server, the server comprising:

a first acquiring unit, configured to acquire a pre-played multimedia stream;

a second acquiring unit, configured to acquire, according to the multimedia stream, data information corresponding to the multimedia stream;

The sending unit is configured to send the data information corresponding to the multimedia stream by using a multicast manner.

In the above solution, the server further includes:

The setting unit is configured to set a virtual interaction interface; the virtual interaction interface can be displayed on each client corresponding to the preset multicast group;

a third acquiring unit, configured to acquire, by using the virtual interaction interface, an identifier corresponding to the multimedia stream;

Correspondingly, the first acquiring unit is further configured to determine a pre-played multimedia stream according to the identifier.

The embodiment of the invention further provides a system for playing multimedia, the system comprising: a server and N clients; wherein

And the server is configured to obtain the pre-played multimedia stream, and obtain the data information corresponding to the multimedia stream, and send the data information corresponding to the multimedia stream to the N clients corresponding to the preset multicast group by using a multicast mode. ;

The client is configured to receive the data information corresponding to the multimedia stream, decode the data information, and present the decoded data information corresponding to the multimedia stream.

In the above solution, the server is further configured to set a virtual interaction interface, and present the virtual interaction interface on the N clients.

a client, configured to determine, by using the virtual interaction interface, an identifier of the pre-played multimedia stream; correspondingly,

The server is further configured to acquire the identifier, and determine a pre-played multimedia stream corresponding to the identifier.

In the above solution, the client is further configured to display the data information received by itself on its own virtual interactive interface.

The method and system for playing multimedia, the server, and the storage medium provided by the embodiment of the present invention strip the multimedia stream from the system corresponding to the virtual interaction interface, so that the multimedia stream is not decoded by the system corresponding to the virtual interaction interface. The code is not encoded by the server corresponding to the virtual interactive interface, but the original undecoded multimedia stream is directly sent to the multicast mode. On each client corresponding to the multicast group, each client is decoded and presented on the virtual interaction interface of each client. Therefore, the problem that the multimedia information presented on the client is not smooth due to excessive server overhead can be overcome.

DRAWINGS

1 is a schematic flowchart of an implementation process of a method for playing multimedia in the prior art;

2 is a schematic flowchart 1 of an implementation process of a method for playing multimedia according to an embodiment of the present invention;

3 is a schematic structural diagram of a server according to an embodiment of the present invention;

4 is a second schematic diagram of an implementation process of a method for playing multimedia according to an embodiment of the present invention;

5 is a schematic flowchart 3 of an implementation process of a method for playing multimedia according to an embodiment of the present invention;

6 is a schematic structural diagram of a system for playing multimedia according to an embodiment of the present invention;

FIG. 7 is a schematic flowchart of a specific implementation of a method for playing multimedia according to an embodiment of the present invention;

FIG. 8 is a schematic structural diagram of a system for playing multimedia according to an embodiment of the present invention.

detailed description

The embodiments of the present invention are described in detail with reference to the accompanying drawings.

Embodiment 1

2 is a schematic flowchart of an implementation of a method for playing multimedia according to an embodiment of the present invention; the method is applied to a server; and the server can send data to a multicast group corresponding to the multicast group according to a preset multicast group. Each client; as described in FIG. 2, the method includes:

Step 201: Acquire a pre-played multimedia stream.

Step 202: Acquire data information corresponding to the multimedia stream according to the multimedia stream, and send data information corresponding to the multimedia stream by using a multicast manner.

Correspondingly, the acquiring the pre-played multimedia stream includes:

A pre-played multimedia stream is determined based on the identification.

Here, the data information corresponding to the multimedia stream includes data information corresponding to the multimedia stream, format information, time information, and location information of the multimedia stream.

Here, the server is connected to each client corresponding to the preset multicast group, and then the server sets a virtual interaction system, and displays a virtual interaction interface corresponding to the virtual interaction system on each client. A pre-presented client in the client determines an identifier of the pre-played multimedia stream through its virtual interaction interface, and sends the identifier to the server through the virtual interaction interface, the server according to the identifier Determining a pre-played multimedia stream, and reading the multimedia stream through a multimedia player in the server, when the multimedia player reads the multimedia stream, the multimedia stream is used by the multimedia stream capturer in the server Capture, the multimedia stream capturer identifies format information, time information, and location information of the captured multimedia stream, and encapsulates the information and the data information of the multimedia stream, and directly sends the data to the corresponding multicast group. On the client.

Here, the multimedia player in the server of the embodiment of the present invention does not need to decode the pre-played multimedia stream and is presented to the pre-demo, as compared with the prior art, because the multimedia stream obtained by the server is not encoded by the virtual interactive system. On the virtual interactive interface of the client, the multimedia stream is not required to be encoded, but the multimedia stream is directly sent to each client corresponding to the preset multicast group through the multimedia stream capture device; at this time, the settings are set in each client. a multi-format decoder, which decodes each received multimedia stream and its format information, time information, and location information by the multi-format decoder, and presents the multimedia stream to its own corresponding according to the time information and the location information. In the virtual interaction interface, for the user to watch, therefore, the embodiment of the present invention can overcome the service The overhead of the server is too large, and the multimedia information presented on the client is not smooth. .

In order to implement the foregoing method, the embodiment of the present invention further provides a server corresponding to the foregoing method, where the server can send data to each client corresponding to the multicast group by using a multicast mode according to a preset multicast group. As shown in FIG. 3, the server includes:

The first obtaining unit 31 is configured to acquire a pre-played multimedia stream.

The second obtaining unit 32 is configured to acquire, according to the multimedia stream, data information corresponding to the multimedia stream;

The sending unit 33 is configured to send the data information corresponding to the multimedia stream in a multicast manner.

In the above solution, the server further includes:

Correspondingly, the first obtaining unit 31 is further configured to determine a pre-played multimedia stream according to the identifier.

Here, the first obtaining unit, the second obtaining unit, the sending unit, the setting unit, and the third obtaining unit may all run on a computer, and may be a central processing unit (CPU) or a microprocessor (MPU) located on the computer. Or a digital signal processor (DSP), or a programmable gate array (FPGA) implementation; for example, the function of the first acquisition unit can be implemented by a multimedia player in a computer; the function of the second acquisition unit can be operated Implemented in the multimedia capture device.

The embodiment of the present invention further provides a first computer storage medium, wherein the computer storage medium stores a computer program, and the computer program is used to execute the method for playing multimedia according to the first embodiment of the present invention.

Embodiment 2

4 is a schematic flowchart 2 of an implementation process of a method for playing multimedia according to an embodiment of the present invention; the method is applied to a client; the method includes:

Step 401: Receive data information corresponding to the multimedia stream.

Step 402: Decode the data information, and present the decoded data information corresponding to the multimedia stream.

Here, after the virtual interactive system is set up by the server, and the virtual interactive interface corresponding to the virtual interactive system is displayed on each client corresponding to the multicast group, a pre-presented client in the client passes its virtual interaction. The interface determines an identifier of the pre-played multimedia stream, and sends the identifier to the server by using the virtual interaction interface, where the server determines the pre-played multimedia stream according to the identifier, and acquires the multimedia stream according to the multimedia stream. Transmitting the data information corresponding to the multimedia stream, and transmitting the data information corresponding to the multimedia stream to each client corresponding to the preset multicast group by using a multicast mode, and each client receives the data information corresponding to the multimedia stream; The multi-format decoder in the terminal itself decodes the data information, and presents the decoded data information corresponding to the multimedia stream in its corresponding virtual interaction interface.

Specifically, since the data information of the multimedia stream sent by the server includes data information corresponding to the multimedia stream, and format information, time information, and location information of the multimedia stream, each client may use its own multi-format decoder. The data information corresponding to the received multimedia stream and its format information, time information and location information are decoded, and the multimedia stream is presented in its corresponding virtual interaction interface according to the time information and the location information.

Embodiment 3

5 is a schematic flowchart 3 of an implementation process of a method for playing multimedia according to an embodiment of the present invention; the method relates to a server and N clients; and the server can send data to the The N clients corresponding to the multicast group; as shown in FIG. 5, the method includes:

Step 501: The server acquires a pre-played multimedia stream, and acquires the multimedia stream pair. Sending, by the multicast data, the data information corresponding to the multimedia stream to the N clients corresponding to the preset multicast group;

Step 502: The N clients respectively receive data information corresponding to the multimedia stream, decode the data information, and present the decoded data information corresponding to the multimedia stream.

In the above solution, the method further includes:

In order to implement the above method, an embodiment of the present invention further provides a system for playing multimedia corresponding to the foregoing method. As shown in FIG. 6, the system includes: a server 61 and N clients 62; A multicast group is configured to send data to the N clients corresponding to the multicast group by using a multicast mode, where

The server 61 is configured to acquire a pre-played multimedia stream, and obtain data information corresponding to the multimedia stream, and send the data information corresponding to the multimedia stream to the N customers corresponding to the preset multicast group by using a multicast mode. end;

The client 62 is configured to receive data information corresponding to the multimedia stream, decode the data information, and present the decoded data information corresponding to the multimedia stream.

In the above solution, the server 61 is further configured to set a virtual interaction interface, and present the virtual interaction interface on the N clients.

The client 62 is configured to determine, by using the virtual interaction interface, an identifier of the pre-played multimedia stream; correspondingly,

The server 61 is further configured to acquire the identifier, and determine a pre-played multimedia stream corresponding to the identifier.

In the above solution, the client 62 is further configured to display the data information received by itself on its own virtual interactive interface.

The embodiment of the present invention further provides a second computer storage medium, wherein the computer storage medium stores a computer program, and the computer program is used to execute the method for playing multimedia according to the third embodiment of the present invention.

Embodiment 4

FIG. 7 is a schematic flowchart of a specific implementation of a method for playing multimedia according to an embodiment of the present invention; FIG. 8 is a schematic diagram of a specific structure of a system for playing multimedia according to an embodiment of the present invention; FIG. In the remote virtual interactive interface of multi-way push, the specific steps of the method for efficiently playing multimedia include:

Step 701: The client corresponding to the user is logged into the virtual interaction system 81, and the virtual interaction interface 89 is displayed on the presentation user client 86.

Step 702: Each viewing user client 87 is connected to the server 80 and added to the multicast group corresponding to the virtual interaction interface.

Here, the order of execution of

steps

701 and 702 can be reversed.

Step 703: On the presentation user client 86, the original pre-played original multimedia source 82 of the multimedia player 83 is opened through the virtual interaction interface 89;

Step 704: The multimedia player 83 acquires a multimedia stream corresponding to the original multimedia source 82.

Step 705: The multimedia stream in the multimedia player 83 is captured by the multimedia stream capture unit 84 in the server 80, and the multimedia stream capture unit 84 reads the format letter of the multimedia stream. The information, the time information, and the location information are encapsulated, and the data information corresponding to the multimedia stream and the format information, the time information, and the location information of the multimedia stream are encapsulated and then multicasted to each viewing user client corresponding to the multicast group. On end 87;

Here, the encapsulated data information corresponding to the multimedia stream and the format information, time information and location information of the multimedia stream are sent to the viewing user client 87 through the communication module 85 in the server 80;

Under the condition that the operating system of the server is the Windows operating system, the multimedia player generally uses the media Foundation architecture for multimedia playback. Each time the multimedia is played, a media session object and a Topology object are created, and the media session object is used to Playback controls; the Topology object includes a series of interconnected playback components, such as media source, stream, decoder, etc. Each play component describes the data flow of the entire playback process and allows customization of the Topology object. In this case, the multimedia stream capturer is a specially customized Topology object under the media Foundation framework, and the multimedia stream capturer is loaded by the multimedia player, and then captured by the multimedia stream during playback. The device directly forwards the data to the communication module in the server to forward the data through the communication module.

Step 706: After receiving the encapsulated data information corresponding to the multimedia stream and the format information, time information, and location information of the multimedia stream, each viewing user client 87 uses its own multi-format decoder 88 according to the format information. The multimedia stream is decoded, and then the decoded multimedia stream is presented to the virtual interactive interface 89 of each viewing user client 87 for viewing by the user according to the time information and the location information.

Since the multimedia stream read from the original multimedia source can theoretically be in any format, a multi-format decoder is used in the client instead of the fixed-format decoder in the prior art. Here, the multimedia stream is usually soft-solved using the CPU in the client, but if the hardware of the client allows, the client will use the hard solution to speed up the decoding process.

Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention can take the form of a hardware embodiment, a software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) including computer usable program code.

The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

The above is only the preferred embodiment of the present invention and is not intended to limit the scope of the present invention.

Industrial applicability

In the embodiment of the present invention, the multimedia stream is stripped from the system corresponding to the virtual interaction interface, so that the multimedia stream is not decoded by the system corresponding to the virtual interaction interface, and is not encoded by the server corresponding to the virtual interaction interface. Rather, the original undecoded multimedia stream is directly sent to each client corresponding to the multicast group through multicast, and each client is decoded and presented on the virtual interactive interface of each client. Therefore, the server overhead can be overcome. The large resulting multimedia information presented on the client is not smooth.

Claims

A method for playing multimedia, applied to a server; the method includes:

Obtain a pre-played multimedia stream;

Acquiring the data information corresponding to the multimedia stream according to the multimedia stream, and transmitting the data information corresponding to the multimedia stream by using a multicast manner.
The method of claim 1, wherein before the obtaining the multimedia stream, the method further comprises:

Setting a virtual interaction interface; the virtual interaction interface can be displayed on each client corresponding to the preset multicast group;

Obtaining an identifier corresponding to the multimedia stream by using the virtual interaction interface;

Correspondingly, the acquiring the pre-played multimedia stream includes:

A pre-played multimedia stream is determined based on the identification.
A method of playing multimedia, the method involving a server and N clients; the method comprising:

Obtaining, by the server, the pre-played multimedia stream, and acquiring the data information corresponding to the multimedia stream, and transmitting the data information corresponding to the multimedia stream to the N clients corresponding to the preset multicast group by using a multicast manner;

The N clients respectively receive data information corresponding to the multimedia stream, decode the data information, and present the decoded data information corresponding to the multimedia stream.
The method of claim 3, wherein before the server obtains the pre-played multimedia stream, the method further comprises:

The server sets a virtual interaction interface, and presents the virtual interaction interface on the N clients;

Determining pre-played by the virtual interaction interface by any one of the N clients The identifier of the multimedia stream;

The server acquires the identifier, and determines a pre-played multimedia stream corresponding to the identifier.
The method of claim 4 wherein the method further comprises:

The N clients corresponding to the preset multicast group display the data information received by themselves on their own virtual interactive interface.
A server, the server comprising:

a first acquiring unit, configured to acquire a pre-played multimedia stream;

a second acquiring unit, configured to acquire, according to the multimedia stream, data information corresponding to the multimedia stream;

The sending unit is configured to send the data information corresponding to the multimedia stream by using a multicast manner.
The server of claim 6, wherein the server further comprises:

The setting unit is configured to set a virtual interaction interface; the virtual interaction interface can be displayed on each client corresponding to the preset multicast group;

a third acquiring unit, configured to acquire, by using the virtual interaction interface, an identifier corresponding to the multimedia stream;

Correspondingly, the first acquiring unit is further configured to determine a pre-played multimedia stream according to the identifier.
A system for playing multimedia, the system comprising: a server and N clients; wherein

And the server is configured to obtain the pre-played multimedia stream, and obtain the data information corresponding to the multimedia stream, and send the data information corresponding to the multimedia stream to the N clients corresponding to the preset multicast group by using a multicast mode. ;

The client is configured to receive the data information corresponding to the multimedia stream, decode the data information, and present the decoded data information corresponding to the multimedia stream.
The system of claim 8 wherein said server is further configured to set a virtual Defining an interaction interface, and presenting the virtual interaction interface on the N clients;

a client, configured to determine, by using the virtual interaction interface, an identifier of the pre-played multimedia stream; correspondingly,

The server is further configured to acquire the identifier, and determine a pre-played multimedia stream corresponding to the identifier.
The system of claim 8, wherein the client is further configured to display the data information received by itself on its own virtual interactive interface.
A first type of computer storage medium having stored therein a computer program for performing the method of playing multimedia according to claim 1 or 2.
A second type of computer storage medium having stored therein a computer program for performing the method of playing multimedia according to any of the preceding claims 3 to 5.