CN117749856A

CN117749856A - Multimedia information playing method, device and storage medium

Info

Publication number: CN117749856A
Application number: CN202211123954.2A
Authority: CN
Inventors: 郑吉剑
Original assignee: Tencent Technology Beijing Co Ltd
Current assignee: Tencent Technology Beijing Co Ltd
Priority date: 2022-09-15
Filing date: 2022-09-15
Publication date: 2024-03-22

Abstract

The application discloses a multimedia information playing method, a device and a storage medium, wherein the method comprises the following steps: the target server receives a multimedia information playing request sent by a first terminal; acquiring a target protocol instruction corresponding to a first terminal identifier based on a preset protocol instruction library; the preset protocol instruction library is used for storing protocol instructions corresponding to preset terminal identifiers; the protocol instruction corresponding to the preset terminal identifier is constructed based on the successful handshake result of the preset terminal and the local server; the successful handshake result is that the local server responds to a first multimedia information playing request sent by a preset terminal and performs handshake with the preset terminal to obtain the handshake result; acquiring resources to be played corresponding to the identification to be played based on the target protocol instruction; and sending the resources to be played to the first terminal so that the first terminal plays the multimedia information based on the resources to be played. According to the method and the device, the time consumption for playing the first frame image in the multimedia information to be played is reduced, and the playing efficiency of the multimedia information is improved.

Description

Multimedia information playing method, device and storage medium

Technical Field

The present disclosure relates to the field of internet communications technologies, and in particular, to a method and apparatus for playing multimedia information, and a storage medium.

Background

In the process of playing the multimedia information, the terminal needs to acquire playing resources from the server, and before the terminal and the server perform data transmission, connection needs to be established; in the related art, when a terminal does not play multimedia information for the first time, the terminal and a server need to reestablish TCP connection, and the TCP connection needs three handshakes; then, based on TCP connection, the terminal and the server further carry out three-way handshake based on RTMP protocol to establish connection; then, data transmission can be performed; the TCP connection and the RTMP connection both involve three handshakes, which takes a long time and results in lower playing efficiency of the multimedia information.

Disclosure of Invention

The application provides a multimedia information playing method, a device and a storage medium, which can reduce the playing time consumption of a first frame image in multimedia information to be played and improve the playing efficiency of the multimedia information.

In one aspect, the present application provides a method for playing multimedia information, where the method includes:

receiving a multimedia information playing request sent by a first terminal; the multimedia information playing request carries a to-be-played identifier of the to-be-played multimedia information and a first terminal identifier; the distance between the first terminal and the local server is smaller than a preset distance threshold;

Acquiring a target protocol instruction corresponding to the first terminal identifier based on a preset protocol instruction library; the preset protocol instruction library is used for storing protocol instructions corresponding to preset terminal identifiers; the protocol instruction corresponding to the preset terminal identifier is constructed based on the successful handshake result of the preset terminal and the local server; the successful handshake result is obtained by the local server performing handshake with the preset terminal in response to a first multimedia information playing request sent by the preset terminal;

acquiring resources to be played corresponding to the identification to be played based on the target protocol instruction;

and sending the resources to be played to the first terminal so that the first terminal plays the multimedia information based on the resources to be played.

Another aspect provides a method for playing multimedia information, the method comprising:

sending a multimedia information playing request to a target server; the multimedia information playing request carries a to-be-played identifier of the to-be-played multimedia information and a first terminal identifier; the distance between the target server and the first terminal is smaller than a preset distance threshold;

receiving a resource to be played, which is sent by the target server, wherein the resource to be played is a resource corresponding to the identifier to be played, which is acquired by the target server based on a target protocol instruction; the target protocol instruction is an instruction which is obtained by the target server and corresponds to the first terminal identifier based on a preset protocol instruction library; the preset protocol instruction library is used for storing protocol instructions corresponding to preset terminal identifiers; the protocol instruction corresponding to the preset terminal identifier is constructed based on a handshake success result of the preset terminal and the target server; the successful handshake result is obtained by the target server performing handshake with the preset terminal in response to a first multimedia information playing request sent by the preset terminal;

And playing the multimedia information based on the resources to be played.

Another aspect provides a multimedia information playing device, applied to a server, the device comprising:

the playing request receiving module is used for receiving a multimedia information playing request sent by the first terminal; the multimedia information playing request carries a to-be-played identifier of the to-be-played multimedia information and a first terminal identifier; the distance between the first terminal and the local server is smaller than a preset distance threshold;

the target protocol instruction acquisition module is used for acquiring a target protocol instruction corresponding to the first terminal identifier based on a preset protocol instruction library; the preset protocol instruction library is used for storing protocol instructions corresponding to preset terminal identifiers; the protocol instruction corresponding to the preset terminal identifier is constructed based on the successful handshake result of the preset terminal and the local server; the successful handshake result is obtained by the local server performing handshake with the preset terminal in response to a first multimedia information playing request sent by the preset terminal;

the resource to be played obtaining module is used for obtaining the resource to be played corresponding to the identifier to be played based on the target protocol instruction;

And the resource to be played sending module is used for sending the resource to be played to the first terminal so that the first terminal plays the multimedia information based on the resource to be played.

In some embodiments, the apparatus further comprises: the instruction library construction module comprises:

the first request receiving unit is used for receiving a first multimedia information playing request sent by a preset terminal, wherein the first multimedia information playing request carries a preset terminal identifier of the preset terminal and a handshake data packet;

a handshake result determining unit, configured to determine a handshake result between the local server and the preset terminal based on the handshake packet;

a protocol instruction generating unit, configured to generate a protocol instruction corresponding to the preset terminal identifier when the handshake result is the handshake success result;

the instruction library construction unit is used for constructing the preset protocol instruction library according to the corresponding relation between the preset terminal identification and the protocol instruction.

In some embodiments, the handshake result determining unit includes:

an initial handshake result determining subunit, configured to determine an initial handshake result of the local server and the preset terminal based on the handshake packet;

A target handshake result determining subunit, configured to determine a target handshake result between the local server and the preset terminal when the initial handshake result is an initial handshake success result;

and the handshake result determining subunit is used for determining the target handshake result as the handshake result of the local server and the preset terminal.

In some embodiments, the play request receiving module includes:

a multimedia information switching request receiving unit, configured to receive a multimedia information switching request sent by the first terminal, where the multimedia information switching request carries a pause playing message of current multimedia information; the multimedia information switching request is a message generated by the first terminal in response to a multimedia information switching instruction in the playing process of the current multimedia information;

a notification sending unit, configured to send a message receiving notification to the first terminal and stop sending a current resource to be played to the first terminal based on the pause playing message; and the current resource to be played is the resource corresponding to the current multimedia information.

In some embodiments, the apparatus further comprises:

The resource to be played receiving module is used for receiving the resource to be played sent by the preset server; the resource to be played is a play resource generated by a second terminal, the distance between the preset server and the first terminal is larger than or equal to the preset distance threshold, and the distance between the preset server and the second terminal is smaller than the preset distance threshold.

Another aspect provides a multimedia information playing device, applied to a terminal, the device comprising:

the playing request sending module is used for sending a multimedia information playing request to the target server; the multimedia information playing request carries a to-be-played identifier of the to-be-played multimedia information and a first terminal identifier; the distance between the target server and the first terminal is smaller than a preset distance threshold;

the resource to be played receiving module is used for receiving the resource to be played sent by the target server, wherein the resource to be played is a resource corresponding to the identifier to be played, which is acquired by the target server based on a target protocol instruction; the target protocol instruction is an instruction which is obtained by the target server and corresponds to the first terminal identifier based on a preset protocol instruction library; the preset protocol instruction library is used for storing protocol instructions corresponding to preset terminal identifiers; the protocol instruction corresponding to the preset terminal identifier is constructed based on a handshake success result of the preset terminal and the target server; the successful handshake result is obtained by the target server performing handshake with the preset terminal in response to a first multimedia information playing request sent by the preset terminal;

And the information playing module is used for playing the multimedia information based on the resources to be played.

In some embodiments, the play request sending module includes:

a multimedia information switching request sending unit, configured to send a multimedia information switching request to the target server in response to a multimedia information switching instruction in a current playing process of the current multimedia information, where the multimedia information switching request carries a pause playing message of the current multimedia information;

and the notification receiving unit is used for receiving the message receiving notification sent by the target server based on the pause playing message.

In some embodiments, the apparatus further comprises:

the current resource deleting module is used for deleting the current resource corresponding to the current multimedia information in the player;

and the resource storage module is used for storing the resources to be played in the player.

In some embodiments, the player includes a protocol parser and a format parser, and the resource storage module includes:

a target network protocol determining unit, configured to determine a target network protocol corresponding to the resource to be played based on the protocol parser;

The preset database construction unit is used for downloading the resources to be played based on the target network protocol to obtain first analysis data, and constructing a preset database based on the first analysis data;

the data volume monitoring unit is used for monitoring the data volume in the preset database in the construction process of the preset database;

the second analysis data determining unit is used for analyzing the data in the preset database based on the format analyzer to obtain second analysis data under the condition that the data amount in the preset database is larger than a first preset value;

a decoding resource determining unit configured to determine decoding resources based on the second analysis data;

a decoding resource storage unit configured to store the decoding resource in the player;

correspondingly, the information playing module comprises:

and the information playing unit is used for playing the multimedia information based on the decoding resources.

In some embodiments, the player further comprises a decoder, and the decoding resource determining unit comprises:

a second analysis data storage subunit, configured to store the second analysis data in a cache database;

and the decoding resource determining subunit is used for decoding the data in the cache database based on the decoder to obtain the decoding resource under the condition that the data amount in the cache database is larger than a second preset value.

In another aspect, a multimedia information playing system is provided, the system comprising a target server and a first terminal,

the first terminal is used for sending a multimedia information playing request to the target server; the multimedia information playing request carries a to-be-played identifier of the to-be-played multimedia information and a first terminal identifier; the distance between the target server and the first terminal is smaller than a preset distance threshold; playing the multimedia information based on the resources to be played;

the target server is used for acquiring a target protocol instruction corresponding to the first terminal identifier based on a preset protocol instruction library; the preset protocol instruction library is used for storing protocol instructions corresponding to preset terminal identifiers; the protocol instruction corresponding to the preset terminal identifier is constructed based on the successful handshake result of the preset terminal and the local server; the successful handshake result is obtained by the local server performing handshake with the preset terminal in response to a first multimedia information playing request sent by the preset terminal; based on the target protocol instruction, obtaining resources to be played corresponding to the identification to be played; and sending the resources to be played to the first terminal.

In another aspect, a multimedia information playing server is provided, where the server includes a processor and a memory, where at least one instruction or at least one program is stored in the memory, and the at least one instruction or at least one program is loaded and executed by the processor to implement the multimedia information playing method as described above.

Another aspect provides a multimedia information playing terminal, the terminal comprising a processor and a memory, wherein at least one instruction or at least one section of program is stored in the memory, and the at least one instruction or at least one section of program is loaded and executed by the processor to implement the multimedia information playing method as described above.

Another aspect provides a computer readable storage medium storing at least one instruction or at least one program loaded and executed by a processor to implement the multimedia information playing method as described above.

Another aspect provides a computer storage medium storing at least one instruction or at least one program loaded and executed by a processor to implement the multimedia information playing method as described above.

The multimedia information playing method, the device and the storage medium have the following technical effects:

the method comprises the steps that a target server receives a multimedia information playing request sent by a first terminal; the multimedia information playing request carries a to-be-played identifier of the to-be-played multimedia information and a first terminal identifier; the distance between the first terminal and the local server is smaller than a preset distance threshold; acquiring a target protocol instruction corresponding to the first terminal identifier based on a preset protocol instruction library; the preset protocol instruction library is used for storing protocol instructions corresponding to preset terminal identifiers; the protocol instruction corresponding to the preset terminal identifier is constructed based on the successful handshake result of the preset terminal and the local server; the successful handshake result is obtained by the local server performing handshake with the preset terminal in response to a first multimedia information playing request sent by the preset terminal; acquiring resources to be played corresponding to the identification to be played based on the target protocol instruction; and sending the resources to be played to the first terminal so that the first terminal plays the multimedia information based on the resources to be played. After receiving a multimedia information playing request sent by a first terminal, the target server searches a target protocol instruction between the target server and the first terminal in a preset protocol instruction library, and multiplexes the instruction to realize quick interaction between the target server and the first terminal, so that the target server and the first terminal are prevented from handshake again to establish a connection relationship, handshake interaction time consumption of the target server and the first terminal is reduced, the first terminal can quickly acquire resources to be played and play the resources, and playing time consumption of a first frame of image in the multimedia information to be played is reduced, and playing efficiency of the multimedia information is improved.

Drawings

In order to more clearly illustrate the technical solutions and advantages of embodiments of the present application or of the prior art, the following description will briefly introduce the drawings that are required to be used in the embodiments or the prior art descriptions, it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a schematic diagram of a system provided in an embodiment of the present application;

fig. 2 is a flow chart of a method for playing multimedia information according to an embodiment of the present application;

fig. 3 is a flowchart of a method for a first terminal to send a multimedia information playing request to a target server according to an embodiment of the present application;

fig. 4 is a flow chart of a method for constructing a preset protocol instruction library according to an embodiment of the present application;

fig. 5 is a flowchart of another method for playing multimedia information according to an embodiment of the present application;

fig. 6 is a flowchart of another method for playing multimedia information according to an embodiment of the present application;

fig. 7 is a flow chart of a method for switching multimedia information in a live broadcast process according to an embodiment of the present application;

Fig. 8 is a flowchart of a method for storing resources to be played by a player according to an embodiment of the present application;

fig. 9 is a flowchart of another method for storing resources to be played in the player according to the embodiment of the present application;

fig. 10 is a flowchart of a method for determining decoding resources by a first terminal according to an embodiment of the present application based on second parsing data;

FIG. 11 is a flowchart of a data parsing method according to an embodiment of the present disclosure;

FIG. 12 is a flowchart of another data parsing method according to an embodiment of the present application;

fig. 13 is a flowchart of another method for playing multimedia information according to an embodiment of the present application;

fig. 14 is a flowchart of another method for playing multimedia information according to an embodiment of the present application;

fig. 15 is a schematic structural diagram of a multimedia information playing device according to an embodiment of the present application;

fig. 16 is a schematic structural diagram of another multimedia information playing device according to an embodiment of the present application.

Detailed Description

The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present application based on the embodiments herein.

It should be noted that the terms "first," "second," and the like in the description and claims of the present application and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that embodiments of the present application described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or server that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed or inherent to such process, method, article, or apparatus, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

Referring to fig. 1, fig. 1 is a schematic diagram of a multimedia information playing system provided in an embodiment of the present application, and as shown in fig. 1, the system may at least include a server 01 and a terminal 02.

Specifically, the server 01 may include a server that operates independently, or a distributed server, or a server cluster that is formed by a plurality of servers, and may also be a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDNs (Content Delivery Network, content distribution networks), and basic cloud computing services such as big data and artificial intelligence platforms. The server 01 may include a network communication unit, a processor, a memory, and the like. The server 01 may provide a background service to the terminal 02. The server is used for acquiring a target protocol instruction corresponding to the terminal identifier based on a preset protocol instruction library; the preset protocol instruction library is used for storing protocol instructions corresponding to preset terminal identifiers; the protocol instruction corresponding to the preset terminal identifier is constructed based on the successful handshake result of the preset terminal and the server; the successful handshake result is obtained by the server responding to a first multimedia information playing request sent by the preset terminal and performing handshake with the preset terminal; and acquiring resources to be played corresponding to the identification to be played based on the target protocol instruction.

Specifically, the terminal 02 may include a smart phone, a tablet computer, a notebook computer, a digital assistant, a smart wearable device, an in-vehicle terminal, or other type of physical device, or may include software running in the physical device, for example, the terminal 02 may include an application program for playing multimedia information. The terminal 02 may send a multimedia information playing request to the server 01; and playing the multimedia information to be played based on the resource to be played.

In the following description, fig. 2 is a schematic flow chart of a multimedia information playing method according to an embodiment of the present application, where the method operation steps described in the embodiment or the flowchart are provided, but more or fewer operation steps may be included based on conventional or non-creative labor. The order of steps recited in the embodiments is merely one way of performing the order of steps and does not represent a unique order of execution. When implemented in a real system or server product, the methods illustrated in the embodiments or figures may be performed sequentially or in parallel (e.g., in a parallel processor or multithreaded environment). As shown in fig. 2, the method may include:

S201: the first terminal sends a multimedia information playing request to a target server; the multimedia information playing request carries a to-be-played identifier of the to-be-played multimedia information and a first terminal identifier; the distance between the target server and the first terminal is smaller than a preset distance threshold;

in the embodiment of the present specification, the first terminal may send a multimedia information playing request to the target server in response to the multimedia information playing instruction; the multimedia information playing instruction can be an instruction triggered in the target application, and when the first terminal opens the target application for the first time, the multimedia information playing instruction can be a multimedia information switching instruction triggered in the current multimedia information playing process; when the first terminal does not open the target application for the first time, the first terminal is indicated to have interacted with the target server; at this time, the multimedia information playing instruction may be a playing instruction triggered based on any multimedia information in the target application display page; at this time, the multimedia information playing instruction may be a first playing instruction in the target application, or may be a non-first playing instruction.

The method of the embodiment can be applied to live broadcast or on-demand scenes, and when the method is applied to the live broadcast scenes, the multimedia information to be played is live broadcast information, and the live broadcast information can include but is not limited to live broadcast video, live broadcast audio and the like; the first terminal may be a viewer terminal, the first terminal identifier may be a device identifier of the first terminal, and the first terminal identifier may include, but is not limited to, a character string identifier and an image identifier, where the first terminal identifier is used to uniquely identify the first terminal. The to-be-played identifier is used for identifying to-be-played multimedia information, and different to-be-played multimedia information corresponds to different to-be-played identifiers, and the to-be-played identifiers can include, but are not limited to, titles, file names, images and the like of the to-be-played multimedia information.

In this embodiment of the present disclosure, the target server is a background server of the first terminal, and the distance between the target server and the first terminal is smaller than a preset distance threshold, where the preset distance threshold may be set according to an actual situation. The target server and the first terminal may be located within a preset geographical range. One target server can correspond to a plurality of first terminals, and in the process of acquiring the multimedia information, the first terminals can acquire various needed multimedia information through the target server, so that the first terminals are prevented from acquiring different multimedia information from different servers, and multiplexing of handshake protocols can be ensured.

In this embodiment of the present disclosure, as shown in fig. 3, the first terminal sending a multimedia information playing request to the target server includes:

s20101: in the playing process of the current multimedia information, a first terminal responds to a multimedia information switching instruction and sends a multimedia information switching request to a target server, wherein the multimedia information switching request carries a pause playing message of the current multimedia information;

in this embodiment of the present disclosure, the multimedia information switching instruction may include a sliding, clicking, double clicking, dragging instruction triggered by the user based on an initial interface of the multimedia information to be played, and may also include a voice instruction; in the live broadcast scene, the initial interface of the multimedia information to be played can be a preset interface of the live broadcast room of the multimedia information to be played, and a user can enter the corresponding live broadcast room to watch live broadcast by clicking the interface. The multimedia information switching request is used for indicating to switch from a playing interface of the current multimedia information to a playing interface of the multimedia information to be played. The current multimedia information can be the multimedia information currently being played in the first terminal, and in the playing process, an account of the first terminal can trigger a multimedia information switching instruction, a pause playing message aiming at the current multimedia information can be generated at the moment, and a multimedia information switching request is constructed based on the pause playing message, a to-be-played identifier of the to-be-played multimedia information and the first terminal identifier; and then sending a multimedia information switching request to the target server through the first terminal. The current multimedia information and the multimedia information to be played can be information in different application programs, and the current multimedia information and the multimedia information to be played can also be information in target application.

In the embodiment of the present disclosure, in a live broadcast or on demand scenario, before a first terminal performs data interaction with a target server, the first terminal and the target server need to handshake to establish a connection; the multimedia information to be played of the same terminal corresponds to the same server with the current multimedia information, and the target server is used for obtaining playing resources corresponding to the multimedia information to be played and the current multimedia information respectively.

S20103: the target server sends a message receiving notification to the first terminal based on the pause playing message and stops sending the current resources to be played to the first terminal; the current resource to be played is the resource corresponding to the current multimedia information.

In the embodiment of the present disclosure, in a multimedia information playing scene, a playing resource needs to be received first and then played, where a current resource to be played is an unplayed resource corresponding to current multimedia information; the target server can stop sending the current resources to be played to the first terminal based on the pause playing message, so that flow waste caused in the resource transmission process is avoided, meanwhile, the terminal is prevented from storing redundant playing resources, and the storage pressure of the terminal is reduced. After the target server receives the pause playing message, a message receiving notification can be fed back to the first terminal, so that the first terminal can timely acquire the message receiving condition of the server.

S203: the target server obtains a target protocol instruction corresponding to the first terminal identifier based on a preset protocol instruction library; the preset protocol instruction library is used for storing protocol instructions corresponding to preset terminal identifiers; the protocol instruction corresponding to the preset terminal identifier is constructed based on the successful handshake result of the preset terminal and the target server; the successful handshake result is obtained by the target server performing handshake with the preset terminal in response to a first multimedia information playing request sent by the preset terminal;

in the embodiment of the present disclosure, the target server is a background server of the preset terminal, and may be used to provide background service and resources to be played for the preset terminal; the distance between the preset terminal and the target server is smaller than a preset distance threshold, namely the target server and the preset terminal are both in a preset geographic range; the preset terminals are multiple and can include a first terminal, and in a live broadcast scene, the preset terminals can be a main broadcasting terminal or a spectator terminal. The preset terminal identifier is an equipment identifier of the preset terminal; the target server can respond to the first multimedia information playing request sent by the preset terminal, handshake with the preset terminal and obtain a handshake success result; then constructing a protocol instruction based on a handshake success result; after each preset terminal performs first information interaction with the target server, a corresponding protocol instruction is constructed; storing the corresponding relation between the preset terminal identification and the protocol instruction in a preset protocol instruction library; in the subsequent secondary information interaction or multiple information interaction process, the data transmission can be carried out by directly multiplexing the protocol instruction, so that the information interaction efficiency is improved.

In the embodiment of the present disclosure, the first terminal plays the current multimedia information, which indicates that the first terminal has established a connection with the target server, and when the first terminal needs to switch the multimedia information, the first terminal may acquire and multiplex the target protocol instruction, and does not repeat handshake with the target server and establish a connection, thereby reducing interaction time consumption between the first terminal and the target server.

In this embodiment of the present disclosure, as shown in fig. 4, the method for constructing the preset protocol instruction library includes:

s401: the method comprises the steps that a preset terminal sends a first multimedia information playing request to a target server, wherein the first multimedia information playing request carries a preset terminal identifier of the preset terminal and a handshake data packet;

in the embodiment of the present disclosure, when the preset terminal sends a first multimedia information playing request to the target server, that is, when the preset terminal interacts with the target server for the first time, the preset terminal identifier and the handshake data packet of the preset terminal need to be carried by the first multimedia information playing request, and the target server may handshake with the first terminal through the handshake data packet.

S403: the target server determines a handshake result between the target server and a preset terminal based on the handshake data packet;

In this embodiment of the present disclosure, the target server may determine, based on the handshake data packet, a handshake result between the target server and a preset terminal, where the handshake result may include a handshake success result and a handshake failure result; if the handshake between the target server and the first terminal fails, the target server and the first terminal cannot perform subsequent information interaction.

In the embodiment of the present disclosure, the determining, by the target server, a handshake result between the target server and the preset terminal based on the handshake packet includes:

the target server determines an initial handshake result between the target server and a preset terminal based on the handshake data packet;

in the embodiment of the present disclosure, the handshake packet may be a packet of a preset transmission protocol, which may include, but is not limited to, a transmission control protocol (Transmission Control Protocol, TCP), a user datagram protocol (UDP, user Datagram Protocol), and the transmission control protocol is a connection-oriented, reliable, byte stream based transport layer communication protocol. The user datagram protocol provides a method for an application to send encapsulated IP packets without establishing a connection. The target server and the preset terminal can establish preset transmission protocol connection through three-way handshake to obtain an initial handshake result.

In the embodiment of the present specification, when the preset transmission protocol is TCP, in order to establish a connection TCP connection, the two parties of communication must know the following information from each other:

1. a starting sequence number of the message transmission of the opposite party.

2. Buffer size of data transmitted by the other party.

3. The maximum segment length that can be received (Maximum Segment Size, MSS).

4. Supported TCP options.

In the TCP protocol, the two communication parties realize knowledge of the above information through Three TCP messages, and establish a TCP connection on the basis of the knowledge, and the Three-Way Handshake (Three-Way Handshake) process realized by the Three TCP message segments of the two communication parties is also known as the Three-Way Handshake process.

After connection establishment is completed, then:

1. both parties of communication of TCP connection can know sequence number of first byte to be sent by opposite party on connection;

2. both parties can know the length of the maximum message segment that can be sent on the connection;

3. both parties can know the size of the receiving buffer zone of the other party;

4. both parties can know whether the opposite party can use SACK, window scaling and other options. SACK (Selective ACK) is a TCP option that allows the receiver to tell the sender which segments are lost, which messages Duan Chong are transmitted, which segments have been received in advance, etc.

Based on the above information, the target server and the first terminal can establish a TCP connection.

In some embodiments, in the case that the initial handshake result is an initial handshake failure result, the target server fails to establish a connection with the first terminal, and the target server and the first terminal cannot continue to perform information interaction.

Under the condition that the initial handshake result is an initial handshake success result, the target server determines a target handshake result of the target server and a preset terminal;

in this embodiment of the present disclosure, after the initial handshake between the target server and the first terminal is successful, the target server and the first terminal need to perform a third handshake again to establish a real-time message transmission protocol connection, so as to obtain a target handshake result. The real-time messaging protocol (Real Time Messaging Protocol, RTMP) is an application layer protocol for solving the problems of Multiplexing (Multiplexing) and packetization (packetization) of multimedia data transport streams. The RTMP protocol is an application layer protocol, and is to guarantee the reliability of information transmission by means of a reliable transport layer protocol (usually TCP). After the link establishment based on the transport layer protocol is completed, the RTMP protocol also establishes the RTMP link over the transport layer link by the terminal and the server through a "handshake". RTMP is composed of message blocks, and terminal and server correspond to the same number of message blocks.

In some embodiments, in a case that the initial handshake result is an initial handshake success result, the determining, by the target server, a target handshake result between the target server and the preset terminal includes:

under the condition that the initial handshake result is an initial handshake success result, the target server sends an initial handshake success notification to a preset terminal;

the preset terminal acquires a first message block, a second message block and a third message block corresponding to the real-time message transmission protocol based on the initial handshake success notification; the first message block carries an RTMP version number required by a preset terminal, the second message block carries first timestamp information of a block flow, and the third message block carries second timestamp information of a historical message block;

in this embodiment of the present disclosure, the RTMP is formed by three blocks of static size, and the terminal and the server may establish a secondary connection through a three-way handshake, where the terminal obtains a first message block, a second message block, and a third message block corresponding to the real-time message transmission protocol. The first message block carries an RTMP version number required by a preset terminal, the second message block carries first timestamp information of a block flow, and the third message block carries second timestamp information of a historical message block.

The preset terminal sends a first message block to a target server; the first message block carries a first version number;

the first version number is an RTMP version number required by a preset terminal;

the target server sends a fourth message block to a preset terminal based on the first message block; the fourth message block carries a second version number;

the second version number is an RTMP version number selected by the target server;

the preset terminal sends a second message block to the target server; the second message block carries first timestamp information of the block stream;

wherein, in order to synchronize the multiple message block streams, the preset terminal expects the first timestamp information to be the block stream time of other message blocks.

The target server sends a fifth message block to the second terminal based on the second message block; the fifth message block carries the first timestamp information;

the target server may acknowledge the information in the second message block and return a fifth message block, where the fifth message block is identical to the data in the second message block.

The second terminal sends a third message block to the target server, wherein the third message block carries second timestamp information of the historical message block;

the third message block carries second timestamp information of a history message block, and the history message block comprises a first message block, a second message block, a fourth message block and a fifth message block in the interaction process;

The target server determines a target handshake result between the target server and a preset terminal based on the third message block, and sends a sixth message block to the preset terminal; the sixth message block carries a handshake success message;

and the target server determines the target handshake result as the handshake result of the target server and a preset terminal.

In the embodiment of the present specification, the target server determines a target handshake result obtained based on a real-time message transmission protocol as a handshake result between the target server and a preset terminal; after the first terminal establishes a preset transmission protocol connection with the target server, a secondary connection is established based on a real-time message transmission protocol, so that the safety of information interaction between the first terminal and the target server is improved.

In some embodiments, the above method further comprises:

and under the condition that a target protocol instruction corresponding to the first terminal identifier cannot be acquired in a preset protocol instruction library, the target server sends a handshake request to the first terminal.

In the embodiment of the specification, if the target server interacts with the first terminal for the first time or the interaction time of the target server and the first terminal exceeds a preset time threshold, no target protocol instruction matched with the first terminal identifier exists in a preset protocol instruction library, at this time, the target server needs to send a handshake request to the first terminal, generates a target protocol instruction after the handshake between the target server and the first terminal is successful, and stores the target protocol instruction in the preset protocol instruction library, so that the next multiplexing is facilitated. After the handshake between the target server and the first terminal is successful, the subsequent information interaction can be performed.

In some embodiments, as shown in fig. 5, fig. 5 is a flow chart of another multimedia information playing method, where a terminal includes a decoder and other modules, and the method includes:

s501: the terminal and the server establish TCP connection through three-way handshake;

s502: the terminal establishes connection with the server based on RTMP protocol handshake; the RTMP protocol is an application layer protocol built on the TCP protocol; after TCP is established, 3 times of message exchange are needed to complete handshake, RTMP is composed of three blocks with static size instead of blocks with variable size, the terminal and the server send the same three message blocks, the terminal sends C0, C1 and C2, and the server sends S0, S1 and S2.

1. The terminal sends C0, C1 blocks and handshakes begin.

2. The terminal has to wait for receiving S1 before sending C2.

3. The terminal has to wait to receive S2 before sending any data.

4. The server must wait to receive C0 before sending S0 and S1, or may wait to receive C1.

5. The server must wait to receive C1 before sending S2.

6. The server must wait to receive C2 before sending any data.

S503: the terminal establishes instance connection with the server;

s5031: the terminal sends a "connect" in a command message to the server requesting to establish a connection with a service application instance.

S5032: after receiving the connect command message, the server sends a first protocol message confirming the window size (Window Acknowledgement Size) to the terminal while connecting to the application instance in the connect command. The window size is used for describing data of the size of a TCP datagram buffer of a receiving party; the first protocol message carries a first window size corresponding to the server;

s5033: the server sends a set bandwidth protocol (Set Peer Bandwidth) message to the terminal.

S5034: after the terminal processes the set bandwidth protocol message, it sends a second protocol message confirming the window size (Window Acknowledgement Size) to the server side.

The second protocol message sent by the terminal comprises a second window size corresponding to the terminal, and the server compares the sizes of the first window size and the second window size and takes the smaller window as a target window for data stream transmission.

S5035: the server transmits a Stream Begin message in the user control message to the terminal.

S5036: the server sends a "result" in the command message to make the terminal aware of the connection state.

S504: acquiring a data stream;

s5041: the terminal sends a streaming (createstream) command of the application instance to the server;

S5042: the server establishes a first data stream based on the stream establishing command and sends a stream establishing success result to the terminal;

s505: acquiring first multimedia information;

s5051: the terminal sends a play command of the multimedia information to the server;

s5052: after receiving the play command, the server sends a block size (SetChunkSize) setting message;

s5053: the server sends another user control message specifying the event "start of stream". Indicating the start of the flow to the terminal;

s5054: if the server successfully receives a play command sent by the terminal, the server sends a play command message (onStatus) to the terminal, the play command message carrying a first data stream, the first data stream including first audio data and first image data.

S5055: the terminal receives the first audio data sent by the server.

S5056: the terminal receives the first image data sent by the server.

S506: playing the first multimedia information;

s5061: other modules of the terminal send first audio data to a decoder, and the decoder decodes and plays the first audio data;

s5062: other modules of the terminal send the first image data to a decoder, and the decoder decodes and synchronously plays the first image data;

S507: a stop instruction;

s5071: the terminal responds to a switching instruction based on the multimedia information and sends a play suspension message to the server; the multimedia information switching instruction is used for indicating to switch from the first multimedia information to the second multimedia information; the multimedia information switching instruction comprises a stream identifier of the second multimedia information;

s5072: the server receives the notice and stops sending the first playing resource corresponding to the first multimedia information to the terminal based on the message sent to the terminal;

s508: acquiring second multimedia information;

s5081: the terminal sends a stream identifier of the second multimedia information to the server;

s5082: the server sends a second data stream of the second multimedia information to the terminal based on the stream identification of the second multimedia information, wherein the second data stream comprises second audio data and second image data;

s509: playing the second multimedia information;

s5091: the other modules of the terminal send second data streams to the decoder, and the terminal cleans up the first data streams in the player and stores the second data streams;

s5092: the terminal cleans the data path, closes the data path corresponding to the first multimedia information, opens the data path corresponding to the second multimedia information, restarts the data receiving of the second multimedia information, decodes and plays the second data stream through the decoder;

S5010: a flow off instruction;

s50101: the terminal responds to a closing instruction of the second multimedia information and sends a stream closing instruction to the server;

s50102: and the server stops sending the second data stream corresponding to the second multimedia information to the terminal based on the stream closing instruction, and sends a stream closing processing result to the terminal.

In some embodiments, as shown in fig. 6, fig. 6 is a flow chart of another method for playing multimedia information, where the method includes:

s601: the terminal establishes TCP connection with the server;

s603: the terminal and the server carry out three-way handshake of RTMP;

s605: the terminal and the server determine to establish a connection relationship;

s607: the server sends a stream start instruction to the terminal, and the stream start instruction and the terminal start data transmission;

s609: the terminal sends a first website identifier of the first multimedia information to the server, and the server obtains a corresponding first data stream based on the first website identifier and sends the first data stream to the terminal; the terminal receives and plays the first data stream;

s6011: the terminal sends a first data stream stopping instruction to the server based on the multimedia information switching instruction;

s6013: the terminal sends a second website identifier of the second multimedia information to the server; the server acquires a corresponding second data stream and sends the second data stream to the terminal;

S6015: the terminal cleans the stored data in the player, deletes the first data stream and stores the second data stream;

s6017: the terminal plays the second multimedia information based on the second data stream;

s6019: and the terminal responds to a stream closing instruction triggered based on the second multimedia information, and sends the stream closing instruction to the server, and the server stops sending the second data stream to the terminal.

The steps in the dashed box in fig. 6 are modified steps, and in the related art, steps S601-S609 are repeated each time the multimedia information is switched, and finally, the process goes to step S6019. The TCP connection and the three-way handshake of the RTMP are re-established in each switching process, and the time is long; the improved steps do not need to repeatedly establish the TCP connection and the three-way handshake of the RTMP; the time consumption of switching the multimedia information is reduced.

S405: under the condition that the handshake result is a handshake success result, the target server generates a protocol instruction corresponding to a preset terminal identifier;

in the embodiment of the present disclosure, when the handshake between the target server and the preset terminal is successful, a corresponding protocol instruction is generated for multiplexing in subsequent information interaction, so as to avoid subsequent handshake connection between the target server and the preset terminal.

S407: and the target server constructs a preset protocol instruction library according to the corresponding relation between the preset terminal identification and the protocol instruction.

In this embodiment of the present disclosure, the number of preset terminal identifiers may be multiple, and the target server may determine a mapping relationship between the preset terminal identifier and the protocol instruction according to the protocol instruction corresponding to each of the multiple preset terminal identifiers, and store the mapping relationship between the preset terminal identifier and the protocol instruction in the preset protocol instruction library.

S205: the target server obtains the resources to be played corresponding to the identification to be played based on the target protocol instruction;

in this embodiment of the present disclosure, the target server may directly obtain, according to a target protocol instruction, a resource to be played corresponding to the identifier to be played; the connection relation between the target server and the first terminal is prevented from being established through multiple handshakes, the handshaking time is saved, and the acquisition efficiency of the resources to be played is improved.

In an embodiment of the present disclosure, the method further includes:

the preset server sends resources to be played to the target server; the resource to be played is a play resource generated by the second terminal, the distance between the preset server and the first terminal is greater than or equal to the preset distance threshold, and the distance between the preset server and the second terminal is smaller than the preset distance threshold.

In the embodiment of the present disclosure, the second terminal may be a generating terminal of a resource to be played; the preset server can be a background server of the second terminal and is used for providing background service for the second terminal; the distance between the preset server and the first terminal is larger than or equal to the preset distance threshold, and the distance between the preset server and the second terminal is smaller than the preset distance threshold. In a live broadcast scene, the second terminal is a main broadcasting terminal; the resources to be played generated by the second terminal in the live broadcast process can be distributed to other servers through a preset server, and the other servers comprise target servers; therefore, the first terminal can conveniently acquire the resources to be played from the server closest to the first terminal, multiplexing of the target protocol instruction is realized, and the acquisition efficiency of the resources to be played is improved.

In some embodiments, the on-demand program may come from different servers and content delivery network (Content Delivery Network, CDN) nodes, such as: rtmp://1.1.1.1/vod/1 and Rtmp://1.2.3.4/vod/2; these two programs come from different ip addresses, 1.1.1.1/1.2.3.4, representing different server addresses, at which time the three-way handshake of TCP, RTMP must be re-performed. In live programs, particularly all live programs of a platform, CDN nodes accessed by clients are optimally configured; if a customer is in Beijing, the anchor seen by that customer may be mostly Beijing local, or the server has pulled some anchor's information stream to the Beijing local CDN node in advance, the addresses used by the customer when switching tables are as follows:

Rtmp://1.1.1.1/live/101

Rtmp://1.1.1.1/live/102

Rtmp://1.1.1.1/live/109

It can be seen that the ip address is unchanged, and the three handshakes of TCP and RTMP can be multiplexed.

In some embodiments, as shown in fig. 7, fig. 7 is a flow chart of a method for switching multimedia information in a live broadcast process; the method comprises the following steps:

s701: the anchor A issues a live video A through the server A;

s703: the server A distributes the live video A to the server B;

s705: the server A distributes the live video A to the server C;

s707: the anchor B issues a live video B through the server B;

s709: the audience D acquires resources corresponding to the live video A through the server C and watches the live video A;

s7011: the audience C acquires resources through the server B and watches the live video A; when the viewer C needs to switch to the live video B, the corresponding resources can still be obtained from the server B.

In the embodiment of the present disclosure, the terminal corresponding to the viewer C establishes a connection relationship with the server B through handshake when watching the live video a, and when the viewer C switches to the live video B, the terminal does not need to establish a connection relationship with the server B again, but can directly perform data transmission, so that a handshake step is omitted, interaction time consumption of the first terminal and the target server is reduced, and switching efficiency of multimedia information is improved.

In some embodiments, if the distance between the first terminal and the second terminal is smaller than the preset distance, the first terminal and the second terminal correspond to the same server, that is, the preset server is the target server, and at this time, information interaction between the servers is not needed.

S207: the target server sends the resources to be played to the first terminal;

in some embodiments, the target server may further send a website identifier corresponding to the resource to be played to the first terminal.

In the present description embodiment, the web site identification may include, but is not limited to, a uniform resource location system (uniform resource locator, URL). The resources to be played can be stored in the target server or other devices, and the first terminal can further interact with the target server or other devices based on the website identification, so that the resources to be played are obtained.

In this embodiment of the present disclosure, after the target server sends the resource to be played to the first terminal, as shown in fig. 8, the method further includes:

s801: the first terminal deletes the current resource corresponding to the current multimedia information in the player;

in the embodiment of the present specification, the current resource may include, but is not limited to, data that has been downloaded and not parsed in the original playback link, data that has not been decoded after parsing, data that has been decoded, a decoder, a buffered data block, and so on.

S803: and the first terminal stores the resources to be played in the player.

In the related art, in the process of switching multimedia information, a player corresponding to current multimedia information is usually destroyed, and a player corresponding to the multimedia information to be played is re-established, and a certain time is required to be consumed for reconstructing the player, so that the playing time of the multimedia information is longer; in this embodiment, the first terminal only builds one player, and fast playing of the multimedia information is achieved by cleaning up the current resources in the player and storing the resources to be played.

In this embodiment of the present disclosure, as shown in fig. 9, the player includes a protocol parser and a format parser, and the first terminal stores the resource to be played in the player, including:

s901: the first terminal determines a target network protocol corresponding to the resource to be played based on the protocol analyzer;

in the present description, the target network protocols may include, but are not limited to, hypertext transfer protocol (Hyper Text Transfer Protocol, HTTP), real-time messaging transfer protocol (Real Time Messaging Protocol, RTMP), transmission control protocol (Transmission Control Protocol, TCP), and user datagram protocol (User Datagram Protocol, UDP).

In some embodiments, the first terminal may further obtain an resolution protocol corresponding to the current multimedia information, and use the resolution protocol as the target network protocol.

In the embodiment of the present disclosure, since the multimedia information to be played corresponds to the same resource server with the current multimedia information, and the resolution protocol corresponding to the same resource server is the same, the obtained resolution protocol corresponding to the current multimedia information may be used as the target network protocol corresponding to the multimedia information to be played; and determining the corresponding website resolver, namely the current multimedia information and the multimedia information to be played can correspond to the same website resolver, so that multiplexing of the website resolvers is realized, and the time consumption for playing the first frame of image in the multimedia information to be played is reduced.

S903: the first terminal downloads the resources to be played based on the target network protocol to obtain first analysis data, and builds a preset database based on the first analysis data;

in this embodiment of the present disclosure, the first terminal may download the to-be-played resource according to a target network protocol to obtain first analysis data, and store the first analysis data in a preset database.

S905: in the construction process of the preset database, the first terminal monitors the data quantity in the preset database;

In the embodiment of the present disclosure, during the construction process of the preset database, the first terminal may monitor the data size in the preset database in real time, so as to determine the working time of the format parser.

S907: under the condition that the data quantity in the preset database is larger than a first preset value, the first terminal analyzes the data in the preset database based on the format analyzer to obtain second analysis data;

in the embodiment of the present specification, the format parser may include, but is not limited to, a streaming media Format (FLV), a video coding format (MPEG-4 part 14, mp 4), a Movie (MOV) format, a Transport Stream (TS) format, which is a package format performed under high definition camera shooting, and is collectively referred to as MPEG2-TS. The MOV is a quick time film format, and is an audio and video file package for storing common digital media types. When QuickTime (mov) is selected as the "save type", the animation will be saved as a mov file. The first preset value may be set according to actual situations, for example, may be set to 0 or other values greater than 0; the format analyzer can be adopted to analyze when a certain amount of data exists in the preset database, so that the synchronous work of the website analyzer and the format analyzer is realized, and format analysis is not needed after all the resources to be played are analyzed, thereby improving the data analysis efficiency.

S909: the first terminal determines decoding resources based on the second analysis data;

in an embodiment of the present disclosure, as shown in fig. 10, the player further includes a decoder, and the first terminal determines decoding resources based on the second parsing data, including:

s9091: the first terminal stores the second analysis data in a cache database;

s9093: and under the condition that the data quantity in the cache database is larger than a second preset value, the first terminal decodes the data in the cache database based on the decoder to obtain the decoding resource.

In the present specification embodiment, the decoding resources may include audio data and image data; the second parsed data may be decoded by a decoder, which may include, but is not limited to, H.264, H.265, MOV, TS, etc. formats; h.264, which is also part ten of MPEG-4, is a highly compressed digital Video codec standard proposed by the Joint Video Team (JVT, joint Video Team) consisting of the ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC Moving Picture Experts Group (MPEG) Joint. H.265 is a new video coding standard established by ITU-T VCEG followed by h.264. The h.265 standard surrounds the existing video coding standard h.264, retaining some of the original techniques, while improving some of the related techniques. The new technology uses advanced technology to improve the relation among code stream, coding quality, delay and algorithm complexity, so as to achieve the optimal setting.

In this embodiment of the present disclosure, the player may further include an audio driving module and a screen display module, where the decoder decodes the second parsing data to obtain audio data and image data, and sends the audio data to the audio driving module and the image data to the screen display module.

In the embodiment of the present disclosure, the second preset value may be set according to actual situations, for example, may be set to 0 or other values greater than 0; when a certain amount of data exists in the cache database, the decoder can be adopted for analysis, so that synchronous work of the decoder and the format analyzer is realized, decoding is performed after the format analyzer finishes all analysis of the data, and the data decoding efficiency is improved; the time consumption for playing the first frame of image in the multimedia information to be played is reduced.

In some embodiments, the first terminal comprises a player comprising a web site parser, a format parser, a decoder, and a display module; as shown in fig. 11, fig. 11 is a flowchart of a data parsing method in a player, in which a web site parser and a format parser work in series, the method includes:

S1101: analyzing the website identifier based on the website analyzer to obtain first analysis data;

the protocols corresponding to the website analyzer comprise a hypertext transfer protocol, a real-time message transfer protocol, a transmission control protocol and a user datagram protocol.

S1103: after the website analyzer analyzes, format analysis is carried out on the first analysis data based on the format analyzer, and second analysis data is obtained;

the format corresponding to the format parser comprises a streaming media format, a video coding format, a film format and a transport stream format.

S1105: decoding the second analysis data based on the decoder to obtain resources to be played;

the formats corresponding to the decoder include H264, H265, film format and transport stream format.

S1107: and displaying the resources to be played based on a display module.

S9011: the first terminal stores the decoding resource in the player;

in the embodiment of the present disclosure, data storage is performed synchronously during the decoding process, and when the web site parser, the format parser, and the decoder all complete parsing, the complete decoding resource can be obtained.

In some embodiments, as shown in fig. 12, fig. 12 is a flowchart of another data parsing method in a player, where a web site parser and a format parser work in parallel, the method includes:

S1201: analyzing the website identifier based on the website analyzer to obtain first analysis data;

S1203: in the analysis process of the website analyzer, if the data amount corresponding to the first analysis data is larger than a preset value, carrying out format analysis on the first analysis data based on the format analyzer to obtain second analysis data;

the format corresponding to the format parser comprises a streaming media format, a video coding format, a film format and a transport stream format. When the data volume of the first analysis data obtained by the analysis of the website analyzer is larger than a preset value, carrying out format analysis on the first analysis data based on the format analyzer; without waiting for the website parser to parse to obtain all data and restarting the format parser; therefore, the website parser and the format parser work in parallel, and the data parsing efficiency is improved.

S1205: decoding the second analysis data based on the decoder to obtain resources to be played;

S1207: and displaying the resources to be played based on a display module.

S209: and the first terminal plays the multimedia information based on the resources to be played.

In this embodiment of the present disclosure, the playing, by the first terminal, the multimedia information based on the resource to be played includes:

the first terminal plays the multimedia information based on the decoding resource.

In the embodiment of the present specification, the decoding resource may include audio data and image data, and the first terminal may play the audio data based on the audio driving module and synchronously display the image data based on the screen display module.

Fig. 13 is a schematic flow chart of a method for playing multimedia information provided in the embodiment of the present application, specifically, with reference to fig. 13, the method may include:

s1301: receiving a multimedia information playing request sent by a first terminal; the multimedia information playing request carries a to-be-played identifier of the to-be-played multimedia information and a first terminal identifier; the distance between the first terminal and the local server is smaller than a preset distance threshold;

s1303: acquiring a target protocol instruction corresponding to the first terminal identifier based on a preset protocol instruction library; the preset protocol instruction library is used for storing protocol instructions corresponding to preset terminal identifiers; the protocol instruction corresponding to the preset terminal identifier is constructed based on the successful handshake result of the preset terminal and the local server; the successful handshake result is that the local server responds to a first multimedia information playing request sent by the preset terminal and performs handshake with the preset terminal;

s1305: acquiring resources to be played corresponding to the identification to be played based on the target protocol instruction;

S1307: and sending the resources to be played to the first terminal so that the first terminal plays the multimedia information based on the resources to be played.

In some embodiments, the method for constructing the preset protocol instruction library includes:

receiving a first multimedia information playing request sent by a preset terminal, wherein the first multimedia information playing request carries a preset terminal identifier of the preset terminal and a handshake data packet;

determining a handshake result between the local server and the preset terminal based on the handshake data packet;

generating a protocol instruction corresponding to the preset terminal identifier under the condition that the handshake result is the handshake success result;

and constructing the preset protocol instruction library according to the corresponding relation between the preset terminal identification and the protocol instruction.

In some embodiments, the determining, based on the handshake packet, a handshake result between the local server and the preset terminal includes:

determining an initial handshake result between the local server and the preset terminal based on the handshake data packet;

under the condition that the initial handshake result is an initial handshake success result, determining a target handshake result of the local server and the preset terminal;

And determining the target handshake result as the handshake result of the local server and the preset terminal.

In some embodiments, the receiving the multimedia information playing request sent by the first terminal includes:

receiving a multimedia information switching request sent by the first terminal, wherein the multimedia information switching request carries a pause playing message of current multimedia information; the multimedia information switching request is a message generated by the first terminal in response to a multimedia information switching instruction in the playing process of the current multimedia information;

based on the pause playing message, sending a message receiving notification to the first terminal and stopping sending the current resources to be played to the first terminal; the current resource to be played is the resource corresponding to the current multimedia information.

In some embodiments, the above method further comprises:

receiving the resources to be played sent by a preset server; the resource to be played is a play resource generated by a second terminal, the distance between the preset server and the first terminal is greater than or equal to the preset distance threshold, and the distance between the preset server and the second terminal is smaller than the preset distance threshold.

The embodiment of the present disclosure provides a multimedia information playing server, where the server includes a processor and a memory, where at least one instruction or at least one program is stored in the memory, where the at least one instruction or at least one program is loaded and executed by the processor to implement a multimedia information playing method as described above.

Fig. 14 is a schematic flow chart of a multimedia information playing method provided in the embodiment of the present application, specifically, with reference to fig. 14, the method may include:

s1401: sending a multimedia information playing request to a target server; the multimedia information playing request carries a to-be-played identifier of the to-be-played multimedia information and a first terminal identifier; the distance between the target server and the first terminal is smaller than a preset distance threshold;

s1403: receiving a resource to be played sent by the target server, wherein the resource to be played is a resource corresponding to the identifier to be played, which is acquired by the target server based on a target protocol instruction; the target protocol instruction is an instruction corresponding to the first terminal identifier, which is acquired by the target server based on a preset protocol instruction library; the preset protocol instruction library is used for storing protocol instructions corresponding to preset terminal identifiers; the protocol instruction corresponding to the preset terminal identifier is constructed based on the successful handshake result of the preset terminal and the target server; the successful handshake result is obtained by the target server performing handshake with the preset terminal in response to a first multimedia information playing request sent by the preset terminal;

S1405: and playing the multimedia information based on the resources to be played.

In some embodiments, the sending the multimedia information playing request to the target server includes:

in the playing process of the current multimedia information, responding to a multimedia information switching instruction, and sending a multimedia information switching request to the target server, wherein the multimedia information switching request carries a pause playing message of the current multimedia information;

and receiving a message receiving notification sent by the target server based on the pause play message.

In some embodiments, after receiving the resource to be played sent by the target server, the method further includes:

deleting the current resource corresponding to the current multimedia information in the player;

and storing the resources to be played in the player.

In some embodiments, the player includes a protocol parser and a format parser, and the storing the resources to be played in the player includes:

determining a target network protocol corresponding to the resource to be played based on the protocol analyzer;

downloading the resources to be played based on the target network protocol to obtain first analysis data, and constructing a preset database based on the first analysis data;

Monitoring the data quantity in the preset database in the construction process of the preset database;

under the condition that the data quantity in the preset database is larger than a first preset value, analyzing the data in the preset database based on the format analyzer to obtain second analysis data;

determining decoding resources based on the second analysis data;

storing the decoding resource in the player;

correspondingly, playing the multimedia information based on the resources to be played includes:

and playing the multimedia information based on the decoding resources.

In some embodiments, the player further includes a decoder, and the determining a decoding resource based on the second parsing data includes:

storing the second analysis data in a cache database;

and under the condition that the data quantity in the cache database is larger than a second preset value, decoding the data in the cache database based on the decoder to obtain the decoding resource.

The embodiment of the present disclosure provides a multimedia information playing terminal, where the terminal includes a processor and a memory, where at least one instruction or at least one program is stored in the memory, where the at least one instruction or at least one program is loaded and executed by the processor to implement a multimedia information playing method as described above.

In the embodiment of the present disclosure, the above-described memory may be used to store software programs and modules, and the processor executes the software programs and modules stored in the memory to perform various functional applications and data processing. The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, application programs required for functions, and the like; the storage data area may store data created according to the use of the above-described device, or the like. In addition, the memory may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory may also include a memory controller to provide access to the memory by the processor.

The embodiments of the present disclosure provide a computer readable storage medium storing at least one instruction or at least one program, where the at least one instruction or the at least one program is loaded and executed by a processor to implement a multimedia information playing method as described above.

Embodiments of the present application also provide a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes to implement the multimedia information playing method provided by the above method embodiment.

The embodiment of the application also provides a multimedia information playing device, which is applied to a server, as shown in fig. 15, the device may include:

a play request receiving module 1510, configured to receive a multimedia information play request sent by a first terminal; the multimedia information playing request carries a to-be-played identifier of the to-be-played multimedia information and a first terminal identifier; the distance between the first terminal and the local server is smaller than a preset distance threshold;

a target protocol instruction obtaining module 1520, configured to obtain a target protocol instruction corresponding to the first terminal identifier based on a preset protocol instruction library; the preset protocol instruction library is used for storing protocol instructions corresponding to preset terminal identifiers; the protocol instruction corresponding to the preset terminal identifier is constructed based on the successful handshake result of the preset terminal and the local server; the successful handshake result is that the local server responds to a first multimedia information playing request sent by the preset terminal and performs handshake with the preset terminal;

the resource to be played obtaining module 1530, configured to obtain a resource to be played corresponding to the identifier to be played based on the target protocol instruction;

And a resource to be played sending module 1540, configured to send the resource to be played to the first terminal, so that the first terminal plays the multimedia information based on the resource to be played.

In some embodiments, the handshake result determining unit includes:

an initial handshake result determining subunit, configured to determine an initial handshake result between the local server and the preset terminal based on the handshake packet;

In some embodiments, the play request receiving module includes:

a notification sending unit, configured to send a message reception notification to the first terminal and stop sending a current resource to be played to the first terminal based on the pause play message; the current resource to be played is the resource corresponding to the current multimedia information.

In some embodiments, the apparatus further comprises:

The resource to be played receiving module is used for receiving the resource to be played sent by the preset server; the resource to be played is a play resource generated by a second terminal, the distance between the preset server and the first terminal is greater than or equal to the preset distance threshold, and the distance between the preset server and the second terminal is smaller than the preset distance threshold.

The apparatus and method embodiments in the server embodiments described above are based on the same inventive concept.

The embodiment of the application also provides a multimedia information playing device, which is applied to the first terminal, as shown in fig. 16, the device may include:

a play request sending module 1610, configured to send a multimedia information play request to a target server; the multimedia information playing request carries a to-be-played identifier of the to-be-played multimedia information and a first terminal identifier; the distance between the target server and the first terminal is smaller than a preset distance threshold;

the resource to be played receiving module 1620, configured to receive a resource to be played sent by the target server, where the resource to be played is a resource corresponding to the identifier to be played, where the resource to be played is acquired by the target server based on a target protocol instruction; the target protocol instruction is an instruction corresponding to the first terminal identifier, which is acquired by the target server based on a preset protocol instruction library; the preset protocol instruction library is used for storing protocol instructions corresponding to preset terminal identifiers; the protocol instruction corresponding to the preset terminal identifier is constructed based on the successful handshake result of the preset terminal and the target server; the successful handshake result is obtained by the target server performing handshake with the preset terminal in response to a first multimedia information playing request sent by the preset terminal;

The information playing module 1630 is configured to play the multimedia information based on the resource to be played.

In some embodiments, the play request sending module includes:

a multimedia information switching request sending unit, configured to send a multimedia information switching request to the target server in response to a multimedia information switching instruction during a current playing process of the current multimedia information, where the multimedia information switching request carries a pause playing message of the current multimedia information;

and a notification receiving unit configured to receive a message reception notification sent by the target server based on the pause play message.

In some embodiments, the apparatus further comprises:

a target network protocol determining unit, configured to determine a target network protocol corresponding to the resource to be played based on the protocol analyzer;

correspondingly, the information playing module comprises:

In some embodiments, the player further includes a decoder, and the decoding resource determining unit includes:

The apparatus and method embodiments in the terminal embodiments described above are based on the same inventive concept.

The application also provides a multimedia information playing system, which comprises a target server and a first terminal,

the target server is used for acquiring a target protocol instruction corresponding to the first terminal identifier based on a preset protocol instruction library; the preset protocol instruction library is used for storing protocol instructions corresponding to preset terminal identifiers; the protocol instruction corresponding to the preset terminal identifier is constructed based on the successful handshake result of the preset terminal and the local server; the successful handshake result is that the local server responds to a first multimedia information playing request sent by the preset terminal and performs handshake with the preset terminal; based on the target protocol instruction, obtaining resources to be played corresponding to the identification to be played; and sending the resources to be played to the first terminal.

As can be seen from the embodiments of the method, apparatus, storage medium or system for playing multimedia information provided in the present application, in the embodiments of the present application, a target server receives a multimedia information playing request sent by a first terminal; the multimedia information playing request carries a to-be-played identifier of the to-be-played multimedia information and a first terminal identifier; the distance between the first terminal and the local server is smaller than a preset distance threshold; acquiring a target protocol instruction corresponding to the first terminal identifier based on a preset protocol instruction library; the preset protocol instruction library is used for storing protocol instructions corresponding to preset terminal identifiers; the protocol instruction corresponding to the preset terminal identifier is constructed based on the successful handshake result of the preset terminal and the local server; the successful handshake result is obtained by the local server performing handshake with the preset terminal in response to a first multimedia information playing request sent by the preset terminal; acquiring resources to be played corresponding to the identification to be played based on the target protocol instruction; and sending the resources to be played to the first terminal so that the first terminal plays the multimedia information based on the resources to be played. After receiving a multimedia information playing request sent by a first terminal, the target server searches a target protocol instruction between the target server and the first terminal in a preset protocol instruction library, and multiplexes the instruction to realize quick interaction between the target server and the first terminal, so that the target server and the first terminal are prevented from handshake again to establish a connection relationship, handshake interaction time consumption of the target server and the first terminal is reduced, the first terminal can quickly acquire resources to be played and play the resources, and playing time consumption of a first frame of image in the multimedia information to be played is reduced, and playing efficiency of the multimedia information is improved.

It should be noted that: the foregoing sequence of the embodiments of the present application is only for describing, and does not represent the advantages and disadvantages of the embodiments. And the foregoing description has been directed to specific embodiments of this specification. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims can be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for embodiments of the apparatus, system, storage medium, the description is relatively simple as it is substantially similar to the method embodiments, where relevant see the section description of the method embodiments.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program for instructing relevant hardware, where the program may be stored in a computer readable storage medium, and the storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

The foregoing description of the preferred embodiments is provided for the purpose of illustration only, and is not intended to limit the invention to the particular embodiments disclosed, but on the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.

Claims

1. A method for playing multimedia information, the method comprising:

2. The method according to claim 1, wherein the method for constructing the preset protocol instruction library includes:

determining a handshake result of the local server and the preset terminal based on the handshake data packet;

3. The method according to claim 2, wherein determining a handshake result between the local server and the preset terminal based on the handshake packet comprises:

4. The method of claim 1, wherein receiving the multimedia information play request sent by the first terminal comprises:

based on the play suspension message, sending a message receiving notification to the first terminal and stopping sending the current resources to be played to the first terminal; and the current resource to be played is the resource corresponding to the current multimedia information.

5. The method according to any one of claims 1-4, further comprising:

receiving the resources to be played sent by a preset server; the resource to be played is a play resource generated by a second terminal, the distance between the preset server and the first terminal is larger than or equal to the preset distance threshold, and the distance between the preset server and the second terminal is smaller than the preset distance threshold.

6. A method for playing multimedia information, the method comprising:

and playing the multimedia information based on the resources to be played.

7. The method of claim 6, wherein the sending a multimedia information play request to the target server comprises:

and receiving a message receiving notification sent by the target server based on the pause playing message.

8. The method of claim 7, wherein after receiving the resource to be played sent by the target server, the method further comprises:

and storing the resources to be played in the player.

9. The method of claim 8, wherein the player includes a protocol parser and a format parser, wherein storing the resources to be played in the player includes:

determining decoding resources based on the second parsed data;

storing the decoding resources in the player;

correspondingly, the playing the multimedia information based on the resources to be played includes:

and playing the multimedia information based on the decoding resource.

10. The method of claim 9, wherein the player further comprises a decoder, wherein the determining decoding resources based on the second parsed data comprises:

storing the second parsed data in a cache database;

11. A multimedia information playing device applied to a server, the device comprising:

12. A multimedia information playing device applied to a terminal, the device comprising:

13. A computer storage medium having stored therein at least one instruction or at least one program, the at least one instruction or the at least one program being loaded and executed by a processor to implement the method of playing multimedia information as claimed in any one of claims 1 to 5 or 6 to 10.