CN111726658A

CN111726658A - Multimedia data transmission method and device

Info

Publication number: CN111726658A
Application number: CN202010533721.4A
Authority: CN
Inventors: 吴煌鹏; 张鹏
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2020-06-12
Filing date: 2020-06-12
Publication date: 2020-09-29

Abstract

The embodiment of the application discloses a multimedia data transmission method and a device; the method comprises the steps that a data request of target multimedia data is sent to a data node, wherein the target multimedia data comprises a plurality of multimedia fragment data, the multimedia fragment data returned by the data node based on the data request is received, and when all multimedia fragment data of the target multimedia data are not received within a target receiving duration, a data transmission stopping command is sent to the data node so that the data node stops transmitting the multimedia fragment data, and the multimedia fragment data which are not received are obtained from a content distribution server; the scheme can improve the bandwidth utilization rate in the transmission process of the multimedia data.

Description

Multimedia data transmission method and device

Technical Field

The present application relates to the field of networks, and in particular, to a multimedia data transmission method and apparatus.

Background

In the process of performing multimedia on demand or live broadcasting through the internet, in order to guarantee smooth playing to the maximum extent, in the prior art, when multimedia fragment data is obtained, the multimedia fragment data is usually obtained by combining a Peer-to-Peer (P2P) and a Content Delivery Network (CDN), for example, multimedia data is received on the basis of P2P, and if all multimedia data cannot be received on the basis of P2P within a set time, the multimedia data that is not received is obtained on the basis of the CDN. In the process of research and practice on the prior art, the inventors of the present application found that the prior art has a disadvantage of low bandwidth utilization rate when multimedia data transmission is performed.

Disclosure of Invention

The embodiment of the application provides a multimedia data transmission method and device, which can improve the bandwidth utilization rate in the multimedia data transmission process.

The embodiment of the application provides a multimedia data transmission method, which comprises the following steps:

sending a data request of target multimedia data to a data node, wherein the target multimedia data comprises a plurality of multimedia fragment data;

receiving multimedia fragment data returned by the data node based on the data request;

when all multimedia fragment data of the target multimedia data are not received within the target receiving duration, sending a data transmission stopping command to the data node so as to enable the data node to stop transmitting the multimedia fragment data;

and acquiring the multimedia fragment data which is not received from the content distribution server.

receiving a data request sent by a request node, wherein the data request comprises a plurality of pieces of multimedia slicing information;

sending multimedia fragment data to the requesting node based on the multimedia fragment information;

acquiring the current data sending duration of the multimedia fragment data in real time;

and when a data transmission stopping command sent by the request node is received, or the current data sending duration is not less than the target sending duration, stopping executing the step of sending the multimedia fragment data to the request node based on the multimedia fragment information, wherein the data transmission stopping command is sent by the request node based on the target receiving duration.

Accordingly, an embodiment of the present application provides a multimedia data transmission apparatus, including:

the system comprises a first sending module and a second sending module, wherein the first sending module comprises a data request for sending target multimedia data to a data node, and the target multimedia data comprises a plurality of multimedia fragment data;

the receiving module receives multimedia fragment data returned by the data node based on the data request;

the second sending module sends a data transmission stopping command to the data node when not receiving all multimedia fragment data of the target multimedia data within the target receiving duration so as to enable the data node to stop transmitting the multimedia fragment data;

and the acquisition module acquires the multimedia fragment data which is not received from the content distribution server.

In some embodiments of the present application, the multimedia data transmission apparatus further comprises:

the determining module is used for determining a target receiving time length and a target sending time length aiming at the data node, wherein the target sending time length is less than the target receiving time length;

at this time, the first sending module is configured to:

and sending a data request of target multimedia data to the data node based on the target sending duration, wherein the data request comprises the target sending duration.

In some embodiments of the present application, the determining module includes an obtaining submodule and a determining submodule, where the obtaining submodule is configured to obtain duration information corresponding to target multimedia data;

and the determining submodule is used for determining the target receiving time length and the target sending time length aiming at the data node based on the time length information.

In some embodiments of the present application, the second sending module includes a computation sub-module, a real-time detection sub-module, and a sending sub-module, wherein,

the calculation submodule is used for calculating the current data receiving time length based on the preset time length;

the real-time detection submodule is used for carrying out real-time detection on the received multimedia fragment data;

and the sending submodule is used for determining that all multimedia fragment data of the target multimedia data are not received in the target receiving time length when the current data receiving time length is greater than or equal to the target receiving time length and all multimedia fragment data of the target multimedia data are not detected, and sending a data transmission stopping command to the data node.

the setting module is used for setting the current time point as a data receiving starting time point when a data request of target multimedia data is sent to the data node;

at this time, the calculation submodule is specifically configured to:

and acquiring a current time point based on preset time length, and calculating a difference value between the current time point and the data receiving starting time point to obtain the current data receiving time length.

the receiving module is used for receiving a data request sent by a request node, wherein the data request comprises a plurality of pieces of multimedia slicing information;

a sending module, configured to send multimedia fragment data to the requesting node based on the multimedia fragment information;

the acquisition module is used for acquiring the current data sending duration of the multimedia fragment data in real time;

and the execution stopping module is used for stopping executing the step of sending the multimedia fragment data to the request node based on the multimedia fragment information when receiving a data transmission stopping command sent by the request node or the current data sending duration is not less than the target sending duration, wherein the data transmission stopping command is sent by the request node based on the target receiving duration.

and the analysis module is used for analyzing the data request to obtain the target sending duration and the plurality of multimedia fragment information.

and the generating module is used for generating a target sending duration for multimedia data transmission based on the data request when the data request sent by the requesting node is received.

Correspondingly, the embodiment of the present application further provides a storage medium, where the storage medium stores a computer program, and the computer program is suitable for being loaded by a processor to execute any one of the multimedia data transmission methods provided in the embodiment of the present application.

Correspondingly, the embodiment of the present application further provides a computer device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements any one of the multimedia data transmission methods provided in the embodiment of the present application when executing the computer program.

In the application, a request node firstly sends a data request of target multimedia data to a data node, wherein the target multimedia data comprises a plurality of multimedia fragment data, then receives the multimedia fragment data returned by the data node based on the data request, and sends a data transmission stop command to the data node when all multimedia fragment data of the target multimedia data are not received within a target receiving duration, so that the data node stops transmitting the multimedia fragment data, and finally obtains the multimedia fragment data which are not received from a content distribution server.

The data node receives a data request sent by a request node, wherein the data request comprises a plurality of multimedia fragment information, then sends multimedia fragment data to the request node based on the multimedia fragment information, and obtains the current data sending duration of the multimedia fragment data in real time; and when a data transmission stopping command sent by the request node is received, or the current data sending duration is not less than the target sending duration, stopping executing the step of sending the multimedia fragment data to the request node based on the multimedia fragment information, wherein the data transmission stopping command is sent by the request node based on the target receiving duration.

In the scheme, when the request node does not receive all multimedia fragment data of the target multimedia data within the target receiving duration, a data transmission stop command is sent to the data node, and the data node stops sending the multimedia fragment data to the request node after receiving the data transmission stop command, so that the situation that the data node still carries out multimedia data transmission and consumes bandwidth after the request node does not need the multimedia fragment data transmitted by the data node any more is avoided, and therefore the bandwidth utilization rate in the multimedia data transmission process can be effectively improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a schematic view of a multimedia data transmission apparatus according to an embodiment of the present application;

fig. 2 is a flowchart illustrating a multimedia data transmission method according to an embodiment of the present application;

fig. 3 is another schematic flow chart of a multimedia data transmission method according to an embodiment of the present application;

FIG. 4 is a schematic view of a video file fragment provided by an embodiment of the present application;

fig. 5 is a schematic diagram of a video file download data policy provided in an embodiment of the present application;

fig. 6 is another schematic flow chart of a multimedia data transmission method according to an embodiment of the present application;

fig. 7 is another flowchart of a multimedia data transmission method according to an embodiment of the present application;

fig. 8 is a schematic structural diagram of a multimedia data transmission apparatus according to an embodiment of the present application;

fig. 9 is another schematic structural diagram of a multimedia data transmission apparatus according to an embodiment of the present application;

fig. 10 is a schematic structural diagram of a multimedia data transmission apparatus according to an embodiment of the present application;

fig. 11 is a schematic structural diagram of a computer device provided in an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described clearly and completely with reference to the drawings in the embodiments of the present application, and it is obvious that the embodiments described in the present application are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The embodiment of the application provides a multimedia data transmission method and device. Specifically, the embodiment of the present application may be integrated in a first multimedia data transmission device (referred to as a first transmission device for short) and a second multimedia transmission device (referred to as a second transmission device for short).

The first transmission apparatus may be integrated in a first computer device, the first computer device may be a request node, the first computer device may include a terminal or a server, and the terminal may be a smart phone, a tablet computer, a notebook computer, a desktop computer, a smart speaker, a smart watch, and the like, but is not limited thereto. The server may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing cloud computing services. The terminal and the server may be directly or indirectly connected through wired or wireless communication, and the application is not limited herein.

The second transmission device may be integrated in a second computer device, the second computer device may be a data node, the second computer device may include a terminal or a server, and the server may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing cloud computing services. The terminal may be, but is not limited to, a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, and the like. The terminal and the server may be directly or indirectly connected through wired or wireless communication, and the application is not limited herein.

As shown in fig. 1, in the solution of the embodiment of the present application, a requesting node and a data node may perform interaction and multimedia data transmission, and specifically,

the request node can send a data request of target multimedia data to the data node, wherein the target multimedia data comprises a plurality of multimedia fragment data, then the data node receives the multimedia fragment data returned by the data node based on the data request, when all multimedia fragment data of the target multimedia data are not received within a target receiving duration, a data transmission stop command is sent to the data node to enable the data node to stop transmitting the multimedia fragment data, and finally the multimedia fragment data which are not received are obtained from the content distribution server.

The data node can receive a data request sent by the request node, the data request comprises a plurality of pieces of multimedia fragment information, then the multimedia fragment data is sent to the request node based on the multimedia fragment information, and then the current data sending duration of the multimedia fragment data is obtained in real time; and finally, when a data transmission stopping command sent by the request node is received, or the current data sending duration is not less than the target sending duration, stopping executing the step of sending the multimedia fragment data to the request node based on the multimedia fragment information, wherein the data transmission stopping command is sent by the request node based on the target receiving duration.

It should be noted that the scene schematic diagram of the multimedia data transmission apparatus shown in fig. 1 is only an example, and the multimedia data transmission apparatus and the scene described in the embodiment of the present application are for more clearly illustrating the technical solution of the embodiment of the present application, and do not form a limitation on the technical solution provided in the embodiment of the present application, and it is known by a person skilled in the art that the technical solution provided in the embodiment of the present application is also applicable to similar technical problems along with the evolution of the multimedia data transmission apparatus and the appearance of a new service scene.

The following are detailed below. In this embodiment, it will be described from the perspective of the first transmission apparatus that the requesting node may be integrated on the first transmission apparatus, as shown in fig. 2, and fig. 2 is a flowchart illustrating a multimedia data transmission method provided in this embodiment of the present application. The multimedia data transmission method may include:

101. and sending a data request of target multimedia data to a data node, wherein the target multimedia data comprises a plurality of multimedia fragment data.

The data node may be a computer device storing the target multimedia data, and before sending the data request to the data node, the data node storing the target multimedia data may be determined among a plurality of nodes, specifically, request information may be sent to the plurality of nodes, and by receiving feedback information returned by each node, the data stored on each node is determined, and finally the data node storing the target multimedia data is determined; the nodes can also send storage information to each other at set time intervals, the storage information can comprise data information stored on the nodes, and the data nodes storing target multimedia data can be determined through the storage information transmitted by a plurality of nodes at fixed time.

The target multimedia data may include audio data, video data, etc. to be acquired,

the target multimedia data can be embodied in a plurality of application scenarios, such as online video on demand, online audio on demand, online live broadcast (video or audio form), and the like. For example, a user watches the video a online through a video website, the current playing time point of the video a being played is 15s, in order to ensure smooth playing, the video website has downloaded the video data of 15s to 20s in the video a, at this time, the video data of 20s to 30s needs to be downloaded in advance, and at this time, the target multimedia data may be the video data of 20s to 30s of the video a.

The multimedia data can comprise a plurality of multimedia fragment data, so that data transmission is facilitated, the multimedia playing fluency is guaranteed, a large multimedia data can be divided into a plurality of small fragment data, the transmission can be performed in sequence according to sequence information of the fragment data during data transmission, a receiver can play the fragment data after receiving the fragment data, the whole multimedia data does not need to be played again, and the fluency playing can be guaranteed to a certain extent at special moments such as poor network conditions, low network speed and the like.

The data request may be for requesting target multimedia data from a data node. The data request may include multimedia fragment information of the target multimedia data, the multimedia fragment information may be a fragment identifier of the fragment data, the fragment identifier may be information uniquely identifying the fragment data, and the data node may determine the target multimedia data based on the fragment identifier.

For example, a data request O is sent to the data node PP, where the data request O contains information related to the target multimedia data.

In some embodiments, the multimedia data transmission method may further include: determining a target receiving duration and a target transmitting duration for the data node,

at this time, the step of "transmitting a data request of the target multimedia data to the data node" may include: and sending a data request of the target multimedia data to the data node based on the target sending duration, wherein the data request comprises the target sending duration.

Because the data node can be any computer device, the data node is unstable and may disconnect the network connection at any time, and in order to ensure that the required target multimedia data is obtained in time, the requesting node can set key information for the data node, such as target receiving time length and target sending time length.

The target receiving duration may be a maximum duration that can be consumed by the requesting node for performing the target multimedia data transmission with the data node.

The target sending duration may be a maximum duration that can be consumed by the data node in the process of transmitting the target multimedia fragment data to the requesting node, and therefore, the data request sent to the data node may further include the target sending duration, and the requesting node may integrate the fragment information of the target multimedia data and the target sending duration as a data request and send the data request to the data node.

The determination of the target transmission duration and the target reception duration may be accomplished based on a plurality of factors, such as the current network status (e.g., maximum bandwidth, whether or not congestion occurs, etc.), the characteristics of the data node (e.g., distance from the requesting node, etc.), or the target multimedia data (e.g., data amount, duration, etc. of the target multimedia data), etc.

For example, the target sending duration 10s and the target receiving duration 11s of the data node PP may be determined, and based on the target sending duration, the data request O may be sent to the data node PP, where the data request O includes the data sending duration 10 s.

In some embodiments, the step of determining the target receiving duration and the target sending duration for the data node may comprise:

acquiring duration information corresponding to target multimedia data; and determining a target receiving time length and a target sending time length aiming at the data node based on the time length information.

The target receiving time length and the target sending time length of the data node are determined through the time length information, specifically, the target receiving time length can be determined according to the time length information, the target receiving time length is set to ensure smooth playing of online multimedia to the maximum extent, for example, when all target multimedia data cannot be obtained through the data node, the request node can have enough time to download the target multimedia data which are not obtained from the server, so that all the target multimedia data can be obtained within limited time.

In addition, the determination of the target receiving duration may also be determined based on other factors, for example, a format of the target multimedia data, a use of the target multimedia data, and a hardware characteristic of the requesting node, and specifically may be flexibly determined during actual application, which is not described herein again.

After the target receiving duration is determined, a target sending duration may be set for the data node based on the target receiving duration, for example, the time required from sending the data request from the requesting node to receiving and analyzing the target sending duration in the data request by the data node may be pre-judged according to the current network state, and based on the time and the target receiving duration, the target sending duration may be set for the data node, and for example, the time consumed in the process of transmitting the multimedia fragment data from the data node to the requesting node (e.g., the time between sending the data node and receiving the data node by the requesting node, that is, the time consumed in the transmission process) may be pre-judged, and based on the time and the target receiving duration, the target sending duration may be set for the data node, and so on, it is obvious that the target sending duration should be less than the target receiving duration.

102. And receiving the multimedia fragment data returned by the data node based on the data request.

The data node may sequentially return fragment data of the target multimedia data to the requesting node, and fragment data of one multimedia data may represent an order by identification, for example, different fragments may be identified by arabic numbers.

The target multimedia data comprises a plurality of fragment data, and when data transmission is carried out, the data nodes can carry out data transmission in sequence according to the identifiers of the fragment data, so that the request node can receive part of the fragment data of the target multimedia data within a period of time.

For example, the receiving data node PP receives the multimedia fragment data returned based on the data request O, the target multimedia data includes 10 multimedia fragment data, and the requesting node receives the multimedia fragment data in sequence from the fragment data 1.

103. And when all the multimedia fragment data of the target multimedia data are not received within the target receiving duration, sending a data transmission stopping command to the data node so as to stop the data node from transmitting the multimedia fragment data.

The target receiving duration may be the maximum duration that can be consumed by the requesting node and the data node for target multimedia data transmission, and therefore, if the requesting node does not receive all multimedia fragment data within the target receiving duration, data transmission between the requesting node and the data node is to be stopped, that is, the data node is to stop sending the multimedia fragment data to the requesting node, and if the data node continues to transmit the multimedia fragment data to the requesting node at this time, the process needs to consume bandwidth, but since the requesting node does not receive the multimedia fragment data sent by the data node any more after the target receiving duration is exceeded, the bandwidth-consumed transmission of the multimedia fragment data is waste of bandwidth, which results in a complete target multimedia data obtaining process, and the bandwidth utilization rate is low.

Therefore, in the application, when the requesting node does not receive all multimedia fragment data within the target receiving duration, the data transmission stop command is sent to the requesting node, so that the data node stops transmitting the multimedia fragment data to the requesting node, thereby avoiding bandwidth waste at the position and improving the bandwidth utilization rate.

The data transmission stop command may include information instructing the data node to stop transmitting the multimedia fragment data to the requesting node, and the data transmission stop command may include a key character predefined or based on a set protocol, so that the data node and the requesting node may communicate information with the key character as a "language", and trigger further operations based on the key character.

For example, when the requesting node does not receive 10 pieces of fragmented data of the target multimedia data within the target receiving duration 11s, the requesting node sends a data transmission stop command M to the data node PP, so that the data node PP no longer transmits the target multimedia data to the requesting node.

In some embodiments, the step of sending a data transmission stop command to the data node when all multimedia fragment data of the target multimedia data is not received within the target receiving duration may include:

calculating the current data receiving time length based on the preset time length, and detecting the received multimedia fragment data in real time; and when the current data receiving time length is not less than the target receiving time length and all multimedia fragment data of the target multimedia data are not detected, determining that all multimedia fragment data of the target multimedia data are not received in the target receiving time length, and sending a data transmission stopping command to the data node.

The preset time duration may be a period of time, and the preset time duration may be a time duration between adjacent current data receiving time durations, for example, the preset time duration may be 0.5s, that is, the current data receiving time duration is calculated every 0.5 s.

The current receiving duration may refer to a time period that has been consumed by the multimedia data transmission process between the requesting node and the data node.

The received multimedia fragment data is detected in real time, and when the request node receives the multimedia fragment data, whether all multimedia fragment data of the target multimedia data are received can be determined by detecting the identifier of the fragment data.

Therefore, when it is detected that the current receiving duration is no longer less than the target receiving duration and all multimedia fragment data of the target multimedia data are not detected, it can be determined that all multimedia fragment data of the target multimedia data are not received within the target receiving duration, that is, a data transmission stop command is sent to the data node.

For example, the current data receiving duration is calculated every 1s, and when the multimedia fragment data is received, the fragment identifier of the multimedia fragment data is detected to determine whether all multimedia fragment data of the target multimedia data is received. When the target receiving time length is 10s and the current data receiving time length is 10s and the detected multimedia fragment data is 9 (the preset target multimedia data comprises 10 fragments), the requesting node sends a PP data transmission stop command M to the data node.

In some embodiments, the multimedia data transmission method may further include:

when a data request of target multimedia data is transmitted to a data node, setting a current time point as a data reception start time point,

at this time, the step of "calculating the current data reception time period based on the preset time period" may include:

and acquiring a current time point based on the preset time length, and calculating a difference value between the current time point and the data receiving starting time point to obtain the current data receiving time length.

The starting point can be flexibly set according to actual conditions, for example, the starting point can be determined when the requesting node sends a data request of target multimedia data to the data node, that is, the time point when the requesting node sends the data request to the data node can be recorded, and the time point is set as the data receiving starting time point.

Then, the preset time duration may be used as a time interval to obtain a current time point, and a difference between the current time point and the data reception start time point is calculated, where the difference may be the current data reception time duration.

For example, the time point a1 when the requesting node sends the data request O to the data node PP may be recorded, where the time point a1 is the data reception start time point, then the current time point a2 is obtained every 1s, and the difference a between the current time point a2 and the data reception start time point a1 is calculated, where the difference a is the current data reception duration.

104. And acquiring the multimedia fragment data which is not received from the content distribution server.

Specifically, a data request for the multimedia fragment data that is not received may be sent to the content distribution server, and after receiving the data request, the content distribution server may return the multimedia fragment data to the requesting node based on the data request.

The content distribution server is generally stable and fast in data transmission, and can be used as a trusted data source, so that when all multimedia fragment data of the multimedia data cannot be received within a target receiving time, the multimedia fragment data which is not received can be acquired from the content distribution server.

For example, the requesting node obtains the multimedia fragment data 10 from the content distribution server, and the multimedia fragment data 10 is the multimedia fragment data of the target multimedia data that is not received by the requesting node within the target receiving duration.

The embodiment first sends a data request of target multimedia data to a data node, where the target multimedia data includes a plurality of multimedia fragment data, then receives the multimedia fragment data returned by the data node based on the data request,

and when all multimedia fragment data of the target multimedia data are not received within the target receiving duration, sending a data transmission stopping command to the data node to enable the data node to stop transmitting the multimedia fragment data, and finally acquiring the multimedia fragment data which are not received from the content distribution server.

In this embodiment, when the requesting node does not receive all multimedia fragment data of the target multimedia data within the target receiving duration, the requesting node does not need the multimedia fragment data transmitted by the data node any more, but directly obtains the multimedia fragment data that is not obtained from the content distribution server, at this time, the requesting node may send a data transmission stop command to the data node, so that the data node does not transmit the multimedia fragment data to the requesting node any more, thereby saving bandwidth consumed in the original process, and significantly improving bandwidth utilization rate in the multimedia data transmission process.

In this embodiment, it will be described from the perspective of the second transmission apparatus, the data node may be integrated on the second transmission apparatus, as shown in fig. 3, and fig. 3 is a flowchart illustrating a multimedia data transmission method provided in this embodiment of the present application. The multimedia data transmission method may include:

201. and receiving a data request sent by a request node, wherein the data request comprises a plurality of pieces of multimedia slicing information.

The request node can be a computer device which requests target multimedia data from the data node, multimedia data transmission is carried out between the request node and the data node, the request node and the data node are not unique, in a node set formed by a plurality of nodes, any node which needs to request data is the request node, any node which can transmit data to the request node is the data node, and when one node can transmit data to other nodes and needs data of other nodes, the node is both the request node and the data node. However, in the solution of the present application, the requesting node and the data node are the receiver and the sender of the targeted multimedia data transmission, and are two different nodes.

The data request may be for requesting the target multimedia data from the data node, and the data request may contain multimedia slicing information of the target multimedia data.

The multimedia fragment information can uniquely identify the multimedia fragment data, the data node can determine the multimedia fragment data uniquely corresponding to the data node based on the multimedia fragment information, the multimedia fragment data can be data with small memory occupation, and a plurality of multimedia fragment data can form complete target multimedia data.

The target multimedia data can comprise audio data, video data and the like which need to be acquired, the multimedia data can comprise a plurality of multimedia fragment data, data transmission is facilitated, and playing fluency is facilitated, a large multimedia data can be divided into a plurality of small fragment data, when data transmission is carried out, transmission can be carried out in sequence according to sequence information of the fragment data, a receiver receives one fragment data, the fragment data can be played, playing does not need to be carried out after the whole multimedia data is received, and smooth playing can be guaranteed to a certain extent when the network condition is poor and the network speed is slow.

After receiving a data request sent by a requesting node, the data request can be analyzed to obtain multimedia fragment information, and the corresponding multimedia fragment data and the storage position of the multimedia fragment data on the data node are determined based on the fragment information.

For example, a data request O sent by the requesting node KK is received, where the data request O contains multimedia fragment information (fragment identifications 1 to 10).

202. And sending the multimedia fragment data to the requesting node based on the multimedia fragment information.

The data node sends data to the requesting node based on some preset relevant protocols and rules, for example, P2P application for implementing file distribution between the requesting node and the data node, a transmission Protocol providing data transmission service for communication between the requesting node and the data node, such as User Datagram Protocol (UDP), a Protocol providing communication service for the requesting node and the data node, such as Internet Protocol (IP), and a relevant Protocol of a data link layer and a physical layer during data transmission.

The data node may add necessary information to the fragmented data based on the specification of such protocol or rule, and the final multimedia data and the related necessary information will be transmitted to the requesting node through the physical layer in the form of digital signals.

For example, the corresponding multimedia fragment data (fragment data 1 to 10) may be determined based on the multimedia fragment information, and the multimedia fragment data may be sequentially transmitted to the requesting node.

203. And acquiring the current data sending duration of the multimedia fragment data in real time.

The current data sending duration may be a time period that has elapsed for the data node to send the multimedia fragment data to the requesting node. The current data transmission duration may be obtained at set time intervals and compared to the target reception duration. The time point at which the data node receives the data request may be set as a data transmission start time point, and the current time point may be acquired at set time intervals, and a difference between the current time point and the data transmission start time point, which is a current data transmission duration, may be calculated.

204. And when a data transmission stopping command sent by the request node is received, or the current data sending duration is not less than the target sending duration, stopping executing the step of sending the multimedia fragment data to the request node based on the multimedia fragment information, wherein the data transmission stopping command is sent by the request node based on the target receiving duration.

When receiving a data transmission stop command sent by the requesting node, stopping executing the step of sending the multimedia slicing data to the requesting node based on the multimedia slicing information, specifically,

After receiving the multimedia fragment information sent by the request node, the data node defaults to send all multimedia fragment data corresponding to the multimedia fragment information to the request node, a certain time is usually consumed for completing the process, when the network condition is not good, such as congestion occurs, the consumed time is longer, the request node sets a time length for the multimedia data transmission process between the data node and the request node in order to ensure that all multimedia fragment data are received in a set time period, namely a target receiving time length, when the request node determines that the time length consumed in the multimedia data transmission process with the data node reaches the target receiving time length, a data transmission stop command is sent to the data node, after receiving the data transmission stop command, the data node stops sending the multimedia fragment data to the request node, and the situation that the data node continues to send the multimedia fragment data which is not needed by the request node is avoided, unnecessary bandwidth consumption is avoided, and therefore the bandwidth utilization rate in the multimedia data transmission process is improved.

For example, when receiving the data transmission stop command M sent by the requesting node KK, the step of sending the multimedia fragment data to the requesting node is stopped.

Stopping the step of transmitting the multimedia fragment data to the requesting node based on the multimedia fragment information when the current data transmission duration is not less than the target transmission duration, specifically,

the target sending duration may be a maximum duration that may be consumed by the data node in transmitting the target multimedia fragment data to the requesting node. The target sending duration may be flexibly set based on the characteristics of the target receiving duration, the network condition, the data node, and the request node, and is not limited herein, and generally, the target sending duration is less than the target receiving duration.

In order to ensure that the requesting node acquires all multimedia fragment data of the target multimedia data within a set time period and improve the bandwidth utilization rate, the embodiment may further set a target sending time length for the data node, the data node may send the multimedia fragment data to the requesting node within the target sending time length, and when the time period consumed for sending the multimedia fragment data reaches the target sending time length, the data node no longer needs to send the multimedia fragment data to the requesting node, that is, the operation of sending the multimedia fragment data is stopped, thereby avoiding the unnecessary multimedia fragment data from the data node to the sending requesting node, avoiding the bandwidth waste, and effectively improving the bandwidth utilization rate in the multimedia data transmission process.

It should be noted that, in the actual application process, in order to effectively improve the bandwidth utilization rate in the multimedia data transmission process and avoid unnecessary bandwidth waste, the step of sending the multimedia fragment data may be stopped when a data transmission stop command is received; or stopping executing the step of sending the multimedia fragment data when the current data sending duration reaches the target sending duration; and stopping executing the step of sending the multimedia fragment data when a data transmission stop command is received or the current data sending time length reaches the target sending time length, and the like.

For example, if the target sending duration is 10s and the calculated current data sending duration is 10s, the step of sending the multimedia fragment data to the requesting node is stopped.

In some embodiments, the multimedia data transmission method further comprises:

and analyzing the data request to obtain the target sending duration and the multi-media fragment information.

When the request node sends a data request to the data node, a target sending time length can be set for the data node in advance, and after the data node receives the data request, the data request is analyzed, so that the target sending time length can be obtained. For example, the target sending duration 10s can be obtained by analyzing the data request.

In some embodiments, the multimedia data transmission method further comprises:

and when a data request sent by a request node is received, generating a target sending duration for multimedia data transmission based on the data request.

The target sending time length can be automatically generated by the data node according to the relevant information, for example, the characteristics of the request node, the size of the target multimedia data, the target receiving time length set by the request node and the like can be determined according to the data request sent by the request node, and the target sending time length used for carrying out target multimedia data transmission with the request node is generated according to the characteristics of the data node, the network condition and the like.

The method comprises the steps that a data node firstly receives a data request sent by a request node, the data request comprises a plurality of multimedia fragment information, then multimedia fragment data are sent to the request node based on the multimedia fragment information, then the current data sending duration of the multimedia fragment data is obtained in real time, and finally when a data transmission stopping command sent by the request node is received or the current data sending duration is not less than the target sending duration, the step of sending the multimedia fragment data to the request node based on the multimedia fragment information is stopped, wherein the data transmission stopping command is sent by the request node based on the target receiving duration. When the data transmission stopping command is received, the embodiment stops continuously transmitting the multimedia fragment data which is not needed by the request node, thereby avoiding the waste of bandwidth and effectively improving the bandwidth utilization rate in the multimedia data transmission process.

The method described in the above embodiments is further illustrated in detail by way of example.

As shown in fig. 4, the target multimedia data is a 500KB video file, and in order to facilitate transmission of the video data in a network, the video file may be sliced according to a fixed size, as shown in the figure, the word video file is sliced into 50 multimedia fragment data, and fragment identifiers 0 to 49 are sequentially marked in sequence, so that when a requesting node requests the target multimedia data from a data node or a content distribution server, the requesting node can perform the process by carrying the fragment identifier.

In the video on demand process, fragment data may be obtained in a manner of combining P2P with a CDN, generally, the CDN is stably online and has a large bandwidth and is a reliable data source, but the CDN is relatively high in cost, and a node in the P2P manner may be offline at any time, and a network state is not stable, so that, in order to ensure that a video is played smoothly in the video on demand process, video fragment data close to a current playing time point may be obtained by the CDN, and video fragment data far away from the current playing time point is obtained by P2P, as shown in fig. 5, when the current playing time point (i.e., the current playing point in the figure) is the 10 th second, multimedia fragment data of 10s to 20s are downloaded by the CDN, and multimedia fragment data of 20s to 30s are downloaded by the P2P manner.

Fig. 6 is a schematic diagram of a merchant enrollment method according to an embodiment of the present application, as shown in fig. 6, wherein,

301. the request node acquires the total duration of the target multimedia data and the fragment identifiers of a plurality of multimedia fragment data of the target multimedia data.

For example, node a is a requesting node, node B is a data node, and node a determines that the total duration of the target multimedia data is 10s and the segment identifiers (1 to 20) of 20 segment data of the target multimedia data.

302. And the request node determines the target receiving time length and the target sending time length required for multimedia data transmission with the data node based on the total time length.

For example, the node a determines that requestTimeout (target received duration) is 10s and responseTimeout (target transmitted duration) is 9s according to totalpieeccduration.

303. The request node sends a data request to the data node, wherein the data request comprises a plurality of fragment identifications and target sending duration.

For example, the node a creates a p2pRequest (data request), where the data request carries a fragment identifier (1 to 20) of target multimedia data and a responseTimeout (target sending duration), and the node a starts a timer, where the timing duration is requestTimeout.

304. And the data node receives the data request and analyzes the data request to obtain the target sending time length and the fragment identification.

For example, after receiving the p2pRequest, the node B parses the p2pRequest to obtain the segment identifiers (1 to 20) and the responseTimeout (target sending duration), and simultaneously, the node B starts a timer, where the timing duration is responseTimeout.

305. And the data node sends the multimedia fragment data to the requesting node based on the fragment identifier.

For example, the node B determines corresponding multimedia fragment data (fragment data 1 to 20) based on the fragment identifiers (1 to 20), and sequentially transmits the multimedia fragment data to the node a.

306. And when the request node does not receive all the multimedia fragment data of the target multimedia data within the target receiving duration, the request node sends a data transmission stop command to the data node.

For example, when the timer on the node a side finishes timing, the indication reaches the target receiving duration, and the node a does not receive all the multimedia fragment data (fragment data 1 to 20), the node a sends a close command (data transmission stop command) to the node B, so that the node B does not perform transmission of the multimedia fragment data with the node a any more.

307. And when the data node receives a data transmission stop command or does not send all multimedia fragment data corresponding to the fragment identifier within the target receiving duration, the data node stops executing the step of sending the multimedia fragment data to the requesting node based on the fragment identifier.

For example, when the timer at the node B side finishes timing, the target sending time duration is prompted to reach, or the node B receives a close command sent by the node a, and the node B stops the transmission of the multimedia fragment data with the node a.

308. The requesting node acquires the target multimedia data which is not received from the content distribution server.

For example, the node a obtains remainPieces data (i.e. multimedia fragment data that is not received) from the CDN.

In an actual application scenario, problems that network congestion and the like affect transmission speed may exist at any time, and in this embodiment, multimedia data transmission may be completed by simultaneously using a data transmission notification command and a target receiving duration, so as to ensure that when network congestion occurs, a data node may stop sending multimedia fragment data to a requesting node in time, avoid useless multimedia fragment data transmission, and thereby improve bandwidth utilization rate in a multimedia data transmission process.

For example, if a network congestion occurs when a request node sends a data request including a target receiving duration, the data node receives the data request after a long period of time, so that the target receiving duration set by the request node no longer has a referential meaning, but when the request node reaches the target receiving duration, the data node still can act through a data transmission stopping command sent by the request node, stop sending useless multimedia fragment data to the request node by the data node, avoid wasting bandwidth, and improve the bandwidth utilization rate in the multimedia data transmission process.

For another example, network congestion occurs in the sending process of the data transmission stop command, so that the data transmission stop command is received by the data node after a long period of time, but the network condition of the sending process of the data request is good, that is, the target sending time can normally function, and the data node can stop sending the multimedia fragment data to the requesting node when the target sending time is reached, thereby avoiding the bandwidth waste which may occur, and improving the bandwidth utilization rate in the multimedia data transmission process.

As shown in fig. 7, fig. 7 is a flowchart of the present application, a node a (i.e., a requesting node) sends a P2P slice data request and a response timeout parameter (i.e., a target sending time duration) to a node B (i.e., a data node), after receiving the request, the node B starts sending slice data (i.e., multimedia fragment data), knows that the node B triggers the timeout response parameter, and stops sending data, at this time, the node a requests timeout (i.e., reaches the target receiving time duration), the node a receives only part of slice data or all of the slice data, the node a sends a close command (i.e., a data transmission stop command), and after receiving the close command, the node B stops sending data to the node a. Next, the node a requests the CDN for the slice data (the slice data is not received by the multimedia slice data), and the CDN (i.e., the content delivery server) returns the slice data required by the node a.

In this embodiment, when the requesting node does not receive all multimedia fragment data of the target multimedia data within the target receiving duration, the requesting node no longer needs the multimedia fragment data transmitted by the data node, but directly acquires the multimedia fragment data which is not acquired from the content distribution server, at the moment, the requesting node can send a data transmission stopping command to the data node, so that the data node does not transmit the multimedia fragment data to the requesting node any more, meanwhile, when the request node sends the data request, the target sending duration is sent to the data node, and when the data node does not finish sending all the multimedia fragment data within the target sending duration, namely, the multimedia fragment data is automatically stopped from being continuously sent to the request node, so that the bandwidth is saved, and the bandwidth utilization rate in the multimedia data transmission process can be obviously improved.

In order to better implement the multimedia data transmission method provided in the embodiments of the present application, an embodiment of the present application further provides a device based on the multimedia data transmission method. The terms are the same as those in the above-mentioned multimedia data transmission method, and the details of the implementation can refer to the description in the method embodiment.

Fig. 8 is a schematic structural diagram of a multimedia data transmission apparatus according to an embodiment of the present application, as shown in fig. 8, where the multimedia data transmission apparatus may include a first sending module 401, a receiving module 402, a second sending module 403, and an obtaining module 404, where,

a first sending module 401, configured to send a data request of target multimedia data to a data node, where the target multimedia data includes multiple multimedia fragment data;

a receiving module 402, configured to receive multimedia fragment data returned by a data node based on a data request;

a second sending module 403, configured to send a data transmission stop command to the data node when all multimedia fragment data of the target multimedia data is not received within the target receiving duration, so that the data node stops transmitting the multimedia fragment data;

an obtaining module 404, configured to obtain unreceived multimedia slicing data from the content distribution server.

the determining module is used for determining the target receiving time length and the target sending time length aiming at the data node;

at this time, the first sending module is configured to:

and sending a data request of the target multimedia data to the data node based on the target sending duration, wherein the data request comprises the target sending duration.

and the determining submodule is used for determining the target receiving time length and the target sending time length aiming at the data node based on the time length information, wherein the target sending time length is less than the target receiving time length.

In some embodiments of the present application, as shown in fig. 9, the second sending module 403 includes a calculation sub-module 4031, a real-time detection sub-module 4032, and a sending sub-module 4033, wherein,

a calculation submodule 4031 configured to calculate a current data reception time based on a preset time;

the real-time detection submodule 4032 is used for detecting the received multimedia fragment data in real time;

the sending sub-module 4033 is configured to determine that all multimedia fragment data of the target multimedia data are not received within the target receiving duration when the current data receiving duration is greater than or equal to the target receiving duration and all multimedia fragment data of the target multimedia data are not detected, and send a data transmission stop command to the data node.

at this time, the calculation submodule is specifically configured to:

In this embodiment, the first sending module 401 first sends a data request of target multimedia data to a data node, where the target multimedia data includes a plurality of multimedia fragment data, then the receiving module 402 receives multimedia fragment data returned by the data node based on the data request, when all multimedia fragment data of the target multimedia data are not received within a target receiving duration, the second sending module 403 sends a data transmission stop command to the data node, so that the data node stops transmitting the multimedia fragment data, and finally the obtaining module 404 obtains the multimedia fragment data that is not received from the content distribution server.

As shown in fig. 10, fig. 10 is a schematic structural diagram of a multimedia data transmission apparatus according to an embodiment of the present application, where the multimedia data transmission apparatus may include a receiving module 501, a sending module 502, an obtaining module 503, and a stop executing module 504, where,

a receiving module 501, configured to receive a data request sent by a requesting node, where the data request includes multiple pieces of multimedia fragmentation information;

a sending module 502, configured to send multimedia fragment data to a requesting node based on the multimedia fragment information;

an obtaining module 503, configured to obtain a current data sending duration of the multimedia fragment data in real time;

and a stop execution module 504, configured to stop executing the step of sending the multimedia fragment data to the requesting node based on the multimedia fragment information when a data transmission stop command sent by the requesting node is received, or when the current data sending duration is not less than the target sending duration, where the data transmission stop command is sent by the requesting node based on the target receiving duration.

In this embodiment, the receiving module 501 first receives a data request sent by a requesting node, where the data request includes a plurality of pieces of multimedia fragmentation information, then the sending module 502 sends multimedia fragmentation data to the requesting node based on the multimedia fragmentation information, then the obtaining module 503 obtains the current data sending duration of the multimedia fragmentation data in real time, and finally, when a data transmission stop command sent by the requesting node is received, or the current data sending duration is not less than the target sending duration, the stop execution module 504 stops executing the step of sending the multimedia fragmentation data to the requesting node based on the multimedia fragmentation information. In this embodiment, when a data transmission stop command is received, where the data transmission stop command is sent by the requesting node based on the target receiving duration, the data transmission stop command stops continuously transmitting the multimedia fragmented data that is not needed by the requesting node, so that bandwidth waste is avoided, and the bandwidth utilization rate in the multimedia data transmission process is effectively improved.

In addition, an embodiment of the present application further provides a computer device, where the computer device may be a terminal or a server, as shown in fig. 11, which shows a schematic structural diagram of the computer device according to the embodiment of the present application, and specifically:

the computer device may include components such as a processor 601 of one or more processing cores, memory 602 of one or more computer-readable storage media, a power supply 603, and an input unit 604. Those skilled in the art will appreciate that the computer device architecture illustrated in FIG. 11 is not intended to be limiting of computer devices and may include more or less components than those illustrated, or combinations of certain components, or different arrangements of components. Wherein:

the processor 601 is a control center of the computer device, connects various parts of the whole computer device by using various interfaces and lines, and performs various functions of the computer device and processes data by running or executing software programs and/or modules stored in the memory 602 and calling data stored in the memory 602, thereby monitoring the computer device as a whole. Optionally, processor 601 may include one or more processing cores; preferably, the processor 601 may integrate an application processor and a modem processor, wherein the application processor mainly handles operating system, user pages, application programs, and the like, and the modem processor mainly handles wireless communication. It will be appreciated that the modem processor described above may not be integrated into the processor 601.

The memory 602 may be used to store software programs and modules, and the processor 601 executes various functional applications and data processing by operating the software programs and modules stored in the memory 602. The memory 602 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data created according to use of the computer device, and the like. Further, the memory 602 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 602 may also include a memory controller to provide the processor 601 with access to the memory 602.

The computer device further comprises a power supply 603 for supplying power to the various components, and preferably, the power supply 603 is logically connected to the processor 601 through a power management system, so that functions of managing charging, discharging, and power consumption are realized through the power management system. The power supply 603 may also include any component of one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.

The computer device may also include an input unit 604, the input unit 604 being operable to receive input numeric or character information and to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

Although not shown, the computer device may further include a display unit and the like, which are not described in detail herein. Specifically, in this embodiment, the processor 601 in the computer device loads the executable file corresponding to the process of one or more application programs into the memory 602 according to the following instructions, and the processor 601 runs the application programs stored in the memory 602, thereby implementing various functions as follows:

sending a data request of target multimedia data to a data node, wherein the target multimedia data comprises a plurality of multimedia fragment data; receiving multimedia fragment data returned by the data node based on the data request; when all multimedia fragment data of the target multimedia data are not received within the target receiving duration, sending a data transmission stopping command to the data node so as to enable the data node to stop transmitting the multimedia fragment data; and acquiring the multimedia fragment data which is not received from the content distribution server.

Receiving a data request sent by a request node, wherein the data request comprises a plurality of pieces of multimedia slicing information; sending multimedia fragment data to a request node based on the multimedia fragment information; acquiring the current data sending duration of the multimedia fragment data in real time; and when a data transmission stopping command sent by the request node is received, or the current data sending duration is not less than the target sending duration, stopping executing the step of sending the multimedia fragment data to the request node based on the multimedia fragment information, wherein the data transmission stopping command is sent by the request node based on the target receiving duration.

The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.

It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be performed by a computer program, which may be stored in a computer-readable storage medium and loaded and executed by a processor, or by related hardware controlled by the computer program.

To this end, the present application further provides a storage medium, in which a computer program is stored, where the computer program can be loaded by a processor to execute the steps in any one of the multimedia data transmission methods provided in the present application. For example, the computer program may perform the steps of:

Wherein the storage medium may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.

Since the computer program stored in the storage medium can execute the steps in any multimedia data transmission method provided in the embodiments of the present application, the beneficial effects that can be achieved by any multimedia data transmission method provided in the embodiments of the present application can be achieved, and detailed descriptions are omitted here for the foregoing embodiments.

The foregoing describes in detail a multimedia data transmission method and apparatus provided in an embodiment of the present application, and a specific example is applied in the present application to explain the principle and the implementation of the present application, and the description of the foregoing embodiment is only used to help understand the method and the core idea of the present application; meanwhile, for those skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims

1. A method for multimedia data transmission, comprising:

2. The method of claim 1, further comprising:

determining a target receiving time length and a target sending time length aiming at the data node;

the sending of the data request of the target multimedia data to the data node comprises:

3. The method of claim 2, wherein determining the target receive duration and the target transmit duration for the data node comprises:

acquiring duration information corresponding to target multimedia data;

and determining a target receiving time length and a target sending time length aiming at the data node based on the time length information, wherein the target sending time length is less than the target receiving time length.

4. The method according to claim 1, wherein said sending a data transmission stop command to the data node when all multimedia fragment data of the target multimedia data is not received within a target receiving duration comprises:

calculating the current data receiving time length based on the preset time length, and detecting the received multimedia fragment data in real time;

and when the current data receiving duration is greater than or equal to the target receiving duration and all multimedia fragment data of the target multimedia data are not detected, determining that all multimedia fragment data of the target multimedia data are not received within the target receiving duration, and sending a data transmission stopping command to the data node.

5. The method of claim 4, further comprising:

when a data request of target multimedia data is sent to a data node, setting a current time point as a data receiving starting time point;

the calculating of the current data receiving time length based on the preset time length comprises the following steps:

6. A method for multimedia data transmission, comprising:

7. The method of claim 6, wherein after receiving the data request sent by the requesting node, further comprising:

and analyzing the data request to obtain a target sending duration and a plurality of multimedia fragment information.

8. The method of claim 7, wherein after receiving the data request sent by the requesting node, further comprising:

when a data request sent by a request node is received, a target sending duration for multimedia data transmission is generated based on the data request.

9. A multimedia data transmission apparatus, comprising:

the system comprises a first sending module, a second sending module and a data node, wherein the first sending module is used for sending a data request of target multimedia data to the data node, and the target multimedia data comprises a plurality of multimedia fragment data;

a receiving module, configured to receive multimedia fragment data returned by the data node based on the data request;

a second sending module, configured to send a data transmission stop command to the data node when all multimedia fragment data of the target multimedia data is not received within a target receiving duration, so that the data node stops transmitting multimedia fragment data;

and the acquisition module is used for acquiring the multimedia fragment data which is not received from the content distribution server.

10. A multimedia data transmission apparatus, comprising:

a stop execution module, configured to stop transmission of data when receiving a data transmission stop command sent by the requesting node, or

And stopping executing the step of sending the multimedia fragment data to the request node based on the multimedia fragment information when the current data sending time length is not less than the target sending time length, wherein the data transmission stopping command is sent by the request node based on the target receiving time length.