WO2018133709A1

WO2018133709A1 - Method, device and system for streaming media transmission, server and terminal

Info

Publication number: WO2018133709A1
Application number: PCT/CN2018/071959
Authority: WO
Inventors: 王芳; 黄成�
Original assignee: 中兴通讯股份有限公司
Priority date: 2017-01-20
Filing date: 2018-01-09
Publication date: 2018-07-26
Also published as: CN108337574A

Abstract

Disclosed are a method, device and system for streaming media transmission, a server, a terminal and a storage medium. The method comprises: a server sending attribute information about each content fragment of video content to a terminal; the server receiving a video content request message sent by the terminal, wherein the video content request message comprises at least the following information about each content fragment to be requested: fragment identifier information, priority information and pushing completion time information; the server reading, according to the fragment identifier information, a corresponding content fragment, and sending, according to the priority information, the read content fragment to the terminal; and in the process of sending the content fragment, when it is detected, according to the pushing completion time information, that a target content fragment cannot be sent to the terminal, the server cancelling the sending of the target content fragment.

Description

Stream media transmission method and device, system, server and terminal

Cross-reference to related applications

The present application is based on a Chinese patent application filed on Jan. 20, 2017, the entire disclosure of which is hereby incorporated by reference.

Technical field

The present application relates to the field of streaming media technologies, and in particular, to a streaming video transmission method, device, system, server, terminal, and storage medium for panoramic video.

Background technique

Dynamic Adaptive Streaming over HTTP (DASH) based on HyperText Transfer Protocol (HTTP) is a dynamic adaptive streaming media transmission protocol provided by HTTP. In the DASH protocol, media content is sliced into segments, each of which is typically a few seconds long. The terminal acquires these fragments one by one by sending an HTTP request to the server, and then decodes and plays each fragment. When the duration of the fragment is small, the number of HTTP requests is particularly large, and the transmission efficiency is very low. To this end, there is a full-duplex DASH service. The terminal can request the server to transmit multiple fragments in one HTTP request, thereby reducing the number of HTTP requests, and the server can also continuously send the contents of multiple fragments, thereby avoiding The slow start of the Transmission Control Protocol (TCP) improves the transmission efficiency.

On the other hand, with the rapid development of virtual reality (VR) technology, the application of panoramic video is more and more extensive, which brings a realistic video experience to users. However, under the premise that the effective pixel values in the unit area are the same, the data amount of the panoramic video far exceeds the data amount of the ordinary single-view video. Thus, in the case of online viewing, a higher transmission bandwidth is required, which puts a great deal of pressure on the Content Delivery Networks (CDN).

In order to solve this problem, in the video codec, a tile-based codec technology is introduced. Here, a tile refers to a rectangular area in a frame that can be independently coded and decoded. In this way, the picture of a panoramic video is divided into a plurality of separate areas. The terminal only needs to obtain the video data of the area corresponding to the current viewpoint of the user, and can perform decoding and playback. For each area, multiple code rates can be further encoded so that the user can select the most suitable content according to the different view area, network bandwidth and own decoding capability. For example, for the viewpoint area, the content with the highest definition is selected, for the area around the viewpoint, the medium definition content is selected, and for the content of the blind spot area, the low definition content is selected.

However, when the bandwidth is limited, or the network is congested, or the bandwidth is fluctuating, the content fragments requested by the terminal may still exceed the network bandwidth, causing the user side to play the card. Although the user can send a command to cancel the transmission of some content when the card is detected, when the network congestion occurs, the two-way communication will be affected, which may cause the server side to not receive the command to cancel the content transmission by the user in time.

Summary of the invention

To solve the above technical problem, the embodiment of the present application provides a streaming media transmission method, device, system, server, terminal, and storage medium, which can provide a better video experience for users under limited bandwidth.

The streaming media transmission method provided by the embodiment of the present application includes:

The server sends the attribute information of each content fragment of the video content to the terminal;

The server receives the video content request message sent by the terminal, where the video content request message includes at least the following information of each content slice to be requested: fragment identification information, priority information, and push completion time information;

The server reads the corresponding content fragment according to the fragment identification information, and sends the read content fragment to the terminal according to the priority information;

In the process of the server sending the content fragment, if the target completion content fragment cannot be sent to the terminal according to the push completion time information, the transmission of the target content fragment is cancelled.

In the embodiment of the present application, the attribute information of each content fragment of the video content includes at least one of the following:

The codec area division information of each content slice in the video content, the video quality information supported by each content slice, and the view information of each content slice.

In the embodiment of the present application, the fragment identification information includes: a uniform resource identifier (URI) of the content fragment; or

The fragment identification information includes: area information of the content fragment, and video quality information of the content fragment; or

The slice identification information includes: window information of the content slice, and video quality information of the content slice.

In the embodiment of the present application, the video quality information of the content fragment is at least one of the following:

The bit rate of the content slice, the resolution of the content slice, and the hierarchical information of the content slice.

In the embodiment of the present application, the content fragment that is to be read is sent to the terminal according to the priority information, and includes:

According to the priority information, the read content fragments are sent to the terminal in order of priority from high to low.

In the embodiment of the present application, the method further includes:

In the process of sending the content fragment by the server, detecting an actual transmission rate and/or network status information of the fragmented content;

Determining whether the target content fragment can be successfully sent to the terminal according to the actual transmission rate and/or network status information and the push completion time information.

A streaming media transmission method provided by another embodiment of the present application includes:

The terminal acquires attribute information of each content fragment of the video content from the server;

The terminal determines the content fragment to be received based on the attribute information of each content fragment of the video content, and sends a video content request message to the server based on the content fragment to be received, where the video content request message includes each At least the following information of the content fragment to be received: fragment identification information, priority information, and push completion time information;

Receiving, by the terminal, each content fragment sent by the server according to the priority information, wherein, in the process of receiving the content fragment by the terminal, if the server detects that the target content fragment cannot be sent to the terminal, canceling the target content Fragmentation reception.

In the embodiment of the present application, the terminal determines the content fragment to be received based on the attribute information of each content fragment of the video content, including:

The terminal determines the content fragment to be received based on the attribute information of each content fragment of the video content, and in combination with at least one of the following contents:

Viewpoint information, network bandwidth information, scheduling policy.

In the embodiment of the present application, the fragment identification information includes: a URI of the content fragment; or

In the embodiment of the present application, the terminal receiving, by the server, each content fragment sent according to the priority information includes:

The terminal receives each content fragment sent by the server in descending order of priority.

The streaming media transmission device provided by the embodiment of the present application is applied to the server side, and the device includes:

a sending unit, configured to send attribute information of each content fragment of the video content to the terminal;

a receiving unit, configured to receive a video content request message sent by the terminal, where the video content request message includes at least the following information of each content slice to be requested: fragment identification information, priority information, and push completion time information;

The reading unit is configured to read the corresponding content fragment according to the fragment identification information;

The sending unit is further configured to send the read content slice to the terminal according to the priority information;

And the canceling unit is configured to cancel the sending of the target content fragment when the target content fragment cannot be sent to the terminal according to the push completion time information in the process of sending the content fragment.

In the embodiment of the present application, the sending unit is specifically configured to: send the read content fragments to the terminal in descending order of priority according to the priority information.

In the embodiment of the present application, the device further includes:

a detecting unit, configured to detect an actual transmission rate and/or network status information of the fragmented content during the sending of the content fragment; and determine, according to the actual transmission rate and/or network status information, and the push completion time information Whether the target content fragment can be successfully sent to the terminal.

A streaming media transmission device provided by another embodiment of the present application is applied to a terminal side, and the device includes:

a receiving unit configured to acquire attribute information of each content fragment of the video content from the server;

a determining unit, configured to determine a content slice to be received based on attribute information of each content slice of the video content;

The sending unit is configured to send a video content request message to the server according to the content fragment to be received, where the video content request message includes at least the following information of each content fragment to be received: fragment identification information, priority information , push completion time information;

The receiving unit is further configured to receive, by the server, each content fragment sent according to the priority information, wherein, in the process of receiving the content fragment, if the server detects that the target content fragment cannot be sent to the terminal, Then the reception of the target content slice is cancelled.

In the embodiment of the present application, the determining unit is specifically configured to determine the content fragment to be received based on the attribute information of each content fragment of the video content and combined with at least one of the following contents:

Viewpoint information, network bandwidth information, scheduling policy.

In the embodiment of the present application, the receiving unit is specifically configured to: receive, by the server, each content fragment sent in descending order of priority.

The server provided by the embodiment of the present application includes a processor and a memory, where the computer stores executable instructions, and when the processor executes the computer executable instructions, the processor is configured to execute the stream. Media transfer method.

A terminal provided by an embodiment of the present application includes a processor and a memory, where the computer stores computer executable instructions, and when the processor executes the computer executable instructions, the processor is configured to execute the stream. Media transfer method.

The streaming media transmission system provided by the embodiment of the present application includes the server and the terminal.

The storage medium provided by the embodiment of the present application, wherein the storage medium stores computer executable instructions, and the computer executable instructions are used to execute the streaming media transmission method according to any one of the foregoing embodiments.

In the technical solution of the embodiment of the present application, the server sends the attribute information of each content fragment of the video content to the terminal; the server receives the video content request message sent by the terminal, where the video content request message includes each content slice to be requested. At least the following information: the fragment identification information, the priority information, and the push completion time information; the server reads the corresponding content fragment according to the fragment identification information, and sends the read content fragment to the priority information according to the priority information. And transmitting, in the process of sending the content fragmentation by the server, canceling, according to the pushing completion time information, that the target content fragment cannot be sent to the terminal, canceling the sending of the target content fragment. With the technical solution of the embodiment of the present application, the server can cancel part of the content to be transmitted according to the priority in order to ensure the high-priority content fragmentation, and avoid the terminal side as much as possible. Play Caton.

DRAWINGS

The drawings generally illustrate the various embodiments discussed herein by way of example and not limitation.

1 is a schematic flowchart 1 of a streaming media transmission method according to an embodiment of the present application;

2 is a schematic flowchart 2 of a streaming media transmission method according to an embodiment of the present application;

3 is a schematic diagram of a system according to an embodiment of the present application;

4 is a schematic flowchart 3 of a streaming media transmission method according to an embodiment of the present application;

FIG. 5 is a schematic flowchart 4 of a streaming media transmission method according to an embodiment of the present application;

6 is a schematic diagram 1 of video coding according to an embodiment of the present application;

FIG. 7 is a schematic diagram 1 of selecting a to-be-pushed slice according to a user point of view according to an embodiment of the present application;

FIG. 8 is a second schematic diagram of video coding according to an embodiment of the present application; FIG.

FIG. 9 is a schematic diagram 2 of selecting a to-be-pushed slice according to a user point of view according to an embodiment of the present application;

FIG. 10 is a schematic diagram 3 of selecting a to-be-pushed slice according to a user point of view according to an embodiment of the present application;

11 is a first schematic structural diagram of a streaming media transmission device according to an embodiment of the present application;

FIG. 12 is a second schematic structural diagram of a streaming media transmission apparatus according to an embodiment of the present application.

detailed description

The embodiments of the present application are described in detail with reference to the accompanying drawings.

In the technical solution of the embodiment of the present application, the fragment identification information, the priority information, and the push completion time information of the content fragment to be transmitted are specified in the video content request message, so that the server cannot meet the terminal transmission time requirement. Next, part of the content to be transmitted is cancelled according to the priority, and the transmission of the high-priority content fragments is ensured, and the playback on the terminal side is avoided as much as possible.

1 is a schematic flowchart 1 of a streaming media transmission method according to an embodiment of the present application. The streaming media transmission method in this example is applied to a server side. As shown in FIG. 1 , the streaming media transmission method includes the following steps:

Step 101: The server sends the attribute information of each content fragment of the video content to the terminal.

Step 102: The server receives a video content request message sent by the terminal, where the video content request message includes at least the following information of each content slice to be requested: fragment identification information, priority information, and push completion time information.

Step 103: The server reads the corresponding content fragment according to the fragment identification information, and sends the read content fragment to the terminal according to the priority information; in the process of sending the content fragment by the server, according to the When the push completion time information detects that the target content slice cannot be transmitted to the terminal, the transmission of the target content slice is canceled.

In the embodiment of the present application, the video content may be panoramic video content.

In the above solution, content fragmentation refers to video data that supports independently decoded video regions at different time periods.

In the embodiment of the present application, the method further includes:

2 is a schematic flowchart of a flow media transmission method according to an embodiment of the present disclosure. The streaming media transmission method in this example is applied to a terminal side. As shown in FIG. 2, the streaming media transmission method includes the following steps:

Step 201: The terminal acquires attribute information of each content fragment of the video content from the server.

Step 202: The terminal determines the content fragment to be received based on the attribute information of each content fragment of the video content, and sends a video content request message to the server according to the content fragment to be received, the video content request message. The information includes at least the following information of each content slice to be received: fragment identification information, priority information, and push completion time information.

Step 203: The terminal receives each content fragment sent by the server according to the priority information. In the process of receiving the content fragment, if the server detects that the target content fragment cannot be sent to the terminal, the terminal cancels the The reception of the target content slice.

Viewpoint information, network bandwidth information, scheduling policy.

The streaming media transmission method in this embodiment of the present application is further described in detail below with reference to specific application scenarios.

FIG. 3 is a schematic diagram of a system of an embodiment of the present application. The terminal obtains a description file of the video content from the server side, such as an MPD file in DASH, or an m3u8 file in HTTP Live Streaming (HLS, HTTP Live Streaming). Then, according to the slice content information described therein, as well as the current viewpoint of the user, etc., the slice content that needs to be acquired is determined. These sharded content are then prioritized according to the current viewing strategy. A push request is then sent to the server indicating which shards need to be sent, the priority information of the shards, and the time at which these shards need to be fully delivered to the terminal. See Figure 4 for the specific process. After receiving the push request from the terminal, the server side pushes the fragment according to the priority specified in the request. During the push process, the server calculates the push status of the current slice in real time to determine whether the current slice transfer can be completed in time. After completing the push of a slice, according to the push state of the current slice, it is judged whether the push of the next slice can be completed in time. If the push cannot be completed in time, the push of the corresponding slice is canceled. See Figure 5 for the specific process.

Regarding the use of priority and push time under different viewing strategies, the following describes by way of specific embodiments.

In one embodiment, the content is encoded in a partitioned layer, as shown in FIG. Different Tile partitions correspond to different perspectives/spaces. Different layers correspond to different video qualities. For example, the base layer 401 is a panoramic video with the lowest resolution, and one frame corresponds to a complete panoramic image, that is, there is only one Tile partition, and the number is 4011. Two enhancement layers are provided. The first enhancement layer 402 provides a medium resolution panoramic video based on the base layer, and uses a tile-based codec technology to divide a panoramic video into multiple independent regions, for example, Numbers 4021 ~ 4023 are just a few of them. The second enhancement layer 403 provides high-resolution panoramic video on the basis of the first enhancement layer, and also uses a tile-based codec technology to divide a panoramic video into multiple independent regions. For example, number 4031 is one of them. The video of each Tile partition of each bit rate is divided into segments of a fixed time period according to the playback period, for example, one slice every 2 seconds. For convenience of description, it is agreed that for a certain playback time T, a layer, and a tile partition of a Tile partition, the following rules are used to identify each fragment: "layered identifier/Tile number/play time". The layered identifiers are layer0, layer1, and layer2 for the base layer, the first enhancement layer, and the second enhancement layer. For example, the tile with the first enhancement layer number 4021 and the tile at the T0 time have the identifier of layer1/4021/T0. Relevant information is recorded in the description file of the content.

As shown in FIG. 7, the terminal determines the viewpoint area 5A, the viewpoint edge area 5B, and the blind spot area 5C based on the current user viewpoint. And determining the content fragment to be acquired and the corresponding priority according to the related information recorded in the content description file and the current viewing policy. For example, in this embodiment, the viewing policy is to preferentially ensure that the user does not have a black screen when the viewpoint is changed. Then, as shown in FIG. 7, the highest priority should be the 501 partition of the base layer corresponding to the 5C area (corresponding to 4011 in FIG. 6). The fragment is preferentially transmitted to ensure that a panoramic video can be obtained on the terminal side. No matter how the user switches the viewpoint, the corresponding video can be decoded according to the panoramic video, and no black screen appears. The next highest priority is the

partitions

503, 504, 505 corresponding to the viewpoint edge region 5B in the first enhancement layer (corresponding to 4021, 4022, 4023 of FIG. 6). When the terminal superimposes the slice of the first enhancement layer and the video data of the base layer, the terminal can provide the user with a medium resolution image. The lowest priority is the slice corresponding to the view area 5A in the second enhancement layer, that is, 502 (corresponding to 4031 of FIG. 6). When the terminal superimposes the second enhancement layer with the video data of the first enhancement layer and the base layer, the user can provide a high resolution image for the user.

In the push request submitted by the terminal to the server, the content of the slice that needs to be pulled down in this cycle is specified, that is, the content to be played in the next cycle. For example, at time T0, the terminal submits to the server the fragmentation instruction that needs to be pushed before the T1 cycle, and it is necessary to specify the fragmentation, priority, and delivery time information as shown in Table 1 below.

Table 1

After receiving the push request sent by the terminal, the server sorts the requested fragments according to the priority at time T0. Transfer from high to low. After the start time of T1 is reached, the fragment that has not been transmitted is discarded, and the terminal is notified that the relevant fragment has been canceled.

In another embodiment, the content encoding is the same as in the previous embodiment. However, in the push request sent by the terminal, only the required window information, video quality (here, hierarchical information) and corresponding priority are specified according to the current viewpoint. That is, the push instruction submitted by the terminal to the server needs to specify the information shown in Table 2 below, wherein the push completion time is empty, indicating that the server needs to push the content of the current window until the new window push command is received.

视窗信息Window information	分层信息Hierarchical information	推送完成时间Push completion time	优先级priority

视窗5A的标识信息Windows 5A identification information	layer2Layer2	--	低 low

视窗5B的标识信息Windows 5B identification information	layer1Layer1	--	中in
视窗5C的标识信息 Windows 5C identification information	layer0Layer0	--	高high

Table 2

The identification information of the window is used to indicate the direction and range of the window, which can be:

1) The azimuth and elevation angle of the center point of the VR video window in the VR video spherical coordinate system. Plus the width and height information of the VR video window. or,

2) The four sides of the VR video window correspond to the left and right azimuths and the up and down pitch angles in the VR video spherical coordinate system.

The given window identification information, corresponding to the window range, needs to cover the corresponding target Tile partition in the panoramic video.

After receiving the push command, the server needs to obtain the corresponding fragment according to the related information in the content description file, and push the fragment of the corresponding window to the terminal according to the priority. For example, if the bandwidth is sufficient, the contents of the above three windows are pushed to the terminal. In the case of insufficient bandwidth, the content push from part of the window is discarded according to the priority from low to high.

In another embodiment, the content is partitioned plus multi-rate encoded. As shown in Figure 8. A low bit rate 601, a medium bit rate 602, and a high bit rate 603 video are provided, all using tile-based partition codec technology. For each bit rate, its panoramic picture is divided into 18 Tile partitions. For the convenience of the following description, these tiles are numbered in the figure, which are 1-18. The video of each Tile partition of each bit rate is divided into segments of a fixed time period according to the playing period, for example, one slice every 10 seconds. For convenience of description, the following rules are used to identify each fragment for a certain playback period T, a certain code rate, and a tile partition: "code rate identification/Tile number/play period". The code rate flag is high, medium, and low code rate, and the values are high, mid, and low, respectively. For example, in the T0 cycle, the low bit rate, and the slice of the sixth tile, the identifier is low/6/T0. Relevant information is recorded in the description file of the content.

In this embodiment, the viewing viewpoint belongs to the content director pre-specified, and the user cannot or rarely actively switches the viewpoint, such as a live broadcast. Therefore, the viewing strategy is to prioritize the video quality of the user's viewpoint area. As shown in FIG. 9, the image in the viewpoint area 701 is required to be the clearest, the image in the viewpoint edge area 702 is sub-clear, and the other areas other than the blind spot area are required to be the lowest. Therefore, the 7A area needs to obtain the fragment of the high bit rate content, that is, the fragment corresponding to the partition of 603 in FIG. These content have the highest priority. The second highest priority is the shard corresponding to the 7B area in the medium code rate content. The lowest priority is the fragmentation corresponding to the 7C area in the low bit rate content. For example, at time T0, the terminal knows that the user's viewpoint at time T1 is 701, and the terminal submits the fragmentation instruction that the server needs to push before the T1 period, and needs to specify the fragment and priority as shown in Table 3 below. Time and other information.

table 3

In another embodiment, the terminal specifies the content of the subsequent several playback periods in one push request. For the sake of simplicity, there is no multi-rate or hierarchical coding method, and only a panoramic video with a single code rate is taken as an example. And only distinguish between the view area and the non-view area. As shown in Figure 10, the coding still uses tile-based partition coding and decoding techniques. A panoramic picture is divided into 15 Tile partitions. For the convenience of the following description, these tiles are numbered in the figure, which are 1-15. The video of each Tile partition is divided into segments of a fixed time period according to the playback period, for example, one slice every 10 seconds. For the convenience of description, for a certain playback period T, a tile partition of a Tile partition, the following rules are used to identify each fragment: Tile number/play cycle. For example, in the T0 cycle, the slice of the sixth tile, its identifier is 6/T0.

In this example, the viewpoint will also switch from 801 to 802. Wherein, in the first period T1, the viewpoint is at 801, and the Tile partition number of the corresponding viewpoint area is 7. The second period T2, the viewpoint is at 802, and the Tile partition number corresponding to the viewpoint area is 9. Therefore, in the push request submitted by the terminal to the server, the content of the slice that needs to be pulled down in the next two cycles, and the corresponding push completion time and priority are specified. As shown in Table 4 below.

Table 4

In the push completion time, you can use relative time or absolute time. The priority is as described in the previous embodiments, depending on the viewing strategy of the user.

After receiving the push request sent by the terminal at the time T0, the server first pushes the fragment in the T1 period. For multiple shards, sort by priority. After reaching the start time of T1, the fragment that has not been transmitted in the period is discarded, and the terminal is notified that the relevant fragment has been canceled. The server then begins to push the shards within the T2 period by priority.

FIG. 4 is a schematic flowchart 3 of a streaming media transmission method according to an embodiment of the present disclosure. As shown in FIG. 4, the streaming media transmission method includes the following steps:

Step 401: The terminal determines a current user viewpoint.

Step 402: The terminal determines a current region of interest, a common region, and a region of no interest.

Step 403: The terminal determines, according to the content description file, a current period, a fragmentation parameter of the local video that needs to be acquired in the different area.

Step 404: The terminal combines the shards according to different priorities according to a predetermined policy, sends a push request to the server, and carries parameters such as a content priority and a completion transmission time in the request.

Step 405: The terminal receives the fragment pushed by the server according to the request.

Step 406: The terminal merges and renders the received fragments to form a panoramic video in the next cycle, and performs step 401.

FIG. 5 is a schematic flowchart diagram of a streaming media transmission method according to an embodiment of the present disclosure. As shown in FIG. 5, the streaming media transmission method includes the following steps:

Step 501: The server side receives the push request of the terminal.

Step 502: The server side parses out the fragmentation information to be pushed in the request, and the corresponding priority, the time of completing the transmission, and the like.

Step 503: The server starts to push the slice according to a given priority, from high to low.

Step 504: During the fragment push process, the current push rate is calculated.

Step 505: Each time a slice is pushed, it is evaluated whether the next slice to be pushed can be sent to the terminal within a predetermined completion transmission time according to the calculated actual push rate. If yes, the push of the next slice is started, otherwise the push of the next slice is canceled; step 501 is performed.

FIG. 11 is a schematic structural diagram of a structure of a streaming media transmission device according to an embodiment of the present application, applied to a server side, where the device includes:

The sending unit 1101 is configured to send attribute information of each content fragment of the video content to the terminal;

The receiving unit 1102 is configured to receive a video content request message sent by the terminal, where the video content request message includes at least the following information of each content slice to be requested: fragment identification information, priority information, and push completion time information;

The reading unit 1103 is configured to read the corresponding content fragment according to the fragment identification information;

The sending unit 1101 is further configured to send the read content slice to the terminal according to the priority information;

The canceling unit 1104 is configured to cancel the sending of the target content fragment when the target content fragment cannot be transmitted to the terminal according to the push completion time information in the process of transmitting the content fragment.

In the embodiment of the present application, the sending unit 1101 is configured to send the read content fragments to the terminal in descending order of priority according to the priority information.

In the embodiment of the present application, the device further includes:

The detecting unit 1105 is configured to detect an actual transmission rate and/or network status information of the fragmented content during the sending of the content fragment; according to the actual transmission rate and/or network status information, and push completion time information Determine whether the target content fragment can be successfully sent to the terminal.

Those skilled in the art should understand that the implementation functions of the units in the streaming media transmission apparatus shown in FIG. 11 can be understood by referring to the related description of the foregoing streaming media transmission method. The functions of the units in the streaming media transmission device shown in FIG. 11 can be realized by a program running on a processor, or can be realized by a specific logic circuit.

The embodiment of the present application further provides a server, where the server includes a processor and a memory, where the computer stores executable instructions, and when the processor executes the computer executable instructions, the processor is configured to execute The streaming media transmission method described in FIG.

FIG. 12 is a schematic structural diagram of a structure of a streaming media transmission device according to an embodiment of the present application, applied to a terminal side, where the device includes:

The receiving unit 1201 is configured to acquire attribute information of each content slice of the video content from the server;

The determining unit 1202 is configured to determine, according to attribute information of each content slice of the video content, a content slice to be received;

The sending unit 1203 is configured to send a video content request message to the server according to the content fragment to be received, where the video content request message includes at least the following information of each content fragment to be received: fragment identification information, priority Information, push completion time information;

The receiving unit 1201 is further configured to receive, by the server, each content fragment sent according to the priority information, wherein, in the process of receiving the content fragment, if the server detects that the target content fragment cannot be sent to the terminal , the reception of the target content slice is cancelled.

In the embodiment of the present application, the determining unit 1202 is specifically configured to: determine the content fragment to be received based on the attribute information of each content fragment of the video content, and in combination with at least one of the following contents:

Viewpoint information, network bandwidth information, scheduling policy.

In the embodiment of the present application, the receiving unit 1201 is specifically configured to: receive, by the server, each content fragment sent in descending order of priority.

It should be understood by those skilled in the art that the implementation functions of the units in the streaming media transmission apparatus shown in FIG. 12 can be understood by referring to the related description of the foregoing streaming media transmission method. The functions of the units in the streaming media transmission device shown in FIG. 12 can be realized by a program running on the processor, or can be realized by a specific logic circuit.

The embodiment of the present application further provides a terminal, where the terminal includes a processor and a memory, where the computer stores computer executable instructions, and when the processor executes the computer executable instructions, the processor is configured to The streaming media transmission method described in FIG. 2 is performed.

In addition, the embodiment of the present application further provides a streaming media transmission system, where the system includes a server and a terminal, wherein the server is configured to execute the streaming media transmission system described in FIG. 1 , and the terminal is configured to perform the streaming media transmission described in FIG. 2 . method.

Those skilled in the art will appreciate that embodiments of the present application can be provided as a method, system, or computer program product. Accordingly, the application can take the form of a hardware embodiment, a software embodiment, or an embodiment in combination with software and hardware. Moreover, the application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) including computer usable program code.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the present application. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

The above is only the preferred embodiment of the present application, and is not intended to limit the scope of the present application.

Industrial applicability

In the embodiment of the present application, the server sends the attribute information of each content fragment of the video content to the terminal; the server receives the video content request message sent by the terminal, where the video content request message includes at least the content slice to be requested at least as follows Information: the fragment identification information, the priority information, and the push completion time information; the server reads the corresponding content fragment according to the fragment identification information, and sends the read content fragment to the terminal according to the priority information; When the server sends the content fragment, if the target completion content fragment cannot be sent to the terminal according to the push completion time information, the transmission of the target content fragment is cancelled. Therefore, in the case that the server cannot meet the terminal transmission time requirement, part of the content to be transmitted can be cancelled according to the priority, so as to ensure high-priority content fragment transmission, and avoid the terminal-side playback jam as much as possible.

Claims

A streaming media transmission method, the method comprising:

The server sends the attribute information of each content fragment of the video content to the terminal;

The server receives the video content request message sent by the terminal, where the video content request message includes at least the following information of each content slice to be requested: fragment identification information, priority information, and push completion time information;

The server reads the corresponding content fragment according to the fragment identification information, and sends the read content fragment to the terminal according to the priority information;

In the process of the server sending the content fragment, if the target completion content fragment cannot be sent to the terminal according to the push completion time information, the transmission of the target content fragment is cancelled.
The streaming media transmission method according to claim 1, wherein the attribute information of each content slice of the video content comprises at least one of the following:

The codec area division information of each content slice in the video content, the video quality information supported by each content slice, and the view information of each content slice.
The streaming media transmission method according to claim 1, wherein

The fragment identification information includes: a uniform resource identifier URI of the content fragment; or

The fragment identification information includes: area information of the content fragment, and video quality information of the content fragment; or

The slice identification information includes: window information of the content slice, and video quality information of the content slice.
The streaming media transmission method according to claim 3, wherein the video quality information of the content segmentation is at least one of the following:

The bit rate of the content slice, the resolution of the content slice, and the hierarchical information of the content slice.
The streaming media transmission method according to claim 1, wherein the transmitting the read content fragment to the terminal according to the priority information comprises:

According to the priority information, the read content fragments are sent to the terminal in order of priority from high to low.
The streaming media transmission method according to claim 1, wherein the method further comprises:

In the process of sending the content fragment by the server, detecting an actual transmission rate and/or network status information of the fragmented content;

Determining whether the target content fragment can be successfully sent to the terminal according to the actual transmission rate and/or network status information and the push completion time information.
A streaming media transmission method, the method comprising:

The terminal acquires attribute information of each content fragment of the video content from the server;

The terminal determines the content fragment to be received based on the attribute information of each content fragment of the video content, and sends a video content request message to the server based on the content fragment to be received, where the video content request message includes each At least the following information of the content fragment to be received: fragment identification information, priority information, and push completion time information;

Receiving, by the terminal, each content fragment sent by the server according to the priority information, wherein, in the process of receiving the content fragment by the terminal, if the server detects that the target content fragment cannot be sent to the terminal, canceling the target content Fragmentation reception.
The streaming media transmission method according to claim 7, wherein the terminal determines the content fragment to be received based on the attribute information of each content fragment of the video content, including:

The terminal determines the content fragment to be received based on the attribute information of each content fragment of the video content, and in combination with at least one of the following contents:

Viewpoint information, network bandwidth information, scheduling policy.
The streaming media transmission method according to claim 7, wherein the attribute information of each content slice of the video content comprises at least one of the following:

The codec area division information of each content slice in the video content, the video quality information supported by each content slice, and the view information of each content slice.
The streaming media transmission method according to claim 7, wherein

The fragment identification information includes: a URI of the content fragment; or

The fragment identification information includes: area information of the content fragment, and video quality information of the content fragment; or

The slice identification information includes: window information of the content slice, and video quality information of the content slice.
The streaming media transmission method according to claim 10, wherein the content quality of the content segmentation is at least one of the following:

The bit rate of the content slice, the resolution of the content slice, and the hierarchical information of the content slice.
The streaming media transmission method according to claim 7, wherein the terminal receiving each content fragment sent by the server according to the priority information comprises:

The terminal receives each content fragment sent by the server in descending order of priority.
A streaming media transmission device, the device comprising:

a sending unit, configured to send attribute information of each content fragment of the video content to the terminal;

a receiving unit, configured to receive a video content request message sent by the terminal, where the video content request message includes at least the following information of each content slice to be requested: fragment identification information, priority information, and push completion time information;

The reading unit is configured to read the corresponding content fragment according to the fragment identification information;

The sending unit is further configured to send the read content slice to the terminal according to the priority information;

And the canceling unit is configured to cancel the sending of the target content fragment when the target content fragment cannot be sent to the terminal according to the push completion time information in the process of sending the content fragment.
The streaming media transmission device according to claim 13, wherein the attribute information of each content slice of the video content comprises at least one of the following:

The codec area division information of each content slice in the video content, the video quality information supported by each content slice, and the view information of each content slice.
The streaming media transmission device according to claim 13, wherein

The fragment identification information includes: a URI of the content fragment; or

The fragment identification information includes: area information of the content fragment, and video quality information of the content fragment; or

The slice identification information includes: window information of the content slice, and video quality information of the content slice.
The streaming media transmission device according to claim 15, wherein the content quality of the content segmentation is at least one of the following:

The bit rate of the content slice, the resolution of the content slice, and the hierarchical information of the content slice.
The streaming media transmission device according to claim 13, wherein the transmitting unit is configured to: send the read content fragments to the terminal in descending order of priority according to the priority information.
The streaming media transmission device of claim 13, wherein the device further comprises:

a detecting unit, configured to detect an actual transmission rate and/or network status information of the fragmented content during the sending of the content fragment; and determine, according to the actual transmission rate and/or network status information, and the push completion time information Whether the target content fragment can be successfully sent to the terminal.
A streaming media transmission device, the device comprising:

a receiving unit configured to acquire attribute information of each content fragment of the video content from the server;

a determining unit, configured to determine a content slice to be received based on attribute information of each content slice of the video content;

The sending unit is configured to send a video content request message to the server according to the content fragment to be received, where the video content request message includes at least the following information of each content fragment to be received: fragment identification information, priority information , push completion time information;

The receiving unit is further configured to receive, by the server, each content fragment sent according to the priority information, wherein, in the process of receiving the content fragment, if the server detects that the target content fragment cannot be sent to the terminal, Then the reception of the target content slice is cancelled.
The streaming media transmission device according to claim 19, wherein the determining unit is configured to: determine, based on attribute information of each content segment of the video content, in combination with at least one of the following contents, Content fragmentation:

Viewpoint information, network bandwidth information, scheduling policy.
The streaming media transmission device according to claim 19, wherein the attribute information of each content slice of the video content comprises at least one of the following:

The codec area division information of each content slice in the video content, the video quality information supported by each content slice, and the view information of each content slice.
The streaming media transmission device according to claim 19, wherein

The fragment identification information includes: a URI of the content fragment; or

The fragment identification information includes: area information of the content fragment, and video quality information of the content fragment; or

The slice identification information includes: window information of the content slice, and video quality information of the content slice.
The streaming media transmission device according to claim 22, wherein the content quality of the content segmentation is at least one of the following:

The bit rate of the content slice, the resolution of the content slice, and the hierarchical information of the content slice.
The streaming media transmission device according to claim 19, wherein the receiving unit is specifically configured to: receive each content fragment sent by the server in descending order of priority.
A server comprising a processor and a memory, the memory storing computer executable instructions, the processor being configured to perform claims 1-6 when the processor executes the computer executable instructions A streaming media transmission method as claimed in any of the preceding claims.
A terminal, the terminal comprising a processor and a memory, the memory storing computer executable instructions, the processor being configured to perform the claims 7-12 when the processor executes the computer executable instructions A streaming media transmission method as claimed in any of the preceding claims.
A streaming media transmission system, the system comprising the server of claim 25 and the terminal of claim 26.
A storage medium storing computer executable instructions for performing the streaming media transmission method according to any one of claims 1 to 6 and 7 to 12.