CN108574882A

CN108574882A - A kind of video transmission method and device

Info

Publication number: CN108574882A
Application number: CN201710140922.6A
Authority: CN
Inventors: 周川
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2017-03-08
Filing date: 2017-03-08
Publication date: 2018-09-25
Anticipated expiration: 2037-03-08
Also published as: CN108574882B; WO2018161790A1

Abstract

The embodiment of the present application discloses a kind of video transmission method and device, is related to transmission technique field, to save transfer resource and cache resources.The video includes main coding stream and auxiliary encoding stream, and auxiliary encoding stream is used to improve the code check of chief editor's code stream, and chief editor's code stream includes at least two mainstream fragments, and auxiliary encoding stream includes at least two secondary flow fragments, and each mainstream fragment is corresponding with a secondary flow fragment.This method includes：The first mainstream fragment request is sent to server, wherein for the first mainstream fragment request for asking the first mainstream fragment, the first mainstream fragment is a mainstream fragment at least two mainstream fragments；Receive the first mainstream fragment that server is sent；If current real-time network situation meets preset condition, the first secondary flow fragment request is sent to server, wherein the first secondary flow fragment request is for asking the corresponding first secondary flow fragment of the first mainstream fragment；Receive the first secondary flow fragment that server is sent.

Description

A kind of video transmission method and device

Technical field

This application involves transmission technique field more particularly to a kind of video transmission methods and device.

Background technology

HLS (HTTP live streaming) is to be based on hypertext transfer protocol (hyper text transfer Protocol, HTTP) a kind of Streaming transfer protocol, it can be achieved that Streaming Media live streaming and program request.In HLS program request scenes, Server encodes video content, obtains multiple video files of different code checks, then according to the time by multiple video Each video file in file is divided into multiple fragments.When terminal needs to play video, according to reproduction time and current network shape The fragment that condition request needs, and the fragment asked is cached, decoded and played.

In HLS technologies, when the requested fragment of terminal is switched to high code check from low bit- rate, caches but do not played low Code check fragment can be ineffective, to cause the waste of transfer resource and cache resources.

Invention content

A kind of video transmission method of the embodiment of the present application offer and device, to save transfer resource and cache resources.

In a first aspect, providing a kind of video transmission method, which includes main coding stream and auxiliary encoding stream, and auxiliary encoding stream is used In the code check for improving chief editor's code stream, chief editor's code stream includes at least two mainstream fragments, and auxiliary encoding stream includes at least two secondary flows point Piece, each mainstream fragment are corresponding with a secondary flow fragment.This method includes：Terminal to server sends the first mainstream fragment and asks It asks, wherein for the first mainstream fragment request for asking the first mainstream fragment, the first mainstream fragment is at least two mainstream fragments A mainstream fragment；Receive the first mainstream fragment that server is sent；If current real-time network situation meets preset condition, The first secondary flow fragment request is sent to server, wherein the first secondary flow fragment request is corresponding for asking the first mainstream fragment First secondary flow fragment；Receive the first secondary flow fragment that server is sent.In the technical solution, terminal request mainstream fragment, and press It need to ask secondary flow fragment；Wherein, secondary flow fragment is used to improve the code check of mainstream fragment.Due in the embodiment of the present application, editing Code stream can be played individually, alternatively, chief editor's code stream plays after being superimposed reconstruct with auxiliary encoding stream, therefore the chief editor's code stream cached is not It can be ineffective because caching auxiliary encoding stream.Compared with prior art, transfer resource and cache resources can be saved.

Optionally, pass through HTTP/2 protocol communications between terminal and server.The server can support HTTP/2 associations Any one server of view, such as can be WEB server.

In one possible implementation, this method can also include：Terminal is by the first mainstream fragment and the first secondary flow Fragment is superimposed and reconstructs, and plays the code stream generated after reconstruct.In such manner, it is possible to improve video playing quality.

In one possible implementation, terminal receives the first mainstream fragment that server is sent, and may include：One Chain road receives the first mainstream fragment that server is sent, wherein the link can be any bar between terminal and server Link.In this case, the first secondary flow fragment that above-mentioned reception server is sent, including：Receive what server was sent on the link First secondary flow fragment.In this way, terminal and server only needs to safeguard a link, therefore realize simple.

In one possible implementation, this method can also include：Terminal to server sends the second mainstream fragment Request, wherein for the second mainstream fragment request for asking the second mainstream fragment, the second mainstream fragment is at least two mainstream fragments In a mainstream fragment in addition to the first mainstream fragment；Receive the second mainstream fragment that server is sent；If current real-time Network status meets preset condition, then sends the second secondary flow fragment request to server, wherein the second secondary flow fragment request is used for Ask the corresponding second secondary flow fragment of the second mainstream fragment；If after sending the second secondary flow fragment request to server and receiving It to before the second secondary flow fragment, detects that current real-time network situation is unsatisfactory for preset condition, then sends to interrupt to server and ask It asks, wherein the transfer process that interrupt requests are used to ask to interrupt the second secondary flow fragment.In such manner, it is possible to reduce to a certain extent Terminal obtains next mainstream fragment of the second mainstream fragment, to interim card occur during effective less terminal plays video The phenomenon that generation.It should be understood that the possible realization method can independent of any technical solution provided above, and It is individually performed, in this way, the second mainstream fragment has wilfulness.

Second aspect provides a kind of video transmission method, which includes main coding stream and auxiliary encoding stream, edits stream packet At least two mainstream fragments are included, auxiliary encoding stream includes at least two secondary flow fragments, each mainstream fragment and a secondary flow fragment pair It answers；This method may include：The first mainstream fragment request that server receiving terminal is sent, wherein the first mainstream fragment request For asking the first mainstream fragment, the first mainstream fragment is a mainstream fragment at least two mainstream fragments；It is sent out to terminal Send the first mainstream fragment；Receive the first secondary flow fragment request that terminal is sent, wherein the first secondary flow fragment request is for asking the The corresponding first secondary flow fragment of one mainstream fragment；First secondary flow fragment request is that terminal meets preset condition in current network conditions In the case of send；The first secondary flow fragment is sent to terminal.

In one possible implementation, the first mainstream fragment is sent to terminal, may include：To end on a chain road End sends the first mainstream fragment.In this case, sending the first secondary flow fragment to terminal, may include：On the link to terminal Send the first secondary flow fragment.

In one possible implementation, the priority of mainstream fragment is higher than the corresponding secondary flow fragment of the mainstream fragment Priority.In this case, sending the first secondary flow fragment to terminal, may include：If it is determined that sending the first mainstream point to terminal Piece then sends the first secondary flow fragment to terminal.In such manner, it is possible to ensure that mainstream fragment can be with prioritised transmission, to ensure mainstream point The broadcasting continuity of piece.

In one possible implementation, this method can also include：The second mainstream that server receiving terminal is sent Fragment request, wherein for the second mainstream fragment request for asking the second mainstream fragment, the second mainstream fragment is at least two mainstreams A mainstream fragment in addition to the first mainstream fragment in fragment；The second mainstream fragment is sent to terminal；Terminal is received to send The second secondary flow fragment request, wherein the second secondary flow fragment request is for asking the second mainstream fragment corresponding second secondary flow point Piece；If before sending the second secondary flow fragment request to terminal, the interrupt requests of terminal transmission are received, then interrupt the second secondary flow The transfer process of fragment.It should be understood that the possible realization method can independent of any technical solution provided above, But be individually performed, in this way, the second mainstream fragment has wilfulness.

The advantageous effect for the technical solution that any possible realization method of second aspect or second aspect provides To refer to above-mentioned first aspect or the possible realization method of first aspect, details are not described herein again.

The third aspect provides a kind of terminal, and video includes main coding stream and auxiliary encoding stream, and auxiliary encoding stream is edited for improving The code check of code stream, chief editor's code stream include at least two mainstream fragments, and auxiliary encoding stream includes at least two secondary flow fragments, each mainstream Fragment is corresponding with a secondary flow fragment.The terminal may include：Transmission unit and receiving unit.Wherein, transmission unit, for Server sends the first mainstream fragment request, wherein the first mainstream fragment request is for asking the first mainstream fragment, the first mainstream Fragment is a mainstream fragment at least two mainstream fragments.Receiving unit, the first mainstream for receiving server transmission Fragment.Transmission unit is additionally operable to, if current real-time network situation meets preset condition, the first secondary flow fragment is sent to server Request, wherein the first secondary flow fragment request is for asking the corresponding first secondary flow fragment of the first mainstream fragment.Receiving unit is also used In the first secondary flow fragment that reception server is sent.

In one possible implementation, which can also include：Reconfiguration unit and broadcast unit.Wherein, it reconstructs Unit, for the first mainstream fragment and the first secondary flow fragment to be superimposed and reconstruct.Broadcast unit, for being generated after playing reconstruct Code stream.

In one possible implementation, receiving unit is specifically used for, and server is sent the is received on a chain road One mainstream fragment；The first secondary flow fragment that server is sent is received on the link.

In one possible implementation, transmission unit can be also used for, and sending the second mainstream fragment to server asks It asks, wherein for the second mainstream fragment request for asking the second mainstream fragment, the second mainstream fragment is at least two mainstream fragments A mainstream fragment in addition to the first mainstream fragment.Receiving unit can be also used for, and receive the second master that server is sent Flow fragmentation.Transmission unit can be also used for, if current real-time network situation meets preset condition, it is auxiliary to send second to server Flow fragmentation is asked, wherein the second secondary flow fragment request is for asking the corresponding second secondary flow fragment of the second mainstream fragment.It sends single Member can be also used for, if after sending the second secondary flow fragment request to server and before receiving the second secondary flow fragment, inspection It measures current real-time network situation and is unsatisfactory for preset condition, then send interrupt requests to server, wherein interrupt requests are for asking Seek the transfer process for interrupting the second secondary flow fragment.

Fourth aspect provides a kind of server, and video includes main coding stream and auxiliary encoding stream, and chief editor's code stream includes at least two A mainstream fragment, auxiliary encoding stream include at least two secondary flow fragments, and each mainstream fragment is corresponding with a secondary flow fragment.The service Device may include：Receiving unit and transmission unit.Wherein, receiving unit, the first mainstream fragment for receiving terminal transmission are asked It asks, wherein for the first mainstream fragment request for asking the first mainstream fragment, the first mainstream fragment is at least two mainstream fragments A mainstream fragment.Transmission unit, for sending the first mainstream fragment to terminal.Receiving unit is additionally operable to, and receives terminal hair The the first secondary flow fragment request sent, wherein the first secondary flow fragment request is for asking corresponding first secondary flow of the first mainstream fragment Fragment；First secondary flow fragment request is that terminal is sent in the case where current network conditions meet preset condition.Transmission unit It is additionally operable to, the first secondary flow fragment is sent to terminal.

In one possible implementation, transmission unit is specifically used for：On a chain road the first mainstream is sent to terminal Fragment；On the link the first secondary flow fragment is sent to terminal.

In one possible implementation, the priority of mainstream fragment is higher than the corresponding secondary flow fragment of the mainstream fragment Priority；In this case, transmission unit is specifically used for：If it is determined that sending the first mainstream fragment to terminal, then sent to terminal First secondary flow fragment.

In one possible implementation, receiving unit is additionally operable to, and receives the second mainstream fragment request that terminal is sent, Wherein, for the second mainstream fragment request for asking the second mainstream fragment, the second mainstream fragment is at least two mainstream fragments A mainstream fragment in addition to the first mainstream fragment.Transmission unit is additionally operable to, and the second mainstream fragment is sent to terminal.It receives single Member is additionally operable to, and receives the second secondary flow fragment request that terminal is sent, wherein the second secondary flow fragment request is for asking the second mainstream The corresponding second secondary flow fragment of fragment.Receiving unit is additionally operable to, and receives the interrupt requests that terminal is sent.The server can also wrap It includes：Interrupt location, if for before transmission unit sends the second secondary flow fragment request to terminal, receiving unit receives terminal The interrupt requests of transmission then interrupt the transfer process of the second secondary flow fragment.

Optionally, the interrupt requests in first aspect to fourth aspect above may include：RST_STREM in HTTP/2 Frame.In addition, interrupt requests can also be a kind of newly-designed frame, or can be multiplexed other frames provided in the prior art, this Apply embodiment to this without limiting.

5th aspect, provides a kind of terminal, which has the function of realizing terminal behavior in above method embodiment.It should Function can also execute corresponding software realization by hardware realization by hardware.The hardware or software include one or Multiple modules corresponding with above-mentioned function.

In one possible implementation, which may include：Processor, memory, communication bus and communication connect Mouthful；Wherein, for storing computer executed instructions, processor is connect with memory by communication bus memory, when terminal is transported When row, processor executes the computer executed instructions of memory storage, so that terminal executes above-mentioned first aspect or first aspect Any realization method provide video transmission method.

6th aspect, provides a kind of computer readable storage medium, soft for being stored as computer used in above-mentioned terminal Part instructs, when run on a computer so that computer can execute the transmission of video of any one of above-mentioned first aspect Method.

7th aspect provides a kind of computer program product including instruction, when run on a computer so that meter Calculation machine can execute the video transmission method of any one of above-mentioned first aspect.

In addition, technique effect caused by any design method can join in the third aspect, the 5th aspect and the 6th aspect See technique effect caused by different designs mode in first aspect, details are not described herein again.

Eighth aspect provides a kind of server, which has server behavior in above method embodiment of realizing Function.The function can also execute corresponding software realization by hardware realization by hardware.The hardware or software include One or more modules corresponding with above-mentioned function.

In one possible implementation, which may include：Processor, memory, communication bus and communication Interface.Wherein, for storing computer executed instructions, processor is connect with memory by communication bus memory, works as service When device is run, processor executes the computer executed instructions of memory storage, so that server executes above-mentioned second aspect or the The video transmission method that any realization method of two aspects provides.

9th aspect, provides a kind of computer readable storage medium, the computer for being stored as used in above-mentioned server Software instruction, when run on a computer so that the video that computer can execute any one of above-mentioned second aspect passes Transmission method.

Tenth aspect provides a kind of computer program product including instruction, when run on a computer so that meter Calculation machine can execute the video transmission method of any one of above-mentioned second aspect.

In addition, technique effect caused by any design method can join in fourth aspect, the 9th aspect and the tenth aspect See technique effect caused by different designs mode in first aspect, details are not described herein again.

Description of the drawings

A kind of schematic diagram for system architecture that Fig. 1 is applicable in by technical solution provided by the embodiments of the present application；

Fig. 2 is a kind of structural schematic diagram of encoder server provided by the embodiments of the present application；

Fig. 3 is a kind of structural schematic diagram of transmission server provided by the embodiments of the present application；

Fig. 4 is a kind of structural schematic diagram of terminal provided by the embodiments of the present application；

Fig. 5 is a kind of interaction schematic diagram of video transmission method provided by the embodiments of the present application；

Fig. 6 is the interaction schematic diagram of another video transmission method provided by the embodiments of the present application；

Fig. 7 is a kind of flow diagram of video transmission method provided by the embodiments of the present application；

Fig. 8 is a kind of flow diagram playing video provided by the embodiments of the present application；

Fig. 9 is the interaction schematic diagram of another video transmission method provided by the embodiments of the present application；

Figure 10 is the structural schematic diagram of another terminal provided by the embodiments of the present application；

Figure 11 is the structural schematic diagram of another server provided by the embodiments of the present application.

Specific implementation mode

In HLS technologies, when the requested fragment of terminal is switched to high code check from low bit- rate, caches but do not played low Code check fragment can be ineffective, to cause the waste of transfer resource and cache resources.For example, it is assumed that terminal has requested that and caches Low bit- rate fragment 1~10, and it is currently played fragment 5；If terminal detects current network conditions when playing fragment 5 Preferably, then the fragment 6 of high code check can be asked to server, in this way, the fragment 6 for the low bit- rate for having cached but not played can lose Effect, to cause the waste of transfer resource and cache resources.

Based on this, the embodiment of the present application provides a kind of video transmission method and device, basic principle are：Terminal request Mainstream fragment, and on-demand request secondary flow fragment；Wherein, secondary flow fragment is used to improve the code check of mainstream fragment.In the prior art, no Fragment with the same content of code check is individually present, individual transmission and selects a broadcasting.And in the application, the effect of auxiliary encoding stream It is in order to improve the code check of chief editor's code stream, i.e.,：Chief editor's code stream can be played individually, alternatively, chief editor's code stream is superimposed with auxiliary encoding stream The chief editor's code stream for playing, therefore having cached after reconstruct will not be ineffective because caching auxiliary encoding stream.Compared with prior art, energy Enough save transfer resource and cache resources.

Involved chief editor's code stream and auxiliary encoding stream can be that server is encoded according to reconstructing video in the embodiment of the present application The code stream obtained after the codings such as (reconstructive video coding, RVC) technology.Wherein, in RVC technologies, coding Device can generate two-way stream simultaneously, wherein all the way be main encoding stream, all the way supplemented by encoding stream.It is that resolution ratio is lower to edit code stream Video code flow, player can directly decode broadcasting.The effect of auxiliary encoding stream is that player is assisted to differentiate main coding stream The promotion of rate.For example, the code check of chief editor's code stream is 720p, by carrying out super-resolution operation, weight is carried out after being superimposed auxiliary encoding stream Structure, you can promote the code check to 1080p, to promote the play quality of video.Certainly, the embodiment of the present application is not limited to A kind of this coding techniques of RVC technologies, can also be other coding techniques.

Technical solution provided by the embodiments of the present application can be applied in system architecture as shown in Figure 1, system shown in FIG. 1 System packet：Encoder server 11, transmission server 12 and terminal 13.Encoder server 11 is used for according to certain coding techniques to video Content is encoded, and coding result is transmitted to transmission server 12.Transmission server 12 for preserving coding result, and When receiving the fragment request of the transmission of terminal 13, the fragment after sending coding to terminal 13.Terminal 13 according to user for indicating Or it itself triggers to transmission server 12 and sends fragment request, and point after the coding to receiving the transmission of transmission server 12 Piece is decoded and plays.

It should be noted that the merely illustrative figures of Fig. 1, wherein the embodiment of the present application is to the number of encoder server 11, transmission The number of the number of server 12 and at least one terminal 13 without limit, in practical applications, can as needed with Network deployment is carried out different from number shown in FIG. 1.

Optionally, one or more link can be established between transmission server 12 and terminal 13, and on these chain roads Transmit fragment request and fragment.Wherein, link here can be HTTP/2 links, in this case, transmission server 12 can be with It is the server for supporting HTTP/2.Certainly, without being limited thereto when specific implementation.

In order to realize technical solution provided by the embodiments of the present application, as shown in Fig. 2, encoder server 11 in Fig. 1 can be with Including：Down sample module 1101, mainstream encoder 1102, secondary flow generation module 1103, fragment control module 1104, mainstream encapsulation Fragment module 1105 and secondary flow encapsulation fragment module 1106.

Wherein, down sample module 1101 is for receiving original video inlet flow, and the original video inlet flow to being inputted Drop code check is carried out, and is exported the video flowing obtained after code check is dropped to mainstream encoder 1102.For example, receiving the yuv format of 4K Video input stream, and to the video input stream of the yuv format of 4K drop code check, generate the video flowing of the yuv format of 2K, then will The video flowing of the yuv format of the 2K is exported to mainstream encoder 1102.Wherein, YUV is a kind of coded format of color data.

Mainstream encoder 1102 is used to receive the video flowing of the input of down sample module 1101, and is compiled to the video flowing Code, such as H.264 coding etc., generate chief editor's code stream, then export chief editor's code stream to mainstream encapsulation fragment module 1105.

Secondary flow information generating module 1103 is used to compare the video flowing and mainstream encoder of the output of down sample module 1101 Chief editor's code stream of 1102 outputs, generates auxiliary encoding stream.Wherein, auxiliary encoding stream includes content of the reconstruct for improving video quality, Such as modified information etc. is carried out to the partial pixel point in chief editor's code stream.

Chief editor code stream of the mainstream encapsulation fragment module 1105 for receiving the output of mainstream encoder 1102, and controlled in fragment Under the control of module 1104, fragment and encapsulation are carried out to main coding stream according to time point, obtain at least two mainstream fragments, such as TS (transport stream) fragment or mp4 fragments etc., then exports at least two mainstreams fragment.

Secondary flow package section module 1106 is used to receive the auxiliary encoding stream of the output of secondary flow generation module 1103, and in fragment control Under the control of molding block 1104, fragment and encapsulation are carried out to auxiliary encoding stream according to the time, obtain at least two secondary flow fragments, then Export at least two secondary flows fragment.Wherein, the format of secondary flow fragment can be user-defined format, each secondary flow fragment and one Mainstream fragment corresponds to, and the time point of the time point corresponding mainstream fragment of each secondary flow fragment is identical, each secondary flow fragment Code check for improving the mainstream fragment corresponding to it.

Fragment control module 1104 is used to encapsulate collapsible mould to the implementation procedure and secondary flow of mainstream encapsulation fragment module 1105 The implementation procedure of block 1106 is controlled, and generates the warehouse receipt file of description fragment (including mainstream fragment and secondary flow fragment), so After export the warehouse receipt file.Wherein, warehouse receipt file may include the time point of each fragment, each mainstream fragment and each mainstream Correspondence of fragment etc..

In addition, encoder server 11 can also include communication interface, for external equipment (such as transmission server 2) into Row communication.For example, it is defeated to be used to receive the mainstream fragment of 1105 output of mainstream encapsulation fragment module, secondary flow encapsulation fragment module 1106 The warehouse receipt file of secondary flow fragment and fragment control module 1104 output gone out；And by these information, it is sent to WEB server, Wherein, which can support the WEB server of HTTP/2 agreements, which can be transmission clothes above Business device 12.

In hardware realization, communication interface 1107 can be transceiver, down sample module 1101, mainstream encoder 1102, Secondary flow information generating module 1103, fragment control module 1104, mainstream encapsulation fragment module 1105 and secondary flow encapsulate fragment module 1106 can be embedded in or independently of in the processor of encoder server 11, can also deposit in the form of software in the form of hardware It is stored in the memory of encoder server 11, the corresponding operation of the above modules is executed in order to which processor calls.In addition, compiling Code server 11 other than comprising transceiver, processor and memory, can also include communication bus, for make transceiver, Processor and memory are connected with each other.

In order to realize technical solution provided by the embodiments of the present application, as shown in figure 3, transmission server 12 in Fig. 1 can be with Including：Communication interface 1201, processor 1202, memory 1203 and communication bus 1204.Wherein, communication interface 1201, processing Device 1202 and memory 1203 are connected with each other by communication bus 1204.

Communication interface 1201 carries out between transmission server 12 and ext nal network element (such as encoder server 11 and terminal 13) The unit of business data flow interaction.Specifically, communication interface 1201 can be used for receiving each mainstream that encoder server 11 is sent Fragment, each secondary flow fragment and warehouse receipt file.Alternatively, receive terminal 13 send mainstream fragment request, secondary flow coding request or Person's interrupt requests, alternatively, replying requested mainstream fragment, secondary flow fragment or warehouse receipt file etc. to terminal 13.Memory 1203, which can be used for storing data and/or code, processor 1302, to be stored in memory 1203 by running or executing Program code, and call and be stored in data in memory 1203, realize the various functions of transmission server 12.

It should be understood that transmission server 12 shown in Fig. 3 does not constitute the restriction to transmission server 12, it is practical real Now, transmission server 12 can also include either combining certain components or different component cloth than illustrating more components It sets.Such as transmission server 12 can also include power supply (power), fan (fan), clock (clock, CLK) etc..

In order to realize technical solution provided by the embodiments of the present application, as shown in figure 4, the terminal 13 in Fig. 1 may include：It is logical Believe interface 1301, processor 1302, memory 1303, communication bus 1304, player 1305 and display screen 1306.Wherein, lead to Believe that interface 1301, processor 1302, memory 1303, player 1305 and display screen 1306 are mutual by communication bus 1304 Connection.

Communication interface 1303 carries out business data flow interaction between terminal 13 and ext nal network element (such as transmission server 12) Unit.Specifically, communication interface 1303 can be used for sending mainstream fragment request, secondary flow coding request to transmission server 12 Either interrupt requests are alternatively, receive mainstream fragment, secondary flow fragment or the warehouse receipt file etc. that transmission server is sent.Memory 1303, which can be used for storing data and/or code, processor 1302, to be stored in memory 1303 by running or executing Program code, and call and be stored in data in memory 1303, realize the various functions of terminal 13.

It should be understood that the restriction of the not structure paired terminal 13 of terminal 13 shown in Fig. 4, in actual implementation, terminal 13 Can also include either combining certain components or different components arrangement than illustrating more components.Such as terminal 13 may be used also To include power supply, fan, clock etc..

It, specifically can be in addition, communication interface 1201 and communication interface 1301 may each comprise receiving unit and transmission unit It is transceiver or coffret etc..

Processor 1202 and processor 1302 can include multiple central processing units (central processing unit, CPU can be specific integrated circuit) or comprising multiple network processing units (network processing unit, CPU) (application specific integrated circuit, ASIC), or be arranged to implement the embodiment of the present application One or more integrated circuits, such as：One or more microprocessors (digital signal processor, DSP), Or, one or more field programmable gate array (field programmable gate array, FPGA), or Multi-core system level chip (system on chip, SoC).

Memory 1203 and memory 1303 may each be volatile memory (volatile memory), such as：It deposits at random Access to memory (random-access memory, RAM)；Can also be nonvolatile memory (non-volatile Memory), such as：Read-only memory (read-only memory, ROM), flash memory (flash memory), hard disk (hard disk drive, HDD) can also be solid state disk (solid-state drive, SSD) or mentioned kind The combination of memory.Communication bus 1204 and communication bus 1304 can be divided into address bus, data/address bus, controlling bus Deng, can be industry ethernet, industry standard architecture (industry standard architecture, ISA) bus, External equipment interconnection (peripheral component, PCI) bus or extended industry-standard architecture (extended Industry standard architecture, EISA) bus etc..For ease of indicating, only with a thick line in Fig. 3 and Fig. 4 Each communication bus is indicated, it is not intended that an only bus or a type of bus.

It should be noted that being above that encoder server 11 and transmission server 12 are independent equipment and are retouched It states, when specific implementation, the two equipment, which can also be, to be integrated, in addition, any one equipment in the two equipment It can also be integrated with other network side equipments, the embodiment of the present application is to this without limiting.

For ease of description, following embodiment is shown in the form of step and video biography provided by the invention is described in detail Transmission method, wherein the step of showing can also be in addition to transmission server 12 shown in Fig. 3 and terminal shown in Fig. 4 13 It is executed in other any computers.Although in addition, showing transmission of video provided by the embodiments of the present application in method flow diagram The logical order of method, but in some cases, it can be with the steps shown or described are performed in an order that is different from the one herein.

It should be noted that " server " described in examples provided hereinafter can be outlined above Transmission server 12."and/or" herein, only a kind of incidence relation of description affiliated partner, indicates may exist Three kinds of relationships, for example, A and/or B, can indicate：Individualism A exists simultaneously A and B, these three situations of individualism B.Separately Outside, character "/" herein, it is a kind of relationship of "or" to typically represent forward-backward correlation object." multiple " herein refer to two Or it is more than two.

As shown in figure 5, being a kind of interaction schematic diagram of video transmission method provided by the embodiments of the present application.It is shown in fig. 5 Method may comprise steps of S101~S104：

S101：Terminal to server obtains the warehouse receipt file of video to be played.

Video to be played can be any one section of video of terminal to server request.The video may include chief editor's code stream With auxiliary encoding stream, auxiliary encoding stream is used to improve the code check of chief editor's code stream, and chief editor's code stream includes at least two mainstream fragments, auxiliary coding Stream includes at least two secondary flow fragments, and each mainstream fragment is corresponding with a secondary flow fragment.Wherein, code stream and auxiliary encoding stream are edited Generating process and its Slicing procedure, can refer to above, details are not described herein again.

The warehouse receipt file of video to be played can include but is not limited to：Each mainstream point in at least two mainstreams fragment The information of the information of piece and each secondary flow fragment in at least two secondary flows fragment.For example, each fragment (including mainstream Fragment and secondary flow fragment) time point, the correspondence etc. of mainstream fragment and secondary flow fragment.The time point of each mainstream fragment It is identical with the corresponding time point of secondary flow fragment.

When user needs to play a video, instruction information can be sent to terminal, such as pass through contact action, word Input, the modes such as voice input send instruction information；Terminal detects after the instruction information, however, it is determined that the terminal with service Connection is established between device, then the warehouse receipt file of video to be played is asked to the server；If it is determined that the terminal does not have and server Between establish connection, then first the warehouse receipt file for connecting, then asking to the server time-frequency to be played is established between the server. Wherein, the specific reality of warehouse receipt file is asked about the process and terminal to server for establishing connection between terminal and server Existing process can refer to the prior art, and details are not described herein again.

S102：Terminal parses warehouse receipt file, obtains the time point of each fragment of video to be played, each mainstream fragment with The correspondence etc. of secondary flow fragment.

S103：Terminal to server obtains the mainstream fragment of video to be played, and meets in advance in current real-time network situation If when condition, obtaining the corresponding secondary flow fragment of mainstream fragment；And each fragment that caching is got.

The instruction information that terminal can be sent according to the user detected, determination are asked to server in time-frequency to be played Which mainstream fragment, then, terminal can be after the mainstream fragments for receiving server reply, should to server request Next mainstream fragment of mainstream fragment, and so on, until last of the video to be played is arrived in terminal to server request Until a fragment.For example, it is assumed that video to be played includes 10 mainstream fragments, then, indicated by the instruction information that user sends Broadcasting initial time corresponding to mainstream fragment can be the 1st mainstream fragment, can also be the 5th mainstream fragment etc..If Mainstream fragment corresponding to indicated broadcasting initial time is the 5th mainstream fragment, then terminal can ask the 5th to server A mainstream fragment, and after the 5th mainstream fragment for receiving server reply, the 6th mainstream fragment is asked to server, And so on, until terminal request to the 10th mainstream fragment.

Current network conditions be not it is unalterable, can with the variation of the factors such as environment, load real-time change. Terminal can periodically detect current network conditions, when detection cycle is smaller, it is believed that be real-time detection current network Situation.Wherein, detection current network conditions can include but is not limited to detect at least one of following parameter：Network delay, Network packet loss rate and network fluctuation system.Its specific detection process can refer to the prior art, and details are not described herein again.

It should be noted that in technical solution provided by the embodiments of the present application, current real-time network situation, refers to terminal When executing detection Network status This move, detected Network status.That is, the different step of the embodiment of the present application Involved in meaning representated by " the current real-time network situation " that arrives, need to be realized or actual context determines according to practical, without It can think the Network status that the same word " current real-time network situation " in different step indicates that synchronization measurement obtains.Class As, at the time of " currently playing moment " refers to terminal playing.

Current real-time network situation meets preset condition, it can be understood as, the quality of current network conditions is preferable, that is, communicates Quality is preferable.In this case, terminal can ask secondary flow fragment to server, which is superimposed simultaneously with mainstream fragment Reconstruct to improve the code check of the corresponding mainstream fragment of the secondary flow fragment, and then improves the experience that user watches video.It is current real When Network status meet preset condition, may include following at least one：Current network time delay is less than or equal to first threshold, when Preceding network packet loss rate is less than or equal to second threshold, and current network coefficient of variation is less than or equal to third threshold value.The application is implemented Example is to the specific value of first threshold, second threshold and third threshold value and how value is without limiting.

In the embodiment of the present application, terminal can independently cache mainstream fragment and secondary flow fragment, for example, opening up in the terminal Specific two parts memory space, for storing mainstream fragment, another part memory space is used for a portion memory space Store secondary flow fragment.Alternatively, terminal can be with integrated cache of memory mainstream fragment and secondary flow fragment, for example, opening up in the terminal specific Memory space, and mainstream fragment and secondary flow fragment are stored in the memory space.

Illustrate that terminal obtains the process of mainstream fragment secondary flow fragment corresponding with its below.As shown in fig. 6, this method Include the following steps S11~S16：

S11：Terminal to server sends the first mainstream fragment request, and the first mainstream fragment request is for asking the first mainstream Fragment.

May include the mark of the first mainstream fragment, such as the time of the first mainstream fragment in first mainstream fragment request The index etc. of point or the first mainstream fragment.First mainstream fragment, can be any one in at least two mainstreams fragment Mainstream fragment can be specifically since the mainstream fragment played corresponding to initial time indicated by instruction information to be played Any one mainstream fragment in the last one mainstream fragment that video includes.

S12：The first mainstream fragment request that server receiving terminal is sent, and according to the first mainstream fragment request to terminal Send the first mainstream fragment.

S13：Terminal receives the first mainstream fragment that server is sent, and caches the first mainstream fragment.

S14：If current real-time network situation meets preset condition, terminal to server sends the first secondary flow fragment and asks It asks, wherein the first secondary flow fragment request is for asking the corresponding first secondary flow fragment of the first mainstream fragment.

May include the mark of the first secondary flow fragment, such as the time of the first secondary flow fragment in first secondary flow fragment request The index etc. of point or the first secondary flow fragment.

S15：The first secondary flow fragment request that server receiving terminal is sent, and send the first secondary flow fragment to terminal.

S16：Terminal receives the first secondary flow fragment that server is sent, and caches the first secondary flow fragment.

S11~S13 is the process for obtaining the first mainstream fragment, and S14~S16 is the process for obtaining the first secondary flow fragment；This Apply embodiment to the execution of S11~S13 and S14~S16 sequence without limiting, for example, S11~S13 can be first carried out again S14~S16 is executed, S14~S16 can also be first carried out and execute S11~S13 again, it can also be during executing S11~S13 Execute S14~S16.That is, terminal obtains the process secondary flow point corresponding with the mainstream fragment is obtained of a mainstream fragment The process of piece can be in no particular order.

Illustrate that terminal obtains the process of multiple mainstream fragments and the corresponding secondary flow fragment of each mainstream fragment below.

It is usually that the sequencing for asking each mainstream fragment is distinguished according to time point for terminal；And it is possible to The sequencing for asking each secondary flow fragment is distinguished according to time point, can not also be distinguished according to time point and be asked each secondary flow fragment Sequencing.For the mainstream fragment and secondary flow fragment put at the same time, (i.e. mainstream fragment and the mainstream fragment is corresponding auxiliary Flow fragmentation) request sequence, can without limit.

For server, be typically also send each mainstream fragment to terminal according to time point, and according to the time to Terminal sends each secondary flow fragment.For mainstream fragment and secondary flow fragment (i.e. the mainstream fragment and the mainstream minute put at the same time The corresponding secondary flow fragment of piece) transmission sequence, in the embodiment of the present application, can be determined in such a way that priority is set.It can Choosing, server and terminal can make an appointment or server and terminal between mainstream fragment arranged by signaling method The priority of secondary flow fragment corresponding with the mainstream fragment.For example, priority is arranged in the PRIORITY frames using HTTP/2.Example Such as, terminal is sending mainstream fragment request and/or when secondary flow fragment request to server, carry requested mainstream fragment and/ Or the priority of secondary flow fragment.Optionally, it is contemplated that mainstream fragment can be played individually, and secondary flow fragment needs and mainstream fragment It just can play together, the priority that mainstream fragment can be arranged is higher than the priority of the corresponding secondary flow fragment of the mainstream fragment, from And ensure that mainstream fragment can be with prioritised transmission, and then ensure the broadcasting continuity of mainstream fragment；That is, server is to end After end sends a mainstream fragment, it can just be sent to the corresponding secondary flow fragment of the mainstream fragment.

Based on this, terminal obtains the process of multiple mainstream fragments and the corresponding secondary flow fragment of each mainstream fragment, such as Fig. 7 institutes Show, can specifically include following steps S21~S24：

S21：Terminal to server obtains i-th of mainstream fragment, and caches i-th of mainstream fragment.

Wherein, i-th of mainstream fragment refers to i-th of mainstream fragment of video to be played, and i is greater than the integer equal to 1, i Initial value be 1, i maximum value be video to be played in include mainstream fragment quantity.

S22：Terminal judges whether to ask the corresponding secondary flow fragment of i-th of mainstream fragment.

If so, S23 is thened follow the steps, if it is not, thening follow the steps S24.

Specifically, terminal is detecting that current real-time network situation meets preset condition, and without caching i-th of secondary flow point In the case of piece, determines and need to ask i-th of secondary flow fragment；Detecting that current real-time network situation is unsatisfactory for preset condition, Or in the case of having cached i-th of secondary flow fragment, determination need not ask i-th of secondary flow fragment.

S23：Terminal obtains the corresponding secondary flow fragment of i-th of mainstream fragment, and caches the secondary flow fragment.

After executing step S23, step S24 is executed.

S24：Terminal judges whether i-th mainstream fragment is the last one mainstream fragment to be played.

If so, terminating.If it is not, i=i+1 is then executed, and return to step S21.

It should be understood that after terminal obtains the last one mainstream fragment, the corresponding secondary flow point of the mainstream fragment is obtained Before piece, it can not judge whether current real-time network situation meets preset condition.In addition, executed above-mentioned S21~S24 it Afterwards, terminal has got each mainstream fragment to be played, and the partly or entirely corresponding secondary flow fragment of mainstream fragment.It is optional , this method can also include：Terminal obtains the corresponding uncached secondary flow fragment of mainstream fragment not played.For example, it is assumed that Mainstream fragment to be played is main flow fragmentation 1~5, mainstream fragment 1~5 and secondary flow fragment 1~5 after successively sorting according to time point It corresponds, then, the sequence of mainstream fragment and secondary flow fragment that terminal obtains can be：Mainstream fragment 1, secondary flow fragment 1, master Flow fragmentation 2, mainstream fragment 3, mainstream fragment 4, secondary flow fragment 4, mainstream fragment 5, secondary flow fragment 5.Further, if obtaining When secondary flow fragment 5, currently playing 1 corresponding video content of moment playing mainstream fragment, then terminal can also obtain successively Following secondary flow fragment：Secondary flow fragment 2 and secondary flow fragment 3.

It should be noted that when specific implementation, terminal is after obtaining each mainstream fragment, if detecting current Real-time Network Network situation meets preset condition, then obtains the corresponding uncached first secondary flow fragment of the mainstream fragment not played, until obtaining To a last mainstream fragment, then, then the corresponding uncached secondary flow fragment of the mainstream fragment not played is obtained.Alternatively, eventually End can obtain one or more corresponding uncached secondary flows of mainstream fragment not played after obtaining multiple mainstream fragments Fragment etc., the embodiment of the present application is to this without limiting.

S104：Terminal plays video according to the fragment cached.

Terminal first caches the fragment, and slow after asking to each fragment (including mainstream fragment and secondary flow fragment) It deposits to a certain number of mainstream fragments, starts to be broadcast according to the mainstream fragment cached successively according to the time point of mainstream fragment Video to be played is put, to ensure the continuity played.It should be noted that the mainstream fragment got due to terminal to server It is the code stream obtained after server code with secondary flow fragment, therefore, terminal is before being played, it is also necessary to mainstream fragment and secondary flow Fragment is decoded.In addition, the embodiment of the present application is to a certain number of specific values and how value is without limiting.

It should be understood that for the video to be played comprising multiple mainstream fragments, terminal can be with when obtaining video The video cached is played, but for the same mainstream fragment, terminal first obtains the mainstream fragment, then plays and cached The mainstream fragment.

Based on this, the process of terminal plays video, as shown in figure 8, can specifically include following steps S31~S35：

S31：Terminal determines j-th of mainstream fragment according to the time point of mainstream fragment.Wherein, j-th of mainstream fragment indicates The mainstream fragment that terminal will play recently, if for example, mainstream fragment 1 is currently played in terminal, terminal will be broadcast recently The mainstream fragment put is mainstream fragment 2.

Wherein, j-th of mainstream fragment refers to j-th of mainstream fragment of video to be played, and j is greater than the integer equal to 1, j Initial value be 1, j maximum value be video to be played in include mainstream fragment quantity.

S32：Terminal judges whether to have cached the corresponding secondary flow fragment of j-th of mainstream fragment.

If so, thening follow the steps S33；If it is not, thening follow the steps S34.

S33：J-th of mainstream fragment of terminal plays.That is, playing the corresponding video content of j-th of mainstream fragment.

After executing step S33, step S35 is executed.

S34：J-th of mainstream fragment and the secondary flow fragment are overlapped and are reconstructed by terminal, obtain synthesis fragment, and playing should Synthesize fragment.

After executing step S34, step S35 is executed.

It should be understood that played in the corresponding video content of the video content played in step S33 and step S34 The corresponding video content of synthesis fragment is identical, and only the code check of the two is different, therefore play quality is different.

Mainstream fragment be superimposed secondary flow fragment and reconstruct be reconstructing video coding committed step.Since encoder server exists Video content is encoded, during generating mainstream fragment, drop code check processing can be carried out, such as the video flowing of 4K is carried out Code check is dropped, the video flowing of 2K is generated.Therefore, the resolution ratio of the picture frame obtained after the decoding of terminal-pair mainstream fragment is relatively low.Generally Ground, terminal can carry out super-resolution processing to the image that decoding obtains, again promote code check after being decoded to mainstream fragment To 4K；But in lifting process, the time-frequency quality of the video flowing compared to original 4K can decline, therefore can utilize auxiliary coding Stream is modified, such as supplements the details of loss, corrects the error etc. introduced in cataloged procedure.

S35：Terminal judges whether j-th mainstream fragment is the last one mainstream fragment to be played.

If so, terminating.If it is not, i=i+1 is then executed, and return to step S31.

For example, it is assumed that video to be played includes 10 mainstream fragments, each mainstream fragment corresponds to a secondary flow fragment, currently Mainstream fragment indicated by playing time is the 5th mainstream fragment, has cached the 6th~10 mainstream fragment and the 6th~7 Secondary flow fragment, then a kind of possible situation be：Play in order synthesis fragment 6, synthesis the 7, the 8th~10 mainstream fragment of fragment.Its In, synthesis fragment 6 is the synthesis fragment that the 6th mainstream fragment and the 6th secondary flow fragment are superimposed and are obtained after reconstructing, and synthesizes fragment 7 be the synthesis fragment that the 7th mainstream fragment and the 7th secondary flow fragment are superimposed and are obtained after reconstructing.

Video transmission method provided by the embodiments of the present application, terminal request mainstream fragment, and on-demand request secondary flow fragment；Its In, secondary flow fragment is used to improve the code check of mainstream fragment.Since in the embodiment of the present application, chief editor's code stream can be played individually, Alternatively, chief editor's code stream be superimposed chief editor's code stream for playing, therefore having cached after reconstructing with auxiliary encoding stream will not be because of the auxiliary encoding stream of caching And it is ineffective.Compared with prior art, transfer resource and cache resources can be saved.

It should be understood that one or more link can be established between terminal and server, it is in the embodiment of the present application, main Flow fragmentation can be transmitted with secondary flow fragment in independent both links, can also be transmitted on same link.If same It is transmitted on link, terminal and server only needs to safeguard this link, therefore realizes simple.It is exemplary, here Link can be HTTP/2 links.That is, terminal is sending mainstream fragment request and when secondary flow fragment request, using same One HTTP/2 links, i.e. mainstream fragment and secondary flow fragment use the frame of different HTTP/2, two-way stream to be multiplexed into same HTTP/2 In link.

Above-mentioned S11~S16 provides the process for obtaining the first mainstream fragment and the first secondary flow fragment.In this process, also Interrupt requests can be set, to interrupt the transfer process of secondary flow fragment.As shown in figure 9, can specifically include following steps S41~ S47.Wherein, in order to be distinguished with the first mainstream fragment, underneath with being illustrated for the second mainstream fragment.It is appreciated that , there is the second mainstream fragment arbitrariness, i.e. terminal can interrupt the transport stream of any one secondary flow fragment in time-frequency to be played Journey.

S41：Terminal to server sends the second mainstream fragment request, wherein the second mainstream fragment request is for asking the Two mainstream fragments, the second mainstream fragment are the mainstreams in addition to the first mainstream fragment point at least two mainstream fragments Piece.

S42：The second mainstream fragment request that server receiving terminal is sent, and according to the second mainstream fragment request to service Device sends the second mainstream fragment.

S43：Terminal receives the second mainstream fragment that server is sent, and caches the second mainstream fragment.

S44：If current real-time network situation meets preset condition, terminal to server sends the second secondary flow fragment and asks It asks, wherein the second secondary flow fragment request is for asking the corresponding second secondary flow fragment of the second mainstream fragment.

Wherein, the specific implementation of S41~S44 can refer to S11~S14 above.

S45：The second secondary flow fragment request that server receiving terminal is sent.

S46：If after sending the second secondary flow fragment request to server and before receiving the second secondary flow fragment, terminal It detects that current real-time network situation is unsatisfactory for preset condition, then sends interrupt requests to server, wherein interrupt requests are used for The transfer process of the second secondary flow fragment is interrupted in request.

Since terminal can detect current network conditions in real time, if terminal is sending the second secondary flow point to server After piece request and before receiving the second secondary flow fragment, terminal detects that current real-time network situation is unsatisfactory for preset condition, Illustrate that Network status is poor at this time, if server sends the second secondary flow fragment to terminal, may take a long time, to lead It causes interim card etc. occur during terminal plays video, is based on this, the embodiment of the present application provides terminal and sends interrupt requests Technical solution.Wherein, which can be the RST_STREM frames in HTTP/2, can also be a kind of new frame, either Other frames, the embodiment of the present application is to this without limiting.

If it should be understood that server send the second secondary flow fragment request after and receive the second secondary flow fragment it Before, terminal detects that current real-time network situation still meets preset condition, then does not send interrupt requests to server, that is, service Device will not receive interrupt requests.In this case, server can send the second secondary flow fragment request to terminal, terminal receives second Secondary flow fragment, and the second secondary flow fragment is cached, specific implementation process can refer to above.

S47：The interrupt requests that server receiving terminal is sent, and determining also the second secondary flow fragment is not sent to terminal In the case of, the transfer process of the second secondary flow fragment is interrupted according to interrupt requests.

Specifically, server after receiving interrupt requests, can be not responding to the second secondary flow fragment request message, i.e., not The second secondary flow fragment is sent to terminal.If server is when receiving the interrupt requests of terminal transmission, warp-wise terminal has sent Second secondary flow fragment, then server can abandon the interrupt requests.

It should be understood that after executing S41~S47, terminal may not receive the second secondary flow point of server transmission Piece, but terminal has got the second mainstream fragment, therefore, terminal can continue to ask the second mainstream fragment to server Next mainstream fragment.

Technical solution provided in this embodiment, terminal to server after sending secondary flow fragment request and does not receive Before requested secondary flow fragment, if detecting, current real-time network situation is unsatisfactory for preset condition, can trigger interruption and be asked The transfer process for the secondary flow fragment asked.In such manner, it is possible to which reducing terminal to a certain extent obtains the corresponding mainstream of secondary flow fragment Next mainstream fragment of fragment, to the generation of the phenomenon that interim card occur during effective less terminal plays video.

It is above-mentioned that mainly scheme provided by the embodiments of the present application is described from the angle of interaction between each network element.It can With understanding, each network element, such as terminal or server.In order to realize above-mentioned function, it comprises execute each function Corresponding hardware configuration and/or software module.Those skilled in the art should be readily appreciated that, in conjunction with disclosed herein Each exemplary unit and algorithm steps of embodiment description, the application can be with the combination shape of hardware or hardware and computer software Formula is realized.Some functions is executed in a manner of hardware or computer software driving hardware actually, depends on technical solution Specific application and design constraint.Professional technician can be realized each specific application using distinct methods Described function, but this realization is it is not considered that exceed scope of the present application.

The embodiment of the present application can carry out terminal or server according to the above method example division of function module, example Such as, each function can be corresponded to and divide each function module, two or more functions can also be integrated at one It manages in module.The form that hardware had both may be used in above-mentioned integrated module is realized, the form of software function module can also be used It realizes.It should be noted that being schematical to the division of module in the embodiment of the present application, only a kind of logic function is drawn Point, formula that in actual implementation, there may be another division manner.

For example, in the case where dividing each function module using corresponding each function, Figure 10 shows above-described embodiment In involved terminal 100 a kind of possible structural schematic diagram.The terminal 100 includes transmission unit 1401 and receiving unit 1402.Optionally, can also include：Reconfiguration unit 1403 and broadcast unit 1404.Wherein, transmission unit 1401 can be used for holding The action that terminal executes in S11 and S14 in row Fig. 6, the action that terminal executes in the S41 and S46 in Fig. 9, and/or for branch Hold other processes of techniques described herein.Receiving unit can be used for executing what terminal in the S12 and S15 in Fig. 6 executed It acts, the action that terminal executes in the S42 in Fig. 9, and/or other processes for supporting techniques described herein.Reconstruct Unit 1403 can be used for executing the action that reconstructs in the S34 in Fig. 8, and/or for support techniques described herein its Its process.Broadcast unit 1404 can be used for executing the action played in the S34 in Fig. 8, and/or described herein for supporting Technology other processes.

Wherein, all related contents for each step that above method embodiment is related to can quote corresponding function module Function description, details are not described herein.

In the embodiment of the present application, which answers each function to divide the form of each function module to present, alternatively, The policy entity is presented in the form of using the integrated each function module of model split.Here " module " can refer to specific Application integrated circuit (Application-Specific Integrated Circuit, ASIC) executes one or more softwares Or the processor and memory of firmware program, integrated logic circuit and/or other the device of above-mentioned function can be provided.One In a simple embodiment, those skilled in the art is contemplated that the terminal can be by form shown in Fig. 4.On for example, The transmission unit 1401 that text provides can be transmitter, and receiving unit 1402 can be receiver, and transmitter can be with receiver Transceiver is constituted together, can be specifically the communication interface 1301 in Fig. 4.In addition, reconfiguration unit 1403 can be with hardware shape Formula is embedded in or independently of in the processor (processor 1302 in such as Fig. 4) of terminal, can also be stored in end in a software form In the memory (memory 1303 in such as Fig. 4) at end.Broadcast unit 1404 can be player 1305 in Fig. 4 and/or aobvious Display screen 1306.

Since terminal provided by the embodiments of the present application can be used for executing above-mentioned video transmission method, can be obtained Technique effect can refer to above method embodiment, and details are not described herein for the embodiment of the present application.

For example, in the case where dividing each function module using corresponding each function, Figure 11 shows above-described embodiment In involved server 110 a kind of possible structural schematic diagram.The server 110 may include receiving unit 1501 and hair Send unit 1502.Optionally, can also include：Interrupt location 1503.Wherein, receiving unit 1501 can be used for executing in Fig. 6 S11 and S14 in the action that executes of server, the action that server executes in S41 and S44 in Fig. 9, and/or for supporting this Other processes of technology described in text.Transmission unit 1502 can be used for executing server in the S12 and S15 in Fig. 6 and execute Action, the action that server executes in S45 and S46 in Fig. 9, and/or other mistakes for supporting techniques described herein Journey.Interrupt location 1503 can be used for executing the action of S47 in Fig. 9, and/or for supporting the other of techniques described herein Process.

In the embodiment of the present application, which corresponds to each function and divides the form of each function module to present, or Person, the server are presented in the form of using the integrated each function module of model split.Here " module " can refer to spy Determine ASIC circuit, execute the processor and memory of one or more softwares or firmware program, integrated logic circuit and/or its He can provide the device of above-mentioned function.In a simple embodiment, those skilled in the art is contemplated that the terminal Form shown in Fig. 3 can be passed through.For example, transmission unit 1502 provided above can be transmitter, receiving unit 1501 can To be receiver, transmitter can constitute transceiver together with receiver, can be specifically the communication interface 1201 in Fig. 3. In addition, interrupt location 1503 can be embedded in the form of hardware or independently of terminal the processor (processor in such as Fig. 3 1202) it in, can also be stored in a software form in the memory (memory 1203 in such as Fig. 3) of terminal.

In the above-described embodiments, can come wholly or partly by software, hardware, firmware or its arbitrary combination real It is existing.When being realized using software program, can entirely or partly realize in the form of a computer program product.The computer Program product includes one or more computer instructions.On computers load and execute computer program instructions when, all or It partly generates according to the flow or function described in the embodiment of the present application.The computer can be all-purpose computer, special meter Calculation machine, computer network or other programmable devices.The computer instruction can be stored in computer readable storage medium In, or from a computer readable storage medium to the transmission of another computer readable storage medium, for example, the computer Instruction can pass through wired (such as coaxial cable, optical fiber, number from a web-site, computer, server or data center Word user line (digital subscriber line, DSL)) or wireless (such as infrared, wireless, microwave etc.) mode to another A web-site, computer, server or data center are transmitted.The computer readable storage medium can be computer Any usable medium that can be accessed is either comprising numbers such as one or more server, data centers that can be integrated with medium According to storage device.The usable medium can be magnetic medium (for example, floppy disk, hard disk, tape), optical medium (for example, DVD), Or semiconductor medium (such as solid state disk (solid state disk, SSD)) etc..

Although the application is described in conjunction with each embodiment herein, however, implementing the application claimed In the process, those skilled in the art are by checking the attached drawing, disclosure and the appended claims, it will be appreciated that and it is real Other variations of the existing open embodiment.In the claims, " comprising " (comprising) word is not excluded for other compositions Part or step, "a" or "an" are not excluded for multiple situations.Claim may be implemented in single processor or other units In several functions enumerating.Mutually different has been recited in mutually different dependent certain measures, it is not intended that these are arranged It applies to combine and generates good effect.

Although the application is described in conjunction with specific features and embodiment, it is clear that, do not departing from this Shen In the case of spirit and scope please, it can be carry out various modifications and is combined.Correspondingly, the specification and drawings are only institute The exemplary illustration for the application that attached claim is defined, and be considered as covered within the scope of the application arbitrary and all and repair Change, change, combining or equivalent.Obviously, those skilled in the art the application can be carried out various modification and variations without It is detached from spirit and scope.If in this way, these modifications and variations of the application belong to the application claim and its Within the scope of equivalent technologies, then the application is also intended to include these modifications and variations.

Claims

1. a kind of video transmission method, which is characterized in that the video includes main coding stream and auxiliary encoding stream, the auxiliary encoding stream Code check for improving chief editor's code stream, chief editor's code stream includes at least two mainstream fragments, and the auxiliary encoding stream includes At least two secondary flow fragments, each mainstream fragment are corresponding with a secondary flow fragment；The method includes：

The first mainstream fragment request is sent to server, wherein the first mainstream fragment request is for asking the first mainstream point Piece, the first mainstream fragment are a mainstream fragments in at least two mainstreams fragment；

Receive the first mainstream fragment that the server is sent；

If current real-time network situation meets preset condition, the first secondary flow fragment request is sent to the server, wherein institute The first secondary flow fragment request is stated for asking the corresponding first secondary flow fragment of the first mainstream fragment；

Receive the first secondary flow fragment that the server is sent.

2. according to the method described in claim 1, it is characterized in that,

The the first mainstream fragment for receiving the server and sending, including：

The first mainstream fragment that the server is sent is received on a chain road；

The the first secondary flow fragment for receiving the server and sending, including：

The first secondary flow fragment that the server is sent is received on said link.

3. method according to claim 1 or 2, which is characterized in that the method further includes：

The second mainstream fragment request is sent to the server, wherein the second mainstream fragment request is for asking the second master Flow fragmentation, the second mainstream fragment are one in addition to the first mainstream fragment in at least two mainstreams fragment Mainstream fragment；

Receive the second mainstream fragment that the server is sent；

If current real-time network situation meets the preset condition, the second secondary flow fragment request is sent to the server, In, the second secondary flow fragment request is for asking the corresponding second secondary flow fragment of the second mainstream fragment；

If after sending the second secondary flow fragment request to the server and before receiving the second secondary flow fragment, It detects that current real-time network situation is unsatisfactory for the preset condition, then sends interrupt requests to the server, wherein described Interrupt requests are used to ask to interrupt the transfer process of the second secondary flow fragment.

4. according to the method described in claim 3, it is characterized in that, the interrupt requests include：RST_STREM in HTTP/2 Frame.

5. method according to any one of claims 1 to 3, which is characterized in that the method further includes：

The first mainstream fragment and the first secondary flow fragment are superimposed and are reconstructed, the code stream generated after reconstruct is played.

6. a kind of video transmission method, which is characterized in that the video includes main coding stream and auxiliary encoding stream, chief editor's code stream Including at least two mainstream fragments, the auxiliary encoding stream includes at least two secondary flow fragments, each mainstream fragment and a secondary flow Fragment corresponds to；The method includes：

Receive the first mainstream fragment request that terminal is sent, wherein the first mainstream fragment request is for asking the first mainstream Fragment, the first mainstream fragment are a mainstream fragments in at least two mainstreams fragment；

The first mainstream fragment is sent to the terminal；

Receive the first secondary flow fragment request that the terminal is sent, wherein the first secondary flow fragment request is described for asking The corresponding first secondary flow fragment of first mainstream fragment；The first secondary flow fragment request is that the terminal is full in current network conditions It is sent in the case of sufficient preset condition；

The first secondary flow fragment is sent to the terminal.

7. according to the method described in claim 6, it is characterized in that,

It is described to send the first mainstream fragment to the terminal, including：

On a chain road the first mainstream fragment is sent to the terminal；

It is described to send the first secondary flow fragment to the terminal, including：

On said link the first secondary flow fragment is sent to the terminal.

8. the method described according to claim 6 or 7, which is characterized in that the priority of mainstream fragment is higher than the mainstream fragment pair The priority for the secondary flow fragment answered；It is described to send the first secondary flow fragment to the terminal, including：

If it is determined that sending the first mainstream fragment to the terminal, then the first secondary flow fragment is sent to the terminal.

9. according to claim 6 to 8 any one of them method, which is characterized in that the method further includes：

Receive the second mainstream fragment request that the terminal is sent, wherein the second mainstream fragment request is for asking second Mainstream fragment, the second mainstream fragment are one in addition to the first mainstream fragment in at least two mainstreams fragment A mainstream fragment；

The second mainstream fragment is sent to the terminal；

Receive the second secondary flow fragment request that the terminal is sent, wherein the second secondary flow fragment request is described for asking The corresponding second secondary flow fragment of second mainstream fragment；

If before sending the second secondary flow fragment request to the terminal, the interrupt requests that the terminal is sent are received, Then interrupt the transfer process of the second secondary flow fragment.

10. according to the method described in claim 9, it is characterized in that, the interrupt requests include：RST_ in HTTP/2 STREM frames.

11. a kind of terminal, which is characterized in that video includes main coding stream and auxiliary encoding stream, and the auxiliary encoding stream is for improving institute The code check of chief editor's code stream is stated, chief editor's code stream includes at least two mainstream fragments, and the auxiliary encoding stream includes at least two auxiliary Flow fragmentation, each mainstream fragment are corresponding with a secondary flow fragment；The terminal includes：Transmission unit and receiving unit；

The transmission unit, for sending the first mainstream fragment request to server, wherein the first mainstream fragment request is used In asking the first mainstream fragment, the first mainstream fragment is a mainstream fragment in at least two mainstreams fragment；

The receiving unit, the first mainstream fragment sent for receiving the server；

The transmission unit is additionally operable to, if current real-time network situation meets preset condition, first is sent to the server Secondary flow fragment request, wherein the first secondary flow fragment request is for asking corresponding first secondary flow of the first mainstream fragment Fragment；

The receiving unit is additionally operable to, and receives the first secondary flow fragment that the server is sent.

12. terminal according to claim 11, which is characterized in that

The receiving unit is specifically used for, and the first mainstream fragment that the server is sent is received on a chain road；Institute It states chain road and receives the first secondary flow fragment that the server is sent.

13. terminal according to claim 11 or 12, which is characterized in that

The transmission unit is additionally operable to, and sends the second mainstream fragment request to the server, wherein the second mainstream fragment Request is to remove described first in at least two mainstreams fragment for asking the second mainstream fragment, the second mainstream fragment A mainstream fragment except mainstream fragment；

The receiving unit is additionally operable to, and receives the second mainstream fragment that the server is sent；

The transmission unit is additionally operable to, if current real-time network situation meets the preset condition, is sent to the server Second secondary flow fragment request, wherein the second secondary flow fragment request is for asking the second mainstream fragment corresponding second Secondary flow fragment；

The transmission unit is additionally operable to, if after sending the second secondary flow fragment request to the server and receiving institute It before stating the second secondary flow fragment, detects that current real-time network situation is unsatisfactory for the preset condition, is then sent out to the server Send interrupt requests, wherein the interrupt requests are used to ask to interrupt the transfer process of the second secondary flow fragment.

14. terminal according to claim 13, which is characterized in that the interrupt requests include：RST_ in HTTP/2 STREM frames.

15. according to claim 11 to 14 any one of them terminal, which is characterized in that the terminal further includes：

Reconfiguration unit, for the first mainstream fragment and the first secondary flow fragment to be superimposed and reconstruct；

Broadcast unit, for playing the code stream generated after reconstruct.

16. a kind of server, which is characterized in that video includes main coding stream and auxiliary encoding stream, and chief editor's code stream includes at least Two mainstream fragments, the auxiliary encoding stream include at least two secondary flow fragments, and each mainstream fragment is corresponding with a secondary flow fragment； The server includes：Receiving unit and transmission unit；

The receiving unit, the first mainstream fragment request for receiving terminal transmission, wherein the first mainstream fragment request For asking the first mainstream fragment, the first mainstream fragment is a mainstream fragment in at least two mainstreams fragment；

The transmission unit, for sending the first mainstream fragment to the terminal；

The receiving unit is additionally operable to, and receives the first secondary flow fragment request that the terminal is sent, wherein first secondary flow point Piece is asked for asking the corresponding first secondary flow fragment of the first mainstream fragment；The first secondary flow fragment request is the end What end was sent in the case where current network conditions meet preset condition；

The transmission unit is additionally operable to, and the first secondary flow fragment is sent to the terminal.

17. server according to claim 16, which is characterized in that

The transmission unit is specifically used for：On a chain road the first mainstream fragment is sent to the terminal；In the link On to the terminal send the first secondary flow fragment.

18. server according to claim 16 or 17, which is characterized in that the priority of mainstream fragment is higher than the mainstream point The priority of the corresponding secondary flow fragment of piece；

The transmission unit is specifically used for：If it is determined that sending the first mainstream fragment to the terminal, then to the terminal Send the first secondary flow fragment.

19. according to claim 16 to 18 any one of them server, which is characterized in that

The receiving unit is additionally operable to, and receives the second mainstream fragment request that the terminal is sent, wherein second mainstream point Piece request is in at least two mainstreams fragment except described for asking the second mainstream fragment, the second mainstream fragment A mainstream fragment except one mainstream fragment；

The transmission unit is additionally operable to, and the second mainstream fragment is sent to the terminal；

The receiving unit is additionally operable to, and receives the second secondary flow fragment request that the terminal is sent, wherein second secondary flow point Piece is asked for asking the corresponding second secondary flow fragment of the second mainstream fragment；

The receiving unit is additionally operable to, and receives the interrupt requests that the terminal is sent；

The server further includes：

Interrupt location, if for before the transmission unit sends the second secondary flow fragment request to the terminal, it is described Receiving unit receives the interrupt requests that the terminal is sent, then interrupts the transfer process of the second secondary flow fragment.

20. server according to claim 19, which is characterized in that the interrupt requests include：RST_ in HTTP/2 STREM frames.

21. a kind of terminal, which is characterized in that including：Processor, memory, communication bus and communication interface；

For storing computer executed instructions, the processor is connected with the memory by the communication bus memory It connects, when the terminal operating, the processor executes the computer executed instructions of the memory storage, so that described Terminal executes the video transmission method as described in any one of claim 1-5.

22. a kind of server, which is characterized in that including：Processor, memory, communication bus and communication interface；

For storing computer executed instructions, the processor is connected with the memory by the communication bus memory It connects, when the server is run, the processor executes the computer executed instructions of the memory storage, so that institute State video transmission method of the server execution as described in any one of claim 6-10.