CN103167319B - The transfer processing method of a kind of Streaming Media, Apparatus and system - Google Patents
The transfer processing method of a kind of Streaming Media, Apparatus and system Download PDFInfo
- Publication number
- CN103167319B CN103167319B CN201110423228.8A CN201110423228A CN103167319B CN 103167319 B CN103167319 B CN 103167319B CN 201110423228 A CN201110423228 A CN 201110423228A CN 103167319 B CN103167319 B CN 103167319B
- Authority
- CN
- China
- Prior art keywords
- resource
- terminal
- data block
- video resource
- node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
Embodiment of the invention discloses that the transfer processing method of a kind of Streaming Media, Apparatus and system, relate to field of video encoding, solve the transfer processing method of SVC technical flow media in prior art and cannot realize the technical problem of resource sharing。The method of the present invention specifically includes that at least one the AU data block receiving the video resource having node from resource；Level identities and the time paragraph header byte-identifier of AU data block is parsed from AU data block；The message bit pattern table for recording the resource situation that video resource has obtained is updated according to time paragraph header byte-identifier and level identities；Determine the AU data block lacked according to the record in message bit pattern table, and have node request to resource。The embodiment of the present invention is mainly used in streaming media resource and shares。
Description
Technical field
The present invention relates to field of video encoding, particularly relate to the transfer processing method of a kind of Streaming Media, Apparatus and system。
Background technology
SVC (ScalableVedioCoding, scalable video) technology is based on temporal scalability, spatial domain scalability, three dimensions of quality scalability, each frame of inlet flow Media Stream is carried out hierarchical coding, same primitive frame finally encodes the Frame forming multiple different levels, the Frame produced after these codings is encapsulated in VCL (VideoCodingLayer, video coding layer), and be that each VCL level is according to adding NAL (NetworkAccessLayer, network abstraction layer) leader knowledge, VCL coding data are encapsulated in network abstraction layer unit NALU the most at last, NALU unit structure as shown in Figure 1。Multiple NALU will be combined and finally be encapsulated in access unit AU (AccessUnit)。Access unit AU structure as shown in Figure 2, each access unit AU is the complete or collected works that same frame encodes data, and each access unit AU comprises one group of NALU。Access unit AU arranged in sequence completes the coding to whole video file the most at last。:
In prior art, transmission processing mode for AU is as follows: when terminal request video file, Resource Server selects suitable NALU sequence flowing from whole access unit AU according to the real-time bandwidth situation of terminal, these NALU sequences are spliced again final composition AU subcode stream response terminal request, thus completing the request responding process of files in stream media, complete transmission of video service。
But, state in realization in process, prior art at least exist following technical problem:
The hierarchical coding mode of prior art is in the SVC scheme of standard, and this mode makes to be likely between terminal have different AU subcode stream data, causes sharing the AU subcode stream data obtained each other between terminal, is unfavorable for resource-sharing；In addition, owing to existing Bitmap table is one-dimentional structure, it is only capable of identifying whether terminal obtains related resource by 0,1, so in SVC scheme, the existing Bitmap table of terminal will be unable to represent the situation of three dimensions based on SVC resource obtained, and causes can not effectively meeting the SVC technical problem shared。
Summary of the invention
Embodiments of the invention provide the transfer processing method of a kind of Streaming Media, Apparatus and system, in order to being embodied as the diversified real network of terminal provides streaming media service demand, and shares the purpose of SVC data resource between terminal。
A kind of transfer processing method of Streaming Media, including:
Receive at least one the AU data block of the video resource having node from resource；
Level identities and the time paragraph header byte-identifier of AU data block is parsed from AU data block；
The message bit pattern table for recording the resource situation that video resource has obtained is updated according to time paragraph header byte-identifier and level identities；
Determine the AU data block lacked according to the record in message bit pattern table, and have node request to resource。
Wherein, can having node as resource provide service when being absent from terminal in network, described resource has node when being Resource Server, described in receive at least one AU data block of the video resource having node from resource and specifically include:
Video resource is asked to Resource Server；
Receive the index information of the described video resource from described Resource Server and at least one AU data block, wherein, the bandwidth requirement that described index information includes level identities and described level identities should meet；
Accordingly, described determine that the AU data block lacked specifically includes according to the record in institute's bitmap information table:
The AU data block lacking and meeting resource requirement is determined according to the record in described index information and institute's bitmap information table。
Wherein, can having node as resource provide service when there is terminal in network, resource has node when being terminal, and the method also includes:
Video resource is asked to Resource Server；
Receive the index information of the node listing from described Resource Server and described video resource, described node listing at least includes the address information having the terminal of described video resource, wherein, the bandwidth requirement that described index information includes level identities and described level identities should meet；
Ask its message bit pattern table according to the address information of described terminal to counterpart terminal and then determine the situation of described video resource that described counterpart terminal has；
The situation of the described video resource having according to described index information and described counterpart terminal is determined for compliance with the AU data block of resource requirement, and asks described video resource according to described terminal address to described counterpart terminal。
Additionally, the method also includes:
The resource situation that video resource has been obtained by record according to message bit pattern table, and when the described resource situation obtained enough plays described video resource, the address information of self is reported Resource Server。
A kind of transfer processing method of Streaming Media, including:
Access unit full code flow point after being encoded by video resource by duration is slit into multiple access unit AU data block；
Each AU data block is added time paragraph header byte-identifier；
The AU data block adding time paragraph header byte-identifier is sent to the first terminal of request video resource。
Additionally, the method also includes: receive the address information from described first terminal；
Described address information is added in the node listing of storage, in order to the resource having described video resource in record network has node。
Additionally, the method also includes: receive the request obtaining video resource from the second terminal；
From node listing, find the first terminal having video resource, and the address information of the described first terminal found is sent to the second terminal。
A kind of terminal, including:
Receive unit, for receiving at least one the AU data block of the video resource having node from resource；
Resolution unit, for parsing level identities and the time paragraph header byte-identifier of AU data block from AU data block；
Record unit, for updating the message bit pattern table for recording the resource situation that video resource has obtained according to time paragraph header byte-identifier and level identities；
Determine unit, for determining the AU data block lacked according to the record in message bit pattern table, and have node request to resource。
Additionally, this terminal also includes: request unit, for asking video resource to Resource Server；
Accordingly, above-mentioned reception unit, described reception unit, be additionally operable to work as network is absent from terminal can as resource have node provide service, described resource has node when being Resource Server, receives index information and at least one AU data block of the described video resource from described Resource Server；Determine unit, be additionally operable to determine, according to the record in described index information and institute's bitmap information table, the AU data block lacking and meeting resource requirement。
In addition, above-mentioned reception unit, node offer service can be had as resource when network exists terminal, described resource has node when being terminal, receive the index information of the node listing from described Resource Server and described video resource, described node listing at least includes the address information having the terminal of described video resource；Above-mentioned request unit, is additionally operable to the address information according to described terminal and asks its message bit pattern table to counterpart terminal and then determine the situation of described video resource that described counterpart terminal has；Above-mentioned determining unit, the situation of the described video resource for having according to described index information and described counterpart terminal is determined for compliance with the AU data block of resource requirement, and asks described video resource according to described terminal address to described counterpart terminal。
Further, also include: reporting element, for the resource situation obtained by video resource according to the record of message bit pattern table, and when the described resource situation obtained enough plays described video resource, the address information of self is reported Resource Server。
A kind of Resource Server, including:
Cutting unit, has the access unit full code flow point after being encoded by video resource by duration and is slit into multiple access unit AU data block；
Adding device, for adding time paragraph header byte-identifier to each AU data block；
Transmitting element, for being sent to the first terminal of request video resource by the AU data block adding time paragraph header byte-identifier。
Additionally, also include:
Generating unit, generate index information for the capacity according to video resource, index information is used for the first terminal transmissible AU data block of bandwidth request according to self；
Transmitting element, is additionally operable to be sent to index information the first terminal of request video resource。
Preferably, may also include that updating block, for described address information being added in the node listing of storage, in order to the resource having described video resource in record network has node。
Search unit, for when receiving the request obtaining video resource from the second terminal, finding the first terminal having video resource from node listing, and the address information of the described first terminal found is sent to the second terminal。
The transmission of a kind of Streaming Media processes system, including: first terminal and Resource Server；
Described Resource Server, it is slit into multiple access unit AU data block for the access unit full code flow point after being encoded by video resource by duration, and each described AU data block is added time paragraph header byte-identifier, the more described AU data block adding time paragraph header byte-identifier is sent to the first terminal asking described video resource；
Described first terminal, for receiving at least one AU data block of the video resource from described Resource Server, level identities and the time paragraph header byte-identifier of described AU data block is parsed from described AU data block, the message bit pattern table for recording the resource situation that described video resource has obtained is updated according to described time paragraph header byte-identifier and described level identities, wherein, institute's bitmap information table adds level identities field, for the resource situation that physical record has obtained, the AU data block lacked is determined according to the record in institute's bitmap information table, and to described Resource Server。
Additionally, this system also includes: the second terminal；
Described second terminal, for asking described video resource to described Resource Server；
Described Resource Server, it is additionally operable to when receiving the request obtaining described video resource from described second terminal, from described node listing, search the described first terminal having described video resource, and the address information of the described first terminal found is sent to described second terminal。
The scheme that the embodiment of the present invention provides, it is divided into multiple AU data block by the complete code stream of AU after the streaming media of server side adopts SVC coding is on time long, and in AU data block the mode of expansion time paragraph header byte-identifier, realize each AU data block is identified, be conducive to the mark according to AU data block to make terminal recognize and get which AU data block, and carry out, according to the situation obtained, the AU data block that suitable request does not obtain, and then acquirement has the technique effect of resource-sharing in node in different resources；Simultaneously, by increasing level identities and time paragraph header byte-identifier in bitmap information table in end side, make this message bit pattern table can reflect the acquisition situation of resource under SVC, and then guarantee that terminal can determine the AU data block of needs according to this message bit pattern table, and have node autotelic request AU data block to resource, being easy between terminal and realize resource-sharing, AU data block synchronizes。
Accompanying drawing explanation
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, the accompanying drawing used required in embodiment or description of the prior art will be briefly described below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the premise not paying creative work, it is also possible to obtain other accompanying drawing according to these accompanying drawings。
Fig. 1 is the schematic diagram of network abstraction layer unit NALU data structure in background technology；
Fig. 2 is the structural representation of AU composition in background technology；
Fig. 3 is the schematic flow sheet of the transfer processing method of a kind of Streaming Media in the embodiment of the present invention 1；
Fig. 4 is the schematic diagram that complete for AU code stream cuts in the embodiment of the present invention 1 AU data block；
Fig. 5 is the header structural representation in the time paragraph header byte-identifier of AU data block in the embodiment of the present invention 1 and section after sequence number field；
Fig. 6 is the process schematic adding AU data block time paragraph header byte-identifier in the embodiment of the present invention 1；
Fig. 7 synchronizes to share the scene schematic diagram of AU data block for terminal in the transfer processing method of the Streaming Media provided in the embodiment of the present invention 2；
Fig. 8 is the schematic diagram that in the embodiment of the present invention 2, terminal asks synchronous transmitting data；
Fig. 9 is the structural representation of the terminal in the embodiment of the present invention 3；
Figure 10 is the structural representation of the Resource Server in the embodiment of the present invention 4。
Detailed description of the invention
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is only a part of embodiment of the present invention, rather than whole embodiments。Based on the embodiment in the present invention, the every other embodiment that those of ordinary skill in the art obtain under not making creative work premise, broadly fall into the scope of protection of the invention。Further, following embodiment is the alternative of the present invention, embodiment put in order and the numbering of embodiment preferably be carried out order with it unrelated。
Embodiment 1
The present embodiment provides the transfer processing method of a kind of Streaming Media, and the method is mainly used in describing when certain terminal in the present embodiment, when accessing Resource Server acquisition request video first such as first terminal, and the exchange process between Resource Server and terminal。As it is shown on figure 3, the method includes:
101, the AU full code flow point after the video resource coding of Streaming Media is slit into multiple AU data block by duration by Resource Server；
In the method that the present embodiment provides, without influence on the existing mode adopting SVC streaming media to be encoded, the improvement in the present invention is only from the complete code stream of AU produced after coding。
In the scalable video scheme of standard, Resource Server is to forming AU complete stream after original video stream encryption, in the present embodiment, for the ease of shared AU code stream, initially with upper AU full code stream being carried out suitably cutting and labelling cuts the AU data block obtained。
The mode of the data block after labelling segmentation can be divided into based on the segmentation of data block size, split based on duration。It is directed to this programme, because the size of data obtained after each frame coding is different, the mode split based on the size of data block is forced cutting by what inevitably result in Frame, and this cutting is by increase system for safeguarding the expense of this part Frame, but this Section Overhead originally can be avoided。For this, this programme such as preferably employs at the duration partitioning scheme, partitioning scheme is as shown in Figure 4, because video flowing has certain frame per second, can easily completing to wait duration cutting task according to frame per second, the complete code stream of the most whole AU cuts into multiple continuous print AU data block, therefore, in the present invention, Resource Server is asked with AU data block for ultimate unit response terminal。By this ways of distribution, the AU data block situation that terminal record obtains can be easy to, consequently facilitating share data between the terminals。Such as: the individual data frame sign obtained after coding is 1000B, it is assumed that frame per second is 25F/S, one second data volume is 25KB=200Kbit。It is preferred to cut original access unit AU code stream with the durations such as 2 seconds to form sub-AU data block。Meanwhile, this programme assumes that terminal bandwidth in 2 seconds can remain stable substantially, therefore specifies when system realizes that every sub-AU data block frame interior information obtains with identical spatial domain scalability, temporal scalability, quality scalability standard, transmits。
102, each AU data block is added time paragraph header byte-identifier by Resource Server；
A series of AU data block will be formed based on to duration segmentations such as complete AU code stream carry out, realize P2P resource-sharing for the ease of identifying these AU data blocks, this programme proposes in AU data block head information, increase the time period information belonging to " time paragraph header byte-identifier " this AU data block of field identification。Each AU head byte information after increase time paragraph header byte-identifier can refer to shown in Fig. 5。By increasing time paragraph header byte-identifier, it is possible to each AU data block of accurate identification。The time effect of paragraph header byte-identifier is in that: by time period label, can carry out sharing of AU data block more accurately mutual between terminal。The signal that AU full code stream is divided into interpolation time paragraph header byte-identifier refer to shown in Fig. 6。
In preferred version, time paragraph header byte-identifier adopts two byte-identifiers, it is possible to record maximum 65536 time period information。Because if adopting single byte mark, it is possible to recording maximum 256 time period information, if separating AU data block with 2 seconds etc., 256 AU data blocks will accommodate up to the video resource of 256*2s=512s=0.14h, it is clear that is can not meet to be actually needed。Therefore according to the employing double byte mark mentioned in the preferred version of this programme, waiting point data block with 2 seconds, 65536 data blocks will finally hold the video of 65536*2s=131072s=36.41h, it is already possible to meets reality need。When terminal obtains AU data block file, it will the AU data block time paragraph header byte-identifier that record obtains。And this identification information storage is in Bitmap bitmap table。
During in order to ensure terminal to Resource Server request resource, will not support that the situation of the video resource causing terminal cannot obtain request occurs because of the bandwidth resources of terminal, it is preferable that the present embodiment can also comprise the steps 103。
103, Resource Server generates index information according to the capacity of this video resource, and index information is sent to the terminal of request video resource, such as first terminal, the bandwidth requirement that index information includes level identities and level identities should meet, for the first terminal transmissible AU data block of bandwidth request according to self。
Specifically, index information is intended to indicate that minimum bandwidth required when the situation by different level of video resource and each transmission by different level, and in actual applications, this index information is to exist with the form of index file。Just would know that the data which kind of which kind of level identities of bandwidth condition adapted transmission is corresponding by index file terminal。Index file is defined by XML language。One index file is schematically as follows:
Schematically illustrate: this index file defines three level identities that video file is corresponding, respectively 1,2 and 3, and give each level the required lowest-bandwidth information met。As being layered 1 minimum transmission rate needing 10KB/s。The needs of every level bandwidth are can to calculate according to the size of the video resource of this level and time span, such as: if the video resource size 560MB of N shell time mark, video resource duration is 100 minutes, then use the 560MB/100/60 second, when can calculate the video resource of this N shell of terminal request, it is necessary to the lowest-bandwidth requirement possessed。The not broken ends of fractured bone is monitored the own bandwidth suitable level identities of coupling by terminal, during minimum transmission rate request needed for bandwidth meets certain level, can switch in good time, obtain the data that different level identities is corresponding, it is achieved the quality adaptation of SVC coding。Index file herein is only how signal terminal adjusts the SVC quality adaptation encoded according to bandwidth situation。Also needing the AU piecemeal total number information of video file when implementing, the relevant information such as coded video information is added in index file。
Resource Server return index file at the same time it can also be return suitable peerlist list；If there not being any terminal to have this resource in network, peerlist can be empty table or now not return peerlist。
104, when the peerlias that terminal receives is empty or does not have peerlist, then had node by this Resource Server as resource, it is provided that resource service, now perform step 105；Receiving peerlist and not for empty in terminal, terminal may determine that there is terminal in network can have node use as resource, then perform step 106。
Wherein, peerlist is used for storing each resource and has nodal information, mainly comprises the address information that can have the terminal that node uses as resource in information。Terminal can interact according to the node address information in peerlist and node, and then whether the part understanding this video resource that this node has is need belonging to terminal。Wherein, above-mentioned " terminal can interact according to the node address information in peerlist and node " particular content can refer to following step 106。
The address information of each terminal in Peerlist is that each terminal is after getting the video resource of request, and the video resource got is when can meet minimum broadcasting condition (such as having the part that all levels is 1 of this video resource), terminal is reported to Resource Server and is got, and detailed process can refer to following step 110。
105, request that Resource Server sends according to terminal (this request can be terminal at step 104, when not having terminal to have node use as resource in a network, the request again sent, request when can also be that in step 103, terminal is asked first) the AU data block adding time paragraph header byte-identifier is sent to the terminal (setting this terminal as first terminal) asking video resource, and perform step 107。
Now, network just there is first terminal can have node as resource and use, follow-up by this first terminal, this video resource is shared with the second terminal。First terminal herein is interpreted as the first terminal obtaining the specific AU data block of specific level from Resource Server, not necessarily proposes the terminal of resource bid first to Resource Server。But due to before sharing this, it is necessary to ensure that network has terminal to have this video resource, therefore, for asking the scene of this resource first, it is necessary to being provided in terminal by Resource Server by this video resource, namely this step 105 is necessary。
106, in the Peerlist that terminal transmits according to Resource Server, the address information of terminal asks its bitmap (Bitmap0 information table and then determine the situation of video resource that A terminal has to counterpart terminal (being set to A terminal), and the situation of the video resource having according to index information and A terminal is determined for compliance with the AU data block of resource requirement, according still further to address information to video resource described in this A terminal request。After A terminal receives this request, the video resource it obtained shares terminal。
This is 106 specifically: terminal 1 interacts according to the address information on peerlist (node listing) and the node (being set to terminal 2) having video resource, the Bitmap information table (related content after following step 108 is asked for an interview in the explanation about this Bitmap information table) of requesting terminal 2, terminal 1 is by inquiring about Bitmap information table it is known that whether terminal 2 gathers around this video resource, or say accurately, it can also be seen that terminal 2 is specifically gathered around, which level of this video resource。Thus, terminal 1 can ask the part of the video resource of its needs accurately to terminal 2, terminal 2 after receiving the request, by the resource sharing of corresponding part to terminal 1。
107, terminal receives at least one the AU data block of the video resource having node (A terminal or Resource Server) from resource；
108, terminal parses level identities and the time paragraph header byte-identifier of AU data block from AU data block, and updates the Bitmap information table for recording the resource situation that video resource has obtained according to time paragraph header byte-identifier and level identities；
This step 108 contains the important innovations point in this embodiment: the resource-sharing that structure two dimension Bitmap bitmap table realizes between terminal。
Specifically, Bitmap information table is applied to P2P file-sharing, Bitmap information table records the AU data block situation that terminal has obtained, rational AU data block can be obtained from different end by Bitmap information table when sharing AU data block between terminal, finally realize AU data block sharing between terminal (peer)。But existing one-dimensional Bitmap is only by 0, the presence or absence of 1 record AU subcode stream, but in SVC, terminal not only needs the presence or absence of record AU data block, also should record obtain the space of AU data block, quality, time horizon information state, therefore existing one-dimensional Bitmap information table can not efficiently accomplish such function。Propose the two-dimentional Bitmap information table form of improvement for this this programme, effectively record the practical situation of the AU data block that terminal obtains with this。Bitmap information table form is with reference to following table one。
Table one
Bitmap information table is a bivariate table in the present embodiment, every a line time period information is defined in units of the time period, every a line comprises two field informations: whether obtain (accounting for 1bit), level identities (accounts for 10bit, in optimal way, represent the space layer mark of each time period resource in SVC with 4bit, represent that with 4bit the quality layers of each time period resource in SVC identifies, identifies with 3bit the time horizon mark of each time period resource in SVC)。Wherein, whether first character section obtains corresponding time period AU data block situation according to terminal is updated, gained is analyzed by the sub-AU data block obtained in one NALU packet header by level identities: extract relevant layers mark, quality layers mark, time horizon ident value according to the head byte information of NALU sequence in sub-AU data block, carries out computing and ultimately generates level identities and insert in corresponding Bitmap bitmap file。
By two dimension Bitmap table, terminal is possible not only to the presence or absence of record AU data block, and can be known the level situation of the obtained AU data block of terminal by level identities。By the information reportings such as the level identities that will record in this Bitmap information table and time period to Resource Server, it is possible to achieve the resource-sharing of AU data block。
Improved Bitmap bivariate table, every a line is for an AU data block。By the two-dimentional Bitmap information table of above-mentioned table one it can be seen that be the single AU data block information of labelling by adopting 11 bit。One-dimensional Bitmap bitmap table before relatively expands 10 times。It is assumed herein that terminal obtains all of 65536 data blocks, it is assumed that Bitmap table each row accounts for 2B size, and the data that the final size of bivariate table information will be 65536*2B=131072B=128KB, 128KB will not occupy the memory space that terminal is excessive。
Terminal is after obtaining video data resource, and Bitmap information table is filled in by the AU data block according to obtaining。In follow-up P2P is mutual, terminal can determine the AU data block lacked by Bitmap information table, and mutual with other Peer。
109, terminal determines the AU data block lacked according to the record in Bitmap information table, and has node request to resource。Resource has node and comprises A terminal and Resource Server。The AU data block lacked is obtained according to 104 to 108 steps。
Preferably, above-mentioned terminal determines that according to the record in Bitmap information table the AU data block lacked can be: terminal determines the AU data block lacking and meeting resource requirement according to the record in index information and Bitmap information table。
Specifically, for instance: terminal checks the first row of two dimension Bitmap form by one-dimensional Bitmap mode, can show that terminal obtains resource situation from first row。Definition " 0 " is not for obtain, and " 1 " does not obtain。As: assume whether inquiry n-th data block obtains, it is possible to according to bivariate table line number value N, the value of inquiry X [N] [1] judges。Thus, the AU data block of terminal which time period known does not obtain, and according to the bandwidth that the level not obtained accordingly in the bandwidth of terminal and index information requires, the A terminal request having this level resource known in step 106。After A terminal receives this request, the video resource it obtained shares terminal。
Wherein, after A terminal receives this request, specifically can be as follows by the process of resource sharing to terminal:
The A terminal level identities according to a line every in the Bitmap information table of oneself, it is possible to know the level identities of the AU data block that A terminal has。If to the value of the level identities required for the terminal of its request value less than the level identities of A terminal, then A terminal can be Terminal for service。Otherwise it is not provided that service。
One concrete example is such as shown in following table two:
Table two
From above table two:
1, whether obtain AU data block, be can determine that by " whether obtaining " mark；0 expression there is no, and 1 expression obtains；
2, terminal has #2, #N time period resource, it does not have #1 time period resource；
3, because there is no #1 time period resource, if obtaining bit-identify is 0；Now A terminal cannot provide #1AU Resource Block to other-end。
4, when request #2 time period resource, #2 resource hierarchy is designated 0000000010, namely represents that terminal has the #2AU data block that level is 2；The AU request of data that level request is not more than 2 can be met。
5, when request #N time period resource, #N resource hierarchy is designated 0000000101, namely represents that terminal has the #NAU data block that level is 5；The AU request of data that level request is not more than 5 can be met。
From the above analysis, it can be deduced that conclusion: can know, from two dimension Bitmap information table, the time period resource information that terminal has, thus realizing resource-sharing between the terminals。
110, when terminal obtain this video resource part enough by this video playback out time, the address information of self is reported Resource Server, so that this address information is added in peerlist by Resource Server, so, Resource Server just can count in network has have this video resource on earth for which terminal。
According to the record in Bitmap information table, terminal is appreciated that the resource of which level all obtains。Such as: when the resource of level 1 all gets, just can meeting the condition playing this video resource, can report to Resource Server, notice this terminal of Resource Server has had this video resource。
After terminal gets the AU data block of this video resource, terminal numbers restructuring video resource according to the AU data block time period, and the final this locality that realizes is play。
SVC technology is applied under P2P framework by the scheme that this enforcement provides, proposing to cut the complete code stream of AU by duration is multiple AU data blocks, and increase the technological means of AU data block head label information, and reasonable in design, efficient 2-d Bitmap information table, finally realize a kind of SVC solution terminal bandwidth variation under P2P service architecture, between the diversified real network streaming media service demand of terminal and terminal, share the technique effect of SVC data resource。
Embodiment 2
The present embodiment is specifically in conjunction with the scene shown in Fig. 7, it is provided that the transfer processing method of a kind of Streaming Media, and the method may be considered and describes than embodiment 1 more specifically example。
For the ease of describe, set in the present embodiment request video resource correspondence generate index information as:
Wherein, PeerA node bandwidth is 65KB/s, it is possible to the AU data block resource of application access level 3；Wherein, PeerB node bandwidth is 15KB/s, it is possible to the AU data block resource of application access level 1；
Wherein, PeerC node bandwidth is 35KB/s, it is possible to the AU data block resource of application access level 2；
Concrete grammar is as follows:
PeerA node accesses this video resource to Resource Server application, and Resource Server detects the Peer node having respective resources in current network, then transmits level 3 data for PeerA；PeerA becomes the first terminal node having level 3 video resource in network
PeerA updates local Bitmap information table, and reports nodal information situation to Resource Server；
PeerB node accesses this video resource to Resource Server application, and Resource Server detects that in current network, PeerA has the peer of respective resources, returns the Peerlist of relevant PeerA part relevant information；The PeerB node Bitmap information table according to PeerA, asks the AU data block of level 1 to PeerA, and PeerA transmits the AU data block of level 1 to PeerB；
PeerB updates local Bitmap information table, and reports the nodal information situation of PeerB to server；
PeerC node accesses this video resource to Resource Server application, and Resource Server detects that in current network, PeerA, B have respective resources, return the Peerlist comprising PeerA, B relevant information；The PeerC node Bitmap information table according to PeerA, B, asks the AU data block of level 1,2 to PeerA, B, and PeerA, B transmit the AU data block of level 1,2 to PeerC；
PeerC updates local Bitmap information table, and reports the nodal information situation of PeerC to Resource Server；So far complete Resource Exchange and share flow process。
Additionally, in the present embodiment when PeerA, PeerB transmit the AU data block of level 1 to PeerC, relate to synchronization mechanism。Assume that the AU data block of level 1 has 10, wherein the good time period numbering of each AU data block labelling all。So the AU transmission of data blocks method of synchronization of level 1 is as shown in Figure 8:
By AU piecemeal dispatching algorithm, such that it is able to carry out carrying out between terminal effective data syn-chronization。
For example herein, can obtain, from PeerA, the AU data block being numbered 1 to 5 with reference to Fig. 8, PeerC；The AU data block being numbered 6 to 10 is obtained from PeerB。Such PeerA, PeerB will not transmit the AU data block of repetition, individually again to relevant Peer node, the AU data block of disappearance can be sent request when PeerC lacks certain data block。Wherein, how PeerC obtains different data from PeerA, B。When implementing, various synchronized algorithm can be designed according to network resource status etc.。It is not repeated herein。
Embodiment 3
The present embodiment provides a kind of terminal, can be used as the terminal in embodiment 1,2/peer and uses。As it is shown in figure 9, include: receive unit 31, resolution unit 32, record unit 33, it is determined that unit 34。
Receive unit 31, for receiving at least one the AU data block of the video resource having node from resource；Resolution unit 32, for parsing level identities and the time paragraph header byte-identifier of AU data block from AU data block；Record unit 33, for updating the Bitmap information table for recording the resource situation that video resource has obtained according to time paragraph header byte-identifier and level identities；Determine unit 34, for determining the AU data block lacked according to the record in Bitmap information table, and have node request to resource。
Additionally, this terminal also includes: request unit 34, for asking video resource to Resource Server；
Correspondingly, receive unit 31, being additionally operable to work as and be absent from terminal in network and can have node as resource and provide service, described resource has node when being Resource Server, receives index information and at least one AU data block of the described video resource from described Resource Server；
Correspondingly, it is determined that unit 34, it is additionally operable to determine, according to the record in index information and Bitmap information table, the AU data block lacking and meeting resource requirement。
In addition, receive unit 31, be additionally operable to work as network exists terminal can as resource have node provide service, described resource has node when being terminal, receive the index information of the node listing from described Resource Server and described video resource, described node listing at least includes the address information having the terminal of described video resource；Request unit 34, is additionally operable to the address information according to described terminal and asks its message bit pattern table to counterpart terminal and then determine the situation of described video resource that described counterpart terminal has；
Correspondingly, it is determined that unit 34, the situation of the described video resource for having according to described index information and described counterpart terminal is determined for compliance with the AU data block of resource requirement, and asks described video resource according to described terminal address to described counterpart terminal。
Preferably, may also include that reporting element 35, for the resource situation obtained by described video resource according to the record of institute's bitmap information table, and when the described resource situation obtained enough plays described video resource, report Resource Server。
Terminal in the present embodiment can according to parsing level identities and time paragraph header byte-identifier renewal Bitmap information table from AU data block, and this Bitmap information table may be used for the AU data block of record SVC technology, therefore it is easy to terminal and determines the applicable resource needing to obtain according to the information of the record in this Bitmap information table, Resource Server is made to grasp the video resource that in network, each terminal gets simultaneously also by the means getting video resource to Resource Server report terminal, and the address information that resource has terminal informs the terminal of request by peerlist, thus realizing resource sharing between each terminal, the technique effect of source synchronous。
Embodiment 4
The present embodiment provides a kind of Resource Server, and this Resource Server can be used for swapping with the terminal in embodiment 3, it is also possible to use as the Resource Server in embodiment 1 and embodiment 2。As shown in Figure 10, cutting unit 41, adding device 42, transmitting element 43 are specifically included that。
Cutting unit 41, has the access unit full code flow point after being encoded by video resource by duration and is slit into multiple access unit AU data block；Adding device 42, for adding time paragraph header byte-identifier to each AU data block；Transmitting element 43, for being sent to the first terminal of request video resource by the AU data block adding time paragraph header byte-identifier。
Preferably, may also include that generation unit 44, generate index information for the capacity according to video resource, index information is used for the first terminal transmissible access unit data block of bandwidth request according to self；
Correspondingly, transmitting element 43, it is additionally operable to be sent to index information the first terminal of request video resource。
Preferably, may also include that updating block, search unit。
Updating block, for adding to described address information in the node listing of storage, in order to the resource having described video resource in record network has node。
Search unit, for when receiving the request obtaining video resource from the second terminal, finding the first terminal having video resource from node listing, and the address information of the described first terminal found is sent to the second terminal。
The Resource Server that the present embodiment provides is by being divided into multiple AU data block by time long for complete for AU code stream, and in each AU data block, add the technological means of time paragraph header byte-identifier, make server and terminal all can determine concrete resource according to this time paragraph header byte-identifier, and then be easy to terminal and only need to the AU data block that Resource Server or other terminal request are suitable for, it may be achieved resource sharing。
Embodiment 5
The present embodiment provides the transmission of a kind of Streaming Media to process system, including first terminal and Resource Server；
Wherein, Resource Server, it is slit into multiple access unit AU data block for the access unit full code flow point after being encoded by video resource by duration, and each AU data block is added time paragraph header byte-identifier, then the AU data block adding time paragraph header byte-identifier is sent to the first terminal of request video resource；
First terminal, for receiving at least one AU data block of the video resource from Resource Server, level identities and the time paragraph header byte-identifier of AU data block is parsed from AU data block, the message bit pattern table for recording the resource situation that video resource has obtained is updated according to time paragraph header byte-identifier and level identities, wherein, message bit pattern table adds level identities field, for the resource situation that physical record has obtained, the AU data block lacked is determined according to the record in message bit pattern table, and to Resource Server。
Additionally, this system also includes: the second terminal；
Second terminal, for asking video resource to Resource Server；Correspondingly, Resource Server, it is additionally operable to, when receiving the request obtaining video resource from the second terminal, from node listing, search the first terminal having video resource, and the address information of the first terminal found is sent to the second terminal。
In the system that the embodiment of the present invention provides, the complete code stream of AU length on time after the streaming media employing SVC coding of Resource Server is divided into multiple AU data block, and in AU data block the mode of expansion time paragraph header byte-identifier, thus can realize each AU data block is identified, be conducive to the mark according to AU data block to make terminal recognize and get which AU data block, and carry out, according to the situation obtained, the AU data block that suitable request does not obtain, and then acquirement has the technique effect of resource-sharing in node in different resources；Simultaneously, by increasing level identities and time paragraph header byte-identifier in the message bit pattern table of first terminal, make this message bit pattern table can reflect the acquisition situation of resource under SVC, and then guarantee that terminal can determine the AU data block of needs according to this message bit pattern table, and have node autotelic request AU data block to resource, being easy between first terminal and the second terminal and realize resource-sharing, AU data block synchronizes。
Through the above description of the embodiments, those skilled in the art is it can be understood that can add the mode of required general hardware platform by software to the present invention and realize, naturally it is also possible to by hardware, but in a lot of situation, the former is embodiment more preferably。Based on such understanding, the part that prior art is contributed by technical scheme substantially in other words can embody with the form of software product, this computer software product is stored in the storage medium that can read, floppy disk such as computer, hard disk or CD etc., including some instructions with so that equipment method of performing each embodiment of the present invention。
Above; being only the specific embodiment of the present invention, but protection scope of the present invention is not limited thereto, any those familiar with the art is in the technical scope that the invention discloses; change can be readily occurred in or replace, all should be encompassed within protection scope of the present invention。Therefore, protection scope of the present invention should be as the criterion with scope of the claims。
Claims (18)
1. the transfer processing method of a Streaming Media, it is characterised in that including:
Receive at least one access unit AU data block of the video resource having node from resource；
Level identities and the time paragraph header byte-identifier of described AU data block is parsed from described AU data block；
Update the message bit pattern table for recording the resource situation that described video resource has obtained according to described time paragraph header byte-identifier and described level identities, wherein, institute's bitmap information table adds level identities field, for the resource situation that physical record has obtained；
Determine the AU data block lacked according to the record in institute's bitmap information table, and have node request to described resource。
2. the transfer processing method of Streaming Media according to claim 1, it is characterized in that, node offer service can be had as resource when network is absent from terminal, described resource has node when being Resource Server, described in receive at least one AU data block of the video resource having node from resource and specifically include:
Video resource is asked to Resource Server；
Receive the index information of the described video resource from described Resource Server and at least one AU data block, wherein, the bandwidth requirement that described index information includes level identities and described level identities should meet；
Described determine that the AU data block lacked specifically includes according to the record in institute's bitmap information table:
The AU data block lacking and meeting resource requirement is determined according to the record in described index information and institute's bitmap information table。
3. the transfer processing method of Streaming Media according to claim 1, it is characterised in that can having node as resource provide service when there is terminal in network, described resource has node when being terminal, and the method also includes:
Described video resource is asked to Resource Server；
Receive the index information of the node listing from described Resource Server and described video resource, described node listing at least includes the address information having the terminal of described video resource, wherein, the bandwidth requirement that described index information includes level identities and described level identities should meet；
Ask its message bit pattern table according to the address information of described terminal to counterpart terminal and then determine the situation of described video resource that described counterpart terminal has；
The situation of the described video resource having according to described index information and described counterpart terminal is determined for compliance with the AU data block of resource requirement, and asks described video resource according to described terminal address to described counterpart terminal。
4. the transfer processing method of Streaming Media as claimed in any of claims 1 to 3, it is characterised in that the method also includes:
The resource situation that described video resource has obtained determined in record according to institute's bitmap information table；
When the described resource situation obtained enough plays described video resource, report Resource Server。
5. the transfer processing method of a Streaming Media, it is characterised in that including:
Access unit full code flow point after being encoded by video resource by duration is slit into multiple AU data block；
Each described AU data block is added time paragraph header byte-identifier；
The described AU data block adding time paragraph header byte-identifier is sent to the first terminal asking described video resource；
The method also includes: generate index information according to the capacity of described video resource, the bandwidth requirement that described index information includes level identities and described level identities should meet, for the described first terminal transmissible AU data block of bandwidth request according to self；
Wherein, described time paragraph header byte-identifier and described level identities update the message bit pattern table for recording the resource situation that described video resource has obtained, and determine the AU data block lacked according to the record in institute's bitmap information table。
6. the transfer processing method of Streaming Media according to claim 5, it is characterised in that the method also includes:
Described index information is sent to the first terminal asking described video resource。
7. the transfer processing method of Streaming Media according to claim 5, it is characterised in that the method also includes:
Receive the address information from described first terminal；
Described address information is added in the node listing of storage, in order to the resource having described video resource in record network has node。
8. the transfer processing method of Streaming Media according to claim 7, it is characterised in that the method also includes:
Receive the request obtaining described video resource from the second terminal；
From described node listing, find the first terminal having described video resource, and the address information of the described first terminal found is sent to described second terminal。
9. a terminal, it is characterised in that including:
Receive unit, for receiving at least one the AU data block of the video resource having node from resource；
Resolution unit, for parsing level identities and the time paragraph header byte-identifier of described AU data block from described AU data block；
Record unit, for updating the message bit pattern table for recording the resource situation that described video resource has obtained according to described time paragraph header byte-identifier and described level identities；
Determine unit, for determining, according to the record in institute's bitmap information table, the AU data block lacked, and have node request to resource。
10. terminal according to claim 9, it is characterised in that
This terminal also includes: request unit, for asking video resource to Resource Server；
Described reception unit, be additionally operable to work as network is absent from terminal can as resource have node provide service, described resource has node when being Resource Server, receives index information and at least one AU data block of the described video resource from described Resource Server；
Described determine unit, be additionally operable to determine, according to the record in described index information and institute's bitmap information table, the AU data block lacking and meeting resource requirement。
11. terminal according to claim 9, it is characterised in that
This terminal also includes: request unit, for asking video resource to Resource Server；
Described reception unit, be additionally operable to work as network exists terminal can as resource have node provide service, described resource has node when being terminal, receive the index information of the node listing from described Resource Server and described video resource, described node listing at least includes the address information having the terminal of described video resource；
Described request unit, is additionally operable to the address information according to described terminal and asks its message bit pattern table to counterpart terminal and then determine the situation of described video resource that described counterpart terminal has；
Described determining unit, the situation of the described video resource for having according to described index information and described counterpart terminal is determined for compliance with the AU data block of resource requirement, and asks described video resource according to described terminal address to described counterpart terminal。
12. the terminal according to any one in claim 9 to 11, it is characterised in that also include:
Reporting element, determines, for the record according to institute's bitmap information table, the resource situation that described video resource has obtained, and when the described resource situation obtained enough plays described video resource, reports Resource Server。
13. a Resource Server, it is characterised in that including:
Cutting unit, is slit into multiple access unit AU data block for the access unit full code flow point after being encoded by video resource by duration；
Adding device, for adding time paragraph header byte-identifier to each described AU data block；
Transmitting element, for being sent to, by the described AU data block adding time paragraph header byte-identifier, the first terminal asking described video resource；
Generate unit, index information is generated for the capacity according to described video resource, the bandwidth requirement that described index information includes level identities and described level identities should meet, described index information is used for the described first terminal transmissible AU data block of bandwidth request according to self；
Wherein, described time paragraph header byte-identifier and described level identities update the message bit pattern table for recording the resource situation that described video resource has obtained, and determine the AU data block lacked according to the record in institute's bitmap information table。
14. Resource Server according to claim 13, it is characterised in that
Also include: described transmitting element, be additionally operable to described index information is sent to the first terminal asking described video resource。
15. Resource Server according to claim 13, it is characterised in that also include:
Updating block, for adding to address information in the node listing of storage, in order to the resource having described video resource in record network has node。
16. Resource Server according to claim 15, it is characterised in that also include:
Search unit, for when receiving the request obtaining described video resource from the second terminal, from described node listing, find the first terminal having described video resource, and the address information of the described first terminal found is sent to described second terminal。
17. the transmission of a Streaming Media processes system, it is characterised in that including: first terminal and Resource Server；
Described Resource Server, it is slit into multiple access unit AU data block for the access unit full code flow point after being encoded by video resource by duration, and each described AU data block is added time paragraph header byte-identifier, the more described AU data block adding time paragraph header byte-identifier is sent to the first terminal asking described video resource；
Described first terminal, for receiving at least one AU data block of the video resource from described Resource Server, level identities and the time paragraph header byte-identifier of described AU data block is parsed from described AU data block, the message bit pattern table for recording the resource situation that described video resource has obtained is updated according to described time paragraph header byte-identifier and described level identities, wherein, institute's bitmap information table adds level identities field, for the resource situation that physical record has obtained, the AU data block lacked is determined according to the record in institute's bitmap information table, and to described Resource Server。
18. the transmission of Streaming Media according to claim 17 processes system, it is characterised in that this system also includes: the second terminal；
Described second terminal, for asking described video resource to described Resource Server；
Described Resource Server, it is additionally operable to when receiving the request obtaining described video resource from described second terminal, from node listing, find the described first terminal having described video resource, and the address information of the described first terminal found is sent to described second terminal。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110423228.8A CN103167319B (en) | 2011-12-16 | 2011-12-16 | The transfer processing method of a kind of Streaming Media, Apparatus and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110423228.8A CN103167319B (en) | 2011-12-16 | 2011-12-16 | The transfer processing method of a kind of Streaming Media, Apparatus and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103167319A CN103167319A (en) | 2013-06-19 |
| CN103167319B true CN103167319B (en) | 2016-06-22 |
Family
ID=48590018
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110423228.8A Active CN103167319B (en) | 2011-12-16 | 2011-12-16 | The transfer processing method of a kind of Streaming Media, Apparatus and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103167319B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105657470B (en) * | 2015-12-31 | 2018-09-28 | 深圳市海云天科技股份有限公司 | A kind of recording method of bit map type video tour and system |
| CN105635188B (en) * | 2016-03-31 | 2019-07-09 | 深圳市矽伟智科技有限公司 | A kind of visual content distribution method and system |
| CN114124940A (en) * | 2021-11-30 | 2022-03-01 | 上海御渡半导体科技有限公司 | Data customization transmission method based on UDP protocol |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007051425A1 (en) * | 2005-11-03 | 2007-05-10 | Huawei Technologies Co., Ltd. | A multimedia communication method and the terminal thereof |
| CN101500157A (en) * | 2008-12-31 | 2009-08-05 | 深圳市同洲电子股份有限公司 | Method and apparatus for converting access unit into transmission flow |
| US20110208829A1 (en) * | 2010-02-23 | 2011-08-25 | Samsung Electronics Co., Ltd. | Method and apparatus for transmitting and receiving data |
-
2011
- 2011-12-16 CN CN201110423228.8A patent/CN103167319B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007051425A1 (en) * | 2005-11-03 | 2007-05-10 | Huawei Technologies Co., Ltd. | A multimedia communication method and the terminal thereof |
| CN101500157A (en) * | 2008-12-31 | 2009-08-05 | 深圳市同洲电子股份有限公司 | Method and apparatus for converting access unit into transmission flow |
| US20110208829A1 (en) * | 2010-02-23 | 2011-08-25 | Samsung Electronics Co., Ltd. | Method and apparatus for transmitting and receiving data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103167319A (en) | 2013-06-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101973544B1 (en) | Method and apparatus for transmitting/receiving hybrid media content in a multimedia system | |
| JP6903606B2 (en) | Content transmission / reception method and equipment | |
| US10630759B2 (en) | Method and apparatus for generating and reproducing adaptive stream based on file format, and recording medium thereof | |
| US8776150B2 (en) | Implementation method and system for a media-on-demand frame-spanning playing mode in a peer-to-peer network | |
| CN103069492B (en) | Use storage method and the client terminal device of the storage file format for transmission of multimedia streams file | |
| JP6181650B2 (en) | Transmission device, transmission method, and network device | |
| CN101677325B (en) | Method, device and system for publishing media description information and acquiring media | |
| EP2666288B1 (en) | Apparatus and method for storing and playing content in a multimedia streaming system | |
| JP5592960B2 (en) | Apparatus and method for recording and reproducing media file and recording medium thereof | |
| CN105704159A (en) | Method for providing media and server | |
| KR20040068505A (en) | Method for splitting and distributing a file | |
| CN102143150A (en) | Method, device and system for obtaining media contents | |
| CN103167319B (en) | The transfer processing method of a kind of Streaming Media, Apparatus and system | |
| CN103856778A (en) | System and Method for Processing Video Files | |
| CN106105239B (en) | Sending device, sending method, receiving device, method of reseptance and program | |
| CN105191324A (en) | Communication apparatus, communication data generation method, and communication data processing method | |
| CN104113545A (en) | Streaming media system under information center network and application method thereof | |
| CN103561013A (en) | Streaming media data distributing system | |
| CN101288286B (en) | Method and devices for the transfer of a data flow from a data source to a data sink | |
| JP2013258657A (en) | Terminal and program for use in p2p network service | |
| CN101389010B (en) | Player and playing method | |
| CN108924573A (en) | Data Stream Processing, playback method, server, playing device, system and medium | |
| CN111147952B (en) | Method and device for sending monitoring resource data and storage medium | |
| CN113949696B (en) | Resource distribution method, electronic device, and computer-readable storage medium | |
| TW201937938A (en) | Decoder, decoding method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |