CN103167319A - Transmission processing method, device and system of streaming media - Google Patents
Transmission processing method, device and system of streaming media Download PDFInfo
- Publication number
- CN103167319A CN103167319A CN2011104232288A CN201110423228A CN103167319A CN 103167319 A CN103167319 A CN 103167319A CN 2011104232288 A CN2011104232288 A CN 2011104232288A CN 201110423228 A CN201110423228 A CN 201110423228A CN 103167319 A CN103167319 A CN 103167319A
- Authority
- CN
- China
- Prior art keywords
- resource
- terminal
- data block
- video resource
- request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a transmission processing method, a device and a system of streaming media and relates to the video coding field. The transmission processing method, the device and the system of the streaming media solves the technical problem in the prior art that the transmission processing method of switching virtual circuit (SVC) technique streaming media cannot achieve resource sharing. The transmission method of the streaming media mainly comprises the following steps: at least one AU data block of the video resources from resources possessing nodes is received, layer identification and a time paragraph header byte identification of the AU data block are analyzed from the AU data block, bitmap information chart used for recording resource status obtained by the video resources is renewed according to the time paragraph header byte identification and the layer identification, and the missing AU block according to records of the bitmap information chart is confirmed and requested to the resources possessing nodes. The transmission processing method, the device and the system of the streaming media are mainly used for streaming media resource sharing.
Description
Technical field
The present invention relates to field of video encoding, relate in particular to a kind of transfer processing method, Apparatus and system of Streaming Media.
Background technology
SVC (Scalable Vedio Coding, scalable video) technology is according to flexible time domain, the spatial domain scalability, three dimensions of quality scalability, each frame to the inlet flow Media Stream carries out hierarchical coding, same primitive frame is finally encoded and is formed the Frame of a plurality of different levels, the Frame that produces after these codings is encapsulated in VCL (Video Coding Layer, the Video coding layer), and be that each VCL level is according to adding NAL (Network Access Layer, network abstraction layer) leader is known, the VCL coded data is encapsulated in network abstraction layer unit NALU the most at last, NALU unit structure as shown in Figure 1.A plurality of NALU will be combined and finally be encapsulated in access unit AU (Access Unit).Access unit AU structure as shown in Figure 2, each access unit AU is the complete or collected works to same frame coded data, each access AU of unit comprises one group of NALU.Access unit AU arranged in sequence is completed the coding to whole video file the most at last.：
In prior art, transmission processing mode for AU is as follows: when the terminal request video file, Resource Server is selected suitable NALU sequence according to the real-time bandwidth situation of terminal from whole access unit AU stream, these NALU sequences are spliced the request of final composition AU subcode stream response terminal again, thereby complete the request responding process of files in stream media, complete the transmission of video service.
But, state in realization in process, there is at least following technical problem in prior art:
The hierarchical coding mode of prior art is in the SVC of standard scheme, and this mode makes and may have different AU subcode stream data between terminal, causes can not sharing between terminal the AU subcode stream data that obtain each other, is unfavorable for resource-sharing; In addition, because existing Bitmap table is one-dimentional structure, only can whether obtain related resource by 0,1 marking terminal, so in the SVC scheme, the existing Bitmap of terminal table can't be expressed the situation based on three dimensions of SVC resource that obtains, and cause effectively satisfying the technical problem that SVC shares.
Summary of the invention
Embodiments of the invention provide a kind of transfer processing method, Apparatus and system of Streaming Media, provide the streaming media service demand in order to be embodied as the diversified real network of terminal, and the purpose of sharing the SVC data resource between terminal.
A kind of transfer processing method of Streaming Media comprises:
Receive at least one the AU data block that has the video resource of node from resource;
Parse level sign and the time paragraph header byte-identifier of AU data block from the AU data block;
The message bit pattern table that is used for the resource situation that the recording of video resource obtained according to time paragraph header byte-identifier and level identification renewal;
Determine the AU data block that lacks according to the record in the message bit pattern table, and have the node request to resource.
Wherein, do not exist terminal to can be used as resource in network and have node service is provided, when described resource had node and is Resource Server, described at least one the AU data block that has a video resource of node from resource that receives specifically comprised:
To Resource Server request video resource;
Receive index information and at least one AU data block from the described video resource of described Resource Server, wherein, described index information comprises the bandwidth requirement that level sign and described level sign should satisfy;
Accordingly, describedly determine that according to the record in described message bit pattern table the AU data block that lacks specifically comprises:
Determine to lack and meet the AU data block of resource requirement according to the record in described index information and described message bit pattern table.
Wherein, exist terminal to can be used as resource in network and have node service is provided, when resource had node and is terminal, the method also comprised:
To Resource Server request video resource;
Receive from the node listing of described Resource Server and the index information of described video resource, at least comprise the address information of the terminal that has described video resource in described node listing, wherein, described index information comprises the bandwidth requirement that level sign and described level sign should satisfy;
According to the address information of described terminal to its message bit pattern table of counterpart terminal request and then determine the situation of the described video resource that described counterpart terminal has;
The situation of the described video resource that has according to described index information and described counterpart terminal determines to meet the AU data block of resource requirement, and according to described terminal address to the described video resource of described counterpart terminal request.
In addition, the method also comprises:
The resource situation of video resource having been obtained according to the record of message bit pattern table, and when the described resource situation of having obtained is enough play described video resource, the address information of self is reported Resource Server.
A kind of transfer processing method of Streaming Media comprises:
Access unit full code flow point after by duration, video resource being encoded is slit into a plurality of access unit AU data blocks;
Each AU data block is added time paragraph header byte-identifier;
The AU data block of adding time paragraph header byte-identifier is sent to the first terminal of request video resource.
In addition, the method also comprises: receive the address information from described first terminal;
Described address information is added in the node listing of storage, have node in order to record the resource that has described video resource in network.
In addition, the method also comprises: receive the request of obtaining video resource from the second terminal;
Find the first terminal that has video resource from node listing, and the address information of the described first terminal that will find sends to the second terminal.
A kind of terminal comprises:
Receiving element is used for receiving at least one the AU data block that has the video resource of node from resource;
Resolution unit is for the level sign and the time paragraph header byte-identifier that parse the AU data block from the AU data block;
Record cell is used for being used for according to time paragraph header byte-identifier and level identification renewal the message bit pattern table of the resource situation that the recording of video resource obtained;
Determining unit for the AU data block of determining according to the record of message bit pattern table to lack, and has the node request to resource.
In addition, this terminal also comprises: request unit is used for to Resource Server request video resource;
Accordingly, above-mentioned receiving element, described receiving element, also be used for not having node service being provided when network does not exist terminal to can be used as resource, when described resource has node and is Resource Server, receive index information and at least one AU data block from the described video resource of described Resource Server; Determining unit is also for determine to lack and meet the AU data block of resource requirement according to the record of described index information and described message bit pattern table.
In addition, above-mentioned receiving element, existing terminal to can be used as resource in network has node service is provided, when described resource has node and is terminal, receive from the node listing of described Resource Server and the index information of described video resource, comprise at least the address information of the terminal that has described video resource in described node listing; Above-mentioned request unit also is used for according to the address information of described terminal to its message bit pattern table of counterpart terminal request and then determines the situation of the described video resource that described counterpart terminal has; Above-mentioned determining unit, the situation that is used for the described video resource that has according to described index information and described counterpart terminal determines to meet the AU data block of resource requirement, and according to described terminal address to the described video resource of described counterpart terminal request.
Further, also comprise: report the unit, be used for the resource situation that the record according to the message bit pattern table has obtained video resource, and when the described resource situation of having obtained is enough play described video resource, the address information of self reported Resource Server.
A kind of Resource Server comprises:
Cutting unit, the access unit full code flow point that has after by duration, video resource being encoded is slit into a plurality of access unit AU data blocks;
Adding device is used for each AU data block is added time paragraph header byte-identifier;
Transmitting element sends to the first terminal of asking video resource for the AU data block that will add time paragraph header byte-identifier.
In addition, also comprise:
Generation unit is used for the capacity generating indexes information according to video resource, and index information is used for first terminal AU data block transmissible according to the bandwidth request of self;
Transmitting element also is used for index information is sent to the first terminal of asking video resource.
Preferably, also can comprise: updating block, be used for adding described address information the node listing of storage to, have node in order to record the resource that has described video resource in network.
Search the unit, be used for receive from the second terminal obtain the request of video resource the time, find the first terminal that has video resource from node listing, and the address information of the described first terminal that will find sends to the second terminal.
A kind of transmission treatment system of Streaming Media comprises: first terminal and Resource Server;
Described Resource Server, access unit full code flow point after being used for by duration, video resource being encoded is slit into a plurality of access unit AU data blocks, and each described AU data block is added time paragraph header byte-identifier, the more described AU data block of adding time paragraph header byte-identifier is sent to the first terminal of the described video resource of request;
described first terminal, be used for receiving at least one the AU data block from the video resource of described Resource Server, parse level sign and the time paragraph header byte-identifier of described AU data block from described AU data block, the message bit pattern table that is used for recording the resource situation that described video resource obtained according to described time paragraph header byte-identifier and described level identification renewal, wherein, increased the level identification field in described message bit pattern table, be used for the resource situation that physical record has obtained, determine the AU data block that lacks according to the record in described message bit pattern table, and to described Resource Server.
In addition, this system also comprises: the second terminal;
Described the second terminal is used for asking described video resource to described Resource Server;
Described Resource Server, also be used for receive from described the second terminal obtain the request of described video resource the time, search the described first terminal that has described video resource from described node listing, and the address information of the described first terminal that will find sends to described the second terminal.
The scheme that the embodiment of the present invention provides, be divided into a plurality of AU data blocks by grow at the complete code stream of AU to after Streaming Media employing SVC coding of server side on time, and in the AU data block mode of expansion time paragraph header byte-identifier, realization identifies each AU data block, being conducive to sign according to the AU data block recognizes terminal to have got which AU data block, and carry out according to the situation of obtaining the AU data block that suitable request does not obtain, and then obtain the technique effect of resource-sharing in different resources has node; Simultaneously, by increase level sign and time paragraph header byte-identifier in the bitmap information table in end side, make this message bit pattern table can reflect the situation of obtaining of resource under SVC, and then guarantee that terminal can determine according to this message bit pattern table the AU data block of needs, and have the autotelic request of node AU data block to resource, be convenient to realize between terminal resource-sharing, the AU data block is synchronous.
Description of drawings
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, the below will do to introduce simply to the accompanying drawing of required use in embodiment or description of the Prior Art, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain according to these accompanying drawings other accompanying drawing.
Fig. 1 is the schematic diagram of network abstraction layer unit NALU data structure in background technology;
Fig. 2 is the structural representation that in background technology, AU forms;
Fig. 3 is the schematic flow sheet of a kind of transfer processing method of Streaming Media in the embodiment of the present invention 1;
Fig. 4 in the embodiment of the present invention 1 cuts into the complete code stream of AU the schematic diagram of AU data block;
Fig. 5 is the time paragraph header byte-identifier of AU data block in the embodiment of the present invention 1 and the header structural representation after the interior sequence number field of section;
Fig. 6 adds the process schematic diagram of AU data block time paragraph header byte-identifier in the embodiment of the present invention 1;
The scene schematic diagram of terminal synchronizes sharing A U data block in the transfer processing method of the Streaming Media that provides in the embodiment of the present invention 2 is provided Fig. 7;
Fig. 8 is the schematic diagram that in the embodiment of the present invention 2, terminal is asked synchronous transmitting data;
Fig. 9 is the structural representation of the terminal in the embodiment of the present invention 3;
Figure 10 is the structural representation of the Resource Server in the embodiment of the present invention 4.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is only the present invention's part embodiment, rather than whole embodiment.Based on the embodiment in the present invention, those of ordinary skills belong to the scope of protection of the invention not making the every other embodiment that obtains under the creative work prerequisite.And, below each embodiment be possibility of the present invention, embodiment put in order and the numbering execution sequence preferred with it of embodiment irrelevant.
The present embodiment provides a kind of transfer processing method of Streaming Media, and the method is mainly used in describing when certain terminal in the present embodiment, when the access resources server request obtains video first as first terminal, and the exchange process between Resource Server and terminal.As shown in Figure 3, the method comprises:
101, the AU full code flow point after Resource Server is encoded the video resource of Streaming Media by duration is slit into a plurality of AU data blocks;
In the method that the present embodiment provides, can not affect the mode that existing employing SVC encodes to Streaming Media, the improvement in the present invention is only from the complete code stream of AU of the rear generation of encoding.
In the scalable video scheme of standard, Resource Server forms the AU complete stream after to the original video stream encryption, in the present embodiment, for the ease of sharing A U code stream, at first adopt upper AU full code stream is carried out suitably cutting the AU data block that also mark cutting obtains.
The mode of the data block after mark is cut apart can be divided into the based on data block size and cut apart, cuts apart based on duration.Be directed to this programme, because the size of data that obtains after each frame coding is different, the mode that the based on data block size is cut apart will inevitably cause the cutting that is forced to of Frame, and this cutting will increase system for the expense of safeguarding this part Frame, but this part expense originally can be avoided.For this, this programme such as preferably adopts at the duration partitioning scheme, partitioning scheme as shown in Figure 4, because video flowing has certain frame per second, the duration cutting task such as can easily complete according to frame per second, the complete code stream of the most whole AU cuts into a plurality of continuous AU data blocks, therefore, in the present invention, Resource Server is take the AU data block as the request of base unit response terminal.By this ways of distribution, can be convenient to the AU data block situation that the terminal record obtains, thereby be convenient to the data sharing in terminal.For example: the individual data frame sign that obtains after coding is 1000B, supposes that frame per second is 25F/S, and one second data volume is 25KB=200Kbit.Therefore preferably waited the original access unit AU code stream of duration cutting to form sub-AU data block with 2 seconds.Simultaneously, this programme hypothesis terminal bandwidth in 2 seconds can be kept stable substantially, and when therefore realizing in system, every sub-AU data block frame interior information of regulation is with identical spatial domain scalability, flexible time domain, the acquisition of quality scalability standard, transmission.
102, Resource Server adds time paragraph header byte-identifier to each AU data block;
Based on waiting the duration segmentation will form a series of AU data blocks to complete AU code stream, realize the P2P resource-sharing for the ease of identifying these AU data blocks, propose to increase the affiliated time period information of this AU data block of " time paragraph header byte-identifier " field identification in this programme in AU data block head information.Each AU byte information after increase time paragraph header byte-identifier can be with reference to shown in Figure 5.By increasing time paragraph header byte-identifier, can accurately identify each AU data block.The time effect of paragraph header byte-identifier is: by the time period label, can carry out more accurately sharing alternately of AU data block between terminal.The signal that AU full code stream is divided into interpolation time paragraph header byte-identifier please refer to shown in Figure 6.
In preferred version, time paragraph header byte-identifier adopts two byte-identifiers, can record maximum 65536 time period information.Because if adopt the byte sign, can record maximum 256 time period information, tell the AU data block if waited with 2 seconds, 256 AU data blocks will be held at most the video resource of 256*2s=512s=0.14h, be obviously to satisfy actual needs.Therefore the employing double byte sign of mentioning in the preferred version according to this programme waited with 2 seconds and divides data block, and 65536 data blocks will finally be held the video of 65536*2s=131072s=36.41h, can satisfy real needs.When terminal obtains AU data block file, will record the AU data block time paragraph header byte-identifier that obtains.And this identification information storage is in the Bitmap bitmap table.
When guaranteeing terminal to the Resource Server request resource, can not support to cause the situation of the video resource that terminal can't obtain to ask to occur because of the bandwidth resources of terminal, preferably, the present embodiment can also comprise the steps 103.
103, Resource Server is according to the capacity generating indexes information of this video resource, and with index information send to the request video resource terminal, as first terminal, index information comprises the bandwidth requirement that level sign and level sign should satisfy, and is used for first terminal AU data block transmissible according to the bandwidth request of self.
Particularly, index information is minimum bandwidth required when transmitting by different level for the expression situation by different level of video resource and each, and in actual applications, this index information is that the form with index file exists.Just can know data corresponding to which kind of level sign of which kind of bandwidth condition adapted transmission by the index file terminal.Index file is by XML language definition.An index file is schematically as follows:
Signal explanation: defined three level signs corresponding to video file in this index file, be respectively 1,2 and 3, and provided the required satisfied lowest-bandwidth information of each level.The minimum transmission rate that needs 10KB/s as layering 1.The needs of every level bandwidth are to calculate according to size and the time span of the video resource of this level, for example: if the video resource size 560MB of N level sign, the video resource duration is 100 minutes, use 560MB/100/60 second, in the time of can calculating the video resource of this N layer of terminal request, prerequisite lowest-bandwidth requirement.Terminal will be not the suitable level sign of broken ends of fractured bone monitoring self bandwidth match, when bandwidth satisfies the required minimum transmission rate request of certain level, can switch in good time, obtain different data corresponding to level sign, realize the quality adaptation of SVC coding.How index file herein only adjusts according to bandwidth situation the quality adaptation that SVC encodes in the signal terminal.Also need the AU piecemeal total number information with video file when specific implementation, the relevant informations such as coded video information are added in index file.
Resource Server can also return to suitable peerlist list when returning to index file; If there is not any terminal to have this resource in network, peerlist can or not return to peerlist this moment for the sky table.
104, in the situation that the peerlias that terminal receives has node by this Resource Server as resource for empty or there is no peerlist, provide resource service, this moment execution in step 105; In the situation that terminal receives peerlist and for empty, terminal can be determined to exist in network terminal to can be used as resource to have node and use, and execution in step 106.
Wherein, peerlist is used for storing each resource and has nodal information, mainly comprises in information to can be used as the address information that resource has the terminal of node use.Terminal can be carried out alternately according to the node address information in peerlist and node, and then whether the part of understanding this video resource that this node has is to need under terminal.Wherein, the particular content of above-mentioned " terminal can be carried out according to the node address information in peerlist and node alternately " can be with reference to following step 106.
The address information of each terminal in Peerlist is that each terminal is after getting the video resource of request, and when the video resource that gets can satisfy minimum broadcast condition (all levels that for example has this video resource is 1 part), terminal is reported to Resource Server and is got, and detailed process can be with reference to following step 110.
105, (this request can be that terminal is in step 104 in the request that Resource Server sends according to terminal, do not use in the situation that have terminal to have node as resource in network, the request that again sends, can be also the request when in step 103, terminal is asked first) the AU data block of adding time paragraph header byte-identifier is sent to the terminal (establishing this terminal is first terminal) of request video resource and execution in step 107.
At this moment, just there is first terminal to can be used as resource in network and has node and use, follow-uply can this video resource be shared with the second terminal by this first terminal.First terminal herein is interpreted as the first terminal of obtaining the specific AU data block of specific level from Resource Server, might not be to propose first the terminal of resource bid to Resource Server.But due to before sharing this, needing to guarantee have terminal to have this video resource in network, therefore, for the scene of asking first this resource, must be by Resource Server, this video resource to be provided in terminal, and namely this step 105 is necessary.
106, terminal is asked its bitmap (situation of the video resource that Bitmap0 information table and then definite A terminal have according to the address information of terminal in the Peerlist of Resource Server transmission to counterpart terminal (being made as the A terminal), and the situation of the video resource that has according to index information and A terminal determines to meet the AU data block of resource requirement, then according to address information to the described video resource of this A terminal request.After the A terminal is received this request, its video resource that has obtained is shared terminal.
This 106 is particularly: terminal 1 is carried out alternately according to the address information on peerlist (node listing) and the node (being made as terminal 2) that has video resource, the Bitmap information table of requesting terminal 2 (asking for an interview the related content of following step 108 back about the explanation of this Bitmap information table), terminal 1 can know by inquiry Bitmap information table whether terminal 2 gathers around this video resource, perhaps say accurately, can also know that terminal 2 specifically gathers around, which level of this video resource.Thus, terminal 1 can be accurately to the part of terminal 2 its video resources that need of request, terminal 2 arrives terminal 1 with the resource sharing of corresponding part after receiving this request.
107, terminal receives at least one the AU data block that has the video resource of node (A terminal or Resource Server) from resource;
108, terminal parses level sign and the time paragraph header byte-identifier of AU data block from the AU data block, and the Bitmap information table of the resource situation of having obtained for the recording of video resource according to time paragraph header byte-identifier and level identification renewal;
Comprised the important innovations point in this embodiment in this step 108: construct two-dimentional Bitmap bitmap table and realize resource-sharing between terminal.
Particularly, the Bitmap information table is applied to the P2P file-sharing, the Bitmap information table is recording the AU data block situation that terminal has obtained, can obtain rational AU data block from different end by the Bitmap information table during sharing A U data block between terminal, finally realize AU data block sharing between terminal (peer).But existing one dimension Bitmap can only be by 0,1 records having or not of AU subcode stream, but in SVC, terminal not only needs to record having or not of AU data block, also should record space, quality, the time horizon information state of the AU data block that obtains, therefore existing one dimension Bitmap information table can not effectively be completed such function.This programme has proposed improved two-dimentional Bitmap information table form for this reason, effectively records the actual conditions of the AU data block that terminal obtains with this.Bitmap information table form is with reference to following table one.
Table one
The Bitmap information table is a bivariate table in the present embodiment, each line time segment information take the time period as unit definition, every delegation comprises two field informations: whether obtain (accounting for 1bit), level sign and (account for 10bit, in optimal way, represent that with 4bit the space layer of each time period resource in SVC identifies, represents that with 4bit the quality layers of each time period resource in SVC identifies, identifies with 3bit the time horizon sign of each time period resource in SVC).Wherein, whether first field obtains corresponding time period AU data block situation according to terminal is upgraded, level sign is by in the sub-AU data block that obtains, gained being analyzed in NALU packet header: extract relevant layers sign, quality layers sign, time horizon ident value according to a byte information of NALU sequence in sub-AU data block, carry out the final generation layer of computing time sign and insert in corresponding Bitmap bitmap file.
By two-dimentional Bitmap table, terminal not only can record having or not of AU data block, and can identify by level and know that terminal obtains the level situation of AU data block.The information reportings such as the level sign by will record in this Bitmap information table and time period can be realized the resource-sharing of AU data block to Resource Server.
Improved Bitmap bivariate table, every delegation is for an AU data block.By the two-dimentional Bitmap information table of above-mentioned table one as can be known, will adopt 11 bit is the single AU data block information of mark.One dimension Bitmap bitmap table has enlarged 10 times.Obtain 65536 all data blocks in this hypothesis terminal, suppose that the every row of Bitmap table accounts for the 2B size, the final large young pathbreaker of bivariate table information is 65536*2B=131072B=128KB, and the data of 128KB will can not occupy the excessive memory space of terminal.
Terminal is filled in the Bitmap information table according to the AU data block of obtaining after obtaining the video data resource.In follow-up P2P was mutual, terminal can be determined the AU data block that lacks by the Bitmap information table, and mutual with other Peer.
109, terminal is determined the AU data block that lacks according to the record in the Bitmap information table, and has the node request to resource.Resource has node and comprises A terminal and Resource Server.Obtain according to 104 to 108 steps the AU data block that lacks.
Preferably, above-mentioned terminal determines that according to the record in the Bitmap information table AU data block that lacks can be: terminal determines to lack and meet the AU data block of resource requirement according to the record in index information and Bitmap information table.
Particularly, for example: terminal checks the first row of two-dimentional Bitmap form by one dimension Bitmap mode, can draw terminal Gains resources situation from first row.Definition " 0 " is acquisition, and " 1 " does not obtain.As: suppose whether N data block of inquiry obtains, can be according to bivariate table line number value N, inquiry X[N] value of [1] judges.Thus, the terminal AU data block of which time period does not as can be known obtain, and the bandwidth that requires according to the corresponding level that does not obtain in the bandwidth of terminal and index information, the A terminal request that has this level resource of knowing in the step 106.After the A terminal is received this request, its video resource that has obtained is shared terminal.
Wherein, after the A terminal was received this request, the process that specifically resource sharing is arrived terminal can be as follows:
The A terminal can be known the level sign of the AU data block that the A terminal has according to the level sign of every delegation in the Bitmap information table of oneself.If to the value of the needed level of the terminal of its request sign value less than the level sign of A terminal, the A terminal can provide service for terminal.Otherwise can not provide service.
A concrete example is as shown in following table two:
Table two
From above table two as can be known:
1, whether obtain the AU data block, can determine by " whether obtaining " sign; 0 expression does not obtain, and 1 expression obtains;
2, terminal has #2, #N time period resource, there is no #1 time period resource;
3, because there is no #1 time period resource, whether obtaining bit-identify is 0; This moment, the A terminal can't provide the #1AU Resource Block to other-end.
4, when request # 2 time period resource, the #2 resource hierarchy is designated 0000000010, represents that namely it is 2 #2AU data block that terminal has level; Can satisfy the level request and be not more than 2 AU request of data.
5, when request #N time period resource, the #N resource hierarchy is designated 0000000101, represents that namely it is 5 #NAU data block that terminal has level; Can satisfy the level request and be not more than 5 AU request of data.
From the above analysis, can reach a conclusion: can know the time period resource information that terminal has from two-dimentional Bitmap information table, thereby realize the resource-sharing between terminal.
110, the part of this video resource that obtains when terminal is enough with this video playback out the time, the address information of self is reported Resource Server, so that Resource Server adds this address information in peer list to, so, Resource Server just can count has have this video resource on earth for which terminal in network.
Terminal can learn that according to the record in the Bitmap information table resource of which level all obtains.For example: when the resource of level 1 all gets, just can satisfy the condition of playing this video resource, can report to Resource Server, this terminal of notice Resource Server has had this video resource.
Get the AU data block of this video resource when terminal after, terminal is according to AU data block time period numbering restructuring video resource, and final realization is local plays.
The scheme that this enforcement provides is applied to the SVC technology under the P2P framework, proposition is a plurality of AU data blocks by the complete code stream of duration cutting AU, and the technological means of increase AU data block head label information, and reasonable in design, efficient 2-d Bitmap information table, finally realize a kind of technique effect of sharing the SVC data resource between terminal bandwidth change, terminal diversified real network streaming media service demand and terminal that solves at SVC under the P2P service architecture.
The present embodiment provides a kind of transfer processing method of Streaming Media specifically in conjunction with scene shown in Figure 7, and the method can be thought the more specifically example description than embodiment 1.
For convenience of description, the corresponding index information that generates of video resource of establishing in the present embodiment request is:
Wherein, the PeerA node bandwidth is 65KB/s, can apply for the AU data block resource of access level 3; Wherein, the PeerB node bandwidth is 15KB/s, can apply for the AU data block resource of access level 1;
Wherein, the PeerC node bandwidth is 35KB/s, can apply for the AU data block resource of access level 2;
Concrete grammar is as follows:
The PeerA node is accessed this video resource to the Resource Server application, and Resource Server detects the Peer node that has respective resources in present network, so be PeerA transmission level 3 data; PeerA becomes the first terminal node that has level 3 video resources in network
PeerA upgrades local Bitmap information table, and reports the nodal information situation to Resource Server;
The PeerB node is accessed this video resource to the Resource Server application, and Resource Server detects the peer that PeerA in present network has respective resources, returns to the Peerlist of relevant PeerA part relevant information; The PeerB node is according to the Bitmap information table of PeerA, and to the AU data block of PeerA request level 1, the AU data block of PeerA transmission level 1 is to PeerB;
PeerB upgrades local Bitmap information table, and reports the nodal information situation of PeerB to server;
The PeerC node is accessed this video resource to the Resource Server application, and Resource Server detects that in present network, PeerA, B have respective resources, returns to the Peerlist that comprises PeerA, B relevant information; The PeerC node is according to the Bitmap information table of PeerA, B, and to the AU data block of PeerA, B request level 1,2, the AU data block of PeerA, B transmission level 1,2 is to PeerC;
PeerC upgrades local Bitmap information table, and reports the nodal information situation of PeerC to Resource Server; So far complete Resource Exchange and share flow process.
In addition, in the present embodiment at Peer A, when Peer B transmits the AU data block of level 1 to Peer C, relate to synchronization mechanism.The AU data block of supposing level 1 has 10, and wherein each AU data block all number by the good time period of mark.The AU transmission of data blocks method of synchronization of level 1 is as shown in Figure 8 so:
By AU piecemeal dispatching algorithm, thereby it is synchronous to carry out carrying out between terminal active data.
Take herein example as example, with reference to Fig. 8, Peer C can obtain from Peer A and be numbered 1 to 5 A U data block; Obtain from Peer B and be numbered 6 to 10 AU data block.So Peer A, Peer B will can not transmit the AU data block of repetition, can separately the AU data block of disappearance be sent request to relevant Peer node again when Peer C lacks certain data block.Wherein, how Peer C obtains different data from Peer A, B.During specific implementation, can design various synchronized algorithms according to network resource status etc.Be not repeated herein.
The present embodiment provides a kind of terminal, can be used as terminal in embodiment 1,2/peer and uses.As shown in Figure 9, comprising: receiving element 31, resolution unit 32, record cell 33, determining unit 34.
Receiving element 31 is used for receiving at least one the AU data block that has the video resource of node from resource; Resolution unit 32 is for the level sign and the time paragraph header byte-identifier that parse the AU data block from the AU data block; Record cell 33 is used for being used for according to time paragraph header byte-identifier and level identification renewal the Bitmap information table of the resource situation that the recording of video resource obtained; Determining unit 34 for the AU data block of determining according to the record of Bitmap information table to lack, and has the node request to resource.
In addition, this terminal also comprises: request unit 34 is used for to Resource Server request video resource;
Correspondingly, receiving element 31, also be used for not having node service being provided when network does not exist terminal to can be used as resource, when described resource has node and is Resource Server, receive index information and at least one AU data block from the described video resource of described Resource Server;
Correspondingly, determining unit 34 is also for determine to lack and meet the AU data block of resource requirement according to the record of index information and Bitmap information table.
In addition, receiving element 31, also be used for having node service being provided when network exists terminal to can be used as resource, when described resource has node and is terminal, receive from the node listing of described Resource Server and the index information of described video resource, comprise at least the address information of the terminal that has described video resource in described node listing; Request unit 34 also is used for according to the address information of described terminal to its message bit pattern table of counterpart terminal request and then determines the situation of the described video resource that described counterpart terminal has;
Correspondingly, determining unit 34, the situation that is used for the described video resource that has according to described index information and described counterpart terminal determines to meet the AU data block of resource requirement, and according to described terminal address to the described video resource of described counterpart terminal request.
Preferably, also can comprise: report unit 35, be used for the resource situation that the record according to described message bit pattern table has obtained described video resource, and when the described resource situation of having obtained enough is play described video resource, Resource Server is arrived in report.
terminal in the present embodiment can be upgraded the Bitmap information table according to parse level sign and time paragraph header byte-identifier from the AU data block, and this Bitmap information table can be used for recording the AU data block of SVC technology, therefore being convenient to terminal determines according to the information of the record in this Bitmap information table the suitable resource that needs obtain, the means that also get simultaneously video resource by report terminal to Resource Server make Resource Server grasp the video resource that in network, each terminal gets, and the address information that resource is had terminal is informed the terminal of request by peerlist, thereby realize resource sharing between each terminal, the technique effect of source synchronous.
The present embodiment provides a kind of Resource Server, this Resource Server can be used for embodiment 3 in terminal exchange, the Resource Server that also can be used as in embodiment 1 and embodiment 2 uses.As shown in figure 10, mainly comprise: cutting unit 41, adding device 42, transmitting element 43.
Cutting unit 41, the access unit full code flow point that has after by duration, video resource being encoded is slit into a plurality of access unit AU data blocks; Adding device 42 is used for each AU data block is added time paragraph header byte-identifier; Transmitting element 43 sends to the first terminal of asking video resource for the AU data block that will add time paragraph header byte-identifier.
Preferably, also can comprise: generation unit 44, be used for the capacity generating indexes information according to video resource, index information is used for first terminal access unit data block transmissible according to the bandwidth request of self;
Correspondingly, transmitting element 43 also is used for index information is sent to the first terminal of asking video resource.
Preferably, also can comprise: updating block, search the unit.
Updating block is used for adding described address information the node listing of storage to, has node in order to record the resource that has described video resource in network.
Search the unit, be used for receive from the second terminal obtain the request of video resource the time, find the first terminal that has video resource from node listing, and the address information of the described first terminal that will find sends to the second terminal.
The Resource Server that the present embodiment provides is divided into a plurality of AU data blocks by the complete code stream of AU is grown on time, and the technological means of adding time paragraph header byte-identifier in each AU data block, make server and terminal all can determine concrete resource according to this time paragraph header byte-identifier, and then be convenient to terminal and only need the AU data block that is fit to Resource Server or other terminal request, can realize resource sharing.
The present embodiment provides a kind of transmission treatment system of Streaming Media, comprises first terminal and Resource Server;
Wherein, Resource Server, access unit full code flow point after being used for by duration, video resource being encoded is slit into a plurality of access unit AU data blocks, and each AU data block is added time paragraph header byte-identifier, then the AU data block of adding time paragraph header byte-identifier is sent to the first terminal of request video resource;
First terminal, be used for receiving at least one the AU data block from the video resource of Resource Server, parse level sign and the time paragraph header byte-identifier of AU data block from the AU data block, the message bit pattern table that is used for the resource situation that the recording of video resource obtained according to time paragraph header byte-identifier and level identification renewal, wherein, increased the level identification field in the message bit pattern table, be used for the resource situation that physical record has obtained, determine the AU data block that lacks according to the record in the message bit pattern table, and to Resource Server.
In addition, this system also comprises: the second terminal;
The second terminal is used for asking video resource to Resource Server; Correspondingly, Resource Server, also be used for receive from the second terminal obtain the request of video resource the time, search the first terminal that has video resource from node listing, and the address information of the first terminal that finds sent to the second terminal.
In the system that the embodiment of the present invention provides, the complete code stream of AU to after Streaming Media employing SVC coding of Resource Server is grown on time and is divided into a plurality of AU data blocks, and in the AU data block mode of expansion time paragraph header byte-identifier, thereby can realize each AU data block is identified, being conducive to sign according to the AU data block recognizes terminal to have got which AU data block, and carry out according to the situation of obtaining the AU data block that suitable request does not obtain, and then obtain the technique effect of resource-sharing in different resources has node; Simultaneously, by increase level sign and time paragraph header byte-identifier in the message bit pattern table of first terminal, make this message bit pattern table can reflect the situation of obtaining of resource under SVC, and then guarantee that terminal can determine according to this message bit pattern table the AU data block of needs, and have the autotelic request of node AU data block to resource, be convenient to realize resource-sharing between first terminal and the second terminal, the AU data block is synchronous.
Through the above description of the embodiments, the those skilled in the art can be well understood to the present invention and can realize by the mode that software adds essential general hardware platform, can certainly pass through hardware, but in a lot of situation, the former is better execution mode.Based on such understanding, the part that technical scheme of the present invention contributes to prior art in essence in other words can embody with the form of software product, this computer software product is stored in the storage medium that can read, floppy disk as computer, hard disk or CD etc. comprise that some instructions are used so that the method for each embodiment of equipment execution the present invention.
Above; be only the specific embodiment of the present invention, but protection scope of the present invention is not limited to this, anyly is familiar with those skilled in the art in the technical scope that the present invention discloses; can expect easily changing or replacing, within all should being encompassed in protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with the protection range of claim.
Claims (18)
1. the transfer processing method of a Streaming Media, is characterized in that, comprising:
Receive at least one the access unit AU data block that has the video resource of node from resource;
Parse level sign and the time paragraph header byte-identifier of described AU data block from described AU data block;
The message bit pattern table that is used for recording the resource situation that described video resource obtained according to described time paragraph header byte-identifier and described level identification renewal, wherein, increase the level identification field in described message bit pattern table, be used for the resource situation that physical record has obtained;
Determine the AU data block that lacks according to the record in described message bit pattern table, and have the node request to described resource.
2. the transfer processing method of Streaming Media according to claim 1, it is characterized in that, not existing terminal to can be used as resource in network has node service is provided, when described resource had node and is Resource Server, described at least one the AU data block that has a video resource of node from resource that receives specifically comprised:
To Resource Server request video resource;
Receive index information and at least one AU data block from the described video resource of described Resource Server, wherein, described index information comprises the bandwidth requirement that level sign and described level sign should satisfy;
Describedly determine that according to the record in described message bit pattern table the AU data block that lacks specifically comprises:
Determine to lack and meet the AU data block of resource requirement according to the record in described index information and described message bit pattern table.
3. the transfer processing method of Streaming Media according to claim 1, is characterized in that, exists terminal to can be used as resource in network and have node service is provided, and when described resource had node and is terminal, the method also comprised:
To the described video resource of Resource Server request;
Receive from the node listing of described Resource Server and the index information of described video resource, at least comprise the address information of the terminal that has described video resource in described node listing, wherein, described index information comprises the bandwidth requirement that level sign and described level sign should satisfy;
According to the address information of described terminal to its message bit pattern table of counterpart terminal request and then determine the situation of the described video resource that described counterpart terminal has;
The situation of the described video resource that has according to described index information and described counterpart terminal determines to meet the AU data block of resource requirement, and according to described terminal address to the described video resource of described counterpart terminal request.
4. the transfer processing method of the described Streaming Media of any one according to claim 1 to 3, is characterized in that, the method also comprises:
The resource situation of described video resource having been obtained according to the record of described message bit pattern table;
When the described resource situation of having obtained is enough play described video resource, report Resource Server.
5. the transfer processing method of a Streaming Media, is characterized in that, comprising:
Access unit full code flow point after by duration, video resource being encoded is slit into a plurality of AU data blocks;
Each described AU data block is added time paragraph header byte-identifier;
The described AU data block of adding time paragraph header byte-identifier is sent to the first terminal of the described video resource of request.
6. the transfer processing method of Streaming Media according to claim 5, is characterized in that, the method also comprises:
Capacity generating indexes information according to described video resource, and with described index information send to the request described video resource first terminal, described index information comprises the bandwidth requirement that level sign and described level sign should satisfy, and is used for described first terminal AU data block transmissible according to the bandwidth request of self.
7. the transfer processing method of Streaming Media according to claim 5, is characterized in that, the method also comprises:
Reception is from the address information of described first terminal;
Described address information is added in the node listing of storage, have node in order to record the resource that has described video resource in network.
8. the transfer processing method of Streaming Media according to claim 7, is characterized in that, the method also comprises:
Receive the request of obtaining described video resource from the second terminal;
Find the first terminal that has described video resource from described node listing, and the address information of the described first terminal that will find sends to described the second terminal.
9. a terminal, is characterized in that, comprising:
Receiving element is used for receiving at least one the AU data block that has the video resource of node from resource;
Resolution unit is for the level sign and the time paragraph header byte-identifier that parse described AU data block from described AU data block;
Record cell is used for being used for recording according to described time paragraph header byte-identifier and described level identification renewal the message bit pattern table of the resource situation that described video resource obtained;
Determining unit for the AU data block of determining according to the record of described message bit pattern table to lack, and has the node request to resource.
10. terminal according to claim 9, is characterized in that,
This terminal also comprises: request unit is used for to Resource Server request video resource;
Described receiving element, also be used for not having node service being provided when network does not exist terminal to can be used as resource, when described resource has node and is Resource Server, receive index information and at least one AU data block from the described video resource of described Resource Server;
Described determining unit is also for determine to lack and meet the AU data block of resource requirement according to the record of described index information and described message bit pattern table.
11. terminal according to claim 9 is characterized in that,
This terminal also comprises: request unit is used for to Resource Server request video resource;
Described receiving element, also be used for having node service being provided when network exists terminal to can be used as resource, when described resource has node and is terminal, receive from the node listing of described Resource Server and the index information of described video resource, comprise at least the address information of the terminal that has described video resource in described node listing;
The described request unit also is used for according to the address information of described terminal to its message bit pattern table of counterpart terminal request and then determines the situation of the described video resource that described counterpart terminal has;
Described determining unit, the situation that is used for the described video resource that has according to described index information and described counterpart terminal determines to meet the AU data block of resource requirement, and according to described terminal address to the described video resource of described counterpart terminal request.
12. according to claim 9 to 11, the described terminal of any one, is characterized in that, also comprises:
Report the unit, be used for the resource situation that the record according to described message bit pattern table has obtained described video resource, and when the described resource situation of having obtained enough is play described video resource, Resource Server is arrived in report.
13. a Resource Server is characterized in that, comprising:
Cutting unit, the access unit full code flow point after being used for by duration, video resource being encoded is slit into a plurality of access unit AU data blocks;
Adding device is used for each described AU data block is added time paragraph header byte-identifier;
Transmitting element sends to the first terminal of asking described video resource for the described AU data block that will add time paragraph header byte-identifier.
14. Resource Server according to claim 13 is characterized in that,
Also comprise: generation unit, be used for the capacity generating indexes information according to described video resource, described index information is used for described first terminal AU data block transmissible according to the bandwidth request of self;
Described transmitting element also is used for described index information is sent to the first terminal of asking described video resource.
15. Resource Server according to claim 13 is characterized in that, also comprises:
Updating block is used for adding described address information the node listing of storage to, has node in order to record the resource that has described video resource in network.
16. according to claim 13 to the described Resource Server of any one in 15, it is characterized in that, also comprise:
Search the unit, be used for receive from the second terminal obtain the request of described video resource the time, find the first terminal that has described video resource from described node listing, and the address information of the described first terminal that will find sends to described the second terminal.
17. the transmission treatment system of a Streaming Media is characterized in that, comprising: first terminal and Resource Server;
Described Resource Server, access unit full code flow point after being used for by duration, video resource being encoded is slit into a plurality of access unit AU data blocks, and each described AU data block is added time paragraph header byte-identifier, the more described AU data block of adding time paragraph header byte-identifier is sent to the first terminal of the described video resource of request;
described first terminal, be used for receiving at least one the AU data block from the video resource of described Resource Server, parse level sign and the time paragraph header byte-identifier of described AU data block from described AU data block, the message bit pattern table that is used for recording the resource situation that described video resource obtained according to described time paragraph header byte-identifier and described level identification renewal, wherein, increased the level identification field in described message bit pattern table, be used for the resource situation that physical record has obtained, determine the AU data block that lacks according to the record in described message bit pattern table, and to described Resource Server.
18. the transmission treatment system of Streaming Media according to claim 17 is characterized in that, this system also comprises: the second terminal;
Described the second terminal is used for asking described video resource to described Resource Server;
Described Resource Server, also be used for receive from described the second terminal obtain the request of described video resource the time, find the described first terminal that has described video resource from described node listing, and the address information of the described first terminal that will find sends to described the second terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110423228.8A CN103167319B (en) | 2011-12-16 | 2011-12-16 | The transfer processing method of a kind of Streaming Media, Apparatus and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110423228.8A CN103167319B (en) | 2011-12-16 | 2011-12-16 | The transfer processing method of a kind of Streaming Media, Apparatus and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103167319A true CN103167319A (en) | 2013-06-19 |
| CN103167319B CN103167319B (en) | 2016-06-22 |
Family
ID=48590018
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110423228.8A Active CN103167319B (en) | 2011-12-16 | 2011-12-16 | The transfer processing method of a kind of Streaming Media, Apparatus and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103167319B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105635188A (en) * | 2016-03-31 | 2016-06-01 | 深圳市矽伟智科技有限公司 | Visualization content distribution method and system |
| CN105657470A (en) * | 2015-12-31 | 2016-06-08 | 深圳市海云天科技股份有限公司 | Bitmap type video browsing recording method and system |
| CN114124940A (en) * | 2021-11-30 | 2022-03-01 | 上海御渡半导体科技有限公司 | Data customization transmission method based on UDP protocol |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007051425A1 (en) * | 2005-11-03 | 2007-05-10 | Huawei Technologies Co., Ltd. | A multimedia communication method and the terminal thereof |
| CN101500157A (en) * | 2008-12-31 | 2009-08-05 | 深圳市同洲电子股份有限公司 | Method and apparatus for converting access unit into transmission flow |
| US20110208829A1 (en) * | 2010-02-23 | 2011-08-25 | Samsung Electronics Co., Ltd. | Method and apparatus for transmitting and receiving data |
-
2011
- 2011-12-16 CN CN201110423228.8A patent/CN103167319B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007051425A1 (en) * | 2005-11-03 | 2007-05-10 | Huawei Technologies Co., Ltd. | A multimedia communication method and the terminal thereof |
| CN101500157A (en) * | 2008-12-31 | 2009-08-05 | 深圳市同洲电子股份有限公司 | Method and apparatus for converting access unit into transmission flow |
| US20110208829A1 (en) * | 2010-02-23 | 2011-08-25 | Samsung Electronics Co., Ltd. | Method and apparatus for transmitting and receiving data |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105657470A (en) * | 2015-12-31 | 2016-06-08 | 深圳市海云天科技股份有限公司 | Bitmap type video browsing recording method and system |
| CN105635188A (en) * | 2016-03-31 | 2016-06-01 | 深圳市矽伟智科技有限公司 | Visualization content distribution method and system |
| CN105635188B (en) * | 2016-03-31 | 2019-07-09 | 深圳市矽伟智科技有限公司 | A kind of visual content distribution method and system |
| CN114124940A (en) * | 2021-11-30 | 2022-03-01 | 上海御渡半导体科技有限公司 | Data customization transmission method based on UDP protocol |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103167319B (en) | 2016-06-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101973544B1 (en) | Method and apparatus for transmitting/receiving hybrid media content in a multimedia system | |
| CN103069492B (en) | Use storage method and the client terminal device of the storage file format for transmission of multimedia streams file | |
| CN101677325B (en) | Method, device and system for publishing media description information and acquiring media | |
| CN101321265B (en) | Method and system for implementing peer-to-peer network media order frame-across broadcast mode | |
| CN100382499C (en) | Apparatus and method for stream-oriented multimedia data transmission | |
| CN101795297B (en) | Live broadcasting time shifting system based on P2P (peer-to-peer) technology and method thereof | |
| CN108924600A (en) | Sending and receiving methods, device and the electronic equipment of live data | |
| CN101409630A (en) | Method, apparatus and system for sending and receiving stream medium data | |
| CN103078847B (en) | Method for storing and reading multi-code-rate stream file and relevant device | |
| CN104270646A (en) | Self-adaption transmission method and system based on mobile streaming media | |
| CN101867796B (en) | Method and device for monitoring video | |
| US20090031021A1 (en) | Transmitting/receiving method of svc file and apparatus thereof | |
| CN101511010A (en) | Method and device for sending medium stream | |
| CN104737512B (en) | Device and method for being transmitted in hybrid network and receiving multi-medium data | |
| CN101155296A (en) | Method for transmitting data | |
| CN105704159A (en) | Method for providing media and server | |
| CN102231860A (en) | Live time shift data storage method | |
| JP2003114845A (en) | Media conversion method and media conversion device | |
| CN113596518B (en) | Video access method for improving double-speed playing performance | |
| CN108307202A (en) | Real-time video transcoding sending method, device and user terminal | |
| CN103167319A (en) | Transmission processing method, device and system of streaming media | |
| US7779159B2 (en) | Apparatus and method for providing high speed download service of multimedia contents | |
| CN111629283A (en) | Multi-stream media gateway service system and method | |
| KR101032744B1 (en) | Devices and processes for transmitting and receiving data, computer program product and carrier signal | |
| US9332421B2 (en) | Method and apparatus for random access to multimedia content in wireless communication system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |