CN104506959A - Packet transmission method and packet transmission system for H264 code streams - Google Patents

Packet transmission method and packet transmission system for H264 code streams Download PDF

Info

Publication number
CN104506959A
CN104506959A CN201410777716.2A CN201410777716A CN104506959A CN 104506959 A CN104506959 A CN 104506959A CN 201410777716 A CN201410777716 A CN 201410777716A CN 104506959 A CN104506959 A CN 104506959A
Authority
CN
China
Prior art keywords
nal unit
rtp
nalu
bag
rtp bag
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201410777716.2A
Other languages
Chinese (zh)
Inventor
李�根
谭小刚
谢文君
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vtron Technologies Ltd
Original Assignee
Vtron Technologies Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vtron Technologies Ltd filed Critical Vtron Technologies Ltd
Priority to CN201410777716.2A priority Critical patent/CN104506959A/en
Publication of CN104506959A publication Critical patent/CN104506959A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/632Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing using a connection between clients on a wide area network, e.g. setting up a peer-to-peer communication via Internet for retrieving video segments from the hard-disk of other client devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643Communication protocols
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64784Data processing by the network

Abstract

The invention discloses a packet transmission method and a packet transmission system for H.264 code streams. The transmission method comprises the following steps: at a transmitting end, performing importance analysis on all NALUs (network abstract layer units) in each frame of code stream, and performing RTP (real-time transmission protocol) packeting according to the importance of the NALUs, wherein the importance of the NALUs comprises three classes: important, generally important and unimportant; respectively establishing threads for RTP packets with different importance; according to the importance of the RTP packets, repeatedly transmitting the RTP packets to a receiving end for one time or n times in a corresponding dedicated thread, wherein n is greater than or equal to 2; at the receiving end, discarding the received RTP packets until one RTP packet is reserved, and recombining the reserved RTP packet and non-repetitive RTP packets to form the NALUs to recover H.264 code data. According to the packet transmission method and the packet transmission system disclosed by the invention, parallel processing is performed on the NALUs with different importance by multiple threads, and the NALUs are transmitted, so the RTP transmitting efficiency can be considered while the packet loss of high-importance NALUs is reduced, and the video quality after the H.264 code streams are decoded is improved.

Description

A kind of H264 code stream divided stator frame method and system
Technical field
The present invention relates to field of data transmission, more specifically, relate to a kind of H264 code stream divided stator frame method and system.
Background technology
Along with the development of IP network technology and video, audio decoding techniques, H.264 content code stream is transmitted by IP network.Known, data are transmitted in ethernet networks, and as shown in Figure 1, the MTU (MTU) of Ethernet is 1500 bytes, so the maximum load length of 1 RTP bag is generally 1460 bytes.
Known, every frame H.264 code stream is made up of multiple NAL unit (network abstraction layer unit), and each NAL unit is in different size.H.264 code stream more often uses Real-time Transport Protocol at present, normally with each NAL for unit processes in the following manner: (1) when 1 NAL unit length be greater than RTP bag maximum load length (1460Byte) time, need this NAL unit to be divided into multiple RTP to wrap to send, the loaded length that each RTP is wrapped is not more than 1460Byte; (2) when 1 NAL unit length is less than or equal to 1460Byte, use single RTP to wrap and send; (3) when 1 NAL unit length is much smaller than 1460Byte, using 1 RTP bag transmitting efficiency lower, in order to improve its transmitting efficiency, multiple NAL unit can be placed, as long as multiple NAL unit is not more than 1460Byte in the load of 1 RTP bag.
As shown in Figure 2, the structure of each NAL unit comprises NAL head and raw byte sequence payload (RBSP:Raw Byte Sequence Payloads) is formed, and NAL head is by F(1bit), R(2bit), T(5bit) form.Wherein R is NAL unit importance flag, is used for representing the importance of NAL unit, and 00 represents that NAL is inessential, and 11 represent that NAL unit are extremely important.
As shown in Figure 3, transmission is generally process successively from NALU1 ~ NALU7 according to NAL unit sequencing in code stream.Be 432 bytes with regard to there will be the length of NALU1 like this, much smaller than 1460 bytes, but due to the length of NALU2 larger, can not merge, together with NALU4, NALU5, NALU6,1 RTP bag can not be formed, 1 RTP bag can only be formed separately.And total length 1015 byte of its NALU4, NALU5, NALU6 tri-NALU, still there are 445 byte residues to may be used for merging NALU1, namely adopt NAL unit order to process successively, can also transmitting efficiency be improved.
And reliably connect due to RTP bag right and wrong, packet loss phenomenon can be there is in process of transmitting.As shown in Figure 3, when forming 1 RTP bag because of three NAL unit (NALU4, NALU5, NALU6) much smaller than RTP load largest unit, when losing this bag, when decoding, very important NAL unit (NALU5) and unessential unit (NALU4, NALU6) can be caused to lose together.So in fact, the important symbol position of NAL head is not made full use of.
There is technology to propose to reset NAUL unit from high to low according to importance, and by importance, RTP grouping is carried out to NAUL unit, and carry out serial transmission from high to low according to importance; Which can improve video transmission efficiency to a certain extent, but which still exists the possibility of data-bag lost.
Summary of the invention
In order to solve the problem, first the present invention proposes a kind of H264 code stream divided stator frame method, and the method effectively make use of the importance of NAL unit, is ensureing, under the prerequisite that most important bag is not lost as far as possible, to improve RTP bag transmitting efficiency.
Another object of the present invention proposes a kind of H264 code stream divided stator frame system.
To achieve these goals, technical scheme of the present invention is:
A kind of H264 code stream divided stator frame method, comprises the following steps:
At transmitting terminal, importance analysis is carried out to all NAL unit in every frame H.264 code stream, and carry out RTP subpackage according to the importance of NAL unit, the importance of NAL unit comprises 3 classes, be respectively important, generally important, inessential, then RTP bag also comprises 3 classes, is respectively important, generally important, inessential; For different importance RTP bag set up dedicated thread respectively, according to RTP bag importance, in corresponding dedicated thread once or repeat for n time transmission RTP wrap receiving terminal, n >=2;
At receiving terminal, the RTP of each repetition received bag is abandoned and wraps to reservation RTP, the RTP retained is wrapped and does not repeat RTP bag and carry out decoding acquisition video data.
First the present invention analyzes the importance of every frame H.264 all NALU of code stream, and carries out RTP subpackage according to NALU importance.Then, for the RTP bag of different importance is set up thread respectively and carried out transmission processing.In order to avoid the RTP packet loss of the highest NAL unit of importance, a thread special disposal can be used to send, and each bag can repeat to send repeatedly.And the RTP bag of the NAL unit of importance slightly low (generally important) sends, use the process of another one dedicated thread, each RTP bag repeats to send repeatedly.And the RTP bag of the NAL unit of importance minimum (inessential), then use the 3rd dedicated thread process, this thread is to each RTP bag transmission 1 time or repeatedly.Such meeting, under utilizing NAL unit importance to ensure the prerequisite that most important bag is not lost as far as possible, improves RTP bag transmitting efficiency.
A kind of H264 code stream divided stator frame system, comprising:
Transmitting terminal, for carrying out importance analysis to all NAL unit in every frame H.264 code stream, and carries out RTP subpackage according to the importance of NAL, the importance of NALU comprises 3 classes, be respectively important, generally important, inessential, then RTP bag also comprises 3 classes, is respectively important, generally important, inessential; Simultaneously for different importance RTP bag set up dedicated thread respectively, according to RTP bag importance, in corresponding dedicated thread once or repeat for n time transmission RTP wrap receiving terminal, n >=2;
Receiving terminal, wraps to reservation RTP for being abandoned by the RTP of each repetition received bag, wraps and does not repeat RTP bag carry out decoding acquisition video data to the RTP retained.
Compared with prior art, the invention has the beneficial effects as follows: use the NALU of the different importance of multi-threading parallel process to send, RTP transmitting efficiency can be taken into account while the high importance NALU packet loss of minimizing, improve the video quality after H.264 code stream decoding.
Accompanying drawing explanation
Fig. 1 is RTP pack arrangement schematic diagram.
Fig. 2 is NAL unit structural representation.
Fig. 3 is that 3 NAL unit form 1 RTP bag schematic diagram.
Fig. 4 is transmitting terminal RTP subpackage process block schematic illustration.
Fig. 5 is receiving terminal RTP group bag process block schematic illustration.
Fig. 6 is 1 frame H264 code stream schematic diagram in embodiment.
Embodiment
Below in conjunction with accompanying drawing, the present invention will be further described, but embodiments of the present invention are not limited to this.
System of the present invention comprises RTP subpackage transmitting terminal and the RTP group bag receiving terminal of H.264 code stream.
H.264 the RTP subpackage transmitting terminal implementation of code stream is as follows:
The every frame produced by H.264 encoder H.264 code stream has multiple NAL unit, and its RTP subpackage handling process as shown in Figure 4.
(1) enter mark NALU sequence number module, mark 1 ~ n successively by putting in order of NALU.
(2) then enter NALU importance analysis module, NALU1 ~ NALUn is divided into 3 classes by the R according to the head of each NALU: R=' 00 ', R=' 01 ' and ' 10 ', R=' 11 '.
(3) importance is the length analysis module that all NALU of R=' 11 ' can be sent to thread 1:
A () NALU length is greater than the NAL unit of 1460 bytes, can resolve into multiple part by 1460 bytes, each part enters type-identification module and is identified as " decomposition ", then enters network sending module 3, after entering RTP encapsulation, the repetition of each RTP bag sends to receiving terminal 3 times .
B () length is less than all NALU of 1460 bytes, length analysis module is from the NALU that sequence number is minimum, can to merge a follow-up m NALU successively, when when being merged into certain NAL unit, total length is more than 1460 byte, NALU is also had if follow-up, then first skip this NAL unit, until merge follow-up all NALU all can more than 1460 byte time.If m=0, then this NAL unit is sent into the mono-bag module of NALU, NALU directly can be sent into type-identification module mark " single bag " by single bag module, and then deliver to network sending module 3, carry out RTP package, send to receiving terminal, each bag repeats transmission 3 times.If m>1, then, after m+1 unit enters and merge multiple NALU block merging, enter type-identification module mark " merging ", then enter network sending module 3 and carry out RTP package, and repeat 3 times and be sent to receiving terminal.
C () then to residue NAL unit, presses (a), (b) reprocessing, until all NALU all send.
(4) all NAL unit of importance R=' 01 ' and ' 10 ', are admitted to thread 2, and the RTP package handling process of NAL unit is with (3), and just in network sending module 2, each RTP only repeats transmission 2 times.
(5) all NAL unit of importance R=' 00 ', are admitted to thread 3, and the RTP package handling process of NAL unit is with (3), and just in network sending module 1, each RTP only sends 1 time.
H.264 the RTP group bag receiving terminal implementation of code stream is as follows, as shown in Figure 5:
(1) in receiving terminal thread 1, after network reception module 3 receives the RTP bag of sending module 3 transmission, according to RTP packet number, duplicate packages abandons, unduplicated bag sends into type parsing module after removing RTP packet header, if " decomposition ", delivers in combination NALU module and has been combined into NALU; If single bag, then send into the mono-bag module of NALU, this module does not carry out any process; " if merging ", then send into fractionation module and split into multiple NALU.Then NALU order module is sent into.
(2), in receiving terminal thread 2, network reception module 2 receives the RTP bag that network sending module 2 sends, and handling process is with (1) thereafter.
(3), in receiving terminal thread 1, network reception module 2 receives the RTP bag that network sending module 1 sends, and handling process is with (1) thereafter.
(4) last NALU order module is by the NALU of process in thread 1,2,3, by the H.264 code stream that NALU sequence number sequence composition 1 frame is complete.
Use the NALU of the different importance of multi-threading parallel process to send, RTP transmitting efficiency can be taken into account while the high importance NALU packet loss of minimizing, improve the video quality after H264 code stream decoding.
Embodiment 1
At this, provide a simple embodiment, as shown in Figure 6, here 1 frame H.264 code stream be made up of 7 NALU.Each NALU length and importance mark in figure 6.
(1) code stream shown in Fig. 6 enters sequence number representation module, identifier number.
(2) importance analysis module obtains the importance of NALU1 ~ NALU7, and they is classified: R=' 11 ' (NALU1, NALU2, NALU3, NALU5) R=' 01 ' and ' 10 ' (NALU7) R=' 00 ' (NALU4, NALU6)
(3) NALU1/NALU2/NALU3/NALU5 is sent in thread 1, NALU7 is sent into thread 2, NALU4 and NALU6 feeding thread 3 simultaneously.
(4) in thread 1, length analysis decision-making module: (a) can analyze NALU1 length 432 byte, is less than 1460 bytes.
B () then analyzes next NALU2 length is 1446 bytes, both discoveries total length 1892 byte, and follow-up more than 1460 byte analysis modules discoveries also exist NALU3;
So c () analyzes length summation 4117 byte of NALU1 and NALU3, also more than 1460 bytes;
D total length that () continues to analyze NALU1 and NALU5 is 833 bytes, is less than 1460 bytes.
E the discovery of () analysis module is follow-up does not have NALU, now m>0, so NALU1/NALU5 is sent to " merging multiple NALU module " to merge, then " type identification " module id " merging " is delivered to, load after last network sending module 3 is combined carries out RTP package, and this RTP bag 1 is sent 3 times continuously to receiving terminal.
F length that () analysis module analyzes NALU2 is again 1446 bytes, is less than 1460 bytes.Then analyze NALU2 and NALU3 total length 5131 byte, exceed 1460 bytes.Now m=0, so NALU2 can be delivered to " the mono-bag of NALU " module, this module does not process directly to be delivered to after " type identification " module carries out " single bag " mark, is put into network sending module 3 and carries out RTP package 2, and completes and repeat for 3 times to send.
G () then analyzes length 3685 byte of NALU3, more than 1460 bytes.Deliver to " decomposing N ALU " decomposition module and become 3 parts, each part successively length is 1460,1460,765.And they are designated " decomposition " successively, be packaged into RTP bag 3, RTP bag 4, RTP bag 5 by mixed-media network modules mixed-media 3, send 3 times continuously.
(5) while thread 1 processes, length 4876 byte of the length of the NALU7 of length analysis module analysis R=' 10 ' and ' 01 ': NALU7 in thread 2, more than 1460 bytes, deliver to " decomposing N ALU " decomposition module and become 3 parts, each part successively length is 1460,1460,1460,496.And they are designated " decomposition " successively, be packaged into RTP bag 6, RTP bag 7, RTP bag 8 by mixed-media network modules mixed-media 2, send 2 times continuously.
(6) while thread 1,2 processes, the length of NALU4 and NALU6 of length analysis module analysis R=' 10 ' in thread 3: NALU4 and NALU6 total length 614 byte, follow-up without NALU, now m=1, send into " merging multiple NALU " block merging, then enter identification module to be designated " merging ", then wrap 5 by mixed-media network modules mixed-media 1 package RTP, and only send 1 time.
(7) receiving terminal thread 1:
A () network reception module 3 unpacks after receiving the 1st RTP bag 1, deliver to " type parsing " module to resolve to " merging ", deliver to after " splitting into multiple NALU " module splits into NALU1 and NALU5, delivering to NALU order module according to the sequence of NALU sequence number is NALU1, NALU5.
When () network reception wraps 1 to rear 2 RTP repeated b, directly abandon and down do not process.
C () network reception unpacks after the 1st RTP bag 2, and when delivering to type parsing module parsing type for " single bag ", deliver to " the mono-bag of NALU " module, this module does not process, directly deliver to NALU order module, now sort as NALU1, NALU2, NALU5 according to NALU sequence number.Other 2 RTP bags 2 same are dropped.
After unpacking after (d) network reception to RTP bag 3, RTP bag 4, RTP bag 5, deliver to after type parsing module resolves to " mergings " type, deliver to " combining NALU " module group and be bundled into NALU3.Then put into NALU order module to sort: NALU1, NALU2, NALU3, NALU5.
(8) while receiving terminal thread 1 processes, the network reception module 2 of receiving thread 2 is carried out RTP after receiving RTP bag 6, RTP bag 7, RTP bag 8 and is unpacked, and when then to resolve type be " mergings ", feeding " combines NALU ", and module group is bundled into NALU7.Then being placed into the sequence of " NALU sequence " module is: NALU1, NALU2, NALU3, NALU5, NALU7.
(9) process simultaneously at receiving terminal thread 1 and 2, receiving thread 3 network reception module 2 unpacks after receiving RTP bag 5, after sending into " type parsing " module parsing " merging " type, deliver to " splitting into multiple NALU " module and carry out splitting into NALU4, NALU6.Then NALU4, NALU6 are fed to the sequence of " NALU sequence " module for NALU1, NALU2, NALU3, NALU4, NALU5, NALU6, NALU7.
Now receiving terminal is just complete receives the 1 frame H264 code stream be made up of NALU1 ~ NANU7.
Above-described embodiments of the present invention, do not form limiting the scope of the present invention.Any amendment done within spiritual principles of the present invention, equivalent replacement and improvement etc., all should be included within claims of the present invention.

Claims (8)

1. a H264 code stream divided stator frame method, is characterized in that, comprise the following steps:
At transmitting terminal, importance analysis is carried out to all NAL unit in every frame H.264 code stream, and carry out RTP subpackage according to the importance of NAL unit, the importance of NAL unit comprises 3 classes, be respectively important, generally important, inessential, then RTP bag also comprises 3 classes, is respectively important, generally important, inessential; For different importance RTP bag set up dedicated thread respectively, according to RTP bag importance, in corresponding dedicated thread once or repeat for n time transmission RTP wrap receiving terminal, n >=2;
At receiving terminal, the RTP of each repetition received bag is abandoned and wraps to reservation RTP, the RTP retained is wrapped and does not repeat RTP bag and carry out decoding acquisition video data.
2. H264 code stream divided stator frame method according to claim 1, is characterized in that, represent that NAL unit is important in NAL unit during R=' 11 ', and R=' 01 ' or R=' 10 ' represents that NAL unit is generally important, and R=' 00 ' represents that NAL unit is inessential.
3. H264 code stream divided stator frame method according to claim 1 and 2, is characterized in that, adopt a dedicated thread to carry out process to important RTP bag and send, and each important RTP bag repeats transmission 3 times; Adopt another dedicated thread to carry out process to generally important RTP bag to send, and each generally important RTP bag repeats transmission 2 times; Adopt another dedicated thread to carry out process to unessential RTP bag to send, each unessential RTP bag transmission 1 time.
4. H264 code stream divided stator frame method according to claim 3, is characterized in that, at transmitting terminal to each NAL unit by successively marking, be labeled as respectively NALU1, NALU2 ..., NALUM; Carry out importance analysis to each NAL unit again, NAL unit comprises important NAL unit, general important NAL unit and inessential NAL unit;
Carry out length analysis to each NAL unit in important NAL unit, general important NAL unit and inessential NAL unit respectively, decomposing NAL unit according to length analysis result or merge, its concrete mode is:
1) length is greater than to the NAL unit of MTU MTU, is broken down into multiple NAL subelement, each NAL subelement is encapsulated as RTP bag, and each RTP bag is designated " decomposition ", send to receiving terminal;
2) length is less than to all NAL unit of MTU, from the NAL unit that sequence number is minimum, merges a follow-up m NAL unit successively, when being merged into certain NAL unit, when its total length exceedes the byte of MTU MTU, and follow-up other NAL unit in addition, then first skip this NAL unit; Until merge follow-up all NAL unit when all can exceed the length of MTU MTU, then merge stopping, adopting process in the same way remaining the NAL unit do not merged;
If m=0, then this NAL unit is encapsulated as RTP bag, and this RTP bag is designated " single bag ", send to receiving terminal;
If m>1, then m+1 NAL unit is merged, the NAL unit that m+1 merges is encapsulated as RTP bag, and this RTP bag is designated " merging ", be sent to receiving terminal.
5. H264 code stream divided stator frame method according to claim 4, it is characterized in that, at receiving terminal, receive the RTP bag that each dedicated thread sends, in being wrapped by the RTP of repetition, RTP bag abandons part only reservation RTP bag, removes the RTP bag remained or the packet header of not repeating RTP bag, and analyzes the load type that this RTP wraps, if RTP bag is designated " decomposition ", then obtain NAL unit to carrying out merging; When being designated " merging ", then carrying out decomposition and obtain NAL unit; When being designated " single bag ", then directly obtain NAL unit; Carry out sequence according to the sequence number of each NAL unit and regain H264 video data encoder.
6. a H264 code stream divided stator frame system, is characterized in that, comprising:
Transmitting terminal, for carrying out importance analysis to all NAL unit in every frame H264 code stream, and carries out RTP subpackage according to the importance of NAL, the importance of NALU comprises 3 classes, be respectively important, generally important, inessential, then RTP bag also comprises 3 classes, is respectively important, generally important, inessential; Simultaneously for different importance RTP bag set up dedicated thread respectively, according to RTP bag importance, in corresponding dedicated thread once or repeat for n time transmission RTP wrap receiving terminal, n >=2;
Receiving terminal, wraps to reservation RTP for being abandoned by the RTP of each repetition received bag, wraps and does not repeat RTP bag carry out decoding acquisition video data to the RTP retained.
7. H264 code stream divided stator frame system according to claim 6, it is characterized in that, described transmitting terminal comprises NALU sequence number identification module, NALU importance analysis module, NALU length analysis module, NALU decomposing module, NALU merging module and NALU type-identification module;
Described NALU sequence number identification module, for each NAL unit by successively marking, be labeled as respectively NALU1, NALU2 ..., NALUM;
Described NALU importance analysis module, for carrying out importance analysis to NAL unit, NAL unit comprises important NAL unit, general important NAL unit and inessential NAL unit;
Described NALU length analysis module, for carrying out length analysis to each NAL unit in important NAL unit, general important NAL unit and inessential NAL unit respectively;
Described NALU decomposing module, the NAL unit for length being greater than MTU MTU resolves into multiple NAL subelement, each NAL subelement is encapsulated as RTP bag, and is designated " decomposition " by each RTP bag, sends to receiving terminal by dedicated thread;
Described NALU merges module, all NAL unit for being less than MTU to length merge, from the NAL unit that sequence number is minimum, merge a follow-up m NAL unit successively, when being merged into certain NAL unit, when its total length exceedes the byte of MTU MTU, and follow-up other NAL unit in addition, then first skip this NAL unit, until merge follow-up all NAL unit when all can surpass the byte of MTU MTU, then merge stopping, adopting process in the same way remaining the NAL unit that do not merge;
If m=0, then this NAL unit is encapsulated as RTP bag, and this RTP bag is designated " single bag ", send to receiving terminal by dedicated thread;
If m>1, then m+1 NAL unit is merged, the NAL unit that m+1 merges is encapsulated as RTP bag, and this RTP bag is designated " merging ", be sent to receiving terminal by dedicated thread.
8. H264 code stream divided stator frame system according to claim 7, it is characterized in that, at receiving terminal, receive the RTP subpackage that each dedicated thread sends, in being wrapped by the RTP of repetition, RTP bag abandons part only reservation RTP bag, removes the RTP bag remained or the packet header of not repeating RTP bag; Described receiving terminal also comprises NALU type parsing module, NALU composite module, the mono-bag module of NALU, NALU fractionation module and NALU order module;
Described NALU type parsing module, for carrying out type parsing to the RTP bag removing packet header, when RTP bag is designated " decomposition ", is then sent to NALU composite module and carries out combination acquisition NAL unit, and be sent to NALU order module by this RTP bag; When RTP bag is designated " subpackage ", then this RTP bag is sent to the mono-bag module of NALU and obtains NAL unit, and be sent to NALU order module; When RTP bag is designated " combination ", then this RTP bag is sent to NALU fractionation module and carries out fractionation acquisition NAL unit, and be sent to NALU order module;
Described NALU order module, sorts to each NAL unit according to NALU sequence number.
CN201410777716.2A 2014-12-15 2014-12-15 Packet transmission method and packet transmission system for H264 code streams Pending CN104506959A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410777716.2A CN104506959A (en) 2014-12-15 2014-12-15 Packet transmission method and packet transmission system for H264 code streams

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410777716.2A CN104506959A (en) 2014-12-15 2014-12-15 Packet transmission method and packet transmission system for H264 code streams

Publications (1)

Publication Number Publication Date
CN104506959A true CN104506959A (en) 2015-04-08

Family

ID=52948663

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410777716.2A Pending CN104506959A (en) 2014-12-15 2014-12-15 Packet transmission method and packet transmission system for H264 code streams

Country Status (1)

Country Link
CN (1) CN104506959A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017190329A1 (en) * 2016-05-05 2017-11-09 华为技术有限公司 Video service transmission method and device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1852429A (en) * 2005-12-05 2006-10-25 华为技术有限公司 Video-code-flow grouped transmission method and system
CN1905531A (en) * 2006-08-11 2007-01-31 白杰 Method for processing data being transmitted and method and apparatus for transmitting data
US20080232472A1 (en) * 2007-03-23 2008-09-25 Samsung Electronics Co., Ltd. Method and apparatus for transmitting packet-based image frame
CN102006221A (en) * 2010-09-30 2011-04-06 北京交通大学 Method for optimizing quality of service of stream media
CN102067618A (en) * 2008-06-17 2011-05-18 汤姆逊许可证公司 Staggercasting method and apparatus using type of service (TOS) information
CN102340742A (en) * 2010-07-22 2012-02-01 华为技术有限公司 Data processing method and access point equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1852429A (en) * 2005-12-05 2006-10-25 华为技术有限公司 Video-code-flow grouped transmission method and system
CN1905531A (en) * 2006-08-11 2007-01-31 白杰 Method for processing data being transmitted and method and apparatus for transmitting data
US20080232472A1 (en) * 2007-03-23 2008-09-25 Samsung Electronics Co., Ltd. Method and apparatus for transmitting packet-based image frame
CN102067618A (en) * 2008-06-17 2011-05-18 汤姆逊许可证公司 Staggercasting method and apparatus using type of service (TOS) information
CN102340742A (en) * 2010-07-22 2012-02-01 华为技术有限公司 Data processing method and access point equipment
CN102006221A (en) * 2010-09-30 2011-04-06 北京交通大学 Method for optimizing quality of service of stream media

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
樊姗: "基于RTP的H.264视频传输技术的研究", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017190329A1 (en) * 2016-05-05 2017-11-09 华为技术有限公司 Video service transmission method and device
CN109076260A (en) * 2016-05-05 2018-12-21 华为技术有限公司 The transmission method and device of video traffic
US10939127B2 (en) 2016-05-05 2021-03-02 Huawei Technologies Co., Ltd. Method and apparatus for transmission of substreams of video data of different importance using different bearers

Similar Documents

Publication Publication Date Title
CN108306900B (en) Apparatus for transmitting media data in a multimedia transmission system
US9906326B2 (en) Device and method for transmitting/receiving a packet in communication system
KR101972951B1 (en) Method of delivering media data based on packet with header minimizing delivery overhead
JP6499071B2 (en) Transmitting apparatus, transmitting method, receiving apparatus, and receiving method
RU2369040C2 (en) Buffering during data streaming
CN100568971C (en) The transmission code stream of a kind of MPEG-4 is to the real time conversion method of internet stream media alliance stream
KR101933465B1 (en) Apparatus and method for transmitting/receiving a packet in a mobile communication system
US10985870B2 (en) Method and device for transmitting and receiving packet in communication system
CN102665140B (en) RTP (real-time transport protocol) packaging method of AVS (audio video coding standard) video frame
WO2012094915A1 (en) Method and system for implementing forward error correction for streaming media
CN110224795B (en) Method and apparatus for transmitting and receiving packet in communication system
JP5011239B2 (en) Broadcast packet generator, data supplement server, receiving terminal, and program thereof
KR101764636B1 (en) Method and device for transmitting/receiving broadcast signal
JP2007329606A (en) Repeating installation
EP3029869B1 (en) Information processing device, information processing method, and program
CN114339488B (en) Method and device for protecting Ethernet service in optical transmission network
CN101325701B (en) AVS encoding network transmission method for hard disk videocorder and video server
EP2842253B1 (en) Apparatus and method for transmitting a packet in a communication system
TW200714083A (en) Apparatus and method for IP datagram and rs-parity encapsulation and de-encapsulation
CN104506959A (en) Packet transmission method and packet transmission system for H264 code streams
CN103313045A (en) H.264 video sub-packaging method of dispatching desk of wideband multimedia trunking system
CN101159667B (en) Method of performing packet compression to packet data of mobile multimedia broadcasting system
CN105407351B (en) A kind of method and apparatus for rebuilding coding mode from Realtime Transport Protocol data packet
CN103546827B (en) Method, device and system for transmitting transport stream in television system
Series Carriage of IP packets in MPEG-2 transport streams in multimedia broadcasting

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20150408

RJ01 Rejection of invention patent application after publication