CN101595733A - Be used for the transmission of hierarchical modulation of scalable video bitstream and the apparatus and method of reception - Google Patents

Be used for the transmission of hierarchical modulation of scalable video bitstream and the apparatus and method of reception Download PDF

Info

Publication number
CN101595733A
CN101595733A CNA2007800506613A CN200780050661A CN101595733A CN 101595733 A CN101595733 A CN 101595733A CN A2007800506613 A CNA2007800506613 A CN A2007800506613A CN 200780050661 A CN200780050661 A CN 200780050661A CN 101595733 A CN101595733 A CN 101595733A
Authority
CN
China
Prior art keywords
bit stream
layer
scalable video
video bitstream
hierarchical
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CNA2007800506613A
Other languages
Chinese (zh)
Inventor
全东山
崔海哲
金在坤
林钟秀
洪镇佑
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Electronics and Telecommunications Research Institute ETRI
Original Assignee
Electronics and Telecommunications Research Institute ETRI
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Electronics and Telecommunications Research Institute ETRI filed Critical Electronics and Telecommunications Research Institute ETRI
Publication of CN101595733A publication Critical patent/CN101595733A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234381Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H20/00Arrangements for broadcast or for distribution combined with broadcast
    • H04H20/44Arrangements characterised by circuits or components specially adapted for broadcast
    • H04H20/46Arrangements characterised by circuits or components specially adapted for broadcast specially adapted for broadcast systems covered by groups H04H20/53-H04H20/95
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H04N19/37Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability with arrangements for assigning different transmission priorities to video input data or to video coded data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234327Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into layers, e.g. base layer and one or more enhancement layers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64784Data processing by the network
    • H04N21/64792Controlling the complexity of the content stream, e.g. by dropping packets
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H2201/00Aspects of broadcast communication
    • H04H2201/10Aspects of broadcast communication characterised by the type of broadcast system
    • H04H2201/11Aspects of broadcast communication characterised by the type of broadcast system digital multimedia broadcasting [DMB]

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

A kind of transmission of the hierarchical modulation that is used for scalable video bitstream and the apparatus and method of reception are provided.A kind of transmission of the hierarchical modulation that is used for scalable video bitstream and the transceiver of reception comprise decomposer, and it produces the HP bit stream with high priority (HP) based on the basic layer in a plurality of hierarchical layer that are included in scalable video bitstream; And produce LP bit stream based on the enhancement layer in a plurality of hierarchical layer that are included in scalable video bitstream with low priority (LP).

Description

Be used for the transmission of hierarchical modulation of scalable video bitstream and the apparatus and method of reception
Technical field
The present invention relates to be used for the transmission of hierarchical modulation of scalable video bitstream and the apparatus and method of reception, more specifically, relate to the apparatus and method of the transmission and the reception of the hierarchical modulation that is used for scalable video bitstream, so that the high-quality video service of senior T-DMB (T-DMB) is provided.
This work is subjected to the IT R﹠amp of MIC/IITA; The support of D project [2006-S017-01, the exploitation of the senior tranmission techniques of terrestrial DMB system].
Background technology
Because the arriving of digital broadcasting technology provides high-resolution (HD) Digital Television (DTV) that comprises high quality audio and video to serve and the digital multimedia transfer approach various of future generation of additional data service is attempted.
In addition, according to the expansion of various broadcast medium, program and user's taste, the society and the technique variation of digital broadcast service are finished rapidly, and broadcast environment changes over comprehensive/mobile environment for use that integrated information type (multimedia) service is provided from independence/fixing environment for use that single information type (video/audio/literal) service is provided.
As the part that broadcast environment changes, be used for the service of compact disk (CD) rank high quality audio being provided, being finished fast such as the exploitation of DMB (DMB) technology of the various additional data services of traffic and advertisement and clear Video service in mobile environment.
DMB is the digitized digital broadcast service of future generation that surpasses traditional amplitude modulation (AM) and frequency modulation (FM) radiotechnics according to audio broadcasting, is used to provide CD-rank high audio quality, various bi-directional data service and the good mobile quality of reception.
In addition, DMB is " audio/visual broadcasting " and can broadcast music and various types of multimedia messages with the conceptual expansion of " audio broadcasting " of conventional wireless electricity broadcasting, such as news, transport information, Weather information, geographical location information with as the video information of figure and image.
Accompany with it, the digital audio broadcasting of Korea S (DAB) expands to the video multimedia service with its notion by initial audio frequency and data, services, and at the beginning of 2003 its title is changed into DMB by DAB.
; if international standard is evolution from the Study on Technology of (big capacity and high quality communication and broadcasting) mobile multimedia service that fusion is provided through various terminals and development only; quality and the function that is provided by existing T-DMB greatly is provided this technology, and then the competitiveness of T-DMB technology can be kept.
As mentioned above, need exploitation high-quality mobile multimedia service technology, keeping and the compatibility of existing T-DMB, and according to the requirement of satisfying the user of popularizing of the digital broadcast service of better picture quality and broadband network.
Summary of the invention
Technical problem
In existing T-DMB, because maximum screen resolution is owing to limited data transfer rate is restricted to CLV Common Intermediate Format (CIF) 352*288, the user can't the receiving high definition Video service.
H.263 or MPEG-4 part 2 vision easy configuration document (simple profile) high 50% or bigger compression ratio the video compression standard that uses in existing T-DMB H.264 (ITU-T Rec.H.264|ISO/IEC14496-10 Annex A.21) has in most bit rates than.
Eliminate block effect filtering device and 1/4 pixel motion vector by using, H.264 can provide high-quality Video service, and by using multi-reference frame to carry out motion compensation and using SP (switching P) and SI (switching I) frame to have improved error robustness.
In addition, owing to H.264 adopt network abstraction layer (NAL), H.264 bit stream can easily transmit via diverse network.
, in H.264, can't be provided for providing the grading function of various screen resolution/temporal resolutions/picture quality,, can't in senior T-DMB, be provided for the multipurpose service in a source of high-quality video service because this.
Technical scheme
The invention provides the apparatus and method of the transmission and the reception of the hierarchical modulation that is used for scalable video bitstream,, keep simultaneously and the down link compatibility of existing T-DMB so that the high-quality video service of senior T-DMB (T-DMB) is provided.
According to an aspect of the present invention, a kind of transmitter that is used for scalable video bitstream is provided, this transmitter comprises decomposer, be used for the transmission of the hierarchical modulation of scalable video bitstream, this decomposer comprises: high priority (HP) channel generator produces the HP bit stream with HP based on the basic layer in a plurality of hierarchical layer that are included in scalable video bitstream; Low priority (LP) channel generator produces the LP bit stream with LP based on the enhancement layer in a plurality of hierarchical layer that are included in scalable video bitstream.
The decomposer that is used for the transmitter of scalable video bitstream can also comprise decomposer header resolver, by analyze network abstraction layer (NAL) header that comprises in the NAL unit of scalable video bitstream scalable video bitstream is resolved into basic layer and enhancement layer.
According to a further aspect in the invention, a kind of receiver that is used for scalable video bitstream is provided, receiver comprises the combiner (compositor) of the scalable video bitstream that is used for hierarchical modulation, and this combiner receives the HP bit stream with high priority (HP) by the decomposing grading video bit stream and has the LP bit stream of low priority (LP) and rebuild this scalable video bitstream.
The combiner that is used for the receiver of scalable video bitstream can comprise: the bit stream receiver that receives HP bit stream and LP bit stream; Analysis is included in network abstraction layer (NAL) header of NAL unit of HP bit stream and LP bit stream and the combiner header resolver of slice header; With the bit stream reconstructor, be used to each addressed location (AU) to rebuild and the output scalable video bitstream, wherein addressed location is one group of NAL unit at identical time shaft.
According to a further aspect in the invention, a kind of transceiver that is used for scalable video bitstream is provided, this transceiver comprises: transmitter, this transmitter comprises decomposer, be used for the transmission of the hierarchical modulation of scalable video bitstream, this decomposer produces by the decomposing grading video bit stream has the different a plurality of bit streams that transmit priority, and they are based on, and the certain layer of a plurality of hierarchical layer produces.This transceiver also comprises receiver, it comprises the combiner of the scalable video bitstream that is used for hierarchical modulation, this combiner receives a plurality of bit streams with different transmission priority that produce based on the certain layer in a plurality of hierarchical layer, and rebuilds this scalable video bitstream.
The decomposer of transmitter that is used for the transceiver of scalable video bitstream can comprise: high priority (HP) channel generator produces the HP bit stream with HP based on the basic layer in a plurality of hierarchical layer; Low priority (LP) channel generator produces the LP bit stream with LP based on the enhancement layer in a plurality of hierarchical layer; With decomposer header resolver, scalable video bitstream is resolved into basic layer and enhancement layer by analyzing network abstraction layer (NAL) header that in the NAL unit of scalable video bitstream, comprises.
The combiner of receiver that is used for the transceiver of scalable video bitstream can comprise: the bit stream receiver receives HP bit stream with HP that produces based on the basic layer in a plurality of hierarchical layer and the LP bit stream with LP that produces based on the enhancement layer in a plurality of hierarchical layer; Combiner header resolver, analysis is included in network abstraction layer (NAL) header and the slice header of the NAL unit of HP bit stream and LP bit stream; With the bit stream reconstructor, be used to each addressed location (AU) to rebuild and the output scalable video bitstream, wherein addressed location is one group of NAL unit corresponding to identical time shaft.
According to a further aspect in the invention, a kind of method that transmits scalable video bitstream is provided, this method comprise scalable video bitstream is resolved into as follows: produce HP bit stream with high priority (HP) based on the basic layer in a plurality of hierarchical layer that are included in the scalable video bitstream; And produce LP bit stream based on the enhancement layer in a plurality of hierarchical layer that are included in the scalable video bitstream with low priority (LP).
The decomposition of scalable video bitstream can also comprise decomposer header resolving, wherein by analyze network abstraction layer (NAL) header that comprises in the NAL unit of scalable video bitstream scalable video bitstream is resolved into basic layer and enhancement layer.
According to a further aspect in the invention, a kind of method that receives scalable video bitstream is provided, this method comprises the process of the scalable video bitstream that makes up hierarchical modulation, wherein rebuilds this scalable video bitstream by decomposing the LP bit stream that this scalable video bitstream receives the HP bit stream with high priority (HP) and have a low priority (LP).
The process of this combination can comprise: the bit stream receiving course, and wherein HP bit stream and LP bit stream are received; Combiner header resolving is wherein analyzed network abstraction layer (NAL) header and slice header in the NAL unit that is included in HP bit stream and LP bit stream; With the bit stream process of reconstruction, wherein rebuild and export this scalable video bitstream for each addressed location (AU), wherein addressed location is one group of NAL unit corresponding to identical time shaft.
According to a further aspect in the invention, a kind of method that transmits and receive scalable video bitstream is provided, this method comprises: the transport process that the hierarchical modulation of scalable video bitstream transmits, and wherein the certain layer based on a plurality of hierarchical layer produces a plurality of bit streams with different transmission priority; And the receiving course of the scalable video bitstream of hierarchical modulation, wherein rebuild this scalable video bitstream by receiving based on the different a plurality of bit streams that transmit priority of having of the certain layer in a plurality of hierarchical layer.
This transport process can comprise: high priority (HP) channel production process wherein produces the HP bit stream with HP based on the basic layer in a plurality of hierarchical layer; Low priority (LP) channel production process wherein produces the LP bit stream with LP based on the enhancement layer in a plurality of hierarchical layer; With decomposer header resolving, wherein scalable video bitstream is resolved into basic layer and enhancement layer by analyzing network abstraction layer (NAL) header that in the NAL unit of scalable video bitstream, comprises.
This receiving course can comprise: the bit stream receiving course wherein receives HP bit stream with HP that produces based on the basic layer in a plurality of hierarchical layer and the LP bit stream with LP that produces based on the enhancement layer in a plurality of hierarchical layer; Combiner header resolving, analyzed comprising network abstraction layer (NAL) header and slice header in the NAL unit of HP bit stream and LP bit stream; With the bit stream process of reconstruction, wherein be that each addressed location (AU) is rebuild and the output scalable video bitstream, wherein addressed location is one group of NAL unit corresponding to identical time shaft.
As mentioned above, the present invention advises a kind of transmission of the hierarchical modulation that is used for scalable video bitstream and the apparatus and method of reception, two sub-bit streams (HP bit stream and LP bit stream) in order to produce in senior T-DMB and to rebuild wherein, transmitter end is decomposed this scalable video bitstream and receiver end is rebuild this scalable video bitstream.
Beneficial effect
As mentioned above, according to the present invention, the apparatus and method that are used for the transmission of hierarchical modulation of scalable video bitstream and reception provide the high quality services of senior T-DMB, keep simultaneously and the compatibility of the down link of existing T-DMB.
Description of drawings
By being described in detail with reference to the attached drawings example embodiment of the present invention, above-mentioned and further feature of the present invention and advantage will be more clear, wherein:
Fig. 1 is the concept map of the hierarchical modulation of use in senior T-DMB (T-DMB);
Fig. 2 is the concept map of scalable video coding (SVC);
Fig. 3 is the allocation plan of traditional T-DMB service;
Fig. 4 is the allocation plan of data transfer rate available in senior T-DMB;
Fig. 5 is the allocation plan of senior T-DMB, wherein applies scalable video according to embodiments of the invention;
Fig. 6 is the block diagram that is used for the transmitter that the hierarchical modulation of scalable video bitstream transmits according to an embodiment of the invention in senior T-DMB;
Fig. 7 is the allocation plan of scalable video bitstream, wherein according to embodiments of the invention it is applied hierarchical modulating method;
Fig. 8 A is the block diagram that is used for the decomposer that the hierarchical modulation of scalable video bitstream transmits according to an embodiment of the invention in senior T-DMB;
Fig. 8 B is the figure of the operation of the decomposer of explaining that the hierarchical modulation that is used for scalable video bitstream according to an embodiment of the invention in senior T-DMB transmits;
Fig. 8 C is the flow chart of method of the decomposing grading video bit stream of the decomposer that illustrates that the hierarchical modulation that is used for scalable video bitstream according to an embodiment of the invention in senior T-DMB transmits;
Fig. 9 is the block diagram that is used for the receiver that the hierarchical modulation of scalable video bitstream receives according to an embodiment of the invention in senior T-DMB;
Figure 10 A is the block diagram that is used for the combiner that the hierarchical modulation of scalable video bitstream receives according to an embodiment of the invention in senior T-DMB;
Figure 10 B is the figure of the operation of the combiner of explaining that the hierarchical modulation that is used for scalable video bitstream according to an embodiment of the invention in senior T-DMB receives;
Figure 10 C is the flow chart of method of the reconstruction bit stream of the combiner that illustrates that the hierarchical modulation that is used for scalable video bitstream according to an embodiment of the invention in senior T-DMB receives.
Embodiment
Fig. 6 is the block diagram that is used for the transmitter that the hierarchical modulation of scalable video bitstream transmits according to an embodiment of the invention in senior T-DMB.
With reference to figure 6, the transmitter of current embodiment comprises transmission standard, external encode (reed-solomon) and the outside convolutional deinterleaver of the MPEG-4/MPEG-2 systems approach as existing T-DMB according to the present invention, also is included in the decomposer 600 in the video encoder of input side in addition.
Decomposer 600 codings have the scalable video of hierarchy and decompose the scalable video bitstream of every chnnel coding.
Particularly, a plurality of video layers are that individual bit stream and each video layer have bit rate, frame per second, image size and picture quality independently because SVC encodes, and therefore use decomposer 600 to decompose the sub-bit stream of suitable each channel so that hierarchical modulation transmits.
Fig. 8 A is the block diagram that is used for the decomposer 810 that the hierarchical modulation of scalable video bitstream transmits according to an embodiment of the invention in senior T-DMB.
With reference to figure 8A, decomposer 810 can comprise decomposer header resolver 811, HP channel generator 812 and LP channel generator 813.
Decomposer 810 is decomposed into the bit stream that is suitable for each channel with single scalable video bitstream and transmits so that carry out hierarchical modulation.
Scalable video bitstream comprises a plurality of hierarchical layer, has the bit rate, frame per second and the resolution that are used for individual bit stream independently.
Network abstraction layer (NAL) header that decomposer header resolver 811 is resolved in the NAL unit that is included in scalable video bitstream.
Decomposer header resolver 811 is categorized into basic layer and enhancement layer by resolving the NAL header with scalable video bitstream.
HP channel generator 812 produces the HP bit stream with HP based on the basic layer in a plurality of hierarchical layer that are included in the scalable video bitstream.
LP channel generator 813 produces the LP bit stream with LP based on the enhancement layer in a plurality of hierarchical layer that are included in the scalable video bitstream.
Senior T-DMB uses hierarchical modulating method, and available thus data transfer rate can have now more than the twice of T-DMB.
In order to apply hierarchical modulating method, according to current embodiment, can be by producing two sub-bit streams (HP and LP stream) in decomposer 810 through HP and the single scalable video bitstream of LP channel decomposing.In addition, according to current embodiment, can send the bit stream of two generations by single transmitter.
Fig. 8 C is that the decomposer that the hierarchical modulation transmission that is used for scalable video bitstream according to an embodiment of the invention in senior T-DMB is described comes the flow chart of the method for decomposing grading video bit stream.
The simple pseudo-code of decomposer algorithm is described now.
Situation A) pseudo-code under the situation of the bit stream that decomposes SD-rank 30 frame per second
if((Dependency_id==0)&&(NAL_unit_type!=6)) write_bitstream_HP;
else if(Dependency_id==0)&&(NAL_unit_type==6)) write_bitstream_LP;
else write_bitstream_LP;
Situation B) pseudo-code under the situation of the bit stream that uses non-reference picture decomposition SD-rank 15 frame per second
if((Dependency_id==0)&&(non_ref_pic!=0)&&(NAL_unit_type!=6))//
((Dependency_id==0)&&(NAL_unit_type==7))//
((Dependency_id==0)&&(NAL_unit_type==8)) write_bitstream_HP;
else if(Dependency_id!=0)//(NAL_unit_type==6)) write_bitstream_LP;
else drop;
SPS and PPS are the parameter N AL unit of indicating " the sequential parameter group " and " image parameter group " of the decoded information with every layer.
SEI represents that " supplemental enhancement information " and indication are about the information of classification.
Lid represents " Dependency_id ".
SPS and PPS also indicate the NAL cell type, and also export through decomposer corresponding to the SPS/PPS of equivalent layer.
Each nal_unit_type of definition as shown in table 2 (NAL cell type).
[table 2]
nal_unit_type The NAL location contents
1 The burst of the coding of non-IDR image
5 The burst of the coding of IDR image
6 Supplemental enhancement information (SEI)
7 Sequential parameter group (SPS)
8 Image parameter group (PPS)
20 The burst of the coding of non-IDR image in grading extension
21 The burst of the coding of IDR image in grading extension
For the decomposing grading video bit stream, the process of analyzing the syntactic information of SVC NAL header is essential, and in this case, essential syntactic element is as follows
(1) nal_unit_type: indication comprises type and identification SEI, SPS, PPS and the burst of NAL grouping of cells.
(2) dependency_id: be the information from the NAL header that H.264 expands, be used to decode procedure, and indication is used for the low layer of inter-layer prediction.
Therefore, in being encoded to two-layer bit stream, by the basic layer of dependency_id=0 indication, and dependency_id=1 indication enhancement layer.At Fig. 7, the Lid indication is used for the dependency_id that interlayer is distinguished.
With reference to figure 8C, in operation S801 and S802, can obtain nal_unit_type and dependency_id by the NAL header of resolving incoming bit stream.
Exception, under the situation of SEI message,, in operation S803, when the destroyer breaks down bit stream, can not transmit SEI message owing to when the extractor of supporting among the SVC extracts bit stream, use SEI message and in actual decode procedure, do not need SEI message.
Have dependency_id that two-layer bit stream can have a basic layer with CIF resolution and be 0 and dependency_id with enhancement layer of 4CIF resolution be 1.Therefore, in operation S804, can use dependency_id to decompose bit stream.
As a reference, produce two PPS that are used for enhancement layer and apply Intra_BL MB pattern separately to key images and non-key image to decode in single circulation.
As mentioned above, in operation S805 and S806, can use according to the method acquisition of current embodiment and basic layer and two corresponding bit streams of enhancement layer of scalable video bitstream, and two bit streams are transmitted through HP channel and LP channel respectively.
Fig. 9 is the block diagram that is used for the receiver that the hierarchical modulation of scalable video bitstream receives according to an embodiment of the invention in senior T-DMB.
With reference to figure 9, comprise the combiner 900 of the front that places decoding end according to the receiver of current embodiment of the present invention, combiner 900 is rebuild two son streams (HP bit stream and LP bit stream) of receiving through HP and LP channel so that receive high-quality/high-resolution AV service.
Combiner 900 receives two sub-bit streams and rebuilds decodable single scalable video bitstream.
Existing T-DMB terminal can provide existing service by only receiving the HP channel.Also promptly, current embodiment provides and has now the down link compatibility of T-DMB.
Senior T-DMB terminal must comprise the combiner 900 of the front that places decoding end, and combiner 900 is rebuild through two son streams (HP bit stream and LP bit stream) of HP and the reception of LP channel so that receive high-quality/high-resolution AV service.
Figure 10 A is the block diagram that is used for the combiner 1010 that the hierarchical modulation of scalable video bitstream receives according to an embodiment of the invention in senior T-DMB.
Scalable video bitstream comprises a plurality of hierarchical layer, and each hierarchical layer has bit rate, frame per second and resolution independently.
In order to apply hierarchical modulating method, transmitter can be by HP and LP channel (with reference to figure 8A and 8B) generation two the sub-bit streams (HP and LP bit stream) of decomposing grading video bit stream through decomposer according to an embodiment of the invention.
Combiner 1010 receives two sub-bit streams at the front end of the video decode end of bit stream receiver 1011, and rebuilds and export decodable scalable video bitstream.
With reference to figure 10A, comprise bit stream receiver 1011, combiner header resolver 1012 and bit stream reconstructor 1013 according to the combiner 1010 of current embodiment of the present invention.
Bit stream receiver 1011 receives HP bit stream and LP bit stream.
NAL header and slice header that combiner header resolver 1012 is analyzed in the NAL unit that is included in HP bit stream and LP bit stream.
Bit stream reconstructor 1013 receives two sub-bit streams (HP and LP bit stream) and rebuilds decodable scalable video bitstream for each addressed location (AU), and wherein addressed location is one group of NAL unit at identical time shaft.
Figure 10 C is that the combiner that the hierarchical modulation reception that is used for scalable video bitstream according to an embodiment of the invention in senior T-DMB is described is rebuild the flow chart of the process of bit stream.
Combiner provides the function of two bit streams rebuilding process HP channel and the transmission of LP channel to form decodable classification bit stream.
In order to rebuild the classification bit stream, use at the syntax element information of decomposer use and the frame_num element information in the slice header.The syntactic element that uses in combiner is as follows.
(1)nal_unit_type
(2) frame_num: as the ID of each image and in slice header, use.
In operation S1001, combiner sequentially obtains the NAL unit from buffer.The NAL unit is stored through HP and LP channel temporarily in buffer.
In operation S1002, can be through the process acquisition nal_unit_type of parsing by the NAL header of two incoming bit streams of destroyer breaks down.
After from two incoming bit streams, reading each NAL unit, obtain such as the parameter N AL of SPS and PPS and among operation S1004, select the grouping of HP and LP channel and in operation S1009, rebuild bit stream from the nal_unit_type of NAL header by using first condition statement (operation S1003).
, owing under the situation of enhancement layer, use two PPS, therefore can be come in operating S1009, to rebuild bit stream so that obtain the grouping that the 2nd PPS uses the LP channel by using second condition statement (S1005).
Because other situations are corresponding to the NAL unit that comprises actual burst information, slice header that therefore can be by resolving each NAL unit in operation S1007 also obtains frame_num and rebuild bit stream in operation S1009 in operation S1008.
The POC that the Frame_num indication is corresponding with the actual displayed time of bit stream.
As mentioned above, can calculate POC by dependency_id that analyzes the NAL header of importing the NAL unit and the frame_num (resolving NAL header and slice header) that imports the slice header of NAL unit.
Can come to rebuild bit stream corresponding to the NAL unit of identical POC by set, and can rebuild bit stream according to the NAL unit with less frame_num of the burst NAL unit that obtains from HP and LP according to dependency_id.
In this case, can walk before bit stream for the NAL unit of each AU with low dependency_id.
Rebuilt when bit stream, come to locate SEI/SPS/PPS by identification nal_unit_type, and can after SEI/SPS/PPS, locate NAL unit corresponding to the reconstruction of real data at the place that begins of bit stream.
The invention pattern
Fig. 1 is the concept map of the hierarchical modulation of use in senior T-DMB (T-DMB).
Along with existing WLAN (wireless local area network) (LAN) is replaced by wireless broadband the Internet (Wibro), and existing mobile communications network is inserted (HSDPA) network by high-speed downlink packet and replaces, and T-DMB also must provide high transmission efficiency/high-quality service by the service restriction that overcomes prior art in the future.
Provide the senior T-DMB of high transmission efficiency/high-quality service to use hierarchical modulating method, and roughly double the available data rate that existing T-DMB provides.
With reference to figure 1,,, then can produce two sub-bit streams (HP bit stream and LP bit stream) by bit stream being decomposed into high priority (HP) and low priority (LP) channel if use hierarchical modulating method.
Also promptly, if use hierarchical modulating method, then can transmit two sub-bit streams (HP bit stream and LP bit stream) by single transmitter.
In senior T-DMB, be among the T-DMB of future generation, than the 1.062Mbps as the available data rate of using among the existing T-DMB, data can be transmitted by about 2Mbps, and can provide high-quality/high-resolution Video service based on the available data rate that increases.
In the senior T-DMB that uses hierarchical modulating method, can provide existing T-DMB service through the HP channel, it provides and is other screen resolution of CLV Common Intermediate Format (CIF) 352*288 level to the maximum, and providing T-DMB service through the LP channel simultaneously, it provides high-quality (high-resolution) single-definition (SD) 720*488 level other screen resolution.
Fig. 2 is the concept map of scalable video coding (SVC).
(it is uniting group (JVT) (MPEG﹠amp with SVC in the present invention; VCEG) by standardization) be applied to senior T-DMB so that keep and the compatibility of existing T-DMB, serve existing T-DMB simultaneously relatively and serve the content of multimedia of high-quality (high-resolution).
SVC as H.264 extended coding technology is new extended coding technology, be developed the problem that solves hierarchical coding based on the graded properties that in traditional MPEG-2, MPEG-4 etc., proposes once, such as hanging down compression efficient, not having composite ratings support and high implementation complexity.
With reference to figure 2, SVC is encoded to bit stream with a plurality of video layers.Each video layer comprises basic layer and at least one enhancement layer, and it can be by continuous stratification.
Each enhancement layer can be based on the low layer information representation to the Maximum Bit Rate of its permission, maximum frame per second and ultimate resolution.At SVC, because more enhancement layers by continuous stratification, therefore can be supported the more more options of bit rate, frame per second and resolution.
As mentioned above, SVC is the coding techniques that is suitable for the content of multimedia service of universal multimedia visit (UMA) environment, and it can synthetically solve the problem such as various preferred of the various bandwidth that take place, various receiving terminal performance and resolution, content consumer in heterogeneous network environment.
The present invention is proposed to be used in the transmission of hierarchical modulation of scalable video bitstream and the apparatus and method of reception, so that provide high quality services in senior T-DMB, keeps simultaneously and the down link compatibility of existing T-DMB.
More specifically, the present invention is proposed to be used in the transmission of hierarchical modulation of scalable video bitstream and the apparatus and method of reception, in order to produce in senior T-DMB and to rebuild two sub-bit streams (HP bit stream and LP bit stream), transmitter end decomposing grading video bit stream and receiver end are rebuild this scalable video bitstream therein.
Fig. 3 is the allocation plan of traditional T-DMB service.With reference to figure 3, at existing T-DMB, because the interference between channel frequency, the service provider can have from the data transfer rate of the remaining 1.536Mbps of maximum data rate 2Mbps.
Reject the external encode such as chnnel coding from the data transfer rate of 1.536Mbps, the actual available data rate that can use of service provider is approximately 1.062Mbps.
Therefore, each service provider at existing T-DMB can use available data transfer rate that two CIF (352*288) rank audio frequency-visions (AV) program service, compact disk (CD) quality level audio service and data, services are provided.
The AV program that provides use H.264 video compression standard and to every service provider's coding up to 512-548Kbps.
Fig. 4 is the allocation plan of data transfer rate available in senior T-DMB.With reference to figure 4, in the follow-on senior T-DMB as existing T-DMB, each service provider can have the use hierarchical modulating method available data rate of the twice of data transfer rate before.
At senior T-DMB, can provide traditional T-DMB service through the HP channel, and can provide high transmission efficiency/high quality services through the LP channel.
Under the situation of high transmission efficiency service and traditional services relatively, can transmit about 4 CIF (352*288) rank AV program.
Under the situation of high-quality service and traditional services relatively, a CIF (352*288) rank AV program and the Video service with other screen resolution of SD (720*480) level can be provided.
Fig. 5 is the allocation plan of senior T-DMB, wherein applies scalable video according to embodiments of the invention.
With reference to figure 5, when when applying scalable video and come AV program of hierarchical coding, the AV program is encoded into LP channel by scalable video coding to the HP channel with by SD (720*480) rank corresponding to enhancement layer by CIF (352*288) rank corresponding to basic layer.
When traditional T-DMB terminal received the service of CIF (352*288) rank through the HP channel, senior T-DMB terminal received SD (720*480) rank Video service through the LP channel in addition.
As mentioned above,, can in senior T-DMB, provide high-quality DMB service, keep simultaneously and the compatibility of the down link of existing T-DMB according to embodiments of the invention.
Fig. 7 is the allocation plan of scalable video bitstream, wherein it is applied hierarchical modulating method according to an embodiment of the invention.
With reference to figure 7, scalable video bitstream can comprise the basic layer of distributing to the HP channel and the enhancement layer of distributing to the LP channel.
The basic layer of distributing to the HP channel have the CIF rank of 30 frame per second and with the 384Kbps coding so that keep and and the compatibility of the down link of existing T-DMB.
When layer is distributed to the HP channel substantially, distribute enhancement layer.
Enhancement layer has the SD rank of 30 frame per second and encodes with about 900Kbps.
In order to satisfy the target bit rate of distributing to each channel, SVC is applied H.264 rate control algorithm, and the video coding of basic layer is followed H.264 standard.
In senior T-DMB, can change within the specific limits according to the target bit rate of SVC and can not exceed total available data rate of each service provider.
If according to the bit rate height of content type, the enhancement layer of then distributing to the LP channel in addition can use non-reference picture to be encoded with 15 frame per second.
In this case, decomposer must only be exported the reference picture of the enhancement layer of distributing to the LP channel.
In addition, in senior T-DMB, consider and scalable video complexity terminal capabilities relatively, do not consider classification according to fine granular scalability (FGS).
Fig. 8 B is the figure of the operation of the decomposer 820 of explaining that the hierarchical modulation that is used for scalable video bitstream according to an embodiment of the invention in senior T-DMB transmits.
In H.264, after carrying out video coding, produce the individual bit stream of forming by the NAL unit, each NAL unit has the NAL header of 1 byte.
Except 1 byte N AL header H.264, scalable video also has 2 byte header that comprise rating information in addition.
By each field in the international standard definition NAL header.
The main field of table 1 explanation NAL header.
[table 1]
Main NAL header fields Implication
Num_ref_idc (AVC hdr) It is for referencial use whether this field indicates this NALU to use.' 0 ' indicate this NALU not by other NALU with for referencial use and can be dropped.NALU is by another NALU reference in any other numeral indication.This field is the AVC header fields.
Discardable_flag (SVC hdr) Whether this field indicates this NALU can be dropped.1 bit
Dependency_id (SVC hdr) This field identification space layer and CGS layer.
Temporal_level (SVC hdr) This field recognition time layer.
Quality_level (SVC hdr) This field identification RGS layer.
Fragment_order (Slice hdr) This field is discerned the segmentation of identical RGS layer.
SimplePriority_id (SVC hdr) This field have among the DTQ priority and can the independent allocation priority level (for available fully DTQ group, the function that provides with reference to the DTQ track can be provided this field).
As the Dependency_id of one of main field of NAL header is to be used to classify the grammer of basic layer and enhancement layer.
Therefore.Each input NAL header (parsing of NAL header) of decomposer Algorithm Analysis by decomposer 820 execution.
Decomposer 820 can be exported two sub-bit streams (HP and LP bit stream) of distributing to HP and LP channel respectively.
Decomposer 820 produces the HP channel (HP bit stream) with HP based on the basic layer in the hierarchical layer that is included in the single scalable video bitstream.
Decomposer 820 produces the LP channel (LP bit stream) with LP based on the enhancement layer in hierarchical layer.
Figure 10 B is the figure of the operation of the combiner 1020 of explaining that the hierarchical modulation that is used for scalable video bitstream according to an embodiment of the invention in senior T-DMB receives.
Basically, combiner 1020 is determined the picture order count (POC) corresponding with the DISPLAY ORDER of corresponding frame (NAL unit) by the NAL header information of parsing NAL unit and other slice header.
Combiner 1020 uses existing information, the nal_ref_idc of NAL header and the frame_num information of nal_unit_type and slice header of Dependency_id.
The decodable scalable video bitstream of combiner 1020 last outputs.
Therefore, in order to export the bit stream that is used for each addressed location (AU), POC information must need, and wherein addressed location is one group of NAL unit at identical time shaft.Can calculate POC information by the following pseudo-code that provides by existing SVC is provided.
if(REFERENCE) POC=(2*frame_num);
else POC=(2*frame_num)-1;
Therefore, combiner 1020 can use the header information of the corresponding frame that uses in decomposer to export decodable bit stream.

Claims (15)

1. transmitter that is used to have the scalable video bitstream of a plurality of hierarchical layer, this transmitter comprises the decomposer of the transmission of the hierarchical modulation that is used for scalable video bitstream, this decomposer comprises:
High priority (HP) channel generator produces the HP bit stream with HP based on the basic layer that is included in a plurality of hierarchical layer in the scalable video bitstream;
Low priority (LP) channel generator produces the LP bit stream with LP based on the enhancement layer that is included in a plurality of hierarchical layer in the scalable video bitstream.
2. transmitter as claimed in claim 1, wherein this decomposer also comprises decomposer header resolver, its NAL header that is included in by analysis in the network abstraction layer NAL unit of scalable video bitstream resolves into basic layer and enhancement layer with scalable video bitstream.
3. transmitter as claimed in claim 1, wherein according to basic layer of standard code H.264 and enhancement layer, basic layer is encoded to the bit rate of CLV Common Intermediate Format (CIF) rank 30 frame per second and 384Kbps, and enhancement layer coding is the bit rate of single-definition (SD) rank 30 frame per second and 900Kbps.
4. receiver that is used to have the scalable video bitstream of a plurality of hierarchical layer, this receiver comprises the combiner of the scalable video bitstream that is used for hierarchical modulation, and this combiner receives the HP bit stream with high priority HP by the decomposing grading video bit stream and has the LP bit stream of low priority LP and rebuild this scalable video bitstream.
5. receiver as claimed in claim 4, wherein combiner comprises:
Receive the bit stream receiver of HP bit stream and LP bit stream;
Analysis is included in the NAL header in the network abstraction layer NAL unit of HP bit stream and LP bit stream and the combiner header resolver of slice header; With
The bit stream reconstructor is used to each addressed location (AU) to rebuild scalable video bitstream, and wherein addressed location is one group of NAL unit at identical time shaft.
6. receiver as claimed in claim 4 wherein produces the HP bit stream based on the basic layer in a plurality of hierarchical layer, and produces the LP bit stream based on the enhancement layer in a plurality of hierarchical layer.
7. receiver as claimed in claim 6, wherein according to basic layer of standard code H.264 and enhancement layer, basic layer is encoded to the bit rate of CLV Common Intermediate Format (CIF) rank 30 frame per second and 384Kbps, and enhancement layer coding is the bit rate of single-definition (SD) rank 30 frame per second and 900Kbps.
8. a transmission has the method for the scalable video bitstream of a plurality of hierarchical layer, and this method comprises that this scalable video bitstream of decomposition is as follows:
Produce HP bit stream based on the basic layer in a plurality of hierarchical layer that are included in the scalable video bitstream with high priority HP; And
Produce LP bit stream with low priority LP based on the enhancement layer in a plurality of hierarchical layer that are included in the scalable video bitstream.
9. method as claimed in claim 8, the decomposition of scalable video bitstream also comprises decomposer header resolving, and wherein the NAL header that is included in the network abstraction layer NAL unit of scalable video bitstream by analysis resolves into basic layer and enhancement layer with scalable video bitstream.
10. method as claimed in claim 8, wherein according to basic layer of standard code H.264 and enhancement layer, basic layer is encoded to the bit rate of CLV Common Intermediate Format (CIF) rank 30 frame per second and 384Kbps, and enhancement layer coding is the bit rate of single-definition (SD) rank 30 frame per second and 900Kbps.
11. a reception has the method for the scalable video bitstream of a plurality of hierarchical layer, this method comprises the process of the scalable video bitstream that makes up hierarchical modulation, wherein receives by decomposing this scalable video bitstream HP bit stream with high priority HP that produces and the LP bit stream with low priority LP and rebuilds this scalable video bitstream.
12. method as claimed in claim 11, wherein the process of this combination comprises:
The bit stream receiving course, wherein HP bit stream and LP bit stream are received;
Combiner header resolving is wherein analyzed NAL header and slice header in the network abstraction layer NAL unit that is included in HP bit stream and LP bit stream; With
The bit stream process of reconstruction is wherein rebuild this scalable video bitstream for each addressed location (AU), and wherein addressed location is one group of NAL unit at identical time shaft.
13. method as claimed in claim 11 wherein produces the HP bit stream based on the basic layer in a plurality of hierarchical layer, and produces the LP bit stream based on the enhancement layer in a plurality of hierarchical layer.
14. method as claimed in claim 13, wherein basic layer is encoded to the bit rate of CLV Common Intermediate Format (CIF) rank 30 frame per second and 384Kbps, and enhancement layer coding is the bit rate of single-definition (SD) rank 30 frame per second and 900Kbps.
15. a computer readable recording medium storing program for performing, storage are used for the computer-readable program of any one method of enforcement of rights requirement 8 to 14.
CNA2007800506613A 2006-11-30 2007-10-31 Be used for the transmission of hierarchical modulation of scalable video bitstream and the apparatus and method of reception Pending CN101595733A (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
KR1020060120113 2006-11-30
KR20060120113 2006-11-30
KR1020070018079 2007-02-22

Publications (1)

Publication Number Publication Date
CN101595733A true CN101595733A (en) 2009-12-02

Family

ID=39219799

Family Applications (1)

Application Number Title Priority Date Filing Date
CNA2007800506613A Pending CN101595733A (en) 2006-11-30 2007-10-31 Be used for the transmission of hierarchical modulation of scalable video bitstream and the apparatus and method of reception

Country Status (3)

Country Link
KR (1) KR100799592B1 (en)
CN (1) CN101595733A (en)
MX (1) MX2009005737A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102131083B (en) * 2010-01-18 2013-08-14 西安电子科技大学 Method and device for transmitting scalable videos based on priorities
WO2018006771A1 (en) * 2016-07-05 2018-01-11 Vishare Technology Limited Methods and systems for video streaming

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9621906B2 (en) 2012-12-10 2017-04-11 Lg Electronics Inc. Method for decoding image and apparatus using same
CA3024609C (en) 2014-05-09 2020-04-07 Electronics And Telecommunications Research Institute Signal multiplexing apparatus using layered division multiplexing and signal multiplexing method
KR101824919B1 (en) 2015-10-30 2018-02-02 서울과학기술대학교 산학협력단 Apparatus for Transmitting and Receiving Scalable Multi-point Video

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6798838B1 (en) 2000-03-02 2004-09-28 Koninklijke Philips Electronics N.V. System and method for improving video transmission over a wireless network
US7958532B2 (en) 2001-06-18 2011-06-07 At&T Intellectual Property Ii, L.P. Method of transmitting layered video-coded information
EP1762098A1 (en) 2004-05-12 2007-03-14 Koninklijke Philips Electronics N.V. Scalable video coding for broadcasting

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102131083B (en) * 2010-01-18 2013-08-14 西安电子科技大学 Method and device for transmitting scalable videos based on priorities
WO2018006771A1 (en) * 2016-07-05 2018-01-11 Vishare Technology Limited Methods and systems for video streaming
CN109937578A (en) * 2016-07-05 2019-06-25 高讯科技有限公司 Method and system for video flowing
US10951954B2 (en) 2016-07-05 2021-03-16 Vishare Technology Limited Methods and systems for video streaming
CN109937578B (en) * 2016-07-05 2022-01-21 高讯科技有限公司 Method and system for video streaming

Also Published As

Publication number Publication date
MX2009005737A (en) 2009-06-08
KR100799592B1 (en) 2008-01-30

Similar Documents

Publication Publication Date Title
CA2650151C (en) An iptv receiving system and data processing method
CN101507281B (en) Signaling of region-of-interest scalability information in media files
KR101564461B1 (en) Method and system for encoding a video data signal, encoded video data signal, method and system for decoding a video data signal
JP5213085B2 (en) Encoding system
KR101029854B1 (en) Backward-compatible aggregation of pictures in scalable video coding
CN101584217B (en) Method and device of extended inter-layer coding for spatial scability
CN101578870B (en) Variable length coding table selection based on block type statistics for refinement coefficient coding
CN103843342A (en) Image decoding method and apparatus using same
CN101849417A (en) A scalable video coding method for fast channel change and increased error resilience
CN101180831A (en) Method and apparatus for hierarchical transmission/reception in digital broadcast
CN105027567A (en) Method and apparatus for video coding and decoding
CN101663893A (en) coding systems
WO2008066257A1 (en) Apparatus and method for hierarchical modulation transmission and reception of scalable video bitstream
CN103404140A (en) Indicating bit stream subsets
CN104137561A (en) Method for decoding image and apparatus using same
US8743950B2 (en) Method for filtering, transmitting and receiving scalable video streams, and corresponding programs, server, intermediate node and terminal
KR20120018281A (en) Apparatus and method for encoding/decoding multi-layer videos
KR100952185B1 (en) System and method for drift-free fractional multiple description channel coding of video using forward error correction codes
CN102498722A (en) Distribution of mpeg-2 ts multiplexed multimedia stream with selection of elementary packets of the stream
CN101595733A (en) Be used for the transmission of hierarchical modulation of scalable video bitstream and the apparatus and method of reception
Choi et al. Dynamic and interoperable adaptation of SVC for QoS-enabled streaming
MX2015007827A (en) Robust digital channels.
KR100937590B1 (en) Multiple quality image contents service system and upgrade method thereof
KR100714446B1 (en) Method for transmitting Moving Picture Experts Group multi layered video
Vaz et al. Video Scalability Advantages for the next Brazilian Terrestrial Digital Television Generation (TV 3.0)

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20091202