CN103024369A - Transmitting end, terminal, system and method for multiplexing of hierarchical coding - Google Patents
Transmitting end, terminal, system and method for multiplexing of hierarchical coding Download PDFInfo
- Publication number
- CN103024369A CN103024369A CN2011102799369A CN201110279936A CN103024369A CN 103024369 A CN103024369 A CN 103024369A CN 2011102799369 A CN2011102799369 A CN 2011102799369A CN 201110279936 A CN201110279936 A CN 201110279936A CN 103024369 A CN103024369 A CN 103024369A
- Authority
- CN
- China
- Prior art keywords
- hierarchical coding
- audio
- multiplexed sub
- sub frame
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 26
- 238000005538 encapsulation Methods 0.000 claims description 18
- 230000005540 biological transmission Effects 0.000 description 5
- 230000003750 conditioning effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000630 rising effect Effects 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000005303 weighing Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234327—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into layers, e.g. base layer and one or more enhancement layers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
- H04N21/4622—Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/631—Multimode Transmission, e.g. transmitting basic layers and enhancement layers of the content over different transmission paths or transmitting with different error corrections, different keys or with different transmission protocols
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Time-Division Multiplex Systems (AREA)
Abstract
The invention provides a transmitting end, a terminal, a system and a method for multiplexing of hierarchical coding. The method comprises the following steps of: dividing a traffic channel into a plurality of channels different in reliability; encoding data of a service into M levels; encapsulating M levels of the data into N different multiplex sub-frames; and encapsulating the N multiplex sub-frames on L different reliable channels and then transmitting the N multiplex sub-frames, wherein the M, the N and the L are natural numbers which are greater than 1. By adopting the technical scheme, hierarchical coding audio-video data are carried by multiplex frames, and hierarchical coding data different in importance are transmitted in physical channels different in reliability, so that the receiving reliability of the terminal is improved, and the most basic service can be received when the signal is poor.
Description
Technical field
The invention belongs to multimedia broadcasting or technical field of mobile TV, specially refer to a kind of multiplexing transmitting terminal, terminal, system and method for audio frequency and video hierarchical coding that in multimedia broadcasting network, transmit.
Background technology
Mobile Multimedia Broadcasting is a kind of Play Technique for Multimedia of rising in recent years.By hand-held terminal, in the situation that TV be broadcasted or be watched to high-speed mobile can by listening to audio.Terminal receives programme by wireless protocols, selects the channel of oneself having the right to watch, thereby can accept to select the multi-medium data of different programs, realizes listening to the radio programme or seeing TV at portable terminal.
The different business datum of system's emission, can be encapsulated in respectively in the different physical channels, the data of each program comprise again: one or more in video, audio frequency and the data three types, terminal receives relevant data, by the player on the terminal, realize the normal play of audio or video.
Wireless channel is to be comprised of the channel of different reliabilities, and the difference according to the importance of data is distributed in the different reliability channels and transmits, and highly reliable channel transmits most important data, thereby protects important data.During the terminal receive data, if wireless signal is better, the data of different reliability channels can both receive smoothly, and program quality is higher, when wireless signal is relatively poor, can only receive the data that highly reliable channel transmits, and program quality is relatively poor.
The audio or video data are can hierarchical coding, be divided into basic layer and a plurality of extension layers, reliability requirement to physical channel is that basic layer requires the highest, the reliability requirement of a plurality of extension layers reduces successively, data system can send hierarchical coding respectively in different reliability channels after, under the poorest condition of signal, terminal can only receive base layer data, can hear basic audio broadcasting or see basic video broadcasting, if signal conditioning is better, one or all extension layer data can be received, just high-quality audio-video-frequency broadcast can be realized.
In radio network, the method for existing transmission hierarchical coding audio, video data is:
(1) data of different levels is placed on different RTP (Real-time Transport Protocol, real time transport protocol) in the stream, each rtp streaming independently transmits, and transmits the characterising parameter of hierarchical coding outside band by agreement, and terminal receives corresponding data according to these parameters.
(2) data of different levels are placed in the same rtp streaming, carry the characterising parameter of hierarchical coding in RTP packet header, terminal receives and distinguishes the data of different levels according to these parameters.
These 2 kinds of methods all transmit by the RTP mode, the carrying expense comprises RTP packet header, UDP (User Datagram Protocol) packet header, IP packet header, reach 40 more than the byte, and each RTP message on average is a hundreds of byte, expense is usually between 40% to 80%.
Summary of the invention
The invention provides a kind of in multi-media broadcasting system multiplexing transmitting terminal, terminal, the system and method for hierarchical coding, the hierarchical coding data of different importance are implemented the protection of different stage, protection significant data, the reliability that receives to improve terminal.
The invention provides the multiplexing method of a kind of hierarchical coding, comprising:
Traffic Channel is divided into the different channel of a plurality of reliabilities, be M level with the data encoding of a business, the data of a described M level are encapsulated in N the different multiplexed sub frame, and a described N multiplexed sub frame is encapsulated in respectively on L the different reliable channel and sends;
Described M, N and L are the natural number greater than 1.
Further, when described transmitting terminal sends data, at multiplex frame head or the multiplexed sub frame head also carries the hierarchical coding parameter, described hierarchical coding parameter comprises that hierarchical coding relies on the subframe numbering, when the decoding of the audio, video data of multiplexed sub frame depended on the audio, video data of other multiplexed sub frames, hierarchical coding relied on the subframe numbering and is made as the multiplexed sub frame numbering that is relied on; When this multiplexed sub frame transmitted basic layer audio, video data, hierarchical coding relied on the subframe numbering and is made as the multiplexed sub frame numbering of self.
Further, described hierarchical coding parameter also comprises the indication of audio frequency hierarchical coding parameter, is used to indicate whether audio frequency hierarchical coding parameter is arranged in the multiplexed sub frame.
Further, when in described audio frequency hierarchical coding parameter dial gauge is given instructions in reply with subframe audio frequency hierarchical coding parameter being arranged, described hierarchical coding parameter comprises that also the audio frequency hierarchical coding begins the number of plies and the audio frequency hierarchical coding finishes the number of plies;
Described audio frequency hierarchical coding begins the beginning number of plies that the number of plies is used to indicate multiplexed sub frame sound intermediate frequency hierarchical coding, and described audio frequency hierarchical coding finishes the end number of plies that the number of plies is used to indicate multiplexed sub frame sound intermediate frequency hierarchical coding.
Further, when described business comprises voice data and video data simultaneously, be the M1 layer with audio data coding, be the M2 layer with video data encoding, described M is the maximum among M1 and the M2; And M1 and M2 are not 1 simultaneously.
The present invention also provides a kind of hierarchical coding multiplexing method, comprising:
After terminal is received multiplexed frame, take out multiplexed sub frame, then take out multiplexed sub frame head, audio section, video-frequency band data, hierarchical coding parameter according to encapsulation, obtain the dependence of the audio, video data in one or more multiplexed sub frames, after the audio, video data combination with a plurality of multiplexed sub frames, carry out audio/video decoding, and play.
Further, terminal is according to the timestamp in audio section or the video-frequency band, and the data that have identical time stamp in the data with different levels enter synchronously decoder and decode.
The present invention also provides a kind of hierarchical coding multiplexing transmitting terminal:
Described transmitting terminal comprises encoder, multiplexer and modulator;
Described encoder is used for audio, video data is encoded to M level;
The data that described multiplexer is used for a described M level are encapsulated in N different multiplexed sub frame;
Described modulator sends for N multiplexed sub frame being encapsulated in respectively on L the different reliable channel;
Described M, N and L are the natural number greater than 1.
Further, described multiplexer also is used in multiplex frame head or multiplexed sub frame head encapsulation hierarchical coding parameter, described hierarchical coding parameter comprises that hierarchical coding relies on the subframe numbering, when the decoding of the audio, video data of multiplexed sub frame depended on the audio, video data of other multiplexed sub frames, hierarchical coding relied on the subframe numbering and is made as the multiplexed sub frame numbering that is relied on; When this multiplexed sub frame transmitted basic layer audio, video data, hierarchical coding relied on the subframe numbering and is made as the multiplexed sub frame numbering of self.
Further, the hierarchical coding parameter of described encapsulation also comprises the indication of audio frequency hierarchical coding parameter, is used to indicate whether audio frequency hierarchical coding parameter is arranged in the multiplexed sub frame.
Further, when in described audio frequency hierarchical coding parameter dial gauge is given instructions in reply with subframe audio frequency hierarchical coding parameter being arranged, described hierarchical coding parameter comprises that also the audio frequency hierarchical coding begins the number of plies and the audio frequency hierarchical coding finishes the number of plies;
Described audio frequency hierarchical coding begins the beginning number of plies that the number of plies is used to indicate multiplexed sub frame sound intermediate frequency hierarchical coding, and described audio frequency hierarchical coding finishes the end number of plies that the number of plies is used to indicate multiplexed sub frame sound intermediate frequency hierarchical coding.
Further, when described business comprises voice data and video data simultaneously, be the M1 layer with audio data coding, be the M2 layer with video data encoding, described M is the maximum among M1 and the M2; And M1 and M2 are not 1 simultaneously.
The present invention also provides a kind of hierarchical coding multiplexing terminal:
Described terminal comprises demodulation module, demultiplexing module, decoding and playing module;
Described demodulation module is used for receiving multiplexed frame;
Described demultiplexing module is used for taking out multiplexed sub frame, then takes out multiplexed sub frame head, audio section, video-frequency band; According to the hierarchical coding parameter of encapsulation, obtain the dependence of the audio, video data in one or more multiplexed sub frames again;
Described decoding and playing module carry out audio/video decoding, and play after making up for the audio, video data with a plurality of multiplexed sub frames.
Further, described decoding and playing module also are used for the timestamp according to audio section or video-frequency band, and the data that have identical time stamp in the data with different levels enter synchronously decoder and decode.
The present invention also provides a kind of hierarchical coding multiplexing system, and described system comprises as above arbitrary described transmitting terminal, also comprises as weighing upper arbitrary described terminal.
In sum, the present invention is carried the hierarchical coding audio, video data by multiplexed frame, transmits the hierarchical coding data of different importance in the different Reliability Physics channels, improves the reliability that terminal receives, and realizes can receiving the most basic business when signal difference.And reduced the frame head expense, and according to the importance encapsulation of data of information, important data are protected, realize providing the most basic programme content in the situation that signal conditioning is poor.
Description of drawings
Fig. 1 is the multiplexed frame schematic diagram.
Fig. 2 is the inventive method embodiment one corresponding flow chart;
Fig. 3 is the schematic diagram of multiplexed sub frame transfer approach in different reliability channels in the embodiment of the invention;
Fig. 4 be in the embodiment of the invention hierarchical coding parameter figure is set.
Embodiment
The invention provides a kind of multiplex system and method for hierarchical coding, comprise: Traffic Channel is divided into the different channel of a plurality of reliabilities, be M level with the data encoding of a business, the data of a described M level are encapsulated in N the different multiplexed sub frame, and a described N multiplexed sub frame is encapsulated in respectively on L the different reliable channel and sends; Wherein, M, N and L are the natural number greater than 1.
As shown in Figure 1, a multiplexed frame is comprised of multiplex frame head, multiplexed frame payload and filling, the multiplexed frame payload is comprised of one or more multiplexed sub frames, being numbered according to order of multiplexed sub frame, and multiplexed sub frame is comprised of subframe head, video-frequency band, audio section, data segment and filling.Physical channel is comprised of control information channel and Traffic Channel, and multiplexed frame is carried in the Traffic Channel, and control information channel communicating control information comprises network configuration table, service allocation list, condition reception allocation list etc.
In multiplexed frame, multiplex frame head is optional, and multiplexed frame also can be comprised of multiplexed frame payload and filling, and the parameter of multiplex frame head can be placed in the control channel and transmit.
In multiplexed sub frame, filling is optional, if the length of subframe head, video-frequency band, audio section, data segment is just mated with the length of physical channel, does not then need to fill.
Transmitting terminal embodiment
The present embodiment provides a kind of hierarchical coding multiplexing transmitting terminal, comprises encoder, multiplexer and modulator;
Encoder is used for Traffic Channel is divided into the different channel of a plurality of reliabilities, and is M level with the data encoding of a business;
The data that multiplexer is used for a described M level are encapsulated in N different multiplexed sub frame;
Modulator sends for N multiplexed sub frame being encapsulated in respectively on L the different reliable channel;
M, N and L are the natural number greater than 1.
Further, M is more than or equal to N.
Further, when business comprises voice data and video data simultaneously, be the M1 layer with audio data coding, be the M2 layer with video data encoding, described M is the maximum among M1 and the M2; And M1 and M2 are not 1 simultaneously.
Multiplexer also is used in multiplex frame head or multiplexed sub frame head encapsulation hierarchical coding parameter, described hierarchical coding parameter comprises that hierarchical coding relies on the subframe numbering, when the decoding of the audio, video data of multiplexed sub frame depended on the audio, video data of other multiplexed sub frames, hierarchical coding relied on the subframe numbering and is made as the multiplexed sub frame numbering that is relied on; When this multiplexed sub frame transmitted basic layer audio, video data, hierarchical coding relied on the subframe numbering and is made as the multiplexed sub frame numbering of self.
The hierarchical coding parameter of encapsulation also comprises the indication of audio frequency hierarchical coding parameter, is used to indicate whether audio frequency hierarchical coding parameter is arranged in the multiplexed sub frame.
When in audio frequency hierarchical coding parameter dial gauge is given instructions in reply with subframe audio data layer being arranged, the hierarchical coding parameter comprises that also the audio frequency hierarchical coding begins the number of plies and the audio frequency hierarchical coding finishes the number of plies;
The audio frequency hierarchical coding begins the beginning number of plies that the number of plies is used to indicate multiplexed sub frame sound intermediate frequency hierarchical coding, and the audio frequency hierarchical coding finishes the end layer that the number of plies is used to indicate multiplexed sub frame sound intermediate frequency hierarchical coding.
Terminal embodiment
The present embodiment provides a kind of hierarchical coding multiplexing terminal, comprises demodulation module, demultiplexing module, decoding and playing module;
Demodulation module is used for receiving multiplexed frame;
Demultiplexing module is used for taking out multiplexed sub frame, then takes out multiplexed sub frame head, audio section, video-frequency band data; Also be used for the hierarchical coding parameter according to encapsulation, obtain the dependence of the audio, video data in one or more multiplexed sub frames;
Decoding and playing module carry out audio/video decoding, and play after making up for the audio, video data with a plurality of multiplexed sub frames.
Further, decoding and playing module also are used for the timestamp according to audio section or video-frequency band, and the data that have identical time stamp in the data with different levels enter synchronously decoder and decode.
System embodiment
The system that a kind of hierarchical coding of the present embodiment is multiplexing comprises above-described transmitting terminal and terminal.
Embodiment of the method
Embodiment one
The present embodiment provides a kind of hierarchical coding multiplexing method, as shown in Figure 2, may further comprise the steps:
Step 101: Traffic Channel is divided into L the channel that reliability is different;
Step 102: the audio, video data of same business (or being called program) is encoded to M level, can be divided into and be designated as basic layer, extension layer 1, extension layer 2... extension layer M-1;
Step 103: layer, a plurality of extension layer are arranged according to the importance of information substantially, are encapsulated in successively in N the multiplexed sub frame;
Step 104: N multiplexed sub frame be arranged in L the channel transmit.
Wherein, M, N and L are the natural number greater than 1; The corresponding high data of importance that send of highly reliable channel.
Above-mentioned steps 101 and 102 sequencing can not limit.
Further, M is more than or equal to N, and N can equal L, also can be not equal to L.
The arrangement of multiplexed sub frame is to divide and arrange according to the reliability of physical channel, and base layer data is encapsulated in the highest multiplexed sub frame of reliability.When using the hierarchical coding technology, and channel reliability is when having many levels, the corresponding a plurality of multiplexed sub frames of business.
Voice data and video data are encoded respectively, and the number of plies M1 of voice data and the number of plies M2 of video data can be the same or different; M is the maximum among M1 and the M2; And M1 and M2 are not 1 simultaneously.
Multiplexed sub frame can encapsulate 0, the data Layer of one or more videos, also can encapsulate 0, the data Layer of one or more audio frequency;
For audio data layer, can also be numbered each layer according to the importance of data, as from 0 open numbering, the less representative importance of numeral is higher, and this moment, the number of plies 0 was basic layer, and the number of plies 1 is extension layer M1-1 for extension layer 1... number of plies M1-1.
For example, as shown in Figure 3, Traffic Channel be divided into highly reliable channel, in 3 different stages such as reliable channel, low reliable channel, multiplexed sub frame is placed on respectively in the passage of different stage reliability and transmits, the audio frequency of same program and video data also are encoded as basic layer, extension layer 1 and extension layer 2, with the data encapsulation of basic layer in the multiplexed sub frame in highly reliable channel, with the data encapsulation of extension layer 1 in the multiplexed sub frame of reliable channel, with the data encapsulation of extension layer 2 in the multiplexed sub frame of low reliable channel.
Program 1 is comprised of multiplexed sub frame 1, multiplexed sub frame k, multiplexed sub frame j, 3 multiplexed sub frames be arranged in respectively highly reliable channel, in the reliable channel, low reliable channel, multiplexed sub frame 1 encapsulation base layer data, multiplexed sub frame k encapsulation extension layer 1 data, the decoding of the data of extension layer 1 depends on base layer data, multiplexed sub frame j encapsulation extension layer 2 data, the decoding of the data of extension layer 2 depends on the data of extension layer 1.If extension layer 1 is correct the reception not, extension layer 2 can't be decoded, if base layer data does not have and can correctly receive, extension layer 1 all can't be decoded with the data of extension layer 2.Similarly, program 2 is comprised of multiplexed sub frame 2, multiplexed sub frame k+1, multiplexed sub frame j+1,3 multiplexed sub frames be arranged in respectively highly reliable channel, in the reliable channel, low reliable channel.
Further, when transmitting terminal sends data, in audio section, video-frequency band, carry timestamp, after receiving terminal is received data, the audio, video data that different levels have identical time stamp will enter decoder synchronously in identical time stamp, realizes synchronous decoding and the broadcast of the audio, video data of different levels.
Further, at multiplex frame head or the multiplexed sub frame head also need carry the hierarchical coding parameter, as shown in Figure 4, the hierarchical coding parameter comprises:
Hierarchical coding relies on the subframe numbering, when the decoding of the audio, video data of multiplexed sub frame depends on the audio, video data of other multiplexed sub frames, is made as the multiplexed sub frame numbering that is relied on; When this multiplexed sub frame transmits basic layer audio, video data, be made as the multiplexed sub frame numbering of self.
Further, the hierarchical coding parameter can also comprise:
The indication of audio frequency hierarchical coding parameter: 1 bit field, be used to indicate whether audio frequency hierarchical coding parameter is arranged in the multiplexed sub frame, can have with ' 1 ' expression, ' 0 ' expression does not have.
When audio frequency hierarchical coding parameter is designated as 1, in the expression multiplexed sub frame audio frequency hierarchical coding parameter is arranged, the hierarchical coding parameter also needs to comprise:
The audio frequency hierarchical coding begins the number of plies: be used to indicate the beginning number of plies of multiplexed sub frame sound intermediate frequency hierarchical coding, namely begin the numbering of layer;
The audio frequency hierarchical coding finishes the number of plies: the end number of plies of expression multiplexed sub frame sound intermediate frequency hierarchical coding, the i.e. numbering of end layer.
Embodiment two
The present embodiment provides a kind of hierarchical coding multiplexing method, after terminal receives multiplexed frame, uses the following step to take out the hierarchical coding data:
Step 201: receive multiplexed frame, take out multiplex frame head, multiplexed frame payload.
Step 202: take out multiplexed sub frame, take out multiplexed sub frame head, audio section, video-frequency band data.
Step 203: according to the hierarchical coding parameter that is encapsulated in multiplexed sub frame head or multiplex frame head, obtain the dependence of the audio, video data in one or more multiplexed sub frames.
Step 204: after the audio, video data combination with a plurality of multiplexed sub frames, carry out audio/video decoding, and play.
In step 201, if being placed in the control channel, the parameter of multiplex frame head transmits, just do not need to take out multiplex frame head.
Further, terminal need to enter decoder to the data of different levels synchronously according to the timestamp in audio section or the video-frequency band, with being correctly decoded of the audio, video data that guarantees different levels.
The inventive method has solved the multiplexing method that transmits the hierarchical coding audio, video data, and flexibility is high, has realized the transmission of different levels data in different reliability channels.
Application example:
Below by an example the present invention is described further: in this example, channel is comprised of control information channel, Traffic Channel.Traffic Channel is divided into 3 passages that reliability is different, be respectively 36Kbit/s highly reliable channel, 36Kbit/s in the low reliable channel of reliable channel, 36Kbit/s.
Transmit simultaneously 2 programs in Traffic Channel, the total bandwidth of each program has 54Kbit/s, only transmits voice data, and voice data is encoded as the basic layer of 3 level: 18Kbit/s, the extension layer one of 18Kbit/s, the extension layer two of 18Kbit/s.
Each program is comprised of 3 multiplexed sub frames, totally 6 multiplexed sub frames, and the 1st program uses the 1st, 3,5 multiplexed sub frames, and the 2nd program uses the 2nd, 4,6 multiplexed sub frames.
In multiplexed sub frame head or multiplex frame head, transmit the hierarchical coding parameter, comprising: hierarchical coding relies on the subframe numbering, and the audio frequency hierarchical coding begins the number of plies, the audio frequency hierarchical coding finishes the number of plies, the indication of audio frequency hierarchical coding parameter.
After terminal receives multiplexed frame, carry out demultiplexing according to the following step:
Step 201: from Traffic Channel, receive multiplexed frame, take out multiplex frame head, multiplexed frame payload.
Step 202: take out multiplexed sub frame, take out multiplexed sub frame head, audio section, video-frequency band data.
Step 203: according to the hierarchical coding parameter that is encapsulated in multiplexed sub frame head or multiplex frame head, obtain the dependence of the audio, video data in one or more multiplexed sub frames.
Step 204: after the combination of the audio, video data of a plurality of multiplexed sub frames, according to the timestamp in audio section or the video-frequency band, carry out audio/video decoding, and play.
This multiplexing method has adopted the structure of elongated frame, the frame head expense is little, multiplexing expense is less than 5%, the efficient of the audio frequency and video payload of transmission reaches 95%, in the present example, and the total bandwidth 54Kbit/s of 1 business, the total length of payload user data surpasses 51Kbit/s, guaranteeing that data are graded on the basis of transmission, effectively improved efficiency of transmission, saved bandwidth resources.
Claims (15)
1. method that hierarchical coding is multiplexing comprises:
Traffic Channel is divided into the different channel of a plurality of reliabilities, be M level with the data encoding of a business, the data of a described M level are encapsulated in N the different multiplexed sub frame, and a described N multiplexed sub frame is encapsulated in respectively on L the different reliable channel and sends;
Described M, N and L are the natural number greater than 1.
2. the method for claim 1 is characterized in that:
When described transmitting terminal sends data, at multiplex frame head or the multiplexed sub frame head also carries the hierarchical coding parameter, described hierarchical coding parameter comprises that hierarchical coding relies on the subframe numbering, when the decoding of the audio, video data of multiplexed sub frame depended on the audio, video data of other multiplexed sub frames, hierarchical coding relied on the subframe numbering and is made as the multiplexed sub frame numbering that is relied on; When this multiplexed sub frame transmitted basic layer audio, video data, hierarchical coding relied on the subframe numbering and is made as the multiplexed sub frame numbering of self.
3. method as claimed in claim 2 is characterized in that:
Described hierarchical coding parameter also comprises the indication of audio frequency hierarchical coding parameter, is used to indicate whether audio frequency hierarchical coding parameter is arranged in the multiplexed sub frame.
4. method as claimed in claim 3 is characterized in that:
When in described audio frequency hierarchical coding parameter dial gauge is given instructions in reply with subframe audio frequency hierarchical coding parameter being arranged, described hierarchical coding parameter comprises that also the audio frequency hierarchical coding begins the number of plies and the audio frequency hierarchical coding finishes the number of plies;
Described audio frequency hierarchical coding begins the beginning number of plies that the number of plies is used to indicate multiplexed sub frame sound intermediate frequency hierarchical coding, and described audio frequency hierarchical coding finishes the end number of plies that the number of plies is used to indicate multiplexed sub frame sound intermediate frequency hierarchical coding.
5. the method for claim 1 is characterized in that:
When described business comprises voice data and video data simultaneously, be the M1 layer with audio data coding, be the M2 layer with video data encoding, described M is the maximum among M1 and the M2; And M1 and M2 are not 1 simultaneously.
6. method that hierarchical coding is multiplexing comprises:
After terminal is received multiplexed frame, take out multiplexed sub frame, then take out multiplexed sub frame head, audio section, video-frequency band data, hierarchical coding parameter according to encapsulation, obtain the dependence of the audio, video data in one or more multiplexed sub frames, after the audio, video data combination with a plurality of multiplexed sub frames, carry out audio/video decoding, and play.
7. method as claimed in claim 6 is characterized in that:
Terminal is according to the timestamp in audio section or the video-frequency band, and the data that have identical time stamp in the data with different levels enter synchronously decoder and decode.
8. transmitting terminal that hierarchical coding is multiplexing is characterized in that:
Described transmitting terminal comprises encoder, multiplexer and modulator;
Described encoder is used for audio, video data is encoded to M level;
The data that described multiplexer is used for a described M level are encapsulated in N different multiplexed sub frame;
Described modulator sends for N multiplexed sub frame being encapsulated in respectively on L the different reliable channel;
Described M, N and L are the natural number greater than 1.
9. transmitting terminal as claimed in claim 8 is characterized in that:
Described multiplexer also is used in multiplex frame head or multiplexed sub frame head encapsulation hierarchical coding parameter, described hierarchical coding parameter comprises that hierarchical coding relies on the subframe numbering, when the decoding of the audio, video data of multiplexed sub frame depended on the audio, video data of other multiplexed sub frames, hierarchical coding relied on the subframe numbering and is made as the multiplexed sub frame numbering that is relied on; When this multiplexed sub frame transmitted basic layer audio, video data, hierarchical coding relied on the subframe numbering and is made as the multiplexed sub frame numbering of self.
10. transmitting terminal as claimed in claim 9 is characterized in that:
The hierarchical coding parameter of described encapsulation also comprises the indication of audio frequency hierarchical coding parameter, is used to indicate whether audio frequency hierarchical coding parameter is arranged in the multiplexed sub frame.
11. transmitting terminal as claimed in claim 10 is characterized in that:
When in described audio frequency hierarchical coding parameter dial gauge is given instructions in reply with subframe audio frequency hierarchical coding parameter being arranged, described hierarchical coding parameter comprises that also the audio frequency hierarchical coding begins the number of plies and the audio frequency hierarchical coding finishes the number of plies;
Described audio frequency hierarchical coding begins the beginning number of plies that the number of plies is used to indicate multiplexed sub frame sound intermediate frequency hierarchical coding, and described audio frequency hierarchical coding finishes the end number of plies that the number of plies is used to indicate multiplexed sub frame sound intermediate frequency hierarchical coding.
12. transmitting terminal as claimed in claim 8 is characterized in that:
When described business comprises voice data and video data simultaneously, be the M1 layer with audio data coding, be the M2 layer with video data encoding, described M is the maximum among M1 and the M2; And M1 and M2 are not 1 simultaneously.
13. the terminal that hierarchical coding is multiplexing is characterized in that:
Described terminal comprises demodulation module, demultiplexing module, decoding and playing module;
Described demodulation module is used for receiving multiplexed frame;
Described demultiplexing module is used for taking out multiplexed sub frame, then takes out multiplexed sub frame head, audio section, video-frequency band; According to the hierarchical coding parameter of encapsulation, obtain the dependence of the audio, video data in one or more multiplexed sub frames again;
Described decoding and playing module carry out audio/video decoding, and play after making up for the audio, video data with a plurality of multiplexed sub frames.
14. terminal as claimed in claim 13 is characterized in that:
Described decoding and playing module also are used for the timestamp according to audio section or video-frequency band, and the data that have identical time stamp in the data with different levels enter synchronously decoder and decode.
15. the system that hierarchical coding is multiplexing is characterized in that:
Described system comprises such as the arbitrary described transmitting terminal of claim 8 to 12, also comprises such as claim 13 or 14 described terminals.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110279936.9A CN103024369B (en) | 2011-09-20 | 2011-09-20 | Transmitting terminal, terminal, the system and method for hierarchical coding multiplexing |
| PCT/CN2012/081196 WO2013040996A1 (en) | 2011-09-20 | 2012-09-10 | Sending end, terminal, system and method for hierarchical coding multiplexing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110279936.9A CN103024369B (en) | 2011-09-20 | 2011-09-20 | Transmitting terminal, terminal, the system and method for hierarchical coding multiplexing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103024369A true CN103024369A (en) | 2013-04-03 |
| CN103024369B CN103024369B (en) | 2017-11-10 |
Family
ID=47913876
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110279936.9A Expired - Fee Related CN103024369B (en) | 2011-09-20 | 2011-09-20 | Transmitting terminal, terminal, the system and method for hierarchical coding multiplexing |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN103024369B (en) |
| WO (1) | WO2013040996A1 (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108833050A (en) * | 2017-03-24 | 2018-11-16 | 华为技术有限公司 | Coding method, interpretation method, device and equipment |
| CN110780134A (en) * | 2019-10-30 | 2020-02-11 | 深圳市国电科技通信有限公司 | System optimization method for improving reliability of industrial control data acquisition system |
| CN113038128A (en) * | 2021-01-25 | 2021-06-25 | 腾讯科技（深圳）有限公司 | Data transmission method and device, electronic equipment and storage medium |
| WO2021179307A1 (en) * | 2020-03-13 | 2021-09-16 | 华为技术有限公司 | Method, apparatus and system for processing transport stream (ts) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006109154A1 (en) * | 2005-04-13 | 2006-10-19 | Nokia Corporation | Coding of frame number in scalable video coding |
| CN101207841A (en) * | 2006-12-19 | 2008-06-25 | 华为技术有限公司 | Method, system and apparatus for implementing multimedia broadcast multi-broadcast business |
| CN101507267A (en) * | 2005-09-07 | 2009-08-12 | 维德约股份有限公司 | System and method for scalable and low-delay videoconferencing using scalable video coding |
| CN102098542A (en) * | 2010-12-15 | 2011-06-15 | 中兴通讯股份有限公司 | Multi-media data transmission method, system and device |
-
2011
- 2011-09-20 CN CN201110279936.9A patent/CN103024369B/en not_active Expired - Fee Related
-
2012
- 2012-09-10 WO PCT/CN2012/081196 patent/WO2013040996A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006109154A1 (en) * | 2005-04-13 | 2006-10-19 | Nokia Corporation | Coding of frame number in scalable video coding |
| CN101507267A (en) * | 2005-09-07 | 2009-08-12 | 维德约股份有限公司 | System and method for scalable and low-delay videoconferencing using scalable video coding |
| CN101207841A (en) * | 2006-12-19 | 2008-06-25 | 华为技术有限公司 | Method, system and apparatus for implementing multimedia broadcast multi-broadcast business |
| CN102098542A (en) * | 2010-12-15 | 2011-06-15 | 中兴通讯股份有限公司 | Multi-media data transmission method, system and device |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108833050A (en) * | 2017-03-24 | 2018-11-16 | 华为技术有限公司 | Coding method, interpretation method, device and equipment |
| US10439759B2 (en) | 2017-03-24 | 2019-10-08 | Huawei Technologies Co., Ltd. | Communication method and apparatus |
| US11057152B2 (en) | 2017-03-24 | 2021-07-06 | Huawei Technologies Co., Ltd. | Communication method and apparatus |
| CN110780134A (en) * | 2019-10-30 | 2020-02-11 | 深圳市国电科技通信有限公司 | System optimization method for improving reliability of industrial control data acquisition system |
| CN110780134B (en) * | 2019-10-30 | 2022-04-26 | 深圳市国电科技通信有限公司 | System optimization method for improving reliability of industrial control data acquisition system |
| WO2021179307A1 (en) * | 2020-03-13 | 2021-09-16 | 华为技术有限公司 | Method, apparatus and system for processing transport stream (ts) |
| CN115211127A (en) * | 2020-03-13 | 2022-10-18 | 华为技术有限公司 | Method, device and system for processing transport stream TS |
| CN113038128A (en) * | 2021-01-25 | 2021-06-25 | 腾讯科技（深圳）有限公司 | Data transmission method and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103024369B (en) | 2017-11-10 |
| WO2013040996A1 (en) | 2013-03-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101501347B1 (en) | Method for tranmiting media content in multimedia system | |
| EP2139132B1 (en) | A method for transmitting mobile multimedia broadcast electronic service guide | |
| CN102740064B (en) | Packing method for streaming media transmission in intercom system | |
| CN103947215B (en) | Transmit the method and apparatus of media data, the device and method of receiving media data | |
| CN1972454A (en) | Mobile multimedia broadcasting real-time traffic flow packaging method | |
| KR20090021131A (en) | Digital broadcasting system and method of processing data in digital broadcasting system | |
| CN107079028A (en) | Dispensing device and reception device and its signal processing method | |
| JP2017511040A (en) | Broadcast signal transmitting apparatus, broadcast signal receiving apparatus, broadcast signal transmitting method, and broadcast signal receiving method | |
| WO2008028367A1 (en) | A method for realizing multi-audio tracks for mobile mutilmedia broadcasting system | |
| WO2009006804A1 (en) | A method for transmitting mobile multimedia broadcast service data flow and a multiplexing frame for transmitting | |
| CN101159579B (en) | Method and terminal of receiving network transport protocol based stream media data | |
| CN100518074C (en) | Method for implementing multiple video strems in mobile multimedia broadcast | |
| CN1960328B (en) | Method for packaging real time stream of mobile multimedia broadcast | |
| CN103024369B (en) | Transmitting terminal, terminal, the system and method for hierarchical coding multiplexing | |
| CN100479529C (en) | Conversion method of multiplexing protocols in broadcast network | |
| US20240137603A1 (en) | Transmission apparatus, reception apparatus, and data processing method | |
| CN1976495A (en) | Mobile multimedia broadcasting control information and media information specification transmitting method | |
| JP6785928B2 (en) | Method | |
| US11838099B2 (en) | Reception apparatus and data processing method | |
| CN101453286B (en) | Method for digital audio multiplex transmission in multimedia broadcasting system | |
| CN101179738B (en) | Conversion method from transmission stream to China mobile multimedia broadcasting multiplex protocol | |
| KR102424840B1 (en) | Transmitting apparatus and receiving apparatus and signal processing method thereof | |
| KR20090031322A (en) | Digital broadcasting system and method of processing data in digital broadcasting system | |
| CN1972166B (en) | An audio stream transport method of mobile multimedia broadcast system | |
| WO2008043213A1 (en) | A mobile multimedia broadcast system for enhancing transmission efficiency by using variable-length frame and thereof method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20171110 Termination date: 20190920 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |