CN103024369B - Transmitting terminal, terminal, the system and method for hierarchical coding multiplexing - Google Patents
Transmitting terminal, terminal, the system and method for hierarchical coding multiplexing Download PDFInfo
- Publication number
- CN103024369B CN103024369B CN201110279936.9A CN201110279936A CN103024369B CN 103024369 B CN103024369 B CN 103024369B CN 201110279936 A CN201110279936 A CN 201110279936A CN 103024369 B CN103024369 B CN 103024369B
- Authority
- CN
- China
- Prior art keywords
- hierarchical coding
- audio
- multiplexed sub
- sub frame
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234327—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into layers, e.g. base layer and one or more enhancement layers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
- H04N21/4622—Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/631—Multimode Transmission, e.g. transmitting basic layers and enhancement layers of the content over different transmission paths or transmitting with different error corrections, different keys or with different transmission protocols
Abstract
The present invention provides a kind of transmitting terminal, terminal, the system and method for hierarchical coding multiplexing, and one of which method includes：Traffic Channel is divided into the different channel of multiple reliabilities, it is M level by the data encoding of a business, the data of the M level are encapsulated in N number of different multiplexed sub frame, and N number of multiplexed sub frame is individually enclosed on L different Reliability Channels and sent；Described M, N and L are the natural number more than 1.Using technical scheme, hierarchical coding audio, video data is carried by multiplexed frame, the hierarchical coding data of different importance are transmitted in different Reliability Physics channels, improve the reliability that terminal receives, most basic business can be received in signal difference by realizing.
Description
Technical field
The invention belongs to multimedia broadcasting or technical field of mobile TV, is related specifically to one kind in multimedia broadcasting network
Transmitting terminal, terminal, the system and method for middle transmission audio frequency and video hierarchical coding multiplexing.
Background technology
CMMB is a kind of Play Technique for Multimedia of rising in recent years.By hand-held terminal, at a high speed
In the case of movement, audio broadcasting or viewing TV can be listened to.Terminal receives programme, selection is certainly by wireless protocols
Oneself has the right the channel watched, so as to receive to select the multi-medium data of different programs, realization is listened wide on mobile terminals
Broadcast or see TV.
The different business datums of system transmitting, can be encapsulated in different physical channels, the number of each program respectively
According to again include：One or more in video, audio and data three types, terminal receives related data, by terminal
Player, realize the normal play of audio or video.
Wireless channel is can be made up of the channel of different reliabilities, according to the difference of the importance of data, is distributed not
Transmitted in same reliability channels, highly reliable channel transmits most important data, so as to protect important data.Terminal receives number
According to when, if wireless signal is preferable, the data of different reliability channels can be received smoothly, and program quality is higher, works as wireless communication
When number poor, the data of highly reliable channel transmission can only be received, program quality is poor.
Audio or video data are can be divided into Primary layer and multiple extension layers, to the reliable of physical channel with hierarchical coding
Property require be Primary layer requirement highest, the reliability requirement of multiple extension layers reduces successively, and system can be believed in different reliabilities
The data after hierarchical coding are sent in road respectively, under conditions of signal is worst, terminal can only receive base layer data, can listen
To basic audio broadcasting or see basic video broadcasting, if signal conditioning is preferable, the extension of one or all can be received
Layer data, it is possible to realize the audio-video-frequency broadcast of high quality.
In radio network, the method for existing transmission hierarchical coding audio, video data is：
(1) data of different levels different RTP is placed on (Real-time Transport Protocol, to pass in real time
Send agreement) in stream, each rtp streaming independently transmits, and transmits the characterising parameter of hierarchical coding by agreement outside in band, terminal according to
These parameters receive corresponding data.
(2) data of different levels are placed in same rtp streaming, the description ginseng of hierarchical coding is carried in RTP packet header
Number, terminal receive and distinguished the data of different levels according to these parameters.
This 2 kinds of methods are all transmitted by RTP modes, and carrying expense includes RTP packet header, UDP (user data packages
Agreement) packet header, IP packet header, reach more than 40 bytes, and each RTP messages are averagely hundreds of bytes, expense generally exists
Between 40% to 80%.
The content of the invention
The present invention provides a kind of transmitting terminal, terminal, the system and method for the multiplexing of the hierarchical coding in multi-media broadcasting system,
The hierarchical coding data of different importance are implemented with the protection of different stage, protects significant data, can with improve terminal reception
By property.
The present invention provides a kind of method of hierarchical coding multiplexing, including：
Traffic Channel is divided into the different channel of multiple reliabilities, is M level by the data encoding of a business, institute
The data for stating M level are encapsulated in N number of different multiplexed sub frame, and N number of multiplexed sub frame is individually enclosed in L difference
Reliability Channel on send；
Described M, N and L are the natural number more than 1.
Further, when the transmitting terminal sends data, hierarchical coding is also carried in multiplex frame head or multiplexed sub frame head
Parameter, the hierarchical coding parameter include hierarchical coding rely on subframe number, when multiplexed sub frame audio, video data decoding according to
Rely when the audio, video data of other multiplexed sub frames, hierarchical coding relies on the multiplexed sub frame numbering that subframe number is set to be relied on；
When the multiplexed sub frame transmits Primary layer audio, video data, hierarchical coding relies on subframe number and is set to the multiplexed sub frame volume of itself
Number.
Further, the hierarchical coding parameter also includes the instruction of audio hierarchical coding parameter, for indicating multiplexed sub frame
In whether have audio hierarchical coding parameter.
Further, when the audio hierarchical coding parameter dial gauge shows in multiplexed sub frame there is audio hierarchical coding parameter
When, the hierarchical coding parameter also starts the number of plies including audio hierarchical coding and terminates the number of plies with audio hierarchical coding；
The audio hierarchical coding starts the beginning number of plies that the number of plies is used to indicate multiplexed sub frame sound intermediate frequency hierarchical coding, described
Audio hierarchical coding terminates the end number of plies that the number of plies is used to indicate multiplexed sub frame sound intermediate frequency hierarchical coding.
Further, it is M1 layers by audio data coding when the business includes voice data and video data simultaneously,
It is M2 layers by video data encoding, the M is the maximum in M1 and M2；And M1 is with being 1 during M2 differences.
The present invention also provides a kind of method of hierarchical coding multiplexing, including：
After terminal receives multiplexed frame, multiplexed sub frame is taken out, then takes out multiplexed sub frame head, audio section, video segment data, root
According to the hierarchical coding parameter of encapsulation, the dependence of the audio, video data in one or more multiplexed sub frames is obtained, by multiple multiplexings
After the audio, video data combination of subframe, audio/video decoding is carried out, and play.
Further, timestamp of the terminal in audio section or video-frequency band is identical by having in the data of different levels
The data syn-chronization of timestamp is decoded into decoder.
The present invention also provides a kind of transmitting terminal of hierarchical coding multiplexing：
The transmitting terminal includes encoder, multiplexer and modulator；
The encoder is used to audio, video data being encoded to M level；
The data that the multiplexer is used for the M level are encapsulated in N number of different multiplexed sub frame；
The modulator, which is used to N number of multiplexed sub frame being individually enclosed on L different Reliability Channels, to be sent；
Described M, N and L are the natural number more than 1.
Further, the multiplexer is additionally operable in multiplex frame head or multiplexed sub frame head encapsulation hierarchical coding parameter, institute
State hierarchical coding parameter include hierarchical coding rely on subframe number, when multiplexed sub frame audio, video data decoding dependency in other
During the audio, video data of multiplexed sub frame, hierarchical coding relies on the multiplexed sub frame numbering that subframe number is set to be relied on；When the multiplexing
When subframe transmits Primary layer audio, video data, hierarchical coding relies on subframe number and is set to the multiplexed sub frame numbering of itself.
Further, the hierarchical coding parameter of the encapsulation also includes the instruction of audio hierarchical coding parameter, multiple for indicating
With whether there is audio hierarchical coding parameter in subframe.
Further, when the audio hierarchical coding parameter dial gauge shows in multiplexed sub frame there is audio hierarchical coding parameter
When, the hierarchical coding parameter also starts the number of plies including audio hierarchical coding and terminates the number of plies with audio hierarchical coding；
The audio hierarchical coding starts the beginning number of plies that the number of plies is used to indicate multiplexed sub frame sound intermediate frequency hierarchical coding, described
Audio hierarchical coding terminates the end number of plies that the number of plies is used to indicate multiplexed sub frame sound intermediate frequency hierarchical coding.
Further, it is M1 layers by audio data coding when the business includes voice data and video data simultaneously,
It is M2 layers by video data encoding, the M is the maximum in M1 and M2；And M1 is with being 1 during M2 differences.
The present invention also provides a kind of terminal of hierarchical coding multiplexing：
The terminal includes demodulation module, demultiplexing module, decoding and playing module；
The demodulation module is used to receive multiplexed frame；
The demultiplexing module is used to take out multiplexed sub frame, then takes out multiplexed sub frame head, audio section, video-frequency band；Root again
According to the hierarchical coding parameter of encapsulation, the dependence of the audio, video data in one or more multiplexed sub frames is obtained；
After the decoding and playing module are used for the audio, video data combination by multiple multiplexed sub frames, audio frequency and video solution is carried out
Code, and play.
Further, the decoding and playing module are additionally operable to the timestamp in audio section or video-frequency band, by difference
The data syn-chronization with identical time stamp is decoded into decoder in the data of level.
The present invention also provides a kind of system of hierarchical coding multiplexing, and the system includes as above any described transmitting terminal,
Also include the terminal as described in any on weighing.
In summary, the present invention carries hierarchical coding audio, video data, different Reliability Physics channels by multiplexed frame
The middle hierarchical coding data for transmitting different importance, the reliability that terminal receives is improved, realizing can receive most in signal difference
Basic business.And reduce frame headers overhead, according to the importance encapsulation of data of information, protected important data,
Realization can provide most basic programme content in the case of signal conditioning difference.
Brief description of the drawings
Fig. 1 is multiplexed frame schematic diagram.
Fig. 2 is one corresponding flow chart of the inventive method embodiment；
Fig. 3 is the schematic diagram of multiplexed sub frame transfer approach in different reliability channels in the embodiment of the present invention；
Fig. 4 is the setting figure of hierarchical coding parameter in the embodiment of the present invention.
Embodiment
The present invention provides a kind of multiplex system and method for hierarchical coding, including：Traffic Channel is divided into multiple reliable
The different channel of property, is M level by the data encoding of a business, and the data of the M level are encapsulated in N number of different
In multiplexed sub frame, N number of multiplexed sub frame is individually enclosed on L different Reliability Channels and sent；Wherein, M, N and L are
Natural number more than 1.
As shown in figure 1, a multiplexed frame is made up of multiplex frame head, multiplexed frame payload and filling, multiplexed frame payload be by
One or more multiplexed sub frames composition, multiplexed sub frame are numbered according to order, multiplexed sub frame be by subframe head, video-frequency band,
Audio section, data segment and filling composition.Physical channel is made up of control information channel with Traffic Channel, and multiplexed frame is carried on industry
It is engaged in channel, control information channel transmission control information, including network configuration table, service allocation list, condition reception allocation list etc..
In multiplexed frame, multiplex frame head is optional, and multiplexed frame can also be made up of multiplexed frame payload and filling, multiplexing
The parameter of frame head can be placed in control channel and transmit.
In multiplexed sub frame, filling be it is optional, if the length of subframe head, video-frequency band, audio section, data segment just with
The length matching of physical channel, then need not fill.
Transmitting terminal embodiment
The present embodiment provides a kind of transmitting terminal of hierarchical coding multiplexing, including encoder, multiplexer and modulator；
Encoder is used to Traffic Channel being divided into the different channel of multiple reliabilities, and the data of a business are compiled
Code is M level；
The data that multiplexer is used for the M level are encapsulated in N number of different multiplexed sub frame；
Modulator, which is used to N number of multiplexed sub frame being individually enclosed on L different Reliability Channels, to be sent；
M, N and L is the natural number more than 1.
Further, M is more than or equal to N.
Further, when business includes voice data and video data simultaneously, it is M1 layers by audio data coding, will regards
Frequency is the maximum in M1 and M2 according to M2 layers, the M is encoded to；And M1 is with being 1 during M2 differences.
Multiplexer is additionally operable in multiplex frame head or multiplexed sub frame head encapsulation hierarchical coding parameter, the hierarchical coding parameter
Subframe number is relied on including hierarchical coding, when the decoding dependency of the audio, video data of multiplexed sub frame regards in the sound of other multiplexed sub frames
Frequency according to when, hierarchical coding relies on the multiplexed sub frame numbering that subframe number is set to be relied on；When the multiplexed sub frame transmits Primary layer
During audio, video data, hierarchical coding relies on subframe number and is set to the multiplexed sub frame numbering of itself.
The hierarchical coding parameter of encapsulation also includes audio hierarchical coding parameter and indicated, for indicating whether have in multiplexed sub frame
Audio hierarchical coding parameter.
When audio hierarchical coding parameter dial gauge shows that hierarchical coding parameter also includes when having audio data layer in multiplexed sub frame
Audio hierarchical coding starts the number of plies and terminates the number of plies with audio hierarchical coding；
Audio hierarchical coding starts the beginning number of plies that the number of plies is used to indicate multiplexed sub frame sound intermediate frequency hierarchical coding, audio classification
The end-of-encode number of plies is used for the end layer for indicating multiplexed sub frame sound intermediate frequency hierarchical coding.
Terminal embodiment
The present embodiment provides a kind of terminal of hierarchical coding multiplexing, including demodulation module, demultiplexing module, decoding and broadcasting
Module；
Demodulation module is used to receive multiplexed frame；
Demultiplexing module is used to take out multiplexed sub frame, then takes out multiplexed sub frame head, audio section, video segment data；Also use
In the hierarchical coding parameter according to encapsulation, the dependence of the audio, video data in one or more multiplexed sub frames is obtained；
After decoding and playing module are used for the audio, video data combination by multiple multiplexed sub frames, audio/video decoding is carried out, and
Play.
Further, decoding and playing module are additionally operable to the timestamp in audio section or video-frequency band, by different levels
Data in have identical time stamp data syn-chronization decoded into decoder.
System embodiment
A kind of system of hierarchical coding multiplexing of the present embodiment, including above-described transmitting terminal and terminal.
Embodiment of the method
Embodiment one
The present embodiment provides a kind of method of hierarchical coding multiplexing, as shown in Fig. 2 comprising the following steps：
Step 101：Traffic Channel is divided into the different channel of L reliability；
Step 102：The audio, video data of same business (or being program) is encoded to M level, note can be divided into
For Primary layer, extension layer 1, extension layer 2... extension layers M-1；
Step 103：Primary layer, multiple extension layers are arranged according to the importance of information, are encapsulated in N number of multiplexing successively
In subframe；
Step 104：N number of multiplexed sub frame is arranged in L channel and transmitted.
Wherein, M, N and L are the natural number more than 1；Highly reliable channel correspondingly sends the high data of importance.
Above-mentioned steps 101 can not be limited with 102 sequencing.
Further, M is more than or equal to N, and N can be equal to L, can also be not equal to L.
The arrangement of multiplexed sub frame is divided and arranged according to the reliability of physical channel, base layer data encapsulation
In reliability highest multiplexed sub frame.When using hierarchical coding technology, and when channel reliability has many levels, a business
Corresponding multiple multiplexed sub frames.
Voice data is encoded respectively with video data, and the number of plies M1 of voice data and the number of plies M2 of video data can be with
It is identical can also be different；M is the maximum in M1 and M2；And M1 is with being 1 during M2 differences.
One multiplexed sub frame can encapsulate 0, the data Layer of one or more videos, can also encapsulate 0, one or more
The data Layer of audio；
For audio data layer, each layer can also be numbered according to the importance of data, be such as numbered from 0,
The smaller importance that represents of numeral is higher, and now the number of plies 0 is Primary layer, and the number of plies 1 is that extension layer 1... numbers of plies M1-1 is extension layer
M1-1。
For example, as shown in figure 3, Traffic Channel is divided into highly reliable channel, middle Reliability Channel, low Reliability Channel etc. 3 not
Same level, multiplexed sub frame are individually placed to transmit in the passage of different stage reliability, the audio and video data of same program
Primary layer, extension layer 1 and extension layer 2 are also encoded as, the data of Primary layer are encapsulated in answering in highly reliable channel
With in subframe, the data of extension layer 1 are encapsulated in the multiplexed sub frame transmitted on middle Reliability Channel, by the data of extension layer 2
It is encapsulated in the multiplexed sub frame transmitted on low Reliability Channel.
Program 1 is made up of multiplexed sub frame 1, multiplexed sub frame k, multiplexed sub frame j, and 3 multiplexed sub frames are arranged separately on height
In Reliability Channel, middle Reliability Channel, low Reliability Channel, multiplexed sub frame 1 encapsulates base layer data, multiplexed sub frame k encapsulation extension layers 1
Data, the decoding dependency of the data of extension layer 1 is in base layer data, the multiplexed sub frame j encapsulation data of extension layer 2, the number of extension layer 2
According to decoding dependency in the data of extension layer 1.If extension layer 1 is not properly received, extension layer 2 can not be decoded, such as
Fruit base layer data can be properly received, and the data of extension layer 1 and extension layer 2 can not be all decoded.Similarly, program 2 is
Be made up of multiplexed sub frame 2, multiplexed sub frame k+1, multiplexed sub frame j+1,3 multiplexed sub frames be arranged separately on highly reliable channel, in
In Reliability Channel, low Reliability Channel.
Further, when transmitting terminal sends data, timestamp is carried in audio section, video-frequency band, receiving terminal receives data
Afterwards, the audio, video data that different levels have identical time stamp synchronously will enter decoder in identical time stamp, realize different layers
The synchronous decoding of secondary audio, video data and broadcasting.
Further, also need to carry hierarchical coding parameter in multiplex frame head or multiplexed sub frame head, as shown in figure 4, classification is compiled
Code parameter includes：
Hierarchical coding rely on subframe number, when multiplexed sub frame audio, video data decoding dependency in other multiplexed sub frames
During audio, video data, the multiplexed sub frame numbering being relied on is set to；When the multiplexed sub frame transmits Primary layer audio, video data, it is set to
The multiplexed sub frame numbering of itself.
Further, hierarchical coding parameter can also include：
Audio hierarchical coding parameter indicates：1 bit field, for indicating whether there is audio hierarchical coding ginseng in multiplexed sub frame
Number, can be indicated with ' 1 ', and ' 0 ' represents do not have.
When audio hierarchical coding parameter is designated as 1, represent there is audio hierarchical coding parameter, hierarchical coding in multiplexed sub frame
Parameter also needs to include：
Audio hierarchical coding starts the number of plies：For indicating the beginning number of plies of multiplexed sub frame sound intermediate frequency hierarchical coding, that is, start
The numbering of layer；
Audio hierarchical coding terminates the number of plies：The end number of plies of expression multiplexed sub frame sound intermediate frequency hierarchical coding, i.e. end layer
Numbering.
Embodiment two
The present embodiment provides a kind of method of hierarchical coding multiplexing, after terminal receives multiplexed frame, is taken using the following steps
Go out hierarchical coding data：
Step 201：Multiplexed frame is received, takes out multiplex frame head, multiplexed frame payload.
Step 202：Multiplexed sub frame is taken out, takes out multiplexed sub frame head, audio section, video segment data.
Step 203：According to the hierarchical coding parameter for being encapsulated in multiplexed sub frame head or multiplex frame head, it is multiple to obtain one or more
With the dependence of the audio, video data in subframe.
Step 204：After the audio, video data combination of multiple multiplexed sub frames, audio/video decoding is carried out, and play.
In step 201, transmitted if the parameter of multiplex frame head is placed in control channel, avoid the need for taking out multiplexed frame
Head.
Further, terminal needs the timestamp in audio section or video-frequency band, and the data syn-chronization of different levels is entered
Decoder, to ensure being correctly decoded for the audio, video data of different levels.
The inventive method, solves the multiplexing method of transmission hierarchical coding audio, video data, flexibility is high, realizes difference
Transmission of the hierarchical data in different reliability channels.
Application example：
The present invention is described further below by an example：In this example, channel be by control information channel,
Traffic Channel composition.Traffic Channel is divided into 3 different passages of reliability, respectively 36Kbit/s highly reliable letter
Road, 36Kbit/s middle Reliability Channel, 36Kbit/s low Reliability Channel.
Transmit 2 programs simultaneously in Traffic Channel, the total bandwidth of each program has 54Kbit/s, only transmits audio number
According to voice data is encoded as 3 levels：The extension of 18Kbit/s Primary layer, 18Kbit/s extension layer one, 18Kbit/s
Layer two.
Each program is made up of 3 multiplexed sub frames, totally 6 multiplexed sub frames, the 1st program is using the 1st, 3,5 multiplexed sub frames,
2nd program is using the 2nd, 4,6 multiplexed sub frames.
In multiplexed sub frame head or multiplex frame head, hierarchical coding parameter is transmitted, including：Hierarchical coding relies on subframe number,
Audio hierarchical coding starts the number of plies, audio hierarchical coding terminates the number of plies, the instruction of audio hierarchical coding parameter.
After terminal receives multiplexed frame, demultiplexed according to the following steps：
Step 201：Multiplexed frame is received from Traffic Channel, takes out multiplex frame head, multiplexed frame payload.
Step 202：Multiplexed sub frame is taken out, takes out multiplexed sub frame head, audio section, video segment data.
Step 203：According to the hierarchical coding parameter for being encapsulated in multiplexed sub frame head or multiplex frame head, it is multiple to obtain one or more
With the dependence of the audio, video data in subframe.
Step 204：After the audio, video data combination of multiple multiplexed sub frames, according to the time in audio section or video-frequency band
Stamp, audio/video decoding is carried out, and played.
This multiplexing method employs the structure of elongated frame, and frame headers overhead is small, and less than 5%, the sound of transmission regards multiplexing expense
The efficiency of frequency payload reaches 95%, and in the present example, the total bandwidth 54Kbit/s of 1 business, the total length of payload user data exceedes
51Kbit/s, on the basis of ensureing that data are graded transmission, efficiency of transmission is effectively improved, saves bandwidth resources.
Claims (13)
1. a kind of method of hierarchical coding multiplexing, including：
Traffic Channel is divided into the different channel of multiple reliabilities, is M level by the data encoding of a business, the M
The data of individual level are encapsulated in N number of different multiplexed sub frame, and it is individual different that N number of multiplexed sub frame is individually enclosed in L
Sent on Reliability Channel；
Described M, N and L are the natural number more than 1；
When transmitting terminal sends data, hierarchical coding parameter, the hierarchical coding are also carried in multiplex frame head or multiplexed sub frame head
Parameter include hierarchical coding rely on subframe number, when multiplexed sub frame audio, video data decoding dependency in other multiplexed sub frames
During audio, video data, hierarchical coding relies on the multiplexed sub frame numbering that subframe number is set to be relied on；When the multiplexed sub frame transmits base
During this layer of audio, video data, hierarchical coding relies on subframe number and is set to the multiplexed sub frame numbering of itself.
2. the method as described in claim 1, it is characterised in that：
The hierarchical coding parameter also includes audio hierarchical coding parameter and indicated, for indicating whether there is audio point in multiplexed sub frame
Level coding parameter.
3. method as claimed in claim 2, it is characterised in that：
When the audio hierarchical coding parameter dial gauge, which shows in multiplexed sub frame, audio hierarchical coding parameter, the hierarchical coding
Parameter also starts the number of plies including audio hierarchical coding and terminates the number of plies with audio hierarchical coding；
The audio hierarchical coding starts the beginning number of plies that the number of plies is used to indicate multiplexed sub frame sound intermediate frequency hierarchical coding, the audio
Hierarchical coding terminates the end number of plies that the number of plies is used to indicate multiplexed sub frame sound intermediate frequency hierarchical coding.
4. the method as described in claim 1, it is characterised in that：
When the business includes voice data and video data simultaneously, it is M1 layers by audio data coding, video data is compiled
Code is M2 layers, and the M is the maximum in M1 and M2；And M1 is with being 1 during M2 differences.
5. a kind of method of hierarchical coding multiplexing, including：
After terminal receives multiplexed frame, multiplexed sub frame is taken out, multiplexed sub frame head, audio section, video segment data are then taken out, according to envelope
The hierarchical coding parameter of dress, obtains the dependence of the audio, video data in one or more multiplexed sub frames, by multiple multiplexed sub frames
Audio, video data combination after, carry out audio/video decoding, and play；Wherein, it is individual different to be individually enclosed in L for N number of multiplexed sub frame
Sent on Reliability Channel, the N and L are the natural number more than 1；
When transmitting terminal sends data, hierarchical coding parameter, the hierarchical coding are also carried in multiplex frame head or multiplexed sub frame head
Parameter include hierarchical coding rely on subframe number, when multiplexed sub frame audio, video data decoding dependency in other multiplexed sub frames
During audio, video data, hierarchical coding relies on the multiplexed sub frame numbering that subframe number is set to be relied on；When the multiplexed sub frame transmits base
During this layer of audio, video data, hierarchical coding relies on subframe number and is set to the multiplexed sub frame numbering of itself.
6. method as claimed in claim 5, it is characterised in that：
Timestamp of the terminal in audio section or video-frequency band, there will be the data of identical time stamp same in the data of different levels
Stepping enters decoder and decoded.
A kind of 7. transmitting terminal of hierarchical coding multiplexing, it is characterised in that：
The transmitting terminal includes encoder, multiplexer and modulator；
The encoder is used to audio, video data being encoded to M level；
The data that the multiplexer is used for the M level are encapsulated in N number of different multiplexed sub frame；
The modulator, which is used to N number of multiplexed sub frame being individually enclosed on L different Reliability Channels, to be sent；
Described M, N and L are the natural number more than 1；
The multiplexer is additionally operable in multiplex frame head or multiplexed sub frame head encapsulation hierarchical coding parameter, the hierarchical coding parameter
Subframe number is relied on including hierarchical coding, when the decoding dependency of the audio, video data of multiplexed sub frame regards in the sound of other multiplexed sub frames
Frequency according to when, hierarchical coding relies on the multiplexed sub frame numbering that subframe number is set to be relied on；When the multiplexed sub frame transmits Primary layer
During audio, video data, hierarchical coding relies on subframe number and is set to the multiplexed sub frame numbering of itself.
8. transmitting terminal as claimed in claim 7, it is characterised in that：
The hierarchical coding parameter of the encapsulation also includes audio hierarchical coding parameter and indicated, for indicating whether have in multiplexed sub frame
Audio hierarchical coding parameter.
9. transmitting terminal as claimed in claim 8, it is characterised in that：
When the audio hierarchical coding parameter dial gauge, which shows in multiplexed sub frame, audio hierarchical coding parameter, the hierarchical coding
Parameter also starts the number of plies including audio hierarchical coding and terminates the number of plies with audio hierarchical coding；
The audio hierarchical coding starts the beginning number of plies that the number of plies is used to indicate multiplexed sub frame sound intermediate frequency hierarchical coding, the audio
Hierarchical coding terminates the end number of plies that the number of plies is used to indicate multiplexed sub frame sound intermediate frequency hierarchical coding.
10. transmitting terminal as claimed in claim 7, it is characterised in that：
When business includes voice data and video data simultaneously, it is M1 layers by audio data coding, is by video data encoding
M2 layers, the M are the maximum in M1 and M2；And M1 is with being 1 during M2 differences.
A kind of 11. terminal of hierarchical coding multiplexing, it is characterised in that：
The terminal includes demodulation module, demultiplexing module, decoding and playing module；
The demodulation module is used to receive multiplexed frame；
The demultiplexing module is used to take out multiplexed sub frame, then takes out multiplexed sub frame head, audio section, video-frequency band；Further according to envelope
The hierarchical coding parameter of dress, obtains the dependence of the audio, video data in one or more multiplexed sub frames；Wherein, N number of multiplexing
Frame is individually enclosed on L different Reliability Channels and sent, and the N and L are the natural number more than 1；
After the decoding and playing module are used for the audio, video data combination by multiple multiplexed sub frames, audio/video decoding is carried out, and
Play；
The hierarchical coding parameter includes hierarchical coding and relies on subframe number, when the decoding dependency of the audio, video data of multiplexed sub frame
When the audio, video data of other multiplexed sub frames, hierarchical coding relies on the multiplexed sub frame numbering that subframe number is set to be relied on；When
When the multiplexed sub frame transmits Primary layer audio, video data, hierarchical coding relies on subframe number and is set to the multiplexed sub frame numbering of itself.
12. terminal as claimed in claim 11, it is characterised in that：
The decoding and playing module are additionally operable to the timestamp in audio section or video-frequency band, will have in the data of different levels
The data syn-chronization for having identical time stamp is decoded into decoder.
A kind of 13. system of hierarchical coding multiplexing, it is characterised in that：
The system includes the transmitting terminal as described in claim 7 to 10 is any, in addition to as described in claim 11 or 12
Terminal.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110279936.9A CN103024369B (en) | 2011-09-20 | 2011-09-20 | Transmitting terminal, terminal, the system and method for hierarchical coding multiplexing |
| PCT/CN2012/081196 WO2013040996A1 (en) | 2011-09-20 | 2012-09-10 | Sending end, terminal, system and method for hierarchical coding multiplexing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110279936.9A CN103024369B (en) | 2011-09-20 | 2011-09-20 | Transmitting terminal, terminal, the system and method for hierarchical coding multiplexing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103024369A CN103024369A (en) | 2013-04-03 |
| CN103024369B true CN103024369B (en) | 2017-11-10 |
Family
ID=47913876
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110279936.9A Expired - Fee Related CN103024369B (en) | 2011-09-20 | 2011-09-20 | Transmitting terminal, terminal, the system and method for hierarchical coding multiplexing |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN103024369B (en) |
| WO (1) | WO2013040996A1 (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108631942A (en) | 2017-03-24 | 2018-10-09 | 华为技术有限公司 | Coding method, interpretation method, device and equipment |
| CN110780134B (en) * | 2019-10-30 | 2022-04-26 | 深圳市国电科技通信有限公司 | System optimization method for improving reliability of industrial control data acquisition system |
| WO2021179307A1 (en) * | 2020-03-13 | 2021-09-16 | 华为技术有限公司 | Method, apparatus and system for processing transport stream (ts) |
| CN113038128B (en) * | 2021-01-25 | 2022-07-26 | 腾讯科技（深圳）有限公司 | Data transmission method and device, electronic equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006109154A1 (en) * | 2005-04-13 | 2006-10-19 | Nokia Corporation | Coding of frame number in scalable video coding |
| CN101207841A (en) * | 2006-12-19 | 2008-06-25 | 华为技术有限公司 | Method, system and apparatus for implementing multimedia broadcast multi-broadcast business |
| CN101507267A (en) * | 2005-09-07 | 2009-08-12 | 维德约股份有限公司 | System and method for scalable and low-delay videoconferencing using scalable video coding |
| CN102098542A (en) * | 2010-12-15 | 2011-06-15 | 中兴通讯股份有限公司 | Multi-media data transmission method, system and device |
-
2011
- 2011-09-20 CN CN201110279936.9A patent/CN103024369B/en not_active Expired - Fee Related
-
2012
- 2012-09-10 WO PCT/CN2012/081196 patent/WO2013040996A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006109154A1 (en) * | 2005-04-13 | 2006-10-19 | Nokia Corporation | Coding of frame number in scalable video coding |
| CN101507267A (en) * | 2005-09-07 | 2009-08-12 | 维德约股份有限公司 | System and method for scalable and low-delay videoconferencing using scalable video coding |
| CN101207841A (en) * | 2006-12-19 | 2008-06-25 | 华为技术有限公司 | Method, system and apparatus for implementing multimedia broadcast multi-broadcast business |
| CN102098542A (en) * | 2010-12-15 | 2011-06-15 | 中兴通讯股份有限公司 | Multi-media data transmission method, system and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103024369A (en) | 2013-04-03 |
| WO2013040996A1 (en) | 2013-03-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108777676B (en) | Apparatus and method for receiving media data in multimedia transmission system | |
| EP2139132B1 (en) | A method for transmitting mobile multimedia broadcast electronic service guide | |
| US20200007250A1 (en) | Apparatus for transmitting broadcast signals, apparatus for receiving broadcast signals, method for transmitting broadcast signals and method for receiving broadcast signals | |
| CN104247436A (en) | Apparatus and method for transmitting and receiving signaling information in a digital broadcasting system | |
| CN100531398C (en) | Method for realizing multiple audio tracks in mobile multimedia broadcast system | |
| CN1972454A (en) | Mobile multimedia broadcasting real-time traffic flow packaging method | |
| CN107079028A (en) | Dispensing device and reception device and its signal processing method | |
| CN103733612B (en) | For sending and receiving the method and device of the signaling information for broadcasting service reception in a digital broadcasting system | |
| CN101350768B (en) | Method for conveying IP packet in broadcast network | |
| US20100118760A1 (en) | Method for transmitting mobile multimedia broadcast service data flow and a multiplexing frame for transmitting | |
| CN101159579B (en) | Method and terminal of receiving network transport protocol based stream media data | |
| CN1960328B (en) | Method for packaging real time stream of mobile multimedia broadcast | |
| CN100518074C (en) | Method for implementing multiple video strems in mobile multimedia broadcast | |
| CN103024369B (en) | Transmitting terminal, terminal, the system and method for hierarchical coding multiplexing | |
| CN1972408A (en) | A data transmission method for mobile multimedia broadcasting system | |
| CN1972453A (en) | A data flow packaging method of mobile multimedia broadcasting system | |
| CN102763364A (en) | Method and apparatus for transmitting/receiving multi - channel audio signals using super frame | |
| CN100479529C (en) | Conversion method of multiplexing protocols in broadcast network | |
| CN1976495A (en) | Mobile multimedia broadcasting control information and media information specification transmitting method | |
| CN101267572B (en) | A program stream conversion method and device | |
| CN101179738B (en) | Conversion method from transmission stream to China mobile multimedia broadcasting multiplex protocol | |
| CN100536568C (en) | Method for differentiating transmissions of control information and media information in mobile multimedia broadcast | |
| US11336381B2 (en) | Reception apparatus and data processing method | |
| WO2008043213A1 (en) | A mobile multimedia broadcast system for enhancing transmission efficiency by using variable-length frame and thereof method | |
| CN1972166B (en) | An audio stream transport method of mobile multimedia broadcast system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20171110 Termination date: 20190920 |