CN101193289A - A real time conversion method from MPEG-4 transmission code stream to Internet stream media alliance stream - Google Patents
A real time conversion method from MPEG-4 transmission code stream to Internet stream media alliance stream Download PDFInfo
- Publication number
- CN101193289A CN101193289A CN 200610145625 CN200610145625A CN101193289A CN 101193289 A CN101193289 A CN 101193289A CN 200610145625 CN200610145625 CN 200610145625 CN 200610145625 A CN200610145625 A CN 200610145625A CN 101193289 A CN101193289 A CN 101193289A
- Authority
- CN
- China
- Prior art keywords
- stream
- rtp
- bag
- described step
- transcoder
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention relates to a method for real-time converting transport stream TS of MPEG-4 into ISMA stream in an Internet Stream Media Alliance (ISMA), which includes the following contents: (a) parameters of a code converter is configured, including encoding type of video and audio, a program number of the TS stream, a parameter of a session description protocol (SDP) of ISMA live broadcast stream; (b) the TS stream from an encoder is received by the code converter; (c) according to the configuration information, the code converter de-multiplexes TS stream, and according to program of TS stream and PCR value of a reference clock, a corresponding frame reference time is generated by the code converter; (d) obtained video and audio data is further processed and de-multiplexed by the code converter and a real time transmission protocol (RTP) package is generated according to the configuration information and the frame reference time; and (e) after the RTP package is generated, the generated video and audio RTP package is transmitted to a network through a user datagram protocol (UDP) port configured in the parameter of the SDP or a transmission control protocol (TCP) port by the code converter.
Description
Technical field
The invention belongs to field of multimedia communication, relate in particular to the real time conversion method of the transmission code stream (TS) of a kind of MPEG-4 of Motion Picture Experts Group to internet stream media alliance stream (ISMA).
Background technology
Providing the real-time television video traffic by IP (Internet protocol) network is a kind of trend, and the rise of IPTV (Web TV) is exactly a kind of embodiment of this trend.IPTV transmits on broadband internet, adopts set-top box to add television set and shows and mutual a kind of new video traffic.
In the IPTV system, at present there is the transmission specification of two kinds of video flowings in industry, promptly in the Internet the widely used ISMA standard that proposes by internet stream media alliance (ISMA) and in CHINA RFTCOM Co Ltd the widely used TS standard that proposes by Motion Picture Experts Group (MPEG).The TS standard adopts TS to seal the dress form audio stream and the unified group of video flowing is wrapped and be multiplexed into a transport stream, and the ISMA agreement is then video flowing and separately transmission of audio stream, so these two kinds of standards are incompatible.
Because the ISMA agreement is to propose at Internet characteristics, can adapt to network characteristicses such as packet loss on the IP network, time-delay, shake preferably, add the professional operation experience of the existing internet stream media of telecom operators, therefore, telecom operators tend to adopt the ISMA transmission specification usually in the IPTV system, but television content is grasped in the broadcasting and TV system, adopts the TS transformat usually.In order to solve the format conversion problem, this paper has proposed to convert the code-transferring method of ISMA stream in real time to from TS stream, and has solved problems such as the time stamp generation in the transcoding process, Group Package Policy and transcoding time-delay control emphatically.
Summary of the invention
The video that the technical problem to be solved in the present invention provides a kind of traditional TS form flows to the real time conversion method of ISMA transport stream, for the IPTV system of telecom operators provides the solution of introducing real-time video from the broadcasting and TV system.
The transmission code stream TS of a kind of MPEG-4 flows to the real time conversion method of the ISMA of internet stream media alliance stream, comprises following content:
(a) configuration transcoder parameter, comprise look, the audio coding type, TS flows program number, ISMA live TV stream Session Description Protocol SDP parameter, comprise the transmission connection type in the SDP parameter, i.e. transmission control protocol TCP or User Datagram Protoco (UDP) UDP and corresponding ports number;
(b) transcoder receives the TS stream from encoder;
(c) transcoder is pressed configuration information demultiplexing TS stream, generates the corresponding frame reference time according to TS stream Program Clock Reference PCR value;
(d) transcoder is further handled the video/audio that demultiplexing obtains, and generates the realtime transmission protocol RTP bag according to configuration information and frame reference time;
(e) generate after the RTP bag, the audio frequency RTP bag of looking that transcoder will generate is sent to network by User Datagram Protoco (UDP) udp port or the transmission control protocol tcp port that disposes in the SDP parameter.
The parameter of described step (a) transit code device also comprises program receiving source NIC address; Send the program NIC address; Program source multicast network IP address, but non-multicast source value 0.0.0.0 then, and program source port numbers.
The parameter of described step (a) transcoder is configured with the form of configuration file, and each configuration file can dispose a plurality of programs.
Each video RTP bag comprises a video packets elementary stream PES at the most in the described step (d), and promptly each video PES load head is all in the starting point of RTP pay(useful) load Payload.
Each audio frequency RTP comprises one or more audio frequency PES in the described step (d), and a PES only belongs to a RTP bag.
Each RTP is surrounded by the maximum length of imitating load P ayload and is no more than 1436 bytes in the described step (d).
Described step (e) transit code device is not reserved buffer memory for ordering.
Described step (e) transit code device is that the buffer memory that the set of Marker sign is reserved in the RTP bag is no more than 1 UDP bag or TCP bag.
Transcoder described in the described step (e) receives and adopts when sending data asynchronous mechanism, is unit to the lock control that adds of shared drive with UDP bag or TCP bag.
Described step (e) transit code device sends after receiving the RTP bag immediately.
The TS that adopts this paper invention to provide flows to the real time conversion method of ISMA stream, solved in the problem that the TS that inserts MPEG-4 looks audio content well, thereby provide solution for the IPTV system introduces traditional broadcasting and TV content source based on the IPTV system of ISMA transmission specification.
Description of drawings
Fig. 1 is that TS of the present invention flows to ISMA streaming system block diagram;
Fig. 2 is the real time conversion method flow chart that a kind of TS of the present invention flows to ISMA stream;
Fig. 3 is that TS seals dress form schematic diagram;
Fig. 4 is that the RTP of MPEG-4 video flowing seals dress form schematic diagram;
Fig. 5 is that the RTP of MPEG-4 audio stream seals dress form schematic diagram.
Embodiment
Shown in Figure 1 is the present invention by the system block diagram of TS stream translation to ISMA stream, comprises encoder, transcoder, IP network and terminal, wherein transcoder receives the TS stream from encoder, and this code stream is carried out being encapsulated as the RTP bag behind the demultiplexing, is sent to terminal by IP network again.
The TS of a kind of MPEG-4 of the present invention of being shown in Figure 2 flows to the real time conversion method flow chart of ISMA stream, may further comprise the steps:
Before starting transcoder, earlier transcoder is carried out necessary configuration, comprise look, the audio coding type, TS flows program number, ISMA live TV stream SDP (Session Description Protocol) etc. are configured in the configuration file mode, and a configuration file can be configured simultaneously to a plurality of programs.The configuration item of each program comprises:
1) program number: if TS stream is MPTS (Polymera TS code stream), the then program number of corresponding program (program_number); If TS stream is SPTS (multichannel single-unit order TS), then value is 0;
2) program receiving source NIC address;
3) send the program NIC address;
4) program source multicast ip address, but non-multicast source value 0.0.0.0 then;
5) program source port numbers;
6) program SDP (Session Description Protocol) comprises sending IP address, port numbers, sends connection type (TCP/UDP, transmission control protocol/User Datagram Protoco (UDP)), load type, and the clock frequency of medium type and time stamp defaults to 90kHz;
7) video, audio coding type.
Transcoder receives the TS over UDP stream (with the TS stream of udp protocol carrying) from encoder.The TS pack arrangement as shown in Figure 3, TS bag is made up of packet header, self adaptation district and bag data 3 parts.Each packet length is 188 fixing bytes, and packet header is 4 bytes, and self adaptation district and bag data are 184 bytes.184 bytes are the useful information space, are used to transmit the video/audio data flow of having encoded.Packet header is preferential by sync byte, transmission error code designator, PU Payload Unit start indicator, transmission, bag identification (PID-Packet Identification), transmission scrambling control, the control of self adaptation district and 8 parts of continuous counter are formed.
Transcoder is pressed configuration information demultiplexing TS stream, and (the grouping elementary stream PES with TS is a unit) tells video and audio code stream frame by frame, and is generated the reference time of corresponding frame by Program Clock Reference value (PCR); Transcoder obtains corresponding video-voice frequency flow PES after TS is flowed demultiplexing, gets the time stamp of the PCR value of PES head correspondence as this frame, and the relevant regulations of the concrete conversion method establishing criteria agreement ISO13818-1 of PCR value and time stamp is carried out.
Transcoder is further handled audio packet elementary stream (PES) data of looking that demultiplexing obtains, and according to configuration information and frame reference time, generates the RTP bag according to RFC3016 agreement (the RTP load format agreement that is used for the MPEG-4 audiovisual streams).The video of MPEG-4 and audio frequency RTP packet format are distinguished as shown in Figure 4 and Figure 5, and packet header generally only comprises 12 bytes of beginning, and the CSRC identification field does not generally need.Field V presentation protocol version, field P represents whether comprise padding data, X field represents whether protocols having is expanded, and the CC field is represented the CSRC conventional number, and whether the M field identification is last RTP bag of VOP, the PT field is represented load type, Sequence Number is a sequence number, initial value at random, Timestamp is the time stamp field, indicate the sampling instant of the VOP that is comprised in this RTP bag, SSRC is a random number of sign synchronisation source.Because the TS of input bag is not corresponding one by one with the RTP bag of output, the RTP Group Package Policy is as follows:
1) video RTP bag comprises a PES at the most, and promptly each video PES load head is all in the starting point of RTP pay(useful) load (Payload);
2) audio frequency RTP bag can comprise a plurality of PES, but a PES can not stride a plurality of RTP bags, and promptly each audio frequency RTP pay(useful) load (Payload) starting point is a PES load head;
3) Voice ﹠ Video RTP is surrounded by the maximum length of imitating load (Payload) and is no more than 1436 bytes.
The audio frequency RTP bag of looking that transcoder will generate is sent to network separately by the udp port that disposes.In order to ensure live real-time, the time delay of transcoding should be as far as possible little.Strategy that adopts and mechanism are as follows:
1) because encoder generally is directly to link to each other with transcoder, therefore do not consider packet loss and out of order situation, promptly needn't reserve buffer memory for ordering;
2) Marker must be identified set owing to look last RTP bag of audio frame, if the PES length value of TS stream is 0 (the PES length of TS stream video packets mostly is 0 greatly), having only could the judgment frame border by PES flag bit.Thereby need a certain amount of data of buffer memory with Decision boundaries.From next effectively (containing the ES data) TS bag can determine whether the current TS bag is frame boundaries, institute thinks that buffer memory that Marker set is reserved can be 1 UDP at most and wraps.Wrap generation RTP according to a TS and wrap the back temporary cache, wait to receive to determine the Marker that whether RTP is wrapped to identify set again after next TS wraps, and then send.
3) for avoiding factor influence packet and receive according to handling and sending, receive with handling and send the general asynchronous mechanism that adopts, should be unit with the UDP bag to the lock control that adds of shared drive, promptly wrapping with whole UDP is that unit adds lock control.The buffering area that takies such as this bag is locked by receiving process when receiving, and avoids treatment progress that it is made amendment.Each bag all has a lock, rather than lock of whole buffering area (memory block), is convenient to two process concurrent workings like this, promptly can not produce too much processing time-delay.To reject the buffer memory that produces because of asynchronous mechanism;
4) sending module sends to destination address after receiving the RTP bag of generation immediately, does not make flow control and buffer memory.
Above-mentioned transmission also can be adopting the TCP mode, when adopting the TCP mode, and the same UDP of send mode.
Claims (10)
1. the transmission code stream TS of a MPEG-4 flows to the real time conversion method of the ISMA of internet stream media alliance stream, comprises following content:
(a) configuration transcoder parameter, comprise look, the audio coding type, TS flows program number, ISMA live TV stream Session Description Protocol SDP parameter, comprise the transmission connection type in the SDP parameter, i.e. transmission control protocol TCP or User Datagram Protoco (UDP) UDP and corresponding ports number;
(b) transcoder receives the TS stream from encoder;
(c) transcoder is pressed configuration information demultiplexing TS stream, generates the corresponding frame reference time according to TS stream Program Clock Reference PCR value;
(d) transcoder is further handled the video/audio that demultiplexing obtains, and generates the realtime transmission protocol RTP bag according to configuration information and frame reference time;
(e) generate after the RTP bag, the audio frequency RTP bag of looking that transcoder will generate is sent to network by User Datagram Protoco (UDP) udp port or the transmission control protocol tcp port that disposes in the SDP parameter.
2. the method for claim 1, it is characterized in that: the parameter of described step (a) transit code device also comprises program receiving source NIC address; Send the program NIC address; Program source multicast network IP address, but non-multicast source value 0.0.0.0 then, and program source port numbers.
3. method as claimed in claim 1 or 2 is characterized in that: the parameter of described step (a) transcoder is configured with the form of configuration file, and each configuration file can dispose a plurality of programs.
4. the method for claim 1 is characterized in that: each video RTP bag comprises a video packets elementary stream PES at the most in the described step (d), and promptly each video PES load head is all in the starting point of RTP pay(useful) load Payload.
5. the method for claim 1, it is characterized in that: each audio frequency RTP comprises one or more audio frequency PES in the described step (d), and a PES only belongs to a RTP bag.
6. as claim 4 or 5 described methods, it is characterized in that: each RTP is surrounded by the maximum length of imitating load P ayload and is no more than 1436 bytes in the described step (d).
7. the method for claim 1 is characterized in that: described step (e) transit code device is not reserved buffer memory for ordering.
8. the method for claim 1 is characterized in that: described step (e) transit code device is that the buffer memory that the set of Marker sign is reserved in the RTP bag is no more than 1 UDP bag or TCP bag.
9. the method for claim 1 is characterized in that: transcoder described in the described step (e) receives and adopts when sending data asynchronous mechanism, is unit to the lock control that adds of shared drive with UDP bag or TCP bag.
10. the method for claim 1 is characterized in that: described step (e) transit code device sends after receiving the RTP bag immediately.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200610145625 CN100568971C (en) | 2006-11-22 | 2006-11-22 | The transmission code stream of a kind of MPEG-4 is to the real time conversion method of internet stream media alliance stream |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200610145625 CN100568971C (en) | 2006-11-22 | 2006-11-22 | The transmission code stream of a kind of MPEG-4 is to the real time conversion method of internet stream media alliance stream |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101193289A true CN101193289A (en) | 2008-06-04 |
| CN100568971C CN100568971C (en) | 2009-12-09 |
Family
ID=39487991
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200610145625 Expired - Fee Related CN100568971C (en) | 2006-11-22 | 2006-11-22 | The transmission code stream of a kind of MPEG-4 is to the real time conversion method of internet stream media alliance stream |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100568971C (en) |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102217271A (en) * | 2008-07-16 | 2011-10-12 | 诺基亚公司 | Method and apparatus for peer to peer streaming |
| CN102301737A (en) * | 2009-01-13 | 2011-12-28 | 阿尔卡特朗讯公司 | Method And Device For Ensuring Reliability During Transmission Of Television Data In A Television System Based On Internet Protocol |
| CN102790906A (en) * | 2012-08-28 | 2012-11-21 | 曙光信息产业(北京)有限公司 | Encoding and decoding system and method |
| CN102075766B (en) * | 2009-11-23 | 2013-01-09 | 华为技术有限公司 | Video coding and decoding methods and devices, and video coding and decoding system |
| WO2013053259A1 (en) * | 2011-10-11 | 2013-04-18 | 华为技术有限公司 | Processing method, playing method and apparatus for streaming media data |
| CN103430535A (en) * | 2011-01-21 | 2013-12-04 | 汤姆逊许可公司 | System and method for enhanced remote transcoding using content profiling |
| CN103491368A (en) * | 2013-09-13 | 2014-01-01 | 天脉聚源(北京)传媒科技有限公司 | Method, device and system for processing video |
| CN105847265A (en) * | 2016-03-31 | 2016-08-10 | 乐视控股（北京）有限公司 | Video living streaming transcoding method and device |
| CN107360464A (en) * | 2017-09-05 | 2017-11-17 | 珠海迈科智能科技股份有限公司 | A kind of transcoding device and method |
| CN108243153A (en) * | 2016-12-23 | 2018-07-03 | 北京视联动力国际信息技术有限公司 | A kind of method and apparatus in the broadcasting TV programme in networking |
| CN108540820A (en) * | 2018-05-08 | 2018-09-14 | 腾讯科技（北京）有限公司 | Flow data management method, device and computer readable storage medium |
| CN109348282A (en) * | 2018-11-19 | 2019-02-15 | 深圳市炬力北方微电子有限公司 | A kind of wireless method and device for throwing screen time delay of reduction |
| CN112399194A (en) * | 2021-01-20 | 2021-02-23 | 腾讯科技（深圳）有限公司 | Live data processing method and device, computer and readable storage medium |
| CN112839243A (en) * | 2020-12-30 | 2021-05-25 | 苏州科达科技股份有限公司 | Code stream transfer method and device, electronic equipment and storage medium |
| CN112995714A (en) * | 2021-04-08 | 2021-06-18 | 天津天地伟业智能安全防范科技有限公司 | Method and device for converting private video stream into RTMP standard stream |
| CN114339378A (en) * | 2021-12-23 | 2022-04-12 | 展讯通信（上海）有限公司 | Audio and video code stream processing method and device and electronic equipment |
-
2006
- 2006-11-22 CN CN 200610145625 patent/CN100568971C/en not_active Expired - Fee Related
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102217271A (en) * | 2008-07-16 | 2011-10-12 | 诺基亚公司 | Method and apparatus for peer to peer streaming |
| CN102301737A (en) * | 2009-01-13 | 2011-12-28 | 阿尔卡特朗讯公司 | Method And Device For Ensuring Reliability During Transmission Of Television Data In A Television System Based On Internet Protocol |
| CN102301737B (en) * | 2009-01-13 | 2014-01-08 | 阿尔卡特朗讯公司 | Method And Device For Ensuring Reliability During Transmission Of Television Data In A Television System Based On Internet Protocol |
| CN102075766B (en) * | 2009-11-23 | 2013-01-09 | 华为技术有限公司 | Video coding and decoding methods and devices, and video coding and decoding system |
| CN103430535A (en) * | 2011-01-21 | 2013-12-04 | 汤姆逊许可公司 | System and method for enhanced remote transcoding using content profiling |
| US9681091B2 (en) | 2011-01-21 | 2017-06-13 | Thomson Licensing | System and method for enhanced remote transcoding using content profiling |
| WO2013053259A1 (en) * | 2011-10-11 | 2013-04-18 | 华为技术有限公司 | Processing method, playing method and apparatus for streaming media data |
| CN102790906A (en) * | 2012-08-28 | 2012-11-21 | 曙光信息产业(北京)有限公司 | Encoding and decoding system and method |
| CN103491368A (en) * | 2013-09-13 | 2014-01-01 | 天脉聚源(北京)传媒科技有限公司 | Method, device and system for processing video |
| CN105847265A (en) * | 2016-03-31 | 2016-08-10 | 乐视控股（北京）有限公司 | Video living streaming transcoding method and device |
| CN108243153B (en) * | 2016-12-23 | 2019-03-12 | 视联动力信息技术股份有限公司 | A kind of method and apparatus playing TV programme in view networking |
| CN108243153A (en) * | 2016-12-23 | 2018-07-03 | 北京视联动力国际信息技术有限公司 | A kind of method and apparatus in the broadcasting TV programme in networking |
| CN107360464A (en) * | 2017-09-05 | 2017-11-17 | 珠海迈科智能科技股份有限公司 | A kind of transcoding device and method |
| CN108540820A (en) * | 2018-05-08 | 2018-09-14 | 腾讯科技（北京）有限公司 | Flow data management method, device and computer readable storage medium |
| CN108540820B (en) * | 2018-05-08 | 2020-09-15 | 腾讯科技（北京）有限公司 | Stream data management method, device and computer readable storage medium |
| CN109348282A (en) * | 2018-11-19 | 2019-02-15 | 深圳市炬力北方微电子有限公司 | A kind of wireless method and device for throwing screen time delay of reduction |
| CN112839243A (en) * | 2020-12-30 | 2021-05-25 | 苏州科达科技股份有限公司 | Code stream transfer method and device, electronic equipment and storage medium |
| CN112399194A (en) * | 2021-01-20 | 2021-02-23 | 腾讯科技（深圳）有限公司 | Live data processing method and device, computer and readable storage medium |
| CN112995714A (en) * | 2021-04-08 | 2021-06-18 | 天津天地伟业智能安全防范科技有限公司 | Method and device for converting private video stream into RTMP standard stream |
| CN114339378A (en) * | 2021-12-23 | 2022-04-12 | 展讯通信（上海）有限公司 | Audio and video code stream processing method and device and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN100568971C (en) | 2009-12-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100568971C (en) | The transmission code stream of a kind of MPEG-4 is to the real time conversion method of internet stream media alliance stream | |
| US11196786B2 (en) | Interface apparatus and method for transmitting and receiving media data | |
| US7035295B2 (en) | Direct RTP delivery method and system over MPEG network | |
| JP6422527B2 (en) | Data receiving method and apparatus in multimedia system | |
| KR101972951B1 (en) | Method of delivering media data based on packet with header minimizing delivery overhead | |
| EP2849440A1 (en) | Hybrid transmission method through mmt packet format extension | |
| CN103947215B (en) | Transmit the method and apparatus of media data, the device and method of receiving media data | |
| Schierl et al. | Scalable video coding over RTP and MPEG-2 transport stream in broadcast and IPTV channels | |
| CN102714754A (en) | Remote re-multiplexing of transport streams | |
| WO2007045140A1 (en) | A real-time method for transporting multimedia data | |
| CN101193290A (en) | A real time conversion system from MPEG-4 transmission code stream to Internet stream media alliance stream | |
| CN1972453A (en) | A data flow packaging method of mobile multimedia broadcasting system | |
| Standard | Transport of high bit rate media signals over IP networks (HBRMT) | |
| US9918112B2 (en) | System and method for multiplexed streaming of multimedia content | |
| WO2012173391A2 (en) | Method for transmitting packet-based media data having header in which overhead is minimized | |
| Kordelas et al. | Transport Protocols for 3D Video |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20091209 Termination date: 20151122 |
|
| EXPY | Termination of patent right or utility model |