CN102595202A - Method, device and system for synchronizing multiple media streams - Google Patents

Method, device and system for synchronizing multiple media streams Download PDF

Info

Publication number
CN102595202A
CN102595202A CN2011100050736A CN201110005073A CN102595202A CN 102595202 A CN102595202 A CN 102595202A CN 2011100050736 A CN2011100050736 A CN 2011100050736A CN 201110005073 A CN201110005073 A CN 201110005073A CN 102595202 A CN102595202 A CN 102595202A
Authority
CN
China
Prior art keywords
timestamp
rtp
media
rtp packet
initial value
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2011100050736A
Other languages
Chinese (zh)
Other versions
CN102595202B (en
Inventor
赵宇
孙健
阮亚平
刘继年
陈光亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN201110005073.6A priority Critical patent/CN102595202B/en
Priority claimed from CN201110005073.6A external-priority patent/CN102595202B/en
Priority to PCT/CN2012/070159 priority patent/WO2012094974A1/en
Publication of CN102595202A publication Critical patent/CN102595202A/en
Application granted granted Critical
Publication of CN102595202B publication Critical patent/CN102595202B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4305Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43072Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of multiple content streams on the same device
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/65Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80Responding to QoS
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4341Demultiplexing of audio and video streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61Network physical structure; Signal processing
    • H04N21/6106Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6125Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via Internet

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Synchronisation In Digital Transmission Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention provides a method, a device and a system for synchronizing multiple media streams. The method comprises the following steps: when packaging multiple media streams into a real time protocol RTP (Real Time Protocol) data packet, a transmitting end stamps a timestamp on the RTP data packet by using clock times with the same initial value and the same precision. The method can solve the problem that synchronization among multiple media streams is slightly difficult in existing technology; in this way, the processing load of synchronizing audios and videos of a client and the dependence on the real time control protocol are reduced.

Description

Method, Apparatus and system that a kind of a plurality of Media Stream is synchronous
Technical field
The present invention relates to the multimedia field, method, Apparatus and system that particularly a kind of a plurality of Media Streams are synchronous.
Background technology
Adopting real time transport protocol (Real-time Transport Protocol is called for short RTP) to carry out in media delivery and the medium control transmission, carry the RTP timestamp (timestamp) of medium in the media packet bag, as shown in Figure 1.The sampling time that this timestamp (32 bit) has reflected first byte in the RTP packet.Clock frequency depends on the load data form, and in description document (profile), describes.Also can dynamically describe load format through the RTP method.If the RTP bag is periodically to produce, will use nominal sampling instant so by the sampling clock decision, rather than the reading system time.For example, to the audio frequency of a fixed rate, sampling clock will increase by 1 in each cycle.If an audio frequency reads the piece that contains 160 sampling periods from input equipment, so to each piece, the value of timestamp increases by 160.The initial value of timestamp should be at random.The RTP bag of several successive is if produced simultaneously.As: belong to the RTP bag of same frame of video, identical timestamp will be arranged.The RTP timestamp of different media flows maybe be with different rate increase.And have an independently random offset.Therefore, though these timestamps are enough to the time of an independent stream of reconstruct, directly relatively the timestamp of media flow with different can not carry out synchronously.
For each medium, we can and come from the timestamp on the reference clock the RTP timestamp that is associated with sampling instant, for example adopt the timestamp of NTP (NTP) to be associated.The NTP timestamp has solved the problem that the RTP timestamp has random offset.Reference clock is used for the common time of all medium synchronously.This timestamp is used to judge the corresponding relation of RTP timestamp and NTP timestamp to (RTP timestamp and NTP timestamp), to carry out the synchronous of Media Stream.They are not in each packet, all to be sent out, and in the SR of the lower real time control protocol of transmission rate (RTCP) (Sender Report).
Based on above-mentioned RTP synchronization mechanism, can find out to be cumbersome synchronously between a plurality of Media Streams of RTP.At first RTP itself with time stamp do not have the function of time synchronized, it will rely on, and RTCP sends the absolute time (NTP timestamp) of carrying in the report and the RTP time stamp of correspondence carries out a relationship maps, just can obtain the temporal correlation of each Media Stream.
Summary of the invention
The technical problem that the present invention will solve is; Provide a kind of a plurality of Media Stream synchronous method, Apparatus and system, can not independently bear and carry out the synchronous task of a plurality of Media Streams through on the basis of the RTP head of RFC3550 definition, improving the time stamp that solves the current RTP protocol definition.
In order to solve the problems of the technologies described above, the present invention proposes the synchronous method of a kind of a plurality of Media Stream, comprising:
Transmitting terminal uses the clock time that initial value is identical, precision is identical to beat timestamp as the RTP packet when a plurality of Media Streams are encapsulated as real time transport protocol RTP packet.
Further, said method also can have following characteristics:
Receiving terminal decodes the data of said a plurality of Streaming Medias after receiving said RTP packet, and according to the timestamp in the RTP packet of each Streaming Media of encapsulation the data of said a plurality of Streaming Medias is carried out Synchronous Processing.
Further, said method also can have following characteristics:
Said transmitting terminal is beaten timestamp for the RTP packet and is comprised:
Said transmitting terminal is respectively the data duration information that said each Media Stream safeguards that an initial value is identical, and according to the packed data duration of said each Streaming Media, upgrades the data duration information of said each Media Stream;
Said transmitting terminal is being a Media Stream when beating timestamp, and the value of timestamp is set to the data duration information sum of initial value and this Media Stream of said clock time.
Further, said method also can have following characteristics:
Said a plurality of Media Stream is video flowing and/or audio stream;
Said transmitting terminal is after obtaining frame of video and breaking into RTP bag, for this RTP bag is beaten timestamp from video flowing;
Said transmitting terminal is after obtaining audio frame and breaking into RTP bag from audio stream, and this audio frame is just beaten timestamp for this RTP wraps when being the first frame in the said RTP bag.
In order to solve the problems of the technologies described above, the present invention also proposes the synchronous dispensing device of a kind of a plurality of Media Stream, comprising:
Beat the timestamp module, be used for when a plurality of Media Streams are encapsulated as real time transport protocol RTP packet, using the clock time that initial value is identical, precision is identical to beat timestamp as the RTP packet;
Sending module is used for the RTP packet of stamping said timestamp is sent.
Further, said apparatus also can have following characteristics:
The said timestamp module of beating comprises first computing module and second computing module, wherein:
Said first computing module is used to be respectively the data duration information that said each Media Stream safeguards that an initial value is identical, and according to the packed data duration of said each Streaming Media, upgrades the data duration information of said each Media Stream;
Said second computing module is used for being a Media Stream when beating timestamp that the value of timestamp is set to the data duration information sum of initial value and this Media Stream of said clock time.
Further, said apparatus also can have following characteristics:
Said a plurality of Media Stream is video flowing and/or audio stream, wherein:
Said second computing module is after obtaining frame of video and breaking into RTP bag, for this RTP bag is beaten timestamp from video flowing;
Said second computing module, after obtaining audio frame from audio stream and breaking into RTP bag, and this audio frame is just beaten timestamp for this RTP wraps when being the first frame in the said RTP bag.
In order to solve the problems of the technologies described above, the present invention also proposes the synchronous receiving system of a kind of a plurality of Media Stream, comprising:
Parsing module is used for after receiving said RTP packet, decoding the data of said a plurality of Streaming Medias, and encapsulates the timestamp in the RTP packet of each Streaming Media, and said timestamp uses the clock time that initial value is identical, precision is identical;
Synchronous processing module is used for according to the timestamp of the RTP packet of said each Streaming Media of encapsulation the data of said a plurality of Streaming Medias being carried out Synchronous Processing.
In order to solve the problems of the technologies described above, the present invention also proposes the synchronous system of a kind of a plurality of Media Stream, comprising:
Transmitting terminal when a plurality of Media Streams are encapsulated as real time transport protocol RTP packet, uses the clock time that initial value is identical, precision is identical to beat timestamp as the RTP packet;
Receiving terminal after receiving said RTP packet, decodes the data of said a plurality of Streaming Medias, and according to the timestamp in the RTP packet of each Streaming Media of encapsulation the data of said a plurality of Streaming Medias is carried out Synchronous Processing.
Further, said system also can have following characteristics:
Said transmitting terminal is beaten timestamp for the RTP packet and is comprised:
Said transmitting terminal is respectively the data duration information that said each Media Stream safeguards that an initial value is identical, and according to the packed data duration of said each Streaming Media, upgrades the data duration information of said each Media Stream;
Said transmitting terminal is being a Media Stream when beating timestamp, and the value of timestamp is set to the data duration information sum of initial value and this Media Stream of said clock time.
Synchronous method, the Apparatus and system of a kind of a plurality of Media Streams provided by the invention can overcome in the prior art and to dislike complicated problems synchronously slightly between the media stream, and then reduce the processing load of client synchronized audio/video and reduce the dependence to RTCP.
Description of drawings
Fig. 1 is the sketch map of preceding 12 bytes of the RTP head of RFC3550 definition;
Fig. 2 is preceding 12 bytes of the RTP head of embodiment of the invention definition;
Fig. 3 beats the method flow diagram of timestamp for the RTP packet for embodiment of the invention transmitting terminal;
Fig. 4 is an embodiment of the invention dispensing device block diagram;
Fig. 5 is an embodiment of the invention receiving system block diagram;
Fig. 6 generates the flow chart of the RTP packing of NTP time stamp for application example of the present invention;
Fig. 7 carries out the flow chart of synchronous client process for application example of the present invention uses the NTP time stamp.
Embodiment
For making the object of the invention, technical scheme and advantage clearer, will combine accompanying drawing and specific embodiment to describe the present invention below.
The time stamp that a kind of improvement that the embodiment of the invention is carried out on the basis of the RTP head of RFC3550 definition dexterously solves the current RTP protocol definition can not independently be born and carry out the synchronous task of a plurality of Media Streams.
Like Fig. 1 is the RTP head of the standard of RFC3550 definition.Fig. 2 is the RTP head of present embodiment one definition, and the account form of timestamp field is defined again.That is, when beating timestamp, the scheme of using initial value clock time identical, that precision is identical (promptly have identical stepping, the benchmark of tolerance is identical) to beat timestamp for the RTP packet is proposed dexterously.Thereby adopt same benchmark, same linear module when having realized the timestamp computing of each Streaming Media.
Correspondingly; Receiving terminal is after receiving said RTP packet; After decoding the data of said a plurality of Streaming Medias,, the timestamp in the RTP packet that encapsulates each Streaming Media simply relatively can realize the data of said a plurality of Streaming Medias are carried out Synchronous Processing according to being carried out.
Preferably, said transmitting terminal is beaten timestamp for the RTP packet and can be comprised step shown in Figure 3:
Step S301: said transmitting terminal is respectively the data duration information that said each Media Stream safeguards that an initial value is identical, and according to the packed data duration of said each Streaming Media, upgrades the data duration information of said each Media Stream;
Step S302: said transmitting terminal is being a Media Stream when beating timestamp, and the value of timestamp is set to the data duration information sum of initial value and this Media Stream of said clock time.
Preferably, said a plurality of Media Stream is video flowing and/or audio stream:
Said transmitting terminal on the opportunity of beating timestamp for the RTP of video flowing bag is: said transmitting terminal is obtaining frame of video and breaks into the RTP bag from video flowing after, beat timestamp for this RTP wraps.
Said transmitting terminal on the opportunity of beating timestamp for the RTP of audio stream bag is: said transmitting terminal is obtaining audio frame and breaks into the RTP bag from audio stream after, and this audio frame is just beaten timestamp for this RTP wraps when being the first frame in the said RTP bag.
In order to realize said method, the embodiment of the invention also provides a kind of a plurality of Media Stream synchronous dispensing device, and is as shown in Figure 4, comprising:
Beat the timestamp module, be used for when a plurality of Media Streams are encapsulated as real time transport protocol RTP packet, using the clock time that initial value is identical, precision is identical to beat timestamp as the RTP packet;
Sending module is used for the RTP packet of stamping said timestamp is sent.
Wherein, the said timestamp module of beating comprises first computing module and second computing module, wherein:
Said first computing module is used to be respectively the data duration information that said each Media Stream safeguards that an initial value is identical, and according to the packed data duration of said each Streaming Media, upgrades the data duration information of said each Media Stream;
Said second computing module is used for being a Media Stream when beating timestamp that the value of timestamp is set to the data duration information sum of initial value and this Media Stream of said clock time.
Wherein, said a plurality of Media Stream is video flowing and/or audio stream:
Said second computing module is after obtaining frame of video and breaking into RTP bag, for this RTP bag is beaten timestamp from video flowing;
Said second computing module, after obtaining audio frame from audio stream and breaking into RTP bag, and this audio frame is just beaten timestamp for this RTP wraps when being the first frame in the said RTP bag.
In order to realize said method, the embodiment of the invention also provides a kind of a plurality of Media Stream synchronous receiving system, and is as shown in Figure 5, comprising:
Parsing module is used for after receiving said RTP packet, decoding the data of said a plurality of Streaming Medias, and encapsulates the timestamp in the RTP packet of each Streaming Media, and said timestamp uses the clock time that initial value is identical, precision is identical;
Synchronous processing module is used for according to the timestamp of the RTP packet of said each Streaming Media of encapsulation the data of said a plurality of Streaming Medias being carried out Synchronous Processing.
In order to realize said method, the embodiment of the invention also provides a kind of a plurality of Media Stream synchronous receiving system, comprises above-mentioned receiving system and above-mentioned dispensing device.Initial value is identical, precision is identical (promptly has identical stepping through using at transmitting terminal; The benchmark of tolerance is identical) clock time beat the scheme of timestamp for the RTP packet, thereby adopt same benchmark, same linear module when having realized the timestamp computing of each Streaming Media.Only need carry out simple comparison process at receiving terminal, can realize Synchronization Control said timestamp.
In order to further specify embodiment of the present invention, at this being that a concrete application example describes synchronously to the media stream that comprises an audio stream and a video flowing.
Application example
Of Fig. 6, use the flow chart of the RTP packing of generation of the present invention NTP time stamp.In other application examples, also can use other clock times and beat timestamp, as long as can guarantee that the initial value of said clock time is identical, precision is identical.
Because audio frequency and video RTP packing hockets, so the number of steps among this figure does not have strict time order and function order.
Step S601: define an initial NTP time;
Step S602: define a total duration of audio frequency, initial value is made as 0;
Step S603: define a total duration of video, initial value is made as 0;
Step S604: judging whether frame of video reads finishes, if not, then get into step S605; If then get into step S609;
Step S605: read frame of video;
Step S606: the duration that obtains this frame of video;
Step S607: frame of video is broken into the RTP bag, and the NTP time in RTP packet header adds the frame of video length overall for the NTP initial value;
Step S608: the total duration of video adds the duration of this frame of video, returns step S604;
Step S609: the frame of video RTP end of packing;
Step S610: judging whether audio frame reads finishes, if, then get into step S617, otherwise, step S611 got into;
Step S611: read audio frame;
Step S612: the duration that obtains this audio frame;
Step S613: this audio frame is broken into the RTP bag;
Step S614: judge whether this frame is first frame of RTP bag, if, then get into step S615, otherwise, step S616 got into;
Step S615: the NTP time of this RTP is the total duration that the initial NTP time adds audio frequency;
Step S616: the total duration of audio frequency adds the duration of this audio frame, returns step S610;
Step S617: frame RTP packing frequently finishes.
Of Fig. 7, use application example of the present invention to use the NTP time stamp to carry out the flow chart of synchronous client process.Because resolving, audio frequency and video hocket, so the number of steps among this figure does not have strict time order and function order.
Step S701: resolve the RTP video packets of receiving;
Step S702: will resolve the rear video data and carry out the framing operation, and be combined into a complete frame of video;
Step S703: frame of video is sent into buffering area;
Step S704: the said frame of video of decoding;
Step S705: decoded video data is sent into buffering area;
Step S706: resolve the RTP audio pack of receiving;
Step S707: audio frame is sent into decoding buffer zone;
Step S708: the said audio frame of decoding;
Step S709: decoded voice data is sent into the sync buffering district;
Step S710: carry out audio-visual synchronization output according to the SBSN time stamp in said RTP video packets and the said RTP audio pack;
Step S711: play.
The above only is a preferred implementation of the present invention, should be pointed out that so long as the time that the time stamp of RTP is transformed into the same linear module of same benchmark all in protection scope of the present invention.For the technical staff in present technique field, under the prerequisite that does not break away from the principle of the invention, can also make some improvement and retouching, these improvement and retouching also should be regarded as protection scope of the present invention.

Claims (10)

1. the method that a plurality of Media Streams are synchronous is characterized in that, comprising:
Transmitting terminal uses the clock time that initial value is identical, precision is identical to beat timestamp as the RTP packet when a plurality of Media Streams are encapsulated as real time transport protocol RTP packet.
2. the method for claim 1 is characterized in that:
Receiving terminal decodes the data of said a plurality of Streaming Medias after receiving said RTP packet, and according to the timestamp in the RTP packet of each Streaming Media of encapsulation the data of said a plurality of Streaming Medias is carried out Synchronous Processing.
3. the method for claim 1 is characterized in that, said transmitting terminal is beaten timestamp for the RTP packet and comprised:
Said transmitting terminal is respectively the data duration information that said each Media Stream safeguards that an initial value is identical, and according to the packed data duration of said each Streaming Media, upgrades the data duration information of said each Media Stream;
Said transmitting terminal is being a Media Stream when beating timestamp, and the value of timestamp is set to the data duration information sum of initial value and this Media Stream of said clock time.
4. method as claimed in claim 3 is characterized in that:
Said a plurality of Media Stream is video flowing and/or audio stream;
Said transmitting terminal is after obtaining frame of video and breaking into RTP bag, for this RTP bag is beaten timestamp from video flowing;
Said transmitting terminal is after obtaining audio frame and breaking into RTP bag from audio stream, and this audio frame is just beaten timestamp for this RTP wraps when being the first frame in the said RTP bag.
5. the dispensing device that a plurality of Media Streams are synchronous is characterized in that, comprising:
Beat the timestamp module, be used for when a plurality of Media Streams are encapsulated as real time transport protocol RTP packet, using the clock time that initial value is identical, precision is identical to beat timestamp as the RTP packet;
Sending module is used for the RTP packet of stamping said timestamp is sent.
6. device as claimed in claim 5 is characterized in that, the said timestamp module of beating comprises first computing module and second computing module, wherein:
Said first computing module is used to be respectively the data duration information that said each Media Stream safeguards that an initial value is identical, and according to the packed data duration of said each Streaming Media, upgrades the data duration information of said each Media Stream;
Said second computing module is used for being a Media Stream when beating timestamp that the value of timestamp is set to the data duration information sum of initial value and this Media Stream of said clock time.
7. device as claimed in claim 6 is characterized in that, said a plurality of Media Streams are video flowing and/or audio stream, wherein:
Said second computing module is after obtaining frame of video and breaking into RTP bag, for this RTP bag is beaten timestamp from video flowing;
Said second computing module, after obtaining audio frame from audio stream and breaking into RTP bag, and this audio frame is just beaten timestamp for this RTP wraps when being the first frame in the said RTP bag.
8. the receiving system that a plurality of Media Streams are synchronous is characterized in that, comprising:
Parsing module is used for after receiving said RTP packet, decoding the data of said a plurality of Streaming Medias, and encapsulates the timestamp in the RTP packet of each Streaming Media, and said timestamp uses the clock time that initial value is identical, precision is identical;
Synchronous processing module is used for according to the timestamp of the RTP packet of said each Streaming Media of encapsulation the data of said a plurality of Streaming Medias being carried out Synchronous Processing.
9. the system that a plurality of Media Streams are synchronous is characterized in that, comprising:
Transmitting terminal when a plurality of Media Streams are encapsulated as real time transport protocol RTP packet, uses the clock time that initial value is identical, precision is identical to beat timestamp as the RTP packet;
Receiving terminal after receiving said RTP packet, decodes the data of said a plurality of Streaming Medias, and according to the timestamp in the RTP packet of each Streaming Media of encapsulation the data of said a plurality of Streaming Medias is carried out Synchronous Processing.
10. system as claimed in claim 9 is characterized in that, said transmitting terminal is beaten timestamp for the RTP packet and comprised:
Said transmitting terminal is respectively the data duration information that said each Media Stream safeguards that an initial value is identical, and according to the packed data duration of said each Streaming Media, upgrades the data duration information of said each Media Stream;
Said transmitting terminal is being a Media Stream when beating timestamp, and the value of timestamp is set to the data duration information sum of initial value and this Media Stream of said clock time.
CN201110005073.6A 2011-01-11 2011-01-11 The method of a kind of multiple Media Streams synchronization, Apparatus and system Expired - Fee Related CN102595202B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201110005073.6A CN102595202B (en) 2011-01-11 The method of a kind of multiple Media Streams synchronization, Apparatus and system
PCT/CN2012/070159 WO2012094974A1 (en) 2011-01-11 2012-01-10 Method, device and system for synchronizing media streams

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110005073.6A CN102595202B (en) 2011-01-11 The method of a kind of multiple Media Streams synchronization, Apparatus and system

Publications (2)

Publication Number Publication Date
CN102595202A true CN102595202A (en) 2012-07-18
CN102595202B CN102595202B (en) 2016-12-14

Family

ID=

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106302378A (en) * 2015-05-25 2017-01-04 飞思卡尔半导体公司 For flowing multimedia system and the method for synchronization
CN107517401A (en) * 2016-06-15 2017-12-26 成都鼎桥通信技术有限公司 multimedia data playing method and device
CN108092914A (en) * 2016-11-21 2018-05-29 华为技术有限公司 Network traffic load equalization scheduling method and device
CN111787365A (en) * 2020-07-17 2020-10-16 易视腾科技股份有限公司 Multi-channel audio and video synchronization method and device
CN112671696A (en) * 2019-10-16 2021-04-16 华为技术有限公司 Message transmission method and device, computer equipment and computer storage medium
CN115174979A (en) * 2022-06-20 2022-10-11 阿里巴巴(中国)有限公司 Streaming media transmission network, transmission control method, device, equipment and storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030185245A1 (en) * 2002-04-01 2003-10-02 Samsung Electronics Co., Ltd Apparatus for generating and restoring RTP packet and method thereof
JP2005286449A (en) * 2004-03-29 2005-10-13 Sanyo Electric Co Ltd Data transmitter
CN1738437A (en) * 2004-06-22 2006-02-22 Lg电子株式会社 Synchronizing video/audio of mobile communication terminal
CN1801803A (en) * 2004-12-31 2006-07-12 华为技术有限公司 Method for producing RTP time stamp on gateway
CN101123611A (en) * 2007-09-25 2008-02-13 中兴通讯股份有限公司 A transmission method for stream media data
CN101179484A (en) * 2006-11-09 2008-05-14 华为技术有限公司 Method and system of synchronizing different media stream
CN101282482A (en) * 2008-05-04 2008-10-08 中兴通讯股份有限公司 Apparatus, system and method for synchronously playing video data and audio data
US20090295992A1 (en) * 2005-10-21 2009-12-03 Thomson Licensing Method and Apparatus for Audio and Video Synchronization Timestamp Rollover Correction

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030185245A1 (en) * 2002-04-01 2003-10-02 Samsung Electronics Co., Ltd Apparatus for generating and restoring RTP packet and method thereof
JP2005286449A (en) * 2004-03-29 2005-10-13 Sanyo Electric Co Ltd Data transmitter
CN1738437A (en) * 2004-06-22 2006-02-22 Lg电子株式会社 Synchronizing video/audio of mobile communication terminal
CN1801803A (en) * 2004-12-31 2006-07-12 华为技术有限公司 Method for producing RTP time stamp on gateway
US20090295992A1 (en) * 2005-10-21 2009-12-03 Thomson Licensing Method and Apparatus for Audio and Video Synchronization Timestamp Rollover Correction
CN101179484A (en) * 2006-11-09 2008-05-14 华为技术有限公司 Method and system of synchronizing different media stream
CN101123611A (en) * 2007-09-25 2008-02-13 中兴通讯股份有限公司 A transmission method for stream media data
CN101282482A (en) * 2008-05-04 2008-10-08 中兴通讯股份有限公司 Apparatus, system and method for synchronously playing video data and audio data

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
杨蓓: "流媒体系统中音视频同步机制的设计与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106302378A (en) * 2015-05-25 2017-01-04 飞思卡尔半导体公司 For flowing multimedia system and the method for synchronization
CN106302378B (en) * 2015-05-25 2020-09-22 恩智浦美国有限公司 Multimedia system and method for stream synchronization
CN107517401A (en) * 2016-06-15 2017-12-26 成都鼎桥通信技术有限公司 multimedia data playing method and device
CN108092914A (en) * 2016-11-21 2018-05-29 华为技术有限公司 Network traffic load equalization scheduling method and device
CN112671696A (en) * 2019-10-16 2021-04-16 华为技术有限公司 Message transmission method and device, computer equipment and computer storage medium
CN112671696B (en) * 2019-10-16 2023-05-12 华为技术有限公司 Message transmission method, device, computer equipment and computer storage medium
CN111787365A (en) * 2020-07-17 2020-10-16 易视腾科技股份有限公司 Multi-channel audio and video synchronization method and device
CN115174979A (en) * 2022-06-20 2022-10-11 阿里巴巴(中国)有限公司 Streaming media transmission network, transmission control method, device, equipment and storage medium
CN115174979B (en) * 2022-06-20 2023-12-29 阿里巴巴(中国)有限公司 Streaming media transmission network, transmission control method, device, equipment and storage medium

Also Published As

Publication number Publication date
WO2012094974A1 (en) 2012-07-19

Similar Documents

Publication Publication Date Title
JP7260687B2 (en) Transmission method and transmission device
JP4668515B2 (en) Metadata transmission apparatus and method synchronized with multimedia contents
CN108141455B (en) Deadline signaling for streaming of media data
US6947448B2 (en) Data transmission device and data transmission method
JP6302274B2 (en) Transmitting apparatus and receiving apparatus
CN103414957A (en) Method and device for synchronization of audio data and video data
van der Meer et al. RTP payload format for transport of MPEG-4 elementary streams
CN102057687B (en) Synchronization of media stream components
US20150181003A1 (en) Method and apparatus for transmitting and receiving packets in hybrid transmission service of mmt
CN101605252B (en) Method and system for converting program stream into transport stream
CN112106382B (en) Method, apparatus, and storage medium for retrieving media data
CN107925781A (en) Sending method, method of reseptance, dispensing device and reception device
CN101951387A (en) Method and device for transmitting stream media
TW201633759A (en) Transport interface for multimedia and file transport
KR100916505B1 (en) Method and apparatus for svc video and aac audio synchronization using ntp
CN101729908B (en) Synchronous multiplexing method for video and audio of transmission stream
CN101222616A (en) Transmission processing method for MPEG conveying stream in video-on-demand service
WO2012034442A1 (en) System and method for realizing synchronous transmission and reception of scalable video coding service
EP1936908A1 (en) Method, apparatus and data container for transferring high resolution audio/video data in a high speed IP network
KR20130009670A (en) Packet transmission apparatus and method, and packet reception apparatus and method in mmt system
CN100464586C (en) MPEG1 file real-time playing method based on IP STB
JP2010531087A (en) System and method for transmission of constant bit rate streams
WO2012094974A1 (en) Method, device and system for synchronizing media streams
Seo et al. A new timing model design for MPEG Media Transport (MMT)
CN103905922A (en) Streaming media protocol encapsulation method and device based on http protocol

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20161214

Termination date: 20210111

CF01 Termination of patent right due to non-payment of annual fee