CN1972407A - A video and audio synchronization playing method for mobile multimedia broadcasting - Google Patents
A video and audio synchronization playing method for mobile multimedia broadcasting Download PDFInfo
- Publication number
- CN1972407A CN1972407A CN 200610157163 CN200610157163A CN1972407A CN 1972407 A CN1972407 A CN 1972407A CN 200610157163 CN200610157163 CN 200610157163 CN 200610157163 A CN200610157163 A CN 200610157163A CN 1972407 A CN1972407 A CN 1972407A
- Authority
- CN
- China
- Prior art keywords
- reproduction time
- audio
- video
- unit
- initial
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
This invention relates to one method for multi-media broadcast audio frequency play, which sets one initial play time section to express channel data initial time and comprises the following steps: cutting visual and audio frequency into multiple units; according to each initial play time and whole channel data initial play time difference, in each visual and audio section heads setting one relative play time section to record each visual and audio unit play relative time difference.
Description
Technical field
The present invention relates to a kind of synchronous broadcast method of Mobile Multimedia Broadcasting real-time video audio stream, belong to Mobile Multimedia Broadcasting or technical field of mobile TV.
Background technology
Mobile Multimedia Broadcasting is a kind of Play Technique for Multimedia of rising in recent years.By hand-held terminal, under the situation of high-speed mobile, can watch TV.Terminal receives programme by wireless protocols, and can select the channel of oneself having the right to watch, thereby can accept to select the multi-medium data of channel, is implemented in and sees TV on the portable terminal.
The aerial data of mobile multimedia broadcast system emission are divided into different channels, and the data of each channel comprise again: three types of video, audio frequency and data, and require terminal can guarantee the synchronous playing of video/audio, promptly labial is synchronous.
In the multimedia broadcasting field, the synchronous method of existing assurance labial has 2 kinds, a kind of is TS (transport stream) agreement, system is when sending the video/audio data, stamp and represent timestamp (PTS), allow terminal know the reproduction time of each section video/audio data, with the time of the broadcast that guarantees terminal can be identical with the chronological order of encoder.Another kind method is RTP (RTP), and system stamps a timestamp for each packet, and terminal is play in strict accordance with timestamp, thereby it is synchronous to guarantee that video/audio is play.Above-mentioned 2 kinds of methods have all adopted the length of 4 bytes, and this patent has adopted the length of 2 bytes, has reduced taking of bandwidth, and have reached above-mentioned 2 kinds of time precisions that method is same by 4 public byte parameters.
Above-mentioned TS method is adapted at using in the circuit network, also is fit to unidirectional broadcast network and uses, but because each TS bag is smaller, brought the expense of the bigger network bandwidth.Above-mentioned RTP method is smaller to the expense of the network bandwidth, but only is adapted at using in the IP network, is not suitable for using in the mobile broadcast network.
Summary of the invention
The objective of the invention is at above-mentioned the deficiencies in the prior art, provide a kind of method that can in mobile broadcast network, realize the video/audio synchronous playing, and efficiency of transmission will be higher than present TS mode.
A kind of Mobile Multimedia Broadcasting is looked the method that audio sync is play, and comprises the steps:
(1) the make a start minimum value of the reproduction time of getting each video unit in the multiplexed sub frame and audio unit obtains initial reproduction time;
(2) the initial reproduction time of the reproduction time of the interior video data of calculating video unit and multiplexed sub frame head is poor, be recorded in the relative reproduction time field of each video unit correspondence in the video paragraph header, the initial reproduction time of the reproduction time of voice data and multiplexed sub frame head is poor in the calculating audio unit, be recorded in the relative reproduction time field of each audio unit correspondence in the sound intermediate frequency paragraph header, initial reproduction time is placed in the subframe head, and subframe head, video-frequency band and audio section are formed multiplexed sub frame;
(3) multiplexed sub frame transmits by broadcast channel;
(4) terminal receives multiplexed sub frame;
(5) terminal is taken out initial reproduction time from the subframe head of multiplexed sub frame, from the video paragraph header, take out the relative reproduction time of video unit, calculate the corresponding relative reproduction time of initial reproduction time and this video unit and, obtain the actual play time of this video unit, terminal is taken out the relative reproduction time of audio unit from the audio frequency paragraph header, calculate the corresponding relative reproduction time of initial reproduction time and this audio unit and, obtain the actual play time of this audio unit;
(6) terminal is according to each video unit of step (5) and the actual play time of audio unit, in order the data in each video unit of synchronous playing and the audio unit.
Wherein, the length of described initial reproduction time field is 4 bytes.
Wherein, the length of described relative reproduction time field is 2 bytes.
Wherein, described initial reproduction time is produced by encoder with relative reproduction time.
Wherein, the initial value of described initial reproduction time is a random value, and along with the variation of time can constantly increase.
Method of the present invention is by the initial reproduction time of a channel of Mobile Multimedia Broadcasting and the relative reproduction time of each video unit and audio unit, calculate the reproduction time of each video, audio unit, can in mobile broadcast network, realize the function of video/audio synchronous playing, and efficiency of transmission is higher, can guarantee that the user can normally watch program, can save certain bandwidth simultaneously.
Description of drawings
Fig. 1 is the schematic diagram of the initial reproduction time of Media Stream subframe head.
Fig. 2 is the schematic diagram of the relative reproduction time of video data unit.
Fig. 3 is the schematic diagram of the relative reproduction time of audio data unit.
Embodiment
As shown in Figure 1, the data of 1 channel are made up of subframe head, video-frequency band, audio section and data segment, wherein the subframe header is the public information of a channel, some control informations and media description information have been comprised, an initial reproduction time of field is wherein arranged, be used for representing the initial reproduction time of this channel data.
As shown in Figure 2, video data comprises a video paragraph header and a plurality of video unit, and the video paragraph header is the public information that is used for writing down this video data, cuts apart with synchronous head between each video unit.
According to the initial reproduction time of each video unit and the relative time error of the initial reproduction time of this whole channel data, in each video paragraph header,, write down the broadcast relative time error of each video unit for each video unit is provided with a relative reproduction time information.Like this, the actual play time of each video unit be exactly initial reproduction time with the relative reproduction time of this video unit and, for example:
The relative reproduction time of the reproduction time of video unit 1=initial reproduction time+video unit 1
The relative reproduction time of the reproduction time of video unit N=initial reproduction time+video unit N
As shown in Figure 3, voice data comprises an audio frequency paragraph header and a plurality of audio unit, and the audio frequency paragraph header is the public information that is used for writing down this voice data, cuts apart with synchronous head between each audio unit.
According to the initial reproduction time of each audio unit and the relative time error of the initial reproduction time of this whole channel data, in each audio frequency paragraph header,, write down the broadcast relative time error of each audio unit for each audio unit is provided with a relative reproduction time information.Like this, the actual play time of each video unit be exactly initial reproduction time with the relative reproduction time of this audio unit and, for example:
The relative reproduction time of the reproduction time of audio unit 1=initial reproduction time+audio unit 1
The relative reproduction time of the reproduction time of audio unit N=initial reproduction time+audio unit N
Transmitting terminal will record initial reproduction time information and send with the channel data of relative reproduction time information, after receiving terminal receives this channel data, at first from this channel subframe head, take out initial reproduction time information, determine the initial reproduction time of this channel data; From the video paragraph header of this channel, take out the relative reproduction time information of each video unit again, from the audio frequency paragraph header of this channel, take out the relative reproduction time information of each audio unit, according to above-mentioned algorithm, with the relative reproduction time of each video unit respectively with initial reproduction time addition, determine the actual play time of each video unit; With the relative reproduction time of each audio unit respectively with initial reproduction time addition, determine the actual play time of each audio unit.
Receiving terminal is play according to each video unit determined and the actual play time of audio unit, has just realized looking audio sync and has play.
Initial reproduction time is produced by encoder with relative reproduction time, and initial value can be a random value, but along with the variation of time can constantly increase, time requirement is accurate.Unit is second, can be as accurate as microsecond, to take care of yourself the accuracy of broadcast.
Method by this patent, can reduce the length of each video unit of expression, audio unit reproduction time, for example, the reproduction time of original each video, audio unit all needs 4 byte representations, by using the method for this patent, have only initial reproduction time to need 4 byte numbers to represent reproduction time, remaining relative reproduction time only need just can be represented the reproduction time of each video, audio unit with 2 bytes.Can save certain bandwidth like this.
Below by an example the present invention is described further.In this example, 1 channel has the speed of 256Kbit/s, and frame frequency is 25 frames, and audio frequency is every 50ms sampling 1 time, and like this, video unit is 25, and audio unit has 20.
Send the data of 1 channel each second, from the subframe head, obtain earlier initial reproduction time.
From the video paragraph header, take out the relative reproduction time of 25 video units, when displaying video, the relative reproduction time of the reproduction time of m frame=initial reproduction time+m video unit.
From the audio frequency paragraph header, take out the relative reproduction time of 20 audio units, when audio plays, the relative reproduction time of the reproduction time of m frame=initial reproduction time+m audio unit.
The reproduction time that terminal calculates according to aforesaid way just can be realized the synchronous playing of video/audio.
Claims (5)
1. a Mobile Multimedia Broadcasting is looked the method that audio sync is play, and comprises the steps:
(1) the make a start minimum value of the reproduction time of getting each video unit in the multiplexed sub frame and audio unit obtains initial reproduction time;
(2) the initial reproduction time of the reproduction time of the interior video data of calculating video unit and multiplexed sub frame head is poor, be recorded in the relative reproduction time field of each video unit correspondence in the video paragraph header, the initial reproduction time of the reproduction time of voice data and multiplexed sub frame head is poor in the calculating audio unit, be recorded in the relative reproduction time field of each audio unit correspondence in the sound intermediate frequency paragraph header, initial reproduction time is placed in the subframe head, and subframe head, video-frequency band and audio section are formed multiplexed sub frame;
(3) multiplexed sub frame transmits by broadcast channel;
(4) terminal receives multiplexed sub frame;
(5) terminal is taken out initial reproduction time from the subframe head of multiplexed sub frame, from the video paragraph header, take out the relative reproduction time of video unit, calculate the corresponding relative reproduction time of initial reproduction time and this video unit and, obtain the actual play time of this video unit, terminal is taken out the relative reproduction time of audio unit from the audio frequency paragraph header, calculate the corresponding relative reproduction time of initial reproduction time and this audio unit and, obtain the actual play time of this audio unit;
(6) terminal is according to each video unit of step (5) and the actual play time of audio unit, in order the data in each video unit of synchronous playing and the audio unit.
2. Mobile Multimedia Broadcasting as claimed in claim 1 is looked the method that audio sync is play, and it is characterized in that: the length of described initial reproduction time field is 4 bytes.
3. Mobile Multimedia Broadcasting as claimed in claim 1 is looked the method that audio sync is play, and it is characterized in that: the length of described relative reproduction time field is 2 bytes.
4. Mobile Multimedia Broadcasting as claimed in claim 1 is looked the method that audio sync is play, and it is characterized in that: described initial reproduction time is produced by encoder with relative reproduction time.
5. Mobile Multimedia Broadcasting as claimed in claim 1 is looked the method that audio sync is play, and it is characterized in that: the initial value of described initial reproduction time is a random value, and along with the variation of time can constantly increase.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2006101571636A CN100450163C (en) | 2006-11-30 | 2006-11-30 | A video and audio synchronization playing method for mobile multimedia broadcasting |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2006101571636A CN100450163C (en) | 2006-11-30 | 2006-11-30 | A video and audio synchronization playing method for mobile multimedia broadcasting |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1972407A true CN1972407A (en) | 2007-05-30 |
| CN100450163C CN100450163C (en) | 2009-01-07 |
Family
ID=38112956
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2006101571636A Expired - Fee Related CN100450163C (en) | 2006-11-30 | 2006-11-30 | A video and audio synchronization playing method for mobile multimedia broadcasting |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100450163C (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2009137972A1 (en) * | 2008-05-13 | 2009-11-19 | 中兴通讯股份有限公司 | A method and system for transmitting video-audio in same stream and the corresponding receiving method and device |
| CN101102171B (en) * | 2007-06-21 | 2010-06-09 | 中兴通讯股份有限公司 | A data processing method of mobile multi-media terminal |
| CN101272500B (en) * | 2008-05-14 | 2010-12-01 | 中兴通讯股份有限公司 | Transmission method and system for video/audio data flow |
| CN101453653B (en) * | 2007-12-07 | 2011-01-05 | 中兴通讯股份有限公司 | Method for spreading digital audio and video parameter set |
| WO2011107017A1 (en) * | 2010-03-02 | 2011-09-09 | 中兴通讯股份有限公司 | Method and system for media synchronization |
| CN102215429A (en) * | 2010-04-01 | 2011-10-12 | 安凯(广州)微电子技术有限公司 | Recording method for mobile TV |
| CN102510488A (en) * | 2011-11-04 | 2012-06-20 | 北京播思软件技术有限公司 | Method and device for synchronizing video and audio by utilizing broadcasting characteristics |
| CN103491430A (en) * | 2012-06-12 | 2014-01-01 | 联想(北京)有限公司 | Streaming media data processing method and electronic device |
| CN103747366A (en) * | 2013-12-23 | 2014-04-23 | 乐视致新电子科技（天津）有限公司 | A method for displaying the playing process of a HLS media file and a player |
| CN104618673A (en) * | 2015-01-20 | 2015-05-13 | 武汉烽火众智数字技术有限责任公司 | NVR (Network Video Recorder)-based multi-channel video synchronous playback control method and device |
| CN111757144A (en) * | 2020-04-13 | 2020-10-09 | 湖南化工职业技术学院（湖南工业高级技工学校） | Network computer multimedia video playing method and system |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3197766B2 (en) * | 1994-02-17 | 2001-08-13 | 三洋電機株式会社 | MPEG audio decoder, MPEG video decoder and MPEG system decoder |
| US5959684A (en) * | 1997-07-28 | 1999-09-28 | Sony Corporation | Method and apparatus for audio-video synchronizing |
| TWI353759B (en) * | 2004-05-13 | 2011-12-01 | Qualcomm Inc | Synchronization of audio and video data in a wirel |
| CN1816156A (en) * | 2005-02-02 | 2006-08-09 | 乐金电子（惠州）有限公司 | Synchronous broadcasting method of multi-media data |
-
2006
- 2006-11-30 CN CNB2006101571636A patent/CN100450163C/en not_active Expired - Fee Related
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101102171B (en) * | 2007-06-21 | 2010-06-09 | 中兴通讯股份有限公司 | A data processing method of mobile multi-media terminal |
| CN101453653B (en) * | 2007-12-07 | 2011-01-05 | 中兴通讯股份有限公司 | Method for spreading digital audio and video parameter set |
| WO2009137972A1 (en) * | 2008-05-13 | 2009-11-19 | 中兴通讯股份有限公司 | A method and system for transmitting video-audio in same stream and the corresponding receiving method and device |
| CN101272500B (en) * | 2008-05-14 | 2010-12-01 | 中兴通讯股份有限公司 | Transmission method and system for video/audio data flow |
| WO2011107017A1 (en) * | 2010-03-02 | 2011-09-09 | 中兴通讯股份有限公司 | Method and system for media synchronization |
| CN102215429B (en) * | 2010-04-01 | 2013-04-17 | 安凯(广州)微电子技术有限公司 | Recording method for mobile TV |
| CN102215429A (en) * | 2010-04-01 | 2011-10-12 | 安凯(广州)微电子技术有限公司 | Recording method for mobile TV |
| CN102510488A (en) * | 2011-11-04 | 2012-06-20 | 北京播思软件技术有限公司 | Method and device for synchronizing video and audio by utilizing broadcasting characteristics |
| CN102510488B (en) * | 2011-11-04 | 2015-11-11 | 播思通讯技术（北京）有限公司 | A kind of utilize broadcast characteristic to carry out audio-visual synchronization method and device |
| CN103491430A (en) * | 2012-06-12 | 2014-01-01 | 联想(北京)有限公司 | Streaming media data processing method and electronic device |
| CN103747366A (en) * | 2013-12-23 | 2014-04-23 | 乐视致新电子科技（天津）有限公司 | A method for displaying the playing process of a HLS media file and a player |
| CN103747366B (en) * | 2013-12-23 | 2018-04-27 | 乐视致新电子科技（天津）有限公司 | A kind of display methods and player of HLS playback of media files progress |
| CN104618673A (en) * | 2015-01-20 | 2015-05-13 | 武汉烽火众智数字技术有限责任公司 | NVR (Network Video Recorder)-based multi-channel video synchronous playback control method and device |
| CN104618673B (en) * | 2015-01-20 | 2018-05-01 | 武汉烽火众智数字技术有限责任公司 | A kind of multichannel video recording synchronized playback control method and device based on NVR |
| CN111757144A (en) * | 2020-04-13 | 2020-10-09 | 湖南化工职业技术学院（湖南工业高级技工学校） | Network computer multimedia video playing method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN100450163C (en) | 2009-01-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100450163C (en) | A video and audio synchronization playing method for mobile multimedia broadcasting | |
| CN1960485B (en) | Method for playing back video and audio synchronistically in mobile media broadcast | |
| JP4131703B2 (en) | Clock-based time slicing | |
| CN101202613B (en) | Terminal for clock synchronization | |
| CN101902649A (en) | Audio-video synchronization control method based on H.264 standard | |
| CN100579238C (en) | Synchronous playing method for audio and video buffer | |
| JP3666625B2 (en) | Data recording method and data recording apparatus | |
| CN101827271B (en) | Audio and video synchronized method and device as well as data receiving terminal | |
| KR100482287B1 (en) | Apparatus and method for injection of synchronized stream data in digital broadcasting environment | |
| CN109565466B (en) | Lip sound synchronization method and device among multiple devices | |
| WO2008028367A1 (en) | A method for realizing multi-audio tracks for mobile mutilmedia broadcasting system | |
| CN101282482A (en) | Apparatus, system and method for synchronously playing video data and audio data | |
| CN103888813A (en) | Audio and video synchronization realization method and system | |
| CN108111872B (en) | Audio live broadcasting system | |
| CN106658135B (en) | A kind of audio and video playing method and device | |
| WO2011113315A1 (en) | Stream media live service system and implementation method thereof | |
| CN101419827A (en) | Method for synchronzing audio and video data in avi file | |
| CN100518074C (en) | Method for implementing multiple video strems in mobile multimedia broadcast | |
| CN1972454A (en) | Mobile multimedia broadcasting real-time traffic flow packaging method | |
| CN109040818B (en) | Audio and video synchronization method, storage medium, electronic equipment and system during live broadcasting | |
| DE602004009560T2 (en) | Data transmission synchronization scheme | |
| CN100473171C (en) | Clock synchronizing method in broadcast network | |
| JP6957186B2 (en) | Information processing equipment, information processing methods, programs, and recording medium manufacturing methods | |
| CN100544448C (en) | A kind of clock system of mobile multimedia network | |
| JP5092493B2 (en) | Reception program, reception apparatus, communication system, and communication method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20090107 Termination date: 20151130 |
|
| EXPY | Termination of patent right or utility model |