CN102761776A - Video and audio synchronizing method of P2PVoD (peer-to-peer video on demand) system based on SVC (scalable video coding) - Google Patents

Video and audio synchronizing method of P2PVoD (peer-to-peer video on demand) system based on SVC (scalable video coding) Download PDF

Info

Publication number
CN102761776A
CN102761776A CN2012102715071A CN201210271507A CN102761776A CN 102761776 A CN102761776 A CN 102761776A CN 2012102715071 A CN2012102715071 A CN 2012102715071A CN 201210271507 A CN201210271507 A CN 201210271507A CN 102761776 A CN102761776 A CN 102761776A
Authority
CN
China
Prior art keywords
video
audio
svc
layer
burst
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2012102715071A
Other languages
Chinese (zh)
Other versions
CN102761776B (en
Inventor
唐朝伟
袁杨
罗秀红
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chongqing University
Original Assignee
Chongqing University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chongqing University filed Critical Chongqing University
Priority to CN201210271507.1A priority Critical patent/CN102761776B/en
Publication of CN102761776A publication Critical patent/CN102761776A/en
Application granted granted Critical
Publication of CN102761776B publication Critical patent/CN102761776B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention provides a video and audio synchronizing method based on an SVC (scalable video coding) P2PVoD (peer-to-peer video on demand) system, belonging to the field of multimedia internet application. The video and audio synchronizing method comprises the following steps of: compositing an audio stream into an SVC video stream, combining an SVC video coding feature with a Bittorrent protocol, and improving a package formate of a Torrent file, thus ensuring SVC-based video and audio data transmission synchronization; utilizing a manner combining cache-based quality self adapting with sequential downloading to ensure the video and audio play smoothness and improve the video and audio play quality, and realizing scheduling synchronization of an SVC video and audio segment; and taking an SVC video as a main media stream and an audio as a secondary media stream, updating and synchronizing a clock according to playing time information of the video segment during playing, and synchronously decoding and playing corresponding audio segments by the clock, thus realizing play synchronization of video and audio medias.

Description

Video-audio synchronization method based on the P2PVoD system of SVC
Technical field
The present invention relates to a kind of video-audio synchronization method, relate in particular to a kind of P2PVoD system video-audio synchronization method based on SVC.
Background technology
Along with the extensive utilization of broadband connections, the multimedia application on the Internet becomes and becomes more and more popular.It is to solve P2P system bandwidth capacity marked change and the most promising scheme of the various problem of user terminal isomery that SVC (Scalable Video Coding, scalable video) is applied to P2P (Peer-to-Peer, reciprocity Internet technology) stream media system.SVC allows " video sequence once encode multiple decoding "; Compound spatial and temporal resolution and Hi-Fi video flowing can be provided; Therefore it can satisfy the P2P system carries out the code check adjustment according to available bandwidth requirement effectively; The spatial and temporal resolution that can adapt to different user terminals simultaneously well is for the user provides better service quality and user experience.
For a complete P2P stream media system based on SVC, very crucial synchronously between SVC video flowing and the corresponding audio stream, the quality of method for synchronous design will directly influence the overall performance of system.Look the synchronously relevant with people's audio visual characteristic of audio frequency, Fig. 1 is divided into 5 grades with people's audio visual subjective assessment: fall behind in the 90ms scope to sound at the leading 20ms of sound, people do not feel the variation of view quality, and this scope is called as can not perceive scope; Generally the descend scope that is less than 0.5 grade of subjective assessment is called and can perceives scope, corresponding to the leading 45ms of sound to falling behind 125ms; The scope that subjective assessment decline is less than 1.5 grades is thought tolerance interval, extremely falls behind 185ms corresponding to the leading 90ms of sound; The audio offset of looking in tolerance interval is considered to synchronous, but when subjective assessment descends above 1.5 grades, looks audio offset and will be considered to asynchronous.
Though the P2P stream media system look the solution that audio sync has had comparative maturity, the relatively more classical video-audio synchronization method based on RTP/RTCP that has encapsulates timestamp method for synchronous etc. with MPEG-4.But the video-audio synchronization method of present P2P stream media system also is not suitable for the audio sync demand of looking based on the P2P stream media system of SVC.
The audio sync of looking based on the RTP/RTCP agreement is main Media Stream with audio frequency generally; Video is from Media Stream; At receiving terminal based on same time shaft; Judge synchronized relation through the audio frame play relatively recently and the reproduction time label of frame of video, frame of video is taked repetition or the method that abandons realizes looking audio sync and controls.The advantage of this method for synchronous is the encapsulated delivery and the Synchronization Control of looking audio frequency by the RTP/RTCP agreement, and technical application is extensively ripe.But the shortcoming of this method only suitable single layer video stream that is it; Still the SVC video flowing is not packaged at present the method for RTP packet; And this method need handle each RTCP SR (Sender Reports) message, and concerning this multi-layer video stream of SVC, algorithm complex is higher.
MPEG-4 encapsulation synchronously with based on the syncsort of RTP/RTCP agreement seemingly, also stab service time and look audio sync control.The timing model of MPEG-4 decoded time stamp (DTS) that has been its I, B, P frame definition and generated time stab (CTS); DTS is used for representing decode time; When the moment of DTS arrives, the decoding of addressed location will begin, and CTS representes that synthesis unit begins performance constantly at this.Because the performance time of each frame of video has all been postponed one-period T with respect to decode time, so the decoding of respective audio frame also will be postponed one-period.The remarkable advantage of this method is that MP4 can change according to the network bandwidth, and the mode that abandons B frame or P frame through selectivity solves the network congestion problem, simultaneously heterogeneous terminals is had adaptability preferably, particularly portable terminal.But the same only shortcoming of suitable single layer video stream that exists of this method, the complexity that the SVC video flowing is encapsulated MP4 into is higher.
This shows that at present the video flowing based on the P2P stream media system of SVC still needs absolute coding, independent transmission, independent decoding and broadcast with corresponding audio stream, simultaneously each stage is carried out Synchronization Control and could obtain good result of broadcast at last.
Summary of the invention
The present invention is intended to solve the technical problem that exists in the prior art, has proposed a kind of P2PVoD system video-audio synchronization method based on SVC to special innovation, has realized the transmitting synchronous based on the video/audio of SVC.
In order to realize above-mentioned purpose of the present invention, the invention provides a kind of video-audio synchronization method of the P2PVoD system based on SVC, it is characterized in that may further comprise the steps:
S1, server end with the SVC video flowing according to etc. duration be divided into N video blocks; This N video blocks is divided into M layer video burst respectively; Wherein the video burst of the bottom constitutes the video elementary layer in each video blocks, and each the layer video burst on it all constitutes a video enhancement layer; Audio stream is divided into N audio layer burst according to the duration such as grade; With this audio layer following one deck as this video elementary layer; Look audio frequency layering slicing files thereby generate; Wherein the SVC video flowing unit duration that is divided into video blocks equates with the unit duration that audio stream is divided into the audio layer burst, and N, M are the integer greater than zero;
S2, at server end, this relevant information of looking audio frequency layering slicing files is packaged in the Torrent file;
Audio frequency layering burst download thread is looked in S3, startup, and client is downloaded this Torrent file from server end, from this Torrent file, extracts this and looks the relevant information initializes video decoder and the audio decoder of audio frequency layering slicing files;
This looks audio frequency layering slicing files S4, client downloads;
S5, client look SVC video data and voice data in the audio frequency layering slicing files with this and are sent to corresponding Video Decoder and audio decoder respectively and decode, and the video/audio behind the broadcast decoder.Realized transmitting synchronous thus based on the video/audio of SVC.
At said step S1 sound intermediate frequency layer file by name 0; The setting space hierarchy number is D IdWith quality hierarchy number Q Id, then each hierarchical file of SVC video is called DQ Id=1+16 * D Id+ Q Id, be convenient to client identification and look each layer file in the audio frequency layering slicing files.
The encapsulation format of this Torrent file has increased length, video elementary layer and each video enhancement layer identifier of audio sample rate, video frame rate, video frame number, the contained video frame number of each GOP, the contained GOP number of each video burst, SVC hierarchy number, audio layer file size, audio layer file identifier, video elementary layer and each video enhancement layer, has respectively looked audio frequency branch leaf length and look in the audio frequency burst sum at least one in said step S2, and wherein this SVC hierarchy number comprises the SVC video number of plies and the audio frequency number of plies.Encapsulation format to the Torrent file improves, and has guaranteed the synchronous transmission of SVC video-voice frequency flow.
In said step S4 according to the current play time t of distance PlayDistance, will look audio frequency layering slicing files by near to far being divided into high priority zone, medium priority zone and low priority zone, it is downloaded priority and reduces gradually.Video/audio is downloaded in the prioritization zone in order, has guaranteed to look the fluency of voice playing.
Before audio frequency is looked in broadcast, in the high priority zone towards play time t PlayThe part video/audio of one side is cached in download buffer, and the buffering duration of this part video/audio is PRE TIME, the download number of plies is L Pre, wherein should download number of plies L PreConfirm and comprise audio layer and video elementary layer at least according to the network bandwidth., broadcast confirms to download number of plies L before looking audio frequency according to the initial network bandwidth Pre, cushion video/audio, guaranteed the fluency of video playback.
Client periodically judges whether to confirm again the download number of plies L of this download buffer Pre: setting the duration of waiting to play video/audio in the download buffer is t Buf=t Schedule-t Play, t wherein ScheduleRepresent current download time point, t PlayRepresent current play time, work as t BufRepresent when being decreased to lower threshold that downloading rate is slow excessively,, reduce and download a layer video enhancement layer burst, download the number of plies and subtract a L in order to guarantee to look the fluency of voice playing Pre--; Work as t BufRepresent when increasing to upper limit threshold that downloading rate is too high,, confirm to increase and download a layer video enhancement layer burst, download the number of plies and add a L in order to improve the quality of looking voice playing Pre++.Realized the quality adaptation adjusting of download buffer, further guaranteed to look the fluency of voice playing, and improved the quality of looking voice playing.
The downloading order of video/audio is in this higher order precedence zone: audio layer burst, video elementary layer burst, video enhancement layer burst.
Said step S5 is made up of following steps:
Set and play the reproduction time that synchronised clock Tvideo comes the recording of video fragment data;
Start the video playback thread, the video fragment data that from download buffer, obtains buffer memory carries out decodes and plays, and update playing synchronised clock Tvideo;
Start the voice playing thread, the audio frequency fragment data that from download buffer, obtains buffer memory according to broadcast synchronised clock Tvideo carries out decodes and plays, thereby it is synchronous to realize looking voice playing.
With the SVC video is main Media Stream, and audio frequency is from Media Stream, with the reproduction time information updating synchronised clock of video burst, and with this clock synchronization decoding with play the respective audio burst, thereby realizes that the broadcast of looking between audio frequency media is synchronous during broadcast.
In sum, owing to adopted technique scheme, the invention has the beneficial effects as follows:
1, audio stream is compound in the SVC video flowing, and SVC video coding characteristic is combined with the Bittorrent agreement, improve the encapsulation format of Torrent file, thereby guaranteed transmitting synchronous based on the video/audio of SVC;
2, the mode that adopts quality adaptation and progressive download based on buffer memory to combine has guaranteed to look the fluency of voice playing and can improve the quality of looking voice playing, and it is synchronous to have realized that SVC looks the scheduling of audio frequency burst;
3, be main Media Stream with the SVC video, audio frequency is from Media Stream, with the reproduction time information updating synchronised clock of video burst, and with this clock synchronization decoding with play the respective audio burst, thereby realizes that the broadcast of looking between audio frequency media is synchronous during broadcast.
Additional aspect of the present invention and advantage part in the following description provide, and part will become obviously from the following description, or recognize through practice of the present invention.
Description of drawings
Above-mentioned and/or additional aspect of the present invention and advantage obviously with are easily understood becoming the description of embodiment from combining figs, wherein:
Fig. 1 looks audio sync standard sketch map;
Fig. 2 is based on the structural representation of looking audio frequency layering slicing files in the P2PVoD system of SVC;
Fig. 3 is based on the encapsulation format sketch map of Torrent file in the P2PVoD system of SVC;
Fig. 4 is based on the sketch map in three priority zone in the P2PVoD system of SVC.
Embodiment
Describe embodiments of the invention below in detail, the example of said embodiment is shown in the drawings, and wherein identical from start to finish or similar label is represented identical or similar elements or the element with identical or similar functions.Be exemplary through the embodiment that is described with reference to the drawings below, only be used to explain the present invention, and can not be interpreted as limitation of the present invention.
The present invention has realized that mainly SVC in the P2PVoD system (Scalable Video Coding, scalable video) looks the transmitting synchronous of audio frequency and plays synchronous.
This video-audio synchronization method based on the P2PVoD system of SVC is made up of following steps:
S1, in order to realize the synchronous transmission of SVC video flowing and audio stream; As shown in Figure 2; At server end the SVC video flowing is divided into N video blocks Video Chunk according to duration such as grade (such as according to each second); This N video blocks Video Chunk is divided into M layer video burst Video Piece respectively; Wherein the video burst Video Piece of the bottom constitutes the video elementary layer among each video blocks Video Chunk, and each the layer video burst Video Piece on it all constitutes a video enhancement layer; Audio stream is divided into N audio layer burst according to duration such as grade (such as according to each second); With this audio layer burst following one deck as the video elementary layer; Look audio frequency layering slicing files thereby generate; Wherein the SVC video flowing unit duration that is divided into video blocks equates with the unit duration that audio stream is divided into the audio layer burst, and N, M are the integer greater than zero.
Look each layer file in the audio frequency layering slicing files for the ease of client identification, the present invention adopts following mode that each layer file named.Audio layer file by name 0; The setting space hierarchy number is D IdWith quality hierarchy number Q Id, then each hierarchical file of SVC video is called DQ Id=1+16 * D Id+ Q Id
As shown in Figure 2, in the present embodiment SVC video flowing is divided into four layers, to the video elementary layer, its file is called DQ Id=1+16 * D Id+ Q Id=1+16 * 0+0=1;
To video first enhancement layer, its file is called DQ Id=1+16 * D Id+ Q Id=1+16 * 0+1=2;
To video second enhancement layer, its file is called DQ Id=1+16 * D Id+ Q Id=1+16 * 1+0=17;
To video the 3rd enhancement layer, its file is called DQ Id=1+16 * D Id+ Q Id=1+16 * 1+1=18.
S2, at server end, this relevant information of looking audio frequency layering slicing files is packaged in the Torrent file.With the Torrent files classes of BitTorrent protocol definition seemingly, also be to adopt the BenCode coded format to encode based on the Torrent file of the P2PVoD system of SVC.But owing to have difference based on P2PVoD system and the traditional P 2PVoD system of SVC at aspects such as data characteristics and slicing algorithms, in order to guarantee the synchronous transmission of SVC video-voice frequency flow, the present invention improves the encapsulation format of Torrent file.As shown in Figure 3; The encapsulation format of this Torrent file has increased audio sample rate, video frame rate, video frame number, each GOP (Group of Pictures; The picture group) contained video frame number, the contained GOP number of each video burst, SVC hierarchy number (comprising SVC video layer and audio layer), audio layer file size, audio layer file identifier, each video segmentation length and identifier (such as video elementary layer file size, video elementary layer file identifier, the video first enhancement layer files length, the video first enhancement layer files identifier etc.), respectively look audio frequency branch leaf length and look in the audio frequency burst sum at least one, wherein the long measure among the figure is a byte.
Audio frequency layering burst download thread is looked in S3, startup, and client is downloaded the Torrent file from server, from this Torrent file, extracts this and looks the relevant information initializes video decoder and the audio decoder of audio frequency layering slicing files.
This looks audio frequency layering slicing files S4, client downloads, and the play time t current according to distance PlayDistance will look audio frequency layering slicing files by near to far being divided into high, medium and low three priority zones, and it is downloaded priority and reduces gradually.
As shown in Figure 4, the duration of high priority zone (HP:High Priortiy) is h and apart from play time t PlayRecently.Before audio frequency is looked in broadcast, in the high priority zone towards play time t PlayThe part video/audio of one side is cached in download buffer, and the buffering duration of this part video/audio is PRE TIME(such as 5s, 10s etc.), the download number of plies are L Pre, wherein should buffering duration PRE TIMECan artificially set initial download number of plies L according to actual conditions PreCan confirm and comprise audio layer and video elementary layer at least according to the initial network bandwidth.
Owing to look when audio frequency layering slicing files is play and to comprise audio layer burst and video elementary layer burst; And the effect of video enhancement layer burst is to improve the quality of looking voice playing; And the network bandwidth can constantly change in downloading the process that SVC looks audio frequency; In order to guarantee to look the fluency and the quality of voice playing, client periodically judges whether to confirm again the download number of plies L of this download buffer PreSetting the duration of waiting to play video/audio in the download buffer is t Buf=t Schedule-t Play, t wherein ScheduleRepresent current download time point, t PlayRepresent current play time.t BufChange along with the variation of downloading rate, when downloading speed greater than playback rate, t BufConstantly increase; When downloading speed less than playback rate, t BufConstantly reduce.Work as t BufRepresent when being decreased to lower threshold that downloading rate is slow excessively,, on the basis of downloading audio layer burst and video elementary layer burst at least, reduce and download a layer video enhancement layer burst, download the number of plies and subtract a L in order to guarantee to look the smooth playing of audio frequency Pre--; Work as t BufRepresent when increasing to upper limit threshold that downloading rate is too high,, on the basis that is no more than the video segmentation sum, increase and download a layer video enhancement layer burst, download the number of plies and add a L in order to improve the quality of looking voice playing Pre++.
Owing to the audio layer burst that waits duration is much littler than video elementary layer burst; And the speed of download of audio layer burst is faster; Therefore the downloading order of video/audio is in the high level priority zone: audio layer burst, video elementary layer burst, video enhancement layer burst.
The duration in medium priority zone (MP:Middle Priority) is u and the current play time t of distance PlayNearer, it is placed in the middle to download priority.As time goes on can get into the high priority zone, therefore be the emergency of broadcast and a compromise on the rare burst diffusion velocity, adopts minimum preferential (Rarest-First) strategy of layering.
Low priority zone (LP:Low Priority) is residue dispatcher-controlled territory and the current play time t of distance PlayFarthest, download priority is minimum.In order to improve the speed of rare burst diffusion, adopt minimum preferential (Rarest-First) strategy of layering equally.
S5, client client look SVC video data and voice data in the audio frequency layering slicing files with this and are sent to corresponding Video Decoder and audio decoder respectively and decode, and the video/audio behind the broadcast decoder.Because the video based on the P2PVoD system of SVC is the SVC video flowing, when occurring playing when asynchronous, can relate to several layer videos to the adjustment of video; Deal with more complicated, and audio frequency has only one deck, deal with more simple and reliable; And people as shown in Figure 1 lag behind image to sound to be ahead of the image tolerance than sound many, so the present invention is main Media Stream with the SVC video flowing when audio frequency is looked in broadcast; Audio stream is from Media Stream, and isochronous audio flows to the SVC video flowing.The more complicated because the video blocks Video Chunk of SVC video flowing decodes; Have certain delay from decoded video blocks Video Chunk to playing this video blocks Video Chunk; The corresponding audio frequency burst Audio Piece that decodes is then very fast; Therefore the present invention is with the lock in time as decoding respective audio burst Audio Piece time of the video blocks Video Chunk that decodes, but with the lock in time as decoding diaphone frequency division sheet Audio Piece time of beginning displaying video piece Video Chunk.Concrete steps are:
At first, set the reproduction time that broadcast synchronised clock Tvideo comes the recording of video fragment data;
Then, start the video playback thread, the video fragment data that from download buffer, obtains buffer memory carries out decodes and plays, and update playing synchronised clock Tvideo;
At last, start the voice playing thread, the audio frequency fragment data that from download buffer, obtains buffer memory according to broadcast synchronised clock Tvideo carries out decodes and plays, thereby it is synchronous to realize looking voice playing.
In the description of this specification, the description of reference term " embodiment ", " some embodiment ", " example ", " concrete example " or " some examples " etc. means the concrete characteristic, structure, material or the characteristics that combine this embodiment or example to describe and is contained at least one embodiment of the present invention or the example.In this manual, the schematic statement to above-mentioned term not necessarily refers to identical embodiment or example.And concrete characteristic, structure, material or the characteristics of description can combine with suitable manner in any one or more embodiment or example.
Although illustrated and described embodiments of the invention; Those having ordinary skill in the art will appreciate that: under the situation that does not break away from principle of the present invention and aim, can carry out multiple variation, modification, replacement and modification to these embodiment, scope of the present invention is limited claim and equivalent thereof.

Claims (8)

1. video-audio synchronization method based on the P2PVoD system of SVC is characterized in that may further comprise the steps:
S1, server end with the SVC video flowing according to etc. duration be divided into N video blocks; This N video blocks is divided into M layer video burst respectively; Wherein the video burst of the bottom constitutes the video elementary layer in each video blocks, and each the layer video burst on it all constitutes a video enhancement layer; Audio stream is divided into N audio layer burst according to the duration such as grade; With this audio layer following one deck as this video elementary layer; Look audio frequency layering slicing files thereby generate; Wherein the SVC video flowing unit duration that is divided into video blocks equates with the unit duration that audio stream is divided into the audio layer burst, and N, M are the integer greater than zero;
S2, at server end, this relevant information of looking audio frequency layering slicing files is packaged in the Torrent file;
Audio frequency layering burst download thread is looked in S3, startup, and client is downloaded this Torrent file from server end, from this Torrent file, extracts this and looks the relevant information initializes video decoder and the audio decoder of audio frequency layering slicing files;
This looks audio frequency layering slicing files S4, client downloads;
S5, client look SVC video data and voice data in the audio frequency layering slicing files with this and are sent to corresponding Video Decoder and audio decoder respectively and decode, and the video/audio behind the broadcast decoder.
2. the video-audio synchronization method of the P2PVoD system based on SVC according to claim 1 is characterized in that: at said step S1 sound intermediate frequency layer file by name 0; The setting space hierarchy number is D IdWith quality hierarchy number Q Id, then each hierarchical file of SVC video is called DQ Id=1+16 * D Id+ Q Id
3. the video-audio synchronization method of the P2PVoD system based on SVC according to claim 1; It is characterized in that: the encapsulation format of this Torrent file has increased length, video elementary layer and each video enhancement layer identifier of audio sample rate, video frame rate, video frame number, the contained video frame number of each GOP, the contained GOP number of each video burst, SVC hierarchy number, audio layer file size, audio layer file identifier, video elementary layer and each video enhancement layer, has respectively looked audio frequency branch leaf length and look in the audio frequency burst sum at least one in said step S2, and wherein this SVC hierarchy number comprises the SVC video number of plies and the audio frequency number of plies.
4. the video-audio synchronization method of the P2PVoD system based on SVC according to claim 1 is characterized in that: the play time t current according to distance in said step S4 PlayDistance, will look audio frequency layering slicing files by near to far being divided into high priority zone, medium priority zone and low priority zone, it is downloaded priority and reduces gradually.
5. the video-audio synchronization method of the P2PVoD system based on SVC according to claim 4 is characterized in that: before audio frequency is looked in broadcast, in the high priority zone towards play time t PlayThe part video/audio of one side is cached in download buffer, and the buffering duration of this part video/audio is PRE TIME, the download number of plies is L Pre, wherein should download number of plies L PreConfirm and comprise audio layer and video elementary layer at least according to the network bandwidth.
6. the video-audio synchronization method of the P2PVoD system based on SVC according to claim 5, it is characterized in that: client periodically judges whether to confirm again the download number of plies L of this download buffer Pre: setting the duration of waiting to play video/audio in the download buffer is t Buf=t Schedule-t Play, t wherein ScheduleRepresent current download time point, t PlayRepresent current play time, work as t BufRepresent when being decreased to lower threshold that downloading rate is slow excessively,, reduce and download a layer video enhancement layer burst, download the number of plies and subtract a L in order to guarantee to look the fluency of voice playing Pre--; Work as t BufRepresent when increasing to upper limit threshold that downloading rate is too high,, confirm to increase and download a layer video enhancement layer burst, download the number of plies and add a L in order to improve the quality of looking voice playing Pre++.
7. according to the video-audio synchronization method of any one described P2PVoD system based on SVC in the claim 4~6, it is characterized in that: the downloading order of video/audio is in this higher order precedence zone: audio layer burst, video elementary layer burst, video enhancement layer burst.
8. the video-audio synchronization method of the P2PVoD system based on SVC according to claim 1, it is characterized in that: said step S5 is made up of following steps:
Set and play the reproduction time that synchronised clock Tvideo comes the recording of video fragment data;
Start the video playback thread, the video fragment data that from download buffer, obtains buffer memory carries out decodes and plays, and update playing synchronised clock Tvideo;
Start the voice playing thread, the audio frequency fragment data that from download buffer, obtains buffer memory according to broadcast synchronised clock Tvideo carries out decodes and plays, thereby it is synchronous to realize looking voice playing.
CN201210271507.1A 2012-08-01 2012-08-01 Video and audio synchronizing method of P2PVoD (peer-to-peer video on demand) system based on SVC (scalable video coding) Expired - Fee Related CN102761776B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210271507.1A CN102761776B (en) 2012-08-01 2012-08-01 Video and audio synchronizing method of P2PVoD (peer-to-peer video on demand) system based on SVC (scalable video coding)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210271507.1A CN102761776B (en) 2012-08-01 2012-08-01 Video and audio synchronizing method of P2PVoD (peer-to-peer video on demand) system based on SVC (scalable video coding)

Publications (2)

Publication Number Publication Date
CN102761776A true CN102761776A (en) 2012-10-31
CN102761776B CN102761776B (en) 2015-01-14

Family

ID=47056072

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210271507.1A Expired - Fee Related CN102761776B (en) 2012-08-01 2012-08-01 Video and audio synchronizing method of P2PVoD (peer-to-peer video on demand) system based on SVC (scalable video coding)

Country Status (1)

Country Link
CN (1) CN102761776B (en)

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103338386A (en) * 2013-07-10 2013-10-02 航天恒星科技有限公司 Audio and video synchronization method based on simplified timestamps
CN103428555A (en) * 2013-08-06 2013-12-04 乐视网信息技术(北京)股份有限公司 Multi-media file synthesis method, system and application method
CN103607667A (en) * 2013-11-15 2014-02-26 南京云川信息技术有限公司 A slicing method for SVC video files in a P2P streaming media system
CN105491435A (en) * 2014-10-01 2016-04-13 索尼公司 Sign language window using picture-in-picture
CN105491436A (en) * 2014-10-01 2016-04-13 索尼公司 Selective sign language location
CN105657495A (en) * 2015-12-31 2016-06-08 南京邮电大学 Synchronized playing method and device for multiple intelligent terminals
CN105898501A (en) * 2015-12-30 2016-08-24 乐视致新电子科技(天津)有限公司 Video display method, video player and electronic device
CN106790226A (en) * 2017-01-15 2017-05-31 刘小艳 A kind of Portable audio frequency and video teaching interaction equipment
CN107094141A (en) * 2017-04-28 2017-08-25 山东交通学院 SVC video files burst and dispatching method in a kind of P2P stream media systems
CN109121019A (en) * 2018-09-12 2019-01-01 中国地质大学(武汉) For the dynamic buffering dispatching method of SVC-DASH VOD system, equipment and storage equipment
CN109121020A (en) * 2018-09-12 2019-01-01 中国地质大学(武汉) For the dynamic buffering dispatching method of SVC-DASH VOD system, equipment and storage equipment
CN109121018A (en) * 2018-09-12 2019-01-01 中国地质大学(武汉) For the dynamic buffering dispatching method of SVC-DASH VOD system, equipment and storage equipment
CN109714628A (en) * 2018-12-29 2019-05-03 广州华多网络科技有限公司 Method, apparatus, equipment, storage medium and the system of playing audio-video
CN112152995A (en) * 2020-08-19 2020-12-29 鹏城实验室 SVC video transmission method based on intelligent edge and intelligent edge
CN112153322A (en) * 2020-09-23 2020-12-29 北京字跳网络技术有限公司 Data distribution method, device, equipment and storage medium
CN113709412A (en) * 2020-05-21 2021-11-26 中国电信股份有限公司 Live stream processing method, device and system and computer readable storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101262443A (en) * 2008-05-12 2008-09-10 陶忠伟 A self-adapted real-time transmission method for mobile phone stream media
CN101951506A (en) * 2010-09-17 2011-01-19 中兴通讯股份有限公司 System and method for realizing synchronous transmitting and receiving of scalable video coding service
CN102469072A (en) * 2010-11-08 2012-05-23 华为技术有限公司 Streaming media service method and system, and client

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101262443A (en) * 2008-05-12 2008-09-10 陶忠伟 A self-adapted real-time transmission method for mobile phone stream media
CN101951506A (en) * 2010-09-17 2011-01-19 中兴通讯股份有限公司 System and method for realizing synchronous transmitting and receiving of scalable video coding service
CN102469072A (en) * 2010-11-08 2012-05-23 华为技术有限公司 Streaming media service method and system, and client

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
胡庆宝等: "基于H.264/SVC的P2P内容分发系统设计与实现", 《电子技术应用》, 31 July 2012 (2012-07-31), pages 1 - 3 *

Cited By (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103338386B (en) * 2013-07-10 2016-01-13 航天恒星科技有限公司 Based on the audio and video synchronization method simplifying timestamp
CN103338386A (en) * 2013-07-10 2013-10-02 航天恒星科技有限公司 Audio and video synchronization method based on simplified timestamps
CN103428555A (en) * 2013-08-06 2013-12-04 乐视网信息技术(北京)股份有限公司 Multi-media file synthesis method, system and application method
CN103428555B (en) * 2013-08-06 2018-08-10 乐视网信息技术(北京)股份有限公司 A kind of synthetic method of multimedia file, system and application process
CN103607667A (en) * 2013-11-15 2014-02-26 南京云川信息技术有限公司 A slicing method for SVC video files in a P2P streaming media system
CN105491435B (en) * 2014-10-01 2019-02-22 索尼公司 Using the sign language window of picture-in-picture
CN105491435A (en) * 2014-10-01 2016-04-13 索尼公司 Sign language window using picture-in-picture
CN105491436A (en) * 2014-10-01 2016-04-13 索尼公司 Selective sign language location
WO2017113717A1 (en) * 2015-12-30 2017-07-06 乐视控股(北京)有限公司 Video playing method, video player, and electronic device
CN105898501A (en) * 2015-12-30 2016-08-24 乐视致新电子科技(天津)有限公司 Video display method, video player and electronic device
CN105657495A (en) * 2015-12-31 2016-06-08 南京邮电大学 Synchronized playing method and device for multiple intelligent terminals
CN105657495B (en) * 2015-12-31 2018-10-19 南京邮电大学 A kind of more intelligent terminal synchronous broadcast methods and equipment
CN106790226A (en) * 2017-01-15 2017-05-31 刘小艳 A kind of Portable audio frequency and video teaching interaction equipment
CN107094141B (en) * 2017-04-28 2020-06-02 山东交通学院 SVC video file slicing and scheduling method in P2P streaming media system
CN107094141A (en) * 2017-04-28 2017-08-25 山东交通学院 SVC video files burst and dispatching method in a kind of P2P stream media systems
CN109121018A (en) * 2018-09-12 2019-01-01 中国地质大学(武汉) For the dynamic buffering dispatching method of SVC-DASH VOD system, equipment and storage equipment
CN109121019A (en) * 2018-09-12 2019-01-01 中国地质大学(武汉) For the dynamic buffering dispatching method of SVC-DASH VOD system, equipment and storage equipment
CN109121020A (en) * 2018-09-12 2019-01-01 中国地质大学(武汉) For the dynamic buffering dispatching method of SVC-DASH VOD system, equipment and storage equipment
CN109121018B (en) * 2018-09-12 2020-01-17 中国地质大学(武汉) Dynamic cache scheduling method, device and storage device for SVC-DASH on-demand system
CN109121020B (en) * 2018-09-12 2020-01-17 中国地质大学(武汉) Dynamic cache scheduling method, device and storage device for SVC-DASH on-demand system
CN109121019B (en) * 2018-09-12 2020-01-17 中国地质大学(武汉) Dynamic cache scheduling method, device and storage device for SVC-DASH on-demand system
CN109714628A (en) * 2018-12-29 2019-05-03 广州华多网络科技有限公司 Method, apparatus, equipment, storage medium and the system of playing audio-video
CN109714628B (en) * 2018-12-29 2021-08-03 广州方硅信息技术有限公司 Method, device, equipment, storage medium and system for playing audio and video
CN113709412A (en) * 2020-05-21 2021-11-26 中国电信股份有限公司 Live stream processing method, device and system and computer readable storage medium
CN112152995A (en) * 2020-08-19 2020-12-29 鹏城实验室 SVC video transmission method based on intelligent edge and intelligent edge
WO2022037228A1 (en) * 2020-08-19 2022-02-24 鹏城实验室 Svc video transmission method based on intelligent edge, and intelligent edge
CN112152995B (en) * 2020-08-19 2022-09-13 鹏城实验室 SVC video transmission method based on intelligent edge and intelligent edge
CN112153322A (en) * 2020-09-23 2020-12-29 北京字跳网络技术有限公司 Data distribution method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN102761776B (en) 2015-01-14

Similar Documents

Publication Publication Date Title
CN102761776B (en) Video and audio synchronizing method of P2PVoD (peer-to-peer video on demand) system based on SVC (scalable video coding)
CN107409234B (en) Streaming based on file format using DASH format based on LCT
US10681397B2 (en) System and method for seamless switching through buffering
KR101927145B1 (en) Decoder and method at the decoder for synchronizing the rendering of contents received through different networks
CN105453580B (en) Method of reseptance, sending method, reception device and sending device
CN107925781B (en) Transmission method, reception method, transmission device, and reception device
US7382796B2 (en) System and method for seamless switching through buffering
KR101717555B1 (en) Media content transceiving method and transceiving apparatus using same
US20200112753A1 (en) Service description for streaming media data
CN107005729A (en) The coffret transmitted for multimedia and file
JP5452495B2 (en) System and method for early start of audio / video rendering
EP3095247B1 (en) Robust live operation of dash
JP2018532334A (en) Deadline signaling for streaming media data
CN102342127A (en) Method and apparatus for video coding and decoding
EP3304848B1 (en) Method for initiating a transmission of a streaming content delivered to a client device and access point for implementing this method
EP2580917B1 (en) Receiver and method at the receiver for enabling channel change with a single decoder
JP7338745B2 (en) receiver

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20150114

Termination date: 20150801

EXPY Termination of patent right or utility model