CN103648011A - Audio and video synchronization device and method based on HLS protocol - Google Patents
Audio and video synchronization device and method based on HLS protocol Download PDFInfo
- Publication number
- CN103648011A CN103648011A CN201310637560.3A CN201310637560A CN103648011A CN 103648011 A CN103648011 A CN 103648011A CN 201310637560 A CN201310637560 A CN 201310637560A CN 103648011 A CN103648011 A CN 103648011A
- Authority
- CN
- China
- Prior art keywords
- played
- video data
- timestamp
- audio
- audio signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 230000005236 sound signal Effects 0.000 claims abstract description 112
- 230000001360 synchronised effect Effects 0.000 claims description 29
- 238000001514 detection method Methods 0.000 claims description 22
- 230000008569 process Effects 0.000 claims description 17
- 238000012937 correction Methods 0.000 claims description 15
- 230000014759 maintenance of location Effects 0.000 abstract 1
- 238000012856 packing Methods 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000002045 lasting effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Television Signal Processing For Recording (AREA)
- Synchronisation In Digital Transmission Systems (AREA)
Abstract
The invention provides an audio and video synchronization device and method based on an HLS protocol. The method comprises: after receiving a synchronization request, adding a synchronization mark to audio and video data obtained first; demultiplexing the audio and video data into audio data and video data, and updating timestamps of the audio data and / or video data based on the synchronization mark; decoding the audio data and video data and outputting an audio signal to be played and a video signal to be played; detecting whether the timestamps carried in the audio signal to be played and the video signal to be played are consistent, and sending the synchronization request when the timestamps carried in the audio signal to be played and the video signal to be played are not consistent; and controlling the audio signal to be played and the video signal to be played to be output synchronously based on the synchronization mark. Through the technical scheme in the invention, the problem of picture or sound retention due to continuous nonsynchronization of the audio and video is solved.
Description
Technical field
The present invention relates to Technology of Multimedia Stream Playing field, relate in particular to a kind of audio-visual synchronization apparatus and method based on HLS agreement.
Background technology
HLS(Http live streaming) agreement is the streaming media agreement based on HTML (Hypertext Markup Language) Http that Apple realizes, HLS agreement is carried out segmentation by the huge continuous media data of capacity, the small documents that is divided into One's name is legion transmits, catered to the file transfer of web page server, adopt the lightweight index file of a continuous renewal to control download and the broadcasting of cutting apart rear little media file, can realize the live and program request of Streaming Media.HLS agreement is being paid the utmost attention to the automatic switchover of supporting code check under the prerequisite of fluency, is widely used at present by each large video website.
By HLS agreement, multi-medium data is divided into audio, video data ts file and index m3u8 file after treatment, and is present on Cloud Server.In fact m3u8 file is a kind of organizational form of file group, and the form by audio, video data ts file with playlist organizes together for player downloads and broadcasting.In m3u8 file, generally include a plurality of uniform resource position mark URL of audio, video data ts file.Player obtains after m3u8 file, and then downloads corresponding audio, video data according to URL wherein.For the audio, video data of having downloaded, please refer to Fig. 1, by this audio, video data demultiplexing, be first voice data and video data, then decode this voice data and video data, export audio signal to be played and vision signal to be played, finally export audio signal to be played and vision signal to be played, to realize the broadcasting of audio, video data.
Due to the complicated factor of Internet Transmission, in the process of playing at above-mentioned audio, video data, Voice & Video synchronization accuracy is uncertain, affected by abnormal conditions larger.Therefore, can produce due to audio signal to be played and the lasting picture that can not synchronously bring of vision signal or sound delay to be played.
To sum up, a kind of audio and video synchronization method based on HLS agreement and device urgently provide.
Summary of the invention
In view of this, the invention provides a kind of audio-visual synchronization apparatus and method based on HLS agreement, solve that audio signal to be played and vision signal to be played continue picture asynchronous and that bring or sound is detained.
Particularly, described device comprises mark module, demultiplexing module, decoder module, detection module and the playing module arranging in turn, wherein:
Described mark module, for after receiving synchronization request, for the first audio, video data getting adds sync mark, and notifies playing module;
Described demultiplexing module, for being voice data and video data by described audio, video data demultiplexing, and according to described sync mark, upgrades the timestamp of voice data and/or video data;
Described decoder module, for described voice data and the video data of decoding, exports audio signal to be played and vision signal to be played;
Described detection module, whether consistent with the timestamp carrying in vision signal to be played for detection of described audio signal to be played, when the timestamp that carries is inconsistent, send synchronization request to mark module in audio signal to be played and vision signal to be played;
Described playing module, for synchronously exporting according to the described sync mark described audio signal to be played of control and vision signal to be played.
Further, described detection module, if when the timestamp carrying for described audio signal to be played and vision signal to be played is all inconsistent within the predetermined time, send synchronization request to mark module.
Further, the process of the timestamp of described demultiplexing module renewal voice data and/or video data comprises: described demultiplexing module is according to the timestamp of video data described in the timestamp correction of described voice data.
Further, the process of the timestamp of described demultiplexing module renewal voice data and/or video data comprises: described demultiplexing module is according to the timestamp of voice data described in the timestamp correction of described audio, video data and video data.
Further, described playing module controls described audio signal to be played according to described sync mark and the synchronous process of exporting of vision signal to be played comprises: audio signal to be played or the vision signal to be played of carrying sync mark are stored in to output buffer area, wait receives after the vision signal to be played or audio signal to be played of carrying sync mark, controls to carry the audio signal to be played of sync mark and vision signal to be played is synchronously exported.
Described method comprises:
After receiving synchronization request, for the first audio, video data getting adds sync mark;
By described audio, video data demultiplexing, be voice data and video data, and according to described sync mark, upgrade the timestamp of voice data and/or video data;
Decode described voice data and video data, export audio signal to be played and vision signal to be played;
Detect described audio signal to be played whether consistent with the timestamp carrying in vision signal to be played, when the timestamp that carries is inconsistent, send synchronization request in audio signal to be played and vision signal to be played;
According to the described sync mark described audio signal to be played of control and vision signal to be played, synchronously export.
Further, described method also comprises:
If when the timestamp carrying in described audio signal to be played and vision signal to be played is all inconsistent within the predetermined time, send synchronization request.
Further, the process of the timestamp of described renewal voice data and/or video data comprises: according to the timestamp of video data described in the timestamp correction of described voice data.
Further, the process of the timestamp of described renewal voice data and/or video data comprises: according to the timestamp of voice data described in the timestamp correction of described audio, video data and video data.
Further, according to the described sync mark described audio signal to be played of control and the synchronous process of exporting of vision signal to be played, comprise: audio signal to be played or the vision signal to be played of carrying sync mark are stored in to output buffer area, wait receives after the vision signal to be played or audio signal to be played of carrying sync mark, controls to carry the audio signal to be played of sync mark and vision signal to be played is synchronously exported.
By above description, can be found out, the present invention is by detecting the timestamp of audio signal to be played and vision signal to be played, and then detect audio signal to be played and vision signal to be played whether output is synchronous, in audio signal to be played and vision signal to be played, export when asynchronous, for treating that the audio, video data of demultiplexing adds sync mark.According to this sync mark, control audio signal to be played and vision signal to be played is synchronously exported, when demultiplexing, upgrade the timestamp of voice data and video data simultaneously, synchronous to reach follow-up audio signal to be played and vision signal timestamp to be played, and then export synchronous object.Therefore, solved the problem that audio signal to be played and vision signal to be played continue asynchronous brought picture or sound delay.
Accompanying drawing explanation
Fig. 1 is audio, video data playing flow figure in prior art of the present invention;
Fig. 2 is the structural representation of an embodiment of the present invention middle pitch video synchronization device;
Fig. 3 is the structural representation of TS bag in an embodiment of the present invention;
Fig. 4 is the flow chart of audio and video synchronization method in an embodiment of the present invention.
Embodiment
For making object, technical scheme and the advantage of the embodiment of the present invention clearer, below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is clearly described, obviously, described embodiment is the present invention's part embodiment, rather than whole embodiment.Embodiment based in the present invention, those of ordinary skills, not making the every other embodiment obtaining under creative work prerequisite, belong to the scope of protection of the invention.
For the problems referred to above of the prior art, the invention provides a kind of audio-visual synchronization device based on HLS agreement.For further illustrating the present invention, provide the following example:
Embodiment mono-
Please refer to Fig. 2, the audio-visual synchronization device based on HLS agreement in the present embodiment is provided with in turn: mark module 110, demultiplexing module 120, decoder module 130, detection module 140 and playing module 150.
Playing module 150, for controlling audio signal to be played according to above-mentioned sync mark and vision signal to be played is synchronously exported.
The present invention arranges detection module 140, for the timestamp carrying according to audio signal to be played and vision signal to be played judge audio signal to be played and vision signal to be played whether synchronous.Nonsynchronous time, send synchronization request to mark module 110, mark module 110 is after receiving this synchronization request, for the first audio, video data next getting adds sync mark.This sync mark be used for into 150 promptings of demultiplexing module 120 and playing module synchronous.
In a kind of concrete realization of the present embodiment, demultiplexing module 120, according to sync mark, is upgraded the timestamp of voice data and/or video data, in order to revise voice data and the nonsynchronous problem of video data timestamp.Playing module 150 controls audio signal to be played according to above-mentioned sync mark and vision signal to be played is exported synchronous.
By above description, can be found out, the present invention is by detecting the timestamp of audio signal to be played and vision signal to be played, and then detect audio signal to be played and vision signal to be played whether output is synchronous, in audio signal to be played and vision signal to be played, export when asynchronous, for treating that the audio, video data of demultiplexing adds sync mark.According to this sync mark, control audio signal to be played and vision signal to be played is synchronously exported, when demultiplexing, upgrade the timestamp of voice data and video data simultaneously, synchronous to reach follow-up audio signal to be played and vision signal timestamp to be played, and then export synchronous object.Therefore, solved the problem that audio signal to be played and vision signal to be played continue asynchronous brought picture or sound delay.
Embodiment bis-
The present embodiment provides a kind of more comprehensively audio-visual synchronization device based on HLS agreement, and this device is disposed with mark module, demultiplexing module, decoder module, detection module and playing module.Wherein:
Mark module, for after receiving synchronization request, for the first audio, video data getting adds sync mark, and notifies playing module.
Demultiplexing module, for being voice data and video data by audio, video data demultiplexing, and according to above-mentioned sync mark, upgrades the timestamp of voice data and/or video data.
Decoder module, for above-mentioned voice data and the video data of decoding, exports audio signal to be played and vision signal to be played.
Detection module, whether consistent with the timestamp carrying in vision signal to be played for detection of above-mentioned audio signal to be played, when the timestamp that carries is inconsistent, send synchronization request to mark module in above-mentioned audio signal to be played and vision signal to be played.
Playing module, for controlling audio signal to be played according to above-mentioned sync mark and vision signal to be played is synchronously exported.
Compared to prior art, the present invention arranges detection module between decoder module and playing module, whether consistent with the timestamp carrying in vision signal to be played for detection of audio signal to be played, and then whether the output that detects audio signal to be played and vision signal to be played is synchronous, and inconsistent time, by detection module, send synchronization request to mark module at audio signal to be played and vision signal timestamp to be played.In order to coordinate detection module, the present invention also arranged mark module before demultiplexing module, the synchronization request sending for receiving detection module, and after receiving this synchronization request, for the first audio, video data getting thereafter adds sync mark.Further, playing module controls decoded audio signal to be played according to this sync mark and vision signal to be played is synchronously exported, synchronous to realize the output of Voice & Video.Demultiplexing module is upgraded the timestamp of voice data and/or video data according to this sync mark, synchronous to realize the timestamp of voice data and video data, further guarantees that follow-up output is synchronous.
According to HLS agreement, for a complete multi-medium data, according to the URL in m3u8 file, download the audio, video data of a plurality of TS forms of this multi-medium data.TS is a kind of encapsulation format, and voice data and video data and supplementary all can be encapsulated into the TS bag of 188 bytes.Please refer to the TS pack arrangement schematic diagram shown in Fig. 3, a TS bag is to be formed by TS head and the packing of PES stream.Wherein PES stream is to be formed by PES head and the packing of ES stream, and ES stream comprises voice data and video data.
In a kind of concrete realization of the present embodiment, mark module is for obtaining the audio, video data of having downloaded, when not receiving synchronization request, the output that audio signal at present to be played and vision signal to be played are described is synchronous, mark module does not need to do special processing, and audio, video data is sent to demultiplexing module.Mark module is after receiving synchronization request, illustrate now, audio signal to be played and vision signal to be played are asynchronous, in order to adjust as early as possible, mark module is after receiving synchronization request, and for the first audio, video data next getting adds sync mark, this sync mark can be arranged on TS head, such as, in certain field of TS head, increase corresponding mark.
It is voice data and video data by audio, video data demultiplexing that demultiplexing module is used for.Demultiplexing module is resolved audio, video data TS bag, therefrom parses voice data and video data.In the process of resolving, if find above-mentioned sync mark, upgrade the timestamp of voice data and/or video data.Particularly, include a timestamp in each voice data and video data, this timestamp is exactly displaying time, such as, the time schedule bar of below while watching film.Demultiplexing module, when finding sync mark, synchronously be adjusted the timestamp of voice data and video data.
Particularly, in a kind of exemplary execution mode of the present invention, demultiplexing module has two kinds of synchronous modes of adjusting the timestamp of voice data and/or video data.Be according to a timestamp for the timestamp correction video data of voice data, the timestamp of voice data of namely take is benchmark, revises the timestamp of video data, makes it consistent with the timestamp of voice data.A kind of is according to the timestamp of the timestamp correction video data of audio, video data.According to HLS agreement, each audio, video data has corresponding duration, according to duration corresponding to this audio, video data in m3u8 file, can calculate the time of this audio, video data for whole multi-medium data, namely the timestamp of this audio, video data.In the timestamp of voice data and the timestamp difference of above-mentioned audio, video data when larger, according to the timestamp correction voice data of above-mentioned audio, video data and the timestamp of video data,, the timestamp of voice data and video data is all modified to the timestamp of above-mentioned audio, video data, relatively accurate to guarantee the timestamp of voice data and video data.
Decoder module decode above-mentioned voice data and video data, become the audio signal to be played that can play for output and vision signal to be played by number reduction.
Detection module, for before audio signal to be played and vision signal to be played output, detects the timestamp that audio signal to be played and vision signal to be played are carried.This timestamp is the concrete time of audio, video data, such as 01:20:38, represents the 1st hour 20 minutes 38 seconds.Generally, the time in the playing progress bar of audio, video data just comes from this timestamp.When the timestamp that carries in audio signal to be played and vision signal to be played is inconsistent, illustrate that audio signal to be played and vision signal output to be played are asynchronous, send synchronization request to mark module.Further, when the timestamp that detection module only carries in audio signal to be played and vision signal to be played is all inconsistent within the predetermined time, just send synchronization request, excessive to avoid frequently sending caused mark module pressure.Preferably, this predetermined time can be selected 3 seconds.
The object that playing module is play with realization for exporting decoded audio signal to be played and vision signal to be played.When audio signal to be played and vision signal to be played are exported when asynchronous, playing module carries out the synchronous output of audio signal to be played and vision signal to be played according to sync id.Particularly, playing module is stored in output buffer area by audio signal to be played or the vision signal to be played of carrying sync mark, wait receives after the vision signal to be played or audio signal to be played of carrying sync mark, controls to carry the audio signal to be played of sync mark and vision signal to be played is synchronously exported.Because sync mark is stamped for audio, video data after receiving synchronization request by mark module, carry the audio signal to be played of sync mark and vision signal to be played from same audio, video data, need to synchronously export.If playing module first receives the audio signal to be played of carrying sync mark, illustrate that the output of audio signal to be played is faster than the output of vision signal to be played, therefore first audio signal to be played is stored in to output buffer area, when wait receives the vision signal to be played of carrying sync mark, control and carry the audio signal to be played of sync mark and vision signal to be played is synchronously exported.If playing module first receives the vision signal to be played of carrying sync mark, illustrate that the output of vision signal to be played is faster than the output of audio signal to be played, therefore first vision signal to be played is stored in to output buffer area, when wait receives the audio signal to be played of carrying sync mark, control and carry the audio signal to be played of sync mark and vision signal to be played is synchronously exported.With this, reach the object of isochronous audio and video.
Embodiment tri-
Corresponding said apparatus, the invention provides a kind of audio and video synchronization method based on HLS agreement.Please refer to Fig. 4, the method comprises:
After receiving synchronization request, for the first audio, video data getting adds sync mark;
By audio, video data demultiplexing, be voice data and video data, and according to above-mentioned sync mark, upgrade the timestamp of voice data and/or video data;
Decoding audio data and video data, export audio signal to be played and vision signal to be played;
Detect audio signal to be played whether consistent with the timestamp carrying in vision signal to be played, when the timestamp that carries is inconsistent, send synchronization request in audio signal to be played and vision signal to be played;
According to above-mentioned sync mark, control audio signal to be played and vision signal to be played is synchronously exported.
Further, said method also comprises:
If when the timestamp carrying in audio signal to be played and vision signal to be played is all inconsistent within the predetermined time, send synchronization request.Excessive to avoid frequently sending caused mark module pressure.Preferably, this predetermined time can be selected 3 seconds
Further, the process of the timestamp of renewal voice data and/or video data comprises: according to the timestamp of the timestamp correction video data of voice data.
Further, the process of the timestamp of renewal voice data and/or video data comprises: according to the timestamp correction voice data of audio, video data and the timestamp of video data.
Particularly, in a kind of exemplary execution mode of the present invention, there are two kinds of synchronous modes of adjusting the timestamp of voice data and video data.Be according to a timestamp for the timestamp correction video data of voice data, the timestamp of voice data of namely take is benchmark, revises the timestamp of video data, makes it consistent with the timestamp of voice data.In the timestamp of voice data and the timestamp difference of audio, video data a when larger, according to the timestamp correction voice data of audio, video data and the timestamp of video data.The timestamp of voice data and video data is all modified to the timestamp of above-mentioned audio, video data, relatively accurate to guarantee the timestamp of voice data and video data.
Further, the process of controlling audio signal to be played and the synchronous output of vision signal to be played according to sync mark comprises: audio signal to be played or the vision signal to be played of carrying sync mark are stored in to output buffer area, wait receives after the vision signal to be played or audio signal to be played of carrying sync mark, controls to carry the audio signal to be played of sync mark and vision signal to be played is synchronously exported.
Compared to prior art, before the present invention plays after decoding, detect audio signal to be played whether consistent with the timestamp carrying in vision signal to be played, and then whether the output that detects audio signal to be played and vision signal to be played is synchronous, and inconsistent time, send synchronization request at audio signal to be played and vision signal timestamp to be played.On the one hand, the present invention is before demultiplexing, after receiving synchronization request, for the first audio, video data getting thereafter adds sync mark.Further, according to this sync mark, control decoded audio signal to be played and vision signal to be played is synchronously exported, synchronous to realize the output of Voice & Video.On the other hand, according to this sync mark, upgrade the timestamp of voice data and/or video data, synchronous to realize the timestamp of voice data and video data, further guarantee that follow-up output is synchronous.
By above description, can be found out, the present invention is by detecting the timestamp of audio signal to be played and vision signal to be played, and then detect audio signal to be played and vision signal to be played whether output is synchronous, in audio signal to be played and vision signal to be played, export when asynchronous, for treating that the audio, video data of demultiplexing adds sync mark.According to this sync mark, control audio signal to be played and vision signal to be played is synchronously exported, when demultiplexing, upgrade the timestamp of voice data and video data simultaneously, synchronous to reach follow-up audio signal to be played and vision signal timestamp to be played, and then export synchronous object.Therefore, solved the problem that audio signal to be played and vision signal to be played continue asynchronous brought picture or sound delay.
The foregoing is only preferred embodiment of the present invention, in order to limit the present invention, within the spirit and principles in the present invention not all, any modification of making, be equal to replacement, improvement etc., within all should being included in the scope of protection of the invention.
Claims (10)
1. the audio-visual synchronization device based on HLS agreement, is characterized in that, comprises the mark module, demultiplexing module, decoder module, detection module and the playing module that arrange in turn, wherein:
Described mark module, for after receiving synchronization request, for the first audio, video data getting adds sync mark, and notifies playing module;
Described demultiplexing module, for being voice data and video data by described audio, video data demultiplexing, and according to described sync mark, upgrades the timestamp of voice data and/or video data;
Described decoder module, for described voice data and the video data of decoding, exports audio signal to be played and vision signal to be played;
Described detection module, whether consistent with the timestamp carrying in vision signal to be played for detection of described audio signal to be played, when the timestamp that carries is inconsistent, send synchronization request to mark module in audio signal to be played and vision signal to be played;
Described playing module, for synchronously exporting according to the described sync mark described audio signal to be played of control and vision signal to be played.
2. device according to claim 1, is characterized in that,
Described detection module, if be further used for the timestamp that carries in described audio signal to be played and vision signal to be played when all inconsistent within the predetermined time, sends synchronization request to mark module.
3. device according to claim 1, is characterized in that,
The process that described demultiplexing module is upgraded the timestamp of voice data and/or video data comprises: described demultiplexing module is according to the timestamp of video data described in the timestamp correction of described voice data.
4. device according to claim 1, is characterized in that,
The process that described demultiplexing module is upgraded the timestamp of voice data and/or video data comprises: described demultiplexing module is according to the timestamp of voice data described in the timestamp correction of described audio, video data and video data.
5. device according to claim 1, is characterized in that,
Described playing module controls described audio signal to be played according to described sync mark and the synchronous process of exporting of vision signal to be played comprises: audio signal to be played or the vision signal to be played of carrying sync mark are stored in to output buffer area, wait receives after the vision signal to be played or audio signal to be played of carrying sync mark, controls to carry the audio signal to be played of sync mark and vision signal to be played is synchronously exported.
6. the audio and video synchronization method based on HLS agreement, is characterized in that, method comprises:
After receiving synchronization request, for the first audio, video data getting adds sync mark;
By described audio, video data demultiplexing, be voice data and video data, and according to described sync mark, upgrade the timestamp of voice data and/or video data;
Decode described voice data and video data, export audio signal to be played and vision signal to be played;
Detect described audio signal to be played whether consistent with the timestamp carrying in vision signal to be played, when the timestamp that carries is inconsistent, send synchronization request in audio signal to be played and vision signal to be played;
According to the described sync mark described audio signal to be played of control and vision signal to be played, synchronously export.
7. method according to claim 6, is characterized in that, described method also comprises:
If when the timestamp carrying in described audio signal to be played and vision signal to be played is all inconsistent within the predetermined time, send synchronization request.
8. method according to claim 6, is characterized in that,
The process of the timestamp of described renewal voice data and/or video data comprises: according to the timestamp of video data described in the timestamp correction of described voice data.
9. method according to claim 6, is characterized in that,
The process of the timestamp of described renewal voice data and/or video data comprises: according to the timestamp of voice data described in the timestamp correction of described audio, video data and video data.
10. method according to claim 6, is characterized in that,
According to the described sync mark described audio signal to be played of control and the synchronous process of exporting of vision signal to be played, comprise: audio signal to be played or the vision signal to be played of carrying sync mark are stored in to output buffer area, wait receives after the vision signal to be played or audio signal to be played of carrying sync mark, controls to carry the audio signal to be played of sync mark and vision signal to be played is synchronously exported.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310637560.3A CN103648011B (en) | 2013-11-29 | 2013-11-29 | A kind of audio-visual synchronization apparatus and method based on HLS protocol |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310637560.3A CN103648011B (en) | 2013-11-29 | 2013-11-29 | A kind of audio-visual synchronization apparatus and method based on HLS protocol |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103648011A true CN103648011A (en) | 2014-03-19 |
| CN103648011B CN103648011B (en) | 2017-03-15 |
Family
ID=50253153
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310637560.3A Active CN103648011B (en) | 2013-11-29 | 2013-11-29 | A kind of audio-visual synchronization apparatus and method based on HLS protocol |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103648011B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105847897A (en) * | 2016-03-31 | 2016-08-10 | 乐视控股（北京）有限公司 | Method and device of providing and processing video downloading |
| CN106331840A (en) * | 2016-08-31 | 2017-01-11 | 青岛海信宽带多媒体技术有限公司 | Http live stream (HLS) protocol-based audio and video jump play method and apparatus |
| WO2017071228A1 (en) * | 2015-10-29 | 2017-05-04 | 乐视控股（北京）有限公司 | Hls protocol-based method and system for live broadcast and client |
| CN110267083A (en) * | 2019-06-18 | 2019-09-20 | 广州虎牙科技有限公司 | Detection method, device, equipment and the storage medium of audio-visual synchronization |
| CN110324689A (en) * | 2019-07-08 | 2019-10-11 | 广州酷狗计算机科技有限公司 | Method, apparatus, terminal and the storage medium that audio-visual synchronization plays |
| CN112929713A (en) * | 2021-02-07 | 2021-06-08 | Oppo广东移动通信有限公司 | Data synchronization method, device, terminal and storage medium |
| CN114866827A (en) * | 2022-01-07 | 2022-08-05 | 广州繁星互娱信息科技有限公司 | Audio and video synchronization detection method and device, storage medium and electronic equipment |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3063841B2 (en) * | 1997-11-26 | 2000-07-12 | 日本電気株式会社 | Audio / video synchronous playback device |
| WO2012151756A1 (en) * | 2011-05-12 | 2012-11-15 | Intel Corporation | Techniques for synchronization of audio and video |
-
2013
- 2013-11-29 CN CN201310637560.3A patent/CN103648011B/en active Active
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017071228A1 (en) * | 2015-10-29 | 2017-05-04 | 乐视控股（北京）有限公司 | Hls protocol-based method and system for live broadcast and client |
| CN105847897A (en) * | 2016-03-31 | 2016-08-10 | 乐视控股（北京）有限公司 | Method and device of providing and processing video downloading |
| CN106331840A (en) * | 2016-08-31 | 2017-01-11 | 青岛海信宽带多媒体技术有限公司 | Http live stream (HLS) protocol-based audio and video jump play method and apparatus |
| CN106331840B (en) * | 2016-08-31 | 2019-05-21 | 青岛海信宽带多媒体技术有限公司 | A kind of redirect broadcasting method and device of the audio-video based on HLS protocol |
| CN110267083A (en) * | 2019-06-18 | 2019-09-20 | 广州虎牙科技有限公司 | Detection method, device, equipment and the storage medium of audio-visual synchronization |
| CN110267083B (en) * | 2019-06-18 | 2021-12-10 | 广州虎牙科技有限公司 | Audio and video synchronization detection method, device, equipment and storage medium |
| CN110324689A (en) * | 2019-07-08 | 2019-10-11 | 广州酷狗计算机科技有限公司 | Method, apparatus, terminal and the storage medium that audio-visual synchronization plays |
| CN110324689B (en) * | 2019-07-08 | 2022-05-17 | 成都酷狗创业孵化器管理有限公司 | Audio and video synchronous playing method, device, terminal and storage medium |
| CN112929713A (en) * | 2021-02-07 | 2021-06-08 | Oppo广东移动通信有限公司 | Data synchronization method, device, terminal and storage medium |
| CN112929713B (en) * | 2021-02-07 | 2024-04-02 | Oppo广东移动通信有限公司 | Data synchronization method, device, terminal and storage medium |
| CN114866827A (en) * | 2022-01-07 | 2022-08-05 | 广州繁星互娱信息科技有限公司 | Audio and video synchronization detection method and device, storage medium and electronic equipment |
| CN114866827B (en) * | 2022-01-07 | 2024-04-16 | 广州繁星互娱信息科技有限公司 | Audio and video synchronization detection method and device, storage medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103648011B (en) | 2017-03-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103648011A (en) | Audio and video synchronization device and method based on HLS protocol | |
| CN109565620B (en) | Computing device, method for generating and receiving low-delay video stream | |
| CN110996182B (en) | Timestamp processing method and device, electronic equipment and computer storage medium | |
| CN101415069B (en) | Server and method for sending on-line play video | |
| CN103929427A (en) | Dynamic multi-thread downloading device and method | |
| JP2018530257A (en) | Media content tag data synchronization | |
| CN108063970A (en) | A kind of method and apparatus for handling live TV stream | |
| JP2012168801A (en) | Information processing device | |
| US10986421B2 (en) | Identification and timing data for media content | |
| CN104410902A (en) | Playing method and terminal for live program, as well as generation method and equipment for index document | |
| EP2775709A1 (en) | Playback device, playback method, and program | |
| US11356749B2 (en) | Track format for carriage of event messages | |
| CN113767639B (en) | Method, apparatus and non-volatile computer readable medium for receiving media data | |
| CN105072480B (en) | A kind of net cast method and device | |
| US20180159916A1 (en) | System and method for announcing media changes | |
| CN105898500A (en) | Network video play method and device | |
| WO2018134660A1 (en) | Content streaming system and method | |
| CN103763609A (en) | HLS protocol-based channel switching method and apparatus | |
| US11095699B1 (en) | Streaming media file management | |
| CN104918108A (en) | Video accurate positioning device and method based on HLS (HTTP Live Streaming) protocol | |
| JP2018026778A (en) | Transmission apparatus, transmission method, reception apparatus, and reception method | |
| WO2019088853A1 (en) | Live audio replacement in a digital stream | |
| US20160073137A1 (en) | Transmission apparatus, transmission method, reception apparatus, and reception method | |
| CN106303754A (en) | A kind of audio data play method and device | |
| KR20220116162A (en) | Techniques for Alternative Content Signaling in ATSC 3.0 TV |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| PP01 | Preservation of patent right | ||
| PP01 | Preservation of patent right |
Effective date of registration: 20170721 Granted publication date: 20170315 |
|
| PD01 | Discharge of preservation of patent |
Date of cancellation: 20200721 Granted publication date: 20170315 |
|
| PD01 | Discharge of preservation of patent | ||
| CP03 | Change of name, title or address |
Address after: 300453 Tianjin Binhai New Area, Tianjin Eco-city, No. 126 Animation and Animation Center Road, Area B1, Second Floor 201-427 Patentee after: Xinle Visual Intelligent Electronic Technology (Tianjin) Co.,Ltd. Address before: 300467 Tianjin Binhai New Area, ecological city, animation Middle Road, building, No. two, B1 District, 201-427 Patentee before: LE SHI ZHI XIN ELECTRONIC TECHNOLOGY (TIANJIN) Ltd. Address after: Room 301-1, Room 301-3, Area B2, Animation Building, No. 126 Animation Road, Zhongxin Eco-city, Tianjin Binhai New Area, Tianjin Patentee after: LE SHI ZHI XIN ELECTRONIC TECHNOLOGY (TIANJIN) Ltd. Address before: 300453 Tianjin Binhai New Area, Tianjin Eco-city, No. 126 Animation and Animation Center Road, Area B1, Second Floor 201-427 Patentee before: Xinle Visual Intelligent Electronic Technology (Tianjin) Co.,Ltd. |
|
| CP03 | Change of name, title or address | ||
| PP01 | Preservation of patent right |
Effective date of registration: 20210201 Granted publication date: 20170315 |
|
| PP01 | Preservation of patent right |