CN109218795A - A kind of more device plays progress synchronous method, device and terminal device - Google Patents
A kind of more device plays progress synchronous method, device and terminal device Download PDFInfo
- Publication number
- CN109218795A CN109218795A CN201811447231.1A CN201811447231A CN109218795A CN 109218795 A CN109218795 A CN 109218795A CN 201811447231 A CN201811447231 A CN 201811447231A CN 109218795 A CN109218795 A CN 109218795A
- Authority
- CN
- China
- Prior art keywords
- playback equipment
- playback
- progress
- equipment
- main
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4392—Processing of audio elementary streams involving audio buffer management
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
This application provides a kind of more device plays progress synchronous method, device and terminal devices, specifically, main playback equipment is distributed in more device plays systems and from playback equipment, when asynchronous with the playback progress of main playback equipment from playback equipment, then according to the playback progress difference with main playback equipment, change is directed toward from the pointer of playback equipment data buffer zone.After changing pointer direction, the pipeline time having changed from playback equipment is just corresponded to.It for the audio, video data of data buffer zone will be written, if its timestamp is less than the pipeline time after change, is abandoned, and then realizes the Fast synchronization with main playback equipment；On the contrary, being then written into corresponding audio and video buffer area, and then realize that waiting is synchronous with main playback equipment.Above by the synchronous method that change pointer is directed toward, cost can also be greatly reduced while playing without key frame data and peripheral hardware, and then accurate synchronization may be implemented.
Description
Technical field
This disclosure relates to field of communication technology more particularly to a kind of more device plays progress synchronous method, device and terminal
Equipment.
Background technique
In places such as museum, Demonstration Halls, same media file often is played simultaneously with multiple devices, it is aobvious to carry out advertisement
Show, educational propaganda etc., wherein the type of multimedia file may include video file and audio file.
When due to every device plays video file, clock used by audio-visual synchronization is relatively independent, and this
Clock is linear increment and outside can not be changed.Therefore, lead at present to make multiple devices realize that synchronizing for playback progress jumps
Frequently with method have when a certain or certain several equipment are asynchronous with other device plays progresses, user is pressed by remote controler
Key executes fast forward and fast reverse operation to target device playback progress.But the position obtained after above-mentioned fast forward and fast reverse is usually
Key frame position near target position can not achieve accurate synchronization, thereby reduce user experience.To realize multiple devices
Playback progress more accurately synchronizes, and when same film source will be played simultaneously in multiple equipment, can generally select multiple equipment is same
When be external to HDMI (High Definition Multimedia Interface, high-definition multimedia interface) and set
It is standby.Fig. 1 is a kind of structural schematic diagram of more device plays systems in the prior art.As shown in Figure 1, playback equipment 10 in the system
Be connected to HDMI equipment 20, and within the system, playback equipment 10 only as display equipment, by the output of HDMI equipment Lai
Manage the synchronization of playback progress.But since the cost of HDMI equipment is more high, the broadcast mode of above system, which improves, to be broadcast
Put cost.
Therefore, there is the precisely contradiction between synchronization and high cost in existing more device plays progress methods of synchronization.
Summary of the invention
A kind of more device plays progress synchronous method, device and terminal device are provided in the embodiment of the present invention, to drop
It can guarantee the accurate synchronization of multiple devices playback progress while inexpensive again.
According to a first aspect of the embodiments of the present invention, a kind of more device plays progress synchronous method, this method packet are provided
It includes:
Obtain main playback equipment and the playback progress from playback equipment；
Whether judgement is described synchronous from playback equipment and the playback progress of the main playback equipment；
If asynchronous, according to the playback progress difference from playback equipment and the main playback equipment, described in change
The pointer of data buffer zone is directed toward from playback equipment；
Wherein, the data buffer zone is made of multiple data cache blocks；The pointer is directed toward, will be from which for expression
A data cache block reads data to described from the audio and video playing module in playback equipment.
According to a second aspect of the embodiments of the present invention, a kind of more device plays progress synchronizing devices, the device packet are provided
It includes:
Playback progress obtains module: for obtaining main playback equipment and from the playback progress of playback equipment.
Playback progress judgment module: whether the judgement playback progress from playback equipment and the main playback equipment is same
Step；
Pointer is directed toward adjustment module: if for asynchronous, according to described from playback equipment and the main playback equipment
The pointer of playback progress difference, the change data buffer zone from playback equipment is directed toward；
Wherein, the data buffer zone is made of multiple data cache blocks；The pointer is directed toward, will be from which for expression
A data cache block reads data to described from the audio and video playing module in playback equipment.
According to a third aspect of the embodiments of the present invention, a kind of terminal device is provided, which includes that the present invention is real
Apply more device plays progress synchronizing devices that a second aspect provides, the sound connecting with more device plays progress synchronizing devices
Video play device.
By above technical scheme as it can be seen that more device plays progress synchronous method, device and end provided in an embodiment of the present invention
End equipment is distributed main playback equipment in more device plays systems and from playback equipment, is sent out when as from the equipment of playback equipment
When now it is asynchronous with the playback progress of main playback equipment, then the playback progress difference of basis and main playback equipment, is changed in it
The pointer of portion data buffer zone is directed toward.It is equal to the value and data cache block that pointer is directed toward corresponding data cache blocks according to the pipeline time
The product of capacity, in this way change pointer are directed toward, just the corresponding pipeline time having changed from playback equipment.In this way, for that will write
Enter the audio, video data of data buffer zone, if its timestamp is less than the pipeline time after change, abandoned, and then realizes
With the Fast synchronization of main playback equipment；If its timestamp is greater than the pipeline time after change, it is written into corresponding sound view
Frequency buffer area, and then realize that waiting is synchronous with main playback equipment.Above by the synchronizing process that change pointer is directed toward, without borrowing
Cost can also be greatly reduced while helping key frame data and peripheral hardware to play, and then accurate synchronization may be implemented.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and shows and meets implementation of the invention
Example, and be used to explain the principle of the present invention together with specification.
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, for those of ordinary skill in the art
Speech, without any creative labor, is also possible to obtain other drawings based on these drawings.
Fig. 1 is a kind of structural schematic diagram of more device plays systems in the prior art.
Fig. 2 is a kind of flow diagram of more device plays progress synchronous method provided by the embodiments of the present application；
Fig. 3 is that the basic structure of Gstreamer system sound intermediate frequency writing data buffering area provided by the embodiments of the present application is shown
It is intended to；
Fig. 4 is provided by the embodiments of the present application when being ahead of main playback equipment from playback equipment progress, from playback equipment
The variation schematic diagram of pipeline clock and system clock；
Fig. 5 is provided by the embodiments of the present application when lagging behind main playback equipment from playback equipment progress, from playback equipment
The variation schematic diagram of pipeline clock and system clock；
Fig. 6 is the flow diagram of the more device plays progress synchronous method of another kind provided by the embodiments of the present application；
Fig. 7 is a kind of structural schematic diagram of more device plays progress synchronizing devices provided by the embodiments of the present application.
Specific embodiment
Technical solution in order to enable those skilled in the art to better understand the present invention, below in conjunction with of the invention real
The attached drawing in example is applied, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described implementation
Example is only a part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, this field is common
Technical staff's every other embodiment obtained without making creative work, all should belong to protection of the present invention
Range.
More device plays progress synchronous method, device and terminal device provided in this embodiment, being mainly used in can have
There is the equipment of following audio and video playing mode: firstly, decoded film source is stored in corresponding data buffer area, while the data are slow
Area is deposited to be made of multiple data cache blocks；Then, then from each data buffer storage block read data to the audio-video in playback equipment
Playing module.
As existing terminal device, clock used by its internal audio-visual synchronization is linear increment and outside can not be changed,
Therefore, existing audio-video synchronization technology cannot be used for realizing the synchronization of multiple devices broadcasting content, be mentioned based on this present embodiment
A kind of more device plays progress synchronous method that clock is controllable have been supplied, will be situated between in detail to method provided in this embodiment below
It continues.Fig. 2 is a kind of flow diagram of more device plays progress synchronous method provided by the embodiments of the present application.As shown in Fig. 2, should
Method the following steps are included:
S110: main playback equipment and the playback progress from playback equipment are obtained.
In the present embodiment, multiple playback equipment communication connections, wherein define its playback progress broadcasting as normal pace
Equipment is put as main playback equipment, it is other for from playback equipment, certainly, the angle of master and slave playback equipment in specific broadcasting process
Color can also be exchanged.Further, the playback progress of main playback equipment can be by its active transmission to respectively from playback equipment, from broadcasting
After putting the playback progress that equipment receives its transmission, subsequent synchronisation step is executed；Alternatively, can also from from playback equipment timing to
Main playback equipment sends request.
The present embodiment is for being equipped with the equipment of Gstreamer system, wherein GStreamer is for constructing stream matchmaker
The open source multimedia framework of body application, target is the exploitation of audio/video application program to be simplified, and has been able to be used at present
Handle the multi-medium data as multiple formats such as MP3, Ogg, MPEG1, MPEG2, AVI, Quicktime.
Fig. 3 is that the basic structure of Gstreamer system sound intermediate frequency writing data buffering area provided by the embodiments of the present application is shown
It is intended to.As shown in figure 3, the GstAudioRingBuffer in Gstreamer system is an annular audio data read-write buffering
Area, it provides decoded audio data write-in and reads the function of audio data to audio-frequence player device.Specifically, the ring
Shape buffer area is made of 20 segment, and writeSeg is for indicating that decoded audio data will be write in which segment
Enter, segdone is then used to indicate to read thread and which segment will read data from and audio-frequence player device is written.It is false
If a segment can store the audio data of 20ms, when segdone is equal to 2, then it represents that audio-frequence player device has been at this time
The audio data of 2 segment is played, the corresponding pipeline time is then 40ms.
Based on These characteristics, the playback progress of playback equipment can refer to the pipeline time in the present embodiment, can also refer to
Segdone value.
S120: whether judgement is described synchronous from playback equipment and the playback progress of the main playback equipment.
Such as 20ms, then recognize in certain threshold range specifically, the two progress one threshold value of difference can be set
It is synchronized for the two；Otherwise, S130 is thened follow the steps.
S130: if asynchronous, according to the playback progress difference from playback equipment and the main playback equipment, change
The pointer of the data buffer zone from playback equipment is directed toward.
Wherein, in the present embodiment, pointer is directed toward described for indicating to read data to from which data cache block
From the audio and video playing module in playback equipment；In addition, the present embodiment also sets up simulation clock corresponding with pointer direction: pipeline
Time, wherein the size of the pipeline time is equal to pointer and is directed toward the value of corresponding data cache blocks and multiplying for data cache block capacity
Product.
Specifically, when device plays progress is with pointer point identification, then it can be directly according to the two progress difference, modification
Pointer is directed toward.When playback progress is with pipeline time identifier, then firstly the need of according to the pipe from playback equipment and main playback equipment
The road time and from playback equipment data cache block capacity, calculate the target of the data buffer zone from playback equipment
Pointer is directed toward；Then, it is directed toward further according to object pointer, changes its pointer direction.
By taking Gstreamer system as an example, when lagging behind the playback progress of main playback equipment from playback equipment, if main broadcaster
The currently playing progress for putting the main playback equipment of playback progress of equipment is 400ms (segdone value is 20), from the current of player
Playback progress is 200ms (segdone value is 10).After the playback progress that player receives main playback equipment, oneself is found
Playback progress fall behind 10 segment, the segdone of oneself is then added 10, at this time from player decoded sound view
Feature is written according to will appear lag, according to audio data in frequency, if the audio time stamp that will be written is less than when preceding pipeline
Between, then it represents that it lags behind the pipeline time, needs to abandon, and if it is greater than the preceding pipeline time is worked as, then corresponding segment is written
In.Therefore, the mode of frame losing can be taken from player, directly abandon decoded audio, video data and Fast synchronization to 400ms,
It thereby realizes synchronous with main playback equipment.
Similarly, when being ahead of main playback equipment from the playback progress of playback equipment, from player will according to its with it is described
The segdone of oneself can be subtracted corresponding value by the playback progress difference of main playback equipment, in this way from the decoded sound of player
Video data will appear in advance, and then decoded audio data is directly written in corresponding segment, and segdone value is subtracted
Data after small in corresponding segment have been wiped free of, meanwhile, segdone value after the modification on the basis of continue growing, i.e. pipeline
Clock will continue to linear increment, after having audio data in corresponding segment, just start normal play, i.e. its pipeline clock
When the pipeline clock value of value and main player is in certain threshold range, just terminate to wait.Therefore, by changing data buffer zone
Segdone value, the synchronization for reaching principal and subordinate's player by way of waiting from player can be made.
Therefore, after confirming that its playback progress is asynchronous with main playback equipment from playback equipment, then by modifying above-mentioned sound
Frequency is directed toward according to the pointer of buffer circle, and current device can be forced to be synchronized to target progress.
It is equal to pointer according to the value of pipeline clock and is directed toward the value of corresponding data cache blocks and the product of data cache block capacity,
Therefore, pipeline clock provided in this embodiment has the property of system clock linear increment, but when external modification is provided simultaneously
The interface and progress queries function of clock.Wherein, pipeline clock Major Members include: last_clock_time (when starting pipeline
Between), current_clock_time (when the preceding pipeline time), last_sysclock_time (starter system time) and
Current_sysclock_time (present system time), and lock synchronously control.
Fig. 4 is provided by the embodiments of the present application when being ahead of main playback equipment from playback equipment progress, from playback equipment
The variation schematic diagram of pipeline clock and system clock.When playing film source since playback equipment, pipeline clock starting, record
Current time is 0s, this is as last_clock_time.Assuming that current system time clock is 100s, synchronized update last_
sysclock_time.When arriving at the time of new, for example, system clock is 110s, i.e. current_sysclock_time=
110, at this time when the preceding pipeline time are as follows: current_clock_time=last_clock_time+ (current_sysclock_
Time-last_sysclock_time)=10s.
When actively suspending from playback equipment, current system time clock and pipeline clock time are obtained based on the above method, such as
Fig. 4 system clock suspends when being 130s, and obtaining pipeline clock at this time is 27s, and pipeline clock time-preserving is broadcast until receiving
Message, such as system clock are put to restore to play when 137s, pipeline clock is still 27s at this time, when system clock is 140s, pipe
Road clock is updated to 30s.
And when being ahead of main playback equipment from playback equipment progress, such as from the broadcasting of playback equipment shift to an earlier date 3s, at this time
The current_clock_time of pipeline clock reduces 3s, such as Fig. 4, and when system clock is 120s, pipeline clock be should be this moment
20s reduces 3s, becomes 17s, and pipeline clock continues growing later, when system clock is 130s, pipeline clock 27s.
If currently playing equipment falls behind other equipment, such as Fig. 4, system clock receives current schedules and falls behind 3s when going to 120s
Message, at this time increase pipeline clock current_clock_time value, i.e., by current_clock_time by 20 change to
23s, pipeline clock continues growing later, when system clock is 130s, pipeline clock 33s.
Fig. 5 is provided by the embodiments of the present application when lagging behind main playback equipment from playback equipment progress, from playback equipment
The variation schematic diagram of pipeline clock and system clock.As shown in figure 5, receiving current schedules when system clock goes to 120s and falling
The message of main playback equipment 3s afterwards increases the current_clock_time value of pipeline clock, i.e., by current_ at this time
Clock_time is changed by 20 to 23s, and pipeline clock continues growing later, when system clock is 130s, pipeline clock 33s.
Further, it in more device plays processes, there is also following scene, put equipment such as current anchor and normally broadcasting
It puts, and performs forwarding operation from playback equipment user, be fast-forward to if detecting at this time from playback equipment playback progress by user
Position if operating at this time to pipeline clock, clock after modification can be generated but since the physical location after F.F. wants less than normal
The problem of for negative value.
In view of the above-mentioned problems, the present embodiment also provides when the pointer in change data buffer zone from playback equipment is directed toward
Following steps:
S131: if after judgement change pointer is directed toward, whether the pipeline time from playback equipment is negative value.
S132: if it is negative value, described suspend from playback equipment is played.
S133: after the pause broadcasting preset time from playback equipment, the current broadcasting of the main playback equipment is obtained
Progress.
For example, every time sleep 5ms after again detection play in advance time, until in advance time be less than it is currently playing into
Degree.
S134: according to the currently playing progress difference of the playback progress from playback equipment and the main playback equipment,
The pointer of the change data buffer zone from playback equipment is directed toward.
Further, if above-mentioned playback equipment is also used to playing video data, video player can be with audio clock
On the basis of carry out equipment inside audio-visual synchronization.Specifically, the following method of synchronization can be used:
First, it is determined that whether the timestamp of the video data decoded from playback equipment is greater than when preceding pipeline
Between, wherein the pipeline time is equal to current pointer and is directed toward the value of corresponding data cache blocks and the product of data cache block capacity.
Then, if it is greater than the preceding pipeline time is worked as, then corresponding video cache area is written into decoded video data, i.e., hung thread
It rises and is waited.Otherwise, then the mode of frame losing is taken.It just realizes so synchronous with audio from playback equipment interior video.
Further, in playback equipment playing process, can also there be user and artificially adjust playback progress, such as by main broadcaster
Equipment F.F. 50s is put, correspondingly, all should all execute forwarding operation from playback equipment, principal and subordinate's playback equipment under the situation
Progress difference is larger, and to accelerate synchronizing speed, the present embodiment additionally provides another synchronous method.Fig. 6 is the embodiment of the present application
The flow diagram of the more device plays progress synchronous method of another kind of offer.As shown in fig. 6, this method specifically includes following step
It is rapid:
S210: main playback equipment and the playback progress from playback equipment are obtained.
S220: whether the judgement playback progress difference from playback equipment and the main playback equipment is greater than the first threshold
Value.
If exceeding first threshold, such as 5s thens follow the steps coarse synchronization step of the S230 into S250.If without departing from first
Threshold value executes step S280 and judges whether it is greater than second threshold, if more than second threshold, thens follow the steps S270.
S230: if it is greater than first threshold, then according to the playback progress from playback equipment and the main playback equipment
Difference determines the target playback progress from playback equipment.
In the present embodiment, the method that uses of coarse synchronization step is executed as the key frame near searching target playback progress,
Since the target playback progress corresponding time may be non-key frame, as P frame, B frame will lead to coding if transmitting P frame, B frame
The abnormal problems such as failure or display flower screen.And distribution of the key frame in film source is not fixed, some film sources may be spaced one two seconds
Just have 1 key frame, but have a film source may be spaced 10s or more than just have a key frame.So the key frame found is from mesh
Several seconds of cursor position difference, for example, the key frame actually returned may be 6s if target playback progress is 15s.
In addition, coarse synchronization itself wants time-consuming, based on the above reasons, the present embodiment is when determining target playback progress, meeting
Preset duration is added from the playback progress difference of playback equipment and the main playback equipment by described, as described from playback equipment
Playback progress adjust to target playback progress and need the step-length that changes.Wherein, according to test result, the present embodiment presets this
Duration is designed as 5s.
S240: it from the video data time index table from playback equipment, searches with the target playback progress most
The timestamp of close key frame.
The time index table of video data is mainly by the timestamp pts of key frame and deviation post offset, i.e., by < pts,
Offset > composition.Time index table is generally directly parsed by demux, and such as MP4, avi format, the parsing also having is less than needing
It is dynamically added in playing process, such as ts format.
S250: the corresponding deviation post of the timestamp is synchronized to from the playback progress of playback equipment by described.
Data are parsed i.e. from the position deviation post offset.
S260: judgement it is described from playback equipment synchronize after playback progress put device plays progress difference with the main broadcaster and be
It is no to be less than second threshold.
If being less than second threshold, then it is assumed that the two is synchronized, in 20ms；If more than second threshold, then follow the steps
S270。
S270: if being not less than second threshold, according to the playback progress from playback equipment and the main playback equipment
The pointer of difference, the change data buffer zone from playback equipment is directed toward.
Further, it in order to more accurately synchronize, when principal and subordinate's playback equipment distance is farther out or when network quality is poor, deposits
The data transmission delay the case where, in addition, from reading data to display, there is also certain delay time, needles inside playback equipment
To the problem, this example is provided after the currently playing progress for obtaining main playback equipment, is also performed the following operations:
Prolong by the currently playing progress of the main playback equipment, the main playback equipment and from the network between playback equipment
Slow time and the sum of the display delay time from player, the playback progress as the main playback equipment.
Inventive concept based on the above method, the present embodiment additionally provide a kind of more device plays progress synchronizing devices.Fig. 7
For a kind of structural schematic diagram of more device plays progress synchronizing devices provided by the embodiments of the present application.As shown in fig. 7, the device packet
It includes:
Playback progress obtains module 710: for obtaining main playback equipment and from the playback progress of playback equipment.
Playback progress judgment module 720: judgement it is described from the playback progress of playback equipment and the main playback equipment whether
It is synchronous；
Pointer is directed toward adjustment module 730: if for asynchronous, according to described from playback equipment and the main playback equipment
Playback progress difference, the pointer of the change data buffer zone from playback equipment is directed toward.
Wherein, the data buffer zone is made of multiple data cache blocks；The pointer is directed toward, will be from which for expression
A data cache block reads data to described from the audio and video playing module in playback equipment.
Based on above-mentioned apparatus, the present embodiment additionally provides a kind of terminal device, and the terminal device in this example can be electricity
Depending on mechanical, electrical brain TV integrated machine etc..Specifically, the terminal device includes that more device plays progresses provided by the above embodiment are synchronous
Device, the audio and video display device being connect with more device plays progress synchronizing devices.Wherein, audio and video display device, can
To include the screen of one output interface of offer for output audio signal loudspeaker, between terminal and user.Some
In embodiment, which may include liquid crystal display (LCD) and touch panel (TP).If screen includes touch panel, screen
Curtain may be implemented as touch screen, to receive input signal from the user.
All the embodiments in this specification are described in a progressive manner, same and similar portion between each embodiment
Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for device or
For system embodiment, since it is substantially similar to the method embodiment, so describing fairly simple, related place is referring to method
The part of embodiment illustrates.Apparatus and system embodiment described above is only schematical, wherein as separation
The unit of part description may or may not be physically separated, component shown as a unit can be or
It can not be physical unit, it can it is in one place, or may be distributed over multiple network units.It can be according to reality
Border needs to select some or all of the modules therein to achieve the purpose of the solution of this embodiment.Those of ordinary skill in the art
It can understand and implement without creative efforts.
The above is only a specific embodiment of the invention, it is noted that those skilled in the art are come
It says, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications also should be regarded as
Protection scope of the present invention.
Claims (10)
1. a kind of more device plays progress synchronous method, which is characterized in that the described method includes:
Obtain main playback equipment and the playback progress from playback equipment；
Whether judgement is described synchronous from playback equipment and the playback progress of the main playback equipment；
If asynchronous, according to the playback progress difference from playback equipment and the main playback equipment, change is described from broadcasting
The pointer for putting data buffer zone in equipment is directed toward；
Wherein, the data buffer zone is made of multiple data cache blocks；The pointer is directed toward, will be from which number for expression
It is read data to according to cache blocks described from the audio and video playing module in playback equipment.
2. the method according to claim 1, wherein judgement is described from playback equipment and the main playback equipment
Whether playback progress synchronizes, comprising:
Whether the judgement playback progress difference from playback equipment and the main playback equipment is greater than first threshold；
If it is greater than first threshold, then according to the playback progress difference from playback equipment and the main playback equipment, determine
The target playback progress from playback equipment；
From the video data time index table from playback equipment, search and the immediate key of target playback progress
The timestamp of frame；
The corresponding deviation post of the timestamp is synchronized to from the playback progress of playback equipment by described；
Judgement it is described from playback equipment synchronize after playback progress whether with the main broadcaster put device plays progress synchronous.
3. according to the method described in claim 2, it is characterized in that, according to described from playback equipment and the main playback equipment
Playback progress difference determines the target playback progress from playback equipment, comprising:
Preset duration is added from the playback progress difference of playback equipment and the main playback equipment by described, as described from broadcasting
The playback progress of equipment adjusts the step-length for needing to change to target playback progress.
4. according to the method described in claim 2, it is characterized in that, judgement it is described from playback equipment synchronize after playback progress with
The main broadcaster puts whether device plays progress synchronizes, comprising:
Judgement it is described from playback equipment synchronize after playback progress and the main broadcaster whether put device plays progress less than the second threshold
Value.
5. the method according to claim 1, wherein the pointer of the change data buffer zone from playback equipment
It is directed toward, comprising:
If whether the pipeline time from playback equipment is negative value, wherein the pipeline time after judgement change pointer is directed toward
The value of corresponding data cache blocks and the product of data cache block capacity are directed toward equal to pointer；
If it is negative value, described suspend from playback equipment is played；
After the pause broadcasting preset time from playback equipment, the current playback progress of the main playback equipment is obtained；
According to the currently playing progress difference of the playback progress from playback equipment and the main playback equipment, change it is described from
The pointer of data buffer zone is directed toward in playback equipment.
6. the method according to claim 1, wherein according to described from playback equipment and the main playback equipment
The pointer of playback progress difference, the change data buffer zone from playback equipment is directed toward, comprising:
According to the playback progress difference and the data from playback equipment from playback equipment and the main playback equipment
The capacity of cache blocks, the object pointer for calculating the data buffer zone from playback equipment are directed toward；
It is directed toward according to the object pointer, change is described to be directed toward from the pointer of playback equipment.
7. the method according to claim 1, wherein the pointer of the change data buffer zone from playback equipment
After direction, the method also includes:
Judge whether the timestamp of the video data decoded from playback equipment was greater than when the preceding pipeline time, wherein institute
It states the pipeline time and is directed toward the value of corresponding data cache blocks and the product of data cache block capacity equal to current pointer；
If it is greater than the preceding pipeline time is worked as, then corresponding video cache area is written into the decoded video data.
8. the method according to claim 1, wherein obtaining the playback progress of main playback equipment, comprising:
Obtain the currently playing progress of main playback equipment；
By the currently playing progress of the main playback equipment, the main playback equipment and when from network delay between playback equipment
Between and the sum of the display delay time from playback equipment, as the playback progress from playback equipment.
9. a kind of more device plays progress synchronizing devices, which is characterized in that described device includes:
Playback progress obtains module: for obtaining main playback equipment and from the playback progress of playback equipment；
Playback progress judgment module: whether judgement is described synchronous from playback equipment and the playback progress of the main playback equipment；
Pointer is directed toward adjustment module: if for asynchronous, according to the broadcasting from playback equipment and the main playback equipment
The pointer of progress difference, the change data buffer zone from playback equipment is directed toward；
Wherein, the data buffer zone is made of multiple data cache blocks；The pointer is directed toward, will be from which number for expression
It is read data to according to cache blocks described from the audio and video playing module in playback equipment.
10. a kind of terminal device, which is characterized in that the terminal device includes more device plays progresses as claimed in claim 9
Synchronizing device, the audio and video display device being connect with more device plays progress synchronizing devices.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811447231.1A CN109218795B (en) | 2018-11-29 | 2018-11-29 | Multi-device playing progress synchronization method and device and terminal device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811447231.1A CN109218795B (en) | 2018-11-29 | 2018-11-29 | Multi-device playing progress synchronization method and device and terminal device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109218795A true CN109218795A (en) | 2019-01-15 |
| CN109218795B CN109218795B (en) | 2021-09-24 |
Family
ID=64994528
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811447231.1A Active CN109218795B (en) | 2018-11-29 | 2018-11-29 | Multi-device playing progress synchronization method and device and terminal device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109218795B (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111327911A (en) * | 2020-03-12 | 2020-06-23 | 山东云缦智能科技有限公司 | Method for synchronizing video frames in multi-view live scene |
| CN111541926A (en) * | 2020-05-08 | 2020-08-14 | 浙江大华技术股份有限公司 | Multimedia file playing method and device, storage medium and electronic device |
| CN112040288A (en) * | 2020-09-04 | 2020-12-04 | 华人运通(上海)云计算科技有限公司 | Multimedia system |
| WO2020253844A1 (en) * | 2019-06-19 | 2020-12-24 | 华为技术有限公司 | Method and device for processing multimedia information, and storage medium |
| CN112188258A (en) * | 2020-09-22 | 2021-01-05 | 上海商泰汽车信息系统有限公司 | Pause synchronization method and device, storage medium, user side and multi-device playing system |
| CN112702620A (en) * | 2020-12-29 | 2021-04-23 | 四川长虹电器股份有限公司 | Method for realizing multi-screen synchronous playing of player based on gstreamer |
| CN112887769A (en) * | 2021-01-21 | 2021-06-01 | 海信视像科技股份有限公司 | Display device |
| CN113055728A (en) * | 2021-03-31 | 2021-06-29 | 海信电子科技(武汉)有限公司 | Multi-device synchronous playing method and display device |
| WO2022052734A1 (en) * | 2020-09-08 | 2022-03-17 | 京东方科技集团股份有限公司 | Method and apparatus for synchronized video playing among multiple devices |
| CN114827681A (en) * | 2022-04-24 | 2022-07-29 | 咪咕视讯科技有限公司 | Video synchronization method and device, electronic equipment, terminal equipment and storage medium |
| CN115426514A (en) * | 2022-07-22 | 2022-12-02 | 北京罗克维尔斯科技有限公司 | Cross-device audio and video synchronization method, device, equipment and medium |
| WO2023070374A1 (en) * | 2021-10-27 | 2023-05-04 | 京东方科技集团股份有限公司 | Audio and video synchronization method and apparatus, storage medium, and electronic device |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101106724A (en) * | 2006-07-12 | 2008-01-16 | 联发科技股份有限公司 | Method and system for synchronizing audio and video data |
| CN103391467A (en) * | 2013-07-16 | 2013-11-13 | 四川省迪特尔电子有限公司 | Method for achieving synchronization of decoding and displaying of audio and video of network set-top box |
| US20140059134A1 (en) * | 2012-08-24 | 2014-02-27 | Realtek Semiconductor Corp. | Multimedia delivery system and related computer program product for providing statistical graph related to auxiliary multimedia data |
| CN103839558A (en) * | 2012-11-23 | 2014-06-04 | 三星电子（中国）研发中心 | Method and server for synchronous playing and player |
| US20150067186A1 (en) * | 2013-09-04 | 2015-03-05 | Qualcomm Icorporated | Dynamic and automatic control of latency buffering for audio/video streaming |
| CN105612743A (en) * | 2013-08-30 | 2016-05-25 | 微软技术许可有限责任公司 | Audio video playback synchronization for encoded media |
| US20170142430A1 (en) * | 2011-08-16 | 2017-05-18 | Destiny Software Productions Inc. | Script-based video rendering |
| CN107360475A (en) * | 2017-08-18 | 2017-11-17 | 苏州科可瑞尔航空技术有限公司 | Audio video synchronization plays and control method, control terminal and playback terminal |
| CN107959659A (en) * | 2016-10-17 | 2018-04-24 | 杭州海康威视数字技术股份有限公司 | A kind of flow medium play control method, device and electronic equipment |
| CN108156498A (en) * | 2017-11-13 | 2018-06-12 | 青岛海信电器股份有限公司 | A kind of method and device of audio-visual synchronization |
| CN108200481A (en) * | 2017-12-07 | 2018-06-22 | 北京佳讯飞鸿电气股份有限公司 | A kind of RTP-PS method for stream processing, device, equipment and storage medium |
| CN108540829A (en) * | 2018-04-12 | 2018-09-14 | 青岛海信电器股份有限公司 | A kind of more playback equipment synchronous broadcast methods, system and terminal |
| CN108737874A (en) * | 2018-06-05 | 2018-11-02 | 武汉斗鱼网络科技有限公司 | A kind of video broadcasting method and electronic equipment |
-
2018
- 2018-11-29 CN CN201811447231.1A patent/CN109218795B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101106724A (en) * | 2006-07-12 | 2008-01-16 | 联发科技股份有限公司 | Method and system for synchronizing audio and video data |
| US20170142430A1 (en) * | 2011-08-16 | 2017-05-18 | Destiny Software Productions Inc. | Script-based video rendering |
| US20140059134A1 (en) * | 2012-08-24 | 2014-02-27 | Realtek Semiconductor Corp. | Multimedia delivery system and related computer program product for providing statistical graph related to auxiliary multimedia data |
| CN103839558A (en) * | 2012-11-23 | 2014-06-04 | 三星电子（中国）研发中心 | Method and server for synchronous playing and player |
| CN103391467A (en) * | 2013-07-16 | 2013-11-13 | 四川省迪特尔电子有限公司 | Method for achieving synchronization of decoding and displaying of audio and video of network set-top box |
| CN105612743A (en) * | 2013-08-30 | 2016-05-25 | 微软技术许可有限责任公司 | Audio video playback synchronization for encoded media |
| US20150067186A1 (en) * | 2013-09-04 | 2015-03-05 | Qualcomm Icorporated | Dynamic and automatic control of latency buffering for audio/video streaming |
| CN107959659A (en) * | 2016-10-17 | 2018-04-24 | 杭州海康威视数字技术股份有限公司 | A kind of flow medium play control method, device and electronic equipment |
| CN107360475A (en) * | 2017-08-18 | 2017-11-17 | 苏州科可瑞尔航空技术有限公司 | Audio video synchronization plays and control method, control terminal and playback terminal |
| CN108156498A (en) * | 2017-11-13 | 2018-06-12 | 青岛海信电器股份有限公司 | A kind of method and device of audio-visual synchronization |
| CN108200481A (en) * | 2017-12-07 | 2018-06-22 | 北京佳讯飞鸿电气股份有限公司 | A kind of RTP-PS method for stream processing, device, equipment and storage medium |
| CN108540829A (en) * | 2018-04-12 | 2018-09-14 | 青岛海信电器股份有限公司 | A kind of more playback equipment synchronous broadcast methods, system and terminal |
| CN108737874A (en) * | 2018-06-05 | 2018-11-02 | 武汉斗鱼网络科技有限公司 | A kind of video broadcasting method and electronic equipment |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020253844A1 (en) * | 2019-06-19 | 2020-12-24 | 华为技术有限公司 | Method and device for processing multimedia information, and storage medium |
| CN111327911A (en) * | 2020-03-12 | 2020-06-23 | 山东云缦智能科技有限公司 | Method for synchronizing video frames in multi-view live scene |
| CN111541926B (en) * | 2020-05-08 | 2022-05-03 | 浙江大华技术股份有限公司 | Multimedia file playing method and device, storage medium and electronic device |
| CN111541926A (en) * | 2020-05-08 | 2020-08-14 | 浙江大华技术股份有限公司 | Multimedia file playing method and device, storage medium and electronic device |
| CN112040288A (en) * | 2020-09-04 | 2020-12-04 | 华人运通(上海)云计算科技有限公司 | Multimedia system |
| WO2022052734A1 (en) * | 2020-09-08 | 2022-03-17 | 京东方科技集团股份有限公司 | Method and apparatus for synchronized video playing among multiple devices |
| CN112188258A (en) * | 2020-09-22 | 2021-01-05 | 上海商泰汽车信息系统有限公司 | Pause synchronization method and device, storage medium, user side and multi-device playing system |
| CN112702620A (en) * | 2020-12-29 | 2021-04-23 | 四川长虹电器股份有限公司 | Method for realizing multi-screen synchronous playing of player based on gstreamer |
| CN112887769A (en) * | 2021-01-21 | 2021-06-01 | 海信视像科技股份有限公司 | Display device |
| CN112887769B (en) * | 2021-01-21 | 2023-09-19 | 青岛海信传媒网络技术有限公司 | Display equipment |
| CN113055728A (en) * | 2021-03-31 | 2021-06-29 | 海信电子科技(武汉)有限公司 | Multi-device synchronous playing method and display device |
| WO2023070374A1 (en) * | 2021-10-27 | 2023-05-04 | 京东方科技集团股份有限公司 | Audio and video synchronization method and apparatus, storage medium, and electronic device |
| CN114827681A (en) * | 2022-04-24 | 2022-07-29 | 咪咕视讯科技有限公司 | Video synchronization method and device, electronic equipment, terminal equipment and storage medium |
| CN114827681B (en) * | 2022-04-24 | 2024-03-22 | 咪咕视讯科技有限公司 | Video synchronization method, device, electronic equipment, terminal equipment and storage medium |
| CN115426514A (en) * | 2022-07-22 | 2022-12-02 | 北京罗克维尔斯科技有限公司 | Cross-device audio and video synchronization method, device, equipment and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109218795B (en) | 2021-09-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109218795A (en) | A kind of more device plays progress synchronous method, device and terminal device | |
| CN103839558B (en) | Synchronous broadcast method and server, player | |
| EP3598761A1 (en) | Method and device for synthesizing audio and video data stream | |
| CN110581973B (en) | Data playback method and device, terminal equipment and storage medium | |
| KR100902013B1 (en) | Tiled-display system and synchronization method in the system | |
| KR20160010507A (en) | Method and apparatus for processing video images | |
| CN1981524A (en) | Information processing device and method, recording medium, and program | |
| US20190364346A1 (en) | Methods, systems, and media for synchronizing audio and video content on multiple media devices | |
| CN101119461B (en) | System and method for maintaining video frame and audio frame synchronous broadcasting | |
| CN108540829B (en) | Synchronous playing method, system and terminal for multi-playing device | |
| KR20090106973A (en) | System and method for synchronization of television signals associated with multiple broadcast networks | |
| CN101419827A (en) | Method for synchronzing audio and video data in avi file | |
| CN109379619A (en) | Sound draws synchronous method and device | |
| CN111954050B (en) | Method and system for synchronizing videos among multiple devices | |
| CN108366283A (en) | The media sync playback method of more equipment rooms | |
| KR102566550B1 (en) | Method of display playback synchronization of digital contents in multiple connected devices and apparatus using the same | |
| CN107135413A (en) | A kind of audio and video synchronization method and system | |
| CN107770569A (en) | Multimedia synchronous broadcast method, apparatus and system | |
| CN109040819A (en) | Playback progress synchronous method, device, equipment and storage medium | |
| CN104823176A (en) | Playback synchronization in group viewing media title | |
| KR101600891B1 (en) | Synchronization method and system for audio and video of a plurality terminal | |
| CN108156498B (en) | Audio and video synchronization method and device | |
| CN106060680B (en) | A kind of playback progress synchronous method and device | |
| CN113473191B (en) | Multi-device advertisement synchronous playing method and device, computer device and storage medium | |
| KR101682978B1 (en) | Precision Time Protocol . |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 266555 Qingdao economic and Technological Development Zone, Shandong, Hong Kong Road, No. 218 Applicant after: Hisense Video Technology Co., Ltd Address before: 266555 Qingdao economic and Technological Development Zone, Shandong, Hong Kong Road, No. 218 Applicant before: HISENSE ELECTRIC Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |