CN114143584A - Broadcasting system and method for realizing synchronous broadcasting among multiple terminals - Google Patents
Broadcasting system and method for realizing synchronous broadcasting among multiple terminals Download PDFInfo
- Publication number
- CN114143584A CN114143584A CN202111156509.1A CN202111156509A CN114143584A CN 114143584 A CN114143584 A CN 114143584A CN 202111156509 A CN202111156509 A CN 202111156509A CN 114143584 A CN114143584 A CN 114143584A
- Authority
- CN
- China
- Prior art keywords
- playing
- terminal
- synchronous
- broadcasting
- audio
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000001360 synchronised effect Effects 0.000 title claims abstract description 72
- 238000000034 method Methods 0.000 title claims abstract description 31
- 238000006243 chemical reaction Methods 0.000 claims abstract description 8
- 238000004806 packaging method and process Methods 0.000 claims description 23
- 238000004519 manufacturing process Methods 0.000 claims description 15
- 238000005538 encapsulation Methods 0.000 claims description 10
- 238000009826 distribution Methods 0.000 description 5
- 108700041286 delta Proteins 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 230000003139 buffering effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 238000011056 performance test Methods 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Computer Security & Cryptography (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a broadcasting method and a system for realizing synchronous broadcasting among multiple terminals, wherein the method comprises the following steps: s1, a source content marking reference time stamp step, which is used to ensure that after the terminal receives the data, the reference time stamp of the audio and video data is obtained by accurately restoring each frame of audio and video data directly or in a conversion mode; s2, connecting the synchronous server, judging whether the connection is successful, if not, prompting an error; if the connection is successful, performing terminal playing; s3, a main terminal playing step, wherein after the main terminal starts playing, the main terminal reports the current playing progress and state information to the synchronous service; and S4, a slave terminal playing step, when the slave terminal starts playing, firstly pulling the current playing progress and state information of the master terminal from the synchronous service, simultaneously pulling the media stream, and then setting the data offset for starting playing according to the target of synchronous playing with the master terminal to start playing.
Description
Technical Field
The invention belongs to the technical field of streaming media production and playing, and particularly relates to a playing system and method for realizing synchronous playing among multiple terminals.
Background
When the same program source is played, if the program source is played through a plurality of different types of intelligent terminal devices, users often want to realize synchronous playing, that is, pictures viewed at any time on different playing devices are synchronous.
Generally, to achieve picture synchronization between terminals, each terminal needs to know clearly that, at the time of a common reference clock C, a picture with an original timestamp T needs to be played, so that the pictures are synchronized. The original timestamp refers to that in a production link, audio and video data producers define a common reference time axis according to playing effects, as shown in fig. 1, audio frames 0 to M are arranged in time sequence, and video frames 0 to N are also arranged in time sequence. However, referring to fig. 2, since the transmission of streaming media often goes through many links, including content production (1 audio data and 1 video data), format encapsulation (2-way), distribution channel (3-way), and playing terminal (3-way), the problems faced are:
(1) on different terminals, the clocks cannot realize accurate synchronization, that is, a common reference clock C for realizing synchronization is lacked; if accurate time service is to be realized, the cost of the terminal is increased.
(2) Time stamping is the most important means of identifying video frames in current video technology. However, in an actual use environment, the same content is often packaged into different packaging formats and then distributed, because different packaging formats often have different time expression modes, that is, frames with a timestamp T during production of a link are different in definition of the packaging formats after packaging, different forms of conversion are performed, for example, some may become an incremental number from 0, some may change a time unit, some may overflow due to data accuracy, and the like), so that a terminal cannot find a corresponding video frame according to the timestamp.
(3) The distribution link may generate unpredictable delay, which may cause a great difference in the time of arrival of the same frame data at the terminal.
Due to the above factors, the content played on different terminal devices is fast or slow, and synchronization cannot be realized.
Disclosure of Invention
The technical problem to be solved by the present invention is to provide a broadcasting method and system for realizing synchronous broadcasting among multiple terminals, which is used for eliminating the broadcasting time difference among the multiple terminals as much as possible on the premise of not requiring accurate time service synchronization for the terminals.
In order to solve the technical problems, the invention adopts the following technical scheme:
an embodiment of the present invention provides a method for implementing synchronous play among multiple terminals, which is characterized by comprising the following steps:
s1, a source content marking reference time stamp step, which is used to ensure that after the terminal receives the data, the reference time stamp of the audio and video data is obtained by accurately restoring each frame of audio and video data directly or in a conversion mode;
s2, connecting the synchronous server, judging whether the connection is successful, if not, prompting an error; if the connection is successful, performing terminal playing;
s3, a main terminal playing step, wherein after the main terminal starts playing, the main terminal reports the current playing progress and state information to the synchronous service;
and S4, a slave terminal playing step, when the slave terminal starts playing, firstly pulling the current playing progress and state information of the master terminal from the synchronous service, simultaneously pulling the media stream, and then setting the data offset for starting playing according to the target of synchronous playing with the master terminal to start playing.
Preferably, in S1, in the packaging step, each frame of audio/video data is respectively attached with its original reference timestamp in the media packaging format, and the reference timestamps are continuously increased according to the playing order.
Preferably, in S1, reference timestamps are periodically stamped in the code stream, and the terminal calculates and restores the reference timestamp corresponding to a certain frame by using the timestamp defined by the encapsulation format itself.
Preferably, in S3, the master terminal transmits the status information at regular time intervals.
Preferably, in S3, the master terminal transmits the status information when the status is changed.
Still another aspect of embodiments of the present invention provides a broadcasting system for implementing synchronized broadcasting among multiple terminals, including a content producing side, a synchronization server, a master terminal and at least one slave terminal,
the content production end is used for carrying out content marking of the source end reference time stamp, and ensuring that the reference time stamp of the audio and video data is accurately obtained by directly or in a conversion mode for each frame of audio and video data after the terminal receives the data;
the synchronous server is used for connecting the master terminal and the slave terminal, and playing the terminals after the connection is successful;
the main terminal is used for reporting the current playing progress and the state information to the synchronous service after the playing is started;
the slave terminal is used for pulling the current playing progress and state information of the corresponding master terminal from the synchronous server when the playing is started, simultaneously pulling the media stream, and then setting the data offset for starting the playing according to the target of the synchronous playing with the master terminal to start the playing.
Preferably, in the content production end, in the packaging link, an original reference timestamp is respectively attached to each frame of audio/video data in the media packaging format, and the reference timestamps continuously increase in the playing sequence.
Preferably, in the content production end, reference timestamps are periodically stamped in the code stream, and the terminal calculates and restores the reference timestamp corresponding to a certain frame by using the timestamp defined by the packaging format itself.
Preferably, the master terminal transmits the status information at certain time intervals.
Preferably, the master terminal transmits the status information when the status is changed.
The invention has the following beneficial effects:
(1) the synchronous broadcasting of the streaming media of different types of terminals and different distribution channels can be realized;
(2) cross-terminal interactions (including but not limited to captions, advertisements, etc.) may be implemented.
Drawings
FIG. 1 is a diagram illustrating a prior art reference time setting for an audio/video frame;
FIG. 2 is a flow chart illustrating the production, distribution and consumption of audio and video contents in the prior art;
fig. 3 is a flowchart illustrating steps of a broadcast method for implementing synchronous broadcast among multiple terminals according to an embodiment of the present invention;
fig. 4 is a data flow chart of a broadcast method for implementing synchronous broadcast among multiple terminals according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a broadcast system for implementing synchronous broadcast between multiple terminals according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 3, a broadcasting method for implementing synchronous broadcasting among multiple terminals according to an embodiment of the present invention is shown, including the following steps:
s1, a source content time stamp marking step is used for ensuring that after the terminal receives the data, the reference time stamps of the audio and video data are obtained by accurately restoring each frame of audio and video data directly or in a conversion mode;
s2, connecting the synchronous server, judging whether the connection is successful, if not, prompting an error; if the connection is successful, performing terminal playing; by connecting the synchronous server, the master terminal and the slave terminal can adjust synchronous playing.
S3, a main terminal playing step, wherein after the main terminal starts playing, the main terminal reports the current playing progress and state information to the synchronous service;
and S4, a slave terminal playing step, when the slave terminal starts playing, firstly pulling the current playing progress and state information of the master terminal from the synchronous service, simultaneously pulling the media stream, and then setting the data offset for starting playing according to the target of synchronous playing with the master terminal to start playing.
In S1, the reference timestamp will be referred to as a common reference between different terminals. The generated content may be distributed through conventional content distribution channels (e.g., CDNs). For the setting of the reference time stamp, different ways may be selected.
In an embodiment of the present invention, the timestamp is set in the following manner: in the packaging link, an original reference timestamp T is respectively attached to each frame of audio and video data in a media packaging format, and the reference timestamp meets the condition of continuously increasing according to the playing sequence while the timestamp accords with the packaging format specification. Some optimization methods may also be used if the encapsulation format fails to attach a reference timestamp for each frame.
In another embodiment of the present invention, the reference timestamp is set in the following manner: the reference time stamp T is periodically printed in the code stream, and the terminal may calculate and restore the reference time stamp corresponding to a certain frame by using the time stamp (to distinguish the original reference time stamp, hereinafter denoted by P) defined by the encapsulation format itself. For example, a sequence of video frames F0，F1，F2，F3，F4，F5Known as F0Timestamp P0And its corresponding reference timestamp is T0Then video frame F5(time stamp is P5) Corresponding reference time stamp T5＝T0+(P5-P0)。
In S3 and S4, the playing schedule includes the mark information (reference timestamp) corresponding to the currently played audio-video frame in the packaging format, the clock of the current terminal device, and the like. The playing state information includes events of playing, buffering, pausing, etc. which have obvious influence on the playing progress.
In the embodiment of the invention, the terminal can select to send the playing state at a certain time interval so as to reduce the data transmission quantity with the server. In other embodiments of the present invention, it is also possible to select to transmit only when the playing status changes (e.g., the playing is paused, the playing speed changes, the playing resumes to normal, etc.), so as to further reduce the data amount.
In the embodiment of the present invention, in the process of performing synchronization determination, in S4, since each step of video processing needs to consume a certain amount of time and the consumed time is different on different terminal devices, the terminal needs to first perform a performance test on the consumed time of each module in its own audio/video processing flow to obtain accurate consumed time data of each module. According to the data, the whole time consumption of processing and rendering can be calculated for the data frames with any given time stamp, so that a direct basis is provided for accurate fixed-point playing; each terminal should also get the time consumed for interaction with the synchronization service; according to the factors, corresponding advance processing is added when positioning is carried out. Referring to fig. 4, the specific implementation process is as follows: the master terminal reports the state to the synchronous server, and the method comprises the following steps: play position P0 and local clock Ta(0) And a play status S0; the synchronous server records the following information to a database, including a main playing end and a local clock T of the synchronous server when receiving the informationb(0) Master terminal clock Ta(0) A main terminal playing state S0 and a main terminal delay RTT 0; estimating the playing delay delta 1 of the slave terminal; requesting the state of the master terminal from the slave terminal and recording the current local clock as Tc(0) (ii) a The synchronous server records the time T of receiving the requestb(1) (ii) a Reading data from database by synchronous server, recording time T of sending requestb(2) (ii) a Seventhly, recording the time Tc (1) of receiving the reply from the terminal, and calculating the time delay RTT1 from the terminal ((T)c(1)-Tc(0))-(Tb(2)-Tb(1) B)/2, and calculates the time point P1 (P0 + RTT0+ (T) at which the slave terminal should request the playingb(2)-Tb(0) + RTT1, play delay P1 ═ P1- δ 1; r P1' and Tc(1) And the starting points are respectively used as the starting point of the stream timestamp and the starting point of the local clock for verifying and judging whether the progress is correct in the subsequent playing process.
Corresponding to the method embodiment of the present invention, referring to fig. 5, a broadcast system for implementing synchronous broadcast among multiple terminals according to the embodiment of the present invention is shown, which includes a content production end, a streaming media server, a synchronization server, a master terminal and at least one slave terminal, where the content production end is configured to perform source-end reference timestamp marking, and ensure that after the terminal receives data, the reference timestamps of audio and video data are obtained by accurately restoring each frame of audio and video data directly or in a conversion manner; the streaming media server is used for transmitting the content from the content production end to the terminal; the synchronous server is used for connecting the master terminal and the slave terminal, and playing the terminals after the connection is successful; the main terminal is used for reporting the current playing progress and the state information to the synchronous service after the playing is started; the slave terminal is used for pulling the current playing progress and state information of the corresponding master terminal from the synchronous server when the playing is started, simultaneously pulling the media stream, and then setting the data offset for starting the playing according to the target of the synchronous playing with the master terminal to start the playing.
In an embodiment of the present invention, the setting mode of the reference timestamp is as follows: in the packaging link, an original reference timestamp T is respectively attached to each frame of audio and video data in a media packaging format, and the reference timestamp meets the condition of continuously increasing according to the playing sequence while the timestamp accords with the packaging format specification. Some optimization methods may also be used if the encapsulation format fails to attach a reference timestamp for each frame.
In another embodiment of the present invention, the reference timestamp is set in the following manner: the reference time stamp T is periodically printed in the code stream, and the terminal may calculate and restore the reference time stamp corresponding to a certain frame by using the time stamp (to distinguish the original reference time stamp, hereinafter denoted by P) defined by the encapsulation format itself. For example, a sequence of video frames F0，F1，F2，F3，F4，F5Known as F0Timestamp P0And its corresponding reference timestamp is T0Then video frame F5(time stamp is P5) Corresponding reference time stamp T5＝T0+(P5-P0)。
In the master terminal and the slave terminal, the playing progress comprises the corresponding marking information (reference timestamp) of the currently played audio and video frame in the packaging format, the clock of the current terminal equipment and the like. The playing state information includes events of playing, buffering, pausing, etc. which have obvious influence on the playing progress.
In the embodiment of the invention, the terminal can select to send the playing state at a certain time interval so as to reduce the data transmission quantity with the server. In other embodiments of the present invention, it is also possible to select to transmit only when the playing status changes (e.g., the playing is paused, the playing speed changes, the playing resumes to normal, etc.), so as to further reduce the data amount.
In the embodiment of the invention, in the playing process of the slave terminal and the synchronous judgment process, as each step of video processing needs to consume a certain time and the consumed time on different terminal devices is different, the terminal needs to firstly perform a performance test on the consumed time of each module in the audio and video processing flow of the terminal so as to obtain the accurate consumed time data of each module. According to the data, the whole time consumption of processing and rendering can be calculated for the data frames with any given time stamp, so that a direct basis is provided for accurate fixed-point playing; each terminal should also get the time consumed for interaction with the synchronization service; according to the factors, corresponding advance processing is added when positioning is carried out. Referring to fig. 4, the specific implementation process is as follows: the master terminal reports the state to the synchronous server, and the method comprises the following steps: play position P0 and local clock Ta(0) And a play status S0; the synchronous server records the following information to a database, including a main playing end and a local clock T of the synchronous server when receiving the informationb(0) Master terminal clock Ta(0) A main terminal playing state S0 and a main terminal delay RTT 0; estimating the playing delay delta 1 of the slave terminal; requesting the state of the master terminal from the slave terminal and recording the current local clock as Tc(0) (ii) a The synchronous server records the time T of receiving the requestb(1) (ii) a Reading data from database by synchronous server, recording time T of sending requestb(2)；⑦The time Tc (1) of receiving the reply is recorded from the terminal, and the RTT1 delayed from the terminal is calculated as (T)c(1)-Tc(0))-(Tb(2)-Tb(1) B)/2, and calculates the time point P1 (P0 + RTT0+ (T) at which the slave terminal should request the playingb(2)-Tb(0) + RTT1, play delay P1 ═ P1- δ 1; r P1' and Tc(1) And the starting points are respectively used as the starting point of the stream timestamp and the starting point of the local clock for verifying and judging whether the progress is correct in the subsequent playing process.
Application example 1: begin playing in sequence
A terminal A starts to play a program source (namely A is used as a main terminal) and starts to report a playing progress to a synchronous service at regular time (comprising a timestamp corresponding to a currently played audio and video frame in a packaging format, a system clock of the current terminal, a playing state of the current terminal and the like);
the terminal B (the terminal B is a slave terminal) selects and plays the same program source and requires to be synchronous with the terminal A;
b, acquiring the playing progress of A from the synchronous server, and calculating to obtain a starting point according to the progress information of A to play
And B, continuously receiving the playing progress from A in the playing process and ensuring the synchronization with the sound and the picture of A.
Application example 2: midway synchronization of playing
The two terminals (A, B) independently start to play the same live program source and start to report the playing progress (including the timestamp corresponding to the currently played audio and video frame in the packaging format, the system clock of the current terminal, the playing state of the current terminal, etc.) to the synchronous server at regular time;
wherein the terminal B (slave terminal) is set to follow the terminal A (master terminal) halfway;
b, acquiring the playing progress of A from the synchronization server, and adjusting the current playing progress according to the progress information of A to ensure the synchronization with the sound and the picture of A;
and B, continuously receiving the playing progress from A in the playing process and ensuring the synchronization with the sound and the picture of A.
Application example 3: during the playing process, the playing of A is interrupted or changed in other forms
Two terminals (A is a main terminal, B is a slave terminal) synchronously play the same program source and start to report the playing progress (comprising a timestamp corresponding to the currently played audio and video frame in a packaging format, a system clock of the current terminal, the playing state of the current terminal and the like) to a synchronous service at regular time;
the playing on the terminal A is suspended, and the A reports the playing state as suspended to the synchronous server;
the synchronous server informs the terminal B that the terminal B is also suspended immediately;
the playing on the terminal A is recovered, and the B reports the playing state to the synchronous server;
and the synchronous server informs the terminal B, and the terminal B starts playing from the specified position according to the current playing progress of the terminal A.
Application example 4: multiple slave terminals
The terminal A, B independently starts playing the same live program source and regularly reports the playing progress (including the timestamp corresponding to the currently played audio/video frame in the packaging format, the system clock of the current terminal, the playing state of the current terminal, etc.) to the synchronization server;
the terminal B is set to follow the slave terminal of the terminal A midway, the playing progress of the terminal A is obtained from the synchronization server, and the current playing progress is continuously adjusted according to the progress information of the terminal A so as to ensure the synchronization with the sound and the picture of the terminal A;
setting a terminal C as a following terminal A, acquiring the playing progress of the terminal A from the synchronization server, and setting a playing starting position according to the progress information of the terminal A so as to ensure the sound and picture synchronization with the sound and picture of the terminal A; and in the playing process, the synchronous operation is continuously kept.
It is to be understood that the exemplary embodiments described herein are illustrative and not restrictive. Although one or more embodiments of the present invention have been described with reference to the accompanying drawings, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention as defined by the following claims.
Claims (10)
1. A broadcasting method for realizing synchronous broadcasting among a plurality of terminals is characterized by comprising the following steps:
s1, a source content marking reference time stamp step, which is used to ensure that after the terminal receives the data, the reference time stamp of the audio and video data is obtained by accurately restoring each frame of audio and video data directly or in a conversion mode;
s2, connecting the synchronous server, judging whether the connection is successful, if not, prompting an error; if the connection is successful, performing terminal playing;
s3, a main terminal playing step, wherein after the main terminal starts playing, the main terminal reports the current playing progress and state information to the synchronous service;
and S4, a slave terminal playing step, when the slave terminal starts playing, firstly pulling the current playing progress and state information of the master terminal from the synchronous service, simultaneously pulling the media stream, and then setting the data offset for starting playing according to the target of synchronous playing with the master terminal to start playing.
2. The playing method of claim 1, wherein in S1, in the encapsulation step, each frame of audio/video data is respectively attached with its original reference timestamp in the media encapsulation format, and the reference timestamps are continuously increased according to the playing order.
3. The playing method of claim 1, wherein in S1, reference timestamps are periodically stamped in the code stream, and the terminal obtains the reference timestamp corresponding to a certain frame by calculation and restoration using the timestamp defined by the encapsulation format itself.
4. A playout method as claimed in any one of claims 1 to 3, wherein the master terminal sends the status information at regular time intervals in S3.
5. A playout method as claimed in any one of claims 1 to 3, wherein the master terminal sends status information when the status changes S3.
6. A broadcasting system for realizing synchronous broadcasting among a plurality of terminals is characterized by comprising a content production end, a synchronous server, a main terminal and at least one slave terminal,
the content production end is used for marking the source end content reference time stamp, and ensuring that the terminal accurately restores each frame of audio and video data to obtain the reference time stamp of the audio and video data directly or in a conversion mode after receiving the data;
the synchronous server is used for connecting the master terminal and the slave terminal, and playing the terminals after the connection is successful;
the main terminal is used for reporting the current playing progress and the state information to the synchronous service after the playing is started;
the slave terminal is used for pulling the current playing progress and state information of the corresponding master terminal from the synchronous server when the playing is started, simultaneously pulling the media stream, and then setting the data offset for starting the playing according to the target of the synchronous playing with the master terminal to start the playing.
7. The broadcasting system for implementing synchronous broadcasting among multiple terminals as claimed in claim 1, wherein in the content production end, in the packaging step, each frame of audio/video data is respectively attached with its original reference timestamp in the media packaging format, and the reference timestamps are continuously increased according to the broadcasting sequence.
8. The broadcasting system for implementing synchronous broadcasting among multiple terminals as claimed in claim 1, wherein in the content production end, reference timestamps are periodically printed on the code stream, and the terminal obtains the reference timestamp corresponding to a certain frame by calculation and restoration using the timestamp defined by the encapsulation format itself.
9. A playout system as claimed in any one of claims 1 to 3, wherein the master terminal sends the status information at regular time intervals.
10. A playout system as claimed in any one of claims 1 to 3 wherein the master terminal sends status information when a change in status occurs.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111156509.1A CN114143584B (en) | 2021-09-29 | 2021-09-29 | Broadcasting system and method for realizing synchronous broadcasting among multiple terminals |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111156509.1A CN114143584B (en) | 2021-09-29 | 2021-09-29 | Broadcasting system and method for realizing synchronous broadcasting among multiple terminals |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114143584A true CN114143584A (en) | 2022-03-04 |
| CN114143584B CN114143584B (en) | 2024-03-26 |
Family
ID=80394079
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111156509.1A Active CN114143584B (en) | 2021-09-29 | 2021-09-29 | Broadcasting system and method for realizing synchronous broadcasting among multiple terminals |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114143584B (en) |
Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040170383A1 (en) * | 2003-02-13 | 2004-09-02 | Leszek Mazur | System and method for real-time data archival |
| CN101207809A (en) * | 2006-12-19 | 2008-06-25 | 浙江工业大学 | Method and system for transmitting real time flow media based on video frequency frame splitting |
| CN103209360A (en) * | 2013-03-04 | 2013-07-17 | 北京小米科技有限责任公司 | Multi-party video sharing method and device |
| CN103533388A (en) * | 2013-10-25 | 2014-01-22 | 潘伟洲 | Method and system for synchronously playing multimedia files |
| CN103561356A (en) * | 2013-05-31 | 2014-02-05 | 华为技术有限公司 | Multi-terminal synchronous playing method and device |
| CN103839558A (en) * | 2012-11-23 | 2014-06-04 | 三星电子（中国）研发中心 | Method and server for synchronous playing and player |
| CN104378675A (en) * | 2014-12-08 | 2015-02-25 | 厦门雅迅网络股份有限公司 | Multichannel audio-video synchronized playing processing method |
| CN104602037A (en) * | 2015-02-10 | 2015-05-06 | 福州瑞芯微电子有限公司 | Method, device, terminal and system for controlling synchronous playing of multiple devices |
| CN104683823A (en) * | 2013-11-29 | 2015-06-03 | 红板凳科技股份有限公司 | Multi-screen linked audio and video synchronizing system |
| WO2015188629A1 (en) * | 2014-06-13 | 2015-12-17 | Tencent Technology (Shenzhen) Company Limited | Method and system for client-server real-time interaction based on streaming media |
| CN106162236A (en) * | 2015-03-23 | 2016-11-23 | 腾讯科技（深圳）有限公司 | A kind of method and device of sharing video frequency |
| CN107682715A (en) * | 2016-08-01 | 2018-02-09 | 腾讯科技（深圳）有限公司 | Video synchronization method and device |
| CN110035311A (en) * | 2019-04-04 | 2019-07-19 | 网宿科技股份有限公司 | A kind of methods, devices and systems that message flow and audio/video flow is played simultaneously |
| CN111541926A (en) * | 2020-05-08 | 2020-08-14 | 浙江大华技术股份有限公司 | Multimedia file playing method and device, storage medium and electronic device |
| CN112383795A (en) * | 2021-01-12 | 2021-02-19 | 北京清奇科技有限公司 | Video synchronous playing system |
| KR20210078985A (en) * | 2019-12-19 | 2021-06-29 | 애드커넥티드 주식회사 | Method of display playback synchronization of digital contents in multiple connected devices and apparatus using the same |
| CN113179441A (en) * | 2021-03-26 | 2021-07-27 | 卡莱特云科技股份有限公司 | Synchronous playing method, device, system and computer equipment |
-
2021
- 2021-09-29 CN CN202111156509.1A patent/CN114143584B/en active Active
Patent Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040170383A1 (en) * | 2003-02-13 | 2004-09-02 | Leszek Mazur | System and method for real-time data archival |
| CN101207809A (en) * | 2006-12-19 | 2008-06-25 | 浙江工业大学 | Method and system for transmitting real time flow media based on video frequency frame splitting |
| CN103839558A (en) * | 2012-11-23 | 2014-06-04 | 三星电子（中国）研发中心 | Method and server for synchronous playing and player |
| CN103209360A (en) * | 2013-03-04 | 2013-07-17 | 北京小米科技有限责任公司 | Multi-party video sharing method and device |
| CN103561356A (en) * | 2013-05-31 | 2014-02-05 | 华为技术有限公司 | Multi-terminal synchronous playing method and device |
| CN103533388A (en) * | 2013-10-25 | 2014-01-22 | 潘伟洲 | Method and system for synchronously playing multimedia files |
| CN104683823A (en) * | 2013-11-29 | 2015-06-03 | 红板凳科技股份有限公司 | Multi-screen linked audio and video synchronizing system |
| WO2015188629A1 (en) * | 2014-06-13 | 2015-12-17 | Tencent Technology (Shenzhen) Company Limited | Method and system for client-server real-time interaction based on streaming media |
| CN104378675A (en) * | 2014-12-08 | 2015-02-25 | 厦门雅迅网络股份有限公司 | Multichannel audio-video synchronized playing processing method |
| CN104602037A (en) * | 2015-02-10 | 2015-05-06 | 福州瑞芯微电子有限公司 | Method, device, terminal and system for controlling synchronous playing of multiple devices |
| CN106162236A (en) * | 2015-03-23 | 2016-11-23 | 腾讯科技（深圳）有限公司 | A kind of method and device of sharing video frequency |
| CN107682715A (en) * | 2016-08-01 | 2018-02-09 | 腾讯科技（深圳）有限公司 | Video synchronization method and device |
| CN110035311A (en) * | 2019-04-04 | 2019-07-19 | 网宿科技股份有限公司 | A kind of methods, devices and systems that message flow and audio/video flow is played simultaneously |
| KR20210078985A (en) * | 2019-12-19 | 2021-06-29 | 애드커넥티드 주식회사 | Method of display playback synchronization of digital contents in multiple connected devices and apparatus using the same |
| CN111541926A (en) * | 2020-05-08 | 2020-08-14 | 浙江大华技术股份有限公司 | Multimedia file playing method and device, storage medium and electronic device |
| CN112383795A (en) * | 2021-01-12 | 2021-02-19 | 北京清奇科技有限公司 | Video synchronous playing system |
| CN113179441A (en) * | 2021-03-26 | 2021-07-27 | 卡莱特云科技股份有限公司 | Synchronous playing method, device, system and computer equipment |
Non-Patent Citations (1)
| Title |
|---|
| 马宏雷;刘儿兀;朱军;: "非对称无线传输信道的音视频同步优化设计", 计算机仿真, no. 02 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114143584B (en) | 2024-03-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11368732B2 (en) | Synchronizing program presentation | |
| CN102857796B (en) | Synchronization and automation in an ITV enviroment | |
| US7606928B2 (en) | Method and device for controlling receiver buffer fullness level in multimedia streaming | |
| KR100482287B1 (en) | Apparatus and method for injection of synchronized stream data in digital broadcasting environment | |
| CN103155584A (en) | Method for synchronizing multimedia flows and corresponding device | |
| CN101202613B (en) | Terminal for clock synchronization | |
| CN113179441A (en) | Synchronous playing method, device, system and computer equipment | |
| EP2592842A1 (en) | Computer-implemented method, computer system, and computer program product for synchronizing output of media data across a plurality of devices | |
| WO2006126852A1 (en) | Method and apparatus for synchronizing data service with video service in digital multimedia broadcasting | |
| KR102566550B1 (en) | Method of display playback synchronization of digital contents in multiple connected devices and apparatus using the same | |
| JP2658962B2 (en) | Network time information synchronization method | |
| CN114143584B (en) | Broadcasting system and method for realizing synchronous broadcasting among multiple terminals | |
| CN106060580A (en) | Synchronous image display method and device | |
| JP2003179662A5 (en) | ||
| CN100544448C (en) | A kind of clock system of mobile multimedia network | |
| CN114268706B (en) | Time timing method and device for camera | |
| EP2871848A1 (en) | Providing correction information for media synchronization | |
| KR20190073058A (en) | Method and apparatus of multichannel media synchronization based on MMT protocol | |
| CN101388750B (en) | Random arrived CMTS time stamp correcting method | |
| CN101202918B (en) | Method of terminal correcting clock | |
| JP2003163691A5 (en) | ||
| CN101237276A (en) | Mobile phone TV single-frequency network synchronization system and method based on mobile network | |
| JP2020022082A (en) | Stream distribution system with segment file division function and program | |
| WO2023238907A1 (en) | Media transmission system, sending device, sending system, reception device, and reception system | |
| CN100571119C (en) | A kind of mobile network of utilization realizes the method for clock synchronization |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |