CN114401432B - MV playing method, playing terminal, server equipment and entertainment equipment system - Google Patents
MV playing method, playing terminal, server equipment and entertainment equipment system Download PDFInfo
- Publication number
- CN114401432B CN114401432B CN202210101258.5A CN202210101258A CN114401432B CN 114401432 B CN114401432 B CN 114401432B CN 202210101258 A CN202210101258 A CN 202210101258A CN 114401432 B CN114401432 B CN 114401432B
- Authority
- CN
- China
- Prior art keywords
- player
- playing
- server
- synchronous
- synchronization
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 230000001360 synchronised effect Effects 0.000 claims abstract description 173
- 230000008569 process Effects 0.000 claims description 24
- 238000002360 preparation method Methods 0.000 claims description 20
- 230000000694 effects Effects 0.000 abstract description 17
- 238000007654 immersion Methods 0.000 abstract description 6
- 241001342895 Chorus Species 0.000 description 30
- HAORKNGNJCEJBX-UHFFFAOYSA-N cyprodinil Chemical compound N=1C(C)=CC(C2CC2)=NC=1NC1=CC=CC=C1 HAORKNGNJCEJBX-UHFFFAOYSA-N 0.000 description 30
- 230000001276 controlling effect Effects 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000001105 regulatory effect Effects 0.000 description 2
- 238000009825 accumulation Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000036316 preload Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Abstract
The application relates to an MV playing method, a playing terminal, server equipment and an entertainment equipment system; the method comprises the following steps: the method comprises the steps that a time synchronization instruction is issued to each player through a synchronization server, and time synchronization is carried out on each player; the synchronous server is respectively communicated with each player; each player loads MV resources needing synchronous playing respectively and decodes video frames of the MV resources; each player reports the decoding completion state of the video frame to the synchronous server, and the synchronous server plays and aligns each player; issuing playing instructions to each player through the synchronous server, and controlling each player to synchronously play the video frames of the MV resources; according to the technical scheme, the time deviation of MV playing can be controlled within a very small range, so that the singing effect in the same occasion is realized, better user experience can be obtained, and the immersion sense is greatly improved.
Description
Technical Field
The application relates to the technical field of audio processing, in particular to an MV playing method, a playing terminal, server equipment and an entertainment equipment system.
Background
In some entertainment scenes, users have chorus demands, traditional KTVs are all in the same room to perform offline chorus, and with the development of technology, users can perform offline chorus, and can also use related network technology to cross space-time limitation to realize online chorus.
For example, in mini KTV room use, users in different KTV rooms may sing online with users in other KTV rooms, enriching the entertainment experience. In the chorus process, the playing terminals in each KTV room can synchronously receive and synchronously process MV resources (audio sources or audio and video sources) when in chorus, so that time deviation between the two playing terminals is reduced, audio accuracy and synchronous effect are improved, and real-time chorus effect is provided for users.
At present, the traditional online chorus technology is generally added in series by all parties involved, accompaniment is mixed by a main singing, the main singing cannot hear the sound of a secondary singing, the traditional online chorus technology belongs to pseudo real-time chorus, so that the occurrence of asynchronous MV resource playing is caused, and the transmission effect on a sound source is poor.
Therefore, in the conventional technology, the MV resources are difficult to synchronously preload and synchronize, and are easily influenced by network congestion, so that the time deviation of online chorus is large, and a user cannot obtain the experience of offline chorus.
Disclosure of Invention
In order to solve one of the technical defects, the application provides an MV playing method, a playing terminal, a server device and an entertainment device system, so as to realize accurate synchronous playing of MVs during online chorus, and improve chorus effects.
An MV playback method, comprising:
the method comprises the steps that a time synchronization instruction is issued to each player through a synchronization server, and time synchronization is carried out on each player; the synchronous server is respectively communicated with each player;
each player loads MV resources needing synchronous playing respectively and decodes video frames of the MV resources;
each player reports the decoding completion state of the video frame to the synchronous server, and the synchronous server plays and aligns each player;
and sending a playing instruction to each player through the synchronous server, and controlling each player to synchronously play the video frames of the MV resources.
In one embodiment, the time synchronization of each player is performed by the synchronization server issuing a time synchronization instruction to each player, including:
and sending an http time synchronization instruction to each player through the server, and connecting each player to the Internet time synchronization server for time synchronization.
In one embodiment, the MV playing method further includes:
in the playing process, each player feeds back the playing progress of the video frames to the synchronous server respectively in a set period; and the synchronous server synchronously calibrates each player according to the playing progress.
In one embodiment, the synchronization server performs synchronization calibration on each player according to the playing progress, including:
the synchronous server compares the playing progress of the players to be synchronized according to the requirement, and when time deviation exists on the playing progress of the video frames by the players, the playing speed of the players is adjusted to perform synchronous calibration.
In one embodiment, adjusting the play speed of the player for synchronization calibration includes:
if the playing progress of the first player is faster than that of the second player, reducing the playing speed of the first player, so that the playing progress of the first player and the playing progress of the second player are realigned;
the first player and the second player are players which need to be synchronized.
In one embodiment, adjusting the play speed of the player for synchronization calibration includes:
if the playing progress of the first player is slower than that of the second player, the playing speed of the second player is increased, so that the playing progress of the first player and the playing progress of the second player are realigned;
the first player and the second player are players which need to be synchronized.
In one embodiment, before the playing speed of the second player is increased, the method further includes:
and acquiring the decoding state of the video frame by the second player, and if the decoding is finished, increasing the playing speed of the second player so that the playing progress of the first player and the playing progress of the second player are realigned.
In one embodiment, the sending, by the synchronization server, a time synchronization instruction to each player, and performing time synchronization on each player includes:
the synchronization server requests the synchronization time to the synchronization signal generator through a network;
after synchronization, the synchronization server transmits a preparation signal to each player through a network; after receiving the preparation signals, each player loads MV resources, decodes MV resource video frames and sends preparation completion signals to the synchronous server through a network;
the step of issuing a playing instruction to each player through the synchronous server to control each player to synchronously play the video frames of the MV resources comprises the following steps:
after receiving the preparation completion signals of all the players, the synchronous server transmits a play starting signal to each player through a network; wherein, the play starting signal has a play starting time parameter;
after receiving the play starting signal, the player waits for a clock signal transmitted by the synchronous signal generator through a serial link; if the time parameter in the clock signal is smaller than the playing starting time parameter, continuing to wait, otherwise, starting playing by the player;
wherein, the playing terminals of each player are respectively connected with a clock signal receiver, and each clock signal receiver is connected with a synchronous signal generator through a serial link; the server device is connected with the synchronous signal generator through a network.
In one embodiment, the synchronization server requests a synchronization time from a synchronization signal generator through a network, including:
the synchronous server sends a request to the synchronous signal generator to acquire the current time of the synchronous signal generator and is attached with the current time T of the synchronous server s Parameters;
the synchronous signal generator returns to the current time T c Synchronous server time parameter T carried by request s ；
The synchronous server receives the returned time parameter to obtain the current time T of the completion of the request s And calculate the request time T q ＝T e －T s ；
The synchronization server calculates a time error T with the synchronization signal generator d ＝(T s +T q /2)－T c And according to time error T d Time synchronization is performed.
In one embodiment, the MV playing method further includes:
a synchronous server sends a playing instruction to a synchronous signal generator to control the synchronous signal generator to periodically generate a clock signal;
in the playing process, each player receives the clock signal through the connected clock signal receiver, and synchronously calibrates the playing progress of each player according to the clock signal.
A playback terminal having at least one player built-in, the player configured to perform the steps of:
receiving a time synchronization instruction issued by a synchronization server, and performing time synchronization with other players; the synchronous server is respectively communicated with each player;
loading MV resources needing synchronous playing, and decoding video frames of the MV resources;
reporting the decoding completion state to a synchronous server respectively, and forwarding the decoding completion state to other players by the synchronous server for playing alignment;
and receiving a playing instruction issued by the synchronous server, and synchronously playing the video frames of the MV resources with other players under the control of the synchronous server.
A server device running a synchronization server configured to perform the steps of:
issuing a time synchronization instruction to each player, and performing time synchronization on each player; the synchronous server is respectively communicated with each player;
controlling each player to load MV resources to be synchronously played respectively, decoding video frames of the MV resources, and receiving decoding completion states reported by each player;
and playing and aligning each player, issuing a playing instruction to each player, and controlling each player to synchronously play the video frames of the MV resources.
An entertainment device system, comprising: the playing terminal and/or the server device.
According to the MV playing method, the playing terminal, the server equipment and the entertainment equipment system, the synchronous server is constructed in the local area network to synchronously control each player, the synchronous server firstly carries out time synchronization on each player, and MV resources needing synchronous playing are loaded respectively to carry out decoding on video frames of the MV resources; then in the process of decoding the video frames, playing and aligning each player, and controlling each player to synchronously play the video frames of the MV resources; according to the technical scheme, in the chorus process, the synchronous server controls each player to synchronously decode the video frames of the MV resources, and synchronously play the video frames after alignment, so that the time deviation of MV playing can be controlled within a minimum range, the singing effect in the same occasion is realized, better user experience can be obtained, and the immersion sense is greatly improved.
Further, a synchronous signal generator and a clock signal receiver are designed for synchronization, the synchronous signal generator provides an interface for a synchronous server through a network to acquire the current time, a time synchronous signal with the parameter of the current time is sent to a player through serial port timing, and the player waits for the time signal of the synchronous signal generator according to the time parameter in the starting playing signal of the synchronous server and starts playing when the starting playing condition is met; according to the technical scheme, unified management of synchronization is achieved, server deployment is reduced, and meanwhile, serial links are utilized to synchronize all players, and synchronization quality can be ensured.
Furthermore, synchronous playing calibration is carried out by utilizing a synchronous signal generator, and in the playing process of MV resources, each player receives a clock signal through a connected clock signal receiver and synchronously calibrates the playing progress of each player according to the clock signal; according to the technical scheme, through a hardware physical connection mode, in the playing process after chorus begins, the synchronous calibration of the accurate playing progress can be carried out, and the effect of the same place singing is improved.
Additional aspects and advantages of the application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the application.
Drawings
The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings, in which:
FIG. 1 is a block diagram of an exemplary MV playback network;
FIG. 2 is a flowchart of an MV playing method according to one embodiment;
FIG. 3 is an exemplary MV synchronous play timing diagram;
FIG. 4 is a synchronized network topology of one embodiment;
fig. 5 is a flow chart of a synchronized playback mechanism.
Detailed Description
Embodiments of the present application are described in detail below, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the drawings are exemplary only for the purpose of illustrating the present application and are not to be construed as limiting the present application.
As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless expressly stated otherwise, as understood by those skilled in the art. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, but do not preclude the presence or addition of one or more other features, integers, steps, operations.
The MV playing method provided by the present application can be applied to a chorus scene, and referring to fig. 1, fig. 1 is an exemplary MV playing network structure diagram, and as illustrated, taking on-line chorus of a mini KTV room as an example, playing terminals 1-n are respectively configured in each KTV room 1-n, when users in at least two KTV rooms need chorus a certain MV (audio or audio-video) song, synchronous playing is performed between the playing terminals in these KTV rooms at this time, and chorus audio-video data is then generated; thereby realizing the singing effect in the same occasion.
Accordingly, the present application provides an MV playing method, in which, by improving a player on a playing terminal and combining with a synchronization server constructed in a local area network, a synchronization server network (internet or local area network) communicates with each player, and the synchronization server runs on a server device, where the server device may be a networked computer device, so as to form a set of MV playing technical solution, for convenience of description, in the following embodiments, synchronization between two players will be described as an example.
Referring to fig. 2, fig. 2 is a flowchart of an MV playback method according to an embodiment, which mainly includes the steps of:
and (1) sending a time synchronization instruction to each player through the synchronization server, and performing time synchronization on each player.
As shown in fig. 3, fig. 3 is an exemplary MV synchronous playing timing chart, in which a playing terminal 1 and a playing terminal 2 are respectively configured in a KTV room 1 and a KTV room 2; each playing terminal is provided with a player, and assuming that chorus synchronization is to be performed between the player 1 and the player 2, the synchronization server issues a time synchronization instruction to the player 1 and the player 2, and performs time synchronization to the player 1 and the player 2.
Preferably, the server issues an http time synchronization instruction to the player 1 and the player 2, and the player 1 and the player 2 are connected to an Internet time synchronization server to perform time synchronization.
And (2) loading MV resources to be synchronously played by each player respectively, and decoding video frames of the MV resources.
After selecting the chorus MV song, the player 1 and the player 2 respectively start to load the MV resources to be played for caching, and start to decode the video frames of the MV resources.
And (3) each player respectively reports the decoding completion state of the video frame to the synchronous server, and the synchronous server plays and aligns each player.
And the player 1 and the player 2 report the decoding completion state of the video frames of the MV resources to the synchronous server by the local playing terminal, and simultaneously align the playing of the video frames by the player 1 and the player 2 to prepare for playing.
And (4) issuing playing instructions to each player through the synchronous server, and controlling each player to synchronously play the video frames of the MV resources.
After the player 1 and the player 2 decode the first frame of video frame, the synchronous server issues a playing instruction to the player 1 and the player 2, and the player 1 and the player 2 download and cache MV resources, decode the video frame and synchronously play the video frame.
According to the technical scheme of the embodiment, the synchronous server is constructed in the local area network to synchronously control each player, the synchronous server firstly carries out time synchronization on each player, and MV resources needing synchronous playing are respectively loaded for carrying out and decoding video frames of the MV resources; then in the process of decoding the video frames, playing and aligning each player, and controlling each player to synchronously play the video frames of the MV resources; according to the technical scheme, in the chorus process, the synchronous server controls each player to synchronously decode the video frames of the MV resources, and synchronously play the video frames after alignment, so that the time deviation of MV playing can be controlled within a minimum range, the singing effect in the same occasion is realized, better user experience can be obtained, and the immersion sense is greatly improved.
In order to further improve the synchronization effect in the MV playing process, the technical scheme of the application can also carry out synchronization calibration in the playing process; accordingly, according to the MV playing method, in the playing process, each player can be controlled to feed back the playing progress of the video frames to the synchronous server respectively in a set period; and the synchronous server synchronously calibrates each player according to the playing progress.
In the above scheme, the playing progress of the video frames is fed back to the synchronization server periodically, and the synchronization server can compare the time deviation between the player 1 and the player 2, and when the time deviation is greater than the set threshold, control and adjust the playing progress of the player 1 and the player 2 so as to avoid that the time deviation accumulation is caused by local area network or equipment factors to affect the synchronous playing effect in the playing process.
In one embodiment, when each player is calibrated synchronously in the playing process, the playing progress of the first player is faster than the playing progress of the second player through the synchronous server; if the playing progress of the first player is faster than that of the second player, the playing speed of the first player is reduced, so that the playing progress of the first player and the playing progress of the second player are realigned.
As in the above embodiment, if there is a time deviation between the playing progress of the player 1 and the playing progress of the player 2, by monitoring the playing progress of the video frames, for example, the video frame currently played by the player 1 (the first player) is 0020 frames, and correspondingly, the video frame currently played by the player 2 (the second player) is 0020 frames; the play-out speed of the player 1 can be reduced at this time so that the progress of the played-out video frames of the player 1 and the player 2 are realigned.
Further, when each player is calibrated synchronously in the playing process, the playing progress of the first player can be obtained through the synchronous server and is faster than that of the second player; if the playing progress of the first player is slower than that of the second player, acquiring the decoding state of the video frame by the second player; if the decoding state is completed, the playing speed of the second player is increased, so that the playing progress of the first player and the playing progress of the second player are realigned.
In the above embodiment, the video frame currently played by the player 1 is 0020 frame, the playing progress of the player 1 is faster, and the playing progress of the player 2 is slower, at this time, by decoding the video frame of the player 2, if the 0020 frame is already decoded, the playing speed of the player 2 can be increased, so that the playing progress of the video frame played by the player 1 and the playing progress of the video frame played by the player 2 are realigned.
According to the technical scheme, in the synchronous control process, the time deviation can be controlled within 10ms, and the accurate synchronous effect is achieved.
In the scheme of implementing the chorus synchronization based on the synchronization server, the synchronization server can be deployed on the internet, and time synchronization between the synchronization server and each player is completed through the internet, and the control logic can be implemented on the synchronization server as long as a small number of synchronization servers are deployed. However, the transmission delay of the internet is larger, and if the time synchronization error between the synchronization server and each player is larger, the chorus quality is easy to be unable to be ensured. In addition, the synchronization server can be deployed in the local area network, the quality of the local area network is guaranteed to a certain extent, the delay time is lower than that of the Internet, but at least one synchronization server needs to be deployed in each local area network, and the probability of delay is increased if the bandwidth occupation is increased as the local area network bears more applications.
In order to further improve synchronization accuracy and avoid the influence of network or equipment factors corresponding to transmission of synchronization related control instructions, the application further provides a hardware-based synchronization scheme based on a synchronization server.
Accordingly, in one embodiment, referring to FIG. 4, FIG. 4 is a synchronized network topology of one embodiment; as shown, a synchronous signal generator and a clock signal receiver are designed, the synchronous signal generator and each clock signal receiver can be connected through an unshielded twisted pair, a serial link is used for physical connection and communication, such as TDM data bus communication, and a server device is connected with the synchronous signal generator through a network. As in the network of fig. 4, the synchronization server is deployed on the internet (or local area network) and can communicate with each player through the internet (or local area network); the synchronous server can also communicate with the synchronous signal generator through the Internet; each player communicates with the synchronization signal generator via a serial link.
For the synchronous server, the synchronous server is responsible for controlling each player to synchronize chorus; for the synchronous signal generator, on one hand, the synchronous signal generator is responsible for providing an interface for a synchronous server through a network to acquire the current time; on the other hand, the time synchronization signal is sent to the player through serial port timing, wherein the signal has the parameter of the current time; for a player, the player is responsible for loading resources such as MVs; and after receiving the start playing signal of the synchronous server, waiting for the time signal of the synchronous signal generator according to the time parameter in the signal, and when the playing starting condition is met (the time parameter in the time signal of the synchronous signal generator is greater than or equal to the time parameter of the start playing signal of the synchronous server), starting playing.
Based on the synchronous playing mechanism of the above technical solution, referring to fig. 5, fig. 5 is a flowchart of the synchronous playing mechanism, which may specifically include the following steps:
the first step, the synchronization server synchronizes time to the synchronization signal generator through a network, and specifically comprises the following steps:
a. the synchronous server sends a request to the synchronous signal generator to acquire the current time of the synchronous signal generator and is attached with the current time T of the synchronous server s Parameters.
b. The synchronous signal generator returns to the current time T c Synchronous server time parameter T carried by request s 。
c. The synchronous server receives the return time parameter and obtains the current time of the completion of the requestTime before T s And calculate the request time T q ＝T e －T s 。
d. The synchronous server calculates the time error between the synchronous server and the synchronous signal generator, and the calculation formula is as follows: t (T) d ＝(T s +T q /2)－T c And according to time error T d Time synchronization is performed.
And secondly, the synchronization server transmits a preparation signal to each player through a network.
Thirdly, after each player receives the preparation signal; the following operations are performed:
a. and loading MV resources and decoding MV resource video frames.
b. The player transmits a preparation completion signal to the synchronization server through the network.
And fourthly, after receiving the preparation completion signals of all the players, the synchronous server transmits a playing start signal to each player through a network.
Wherein the play start signal has a play start time parameter T b Assume that the current sync server time is T o T is then b ＝(T o +T d )－T q 。
Fifthly, after receiving the play starting signal, the player waits for a time signal (obtained by demodulating a clock signal) transmitted by the synchronous signal generator from a serial port of the serial link; if the time parameter in the time signal is smaller than T b And continuing to wait, otherwise, starting playing by the player.
Further, after the players start to play, each player performs calibration by using the clock signal of the synchronous signal generator, and the flow may be as follows:
when each player starts to play MV resources, the synchronous signal generator periodically generates clock signals, the clock signals are received by the clock signal receiver and sent to the playing terminal to which each player belongs, and the clock signals are transmitted to the player; each player can synchronously calibrate the playing progress of each player by taking the clock signal as a synchronous reference signal.
For example, assuming that each player starts playing MV from 00:00, the synchronization signal generator periodically sends clock signals to each clock signal receiver, and assuming that the period t=1s and the player frame rate is 60 frames/s, the video frame played by MV at 1s is 00060 frames, and each player can obtain the video frame number played by MV at the time of receiving clock signals by calculation; if the playing progress is fast, the playing speed is regulated down, and if the playing progress is slow, the playing speed is regulated up, so that each player is realigned to realize the synchronous effect.
In the scheme of the embodiment, by means of a hardware physical connection mode, the characteristics of small delay and high stability between the synchronous signal generator and each clock signal receiver are utilized, and under the condition of a certain sampling rate, the clock signal receiver can demodulate a clock signal through a serial link and transmit the clock signal as synchronous reference information to a playing terminal, so that the player can synchronously play and control the MV; according to the technical scheme, the synchronous signal generator transmits the clock signal to each clock signal receiver, each clock signal receiver can provide accurate synchronous reference for the playing terminal through the demodulated clock signal, and the synchronization of video frames played by each playing terminal is ensured; therefore, in the playing process after the chorus begins, the synchronous calibration of the accurate playing progress can be carried out, and the same-place singing effect is improved.
The application also provides a playing terminal, which is internally provided with at least one player, wherein the player is configured to execute the following steps:
s11, receiving a time synchronization instruction issued by a synchronization server, and performing time synchronization with other players; the synchronous server is respectively communicated with each player;
s12, loading MV resources which need to be synchronously played, and decoding video frames of the MV resources;
s13, reporting the decoding completion states to a synchronous server respectively, and forwarding the decoding completion states to other players by the synchronous server for playing alignment;
s14, receiving a playing instruction issued by the synchronous server, and synchronously playing the video frames of the MV resources with other players under the control of the synchronous server.
According to the playing terminal provided by the embodiment, through the player provided by the application, in the chorus process, video frames of MV resources can be synchronously decoded under the control of the synchronous server, and the video frames are synchronously played after being aligned, so that the time deviation of MV playing can be controlled within a minimum range, the singing effect in the same occasion is realized, better user experience can be obtained, and the immersion sense is greatly improved.
The application also provides a server device running a synchronization server configured to perform the steps of:
s21, issuing a time synchronization instruction to each player, and performing time synchronization on each player; the synchronous server is respectively communicated with each player;
s22, controlling each player to load MV resources to be synchronously played respectively, decoding video frames of the MV resources, and receiving decoding completion states reported by each player;
s23, playing alignment is carried out on each player, playing instructions are issued to each player, and each player is controlled to synchronously play the video frames of the MV resources.
According to the server equipment provided by the embodiment, through the synchronous server provided by the application, in the chorus process, each player can be controlled to synchronously decode the video frames of the MV resources, and after alignment, the video frames are synchronously played, so that the time deviation of MV playing can be controlled within a minimum range, the singing effect in the same occasion is realized, better user experience can be obtained, and the immersion sense is greatly improved.
The application also provides an entertainment equipment system, which comprises the playing terminal of the embodiment and the server equipment of the embodiment; the entertainment equipment system comprises a synchronous server, a synchronous signal generator and a clock signal receiver; before MV playing, the synchronous server controls the synchronous playing, in the playing process, the synchronous signal generator periodically generates clock signals and sends the clock signals to each clock signal receiver, each player determines the playing progress according to the clock signals, and the playing speed of the player is controlled according to the playing progress.
In one embodiment, the workflow of the entertainment device system may include the following:
s31, the synchronous server issues time synchronous instructions to each playing terminal and the synchronous signal generator, and the synchronous signal generator periodically generates clock signals.
S32, the players of the playing terminals load the MV resources which need to be synchronously played from the MV resource server, and decode video frames of the MV resources.
S33, each playing terminal respectively reports the decoding completion state to the synchronous server, and the decoding completion state is forwarded to other players by the synchronous server for playing alignment;
and S34, after all the playing terminals are aligned, synchronizing the playing instructions issued by the server, and synchronously playing the video frames of the MV resources by the players of the playing terminals.
S35, each clock signal receiver analyzes the clock signal and sends the clock signal to a player of the playing terminal.
S36, each player calculates the deviation of the playing progress, and adjusts the playing speed of the MV resources according to the deviation.
According to the entertainment equipment system provided by the embodiment, the synchronous server can control each player to synchronously decode the video frames of the MV resources, and synchronously play the video frames after alignment, and in the chorus process, the synchronous signal generator sends a clock signal to the clock signal receiver, and each player calculates the deviation of the playing progress and adjusts the playing speed according to the clock signal; therefore, the time deviation of MV playing can be controlled within a very small range, thereby realizing the singing effect in the same occasion, obtaining better user experience and greatly improving the immersion sense.
The foregoing is only a partial embodiment of the present application, and it should be noted that, for a person skilled in the art, several improvements and modifications can be made without departing from the principle of the present application, and these improvements and modifications should also be considered as the protection scope of the present application.
Claims (12)
1. An MV playback method, comprising:
the method for synchronizing time of each player by sending a time synchronization instruction to each player through the synchronization server comprises the following steps: the synchronization server requests the synchronization time to the synchronization signal generator through a network; after synchronization, the synchronization server transmits a preparation signal to each player through a network; after receiving the preparation signals, each player loads MV resources, decodes MV resource video frames and sends preparation completion signals to the synchronous server through a network; the synchronous server is respectively communicated with each player;
each player loads MV resources needing synchronous playing respectively and decodes video frames of the MV resources;
each player reports the decoding completion state of the video frame to the synchronous server, and the synchronous server plays and aligns each player;
issuing a playing instruction to each player through a synchronous server, controlling each player to synchronously play the video frames of the MV resources, wherein the method comprises the following steps: after receiving the preparation completion signals of all the players, the synchronous server transmits a play starting signal to each player through a network; wherein, the play starting signal has a play starting time parameter; after receiving the play starting signal, the player waits for a clock signal transmitted by the synchronous signal generator through a serial link; if the time parameter in the clock signal is smaller than the playing starting time parameter, continuing to wait, otherwise, starting playing by the player.
2. The MV playback method of claim 1, wherein time-synchronizing each player by the synchronization server issuing a time-synchronization command to each player, comprising:
and sending an http time synchronization instruction to each player through the server, and connecting each player to the Internet time synchronization server for time synchronization.
3. The MV playback method of claim 1, further comprising:
in the playing process, each player feeds back the playing progress of the video frames to the synchronous server respectively in a set period;
and the synchronous server synchronously calibrates each player according to the playing progress.
4. The MV playback method of claim 3, wherein the synchronization server performs synchronization calibration on each player according to the playback progress, comprising:
and comparing the playing progress of the players to be synchronized according to the requirement, and adjusting the playing speed of the players to perform synchronization calibration when the playing progress of the players to the video frames has time deviation.
5. The MV playback method of claim 4, wherein adjusting the playback multiplier of the player for synchronization calibration comprises:
if the playing progress of the first player is faster than that of the second player, reducing the playing speed of the first player, so that the playing progress of the first player and the playing progress of the second player are realigned; or alternatively
If the playing progress of the first player is slower than that of the second player, the playing speed of the second player is increased, so that the playing progress of the first player and the playing progress of the second player are realigned;
the first player and the second player are players which need to be synchronized.
6. The MV playback method of claim 5, further comprising, prior to the step of increasing the playback speed of the second player:
and acquiring the decoding state of the video frame by the second player, and if the decoding is finished, increasing the playing speed of the second player so that the playing progress of the first player and the playing progress of the second player are realigned.
7. The MV playback method of claim 1, wherein each playback terminal to which each player belongs is connected to a clock signal receiver, each clock signal receiver being connected to a synchronization signal generator through a serial link; the server device is connected with the synchronous signal generator through a network.
8. The MV playback method of claim 7, wherein the synchronization server requests a synchronization time from a synchronization signal generator through a network, comprising:
the synchronous server sends a request to the synchronous signal generator to acquire the current time of the synchronous signal generator and is attached with the current time T of the synchronous server s Parameters;
the synchronous signal generator returns to the current time T c Synchronous server time parameter T carried by request s ；
The synchronous server receives the returned time parameter to obtain the current time T of the completion of the request s And calculate the request time T q ＝T e －T s ；
The synchronization server calculates a time error T with the synchronization signal generator d ＝(T s +T q /2)－T c And according to time error T d Time synchronization is performed.
9. The MV playback method of claim 7, further comprising:
a synchronous server sends a playing instruction to a synchronous signal generator to control the synchronous signal generator to periodically generate a clock signal;
in the playing process, each player receives the clock signal through the connected clock signal receiver, and synchronously calibrates the playing progress of each player according to the clock signal.
10. A playback terminal having at least one player built-in, the player configured to perform the steps of:
receiving a time synchronization instruction issued by a synchronization server, and performing time synchronization with other players; the synchronous server is respectively communicated with each player; the synchronization server requests the synchronization time to the synchronization signal generator through a network; after synchronization, the synchronization server transmits a preparation signal to each player through a network; after receiving the preparation signals, each player loads MV resources, decodes MV resource video frames and sends preparation completion signals to the synchronous server through a network;
loading MV resources needing synchronous playing, and decoding video frames of the MV resources;
reporting the decoding completion state to a synchronous server respectively, and forwarding the decoding completion state to other players by the synchronous server for playing alignment;
receiving a playing instruction issued by a synchronous server, and synchronously playing the video frames of the MV resources with other players under the control of the synchronous server; after receiving the preparation completion signals of all the players, the synchronous server transmits a play starting signal to each player through a network; wherein, the play starting signal has a play starting time parameter; after receiving the play starting signal, the player waits for a clock signal transmitted by the synchronous signal generator through a serial link; if the time parameter in the clock signal is smaller than the playing starting time parameter, continuing to wait, otherwise, starting playing by the player.
11. A server device, characterized by running a synchronization server configured to perform the steps of:
issuing a time synchronization instruction to each player, and performing time synchronization on each player; the synchronous server is respectively communicated with each player, and requests synchronous time to the synchronous signal generator through a network; after synchronization, the synchronization server transmits a preparation signal to each player through a network; after receiving the preparation signals, each player loads MV resources, decodes MV resource video frames and sends preparation completion signals to the synchronous server through a network;
controlling each player to load MV resources to be synchronously played respectively, decoding video frames of the MV resources, and receiving decoding completion states reported by each player;
playing alignment is carried out on each player, playing instructions are issued to each player, and each player is controlled to synchronously play video frames of MV resources; after receiving the preparation completion signals of all the players, the synchronous server transmits a play starting signal to each player through a network; wherein, the play starting signal has a play starting time parameter; after receiving the play starting signal, the player waits for a clock signal transmitted by the synchronous signal generator through a serial link; if the time parameter in the clock signal is smaller than the playing starting time parameter, continuing to wait, otherwise, starting playing by the player.
12. An entertainment device system, comprising: the playback terminal of claim 10, and/or the server device of claim 11.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210101258.5A CN114401432B (en) | 2022-01-27 | 2022-01-27 | MV playing method, playing terminal, server equipment and entertainment equipment system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210101258.5A CN114401432B (en) | 2022-01-27 | 2022-01-27 | MV playing method, playing terminal, server equipment and entertainment equipment system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114401432A CN114401432A (en) | 2022-04-26 |
| CN114401432B true CN114401432B (en) | 2024-01-26 |
Family
ID=81233046
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210101258.5A Active CN114401432B (en) | 2022-01-27 | 2022-01-27 | MV playing method, playing terminal, server equipment and entertainment equipment system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114401432B (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20070111695A (en) * | 2006-05-18 | 2007-11-22 | 엘지전자 주식회사 | Video syncronization based on reproducing audio signal slow or fast |
| CN102752642A (en) * | 2012-06-18 | 2012-10-24 | 李洋 | Method and system for synchronously broadcasting multi-terminal video based on IP (internet protocol) network |
| CN103200461A (en) * | 2013-01-14 | 2013-07-10 | 易程（苏州）智能系统有限公司 | Multiple-player-terminal synchronized playing system and playing method |
| CN103634621A (en) * | 2012-08-27 | 2014-03-12 | 中兴通讯股份有限公司 | Method, apparatuses and system for playing synchronization controlling in video recommendation service |
| CN104159150A (en) * | 2014-08-19 | 2014-11-19 | 龙芯中科技术有限公司 | Cloud terminal, cloud server, media data stream playing system and method |
| WO2015000328A1 (en) * | 2013-07-05 | 2015-01-08 | Zeng Dejun | Method and system for simultaneously outputting audio |
| KR101485328B1 (en) * | 2014-01-03 | 2015-01-22 | (주)아바비젼 | Multi-synchro control system for player |
| CN106792154A (en) * | 2016-12-02 | 2017-05-31 | 广东赛特斯信息科技有限公司 | The frame-skipping synchronization system and its control method of video player |
| CN108600815A (en) * | 2018-05-09 | 2018-09-28 | 福建星网视易信息系统有限公司 | A kind of online method and system chorused in real time |
| CN111432260A (en) * | 2020-03-31 | 2020-07-17 | 腾讯科技（深圳）有限公司 | Method, device and equipment for synchronizing multiple paths of video pictures and storage medium |
| CN111954051A (en) * | 2020-02-11 | 2020-11-17 | 华为技术有限公司 | Method, equipment and system for transmitting video and audio |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180367839A1 (en) * | 2017-06-16 | 2018-12-20 | Oohms Ny Llc | Method and system for synchronization of audio content for a remotely displayed video |
| TWI690878B (en) * | 2018-11-02 | 2020-04-11 | 緯創資通股份有限公司 | Synchronous playback system and synchronous playback method |
-
2022
- 2022-01-27 CN CN202210101258.5A patent/CN114401432B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20070111695A (en) * | 2006-05-18 | 2007-11-22 | 엘지전자 주식회사 | Video syncronization based on reproducing audio signal slow or fast |
| CN102752642A (en) * | 2012-06-18 | 2012-10-24 | 李洋 | Method and system for synchronously broadcasting multi-terminal video based on IP (internet protocol) network |
| CN103634621A (en) * | 2012-08-27 | 2014-03-12 | 中兴通讯股份有限公司 | Method, apparatuses and system for playing synchronization controlling in video recommendation service |
| CN103200461A (en) * | 2013-01-14 | 2013-07-10 | 易程（苏州）智能系统有限公司 | Multiple-player-terminal synchronized playing system and playing method |
| WO2015000328A1 (en) * | 2013-07-05 | 2015-01-08 | Zeng Dejun | Method and system for simultaneously outputting audio |
| KR101485328B1 (en) * | 2014-01-03 | 2015-01-22 | (주)아바비젼 | Multi-synchro control system for player |
| CN104159150A (en) * | 2014-08-19 | 2014-11-19 | 龙芯中科技术有限公司 | Cloud terminal, cloud server, media data stream playing system and method |
| CN106792154A (en) * | 2016-12-02 | 2017-05-31 | 广东赛特斯信息科技有限公司 | The frame-skipping synchronization system and its control method of video player |
| CN108600815A (en) * | 2018-05-09 | 2018-09-28 | 福建星网视易信息系统有限公司 | A kind of online method and system chorused in real time |
| CN111954051A (en) * | 2020-02-11 | 2020-11-17 | 华为技术有限公司 | Method, equipment and system for transmitting video and audio |
| CN111432260A (en) * | 2020-03-31 | 2020-07-17 | 腾讯科技（深圳）有限公司 | Method, device and equipment for synchronizing multiple paths of video pictures and storage medium |
Non-Patent Citations (3)
| Title |
|---|
| Sync-MS:synchronized messaging service for real-time multiplayer distributed games;Yow-Jian Lin et al.;《10th IEEE International Conference on Network Protocols, 2002, Proceedings》;全文 * |
| 一种面向家庭的多屏互动媒体播放系统的设计与实现;陈猛;《中国优秀硕士学位论文全文数据库（电子期刊）》;全文 * |
| 网络视频会议录播技术实现方案;贾世杰 等;《微机发展》;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114401432A (en) | 2022-04-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8918541B2 (en) | Synchronization of audio and video signals from remote sources over the internet | |
| US8301790B2 (en) | Synchronization of audio and video signals from remote sources over the internet | |
| JP7230008B2 (en) | Systems and methods for providing real-time audio and data | |
| JP6640359B2 (en) | Wireless audio sync | |
| US7672465B2 (en) | System and method for synchronization using GPS in home network | |
| US7724780B2 (en) | Synchronization of one or more source RTP streams at multiple receiver destinations | |
| US7593354B2 (en) | Method and system for low latency high quality music conferencing | |
| US7243150B2 (en) | Reducing the access delay for transmitting processed data over transmission data | |
| CN103338204B (en) | A kind of audio synchronization output method and system | |
| US5923902A (en) | System for synchronizing a plurality of nodes to concurrently generate output signals by adjusting relative timelags based on a maximum estimated timelag | |
| US8233648B2 (en) | Ad-hoc adaptive wireless mobile sound system | |
| US8111327B2 (en) | Method and apparatus for audio/video synchronization | |
| US9088818B2 (en) | Adaptive media delay matching | |
| CA2489256A1 (en) | System and method for video assisted music instrument collaboration over distance | |
| KR20150055031A (en) | Playback synchronization | |
| US8477810B2 (en) | Synchronization using multicasting | |
| CN114401432B (en) | MV playing method, playing terminal, server equipment and entertainment equipment system | |
| CN104954727A (en) | Audio/video synchronization control device and method | |
| US10063907B1 (en) | Differential audio-video synchronization | |
| Werner et al. | Unison: a novel system for ultra-low latency audio streaming over the internet | |
| CN113891152A (en) | Audio playing control method and device, equipment, medium and product thereof | |
| JPH0630043A (en) | Voice packet communication system | |
| US10917465B2 (en) | Synchronization setting device and distribution system | |
| Miyashita et al. | QoE assessment of group synchronization in networked chorus with voice and video | |
| US20230421954A1 (en) | Method and control circuit for performing synchronization on playback of multiple electronic devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |