CN114339326B - Sound and picture synchronization method, device and system based on video playing - Google Patents
Sound and picture synchronization method, device and system based on video playing Download PDFInfo
- Publication number
- CN114339326B CN114339326B CN202111508523.3A CN202111508523A CN114339326B CN 114339326 B CN114339326 B CN 114339326B CN 202111508523 A CN202111508523 A CN 202111508523A CN 114339326 B CN114339326 B CN 114339326B
- Authority
- CN
- China
- Prior art keywords
- playing
- audio
- program
- video
- mobile terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Abstract
The invention relates to a sound and picture synchronization method, a device and a system based on video playing, wherein the method comprises the following steps: acquiring a program list, a video file and an audio file corresponding to each program; transmitting the program list and all video files to a broadcast control server, and transmitting the program list and all audio files to a mobile terminal associated with the broadcast control server; acquiring program playing information corresponding to the currently played video sent by a playing control server; transmitting the program playing information to the mobile terminal, and acquiring an audio downloading state fed back by the mobile terminal according to the program playing information; determining an audio playing time node corresponding to the currently played video according to the program playing information and the audio downloading state; and controlling the mobile terminal to play the current playing audio corresponding to the current playing video from the audio playing time node. By adopting the scheme, the audio playing time node synchronous with the video playing can be determined, so that the synchronism of the audio and video playing can be ensured, and the playing effect of the program can be improved.
Description
Technical Field
The invention relates to the technical field of video playing, in particular to a sound and picture synchronization method, device and system based on video playing.
Background
The large screen refers to a large screen in a direct-view color television or rear projection television. Typically, the diagonal dimension of the screen is mostly above 40 inches. The large screen is a trend of the 21 st century advertising industry development, and is indoor and outdoor video display equipment with audio and video functions.
The existing large screen is not provided with a sound box, and part of the large screen is provided with the sound box, but even if the large screen is provided with the sound box, the sound box cannot be started under most conditions due to disturbance and the like, so that the large screen can only see pictures, has no sound and is in a silent state when playing videos.
In the prior art, a user usually utilizes a mobile terminal and a large screen to play a video at the same time, so that the user can not only utilize the large screen to watch the video, but also can hear the sound under the condition of no disturbing people, but because the video file is usually larger, the cache time of the mobile terminal is too long, the large screen and the mobile terminal are easy to cause incapability of synchronizing, thereby influencing the playing effect of programs.
Therefore, how to improve the play synchronism between the large screen and the mobile terminal, so as to improve the play effect of the program is a technical problem that needs to be solved by those skilled in the art.
Disclosure of Invention
Accordingly, the present invention is directed to a method, an apparatus, and a system for synchronizing sound and picture based on video playing, so as to solve the problem in the prior art that the large screen and the mobile terminal cannot be synchronized easily due to the long cache time of the mobile terminal because the video file is usually large, thereby affecting the playing effect of the program.
In order to achieve the above purpose, the invention adopts the following technical scheme:
a sound and picture synchronization method based on video playing comprises the following steps:
acquiring a program list, a video file corresponding to each program in the program list and an audio file corresponding to each program in the program list;
transmitting the program list and all the video files to a broadcast control server, and transmitting the program list and all the audio files to a mobile terminal associated with the broadcast control server;
acquiring program playing information corresponding to the currently played video sent by the playing control server;
transmitting the program playing information to the mobile terminal, and acquiring an audio downloading state fed back by the mobile terminal according to the program playing information;
determining an audio playing time node corresponding to the current playing video according to the program playing information and the audio downloading state;
and controlling the mobile terminal to play the current playing audio corresponding to the current playing video from the audio playing time node according to the program playing information.
Further, in the above sound and picture synchronization method based on video playing, the program playing information includes: and the program identifier corresponding to the current playing video and the program playing time of the current playing video.
Further, in the above sound-picture synchronization method based on video playing, the determining, according to the program playing information and the audio downloading state, an audio playing time node corresponding to the currently playing video includes:
if the audio downloading state indicates that the audio is downloaded, determining an audio playing time node corresponding to the current playing video as an audio starting node;
if the audio downloading state indicates that the audio is not downloaded, controlling the mobile terminal to download the current playing audio corresponding to the program identifier in all audio files, and determining the current time when the downloading of the current playing audio is completed;
and taking the difference value between the current time and the program playing time as an audio playing time node corresponding to the current playing video.
Further, in the above sound and picture synchronization method based on video playing, the controlling, according to the program playing information, the mobile terminal to play the currently playing audio corresponding to the currently playing video from the audio playing time node includes:
controlling the mobile terminal to extract the current playing audio corresponding to the program identifier;
and controlling the mobile terminal to play the current playing audio from the audio playing time node.
Further, the sound and picture synchronization method based on video playing further comprises the following steps:
and controlling the broadcast control server and the mobile terminal to acquire the time to be synchronized from a time server according to a preset period, so that the broadcast control server and the mobile terminal perform time synchronization according to the time to be synchronized.
Further, in the above sound and picture synchronization method based on video playing, before the sending the program list and all the video files to the playing control server and the sending the program list and all the audio files to the mobile terminal associated with the playing control server, the method further includes:
receiving an association request sent by the mobile terminal;
and associating the broadcast control server with the mobile terminal according to the association request.
The invention also provides a sound and picture synchronization device based on video playing, which comprises:
the first acquisition module is used for acquiring a program list, a video file corresponding to each program in the program list and an audio file corresponding to each program in the program list;
the sending module is used for sending the program list and all the video files to a broadcasting control server and sending the program list and all the audio files to a mobile terminal associated with the broadcasting control server;
the second acquisition module is used for acquiring the program playing information corresponding to the currently played video sent by the playing control server;
the sending module is further configured to send the program playing information to the mobile terminal;
the third acquisition module is used for acquiring an audio downloading state fed back by the mobile terminal according to the program playing information;
the determining module is used for determining an audio playing time node corresponding to the current playing video according to the program playing information and the audio downloading state;
and the playing control module is used for controlling the mobile terminal to play the current playing audio corresponding to the current playing video from the audio playing time node according to the program playing information.
Further, in the above sound and picture synchronization device based on video playing, the determining module is specifically configured to:
if the audio downloading state indicates that the audio is downloaded, determining an audio playing time node corresponding to the current playing video as an audio starting node;
if the audio downloading state indicates that the audio is not downloaded, controlling the mobile terminal to download the current playing audio corresponding to the program identifier in all audio files, and determining the current time when the downloading of the current playing audio is completed;
and taking the difference value between the current time and the program playing time as an audio playing time node corresponding to the current playing video.
Further, in the sound and picture synchronization device based on video playing, the playing control module is further configured to control the playing control server and the mobile terminal to acquire a time to be synchronized from a time server according to a preset period, so that the playing control server and the mobile terminal perform time synchronization according to the time to be synchronized.
The invention also provides a sound and picture synchronization system based on video playing, which comprises: the system comprises a platform server, a broadcast control server, a mobile terminal and a screen;
the broadcast control server and the mobile terminal are respectively connected with the platform server;
the broadcast control server is connected with the screen;
the playing control server is used for controlling the screen to play the currently played video;
the platform server is used for executing the sound and picture synchronization method based on video playing.
A sound and picture synchronization method, device and system based on video playing, the method includes: acquiring a program list, a video file corresponding to each program in the program list and an audio file corresponding to each program in the program list; transmitting the program list and all video files to a broadcast control server, and transmitting the program list and all audio files to a mobile terminal associated with the broadcast control server; acquiring program playing information corresponding to the currently played video sent by a playing control server; transmitting the program playing information to the mobile terminal, and acquiring an audio downloading state fed back by the mobile terminal according to the program playing information; determining an audio playing time node corresponding to the currently played video according to the program playing information and the audio downloading state; and controlling the mobile terminal to play the current playing audio corresponding to the current playing video from the audio playing time node according to the program playing information. By adopting the technical scheme of the invention, the audio playing time node during audio playing can be determined according to the program playing information of the playing control server for playing the video and the corresponding audio downloading state, thereby ensuring the synchronism of audio and video playing and improving the playing effect of the program.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention as claimed.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart provided by one embodiment of a video playback based sound and picture synchronization method of the present invention;
FIG. 2 is a schematic diagram of an embodiment of a sound and picture synchronization device based on video playing according to the present invention;
fig. 3 is a schematic structural diagram of an embodiment of a sound and picture synchronization system based on video playing according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be described in detail below. It will be apparent that the described embodiments are only some, but not all, embodiments of the invention. All other embodiments, based on the examples herein, which are within the scope of the invention as defined by the claims, will be within the scope of the invention as defined by the claims.
Fig. 1 is a flowchart provided by an embodiment of a sound and picture synchronization method based on video playing according to the present invention, as shown in fig. 1, the sound and picture synchronization method based on video playing according to the present embodiment specifically includes the following steps:
s101, acquiring a program list, video files corresponding to each program in the program list and audio files corresponding to each program in the program list.
In this embodiment, the user makes a program using a computer, and stores the made program in the platform server in terms of audio and video. The platform server can acquire program lists of all programs sent by the computer, video files corresponding to each program in the program list and audio files corresponding to each program in the program list.
S102, sending the program list and all video files to a broadcasting control server, and sending the program list and all audio files to a mobile terminal associated with the broadcasting control server.
After the platform server obtains the program list, all video files and all audio files, the program list and all video files need to be sent to the broadcast control server, and the program list and all audio files are sent to the mobile terminal associated with the broadcast control server. The mobile terminal comprises a mobile phone, a tablet personal computer and the like.
S103, acquiring program playing information corresponding to the currently played video sent by the playing control server.
After the broadcast control server receives the program list and all video files sent by the platform server, the user can select the video files to be played in the program list, and the video files are used as the current playing video. The playing control server controls the screen to play the current playing video, wherein the screen is preferably an LED large screen.
When the playing control server controls the screen to play the current playing video, the playing control server also sends program playing information corresponding to the current playing video to the platform server, so that the platform server obtains the program playing information, wherein the program playing information comprises: program identification corresponding to the currently played video and program playing time when the currently played video is played on the screen.
And S104, sending the program playing information to the mobile terminal, and acquiring an audio downloading state fed back by the mobile terminal according to the program playing information.
After receiving the program playing information, the platform server sends the program playing information to the mobile terminal associated with the playing control server, so that the mobile terminal can determine whether the mobile terminal downloads an audio file corresponding to the current playing video according to the program identification of the current playing video in the program playing information, and the audio downloading state of the current playing video is determined. The mobile terminal then needs to feed back the audio download status to the platform server.
S105, determining an audio playing time node corresponding to the currently played video according to the program playing information and the audio downloading state.
After receiving the audio downloading state fed back by the mobile terminal, the platform server needs to determine an audio playing time node corresponding to the current playing video according to the program playing information and the audio downloading state corresponding to the current playing video. The specific implementation steps of the steps are as follows:
first, if the audio download status indicates that the audio is downloaded, determining an audio playing time node corresponding to the currently playing video as an audio starting node.
If the audio download state fed back by the mobile terminal indicates that the audio file corresponding to the currently played video is downloaded, the mobile terminal does not need to download the audio file, and can directly play the corresponding audio while playing the currently played video on a screen, and two groups of audio download states can realize synchronous playing, so that the audio play time node corresponding to the currently played video can be determined as an audio start node.
And secondly, if the audio downloading state indicates that the audio is not downloaded, controlling the mobile terminal to download the current playing audio corresponding to the program identifier in all the audio files, and determining the current time when the downloading of the current playing audio is completed.
If the audio download status fed back by the mobile terminal indicates that the audio file corresponding to the currently playing video is not downloaded, the mobile terminal is required to be controlled to inquire the audio file corresponding to the program identifier from all the audio files at the moment, download the audio file to obtain the currently playing audio, and determine the current time when the downloading of the currently playing audio is completed.
Thirdly, taking the difference value between the current time and the program playing time as an audio playing time node corresponding to the current playing video.
Because the mobile terminal does not download the audio file corresponding to the currently played video, if the audio corresponding to the currently played video is to be played, the corresponding audio file needs to be downloaded, but the time is needed for downloading the audio file, and the problem that the video and the audio are not synchronous can be caused by audio playing after the downloading is completed. Therefore, the difference between the current time after the downloading and the program playing time of the current playing video is needed to be calculated at the moment, and the difference is used as an audio playing time node corresponding to the current playing video, so that the mobile terminal plays the audio from the audio playing time node, and the time delayed when the audio is downloaded can be directly skipped, thereby realizing the playing synchronization with the current playing video.
S106, according to the program playing information, controlling the mobile terminal to play the current playing audio corresponding to the current playing video from the audio playing time node.
After determining the audio playing time node corresponding to the current playing video, the mobile terminal is controlled to play the current playing audio corresponding to the current playing video from the audio playing time node according to the program identification in the program playing information. The specific implementation steps of the steps are as follows:
firstly, the mobile terminal is controlled to extract the current playing audio corresponding to the program identifier.
The platform server needs to control the mobile terminal to extract the audio file corresponding to the program identifier from the downloaded audio file as the current playing audio.
Secondly, the mobile terminal is controlled to play the current playing audio from the audio playing time node.
After the platform server determines the current playing audio corresponding to the current playing video, the current playing audio needs to be played from a predetermined audio playing time node, so that the video and the audio of the program are synchronous.
According to the sound and picture synchronization method based on video playing, a program list, video files corresponding to each program in the program list and audio files corresponding to each program in the program list are obtained; transmitting the program list and all video files to a broadcast control server, and transmitting the program list and all audio files to a mobile terminal associated with the broadcast control server; acquiring program playing information corresponding to the currently played video sent by a playing control server; transmitting the program playing information to the mobile terminal, and acquiring an audio downloading state fed back by the mobile terminal according to the program playing information; determining an audio playing time node corresponding to the currently played video according to the program playing information and the audio downloading state; and controlling the mobile terminal to play the current playing audio corresponding to the current playing video from the audio playing time node according to the program playing information. By adopting the technical scheme of the embodiment, the audio playing time node during audio playing can be determined according to the program playing information of the current playing video and the corresponding audio downloading state of the program playing information of the current playing video by the playing control server, so that the synchronism of audio and video playing can be ensured, and the playing effect of the program can be improved.
Further, the sound and picture synchronization method based on video playing in this embodiment further includes the following steps:
and controlling the broadcasting control server and the mobile terminal to acquire the time to be synchronized from the time server according to a preset period so as to enable the broadcasting control server and the mobile terminal to perform time synchronization according to the time to be synchronized.
The platform server needs to control the broadcasting control server and the mobile terminal to acquire the time to be synchronized from the time server according to a preset period, and after the broadcasting control server and the mobile terminal acquire the time to be synchronized, time adjustment is needed according to the time to be synchronized, so that time synchronization of the broadcasting control server and the mobile terminal can be realized, time in the broadcasting control server and the mobile terminal is guaranteed to be completely consistent, and accuracy of audio playing time node calculation is guaranteed.
Further, in the sound-picture synchronization method based on video playing of the present embodiment, before executing step S102, the method further includes the following steps:
first, an association request sent by a mobile terminal is received.
When a viewer watching a video played in a screen wants to synchronously play audio corresponding to the video using a mobile terminal, the viewer can transmit an association request to a platform server through the mobile terminal. The platform server may receive association requests sent by the respective mobile terminals.
And secondly, associating the broadcast control server with the mobile terminal according to the association request.
After receiving the association request, the platform server may associate the broadcast control server with the mobile state that sent the association request. The association request can also carry the relevant information of the mobile terminal, the platform server can analyze and verify the relevant information, and for the mobile terminal of which the relevant information does not meet the requirements, the platform server can refuse to associate the mobile terminal with the broadcast control server.
In order to be more comprehensive, the invention also provides a sound and picture synchronization device based on video playing, which corresponds to the sound and picture synchronization method based on video playing provided by the embodiment of the invention.
Fig. 2 is a schematic structural diagram provided by an embodiment of a sound and picture synchronization device based on video playing according to the present invention, as shown in fig. 2, the sound and picture synchronization device based on video playing according to the present embodiment includes: the device comprises a first acquisition module 11, a sending module 12, a second acquisition module 13, a third acquisition module 14, a determining module 15 and a playing control module 16.
A first obtaining module 11, configured to obtain a program list, a video file corresponding to each program in the program list, and an audio file corresponding to each program in the program list;
a transmitting module 12, configured to transmit the program list and all video files to a broadcast control server, and transmit the program list and all audio files to a mobile terminal associated with the broadcast control server;
the second obtaining module 13 is configured to obtain program playing information corresponding to a currently playing video sent by the playing control server;
a transmitting module 12, configured to transmit the program playing information to the mobile terminal;
a third obtaining module 14, configured to obtain an audio download status that is fed back by the mobile terminal according to the program playing information;
the determining module 15 is configured to determine an audio playing time node corresponding to the currently playing video according to the program playing information and the audio downloading state;
the playing control module 16 is configured to control the mobile terminal to play the currently playing audio corresponding to the currently playing video from the audio playing time node according to the program playing information.
According to the sound and picture synchronization device based on video playing, the audio playing time node during audio playing can be determined according to the program playing information of the current playing video and the corresponding audio downloading state of the playing control server, so that the synchronism of audio and video playing can be ensured, and the playing effect of a program can be improved.
Further, in the sound and picture synchronization device based on video playing in this embodiment, the program playing information includes: the program identifier corresponding to the currently played video and the program playing time of the currently played video. The determining module 15 is specifically configured to:
if the audio download state indicates that the video is downloaded, determining an audio playing time node corresponding to the currently played video as an audio starting node;
if the audio downloading state indicates that the audio is not downloaded, controlling the mobile terminal to download the current playing audio corresponding to the program identifier in all the audio files, and determining the current time when the downloading of the current playing audio is completed;
and taking the difference value between the current time and the program playing time as an audio playing time node corresponding to the current playing video.
Further, in the sound-picture synchronization device based on video playing in this embodiment, the playing control module 16 is specifically configured to control the mobile terminal to extract the current playing audio corresponding to the program identifier; and controlling the mobile terminal to play the current playing audio from the audio playing time node.
Further, in the sound and picture synchronization device based on video playing in this embodiment, the playing control module 16 is further configured to control the playing control server and the mobile terminal to obtain the time to be synchronized from the time server according to a preset period, so that the playing control server and the mobile terminal perform time synchronization according to the time to be synchronized.
Further, the sound and picture synchronization device based on video playing in this embodiment further includes: a receiving module and an associating module.
The receiving module is used for receiving the association request sent by the mobile terminal;
and the association module is used for associating the broadcast control server with the mobile terminal according to the association request.
The specific manner in which the various modules perform the operations in the apparatus of the above embodiments have been described in detail in connection with the embodiments of the method, and will not be described in detail herein.
Fig. 3 is a schematic structural diagram of an embodiment of a sound and picture synchronization system based on video playing according to the present invention. As shown in fig. 3, the sound and picture synchronization system based on video playing of the present embodiment includes: a platform server 22, a broadcast control server 21, a mobile terminal 23 and a screen 24. Wherein, the broadcast control server 21 and the mobile terminal 23 are respectively connected with the platform server 22, and the broadcast control server 21 is connected with the screen 24.
In this embodiment, the playing control server 21 may control the screen 24 to play the currently playing video, the mobile terminal 23 is used for synchronously playing the currently playing audio corresponding to the currently playing video, and the platform server 22 is used for executing the sound and picture synchronization method based on video playing described in the above embodiment.
The sound and picture synchronization system based on video playing in this embodiment can determine the audio playing time node when playing audio according to the program playing information of the currently playing video and the corresponding audio downloading state of the playing control server 21, so as to ensure the synchronicity of audio and video playing and improve the playing effect of the program.
It is to be understood that the same or similar parts in the above embodiments may be referred to each other, and that in some embodiments, the same or similar parts in other embodiments may be referred to.
It should be noted that in the description of the present invention, the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. Furthermore, in the description of the present invention, unless otherwise indicated, the meaning of "plurality" means at least two.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and further implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present invention.
It is to be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, the various steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, may be implemented using any one or combination of the following techniques, as is well known in the art: discrete logic circuits having logic gates for implementing logic functions on data signals, application specific integrated circuits having suitable combinational logic gates, programmable Gate Arrays (PGAs), field Programmable Gate Arrays (FPGAs), and the like.
Those of ordinary skill in the art will appreciate that all or a portion of the steps carried out in the method of the above-described embodiments may be implemented by a program to instruct related hardware, and the program may be stored in a computer readable storage medium, where the program when executed includes one or a combination of the steps of the method embodiments.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing module, or each unit may exist alone physically, or two or more units may be integrated in one module. The integrated modules may be implemented in hardware or in software functional modules. The integrated modules may also be stored in a computer readable storage medium if implemented in the form of software functional modules and sold or used as a stand-alone product.
The above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, or the like.
In the description of the present specification, a description referring to terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiments or examples. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
While embodiments of the present invention have been shown and described above, it will be understood that the above embodiments are illustrative and not to be construed as limiting the invention, and that variations, modifications, alternatives and variations may be made to the above embodiments by one of ordinary skill in the art within the scope of the invention.
Claims (7)
1. A sound and picture synchronization method based on video playing is characterized by comprising the following steps:
acquiring a program list, a video file corresponding to each program in the program list and an audio file corresponding to each program in the program list;
transmitting the program list and all the video files to a broadcast control server, and transmitting the program list and all the audio files to a mobile terminal associated with the broadcast control server;
acquiring program playing information corresponding to the currently played video sent by the playing control server; the program playing information includes: the program identifier corresponding to the current playing video and the program playing time of the current playing video;
transmitting the program playing information to the mobile terminal, and acquiring an audio downloading state fed back by the mobile terminal according to the program playing information;
according to the program playing information and the audio downloading state, determining an audio playing time node corresponding to the current playing video comprises the following steps: if the audio downloading state indicates that the audio is downloaded, determining an audio playing time node corresponding to the current playing video as an audio starting node; if the audio downloading state indicates that the audio is not downloaded, controlling the mobile terminal to download the current playing audio corresponding to the program identifier in all audio files, and determining the current time when the downloading of the current playing audio is completed; taking the difference value between the current time and the program playing time as an audio playing time node corresponding to the current playing video;
and controlling the mobile terminal to play the current playing audio corresponding to the current playing video from the audio playing time node according to the program playing information.
2. The method for synchronizing sound and picture based on video playing according to claim 1, wherein said controlling the mobile terminal to play the currently playing audio corresponding to the currently playing video from the audio playing time node according to the program playing information includes:
controlling the mobile terminal to extract the current playing audio corresponding to the program identifier;
and controlling the mobile terminal to play the current playing audio from the audio playing time node.
3. The method for synchronizing sound and picture based on video playback as claimed in claim 1, further comprising:
and controlling the broadcast control server and the mobile terminal to acquire the time to be synchronized from a time server according to a preset period, so that the broadcast control server and the mobile terminal perform time synchronization according to the time to be synchronized.
4. The method of claim 1, wherein the sending the program listings and all the video files to a broadcast control server and the sending the program listings and all the audio files to a mobile terminal associated with the broadcast control server are preceded by:
receiving an association request sent by the mobile terminal;
and associating the broadcast control server with the mobile terminal according to the association request.
5. A sound and picture synchronization device based on video playing, comprising:
the first acquisition module is used for acquiring a program list, a video file corresponding to each program in the program list and an audio file corresponding to each program in the program list;
the sending module is used for sending the program list and all the video files to a broadcasting control server and sending the program list and all the audio files to a mobile terminal associated with the broadcasting control server;
the second acquisition module is used for acquiring the program playing information corresponding to the currently played video sent by the playing control server; the program playing information includes: the program identifier corresponding to the current playing video and the program playing time of the current playing video;
the sending module is further configured to send the program playing information to the mobile terminal;
the third acquisition module is used for acquiring an audio downloading state fed back by the mobile terminal according to the program playing information;
the determining module is used for determining an audio playing time node corresponding to the current playing video according to the program playing information and the audio downloading state; the method is specifically used for determining an audio playing time node corresponding to the currently played video as an audio starting node if the audio downloading state indicates that the audio is downloaded; if the audio downloading state indicates that the audio is not downloaded, controlling the mobile terminal to download the current playing audio corresponding to the program identifier in all audio files, and determining the current time when the downloading of the current playing audio is completed; taking the difference value between the current time and the program playing time as an audio playing time node corresponding to the current playing video;
and the playing control module is used for controlling the mobile terminal to play the current playing audio corresponding to the current playing video from the audio playing time node according to the program playing information.
6. The audio-visual synchronization device based on video playing according to claim 5, wherein the playing control module is further configured to control the playing control server and the mobile terminal to obtain a time to be synchronized from a time server according to a preset period, so that the playing control server and the mobile terminal perform time synchronization according to the time to be synchronized.
7. A sound and picture synchronization system based on video playback, comprising: the system comprises a platform server, a broadcast control server, a mobile terminal and a screen;
the broadcast control server and the mobile terminal are respectively connected with the platform server;
the broadcast control server is connected with the screen;
the playing control server is used for controlling the screen to play the currently played video;
the platform server is used for executing the sound and picture synchronization method based on video playing according to any one of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111508523.3A CN114339326B (en) | 2021-12-10 | 2021-12-10 | Sound and picture synchronization method, device and system based on video playing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111508523.3A CN114339326B (en) | 2021-12-10 | 2021-12-10 | Sound and picture synchronization method, device and system based on video playing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114339326A CN114339326A (en) | 2022-04-12 |
| CN114339326B true CN114339326B (en) | 2023-06-27 |
Family
ID=81050364
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111508523.3A Active CN114339326B (en) | 2021-12-10 | 2021-12-10 | Sound and picture synchronization method, device and system based on video playing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114339326B (en) |
Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20060039728A (en) * | 2004-11-03 | 2006-05-09 | 한국전자통신연구원 | Terrestrial dmb broadcasting tranceiving system for synchronizing data service with audio/video service |
| CN103780921A (en) * | 2014-01-17 | 2014-05-07 | 上海聚力传媒技术有限公司 | Live video information playing method and device |
| CN104010210A (en) * | 2014-06-12 | 2014-08-27 | 广东欧珀移动通信有限公司 | Playing control method, device and system of multiple playing devices |
| CN104618786A (en) * | 2014-12-22 | 2015-05-13 | 深圳市腾讯计算机系统有限公司 | Audio/video synchronization method and device |
| CN104853239A (en) * | 2015-04-27 | 2015-08-19 | 浙江生辉照明有限公司 | Audio and video synchronous playback control method and system |
| CN105578293A (en) * | 2014-09-30 | 2016-05-11 | 剧场耳股份有限公司 | Syncronizing audio playback in coordination with external video playback with auto-dimming |
| CN105847897A (en) * | 2016-03-31 | 2016-08-10 | 乐视控股（北京）有限公司 | Method and device of providing and processing video downloading |
| CN105898501A (en) * | 2015-12-30 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Video display method, video player and electronic device |
| CN105940679A (en) * | 2014-01-31 | 2016-09-14 | 汤姆逊许可公司 | Method and apparatus for synchronizing playbacks at two electronic devices |
| CN107113465A (en) * | 2014-12-10 | 2017-08-29 | 艾科星科技公司 | The method synchronous for the audiovisual with multiple output devices, apparatus and system |
| CN107438192A (en) * | 2017-07-26 | 2017-12-05 | 武汉烽火众智数字技术有限责任公司 | The synchronous method of audio and video playing and related system and multimedia play terminal |
| CN108282685A (en) * | 2018-01-04 | 2018-07-13 | 华南师范大学 | A kind of method and monitoring system of audio-visual synchronization |
| CN111182123A (en) * | 2018-11-13 | 2020-05-19 | 奇酷互联网络科技（深圳）有限公司 | Method for avoiding audio playing delay of wireless player, mobile terminal and storage medium |
| CN112272315A (en) * | 2020-10-21 | 2021-01-26 | 深圳创维汽车智能有限公司 | Video playing method, device, equipment and computer readable storage medium |
| WO2021159864A1 (en) * | 2020-02-11 | 2021-08-19 | 华为技术有限公司 | Method for transmitting video and audio data, cloud server and system |
| CN113672757A (en) * | 2021-08-23 | 2021-11-19 | 北京字跳网络技术有限公司 | Audio playing method and device |
| CN113709585A (en) * | 2021-08-25 | 2021-11-26 | 三星电子（中国）研发中心 | Streaming media playing method and device |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101535827B1 (en) * | 2008-12-05 | 2015-07-27 | 삼성전자주식회사 | Apparatus and method for audio and video synchronization in wireless communication network |
| WO2015148972A1 (en) * | 2014-03-27 | 2015-10-01 | Marck Neil C | Improving the sound quality of the audio portion of audio/video files recorded during a live event |
-
2021
- 2021-12-10 CN CN202111508523.3A patent/CN114339326B/en active Active
Patent Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20060039728A (en) * | 2004-11-03 | 2006-05-09 | 한국전자통신연구원 | Terrestrial dmb broadcasting tranceiving system for synchronizing data service with audio/video service |
| CN103780921A (en) * | 2014-01-17 | 2014-05-07 | 上海聚力传媒技术有限公司 | Live video information playing method and device |
| CN105940679A (en) * | 2014-01-31 | 2016-09-14 | 汤姆逊许可公司 | Method and apparatus for synchronizing playbacks at two electronic devices |
| CN104010210A (en) * | 2014-06-12 | 2014-08-27 | 广东欧珀移动通信有限公司 | Playing control method, device and system of multiple playing devices |
| CN105578293A (en) * | 2014-09-30 | 2016-05-11 | 剧场耳股份有限公司 | Syncronizing audio playback in coordination with external video playback with auto-dimming |
| CN107113465A (en) * | 2014-12-10 | 2017-08-29 | 艾科星科技公司 | The method synchronous for the audiovisual with multiple output devices, apparatus and system |
| CN104618786A (en) * | 2014-12-22 | 2015-05-13 | 深圳市腾讯计算机系统有限公司 | Audio/video synchronization method and device |
| CN104853239A (en) * | 2015-04-27 | 2015-08-19 | 浙江生辉照明有限公司 | Audio and video synchronous playback control method and system |
| CN105898501A (en) * | 2015-12-30 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Video display method, video player and electronic device |
| WO2017113717A1 (en) * | 2015-12-30 | 2017-07-06 | 乐视控股（北京）有限公司 | Video playing method, video player, and electronic device |
| CN105847897A (en) * | 2016-03-31 | 2016-08-10 | 乐视控股（北京）有限公司 | Method and device of providing and processing video downloading |
| CN107438192A (en) * | 2017-07-26 | 2017-12-05 | 武汉烽火众智数字技术有限责任公司 | The synchronous method of audio and video playing and related system and multimedia play terminal |
| CN108282685A (en) * | 2018-01-04 | 2018-07-13 | 华南师范大学 | A kind of method and monitoring system of audio-visual synchronization |
| CN111182123A (en) * | 2018-11-13 | 2020-05-19 | 奇酷互联网络科技（深圳）有限公司 | Method for avoiding audio playing delay of wireless player, mobile terminal and storage medium |
| WO2021159864A1 (en) * | 2020-02-11 | 2021-08-19 | 华为技术有限公司 | Method for transmitting video and audio data, cloud server and system |
| CN112272315A (en) * | 2020-10-21 | 2021-01-26 | 深圳创维汽车智能有限公司 | Video playing method, device, equipment and computer readable storage medium |
| CN113672757A (en) * | 2021-08-23 | 2021-11-19 | 北京字跳网络技术有限公司 | Audio playing method and device |
| CN113709585A (en) * | 2021-08-25 | 2021-11-26 | 三星电子（中国）研发中心 | Streaming media playing method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114339326A (en) | 2022-04-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110267081B (en) | Live stream processing method, device and system, electronic equipment and storage medium | |
| US10547880B2 (en) | Information processor, information processing method and program | |
| CN103327377B (en) | System, method, and infrastructure for synchronized streaming of content | |
| KR102469142B1 (en) | Dynamic playback of transition frames while transitioning between media stream playbacks | |
| US8931024B2 (en) | Receiving apparatus and subtitle processing method | |
| JP5498179B2 (en) | Digital broadcast receiving apparatus and control method thereof | |
| CN105376628A (en) | Method and device for synchronizing audio-video signals | |
| CN108366283B (en) | Media synchronous playing method among multiple devices | |
| CN109379619B (en) | Sound and picture synchronization method and device | |
| CN106063283B (en) | Method and apparatus for synchronizing the playback at two electronic equipments | |
| KR101841313B1 (en) | Methods for processing multimedia flows and corresponding devices | |
| CN109379613A (en) | Audio-visual synchronization method of adjustment, TV, computer readable storage medium and system | |
| CN111343477B (en) | Data transmission method and device, electronic equipment and storage medium | |
| CN114026640B (en) | Method, system and medium for providing dynamic media sessions | |
| CN112383794B (en) | Live broadcast method, live broadcast system, server and computer storage medium | |
| CN114339326B (en) | Sound and picture synchronization method, device and system based on video playing | |
| WO2017080152A1 (en) | Data synchronization method and device | |
| JP4649530B1 (en) | Playback apparatus and playback method | |
| JP2007221376A (en) | Content reproducing apparatus, broadcast content transmission apparatus, control data supply apparatus, user attribute value supply apparatus, broadcast system, content reproduction method, and broadcast content transmission method | |
| TWI660628B (en) | Method for playback synchronization of media among devices | |
| US8909362B2 (en) | Signal processing apparatus and signal processing method | |
| CN111522972B (en) | Multimedia sharing method and vehicle | |
| US20210344973A1 (en) | Method and apparatus for providing audio and video within an acceptable delay tolerance | |
| JP6519042B2 (en) | Reproducing apparatus, reproducing system, and reproducing method | |
| CN111263207A (en) | Control method and device for video playing equipment and computer storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20230802 Address after: Building B, No.6 Fugang Road, Yunhan Village, Shaxi Town, Zhongshan City, Guangdong Province, 528471, Floor 5, B5011-2 Patentee after: Zhongshan Pinxiang Sky Cultural Technology Co.,Ltd. Address before: 102600 102-232, floor 1, building 24, yard 1, Hongye East Road, Daxing District, Beijing Patentee before: Beijing Pinxiang sky Culture Technology Co.,Ltd. |
|
| TR01 | Transfer of patent right |