CN113271487A - Audio and video synchronous playing method, device, system, program product and storage medium - Google Patents
Audio and video synchronous playing method, device, system, program product and storage medium Download PDFInfo
- Publication number
- CN113271487A CN113271487A CN202110510438.4A CN202110510438A CN113271487A CN 113271487 A CN113271487 A CN 113271487A CN 202110510438 A CN202110510438 A CN 202110510438A CN 113271487 A CN113271487 A CN 113271487A
- Authority
- CN
- China
- Prior art keywords
- audio
- video
- playing
- target
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
- G06F3/1446—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display display composed of modules, e.g. video walls
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Television Signal Processing For Recording (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses an audio and video synchronous playing method, an audio and video synchronous playing device, an audio and video synchronous playing system, a program product and a storage medium, wherein the audio and video synchronous playing system at least comprises two spliced screen devices, and each spliced screen device is provided with a credit application, and the method comprises the following steps: acquiring current audio and video playing information of corresponding spliced screen equipment through a messaging application; detecting whether each spliced screen device is in an audio and video synchronous playing state according to the current audio and video playing information; when detecting that at least one splicing screen device is in an audio and video asynchronous playing state, determining a target splicing screen device in the audio and video asynchronous playing state, and executing audio and video synchronous playing operation through a signaling application corresponding to the target splicing screen device. The invention realizes the function of local video synchronous playing through the signaling application on each spliced screen device, does not need to add an additional video distributor, and can reduce the equipment cost in the process of audio and video synchronous playing.
Description
Technical Field
The present invention relates to the field of image processing technologies, and in particular, to a method, an apparatus, a system, a program product, and a storage medium for audio and video synchronous playback.
Background
With the rapid development of science and technology, the application of the spliced screen equipment is more and more extensive, and the spliced screen equipment is gradually expanded from a single professional application field to various fields such as commerce, entertainment, media, real estate and public management. Because the spliced screen equipment is mainly used for playing videos, how to realize synchronous playing of audio and video in different spliced screen equipment becomes an important research direction of various large enterprises.
At present, the audio and video synchronous playing function of the spliced screen equipment is mainly realized by externally connecting a video distributor in the market. The video distributor needs to be additionally arranged, so that the audio and video synchronous playing method needs to increase the equipment cost.
Disclosure of Invention
The invention mainly aims to provide an audio and video synchronous playing method, device, system, program product and storage medium, aiming at realizing the audio and video synchronous playing function of a spliced screen device without increasing extra device cost.
In order to achieve the above object, the present invention provides an audio and video synchronous playing method, which is applied to an audio and video synchronous playing system, wherein the audio and video synchronous playing system at least comprises two spliced screen devices, and each spliced screen device is provided with a messaging application, and the method comprises the following steps:
acquiring current audio and video playing information of corresponding spliced screen equipment through the messaging application;
detecting whether each spliced screen device is in an audio and video synchronous playing state according to the current audio and video playing information;
when detecting that at least one spliced screen device is in an audio and video asynchronous playing state, determining a target spliced screen device in the audio and video asynchronous playing state, and executing audio and video synchronous playing operation through a signaling application corresponding to the target spliced screen device.
Preferably, the step of detecting whether each of the mosaic screen devices is in an audio and video synchronous playing state according to the current audio and video playing information includes:
judging whether the current audio and video playing information is completely consistent;
when the current audio and video playing information is completely consistent, determining that the spliced screen devices are in an audio and video synchronous playing state;
and when the current audio and video playing information is not completely consistent, determining that the spliced screen devices are in an audio and video asynchronous playing state.
Preferably, the step of determining the target mosaic screen device in the audio and video non-synchronous playing state comprises:
determining target audio and video playing information according to the current audio and video playing information;
and determining target spliced screen equipment in an audio and video asynchronous playing state according to each piece of current audio and video playing information and the target audio and video playing information.
Preferably, the step of determining a target mosaic screen device in an audio and video asynchronous playing state according to each piece of the current audio and video playing information and the target audio and video playing information includes:
comparing each current audio and video playing information with the target audio and video playing information respectively to determine whether each current audio and video playing information is the same as the target audio and video playing information or not respectively;
and determining the spliced screen equipment with the current audio and video playing information different from the target audio and video playing information as the target spliced screen equipment in the audio and video asynchronous playing state.
Preferably, the step of executing the audio and video synchronous playing operation through the signaling application corresponding to the target mosaic screen device includes:
determining information offset between current audio and video playing information in the target spliced screen equipment and the target audio and video playing information, and sending each information offset to the corresponding target spliced screen equipment;
when the signaling application in the target splicing screen equipment receives the corresponding information offset, the current audio and video playing information of the target splicing screen equipment is adjusted to the target audio and video playing information according to the received information offset.
Preferably, before the step of obtaining the current audio/video playing information of the corresponding tiled screen device through each of the messaging applications, the method further includes:
determining the splicing number of the spliced screen equipment;
acquiring initial audio and video to be played, preprocessing the initial audio and video according to the splicing number to obtain target audio and video to be played by each spliced screen device, and storing each target audio and video in the corresponding spliced screen device;
and after the target audios and videos are determined to be stored completely, playing the corresponding target audios and videos through the spliced screen devices.
In addition, in order to achieve the above object, the present invention further provides an audio and video synchronization playing device, which is applied to an audio and video synchronization playing system, wherein the audio and video synchronization playing system at least includes two spliced screen devices, and each spliced screen device is installed with a messaging application, and the audio and video synchronization playing device includes:
the acquisition module is used for acquiring the current audio and video playing information of the corresponding spliced screen equipment through the messaging application;
the detection module is used for detecting whether each spliced screen device is in an audio and video synchronous playing state according to the current audio and video playing information;
and the synchronization module is used for determining a target spliced screen device in an audio and video asynchronous playing state when detecting that at least one spliced screen device is in the audio and video asynchronous playing state, and executing audio and video synchronous playing operation through a signaling application corresponding to the target spliced screen device.
Preferably, the detection module is further configured to:
judging whether the current audio and video playing information is completely consistent;
when the current audio and video playing information is completely consistent, determining that the spliced screen devices are in an audio and video synchronous playing state;
and when the current audio and video playing information is not completely consistent, determining that the spliced screen devices are in an audio and video asynchronous playing state.
Preferably, the synchronization module is further configured to:
determining target audio and video playing information according to the current audio and video playing information;
and determining target spliced screen equipment in an audio and video asynchronous playing state according to each piece of current audio and video playing information and the target audio and video playing information.
Preferably, the synchronization module is further configured to:
comparing each piece of current audio and video playing information with the target audio and video playing information respectively, and determining whether each piece of current audio and video playing information is the same as the target audio and video playing information respectively;
and determining the spliced screen equipment with the current audio and video playing information different from the target audio and video playing information as the target spliced screen equipment in the audio and video asynchronous playing state.
Preferably, the synchronization module is further configured to:
determining information offset between current audio and video playing information in the target spliced screen equipment and the target audio and video playing information, and sending each information offset to the corresponding target spliced screen equipment;
when the signaling application in the target splicing screen equipment receives the corresponding information offset, the current audio and video playing information of the target splicing screen equipment is adjusted to the target audio and video playing information according to the received information offset.
Preferably, the audio-video synchronous playing device further includes a data processing module, and the processing module is configured to:
determining the splicing number of the spliced screen equipment;
acquiring initial audio and video to be played, preprocessing the initial audio and video according to the splicing number to obtain target audio and video to be played by each spliced screen device, and storing each target audio and video in the corresponding spliced screen device;
and after the target audios and videos are determined to be stored completely, playing the corresponding target audios and videos through the spliced screen devices.
In addition, to achieve the above object, the present invention further provides a program product, which includes a computer program, and when the computer program is executed by a processor, the steps of the audio and video synchronous playing method as described above are implemented.
In addition, in order to achieve the above object, the present invention further provides an audio/video synchronous playing system, including: the audio and video synchronous playing method comprises a memory, a processor and an audio and video synchronous playing program which is stored on the memory and can be operated on the processor, wherein the audio and video synchronous playing program realizes the steps of the audio and video synchronous playing method when being executed by the processor.
In addition, in order to achieve the above object, the present invention further provides a storage medium, where an audio and video synchronous playing program is stored on the storage medium, and when the audio and video synchronous playing program is executed by a processor, the steps of the audio and video synchronous playing method are implemented.
The audio and video synchronous playing method provided by the invention is applied to an audio and video synchronous playing system, the audio and video synchronous playing system at least comprises two spliced screen devices, and each spliced screen device is provided with a message sending application, and the method comprises the following steps: acquiring current audio and video playing information of corresponding spliced screen equipment through a messaging application; detecting whether each spliced screen device is in an audio and video synchronous playing state according to the current audio and video playing information; when detecting that at least one splicing screen device is in an audio and video asynchronous playing state, determining a target splicing screen device in the audio and video asynchronous playing state, and executing audio and video synchronous playing operation through a signaling application corresponding to the target splicing screen device. The invention realizes the function of local video synchronous playing through the signaling application on each spliced screen device, does not need to add an additional video distributor, and can reduce the equipment cost in the process of audio and video synchronous playing.
Drawings
FIG. 1 is a system diagram of a hardware operating environment according to an embodiment of the present invention;
fig. 2 is a schematic flow chart of a first embodiment of the audio and video synchronous playing method of the present invention;
fig. 3 is a schematic flow chart of a preferred embodiment of the audio and video synchronous playing method of the present invention;
fig. 4 is a functional module diagram of a preferred embodiment of the audio/video synchronous playing method of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
As shown in fig. 1, fig. 1 is a system structural diagram of a hardware operating environment according to an embodiment of the present invention.
The system of the embodiment of the invention can be a mobile terminal, a server, a management platform and the like.
As shown in fig. 1, the system may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the system architecture shown in FIG. 1 is not intended to be limiting of the system, and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and an audio-video synchronous playback program.
The operating system is a program for managing and controlling the audio and video synchronous playing system and software resources, and supports the operation of a network communication module, a user interface module, an audio and video synchronous playing program and other programs or software; the network communication module is used for managing and controlling the network interface 1002; the user interface module is used to manage and control the user interface 1003.
In the audio and video synchronous playing system shown in fig. 1, the audio and video synchronous playing system calls an audio and video synchronous playing program stored in a memory 1005 through a processor 1001, and executes the operations in the following embodiments of the audio and video synchronous playing method.
Based on the hardware structure, the embodiment of the audio and video synchronous playing method is provided.
Referring to fig. 2, fig. 2 is a schematic flowchart of a first embodiment of an audio and video synchronous playing method according to the present invention, where the method includes:
step S10, acquiring the current audio and video playing information of the corresponding spliced screen equipment through the signaling application;
the audio and video synchronous playing method can be applied to an audio and video synchronous playing system with audio and video playing and displaying requirements. For convenience of description, the audio and video synchronous playing system is referred to as a synchronous system for short. The spliced screen equipment is a complete display unit, can be independently used as a display, and can also be spliced into an oversized screen for use, so that the application of the spliced screen equipment is more and more extensive, and the spliced screen equipment is gradually expanded from a single professional application field to various fields such as commerce, entertainment, media, real estate and public management. Because the spliced screen equipment is mainly used for playing videos, how to realize synchronous playing of audio and video in different spliced screen equipment becomes an important research direction of various large enterprises.
At present, the audio and video synchronous playing function of the spliced screen equipment is mainly realized by externally connecting a video distributor in the market. The video distributor needs to be additionally arranged, so that the audio and video synchronous playing method needs to increase the equipment cost.
In this embodiment, the synchronization system at least includes one spliced screen device, and each spliced screen device is installed with a credit application, and a client (spliced screen device) and a server (synchronization system) communicate with each other through the credit application, so as to implement issuing and receiving of various audio and video resources, where the credit application refers to an information distribution system, referred to as a credit system for short, and the credit system is referred to as a credit application in order to distinguish from an execution main body head system in this embodiment; the audio and video resources can include video, pictures, text information, sound information and the like. For example, in order to ensure the playing quality of the audio and video and ensure that the spliced screen device can achieve the expected advertising effect when playing the audio and video, the synchronization system needs to detect whether the spliced screen device is in an audio and video synchronous playing state in the process of normally playing the corresponding audio and video by the spliced screen device, specifically, when playing the audio and video by the spliced screen device, the signaling application can call a corresponding audio and video player interface in a real-time or timing manner to obtain the current audio and video playing information of the spliced screen device, such as the current audio and video playing position, the timestamp information, the sound information and the like, and report the obtained current audio and video playing information to the synchronization system. For a single splicing screen device, if the audio and video played in the splicing screen device are not synchronous, the playing information corresponding to the current audio and video, such as timestamp information, sound information, display picture information, playing position and the like, can be respectively checked to determine whether the splicing screen device is in an audio and video synchronous playing state; when the synchronization system comprises at least two spliced screen devices, the current audio and video playing information of each spliced screen device needs to be compared respectively, and whether each spliced screen device is in an audio and video synchronous playing state can be determined.
By integrating a message application on each spliced screen device, the audio and video synchronous playing function of the spliced screen devices can be realized without adding additional synchronous devices, so that the device cost required in the audio and video synchronous playing process is reduced.
Further, before step S10, the method further includes:
step a1, determining the splicing number of the splicing screen equipment;
in this embodiment, because the splicing screen device can be used as a display alone, and also can splice a plurality of splicing screen devices into a super large screen for use, for example, a display picture can be played through the combination of a plurality of splicing screen devices, monitoring pictures at different angles can also be played through a plurality of splicing screen devices, and the like.
A2, acquiring an initial audio and video to be played, preprocessing the initial audio and video according to the splicing number to obtain a target audio and video to be played by each spliced screen device, and storing each target audio and video in the corresponding spliced screen device;
in this embodiment, according to the splicing number of the spliced screen devices and the actual application requirements, an initial audio/video to be played is preprocessed, such as denoising processing, audio/video segmentation processing and the like, to obtain target audio/video to be played by each spliced screen device, then each target audio/video is sent to the corresponding spliced screen device, and when a signaling application in the spliced screen device detects the target audio/video, a downloading action is started, so that each target audio/video is stored in the corresponding spliced screen device, and a local playing function of the spliced screen device is realized.
Step a3, after each target audio and video is determined to be completely stored, playing the corresponding target audio and video through each splicing screen device.
In this embodiment, after the target audio/video in each of the mosaic screen devices is downloaded, the corresponding signaling application sends an audio/video download completion instruction to the synchronization system, so as to report a message that the target audio/video on the mosaic screen device has been downloaded to the synchronization system; when the synchronization system receives an audio and video storage completion instruction returned by each message application, namely after the target audio and video corresponding to each spliced screen device is determined to be downloaded and stored, an audio and video playing instruction is sent to the message applications on all the spliced screen devices so as to inform the spliced screen devices to start playing the corresponding target audio and video. Specifically, after receiving the audio/video playing instruction, the application on each of the tiled screen devices calls the corresponding audio/video player interface, so that the corresponding target audio/video is played on each of the tiled screen devices.
Step S20, detecting whether each splicing screen device is in an audio and video synchronous playing state according to the current audio and video playing information;
in this embodiment, when detecting whether the mosaic screen devices are in an audio and video synchronous playing state, the current audio and video playing information of each mosaic screen device can be acquired by calling the corresponding audio and video player interface through the signaling application on each mosaic screen device in a real-time or timed manner, and meanwhile, the acquired audio and video playing information is reported to the synchronization system. The synchronization system compares and verifies the current audio and video playing information of all the spliced screen devices, for example, compares the timestamp information, the playing position information (playing progress) and the like of the current playing picture of each spliced screen device respectively, thereby detecting whether each spliced screen device is in an audio and video synchronous playing state. The audio and video playing effect of each spliced screen device can be ensured through a real-time or timing detection mode, and the timeliness of audio and video playing can also be ensured.
And step S30, when detecting that at least one spliced screen device is in an audio and video asynchronous playing state, determining a target spliced screen device in the audio and video asynchronous playing state, and executing audio and video synchronous playing operation through a signaling application corresponding to the target spliced screen device.
In this embodiment, in a general case, if it is detected that each of the mosaic screen devices is in an audio and video synchronous playing state, the mosaic screen devices are synchronized when playing audio and video by default, and the synchronization system may not perform any operation; if it is detected that at least one of the mosaic screen devices is in an audio and video asynchronous playing state, for example, the playing information is explained by taking the playing position as an example, the current playing position of the mosaic screen device a is a, the current playing positions of the other mosaic screen devices B/C/D are B, and the playing progress of a is different from that of B, it is indicated that the current mosaic screen device in the audio and video asynchronous playing state needs to be synchronously played, and if the mosaic screen device in the audio and video asynchronous playing state is fast forwarded or rewound to a designated playing position, frame dropping processing and other modes can be adopted, so that the current playing positions of the mosaic screen devices are consistent, and the purpose of synchronous playing is achieved.
In the audio and video synchronous playing method of the embodiment, the current audio and video playing information corresponding to the spliced screen device is obtained through the signaling application on the spliced screen device; detecting whether each spliced screen device is in an audio and video synchronous playing state according to the current audio and video playing information; when detecting that at least one splicing screen device is in an audio and video asynchronous playing state, determining a target splicing screen device in the audio and video asynchronous playing state, and executing audio and video synchronous playing operation through a signaling application corresponding to the target splicing screen device. The invention realizes the function of local video synchronous playing through the signaling application on each spliced screen device, does not need to add an additional video distributor, and can reduce the equipment cost in the process of audio and video synchronous playing.
Further, based on the first embodiment of the audio and video synchronous playing method of the present invention, a second embodiment of the audio and video synchronous playing method of the present invention is provided.
The second embodiment of the av synchronous playback method differs from the first embodiment of the av synchronous playback method in that step S20 includes:
step b1, judging whether the current audio/video playing information is completely consistent;
b2, when the current audio and video playing information is completely consistent, determining that the spliced screen devices are in an audio and video synchronous playing state;
step b3, when the current audio/video playing information is not completely consistent, determining that the plurality of spliced screen devices are in an audio/video asynchronous playing state.
In this embodiment, it is assumed that the number of tiles of the tiled screen device is n × n, i.e. there is n2The split screen equipment is split to realize a super-large screen function, and the split screen equipment can be passed throughThe message sending application acquires the playing position, the timestamp information and the like of the current playing picture to determine the current audio and video playing information of each spliced screen device, and the current audio and video playing information of each spliced screen device is compared to determine the n2Whether the spliced screen equipment is in an audio and video synchronous playing state or not. In particular, if n is2If the current audio and video playing information corresponding to the spliced screen equipment can be completely matched, the n is indicated2The current audio and video playing information of each spliced screen device is completely consistent and is in an audio and video synchronous playing state; if n is2If the current audio/video playing information corresponding to each of the mosaic screen devices cannot be completely matched, that is, if the current audio/video playing information of at least one of the mosaic screen devices is not matched with the current audio/video playing information of other mosaic screen devices, it can be determined that n is the current audio/video playing information of the other mosaic screen devices2The current audio and video playing information of each spliced screen device is not completely consistent and is in an audio and video asynchronous playing state.
According to the audio and video synchronous playing method, when a plurality of spliced screen devices are spliced into an oversized screen to achieve a synchronous playing function, whether the current audio and video playing information of each spliced screen device is completely consistent or not is compared, so that whether the spliced screen devices are in an audio and video synchronous playing state or not is determined, the plurality of spliced screen devices can be effectively ensured to be capable of synchronously playing corresponding audio and video, and the playing quality of the spliced screen devices is guaranteed.
Further, based on the first and second embodiments of the audio/video synchronous playing method of the present invention, a third embodiment of the audio/video synchronous playing method of the present invention is proposed.
The third embodiment of the audio and video synchronous playing method is different from the first and second embodiments of the audio and video synchronous playing method in that the step of determining the target spliced screen device in the audio and video asynchronous playing state comprises the following steps:
step c1, determining target audio/video playing information according to each current audio/video playing information;
in this embodiment, it is assumed that the number of the current mosaic screen devices is 3 × 2 — 6, and if it is determined that the 6 mosaic screen devices are in the audio/video asynchronous playing state, it is described that the current audio/video playing information corresponding to the 6 mosaic screen devices is not completely consistent, that is, the playing information corresponding to the current playing screen of the 6 mosaic screen devices includes at least two cases. Specifically, for convenience of description, the playing information is described by taking the playing position as an example, for example, the current audio/video playing position of the mosaic screen device a is a, the current audio/video playing position of the mosaic screen device B, C, D is b, the current audio/video playing position of the mosaic screen device E, F is c, the playing progress of a is greater than b, and the playing progress of b is greater than c, that is, the current playing progress of the mosaic screen device a is fastest, the current playing progress of the mosaic screen device B, C, D is second, and the current playing progress of the mosaic screen device E, F is slowest, the fastest/slowest playing position of the current playing progress can be determined as the target audio/video playing position of the mosaic screen device according to the actual playing requirement, and a mode value corresponding to each current audio/video playing position can also be used as the target audio/video playing position.
Step c2, determining target spliced screen equipment in an audio and video asynchronous playing state according to each piece of current audio and video playing information and the target audio and video playing information;
in this embodiment, by comparing the current audio/video playing information and the target audio/video playing information of each of the mosaic screen devices, the mosaic screen devices that are playing normally (in a synchronous playing state) and the target mosaic screen devices that are playing asynchronously can be distinguished.
Specifically, step c2 includes:
step c21, comparing each current audio/video playing information with the target audio/video playing information respectively to determine whether each current audio/video playing information is the same as the target audio/video playing information respectively;
and c22, determining the spliced screen equipment with the current audio and video playing information different from the target audio and video playing information as the target spliced screen equipment in the asynchronous playing state.
In this embodiment, by comparing the current audio/video playing information and the target audio/video playing information of each of the tiled screen devices, it can be determined whether the current audio/video playing information and the target audio/video playing information of each of the tiled screen devices are the same, for example, whether the current playing position and the target playing position of each of the tiled screen devices, and the current timestamp information and the target timestamp information are the same, respectively. If the current audio and video playing information is the same as the target audio and video playing information, the splicing screen device is in an audio and video synchronous playing state; and if the current audio and video playing information is different from the target audio and video playing information, the spliced screen equipment is in an audio and video asynchronous playing state. Assuming that the target audio/video playing position is determined to be a, that is, the current audio/video playing position of the mosaic screen device a is used as a standard, since the current audio/video playing position of the mosaic screen device B, C, D, E, F is different from the target audio/video playing position, it may be determined that the target mosaic screen device in the asynchronous playing state includes the mosaic screen device B, C, D, E, F.
Further, step S30 further includes:
step d1, determining the information offset between the current audio and video playing information and the target audio and video playing information in the target spliced screen equipment, and sending the information offset to the corresponding target spliced screen equipment;
and d2, when the signaling application in the target spliced screen device receives the corresponding information offset, adjusting the current audio and video playing information of the target spliced screen device to the target audio and video playing information according to the received information offset.
In this embodiment, since the mosaic screen device consistent with the target audio/video playing information belongs to a mosaic screen device which is normally played, that is, the mosaic screen device is in a synchronous playing state, it is only necessary to perform a synchronous playing operation on the target mosaic screen device in an asynchronous playing state according to the target audio/video playing information, so that the current audio/video playing information of each mosaic screen device is consistent, and each mosaic screen device can synchronously play the corresponding target audio/video.
Specifically, assuming that the determined target audio/video playing information is d, the target mosaic screen device in the asynchronous playing state includes the mosaic screen device G, H, and the current audio/video playing information of the mosaic screen device G, H is e (d is different from e), when a synchronous playing operation is performed on the target mosaic screen device, an information difference between the current audio/video playing information and the target audio/video playing information of the target mosaic screen device is obtained, and the information difference is used as a corresponding information offset, so that the information offset between the current audio/video playing information and the target audio/video playing information of each target mosaic screen device is determined. For convenience of description, the playing information is explained by taking the playing position as an example, for example, if the playing progress corresponding to d is greater than the playing progress corresponding to e, it may be determined that the position offset between the current audio/video playing position of the target mosaic screen device G, H and the target audio/video playing position is + (d-e), that is, the current audio/video playing position of G, H needs to be fast-forwarded by (d-e) playing positions; if the playing progress corresponding to e is greater than the playing progress corresponding to d, it indicates that the position offset between the current audio and video playing position of the target tiled screen device and the target audio and video playing position is- (e-d), that is, the current audio and video playing position of G, H needs to be backed up by (e-d) playing positions. Then, the synchronization system sends a corresponding position offset instruction to the target tiled screen device G, H according to the obtained position offset, and after the signaling application in the target tiled screen device receives the position offset instruction, the corresponding audio/video player interface is called to adjust the current audio/video playing position of the target tiled screen device to the target audio/video playing position.
As shown in fig. 3, fig. 3 is a schematic flow chart of a preferred embodiment of the audio/video synchronous playing method of the present invention. A synchronization system (a server) issues a video resource instruction to a splicing screen device (a client); after the signal transmission application on the spliced screen equipment receives the video resource instruction, downloading and storing the issued audio and video resources to the spliced screen equipment; after the audio and video are downloaded, a downloading completion instruction is sent to the server side through the signaling application; after receiving a downloading completion instruction returned by each message sending application, the server side sends a video playing instruction to the spliced screen equipment; when the signaling application receives a video playing instruction, current audio and video playing information such as a video playing position and a timestamp of the corresponding spliced screen device is obtained, and the obtained current audio and video playing information is uploaded to a server; and then the server side carries out synchronous playing setting according to the received current audio and video playing information so as to adjust the current audio and video playing information of the spliced screen equipment in the audio and video asynchronous playing state to the target audio and video playing information.
In the audio and video synchronous playing method of this embodiment, the information offset between the current audio and video playing information and the target audio and video playing information of the target spliced screen device that is asynchronously played is determined, and the information offset is sent to the target spliced screen device that needs to perform the synchronous playing operation, so that the signaling application on the target spliced screen device adjusts the current audio and video playing information to the target audio and video playing information, thereby ensuring that the audio and video played in each spliced screen device is in a synchronous playing state.
The invention also provides an audio and video synchronous playing device. Referring to fig. 3, the audio and video synchronous playing device of the present invention includes:
the acquisition module 10 is configured to acquire current audio/video playing information of the corresponding tiled screen device through the messaging application;
the detection module 20 is configured to detect whether each of the mosaic screen devices is in an audio and video synchronous playing state according to the current audio and video playing information;
and the synchronization module 30 is configured to, when it is detected that at least one of the mosaic screen devices is in an audio/video asynchronous playing state, determine a target mosaic screen device in the audio/video asynchronous playing state, and execute an audio/video synchronous playing operation through a signaling application corresponding to the target mosaic screen device.
Preferably, the detection module is further configured to:
judging whether the current audio and video playing information is completely consistent;
when the current audio and video playing information is completely consistent, determining that the spliced screen devices are in an audio and video synchronous playing state;
and when the current audio and video playing information is not completely consistent, determining that the spliced screen devices are in an audio and video asynchronous playing state.
Preferably, the synchronization module is further configured to:
determining target audio and video playing information according to the current audio and video playing information;
and determining target spliced screen equipment in an audio and video asynchronous playing state according to each piece of current audio and video playing information and the target audio and video playing information.
Preferably, the synchronization module is further configured to:
comparing each piece of current audio and video playing information with the target audio and video playing information respectively, and determining whether each piece of current audio and video playing information is the same as the target audio and video playing information respectively;
and determining the spliced screen equipment with the current audio and video playing information different from the target audio and video playing information as the target spliced screen equipment in the audio and video asynchronous playing state.
Preferably, the synchronization module is further configured to:
determining information offset between current audio and video playing information in the target spliced screen equipment and the target audio and video playing information, and sending each information offset to the corresponding target spliced screen equipment;
when the signaling application in the target splicing screen equipment receives the corresponding information offset, the current audio and video playing information of the target splicing screen equipment is adjusted to the target audio and video playing information according to the received information offset.
Preferably, the audio-video synchronous playing device further includes a data processing module, and the processing module is configured to:
determining the splicing number of the spliced screen equipment;
acquiring initial audio and video to be played, preprocessing the initial audio and video according to the splicing number to obtain target audio and video to be played by each spliced screen device, and storing each target audio and video in the corresponding spliced screen device;
and after the target audios and videos are determined to be stored completely, playing the corresponding target audios and videos through the spliced screen devices.
The invention also provides a program product comprising a computer program which, when executed by a processor, carries out the steps of the method of determining a default rate as described above.
The invention also provides a storage medium.
The storage medium of the invention stores an audio and video synchronous playing program, and the audio and video synchronous playing program realizes the steps of the audio and video synchronous playing method when being executed by a processor.
The embodiments of the audio/video synchronous playing system, the program product and the storage medium of the present invention can refer to the embodiments of the audio/video synchronous playing method of the present invention, and are not described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal system (e.g., a mobile phone, a computer, a server, an air conditioner, or a network system) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. An audio and video synchronous playing method is characterized by being applied to an audio and video synchronous playing system, wherein the audio and video synchronous playing system at least comprises two spliced screen devices, and each spliced screen device is provided with a message sending application, and the method comprises the following steps:
acquiring current audio and video playing information of corresponding spliced screen equipment through the messaging application;
detecting whether each spliced screen device is in an audio and video synchronous playing state according to the current audio and video playing information;
when detecting that at least one spliced screen device is in an audio and video asynchronous playing state, determining a target spliced screen device in the audio and video asynchronous playing state, and executing audio and video synchronous playing operation through a signaling application corresponding to the target spliced screen device.
2. The audio and video synchronous playing method according to claim 1, wherein the step of detecting whether the mosaic screen device is in an audio and video synchronous playing state according to the current audio and video playing information comprises:
judging whether the current audio and video playing information is completely consistent;
when the current audio and video playing information is completely consistent, determining that the spliced screen devices are in an audio and video synchronous playing state;
and when the current audio and video playing information is not completely consistent, determining that the spliced screen devices are in an audio and video asynchronous playing state.
3. The audio-video synchronous playing method according to claim 1, wherein the step of determining the target mosaic screen device in the audio-video asynchronous playing state comprises:
determining target audio and video playing information according to the current audio and video playing information;
and determining target spliced screen equipment in an audio and video asynchronous playing state according to each piece of current audio and video playing information and the target audio and video playing information.
4. The audio-video synchronous playing method according to claim 3, wherein the step of determining the target mosaic screen device in an audio-video asynchronous playing state according to each of the current audio-video playing information and the target audio-video playing information comprises:
comparing each current audio and video playing information with the target audio and video playing information respectively to determine whether each current audio and video playing information is the same as the target audio and video playing information or not respectively;
and determining the spliced screen equipment with the current audio and video playing information different from the target audio and video playing information as the target spliced screen equipment in the audio and video asynchronous playing state.
5. The audio and video synchronous playing method according to claim 3, wherein the step of executing the audio and video synchronous playing operation through the signaling application corresponding to the target mosaic screen device comprises:
determining information offset between current audio and video playing information in the target spliced screen equipment and the target audio and video playing information, and sending each information offset to the corresponding target spliced screen equipment;
when the signaling application in the target splicing screen equipment receives the corresponding information offset, the current audio and video playing information of the target splicing screen equipment is adjusted to the target audio and video playing information according to the received information offset.
6. The audio-video synchronous playing method according to claim 1, wherein before the step of obtaining the current audio-video playing information of the corresponding mosaic screen device through each of the messaging applications, the method further comprises:
determining the splicing number of the spliced screen equipment;
acquiring initial audio and video to be played, preprocessing the initial audio and video according to the splicing number to obtain target audio and video to be played by each spliced screen device, and storing each target audio and video in the corresponding spliced screen device;
and after the target audios and videos are determined to be stored completely, playing the corresponding target audios and videos through the spliced screen devices.
7. The utility model provides an audio and video synchronization play device which characterized in that is applied to audio and video synchronization play system, audio and video synchronization play system includes two concatenation screen equipment at least, and each install letter on the concatenation screen equipment and send out the application, the device includes:
the acquisition module is used for acquiring the current audio and video playing information of the corresponding spliced screen equipment through the messaging application;
the detection module is used for detecting whether each spliced screen device is in an audio and video synchronous playing state according to the current audio and video playing information;
and the synchronization module is used for determining a target spliced screen device in an audio and video asynchronous playing state when detecting that at least one spliced screen device is in the audio and video asynchronous playing state, and executing audio and video synchronous playing operation through a signaling application corresponding to the target spliced screen device.
8. An audio and video synchronous playing system is characterized in that the audio and video synchronous playing system comprises: the audio and video synchronous playing method comprises a memory, a processor and an audio and video synchronous playing program which is stored on the memory and can run on the processor, wherein when the audio and video synchronous playing program is executed by the processor, the steps of the audio and video synchronous playing method according to any one of claims 1 to 6 are realized.
9. A program product comprising a computer program characterized in that the computer program realizes the steps of the audio-video synchronized playback method as claimed in any one of claims 1 to 6 when executed by a processor.
10. A storage medium, characterized in that an audio-video synchronous playing program is stored on the storage medium, and when being executed by a processor, the audio-video synchronous playing program realizes the steps of the audio-video synchronous playing method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110510438.4A CN113271487B (en) | 2021-05-11 | 2021-05-11 | Audio and video synchronous playing method, device, system, program product and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110510438.4A CN113271487B (en) | 2021-05-11 | 2021-05-11 | Audio and video synchronous playing method, device, system, program product and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113271487A true CN113271487A (en) | 2021-08-17 |
| CN113271487B CN113271487B (en) | 2023-07-07 |
Family
ID=77230342
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110510438.4A Active CN113271487B (en) | 2021-05-11 | 2021-05-11 | Audio and video synchronous playing method, device, system, program product and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113271487B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114374858A (en) * | 2022-01-14 | 2022-04-19 | 京东方科技集团股份有限公司 | Multicast playing end system and video splicing method and device thereof |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101442653A (en) * | 2008-12-18 | 2009-05-27 | 北京航空航天大学 | Multichannel video play and large screen display method |
| CN104618785A (en) * | 2014-04-16 | 2015-05-13 | 腾讯科技（北京）有限公司 | Audio and video playing method, device and system |
| US20160078903A1 (en) * | 2014-09-17 | 2016-03-17 | Verizon Patent And Licensing Inc. | Sharing and synchronizing content |
| CN105549931A (en) * | 2015-12-10 | 2016-05-04 | 四川长虹电子系统有限公司 | USB (Universal Serial Bus) video splicing playing system |
| WO2018141064A1 (en) * | 2017-02-03 | 2018-08-09 | Nanoport Technology Inc. | Multi-device video and audio |
| CN109561336A (en) * | 2018-12-27 | 2019-04-02 | 威创集团股份有限公司 | Distribution display synchronous method, apparatus and system |
| CN110300319A (en) * | 2019-07-08 | 2019-10-01 | 深圳创维－Rgb电子有限公司 | Audio video synchronization playback method, system and storage medium |
| CN111541913A (en) * | 2020-05-12 | 2020-08-14 | 京东方科技集团股份有限公司 | Video playing method and device of spliced screen, computer equipment and medium |
| CN111586453A (en) * | 2020-05-21 | 2020-08-25 | 上海大因多媒体技术有限公司 | Screen splicing synchronization method and system |
| CN112055242A (en) * | 2020-09-02 | 2020-12-08 | 中国第一汽车股份有限公司 | Video synchronous playing method, device, system and storage medium |
-
2021
- 2021-05-11 CN CN202110510438.4A patent/CN113271487B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101442653A (en) * | 2008-12-18 | 2009-05-27 | 北京航空航天大学 | Multichannel video play and large screen display method |
| CN104618785A (en) * | 2014-04-16 | 2015-05-13 | 腾讯科技（北京）有限公司 | Audio and video playing method, device and system |
| US20160078903A1 (en) * | 2014-09-17 | 2016-03-17 | Verizon Patent And Licensing Inc. | Sharing and synchronizing content |
| CN105549931A (en) * | 2015-12-10 | 2016-05-04 | 四川长虹电子系统有限公司 | USB (Universal Serial Bus) video splicing playing system |
| WO2018141064A1 (en) * | 2017-02-03 | 2018-08-09 | Nanoport Technology Inc. | Multi-device video and audio |
| CN109561336A (en) * | 2018-12-27 | 2019-04-02 | 威创集团股份有限公司 | Distribution display synchronous method, apparatus and system |
| CN110300319A (en) * | 2019-07-08 | 2019-10-01 | 深圳创维－Rgb电子有限公司 | Audio video synchronization playback method, system and storage medium |
| CN111541913A (en) * | 2020-05-12 | 2020-08-14 | 京东方科技集团股份有限公司 | Video playing method and device of spliced screen, computer equipment and medium |
| CN111586453A (en) * | 2020-05-21 | 2020-08-25 | 上海大因多媒体技术有限公司 | Screen splicing synchronization method and system |
| CN112055242A (en) * | 2020-09-02 | 2020-12-08 | 中国第一汽车股份有限公司 | Video synchronous playing method, device, system and storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114374858A (en) * | 2022-01-14 | 2022-04-19 | 京东方科技集团股份有限公司 | Multicast playing end system and video splicing method and device thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113271487B (en) | 2023-07-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2747373B1 (en) | Method and apparatus for managing audio playing | |
| CN111541913B (en) | Video playing method and device of spliced screen, computer equipment and medium | |
| WO2020233142A1 (en) | Multimedia file playback method and apparatus, electronic device, and storage medium | |
| CN111930973B (en) | Multimedia data playing method and device, electronic equipment and storage medium | |
| US20060023949A1 (en) | Information-processing apparatus, information-processing method, recording medium, and program | |
| US20220148624A1 (en) | Image display method and apparatus | |
| WO2022042389A1 (en) | Search result display method and apparatus, readable medium, and electronic device | |
| US10728486B2 (en) | Smart television playing method and device | |
| CN109168027B (en) | Instant video display method and device, terminal equipment and storage medium | |
| CN109618216B (en) | Method, device and equipment for displaying video loading state identification and storage medium | |
| US20240143649A1 (en) | Multimedia information processing method, apparatus, electronic device, and medium | |
| CN109168012B (en) | Information processing method and device for terminal equipment | |
| WO2021018186A1 (en) | Video update push method and terminal | |
| CN111163348A (en) | Searching method and device based on video playing | |
| CN104615432B (en) | Splash screen information processing method and client | |
| CN113271487A (en) | Audio and video synchronous playing method, device, system, program product and storage medium | |
| CN113365150A (en) | Video processing method and video processing device | |
| CN112017261A (en) | Sticker generation method and device, electronic equipment and computer readable storage medium | |
| CN113365010B (en) | Volume adjusting method, device, equipment and storage medium | |
| CN116170549A (en) | Video processing method and device | |
| CN112118473B (en) | Video bullet screen display method and device, computer equipment and readable storage medium | |
| CN113590063A (en) | Method for controlling multimedia presentation by third party | |
| CN114245191B (en) | Split screen social method and related device based on window dynamic information | |
| CN112565859B (en) | Video content display method, client and storage medium | |
| CN111381797B (en) | Processing method and device for realizing KTV function on client and user equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |