CN114845150B - Multi-video display synchronization system of display screen - Google Patents
Multi-video display synchronization system of display screen Download PDFInfo
- Publication number
- CN114845150B CN114845150B CN202210462409.XA CN202210462409A CN114845150B CN 114845150 B CN114845150 B CN 114845150B CN 202210462409 A CN202210462409 A CN 202210462409A CN 114845150 B CN114845150 B CN 114845150B
- Authority
- CN
- China
- Prior art keywords
- frame
- image
- module
- synchronization
- image frames
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
- H04N21/43072—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of multiple content streams on the same device
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04J—MULTIPLEX COMMUNICATION
- H04J3/00—Time-division multiplex systems
- H04J3/02—Details
- H04J3/06—Synchronising arrangements
- H04J3/0635—Clock or time synchronisation in a network
- H04J3/0638—Clock or time synchronisation among nodes; Internode synchronisation
- H04J3/0644—External master-clock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
- H04N21/43632—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wired protocol, e.g. IEEE 1394
- H04N21/43635—HDMI
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8455—Structuring of content, e.g. decomposing content into time segments involving pointers to the content, e.g. pointers to the I-frames of the video stream
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The invention belongs to the technical field of LED display and discloses a display screen multi-video display synchronization method, wherein firstly, bus communication is added between players to supplement time synchronization by GPS/Beidou satellite, so that the synchronism of the multi-players to the video after being split is ensured; secondly, adding the decoded image frames into a frame identifier and forming an HDMI data stream in the processing process of the player video file. After receiving the HDMI data stream output by the player, the transmitting card analyzes and acquires the frame identification and restores the original image frame. Then the transmitting card selects the image frames according to the preset frame configuration parameters through the frame identification and transmits the image frames to the receiving card through the network, thereby ensuring that the spliced image is derived from the same image frame generated by the original video. Through the improvement, the video playing frame synchronism of the display screen is ensured, and the display effect of the large-scale display screen is improved.
Description
Technical Field
The invention belongs to the technical field of LED display screens, and relates to a display screen multi-video display synchronization system, a display screen multi-video display synchronization method, display screen multi-video display synchronization equipment and a storage medium.
Background
A distributed three-layer architecture design for a large LED display screen is shown in fig. 1.
The first layer is composed of a player and a sending card, wherein the player decodes the video file to generate a video data frame and sends the video data frame to the video sending card through an HDMI interface. The video transmitting card receives the HDMI signal, performs a series of operations such as scaling, YUV to RGB conversion, gamma inverse conversion and the like on the video image, and outputs the video image in a data packet mode through a gigabit network (Mo Zhaowang) port.
The second layer is composed of n receiving cards, the receiving cards receive the data packets of the receiving cards through address identification, and the data packets are sent to the LED module in the time sequence and the data format of the LED lamp points. (Note that each receiving card only receives the data of the LED light points corresponding to the LED modules)
The third layer consists of n LED modules, each LED module consists of i x k LED lamp point arrays, and the LED modules comprise LED lamp points and drivers. The LED module receives module image data sent by the receiving card, and display of module patterns is achieved.
With the continuous development of the LED display technology, the outdoor LED display screen has the following characteristics:
(1) The display resolution is continuously improved, and the mini LED is mature, so that the LED display screen can realize the display capability of high-definition and ultra-high-definition videos. This means that the number of LED lamps contained in the LED display screen is increased, and the number of lamps of the large-sized LED display screen can reach more than 200 ten thousand points.
(2) For high definition video playback, refresh rates up to 60Hz are required.
(3) The size of the LED display screen is continuously increased, and the LED display screen has the characteristics of various special-shaped structures. LED screens are so large that the facade of a building can be fully fitted as a display screen, with thousands of square meters of display screens being commonplace. Meanwhile, the large-sized LED outdoor screen is generally designed according to the vertical face structure of a building and integrated with the building, so that the aspect ratio of the screen is not limited by the aspect ratio of the general video, and is in the form of a special-shaped screen, and a video source which is specially played is often arranged.
From the above characteristics, it can be seen that in the outdoor LED large-sized display screen, the outdoor LED large-sized display screen is often appeared as special-shaped screens with aspect ratios not conforming to the aspect ratio of the general video, and the special-shaped screens use special video sources, which exceed the decoding capability of the general player and cannot perform normal playing. In another case, when video playing is performed, since the image data decoded by the player is transmitted through the network, the bandwidth of the network for transmission cannot meet the requirement of high refresh rate transmission of the video image data. In order to solve the problems, a video cutting method is generally adopted in engineering, videos are cut into a plurality of video files according to pictures, and large-screen display is cooperatively completed by adopting a plurality of players, so that the decoding capability requirement of a universal player is met, and the requirement of network bandwidth is reduced.
The precondition of the multi-player for splicing and displaying the video pictures of the large-scale LED screen is synchronous playing of videos, namely, the spliced image frames of the video images output by the multi-player on the LED display screen at any moment are obtained by dividing the original video image frames. The current video synchronous playing and synchronizing method comprises the following steps:
(1) Time synchronization
The time synchronization is that a plurality of players play the video after segmentation at the same time, thereby achieving the purpose of frame synchronization. At present, a synchronous mode of performing time synchronization by adopting GPS/Beidou satellite signals and performing playing at the same time point is adopted. The disadvantage is that time synchronization is difficult to guarantee when the signals of the geographical location where the device is located are weak or the signals are weak due to obstruction by obstacles.
(2) Using decoded I-frame synchronization
For H264 encoded video, I, P, B frames (I frames: key frames; P frames: forward reference frames; B frames: bi-directional reference frames) are formed after decoding, video synchronization is typically achieved using decoded I frames, however, due to the occurrence and frequency of occurrence of I frames and the correlation of video content. When the video content does not change much for a long time, the number of times of occurrence of the I frames is obviously reduced, which causes the video image frames to be out of step.
However, when the number of video image frame pixels reaches a certain number, the network transmission cannot reach a refresh rate of 60 frames/s due to the limitation of bandwidth, and the refresh rate of 60 frames/s for the player HDMI output is fixed. In this case, the transmitting card discards a part of image frames, and adopts a frame extraction transmitting mode to reduce the high requirement of data transmission on bandwidth. As can be seen from the transmission process of the image data of the transmitting card, the frame extraction process has randomness for each transmitting card, and even if the time synchronization of the player is accurate, the image frames received by the receiving cards of different systems cannot be ensured to be synchronized.
In view of the above, to achieve synchronous display, a more efficient method has to be found.
Disclosure of Invention
In order to overcome the defects of the prior art, the invention aims to provide a display screen multi-video display synchronization system, a method, a device and a storage medium, which solve the problem of asynchronous image frames existing in the prior video playing.
The invention is realized by the following technical scheme:
a display screen multi-video display synchronization system comprises a plurality of players and a plurality of sending cards, wherein the players are connected with the sending cards;
an RS232/RS485 bus communication module and an RS232/RS485 communication interface are added on the player, and the player is used for selecting between two modes of RS232/RS485 communication synchronization and satellite synchronization;
the player is internally provided with a video decoding module, an image frame generating module and an HDMI controller which are sequentially connected, wherein the video decoding module is used for generating continuous image frames, and the image frame generating module is used for adding frame identifiers to the continuous image frames generated after decoding and writing the frame identifiers into an HDMI transmission buffer area; the HDMI controller is used for outputting an HDMI data stream with a frame identifier;
the transmitting card is internally provided with a storage module, a receiving module, an image frame generating module, an image frame extracting module, a scaling module, a Gamma correction module, a comparison module and an image sub-packaging module which are connected in sequence;
a receiving module, configured to receive an HDMI data stream with a frame identifier; an image frame generation module for generating an image frame; the image frame extraction module is used for extracting image frames through frame identification according to a set frame extraction rule and recovering original image frames; the scaling module is used for performing scaling compression processing on the restored image frames; the Gamma correction module is used for carrying out Gamma inverse transformation on the image frames; the storage module is used for storing the frame extraction table; the comparison module is used for checking the frame extraction table to judge whether the image frames with the frame identifiers are extracted or not; and the image packetizing module is used for performing packetizing and transmitting in the network.
Further, in the RS232/RS485 communication mode, one of the players is used as a master, and the other players are used as slaves.
Further, the player is connected with the transmission card through an HDMI interface.
The invention also discloses a display screen multi-video display synchronization method, which comprises clock synchronization and frame extraction synchronization, and comprises the following specific processes:
the first step: clock synchronization, including two ways:
mode 1: under the condition that GPS/Beidou satellite signals are good, all players work in a GPS/Beidou satellite synchronous mode to realize time synchronization;
mode 2: under the condition that GPS/Beidou satellite signals are weak, one of the players is configured to be in an RS232/RS485 host mode, the other players are configured to be slaves, the hosts send clock synchronization signals at regular time, and the slaves receive the synchronization signals and synchronize with the hosts;
and a second step of: the frame extraction synchronization comprises the following steps:
step 1: starting a player, and decoding to generate continuous image frames and image frame numbers;
step 2: adding frame identification to the continuous image frames generated after decoding;
step 3: generating an image frame with a frame identification;
step 4: writing the image frames with the frame identifiers into an HDMI transmission buffer;
step 5: the HDMI controller reads the HDMI transmission buffer region, and the controller image frame is converted into HDMI data stream and output through an HDMI interface;
step 6: the transmitting card receives the HDMI data stream and analyzes the HDMI data stream into image frames with frame identifiers;
step 7: extracting a frame identifier from an image frame with the frame identifier, and recovering an original image frame;
step 8: and checking the extraction frame data table, obtaining the frame identification of the transmission frame, reading the corresponding image frame, and packaging and transmitting the image frame into a network.
Further, in step 2, adding a frame identifier to the continuous image frames generated after decoding specifically includes:
the lower 8 bits of the image frame number are taken as the frame identification, and the frame identification is embedded into the image frame.
Further, the 3 rd step is specifically: and adding one row/column of pixels in the fixed position of each frame of image, wherein Y values in YUV of pixel points are replaced by image frame numbers, and generating image frames with frame identifications.
Further, in step 8:
the frame identification range is 0-255, and the frame data table is an array consisting of 256 0 or 1;
the frame extraction synchronization process is to search elements in the array through the frame identification, if the extracted elements are 1, the restored original image is written into the image frame sending buffer area; if the extracted element is 0, the image of the present frame is discarded.
The invention also discloses a computer device, which comprises a memory, a processor and a computer program stored in the memory and capable of running on the processor, wherein the processor realizes the steps of the display screen multi-video display synchronization method when executing the computer program.
The invention also discloses a computer readable storage medium storing a computer program which when executed by a processor implements the steps of the display screen multi-video display synchronization method.
Compared with the prior art, the invention has the following beneficial technical effects:
the invention discloses a display screen multi-video display synchronization method, which is characterized in that RS485 communication channels are added to players in a multi-video playing and splicing display system, so that communication among the multiple players is established to realize time synchronization, and the playing simultaneity of divided videos on different players is ensured; and adding the image frame identifiers into the continuous image frames decoded in the player to form HDMI data stream output with the frame identifiers. The image frame with the frame identification is transmitted to a transmitting card, and the transmitting card decodes and restores the original image frame and extracts the frame identification; the transmitting card performs frame extraction processing according to the set rule table, writes the extracted frames into the transmitting buffer area, discards the rest of the image frames, and transmits the image frames with the determined frame identifications to the receiving card through the network. Through the improvement, the simultaneity of the video playing of the multiple players and the certainty of frame extraction by the sending card under any condition are ensured, and the synchronization of the video display spliced image frames is realized.
Drawings
FIG. 1 is a diagram of a prior art large LED display control system;
FIG. 2 is a diagram of an improved large LED display control system;
FIG. 3 is a process of processing a video file before and after modification of a player; (a) is a processing flow before the improvement of the player; (b) processing flow after player improvement;
FIG. 4 is a process of video files before and after modification of the sending card; (a) is a process flow before improvement of the sending card; (b) modified processing flow for the transmitting card.
Detailed Description
The invention is described in further detail below with reference to the attached drawing figures:
as shown in fig. 1, the distributed three-layer architecture design of a large LED display screen.
The first layer is composed of a player and a transmitting card, wherein the player decodes the video to generate video data frames and transmits the video data frames to the video transmitting card through an HDMI interface. The video transmitting card receives the HDMI signal, performs a series of operations such as scaling, YUV to RGB conversion, gamma inverse conversion and the like on the video image, and outputs the video image in a data packet mode through a gigabit network (Mo Zhaowang) port.
The second layer is composed of n receiving cards, the receiving cards receive the data packets of the receiving cards through address identification, and the data packets are sent to the LED module in the time sequence and the data format of the LED lamp points. (Note that each receiving card only receives the data of the LED light points corresponding to the LED modules)
The third layer consists of n LED modules, each LED module consists of i x k LED lamp point arrays, and the LED modules comprise LED lamp points and drivers. The receiving card sends the module image data to the module in a time sequence format required by the LED drive, so that the display of the module pattern is realized.
For a profile screen, it is often necessary to achieve video display by video segmentation and by a video play and display system. Because the video playing and the display systems are mutually independent, the clock consistency of the two systems must be ensured to realize synchronous playing. In practice, a satellite navigation synchronization mode is adopted, and the synchronization effect is poor due to various reasons such as the installation position of a player, shielding of obstacles and the like.
In practice, there is a case where frame synchronization cannot be achieved by time synchronization. When the number of video image pixel points reaches a certain number, the sending card or the receiving card cannot reach a refresh rate of 60 frames/s due to the limitation of bandwidth, and the refresh rate of 60 frames/s of the HDMI output of the player is fixed. In this case, the transmitting card discards a part of image frames, and adopts a frame extraction transmitting mode to reduce the high requirement of data transmission on bandwidth. As can be seen from the transmission process of the image data of the transmitting card, the frame extraction process has randomness for each transmitting card, and even if the time synchronization of the player is accurate, the image frames received by the receiving cards of different systems cannot be ensured to be synchronized.
The structure of the improved display screen multi-video display synchronous system is shown in fig. 2.
And the first player is added with an RS232/RS485 communication channel, so that the time synchronization among multiple machines is ensured when GPS/Beidou satellite signals are not available. The RS232/RS485 interface is configured in a master/slave mode selectable, and the clock synchronization mode of the player is selectable. When the multi-player works, GPS/Beidou satellite synchronization or RS232/RS485 communication synchronization can be selected. When the RS232/RS485 communication mode is selected for synchronization, the synchronization mode is configured to be an RS232/RS485 synchronization mode, one player is selected as an RS232/RS485 communication host, and the rest players are configured as slaves. As shown in the figure, a large screen display system consisting of 2 sets of video playing and control systems uses a structural schematic diagram of RS232/RS485 communication mode synchronization.
When the satellite synchronizing signal strength is good and the number of the captured satellites exceeds 3, the satellite is used for realizing time synchronization; and when the satellite synchronizing signal is poor, synchronizing by using an RS232/RS485 communication mode. Under the RS232/RS485 communication mode, one player works in a master mode, the other players work in a slave mode through player parameter configuration, the master transmits clock signals at regular time, and the slave receives the signals and processes the signals at regular time to realize clock synchronization.
Second, player decodes image frame and adds image frame identification
The playing flow of the original player is shown in fig. 3 (a); the modified play flow is shown in fig. 3 (b).
The player is internally provided with a video decoding module, an image frame generating module and an HDMI controller which are sequentially connected, wherein the video decoding module is used for generating continuous image frames, and the image frame generating module is used for adding frame identifiers to the continuous image frames generated after decoding and writing the frame identifiers into an HDMI transmission buffer area; the HDMI controller is used for outputting HDMI data stream with frame identification.
And (3) the continuous image frames and image frame numbers generated after video decoding, taking the low 8 bits of the image frame numbers as frame identifications, and embedding the frame identifications into the image frames by the following method.
And adding one row (column) of pixels in each frame of image fixed position, replacing Y values in YUV of pixel points by using image frame identifiers, generating image frames with the frame identifiers, and converting the image frames with the frame identifiers into HDMI data stream to be output through a controller.
Third, improvement of transmitting card
The workflow of the primary send card is shown in fig. 4 (a); the modified workflow is shown in fig. 4 (b). In the original transmitting card image processing flow, the image frame identification extraction, the original image frame recovery and frame extraction processing processes are added.
Specifically, a storage module, an image frame generation module, an image frame extraction module, a scaling module, a Gamma correction module, a comparison module and an image sub-packaging module which are sequentially connected are arranged in the sending card;
a receiving module, configured to receive an HDMI data stream with a frame identifier;
an image frame generation module for generating an image frame;
the image frame extraction module is used for extracting image frames through frame identification according to a set frame extraction rule and recovering original image frames;
the scaling module is used for performing scaling compression processing on the restored image frames;
the Gamma correction module is used for carrying out Gamma inverse transformation processing on the image frames, and carrying out image enhancement processing and color degradation correction on the image frames so as to enable the image frames to better accord with the visual characteristics of human eyes;
the storage module is used for storing the frame extraction table;
the comparison module is used for checking the frame extraction table to judge whether the image frames with the frame identifiers are extracted or not;
and the image packetizing module is used for performing packetizing and transmitting in the network.
The frame extraction process adopts a table look-up method, and firstly a frame extraction data table is established, as shown in the following table, because the frame identification range is 0-255, the data table is an array formed by 256 0 or 1. The frame extraction process is to search the elements in the array through the frame identification, if 1, the restored original image is written into the image frame transmitting buffer area, and if 0, the image of the frame is abandoned. The method realizes the purpose of accurate frame extraction processing.
Through the improvement, the playing synchronism of the player and the accurate frame extraction of the sending card can be ensured, so that the consistency of the image frames received by the receiving card at the same time is ensured.
After improvement, the synchronization process of the large-screen display system of the multi-player is as follows:
(1) Clock synchronization
GPS/Beidou satellite mode: under the condition that the GPS/Beidou satellite is free from shielding and the satellite signal is excellent, all players work in the GPS/Beidou satellite synchronous mode to realize time synchronization.
Master-slave mode: under the condition that GPS/Beidou satellites are shielded and satellite signals are weak, an RS485 interface of the players is connected through a bus, one of the players is configured to be an RS232/RS485 master mode, and the other players are configured to be slaves. The master sends clock synchronization signals at regular time, and the slave receives the synchronization signals and synchronizes with the master.
(2) Frame extraction synchronization
Step 1: starting a player, and decoding to generate continuous image frames and image frame numbers;
step 2: taking the lower 8 bits of the image frame number generated after decoding as frame identifiers (0-255), and embedding the frame identifiers into continuous image frames generated after decoding;
step 3: an image frame with a frame identification is generated.
Adding a row (column) of pixels in a fixed position of an image, wherein the Y value of brightness information in YUV of a pixel point is replaced by an 8-bit image frame number;
step 4: writing the image frames with the frame identifiers into an HDMI transmission buffer;
step 5: the HDMI controller reads the HDMI transmission buffer region, converts the image frame into HDMI data stream and outputs the HDMI data stream through an HDMI interface;
step 6: the sending card receives the HDMI data stream and analyzes the HDMI data stream into an image frame with a frame identifier;
step 7: extracting a frame identifier from an image frame with the frame identifier, and recovering an original image frame;
step 8: and checking the extraction frame table, obtaining the frame identification of the transmission frame, reading the corresponding image frame, packaging and transmitting through a network.
The display screen multi-video display synchronization method of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The display screen multi-video display synchronization method of the present invention, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on such understanding, the present invention may implement all or part of the flow of the method of the above embodiment, or may be implemented by a computer program to instruct related hardware, where the computer program may be stored in a computer readable storage medium, and when the computer program is executed by a processor, the computer program may implement the steps of each of the method embodiments described above. Wherein the computer program comprises computer program code which may be in source code form, object code form, executable file or some intermediate form etc. Computer-readable storage media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. It should be noted that the computer readable medium contains content that can be appropriately scaled according to the requirements of jurisdictions in which such content is subject to legislation and patent practice, such as in certain jurisdictions in which such content is subject to legislation and patent practice, the computer readable medium does not include electrical carrier signals and telecommunication signals. The computer storage media may be any available media or data storage device that can be accessed by a computer, including, but not limited to, magnetic storage (e.g., floppy disks, hard disks, magnetic tape, magneto-optical disks (MOs), etc.), optical storage (e.g., CD, DVD, BD, HVD, etc.), and semiconductor storage (e.g., ROM, EPROM, EEPROM, nonvolatile storage (NANDFLASH), solid State Disk (SSD)), etc.
In an exemplary embodiment, a computer device is also provided, comprising a memory, a processor and a computer program stored in the memory and executable on the processor, the processor implementing the steps of the display screen multi-video display synchronization method when the computer program is executed. The processor may be a central processing unit (CentralProcessingUnit, CPU), but may also be other general purpose processors, digital signal processors (DigitalSignalProcessor, DSP), application specific integrated circuits (ApplicationSpecificIntegratedCircuit, ASIC), off-the-shelf programmable gate arrays (Field-ProgrammableGateArray, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like.
The present invention is not limited to the above-described embodiments, and various modifications and variations can be made by those skilled in the art without inventive effort, and are intended to be covered by the appended claims.
Claims (6)
1. The display screen multi-video display synchronization system is characterized by comprising a plurality of players and a plurality of sending cards, wherein the players are connected with the sending cards;
an RS232/RS485 bus communication module and an RS232/RS485 communication interface are added on the player, and the player is used for selecting between two modes of RS232/RS485 communication synchronization and satellite synchronization;
the player is internally provided with a video decoding module, an image frame generating module and an HDMI controller which are sequentially connected, wherein the video decoding module is used for generating continuous image frames, and the image frame generating module is used for adding frame identifiers to the continuous image frames generated after decoding and writing the frame identifiers into an HDMI transmission buffer area; the HDMI controller is used for outputting an HDMI data stream with a frame identifier;
the transmitting card is internally provided with a storage module, a receiving module, an image frame generating module, an image frame extracting module, a scaling module, a Gamma correction module, a comparison module and an image sub-packaging module which are connected in sequence;
a receiving module, configured to receive an HDMI data stream with a frame identifier; an image frame generation module for generating an image frame; the image frame extraction module is used for extracting image frames through frame identification according to a set frame extraction rule and recovering original image frames; the scaling module is used for scaling the restored image frames; the Gamma correction module is used for carrying out Gamma inverse transformation on the image frames; the storage module is used for storing the frame extraction table; the comparison module is used for checking the frame extraction table to judge whether the image frames with the frame identifiers are extracted or not; the image packetizing module is used for packaging and transmitting the images into a network;
the synchronization process of the display screen multi-video display synchronization system is as follows:
the first step: clock synchronization, including two ways:
mode 1: under the condition that GPS/Beidou satellite signals are good, all players work in a GPS/Beidou satellite synchronous mode to realize time synchronization;
mode 2: under the condition that GPS/Beidou satellite signals are weak, one of the players is configured to be in an RS232/RS485 host mode, the other players are configured to be slaves, the hosts send clock synchronization signals at regular time, and the slaves receive the synchronization signals and synchronize with the hosts;
and a second step of: the frame extraction synchronization comprises the following steps:
step 1: starting a player, and decoding to generate continuous image frames and image frame numbers;
step 2: adding frame identification to the continuous image frames generated after decoding;
step 3: generating an image frame with a frame identification;
step 4: writing the image frames with the frame identifiers into an HDMI transmission buffer;
step 5: the HDMI controller reads the HDMI transmission buffer region, and the controller image frame is converted into HDMI data stream and output through an HDMI interface;
step 6: the transmitting card receives the HDMI data stream and analyzes the HDMI data stream into image frames with frame identifiers;
step 7: extracting a frame identifier from an image frame with the frame identifier, and recovering an original image frame;
step 8: and checking the extraction frame data table, obtaining the frame identification of the transmission frame, reading the corresponding image frame, and packaging and transmitting the image frame into a network.
2. The system of claim 1, wherein one of the players is a master and the other players are slaves in an RS232/RS485 communication.
3. The system of claim 1, wherein the player is connected to the transmitting card via an HDMI interface.
4. The system according to claim 1, wherein in step 2, adding frame identifiers to successive image frames generated after decoding is specifically:
the lower 8 bits of the image frame number are taken as the frame identification, and the frame identification is embedded into the image frame.
5. The system of claim 1, wherein the step 3 is specifically: and adding one row/column of pixels in the fixed position of each frame of image, wherein Y values in YUV of pixel points are replaced by image frame numbers, and generating image frames with frame identifications.
6. The system of claim 1, wherein in step 8:
the frame identification range is 0-255, and the frame data table is an array consisting of 256 0 or 1;
the frame extraction synchronization process is to search elements in the array through the frame identification, if the extracted elements are 1, the restored original image is written into the image frame sending buffer area; if the extracted element is 0, the image of the present frame is discarded.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210462409.XA CN114845150B (en) | 2022-04-28 | 2022-04-28 | Multi-video display synchronization system of display screen |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210462409.XA CN114845150B (en) | 2022-04-28 | 2022-04-28 | Multi-video display synchronization system of display screen |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114845150A CN114845150A (en) | 2022-08-02 |
| CN114845150B true CN114845150B (en) | 2023-08-04 |
Family
ID=82567966
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210462409.XA Active CN114845150B (en) | 2022-04-28 | 2022-04-28 | Multi-video display synchronization system of display screen |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114845150B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104375789A (en) * | 2013-08-14 | 2015-02-25 | 杭州海康威视数字技术股份有限公司 | Synchronous displaying method and system of tiled display screen |
| KR20160082368A (en) * | 2014-12-26 | 2016-07-08 | 전자부품연구원 | Contents Synchronization Method and System in Network-based Multi Display |
| CN112040284A (en) * | 2020-06-24 | 2020-12-04 | 苏州科达科技股份有限公司 | Synchronous display control method and device of multiple display screens and storage medium |
| CN112291477A (en) * | 2020-11-03 | 2021-01-29 | 浙江大华技术股份有限公司 | Multimedia information processing method, device, storage medium and electronic device |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012070447A1 (en) * | 2010-11-22 | 2012-05-31 | 三菱電機株式会社 | Video signal output method and video information player device |
| KR20150057421A (en) * | 2013-11-19 | 2015-05-28 | 한국전자통신연구원 | Multi-screen display apparatus and synchronication tuning method for the same |
| CN105657246A (en) * | 2015-11-15 | 2016-06-08 | 乐视移动智能信息技术（北京）有限公司 | Time-lapse photographing method and apparatus |
| CN112449152B (en) * | 2019-08-29 | 2022-12-27 | 华为技术有限公司 | Method, system and equipment for synchronizing multi-channel video |
| CN111208960B (en) * | 2019-12-26 | 2023-05-09 | 杭州顺网科技股份有限公司 | Remote display delay reduction method based on frame extraction control and time synchronization algorithm |
-
2022
- 2022-04-28 CN CN202210462409.XA patent/CN114845150B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104375789A (en) * | 2013-08-14 | 2015-02-25 | 杭州海康威视数字技术股份有限公司 | Synchronous displaying method and system of tiled display screen |
| KR20160082368A (en) * | 2014-12-26 | 2016-07-08 | 전자부품연구원 | Contents Synchronization Method and System in Network-based Multi Display |
| CN112040284A (en) * | 2020-06-24 | 2020-12-04 | 苏州科达科技股份有限公司 | Synchronous display control method and device of multiple display screens and storage medium |
| CN112291477A (en) * | 2020-11-03 | 2021-01-29 | 浙江大华技术股份有限公司 | Multimedia information processing method, device, storage medium and electronic device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114845150A (en) | 2022-08-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2016107496A1 (en) | Video frame processing method, video processing chip, motion estimation and motion compensation chip | |
| WO2017118078A1 (en) | Image processing method, playing method and related device and system | |
| US10511803B2 (en) | Video signal transmission method and device | |
| US9055275B2 (en) | Image information playback unit, image information playback device and synchronization control method | |
| US20110229106A1 (en) | System for playback of ultra high resolution video using multiple displays | |
| CN107197369B (en) | Video streaming media parallel decoding method with cooperation of multiple sub-streams | |
| CN104954812A (en) | Video synchronized playing method, device and system | |
| KR101677223B1 (en) | Combining video and audio streams utilizing pixel repetition bandwidth | |
| CN111026343A (en) | Real-time synchronous display method for multiple spliced screens | |
| KR20170007261A (en) | Communication apparatus, communication method, and computer program | |
| US20140218608A1 (en) | Method and system for achieving higher video throughput and/or quality | |
| CN106031187B (en) | Transmitting apparatus, transmitting method, receiving apparatus and receiving method | |
| CN105554416A (en) | FPGA (Field Programmable Gate Array)-based high-definition video fade-in and fade-out processing system and method | |
| CN103561227A (en) | High-resolution video playing system | |
| CN107770600A (en) | Transmission method, device, equipment and the storage medium of stream medium data | |
| JP2002199359A (en) | Signal transmitter and signal receiver | |
| CN105430296A (en) | Solving method for multi-picture division cracked screen display of high-definition video | |
| JP5998579B2 (en) | Video display apparatus, method and program for multi-display system | |
| CN109644290B (en) | Data switching device, data acquisition device, system and method | |
| CN114845150B (en) | Multi-video display synchronization system of display screen | |
| CN112040284B (en) | Synchronous display control method and device of multiple display screens and storage medium | |
| CN104038808A (en) | Image decoding apparatus and system for enhancing maneuvering carrier video smoothness, and decoding methods thereof | |
| CN102238421A (en) | Multi-path video synchronous transmission method, device and system | |
| JP2007180999A (en) | Information synchronization system, information transmitter, information receiver, information synchronization program, information transmission program, and information reception program | |
| CN105446685A (en) | Document playing method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |