CN114302086A - Method, device and system for recording and playing back full-screen ultrahigh-resolution picture of display wall - Google Patents

Method, device and system for recording and playing back full-screen ultrahigh-resolution picture of display wall Download PDF

Info

Publication number
CN114302086A
CN114302086A CN202111604786.4A CN202111604786A CN114302086A CN 114302086 A CN114302086 A CN 114302086A CN 202111604786 A CN202111604786 A CN 202111604786A CN 114302086 A CN114302086 A CN 114302086A
Authority
CN
China
Prior art keywords
recording
display wall
picture
processor
playback
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202111604786.4A
Other languages
Chinese (zh)
Other versions
CN114302086B (en
Inventor
甄海华
黄锡平
刘先材
刘明华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vtron Group Co Ltd
Original Assignee
Vtron Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vtron Group Co Ltd filed Critical Vtron Group Co Ltd
Priority to CN202111604786.4A priority Critical patent/CN114302086B/en
Publication of CN114302086A publication Critical patent/CN114302086A/en
Application granted granted Critical
Publication of CN114302086B publication Critical patent/CN114302086B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The invention relates to the technical field of audio and video processing, and discloses a method, a device and a system for recording and playing back a full-screen ultrahigh-resolution picture of a display wall. The recording playback server stores the acquired picture recording data of the target display wall to the local, when a playback instruction is received, a player is established on a desktop, the player decodes multiple paths of video code streams and one path of audio code stream in the picture recording data, all paths of video frames obtained by decoding are spliced into a complete picture according to respective recording region positions for playing, wherein the resolution ratio of the complete picture is the same as that of the picture of the target display wall, the audio obtained by decoding is synchronously played, and the playback of the picture recording data is realized by outputting the playing data to a processor of the display wall to be played back. The invention can simultaneously meet the requirements of ultra-high-definition playback, audio and video synchronization and picture synchronization on video playback, and has wide applicability.

Description

Method, device and system for recording and playing back full-screen ultrahigh-resolution picture of display wall
Technical Field
The invention relates to the technical field of audio and video processing, in particular to a method, a device and a system for recording and playing back full-screen ultrahigh-resolution pictures of a display wall.
Background
In a conference scene of a monitoring room and a conference room, sometimes, the whole playing picture of a large screen of a display wall needs to be recorded as a video, the video is recorded in a storage disk, and the recorded video is played on the large screen of the display wall when the conference record is subsequently checked, namely, the video is played back. When video playback is carried out, the following requirements are met: (1) ultra-high definition playback, preferably the resolution of the recorded video is consistent with that of the whole display wall large screen; (2) audio and video synchronization, namely, the audio and the video are kept synchronous in the video playback process; (3) the playback picture is synchronous, and the picture synchronization among a plurality of spliced screens is required because the large display screen of the display wall is formed by splicing a plurality of display screens.
The traditional method is to use a camera to shoot the whole large screen picture of the display wall, store the picture as a video and then project a video file as a signal to the large screen of the display wall for playing. The method can meet the requirements of audio and video synchronization and playback picture synchronization, but the shooting resolution of the camera is limited, generally only 4K shooting is supported at most, and the resolution of a large screen of a display wall far exceeds 4K resolution, so that the traditional method cannot meet the requirements of ultra-high-definition playback, and is limited by factors such as recorded ambient light, and the quality of a video picture shot by the camera is far different from the quality of a video picture actually displayed by the large screen of the display wall.
Disclosure of Invention
The invention provides a method, a device and a system for recording and playing back a full-screen ultrahigh-resolution picture of a display wall, which can simultaneously meet the video playback requirements of ultrahigh-definition playback, audio and video synchronization and picture synchronization and solve the technical problem that the traditional picture recording and playing back method can not meet the ultrahigh-definition playback requirements.
The invention provides a method for recording and replaying a full-screen ultrahigh-resolution picture of a display wall, which is applied to a recording and replaying server and comprises the following steps:
acquiring and storing picture recording data of a target display wall, wherein the picture recording data comprises a plurality of paths of video code streams and a path of audio code stream with synchronous timestamps, each path of video code stream carries corresponding recording area position information and first timestamp information of each video frame, and the audio code stream carries corresponding second timestamp information;
when a playback instruction is received, a player is created on a desktop, the player decodes the video code stream according to the first timestamp information, and splices all paths of video frames obtained by decoding into a complete picture according to the recording area position information for playing, wherein the resolution of the complete picture is the same as that of the target display wall; meanwhile, the player decodes the audio code stream according to the second timestamp information, and synchronously plays audio obtained by decoding according to the first timestamp information and the second timestamp information;
and outputting the playing data output by the player to a processor of the display wall to be played back, so that the processor controls the display wall to be played back to play the playing data according to the picture resolution.
According to a manner that can be realized by the first aspect of the present invention, the acquiring picture recording data of a target display wall includes:
when receiving a recording instruction, requesting each recording node of a recording node group for the picture recording data; the number of the recording nodes of the recording node group is the same as the number of output channels of the processor of the target display wall;
and receiving video code streams sent by the recording nodes, wherein the video code streams are obtained by carrying out video coding on the collected output videos corresponding to the output channels by the recording nodes.
According to a manner that can be realized by the first aspect of the present invention, the acquiring picture recording data of a target display wall further includes:
and receiving an audio code stream sent by a recording node in the recording node group.
According to a manner that can be realized by the first aspect of the present invention, the processor that outputs the playing data output by the player to a display wall to be played back includes:
if the processor of the display wall to be played back is a centralized processor, directly outputting the playing data to an acquisition channel of the processor of the display wall to be played back; and/or if the processor of the playback display wall is a distributed processor, outputting the playing data to a playback node through a video card port, so that the playback node encodes the playing data into a network stream and transmits the network stream to the distributed processor.
The second aspect of the present invention provides a device for recording and playing back a full-screen ultrahigh-resolution picture on a display wall, comprising:
a memory to store instructions; the instruction is the instruction which can realize the recording and playback method of the full-screen and ultrahigh-resolution picture of the display wall in any one of the realizable modes;
a processor to execute the instructions in the memory.
A third aspect of the present invention provides a computer-readable storage medium, wherein a computer program is stored on the computer-readable storage medium, and when executed by a processor, the computer program implements a method for recording and playing back a full-screen ultrahigh-resolution picture on a display wall according to any of the above-mentioned manners.
The fourth aspect of the present invention provides a device for recording and playing back a full-screen ultrahigh resolution picture on a display wall, comprising:
the system comprises an acquisition module, a storage module and a display module, wherein the acquisition module is used for acquiring and storing picture recording data of a target display wall, the picture recording data comprises a plurality of paths of video code streams and one path of audio code stream with synchronous timestamps, each path of video code stream carries corresponding recording area position information and first timestamp information of each video frame, and the audio code stream carries corresponding second timestamp information;
the processing module is used for creating a player on a desktop when a playback instruction is received, decoding the video code stream by the player according to the first timestamp information, and splicing all paths of video frames obtained by decoding into a complete picture according to the recording area position information for playing, wherein the resolution of the complete picture is the same as that of the target display wall; meanwhile, the player decodes the audio code stream according to the second timestamp information, and synchronously plays audio obtained by decoding according to the first timestamp information and the second timestamp information;
and the output module is used for outputting the playing data output by the player to a processor of the display wall to be played back, so that the processor controls the display wall to be played back to play the playing data according to the picture resolution.
According to an implementable manner of the fourth aspect of the present invention, the obtaining means comprises:
the request unit is used for requesting the picture recording data to each recording node of the recording node group when receiving the recording instruction; the number of the recording nodes of the recording node group is the same as the number of output channels of the processor of the target display wall;
and the first receiving unit is used for receiving the video code stream sent by each recording node, and the video code stream is obtained by carrying out video coding on the collected output video of the corresponding output channel by the recording node.
According to an implementable manner of the fourth aspect of the present invention, the obtaining module further includes:
and the second receiving unit is used for receiving the audio code stream sent by one recording node in the recording node group.
According to an implementable manner of the fourth aspect of the present invention, the output module is specifically configured to:
if the processor of the display wall to be played back is a centralized processor, directly outputting the playing data to an acquisition channel of the processor of the display wall to be played back; and/or if the processor of the playback display wall is a distributed processor, outputting the playing data to a playback node through a video card port, so that the playback node encodes the playing data into a network stream and transmits the network stream to the distributed processor.
The fifth aspect of the invention provides a system for recording and playing back a full-screen ultrahigh-resolution picture of a display wall, which comprises a recording node group and a recording and playing-back server;
the recording node group is used for collecting picture recording data of a target display wall, the picture recording data comprises a plurality of paths of video code streams and one path of audio code stream with synchronous timestamps, each path of video code stream carries corresponding recording area position information and first timestamp information of each video frame, and the audio code stream carries corresponding second timestamp information;
the recording playback server is used for receiving and storing the picture recording data, when a playback instruction is received, a player is created on a desktop, the player decodes the video code stream according to the first timestamp information, and splices all paths of video frames obtained by decoding into a complete picture according to the recording area position information for playing, wherein the resolution of the complete picture is the same as the picture resolution of the target display wall; meanwhile, the player decodes the audio code stream according to the second timestamp information, and synchronously plays audio obtained by decoding according to the first timestamp information and the second timestamp information;
the recording playback server is further configured to output the play data output by the player to a processor of a display wall to be played back, so that the processor controls the display wall to be played back to play the play data according to the picture resolution.
According to a manner that can be realized by the fifth aspect of the present invention, the recording node group includes recording nodes that are the same in number as the output channels of the processor of the target display wall;
the recording playback server is specifically configured to request the picture recording data from each recording node of the recording node group when receiving a recording instruction;
the recording node is used for collecting output videos corresponding to the output channels, carrying out video coding and sending obtained video code streams to the recording playback server.
According to a manner that can be realized in the fifth aspect of the present invention, a recording node in the recording node group is further configured to collect the audio code stream, and send the audio code stream to the recording playback server.
According to one enabling manner of the fifth aspect of the invention, the system further comprises a playback node;
if the processor of the display wall to be played back is a centralized processor, the recording playback server is specifically configured to directly output the play data to an acquisition channel of the processor of the display wall to be played back; and/or if the processor of the playback display wall is a distributed processor, the recording playback server is specifically configured to output the play data to the playback node through a video card port, so that the playback node encodes the play data into a network stream and transmits the network stream to the distributed processor.
According to the technical scheme, the invention has the following advantages:
the recording playback server stores the acquired picture recording data of the target display wall to the local, when a playback instruction is received, a player is established on a desktop, the player decodes multiple paths of video code streams and one path of audio code stream in the picture recording data, all paths of video frames obtained by decoding are spliced into a complete picture according to respective recording region positions, the complete picture is played according to the picture resolution of the target display wall, the audio obtained by decoding is synchronously played, and the playback of the picture recording data is realized by outputting the playing data to a processor of the display wall to be played back; the invention plays the complete picture according to the picture resolution of the target display wall through the established player, and compared with the shooting mode of the traditional video recorder, the invention can ensure that the resolution of the played back picture is completely the same as that of the original display wall, meet the requirement of ultra-high-definition playback, ensure the picture quality precision of the played back picture, play the recorded audio stream through the mode of establishing the player on the desktop, solve the problem of the synchronism of transmission and display among networks of different code streams, and meet the requirements of audio synchronization and played back picture synchronization; the invention has strong applicability, is suitable for distributed processors and centralized processors, and is compatible with processor systems supporting different manufacturers on the market.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without inventive exercise.
Fig. 1 is a flowchart of a method for recording and playing back a full-screen ultrahigh-resolution picture on a display wall according to an alternative embodiment of the present invention;
fig. 2 is a block diagram of a full-screen ultrahigh-resolution picture recording and playback apparatus for a display wall according to an alternative embodiment of the present invention.
Description of the drawings:
1-an acquisition module; 2-a processing module; and 3, outputting the module.
Detailed Description
The embodiment of the invention provides a method, a device and a system for recording and playing back a full-screen ultrahigh-resolution picture of a display wall, which can simultaneously meet the video playback requirements of ultrahigh-definition playback, audio and video synchronization and picture synchronization and solve the technical problem that the traditional picture recording and playing back method can not meet the ultrahigh-definition playback requirements.
In order to make the objects, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the embodiments described below are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The invention provides a method for recording and replaying a full-screen ultrahigh-resolution picture of a display wall, which is applied to a recording and replaying server.
Referring to fig. 1, fig. 1 is a flowchart illustrating a method for recording and playing back a full-screen ultrahigh-resolution picture of a display wall according to an embodiment of the present invention.
The invention provides a method for recording and playing back a full-screen ultrahigh-resolution picture of a display wall, which comprises the steps of S1-S3.
Step S1, obtaining and storing picture recording data of a target display wall, wherein the picture recording data comprises a plurality of paths of video code streams and one path of audio code stream with synchronous timestamps, each path of video code stream carries corresponding recording area position information and first timestamp information of each video frame, and the audio code stream carries corresponding second timestamp information.
The target display wall is a display wall in a conference scene and comprises a plurality of display screens. In order to obtain the picture recording data of the target display wall, the picture of each display screen needs to be recorded. In the embodiment of the invention, the recorded data acquisition of the picture of each display screen is realized by acquiring a plurality of paths of video code streams and one path of audio code stream, wherein each path of video code stream corresponds to position information of a recording area, and the position information of the recording area is used for representing the position of the corresponding display screen. For example, when the target display wall is 2 × 2 in size, the number of output channels of the corresponding processor is four, and each output channel corresponds to four different positions of the 2 × 2 display wall, for example, display wall areas (display screens) at upper left, upper right, lower left and lower right positions. In order to obtain the image recording data of the target display wall, in the specific implementation, four recording areas need to be set, and each recording area corresponds to an output channel of the processor. When acquiring the image recording data, acquiring the output video from each output channel, and encoding the output video to obtain a path of video code stream, where the recording area position information carried by the path of video code stream includes the position of the recording area corresponding to the corresponding output channel. Specifically, for example, the recording area corresponding to the first path of video code stream is at the top left, the recording area corresponding to the second path of video code stream is at the top right, the recording area corresponding to the third path of video code stream is at the bottom left, and the recording area corresponding to the fourth path of video code stream is at the bottom right.
In order to ensure the timestamp synchronization of the multiple paths of video code streams and one path of audio code stream, an NTP (network time protocol) synchronization technology can be adopted when audio and video data are collected. After NTP synchronization, the time error of each acquisition point can be reduced to about 1 millisecond, so that the requirement of signal synchronization can be completely met.
When the picture recording data of the target display wall is stored, the multiple paths of video code streams and one path of audio code stream can be stored in a local disk, and the recording area position corresponding to each path of network video code, the timestamp information of each frame of each path of network video code and the audio timestamp information are recorded in a local database.
In one implementation, the acquiring picture recording data of a target display wall includes:
when receiving a recording instruction, requesting each recording node of a recording node group for the picture recording data; the number of the recording nodes of the recording node group is the same as the number of output channels of the processor of the target display wall;
and receiving video code streams sent by the recording nodes, wherein the video code streams are obtained by carrying out video coding on the collected output videos corresponding to the output channels by the recording nodes.
In the embodiment of the invention, the synchronous acquisition of the audio and the video and the coding of the audio and the video are realized by setting the recording nodes, wherein the number of the recording nodes is the same as the number of output channels of the processor of the target display wall. For example, when the number of the output channels of the processor of the target display wall is four, four recording nodes are correspondingly set, the four recording nodes form a recording node group, and each recording node is responsible for acquiring an output video of one of the output channels of the processor of the target display wall and encoding a corresponding video code stream. The specific encoding method may be to encode the video frames one frame by one frame, and each frame carries the timestamp information of the current frame.
NTP synchronization can be set between every two recording nodes to achieve timestamp synchronization of each video code stream.
In order to realize the above functions of the recording node, a video acquisition encoder can be used as the recording node. The video acquisition encoder generally adopts HDMI/DP/DVI acquisition input and network encoding output, and the output code stream supports video compression formats such as H.264, H.265 and the like.
In an implementation manner, the acquiring picture recording data of a target display wall further includes:
and receiving an audio code stream sent by a recording node in the recording node group.
According to the embodiment of the invention, a recording node can not only acquire the video code stream, but also be responsible for acquiring the field audio and encoding the audio so as to acquire the audio code stream carrying the timestamp information. In specific implementation, one path of audio signal can be output from a sound console in a conference scene and accessed to the recording node, and the access mode is generally 3.5 mm audio line.
Step S2, when a playback instruction is received, a player is created on a desktop, the player decodes the video code stream according to the first timestamp information, and splices all paths of video frames obtained by decoding into a complete picture according to the recording area position information for playing, wherein the resolution of the complete picture is the same as that of the target display wall; and meanwhile, the player decodes the audio code stream according to the second timestamp information, and synchronously plays the audio obtained by decoding according to the first timestamp information and the second timestamp information.
To achieve the same resolution of the complete picture as that of the target display wall, in one embodiment, the resolution of the desktop of the recording and playback server may be configured to be consistent with the picture resolution of the target display wall, for example, the processor output is M rows and N columns, each port output is 1920 × 1080, and the desktop of the recording and playback server is configured to be 1920 × N wide and 1080 × M high. Meanwhile, when creating a player, a player supporting ultra-high resolution is created and the player is made to be full screen.
And the audio obtained by decoding is synchronously played according to the first time stamp information and the second time stamp information, specifically, the second time stamp information is matched with the first time stamp information, so that the audio can be synchronously played with the video.
According to the embodiment of the invention, the complete picture is played by the created player according to the picture resolution of the target display wall, compared with the shooting mode of the traditional video recorder, the resolution of the played back picture is completely the same as that of the original display wall, the requirement of ultra-high-definition playback is met, the picture quality precision of the played back picture is guaranteed, the recorded audio stream is played by the mode of creating the player on the desktop, the problem of synchronism of transmission and display among networks of different code streams can be solved, and the requirements of audio synchronization and played back picture synchronization are met.
Step S3, outputting the playing data output by the player to a processor of a display wall to be played back, so that the processor controls the display wall to be played back to play the playing data according to the picture resolution.
In one implementation manner, the processor for outputting the playing data output by the player to a display wall to be played back includes:
if the processor of the display wall to be played back is a centralized processor, directly outputting the playing data to an acquisition channel of the processor of the display wall to be played back; and/or if the processor of the playback display wall is a distributed processor, outputting the playing data to a playback node through a video card port, so that the playback node encodes the playing data into a network stream and transmits the network stream to the distributed processor.
The number of the playback nodes is the same as the number of the actual output ports of the video cards of the recording and playback server.
In the embodiment of the present invention, the playing data (i.e., the playing picture of the player) is output to the playback node through the port of the graphics card or directly output to the acquisition channel of the processor. The former is suitable for the distributed processor, and the playback node collects the output of the display card and encodes the output into a network stream to be sent to the distributed processor for display. To achieve this, the playback node needs to have the ability to display in synchronization with the signal of the distributed processor.
If the playback node is used, the audio port output of the recording playback server is connected to one of the playback nodes, and the playback node codes are transmitted to the distributed processor for playing. If the playback node is not needed, the audio port of the recording playback server is directly output to the sound box for playing.
Through the setting of the playback node, the display wall full-screen ultrahigh-resolution picture recording and playback method has strong applicability, is suitable for a distributed processor and a centralized processor, and is compatible with processor systems supporting different manufacturers in the market.
The invention also provides a device for recording and playing back the full-screen ultrahigh-resolution picture of the display wall, which comprises:
a memory to store instructions; the instruction is the instruction which can realize the recording and playback method of the full-screen and ultrahigh-resolution picture of the display wall in any one of the realizable modes;
a processor to execute the instructions in the memory.
The present invention further provides a computer-readable storage medium, wherein a computer program is stored on the computer-readable storage medium, and when executed by a processor, the computer program implements the method for recording and playing back a full-screen ultrahigh-resolution picture on a display wall in any of the above-mentioned manners.
The invention also provides a device for recording and playing back the full-screen ultrahigh-resolution picture of the display wall.
Referring to fig. 2, fig. 2 is a block diagram illustrating a structural connection of a device for recording and playing back a full-screen ultrahigh-resolution picture on a display wall according to an embodiment of the present invention.
The embodiment of the invention provides a device for recording and playing back a full-screen ultrahigh-resolution picture of a display wall, which comprises:
the system comprises an acquisition module 1, a storage module and a display module, wherein the acquisition module 1 is used for acquiring and storing picture recording data of a target display wall, the picture recording data comprises a plurality of paths of video code streams and a path of audio code stream with synchronous timestamps, each path of video code stream carries corresponding recording area position information and first timestamp information of each video frame, and the audio code stream carries corresponding second timestamp information;
the processing module 2 is configured to create a player on a desktop when a playback instruction is received, decode the video code stream by the player according to the first timestamp information, and splice the decoded video frames into a complete picture according to the recording area position information for playing, where a resolution of the complete picture is the same as a picture resolution of the target display wall; meanwhile, the player decodes the audio code stream according to the second timestamp information, and synchronously plays audio obtained by decoding according to the first timestamp information and the second timestamp information;
and the output module 3 is configured to output the playing data output by the player to a processor of a display wall to be played back, so that the processor controls the display wall to be played back to play the playing data according to the picture resolution.
In an implementation manner, the obtaining module 1 includes:
the request unit is used for requesting the picture recording data to each recording node of the recording node group when receiving the recording instruction; the number of the recording nodes of the recording node group is the same as the number of output channels of the processor of the target display wall;
and the first receiving unit is used for receiving the video code stream sent by each recording node, and the video code stream is obtained by carrying out video coding on the collected output video of the corresponding output channel by the recording node.
In an implementation manner, the obtaining module 1 further includes:
and the second receiving unit is used for receiving the audio code stream sent by one recording node in the recording node group.
In an implementation manner, the output module 3 is specifically configured to:
if the processor of the display wall to be played back is a centralized processor, directly outputting the playing data to an acquisition channel of the processor of the display wall to be played back; and/or if the processor of the playback display wall is a distributed processor, outputting the playing data to a playback node through a video card port, so that the playback node encodes the playing data into a network stream and transmits the network stream to the distributed processor.
The invention also provides a system for recording and playing back the full-screen ultrahigh-resolution picture of the display wall, which comprises a recording node group and a recording and playing back server;
the recording node group is used for collecting picture recording data of a target display wall, the picture recording data comprises a plurality of paths of video code streams and one path of audio code stream with synchronous timestamps, each path of video code stream carries corresponding recording area position information and first timestamp information of each video frame, and the audio code stream carries corresponding second timestamp information;
the recording playback server is used for receiving and storing the picture recording data, when a playback instruction is received, a player is created on a desktop, the player decodes the video code stream according to the first timestamp information, and splices all paths of video frames obtained by decoding into a complete picture according to the recording area position information for playing, wherein the resolution of the complete picture is the same as the picture resolution of the target display wall; meanwhile, the player decodes the audio code stream according to the second timestamp information, and synchronously plays audio obtained by decoding according to the first timestamp information and the second timestamp information;
the recording playback server is further configured to output the play data output by the player to a processor of a display wall to be played back, so that the processor controls the display wall to be played back to play the play data according to the picture resolution.
In one implementation manner, the recording node group includes recording nodes with the same number as the output channels of the processor of the target display wall;
the recording playback server is specifically configured to request the picture recording data from each recording node of the recording node group when receiving a recording instruction;
the recording node is used for collecting output videos corresponding to the output channels, carrying out video coding and sending obtained video code streams to the recording playback server.
In an implementation manner, one recording node in the recording node group is further configured to collect the audio code stream, and send the audio code stream to the recording playback server.
In one implementation, the system further comprises a playback node;
if the processor of the display wall to be played back is a centralized processor, the recording playback server is specifically configured to directly output the play data to an acquisition channel of the processor of the display wall to be played back; and/or if the processor of the playback display wall is a distributed processor, the recording playback server is specifically configured to output the play data to the playback node through a video card port, so that the playback node encodes the play data into a network stream and transmits the network stream to the distributed processor.
It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes and effects of the systems, apparatuses and modules described above may refer to the corresponding processes and effects in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (14)

1. A recording and playback method of full screen and ultrahigh resolution pictures of a display wall is applied to a recording and playback server and is characterized by comprising the following steps:
acquiring and storing picture recording data of a target display wall, wherein the picture recording data comprises a plurality of paths of video code streams and a path of audio code stream with synchronous timestamps, each path of video code stream carries corresponding recording area position information and first timestamp information of each video frame, and the audio code stream carries corresponding second timestamp information;
when a playback instruction is received, a player is created on a desktop, the player decodes the video code stream according to the first timestamp information, and splices all paths of video frames obtained by decoding into a complete picture according to the recording area position information for playing, wherein the resolution of the complete picture is the same as that of the target display wall; meanwhile, the player decodes the audio code stream according to the second timestamp information, and synchronously plays audio obtained by decoding according to the first timestamp information and the second timestamp information;
and outputting the playing data output by the player to a processor of the display wall to be played back, so that the processor controls the display wall to be played back to play the playing data according to the picture resolution.
2. The method for recording and playing back full-screen ultrahigh-resolution pictures of a display wall according to claim 1, wherein the obtaining of the picture recording data of the target display wall comprises:
when receiving a recording instruction, requesting each recording node of a recording node group for the picture recording data; the number of the recording nodes of the recording node group is the same as the number of output channels of the processor of the target display wall;
and receiving video code streams sent by the recording nodes, wherein the video code streams are obtained by carrying out video coding on the collected output videos corresponding to the output channels by the recording nodes.
3. The method for recording and playing back full-screen ultrahigh-resolution pictures of a display wall according to claim 2, wherein the obtaining of the picture recording data of the target display wall further comprises:
and receiving an audio code stream sent by a recording node in the recording node group.
4. The method for recording and playing back a full-screen ultrahigh-resolution picture on a display wall according to claim 1, wherein the outputting the playing data output by the player to the processor of the display wall to be played back comprises:
if the processor of the display wall to be played back is a centralized processor, directly outputting the playing data to an acquisition channel of the processor of the display wall to be played back; and/or if the processor of the playback display wall is a distributed processor, outputting the playing data to a playback node through a video card port, so that the playback node encodes the playing data into a network stream and transmits the network stream to the distributed processor.
5. A device for recording and playing back a full screen and ultrahigh resolution picture on a display wall is characterized by comprising:
a memory to store instructions; the instruction is an instruction which can realize the recording and playback method of the display wall full-screen ultrahigh-resolution picture according to any one of claims 1 to 4;
a processor to execute the instructions in the memory.
6. A computer-readable storage medium, having stored thereon a computer program which, when executed by a processor, implements the method for recording and playing back full-screen super-high resolution pictures on a display wall according to any one of claims 1 to 4.
7. A device for recording and playing back a full screen and ultrahigh resolution picture on a display wall is characterized by comprising:
the system comprises an acquisition module, a storage module and a display module, wherein the acquisition module is used for acquiring and storing picture recording data of a target display wall, the picture recording data comprises a plurality of paths of video code streams and one path of audio code stream with synchronous timestamps, each path of video code stream carries corresponding recording area position information and first timestamp information of each video frame, and the audio code stream carries corresponding second timestamp information;
the processing module is used for creating a player on a desktop when a playback instruction is received, decoding the video code stream by the player according to the first timestamp information, and splicing all paths of video frames obtained by decoding into a complete picture according to the recording area position information for playing, wherein the resolution of the complete picture is the same as that of the target display wall; meanwhile, the player decodes the audio code stream according to the second timestamp information, and synchronously plays audio obtained by decoding according to the first timestamp information and the second timestamp information;
and the output module is used for outputting the playing data output by the player to a processor of the display wall to be played back, so that the processor controls the display wall to be played back to play the playing data according to the picture resolution.
8. The device for recording and playing back a full screen and ultra-high resolution picture of a display wall according to claim 7, wherein the obtaining module comprises:
the request unit is used for requesting the picture recording data to each recording node of the recording node group when receiving the recording instruction; the number of the recording nodes of the recording node group is the same as the number of output channels of the processor of the target display wall;
and the first receiving unit is used for receiving the video code stream sent by each recording node, and the video code stream is obtained by carrying out video coding on the collected output video of the corresponding output channel by the recording node.
9. The apparatus for recording and playing back a full screen and ultra-high resolution picture of a display wall according to claim 8, wherein the obtaining module further comprises:
and the second receiving unit is used for receiving the audio code stream sent by one recording node in the recording node group.
10. The device for recording and playing back a full-screen ultrahigh-resolution picture of a display wall according to claim 7, wherein the output module is specifically configured to:
if the processor of the display wall to be played back is a centralized processor, directly outputting the playing data to an acquisition channel of the processor of the display wall to be played back; and/or if the processor of the playback display wall is a distributed processor, outputting the playing data to a playback node through a video card port, so that the playback node encodes the playing data into a network stream and transmits the network stream to the distributed processor.
11. A recording and playback system for full-screen ultrahigh-resolution pictures of a display wall is characterized by comprising a recording node group and a recording and playback server;
the recording node group is used for collecting picture recording data of a target display wall, the picture recording data comprises a plurality of paths of video code streams and one path of audio code stream with synchronous timestamps, each path of video code stream carries corresponding recording area position information and first timestamp information of each video frame, and the audio code stream carries corresponding second timestamp information;
the recording playback server is used for receiving and storing the picture recording data, when a playback instruction is received, a player is created on a desktop, the player decodes the video code stream according to the first timestamp information, and splices all paths of video frames obtained by decoding into a complete picture according to the recording area position information for playing, wherein the resolution of the complete picture is the same as the picture resolution of the target display wall; meanwhile, the player decodes the audio code stream according to the second timestamp information, and synchronously plays audio obtained by decoding according to the first timestamp information and the second timestamp information;
the recording playback server is further configured to output the play data output by the player to a processor of a display wall to be played back, so that the processor controls the display wall to be played back to play the play data according to the picture resolution.
12. The system of claim 11, wherein the cluster of recording nodes comprises the same number of recording nodes as the number of output channels of the processor of the target display wall;
the recording playback server is specifically configured to request the picture recording data from each recording node of the recording node group when receiving a recording instruction;
the recording node is used for collecting output videos corresponding to the output channels, carrying out video coding and sending obtained video code streams to the recording playback server.
13. The system of claim 12, wherein a recording node in the group of recording nodes is further configured to collect the audio code stream and send the audio code stream to the recording and playback server.
14. The system of claim 11, further comprising a playback node;
if the processor of the display wall to be played back is a centralized processor, the recording playback server is specifically configured to directly output the play data to an acquisition channel of the processor of the display wall to be played back; and/or if the processor of the playback display wall is a distributed processor, the recording playback server is specifically configured to output the play data to the playback node through a video card port, so that the playback node encodes the play data into a network stream and transmits the network stream to the distributed processor.
CN202111604786.4A 2021-12-24 2021-12-24 Method, device and system for recording and playing back full-screen ultrahigh-resolution picture of display wall Active CN114302086B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111604786.4A CN114302086B (en) 2021-12-24 2021-12-24 Method, device and system for recording and playing back full-screen ultrahigh-resolution picture of display wall

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111604786.4A CN114302086B (en) 2021-12-24 2021-12-24 Method, device and system for recording and playing back full-screen ultrahigh-resolution picture of display wall

Publications (2)

Publication Number Publication Date
CN114302086A true CN114302086A (en) 2022-04-08
CN114302086B CN114302086B (en) 2023-04-21

Family

ID=80968600

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111604786.4A Active CN114302086B (en) 2021-12-24 2021-12-24 Method, device and system for recording and playing back full-screen ultrahigh-resolution picture of display wall

Country Status (1)

Country Link
CN (1) CN114302086B (en)

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104253931A (en) * 2014-08-22 2014-12-31 宁波Gqy视讯股份有限公司 Recording method for screen pictures of multi-screen tiled display system
CN104601863A (en) * 2013-09-12 2015-05-06 深圳锐取信息技术股份有限公司 IP matrix system for recording and playing
US20150187333A1 (en) * 2012-06-22 2015-07-02 Universitaet Des Saarlandes Method and system for displaying pixels on display devices
KR101555449B1 (en) * 2014-12-19 2015-09-23 주식회사 21카일렉시스템 Large screen display black box device for video and audio play-back
CN108259993A (en) * 2018-01-11 2018-07-06 杭州叙简科技股份有限公司 Large-size screen monitors method and its display system are thrown based on wall on combination of network video flowing desktop
CN108924582A (en) * 2018-09-03 2018-11-30 深圳市东微智能科技股份有限公司 Video recording method, computer readable storage medium and recording and broadcasting system
US20190051268A1 (en) * 2017-08-14 2019-02-14 Thomas Frederick Utsch Method and System for the Distribution of Synchronized Video to an Array of Randomly Positioned Display Devices Acting as One Aggregated Display Device
CN111108470A (en) * 2019-12-24 2020-05-05 威创集团股份有限公司 Whole wall redisplay method and device for distributed splicing system and computer equipment
CN111601151A (en) * 2020-04-13 2020-08-28 北京拙河科技有限公司 Method, device, medium and equipment for reviewing hundred million-level pixel video
CN111741324A (en) * 2020-07-03 2020-10-02 全时云商务服务股份有限公司 Recording playback method and device and electronic equipment
CN112929583A (en) * 2021-05-10 2021-06-08 北京小鸟科技股份有限公司 Method and system for synchronously recording and replaying original signal source based on large-screen window

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150187333A1 (en) * 2012-06-22 2015-07-02 Universitaet Des Saarlandes Method and system for displaying pixels on display devices
CN104601863A (en) * 2013-09-12 2015-05-06 深圳锐取信息技术股份有限公司 IP matrix system for recording and playing
CN104253931A (en) * 2014-08-22 2014-12-31 宁波Gqy视讯股份有限公司 Recording method for screen pictures of multi-screen tiled display system
KR101555449B1 (en) * 2014-12-19 2015-09-23 주식회사 21카일렉시스템 Large screen display black box device for video and audio play-back
US20190051268A1 (en) * 2017-08-14 2019-02-14 Thomas Frederick Utsch Method and System for the Distribution of Synchronized Video to an Array of Randomly Positioned Display Devices Acting as One Aggregated Display Device
CN108259993A (en) * 2018-01-11 2018-07-06 杭州叙简科技股份有限公司 Large-size screen monitors method and its display system are thrown based on wall on combination of network video flowing desktop
CN108924582A (en) * 2018-09-03 2018-11-30 深圳市东微智能科技股份有限公司 Video recording method, computer readable storage medium and recording and broadcasting system
CN111108470A (en) * 2019-12-24 2020-05-05 威创集团股份有限公司 Whole wall redisplay method and device for distributed splicing system and computer equipment
CN111601151A (en) * 2020-04-13 2020-08-28 北京拙河科技有限公司 Method, device, medium and equipment for reviewing hundred million-level pixel video
CN111741324A (en) * 2020-07-03 2020-10-02 全时云商务服务股份有限公司 Recording playback method and device and electronic equipment
CN112929583A (en) * 2021-05-10 2021-06-08 北京小鸟科技股份有限公司 Method and system for synchronously recording and replaying original signal source based on large-screen window

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
刘蕾等: "多路视频同步记录与回放系统", 《计算机系统应用》 *

Also Published As

Publication number Publication date
CN114302086B (en) 2023-04-21

Similar Documents

Publication Publication Date Title
US7777692B2 (en) Multi-screen video reproducing system
US7623176B2 (en) Meta-data display system, meta-data synthesis apparatus, video-signal recording/reproduction apparatus, imaging apparatus and meta-data display method
US8929643B2 (en) Method and apparatus for receiving multiview camera parameters for stereoscopic image, and method and apparatus for transmitting multiview camera parameters for stereoscopic image
KR20160079357A (en) Method for sending video in region of interest from panoramic-video, server and device
JP2012507968A (en) Apparatus and method for synchronizing stereoscopic images, and stereoscopic image providing apparatus and method using the same
CN104902317A (en) Audio video synchronization method and device
CN108495152A (en) A kind of net cast method, apparatus, electronic equipment and medium
CN112019877A (en) Screen projection method, device and equipment based on VR equipment and storage medium
US20200358838A1 (en) Efficient Association Between DASH Objects
CN102655585A (en) Video conference system and time delay testing method, device and system thereof
CN104243920A (en) Image stitching method and device based on basic stream video data packaging
CN109547724A (en) A kind of processing method of video stream data, electronic equipment and storage device
CN107295355A (en) A kind of audio frequency and video total system and method
CN110913273A (en) Video live broadcasting method and device
CN114079813A (en) Picture synchronization method, coding method, video playing device and video coding device
CN115639976A (en) Multi-mode and multi-angle synchronous display method and system for virtual reality content
JP2010278481A (en) Data processing device
CN112422882A (en) Method and device for providing video source for video conference system
CN114302086B (en) Method, device and system for recording and playing back full-screen ultrahigh-resolution picture of display wall
CN110798699A (en) Video live broadcasting method and device
US9842572B2 (en) Methods and apparatus for displaying video including variable frame rates
US20230025664A1 (en) Data processing method and apparatus for immersive media, and computer-readable storage medium
CN115665493A (en) Large screen splicing device supporting recording and playing, splicer, playing control method and system
CN107205158A (en) A kind of multichannel audio-video frequency stream synchronous decoding method based on timestamp
KR20040065170A (en) Video information decoding apparatus and method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant