CN115708356A - Video processing method, device, equipment and computer readable storage medium - Google Patents
Video processing method, device, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN115708356A CN115708356A CN202110951453.2A CN202110951453A CN115708356A CN 115708356 A CN115708356 A CN 115708356A CN 202110951453 A CN202110951453 A CN 202110951453A CN 115708356 A CN115708356 A CN 115708356A
- Authority
- CN
- China
- Prior art keywords
- video data
- video
- node
- nodes
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 23
- 238000000034 method Methods 0.000 claims abstract description 34
- 230000001360 synchronised effect Effects 0.000 claims description 37
- 230000003139 buffering effect Effects 0.000 claims description 10
- 238000009877 rendering Methods 0.000 claims description 6
- 230000000694 effects Effects 0.000 abstract description 12
- 230000015654 memory Effects 0.000 description 15
- 230000006870 function Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 239000000872 buffer Substances 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000011010 flushing procedure Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a video processing method, a video processing device, video processing equipment and a computer readable storage medium. Wherein, the method comprises the following steps: the method comprises the following steps that a playback node receives multiple paths of video data from a plurality of video decoding nodes respectively, wherein the playback node and the video decoding nodes are connected with each other by adopting a distributed architecture, and the video decoding nodes are used for processing the multiple paths of video data and sending multiple paths of video signals obtained after processing to a display screen; splicing the multi-channel video data by the echo node to obtain spliced video data; and outputting the spliced video data by the echoing node. The invention solves the technical problem of poor redisplay function effect of the distributed display screen.
Description
Technical Field
The present invention relates to the field of image processing, and in particular, to a video processing method, apparatus, device, and computer readable storage medium.
Background
The distributed display large screen adopts a distributed system architecture to display a complete image. Most distributed systems in the market do not support the function of large-screen playback, and users cannot watch playback images displaying a large screen at a terminal. Some manufacturers can support a user to watch a echoed image displayed on a large screen at a terminal, but data processing of the echoed image depends on computing power and decoding resources of the user display terminal, and if the number of nodes of the distributed large screen display is large, the effect of the echoed function of the user can be influenced, and even other functional experiences of the user on the terminal can be influenced. For example, software of the user terminal such as control software or the mobile terminal APP can support large-screen playback, but the playback effect and capability thereof depend on the capability of the PAD or mobile phone hardware as the terminal and the software processing capability, resulting in relatively low picture real-time and relatively poor picture quality.
In view of the above problems, no effective solution has been proposed.
Disclosure of Invention
The embodiment of the invention provides a video processing method, a video processing device, video processing equipment and a computer readable storage medium, which are used for at least solving the technical problem of poor effect of a playback function of a distributed display screen.
According to an aspect of an embodiment of the present invention, there is provided a video processing method, including: the method comprises the steps that a playback node receives multiple paths of video data from a plurality of video decoding nodes respectively, wherein the playback node and the video decoding nodes are connected with each other by adopting a distributed architecture, and the video decoding nodes are used for processing the multiple paths of video data and sending multiple paths of video signals obtained after processing to a display screen; splicing the multi-channel video data by the echo node to obtain spliced video data; and the echo node outputs the spliced video data.
Optionally, the receiving, by the playback node, target video data in multiple paths of video data, where the target video data is any path of video data in the multiple paths of video data, includes: determining a video decoding node corresponding to the target video data, wherein the video decoding node is a node included in the plurality of video decoding nodes; and receiving the decoded target video data, wherein the decoded target video data is obtained by decoding the target video data through the video decoding node.
Optionally, in a case that the echo node includes a plurality of echo nodes, the echo node receives the decoded target video data, and includes: determining the corresponding relation between a plurality of echoing nodes and a plurality of video decoding nodes, wherein each echoing node corresponds to the plurality of video decoding nodes; and according to the corresponding relation, each echoing node respectively receives target video data obtained after the video decoding node corresponding to the echoing node decodes.
Optionally, the splicing the multiple paths of video data by the echo node to obtain spliced video data includes: image data of one frame of image is taken from the multi-channel video data respectively to obtain image data of multiple frames of images; judging whether the multiple frames of images are synchronous or not according to the image data of the multiple frames of images; under the condition that the multiple frames of images are synchronous, splicing the image data of the multiple frames of images into one frame of spliced image data; and sequentially connecting a plurality of frames of the spliced image data to obtain the spliced video data.
Optionally, the determining, according to the image data of the multiple frames of images, whether the multiple frames of images are synchronized includes: reading a frame header structure of image data of each frame of image in the multi-frame image to obtain a synchronous timestamp of each frame of image; and determining whether the multi-frame images are synchronous or not according to the synchronous time stamp.
Optionally, outputting the stitched video data comprises: rendering the stitched video data using AB double buffering, wherein the echo node comprises the AB double buffering; and outputting the rendered spliced video data.
Optionally, outputting the stitched video data comprises at least one of: outputting the spliced video data by adopting a local data interface; and/or outputting the spliced video data by adopting an RTSP streaming media protocol.
According to another aspect of the embodiments of the present invention, there is also provided a video processing method, including: the method comprises the steps that a video decoding node decodes target video data to obtain the decoded target video data, wherein the target video data is any one path of video data in multi-path video data, the multi-path video data are respectively from a plurality of video decoding nodes, the video decoding nodes and a playback node are mutually connected by adopting a distributed architecture, and the video decoding nodes are used for processing the multi-path video data and sending multi-path video signals obtained after processing to a display screen; and the video decoding nodes send the decoded target video data to the playback nodes, wherein the playback nodes are used for splicing the target video data sent by the video decoding nodes to obtain spliced video data.
According to another aspect of the embodiments of the present invention, there is also provided a video processing apparatus including: the receiving module is used for receiving multiple paths of video data from a plurality of video decoding nodes by a playback node, wherein the playback node and the video decoding nodes are mutually connected by adopting a distributed architecture, and the video decoding nodes are used for processing the multiple paths of video data and sending multiple paths of video signals obtained after processing to a display screen; the splicing module is used for splicing the multi-channel video data by the echo node to obtain spliced video data; and the output module is used for outputting the spliced video data.
According to still another aspect of the embodiments of the present invention, there is also provided a video processing apparatus including: the decoding module is used for decoding target video data by video decoding nodes to obtain the decoded target video data, wherein the target video data is any one-path video data in multi-path video data, the multi-path video data are respectively from a plurality of video decoding nodes, the plurality of video decoding nodes and the playback nodes are mutually connected by adopting a distributed architecture, and the plurality of video decoding nodes are used for processing the multi-path video data and sending the processed multi-path video signals to a display screen; and the sending module is used for sending the decoded target video data to the playback node by the video decoding node, wherein the playback node is used for splicing a plurality of target video data sent by the plurality of video decoding nodes to obtain spliced video data.
According to still another aspect of the embodiments of the present invention, there is further provided a computer-readable storage medium, where the computer-readable storage medium includes a stored program, and when the program runs, the apparatus where the computer-readable storage medium is located is controlled to execute any one of the above video processing methods.
According to still another aspect of the embodiments of the present invention, there is also provided a video processing apparatus, configured to run a program, where the program runs any one of the video processing methods described above.
In the embodiment of the invention, the redisplay nodes are adopted to receive the multi-channel video data from the plurality of video decoding nodes respectively, the redisplay nodes and the plurality of video decoding nodes are connected with each other by adopting a distributed architecture, the redisplay nodes splice the multi-channel video data to obtain spliced video data, and then the redisplay nodes output the spliced video data, so that the aim of generating the redisplay video of the distributed display screen by adopting independent functional nodes is fulfilled, the technical effects of improving the quality and stability of the redisplay video of the distributed display screen are realized, and the technical problem of poor redisplay function effect of the distributed display screen is solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
fig. 1 is a flowchart illustrating a first video processing method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a distributed system including echo nodes provided in accordance with an alternative embodiment of the present invention;
FIG. 3 is a schematic flow chart of generating a playback video according to an alternative embodiment of the present invention;
fig. 4 is a flowchart illustrating a second video processing method according to an embodiment of the present invention;
fig. 5 is a block diagram of a first video processing device according to an embodiment of the present invention;
fig. 6 is a block diagram of a second video processing device according to an embodiment of the present invention.
Detailed Description
In order to make those skilled in the art better understand the technical solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in other sequences than those illustrated or described herein. Moreover, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
First, partial terms or terms appearing in the description of the embodiments of the present application are applied to the following explanations:
and the AB double-buffer technology is used for drawing a final picture by using two image buffers, so that the picture drawing effect is smoother, the phenomena of image flicker, tearing and the like during picture drawing are effectively reduced, and the visual split feeling of the drawing screen is eliminated.
RTSP, a real-time streaming protocol, defines how one-to-many applications efficiently communicate multimedia data over IP networks.
The distributed display screen adopts a distributed system to display images, a plurality of sub-screens are spliced into a large display screen, and a distributed architecture is adopted among the sub-screens.
Example 1
In accordance with an embodiment of the present invention, there is provided a video processing method embodiment, it is noted that the steps illustrated in the flowchart of the figure may be performed in a computer system such as a set of computer executable instructions, and that while a logical order is illustrated in the flowchart, in some cases the steps illustrated or described may be performed in an order different than here.
Fig. 1 is a schematic flowchart of a first video processing method according to an embodiment of the present invention, as shown in fig. 1, the method includes the following steps:
and S102, receiving multi-channel video data from a plurality of video decoding nodes by a playback node, wherein the playback node and the video decoding nodes are connected with each other by adopting a distributed architecture, and the video decoding nodes are used for processing the multi-channel video data and sending multi-channel video signals obtained after processing to a display screen. The echo nodes are specially arranged for processing problems related to the generation of echo videos, and can be in the same distributed network with nodes in a display screen adopting a distributed architecture, so that data interaction with each video decoding node of the display screen is facilitated. In addition, the multi-channel video data may be data received by the video decoding node from a video source encoding end, in order to present an image of a video source on a display screen, the video decoding node needs to decode the video data first to obtain a video signal, and then output the video signal to a corresponding device in the display screen, and the display screen performs image display according to the multi-channel video signal.
The display screen in the step can be a distributed display large screen and is formed by splicing a plurality of display sub-screens, and each display sub-screen corresponds to one node in a distributed architecture, namely a video decoding node. Generally speaking, the node is used for decoding to obtain a video signal, and then outputting the video signal to the display sub-screens, and the plurality of display sub-screens synchronously display images, so that the large display screen presents a complete and smooth display picture.
And step S104, splicing the multi-channel video data by the echo node to obtain spliced video data. In the step, after the redisplay nodes acquire the multi-channel video data from the multiple video decoding nodes, the redisplay nodes can be spliced into the complete redisplay images, and the spliced video data corresponding to the redisplay images is sent to the user subsequently, so that the purpose of providing smooth redisplay images for the user by adopting special nodes is realized, and the problems of unsmooth blocking and poor functional effect caused by the fact that the user adopts the own terminal to process the redisplay images are avoided.
And step S106, outputting the spliced video data by the echoing node.
Through the above steps, adopt the node that shows back, receive the multichannel video data who comes from a plurality of video decoding nodes respectively through the node that shows back, wherein show back node and a plurality of video decoding node adoption distributed architecture interconnect, show back node concatenation multichannel video data, obtain the concatenation video data, then show back the node output concatenation video data by showing back, the video purpose of showing back that adopts independent function node to generate distributed display screen has been reached, thereby the technical effect of the video quality of showing back and stability of improvement distributed display screen has been realized, and then the not good technical problem of the function effect of showing back of distributed display screen has been solved.
Because the distributed large display screen comprises a plurality of video decoding nodes, the echoing nodes can perform data interaction with the plurality of video decoding nodes simultaneously in the same mode, and the working mode of the echoing nodes is explained by taking the example that the echoing nodes interact with any one video decoding node to acquire any one path of video data.
As an optional embodiment, the echoing node may receive target video data in the multiple paths of video data, where the target video data is any path of video data in the multiple paths of video data. In order to receive the target video data, the echoing node may first determine a video decoding node corresponding to the target video data, where the corresponding video decoding node is a node included in the plurality of video decoding nodes; and then receiving the target video data decoded by the video decoding node, wherein the decoded target video data is obtained by decoding the target video data by the video decoding node. For the distributed large display screen, each video decoding node can receive target video data sent by the encoding end, the encoding end acquires a video signal from the signal source, encodes the video signal and sends the video signal to the decoding end for displaying the large screen, and transmission of the video signal is achieved. And the video decoding node at the decoding end decodes the target video data sent to the decoding end, and then the decoded data is respectively output to the display screen and the display back node and is respectively used for displaying the image on the display screen and generating the display back image by the display back node.
As an alternative embodiment, the echo node may comprise a plurality. In some scenes, the display screen can be a very huge display large screen, and at this time, the problem that the generation of a echoed image is processed by adopting one echoed node possibly has a worry also exists, so that a plurality of echoed nodes can be arranged to share the data processing pressure of a single echoed node. In the case that the playback node includes a plurality of playback nodes, the playback node receives the decoded target video data, and the following method may be adopted: determining the corresponding relation between a plurality of playback nodes and a plurality of video decoding nodes, wherein each playback node corresponds to the plurality of video decoding nodes; and according to the corresponding relation, each echo node respectively receives target video data obtained after the video decoding node corresponding to the echo node decodes the target video data. Through the optional embodiment, each echoing node can be responsible for displaying a plurality of video decoding nodes in a part of regions in the large screen, target video data decoded by the video decoding nodes responsible for the echoing nodes is processed into echoed images, and subsequently, a secondary echoing node can be adopted to integrate the echoed images into a complete echoed image for displaying the large screen.
As an alternative embodiment, the echoing node may obtain the stitched video data by stitching multiple paths of video data as follows: the method comprises the steps of obtaining image data of a frame of image from multi-channel video data respectively to obtain image data of multiple frames of images; judging whether the multi-frame images are synchronous or not according to the image data of the multi-frame images; under the condition of multi-frame image synchronization, splicing the image data of the multi-frame images into one frame of spliced image data; and sequentially connecting the multi-frame spliced image data to obtain spliced video data. When the multi-channel video data are spliced into the echo video image, the splicing can be carried out in a frame-by-frame splicing mode, and in order to obtain a spliced image of one frame, multi-frame images before splicing can be synchronously judged, so that the spliced echo video image can display a correct picture.
As an alternative embodiment, whether the multiple frames of images are synchronized may be determined as follows: reading a frame header structure of image data of each frame of image in a plurality of frames of images to obtain a synchronous time stamp of each frame of image; and determining whether the multi-frame images are synchronous according to the synchronous time stamp. Optionally, a synchronization timestamp may be written in a frame header structure of image data of each frame of image obtained by decoding at the video decoding node, so as to facilitate synchronous judgment of multiple frames of images and ensure correct picture display of the spliced video images.
As an alternative embodiment, when outputting the stitched video data, the stitched video data may be rendered using AB double buffering, wherein the echoing node includes AB double buffering; and then, outputting the rendered spliced video data by the echo node. Through the processing of the double-buffering technology, the spliced back-display video image can be prevented from the problems of image tearing and the like, and the image quality of the back-display video image is ensured.
As an alternative embodiment, the output of the spliced video data may be performed in at least one of the following manners: outputting spliced video data by adopting a local data interface; and/or outputting the spliced video data by adopting an RTSP streaming media protocol. When the spliced video data is output by adopting the all-data interface, an HDMI interface or a DP interface can be adopted. In the optional embodiment, the user can be supported to randomly select the mode of acquiring the echoed video data according to the type of the terminal equipment of the user.
Fig. 2 is a schematic diagram of a distributed system including echo nodes according to an alternative embodiment of the present invention, and as shown in fig. 2, a large display screen adopting a distributed architecture may be connected to large screen output nodes of multiple decoding ends, and the large display screen acquires video signals from each node to generate a video image displayed on the large screen, where the large screen output nodes are video decoding nodes in the present invention. The large-screen display-back node processes the multipath decoded video data into display-back video images, and then sends the display-back video images to local equipment through an HDMI/DP interface, or sends the display-back video images to user networking terminal equipment through the switch in the form of RTSP streaming media.
Fig. 3 is a schematic flowchart of generating a playback video according to an alternative embodiment of the present invention, and as shown in fig. 3, generating a playback video by using a playback node may include the following steps:
step (1), configuring large-screen redisplay nodes, wherein configuration parameters of the large-screen redisplay nodes are derived from parameters configured in advance by control software, and the parameters comprise: (1.1) topological structure information (IP, coordinates of each large screen output node, area position size and the like) of the large screen; (1.2) encoding and decoding parameters: encoding parameter information of each large screen output node: IP, resolution, frame rate, type of encoding (H264 or H265), etc.
Initializing a decoder and an encoder, dynamically initializing the encoder and a multi-channel decoder according to the result of the parameter calculation, initializing the number of grids spliced by software, and then drawing a video playback stream of a large-screen output node through multiple channels according to the number of grids; after decoding, the synchronous processing unit is informed.
And (3.1-3.2) synchronously splicing the echo images, firstly acquiring a plurality of paths of decoded video streams to perform synchronous algorithm processing, wherein the core of the synchronous algorithm is the synchronous time stamp of each path of decoding frame header, and judging whether the video frames of each path are synchronous or not.
And (3.3) performing video splicing processing when the judgment result is synchronous after comparison processing is performed by using the synchronous time stamp of each frame.
Step (3.4-3.5), synchronous calibration (strategy discarding and waiting) is carried out on asynchronous video frames, multi-channel video frames which are successfully calibrated are subjected to video splicing processing by software; and if the calibration is unsuccessful, discarding the multiple video frames corresponding to the frame, reacquiring the multiple adaptation streams, and performing resynchronization processing.
And (4) performing video splicing by adopting an AB video memory processing unit, rendering by utilizing the rendering capability of the GPU, and performing AB soft flushing processing on the video spliced result.
And (4.1-4.2) outputting the AB soft-buffering result to the mobile terminal equipment of the user, coding the playback video, and then outputting through the RTSP stream.
And (4.3) outputting the playback video by adopting a local HDMI interface or a DP interface.
Fig. 4 is a schematic flowchart of a second video processing method according to an embodiment of the present invention, as shown in fig. 4, the method includes the following steps:
step S402, decoding target video data by a video decoding node to obtain decoded target video data, wherein the target video data is any one path of video data in multi-path video data, the multi-path video data are respectively from a plurality of video decoding nodes, the plurality of video decoding nodes and a playback node are mutually connected by adopting a distributed architecture, and the plurality of video decoding nodes are used for processing the multi-path video data and sending the multi-path video signals obtained after processing to a display screen.
And S404, the video decoding node sends the decoded target video data to a playback node, wherein the playback node is used for splicing a plurality of target video data sent by a plurality of video decoding nodes to obtain spliced video data.
Through the steps, the purpose of generating the playback video of the distributed display screen by adopting the independent function node, namely the playback node, is achieved through the matching of the video decoding node and the playback node of the display screen adopting the distributed architecture, so that the technical effects of improving the quality and the stability of the playback video of the distributed display screen are achieved, and the technical problem of poor playback function effect of the distributed display screen is solved.
Example 2
According to an embodiment of the present invention, there is further provided a first video processing apparatus for implementing the first video processing method, and fig. 5 is a block diagram of a structure of the first video processing apparatus according to an embodiment of the present invention, as shown in fig. 5, the first video processing apparatus 50 includes: a receiving module 52, a stitching module 54 and an output module 56, which are described below with respect to the first video processing apparatus 50.
The receiving module 52 is configured to receive, by the playback node, multiple paths of video data from multiple video decoding nodes, where the playback node and the multiple video decoding nodes are connected to each other by using a distributed architecture, and the multiple video decoding nodes are configured to process the multiple paths of video data and send multiple paths of video signals obtained after processing to a display screen;
a splicing module 54 connected to the receiving module 52 and configured to splice multiple paths of video data at the playback node to obtain spliced video data;
and an output module 56, connected to the splicing module 54, for outputting the spliced video data.
It should be noted here that the receiving module 52, the splicing module 54 and the output module 56 correspond to steps S102 to S106 in embodiment 1, and the three modules are the same as the corresponding steps in the implementation example and application scenario, but are not limited to the disclosure in embodiment 1.
Example 3
According to an embodiment of the present invention, a second video processing apparatus for implementing the second video processing method is further provided, and fig. 6 is a block diagram of a structure of the second video processing apparatus according to an embodiment of the present invention, as shown in fig. 6, the second video processing apparatus 60 includes: a decoding module 62 and a sending module 64, which will be described below with respect to the second video processing apparatus 60.
The decoding module 62 is configured to decode, by a video decoding node, target video data to obtain decoded target video data, where the target video data is any one of multiple paths of video data, the multiple paths of video data are respectively from multiple video decoding nodes, the multiple video decoding nodes and the playback node are connected to each other by using a distributed architecture, and the multiple video decoding nodes are configured to process the multiple paths of video data and send multiple paths of video signals obtained after processing to a display screen;
and a sending module 64, connected to the decoding module 62, configured to send, by the video decoding node, the decoded target video data to the playback node, where the playback node is configured to splice multiple target video data sent by multiple video decoding nodes to obtain spliced video data.
It should be noted here that the decoding module 62 and the sending module 64 correspond to steps S402 to S404 in embodiment 1, and the two modules are the same as the corresponding steps in the implementation example and the application scenario, but are not limited to the disclosure in embodiment 1.
Example 4
An embodiment of the present invention may provide a computer device, and optionally, in this embodiment, the computer device may be located in at least one network device of a plurality of network devices of a computer network. The computer device includes a memory and a video processing device.
The memory can be used for storing software programs and modules, such as program instructions/modules corresponding to the video processing method and apparatus in the embodiments of the present invention, and the video processing device executes various functional applications and data processing by running the software programs and modules stored in the memory, that is, implements the video processing method described above. The memory may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory may further include memory located remotely from the video processing device, and these remote memories may be connected to the computer terminal over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The video processing device can call the information stored in the memory and the application program through the transmission device to execute the following steps: the method comprises the steps that a playback node receives multi-channel video data from a plurality of video decoding nodes respectively, wherein the playback node and the video decoding nodes are connected with each other by adopting a distributed architecture, and the video decoding nodes are used for processing the multi-channel video data and sending multi-channel video signals obtained after processing to a display screen; splicing the multi-channel video data by the echo node to obtain spliced video data; and outputting the spliced video data by the echoing node.
Optionally, the video processing apparatus may further include program code for performing the following steps: the echoing node receives target video data in the multi-path video data, wherein the target video data is any one path of video data in the multi-path video data, and the echoing node comprises: determining a video decoding node corresponding to the target video data, wherein the video decoding node is a node included by a plurality of video decoding nodes; and receiving the decoded target video data, wherein the decoded target video data is obtained by decoding the target video data through a video decoding node.
Optionally, the video processing apparatus may further include program code for performing the following steps: in the case that the playback node includes a plurality of playback nodes, the playback node receives the decoded target video data, and includes: determining the corresponding relation between a plurality of playback nodes and a plurality of video decoding nodes, wherein each playback node corresponds to the plurality of video decoding nodes; and according to the corresponding relation, each playback node respectively receives target video data obtained after the video decoding node corresponding to the playback node decodes the target video data.
Optionally, the video processing apparatus may further include program code for performing the following steps: the method for splicing the multi-channel video data by the echo node to obtain spliced video data comprises the following steps: the method comprises the steps of obtaining image data of a frame of image from multi-channel video data respectively to obtain image data of multiple frames of images; judging whether the multi-frame images are synchronous or not according to the image data of the multi-frame images; under the condition that multiple frames of images are synchronous, image data of the multiple frames of images are spliced into spliced image data of one frame; and sequentially connecting the multi-frame spliced image data to obtain spliced video data.
Optionally, the video processing apparatus may further execute program codes of the following steps: judging whether the multi-frame images are synchronous according to the image data of the multi-frame images, comprising the following steps: reading a frame header structure of image data of each frame of image in a plurality of frames of images to obtain a synchronous time stamp of each frame of image; and determining whether the multi-frame images are synchronous according to the synchronous time stamps.
Optionally, the video processing apparatus may further include program code for performing the following steps: outputting stitched video data, comprising: rendering the stitched video data using AB double buffering, wherein the echo node comprises AB double buffering; and outputting the rendered spliced video data.
Optionally, the video processing apparatus may further execute program codes of the following steps: outputting stitched video data comprising at least one of: outputting spliced video data by adopting a local data interface; and/or outputting the spliced video data by adopting an RTSP streaming media protocol.
Optionally, the video processing apparatus may further execute program codes of the following steps: the video decoding nodes decode target video data to obtain decoded target video data, wherein the target video data are any one path of video data in multi-path video data, the multi-path video data are respectively from a plurality of video decoding nodes, the video decoding nodes and the playback nodes are mutually connected by adopting a distributed architecture, and the video decoding nodes are used for processing the multi-path video data and sending multi-path video signals obtained after processing to a display screen; and the video decoding node sends the decoded target video data to the playback node, wherein the playback node is used for splicing the plurality of target video data sent by the plurality of video decoding nodes to obtain spliced video data.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by a program instructing hardware associated with the terminal device, where the program may be stored in a computer-readable storage medium, and the storage medium may include: flash disks, read-Only memories (ROMs), random Access Memories (RAMs), magnetic or optical disks, and the like.
Example 5
Embodiments of the present invention also provide a computer-readable storage medium. Alternatively, in this embodiment, the computer-readable storage medium may be used to store the program code executed by the video processing method provided in embodiment 1.
Optionally, in this embodiment, the computer-readable storage medium may be located in any one of a group of computer terminals in a computer network, or in any one of a group of mobile terminals.
Optionally, in this embodiment, a computer-readable storage medium is configured to store program code for performing the steps of: the method comprises the steps that a playback node receives multi-channel video data from a plurality of video decoding nodes respectively, wherein the playback node and the video decoding nodes are connected with each other by adopting a distributed architecture, and the video decoding nodes are used for processing the multi-channel video data and sending multi-channel video signals obtained after processing to a display screen; splicing the multi-channel video data by the echo node to obtain spliced video data; and outputting the spliced video data by the echoing node.
Optionally, in this embodiment, the computer readable storage medium is configured to store program code for performing the following steps: the echoing node receives target video data in the multi-channel video data, wherein the target video data is any one of the multi-channel video data, and the method comprises the following steps: determining a video decoding node corresponding to the target video data, wherein the video decoding node is a node included by a plurality of video decoding nodes; and receiving the decoded target video data, wherein the decoded target video data is obtained by decoding the target video data through a video decoding node.
Optionally, in this embodiment, a computer-readable storage medium is configured to store program code for performing the steps of: in the case that the echo node includes a plurality of echo nodes, the echo node receives the decoded target video data, and includes: determining the corresponding relation between a plurality of playback nodes and a plurality of video decoding nodes, wherein each playback node corresponds to the plurality of video decoding nodes; and according to the corresponding relation, each echo node respectively receives target video data obtained after the video decoding node corresponding to the echo node decodes the target video data.
Optionally, in this embodiment, the computer readable storage medium is configured to store program code for performing the following steps: the method for splicing the multi-channel video data by the echo node to obtain spliced video data comprises the following steps: the method comprises the steps of obtaining image data of a frame of image from multi-channel video data to obtain image data of multiple frames of images; judging whether the multi-frame images are synchronous or not according to the image data of the multi-frame images; under the condition of multi-frame image synchronization, splicing the image data of the multi-frame images into one frame of spliced image data; and sequentially connecting the multi-frame spliced image data to obtain spliced video data.
Optionally, in this embodiment, a computer-readable storage medium is configured to store program code for performing the steps of: judging whether the multi-frame images are synchronous according to the image data of the multi-frame images, comprising the following steps: reading a frame header structure of image data of each frame of image in a plurality of frames of images to obtain a synchronous time stamp of each frame of image; and determining whether the multi-frame images are synchronous according to the synchronous time stamp.
Optionally, in this embodiment, the computer readable storage medium is configured to store program code for performing the following steps: outputting stitched video data comprising: rendering the stitched video data using AB double buffering, wherein the echo node comprises AB double buffering; and outputting the rendered spliced video data.
Optionally, in this embodiment, a computer-readable storage medium is configured to store program code for performing the steps of: outputting stitched video data comprising at least one of: outputting spliced video data by adopting a local data interface; and/or outputting the spliced video data by adopting an RTSP streaming media protocol.
Optionally, in this embodiment, the computer readable storage medium is configured to store program code for performing the following steps: the video decoding nodes decode target video data to obtain decoded target video data, wherein the target video data is any one-path video data in multi-path video data, the multi-path video data are respectively from the multiple video decoding nodes, the multiple video decoding nodes and the playback nodes are mutually connected by adopting a distributed architecture, and the multiple video decoding nodes are used for processing the multi-path video data and sending the processed multi-path video signals to a display screen; and the video decoding node sends the decoded target video data to the playback node, wherein the playback node is used for splicing the plurality of target video data sent by the plurality of video decoding nodes to obtain spliced video data.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
In the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed technical content can be implemented in other manners. The above-described apparatus embodiments are merely illustrative, and for example, a division of a unit may be a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or may be integrated into another system, or some features may be omitted, or may not be executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may also be implemented in the form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk, and various media capable of storing program codes.
The above is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, a plurality of modifications and embellishments can be made without departing from the principle of the present invention, and these modifications and embellishments should also be regarded as the protection scope of the present invention.
Claims (12)
1. A video processing method, comprising:
the method comprises the following steps that a playback node receives multiple paths of video data from a plurality of video decoding nodes, wherein the playback node and the video decoding nodes are connected with each other by adopting a distributed architecture, and the video decoding nodes are used for processing the multiple paths of video data and sending multiple paths of video signals obtained after processing to a display screen;
splicing the multi-channel video data by the echo node to obtain spliced video data;
and the echo node outputs the spliced video data.
2. The method of claim 1, wherein the echo node receives target video data in multiple paths of video data, wherein the target video data is any path of video data in the multiple paths of video data, and the method comprises:
determining a video decoding node corresponding to the target video data, wherein the video decoding node is a node included in the plurality of video decoding nodes;
and receiving the decoded target video data, wherein the decoded target video data is obtained by decoding the target video data through the video decoding node.
3. The method according to claim 2, wherein in the case that the echo node includes a plurality of nodes, the echo node receives the decoded target video data, and includes:
determining the corresponding relation between a plurality of echoing nodes and a plurality of video decoding nodes, wherein each echoing node corresponds to the plurality of video decoding nodes;
and according to the corresponding relation, each echoing node respectively receives target video data obtained after the video decoding node corresponding to the echoing node decodes.
4. The method of claim 1, wherein the splicing the multiple paths of video data by the echo node to obtain spliced video data comprises:
obtaining image data of a frame of image from the multi-path video data respectively to obtain image data of multiple frames of images;
judging whether the multiple frames of images are synchronous or not according to the image data of the multiple frames of images;
under the condition that the multiple frames of images are synchronous, splicing the image data of the multiple frames of images into one frame of spliced image data;
and sequentially connecting the multiple frames of the spliced image data to obtain the spliced video data.
5. The method according to claim 4, wherein determining whether the plurality of frames of images are synchronized according to the image data of the plurality of frames of images comprises:
reading a frame header structure of image data of each frame of image in the multi-frame image to obtain a synchronous timestamp of each frame of image;
and determining whether the multi-frame images are synchronous or not according to the synchronous time stamp.
6. The method of claim 4, wherein outputting the stitched video data comprises:
rendering the stitched video data using AB double buffering, wherein the echo node comprises the AB double buffering;
and outputting the rendered spliced video data.
7. The method of claim 1, wherein outputting the stitched video data comprises at least one of:
outputting the spliced video data by adopting a local data interface;
and/or the presence of a gas in the gas,
and outputting the spliced video data by adopting an RTSP streaming media protocol.
8. A video processing method, comprising:
the method comprises the steps that a video decoding node decodes target video data to obtain the decoded target video data, wherein the target video data is any one path of video data in multiple paths of video data, the multiple paths of video data are respectively from multiple video decoding nodes, the multiple video decoding nodes and a playback node are mutually connected by adopting a distributed architecture, and the multiple video decoding nodes are used for processing the multiple paths of video data and sending multiple paths of video signals obtained after processing to a display screen;
and the video decoding nodes send the decoded target video data to the playback nodes, wherein the playback nodes are used for splicing the target video data sent by the video decoding nodes to obtain spliced video data.
9. A video processing apparatus, comprising:
the receiving module is used for receiving multiple paths of video data from a plurality of video decoding nodes by a playback node, wherein the playback node and the video decoding nodes are mutually connected by adopting a distributed architecture, and the video decoding nodes are used for processing the multiple paths of video data and sending multiple paths of video signals obtained after processing to a display screen;
the splicing module is used for splicing the multi-channel video data by the echo node to obtain spliced video data;
and the output module is used for outputting the spliced video data.
10. A video processing apparatus, comprising:
the decoding module is used for decoding target video data by video decoding nodes to obtain the decoded target video data, wherein the target video data is any one path of video data in multi-path video data, the multi-path video data are respectively from a plurality of video decoding nodes, the video decoding nodes and the playback nodes are mutually connected by adopting a distributed architecture, and the video decoding nodes are used for processing the multi-path video data and sending multi-path video signals obtained after processing to a display screen;
and the sending module is used for sending the decoded target video data to the playback node by the video decoding node, wherein the playback node is used for splicing the plurality of target video data sent by the plurality of video decoding nodes to obtain spliced video data.
11. A computer-readable storage medium, comprising a stored program, wherein the program, when executed, controls an apparatus in which the computer-readable storage medium is located to perform the video processing method according to any one of claims 1 to 8.
12. A video processing apparatus, characterized in that the video processing apparatus is configured to run a program, wherein the program is configured to execute the video processing method according to any one of claims 1 to 8 when running.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110951453.2A CN115708356A (en) | 2021-08-18 | 2021-08-18 | Video processing method, device, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110951453.2A CN115708356A (en) | 2021-08-18 | 2021-08-18 | Video processing method, device, equipment and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115708356A true CN115708356A (en) | 2023-02-21 |
Family
ID=85212542
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110951453.2A Pending CN115708356A (en) | 2021-08-18 | 2021-08-18 | Video processing method, device, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115708356A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117082191A (en) * | 2023-10-13 | 2023-11-17 | 广东保伦电子股份有限公司 | Extended multi-channel video source back display system and multi-channel video back display method |
| CN117499564A (en) * | 2023-11-21 | 2024-02-02 | 北京视睿讯科技有限公司 | Video back display method, system, terminal and storage medium |
-
2021
- 2021-08-18 CN CN202110951453.2A patent/CN115708356A/en active Pending
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117082191A (en) * | 2023-10-13 | 2023-11-17 | 广东保伦电子股份有限公司 | Extended multi-channel video source back display system and multi-channel video back display method |
| CN117082191B (en) * | 2023-10-13 | 2024-03-08 | 广东保伦电子股份有限公司 | Extended multi-channel video source back display system and multi-channel video back display method |
| CN117499564A (en) * | 2023-11-21 | 2024-02-02 | 北京视睿讯科技有限公司 | Video back display method, system, terminal and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109327728B (en) | One-to-many same-screen method, device and system, same-screen equipment and storage medium | |
| CN105744342B (en) | The data transmission method and device of mobile terminal | |
| CN103650515B (en) | wireless 3D streaming server | |
| KR101955202B1 (en) | Device for multipoing video conference and method for displaying multi-party image using the device | |
| KR101234495B1 (en) | Terminal, node device and method for processing stream in video conference system | |
| JP4206407B2 (en) | Multimedia signal matching system and method for performing picture-in-picture functions | |
| KR101229370B1 (en) | Video data receiving and sending systems for videophone and video data processing method thereof | |
| JP2008500752A (en) | Adaptive decoding of video data | |
| CN115708356A (en) | Video processing method, device, equipment and computer readable storage medium | |
| KR100606785B1 (en) | Synchronization method of video and iamge data in system for providing remote multimedia service through network | |
| JP5524193B2 (en) | Media stream processing | |
| US20060008012A1 (en) | Video coding apparatus and video decoding apparatus | |
| CN110996122B (en) | Video frame transmission method, device, computer equipment and storage medium | |
| CN103856809A (en) | Method, system and terminal equipment for multipoint at the same screen | |
| CN112954433A (en) | Video processing method and device, electronic equipment and storage medium | |
| CN114979755A (en) | Screen projection method and device, terminal equipment and computer readable storage medium | |
| CN109729379B (en) | Method, device, terminal and storage medium for realizing live video microphone connection | |
| CN113141352B (en) | Multimedia data transmission method and device, computer equipment and storage medium | |
| JP2001054140A (en) | Stereo video band compression coding method, decoding method and recording medium | |
| EP3920537A1 (en) | Video decoding method and apparatus, video encoding method and apparatus, storage medium and electronic device | |
| WO2011134373A1 (en) | Method, device and system for synchronous transmmision of multi-channel videos | |
| CN102082945A (en) | Method for realizing multi-party video calls, video terminal and system | |
| CN110740286A (en) | video conference control method, multipoint control unit and video conference terminal | |
| CN110248047B (en) | Synchronous switching method and system of video matrix | |
| US11356683B2 (en) | Creating different video stream representations |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |