WO2021127964A1

WO2021127964A1 - Whole-wall echo display method and device for distributed combination system, and computer apparatus

Info

Publication number: WO2021127964A1
Application number: PCT/CN2019/127789
Authority: WO
Inventors: 董友球
Original assignee: 威创集团股份有限公司
Priority date: 2019-12-24
Filing date: 2019-12-24
Publication date: 2021-07-01
Also published as: CN111108470A; CN111108470B

Abstract

A whole-wall echo display method and device for a distributed combination system, and a computer apparatus. The method comprises: acquiring node layout information of a tiled wall, wherein the node layout information indicates node positions at which multiple screens to be tiled together are connected to each other to form an output image (S1); acquiring an echo display code stream of each node on the tiled wall (S2); decoding the echo display code streams to acquire node code streams (S3); acquiring a display region, selecting, on the basis of the node layout information and the display region, node code streams corresponding to the display region, and combining and cropping the selected node code streams to acquire an echo display image (S4); and outputting the echo display image (S5). An image displayed by using the whole-wall echo display method for a distributed combination system is consistent with that displayed in the display region of the tiled wall. The effect of echo display of the tiled wall does not deteriorate as the number of screens to be tiled together increases. The invention achieves high-definition echo display and partial high-definition echo display of the tiled wall. The invention solves the problem in which an image displayed by an existing tiled wall cannot be completely displayed, such that an error is present during image display, and quality of the displayed image is poor.

Description

Distributed splicing system whole wall echo display method, device and computer equipment

Technical field

The invention relates to the technical field of splicing wall echo display, in particular to a distributed splicing system whole wall echo display method, device and computer equipment.

Background technique

With the development of science and the rapid growth of social informatization, the demand for information visualization has expanded rapidly, and the realization of high-end visualization has become more and more difficult. The amount of information displayed by a traditional single display device is far from meeting the needs of customers, especially For some monitoring centers, command centers, dispatch centers and other places. Therefore, the wall-to-wall system has become an indispensable foundation in the field of visualization.

The existing wall-joining system uses a distributed splicing system, and the distributed splicing system consists of a series of nodes, which is suitable for high concurrency and easy expansion, and is widely used in visualization products. The function of the whole wall echo display is to synchronize the current picture on the splicing wall to other operating terminals or monitors on the display terminal, so that the contents of the picture on the splicing wall can be seen intuitively during operation.

Since the resolution of the splicing wall is very high, if the whole wall also displays such a high resolution when the whole wall is echoed, there is no way for general display devices to support it.

At present, the general practice in the visualization industry is to take the low-resolution sub-stream according to the display signal on the splicing wall, and then reduce a certain proportion to display according to the superimposed arrangement order on the large wall. This splicing wall method can reduce the pressure on the display end of the whole wall echo, but because the sub-stream is taken, the display effect will be greatly reduced. If the number of signals is large or the signal does not support the sub-stream, it will still cause the display end The decoding pressure is too large and affects the display quality of the display device. And because the splicing wall method is to obtain the sub-streams from the signal source and display them in the order of the splicing wall, it is not essentially the echo of the splicing wall, so once the splicing wall fails, the entire wall will echo the displayed picture The content is prone to inconsistencies.

Therefore, in view of the above situation, how to make all the displayed pictures displayed on the splicing wall without being affected by the number of windows on the splicing wall has become an important technical problem to be solved urgently by those skilled in the art.

Summary of the invention

The embodiment of the present invention provides a distributed splicing system whole-wall echo display method, device and computer equipment, which are used to solve the problem that the existing splicing wall display screens cannot be fully displayed, resulting in display screen errors and poor display screen quality. technical problem.

In order to achieve the foregoing objectives, the embodiments of the present invention provide the following technical solutions:

A distributed splicing system whole wall echo display method, including the following steps:

S1. Obtain the node layout information of the splicing wall; wherein the node layout information is the position of the node where a plurality of splicing screens are connected to form an output screen;

S2. Obtain the echo code stream of each node on the splicing wall;

S3. Decode the echo code stream to obtain a node code stream;

S4. Obtain a display area, select the node code stream corresponding to the display area based on the node layout information and the display area, and splice and crop the selected node code stream to obtain an echo picture;

S5. Output the display screen.

Preferably, the step of generating the echo code stream of each node includes:

S21. Time synchronization between each of the nodes and the time synchronization server;

S22. Calculate the frame fetching time of the node according to the current system time of the splicing wall;

S23. Grab the display screen of the node at the current system time;

S24. Encode the display picture to obtain the echo code stream.

Preferably, in the process of generating the echo code stream of the display screen, the time for all the nodes to fetch frames for the first time is aligned to an integer number of seconds, and then the nodes are fetched every corresponding time. , Grab the display screen of the node according to the time when the frame is fetched. Wherein, the corresponding time is 1000/echo frame rate, and the echo frame rate is based on the setting required by the mobile terminal.

Preferably, at the same frame capture time, all the nodes on the splicing wall perform the capture of the display screen.

Preferably, the step of selecting the node code stream at the same frame fetching time, and splicing and cropping the selected node code stream includes:

S41. Obtain a picture display area on the splicing wall based on the display area, and obtain each splicing display area and each splicing picture display of the splicing area based on the splicing area of the splicing wall and the picture display area area;

S42. Perform zooming processing on each of the spliced display areas to obtain the same zoomed picture corresponding to the size of the spliced picture display area;

S43. Transmit the zoomed picture to the corresponding splicing area to obtain the echoed picture after splicing.

The present invention also provides a whole wall echo display device of the distributed splicing system, which includes:

A node information obtaining unit for obtaining node layout information of the splicing wall; wherein the node layout information is the position of a node where a plurality of splicing screens are connected to form an output screen;

Obtaining the echo code stream unit, used to obtain the echo code stream of each node on the splicing wall;

A decoding unit, configured to decode the echo code stream to obtain a node code stream;

The display unit is configured to obtain a display area, select the node code stream corresponding to the display area according to the node layout information and the display area, and splice and crop the selected node code stream to obtain an echo Picture

The control unit is used to output the display screen.

Preferably, the acquiring echo code stream unit includes a node time synchronization subunit, a calculation subunit, a collection subunit and an encoding subunit;

The node time synchronization subunit is used to synchronize the time of each of the nodes with a time synchronization server;

The calculation subunit is configured to calculate the frame fetching time of the node according to the current system time of the splicing wall;

The collection subunit is used to capture the display screen of the node at the current system time;

The encoding subunit is used to encode the display picture to obtain the echo code stream.

Preferably, in the acquiring echo code stream unit, the time for all the nodes to fetch frames for the first time is aligned to an integer number of seconds, and then the nodes are fetched at corresponding intervals according to the frame fetching. Capture the display screen of the node at the moment. Wherein, the corresponding time is 1000/echo frame rate, and the echo frame rate is based on the setting required by the mobile terminal.

Preferably, the display unit splices and cuts the node code stream at the same frame-fetching time, and the display unit includes a region dividing subunit, a zooming subunit, and a splicing subunit; the display unit includes Area division sub-unit, zoom sub-unit and splicing sub-unit;

The area dividing subunit is configured to obtain a picture display area on the splicing wall based on the display area, and obtain each splicing display of the splicing area based on the splicing area of the splicing wall and the picture display area Area and display area of each splicing screen;

The zoom subunit is configured to perform zoom processing on each of the spliced display areas to obtain the same zoomed picture corresponding to the size of the spliced picture display area;

The splicing subunit is configured to splice pictures of the same frame fetching time together according to the node layout information according to the zoomed picture to obtain the spliced echo picture.

The present invention also provides a computer device, including a processor and a memory;

The memory is used to store program code and transmit the program code to the processor;

The processor is configured to execute the above-mentioned distributed splicing system whole wall echo method according to the instructions in the program code.

It can be seen from the above technical solutions that the embodiments of the present invention have the following advantages:

1. The entire wall echo method of the distributed splicing system obtains the node layout information of the splicing wall; among them, the node layout information is the position of the node where multiple splicing screens are connected to form the output screen; the echo code of each node on the splicing wall is obtained Stream; decode the echo code stream to obtain the node code stream; obtain the display area, based on the node layout information and display area, select the node code stream corresponding to the display area, and splice and crop the selected node code stream to get the echo Screen; output echo screen. The display screen of this distributed splicing system whole wall echo method is consistent with the display area of the splicing wall; the effect of splicing wall echo will not deteriorate due to the increase in the number of splicing screens of the splicing wall; it can realize the high-definition echo of the splicing wall And partial high-definition echo. It solves the technical problem that all the pictures displayed on the existing splicing wall cannot be displayed, which causes the display picture to be wrong and causes the displayed picture quality to be poor;

2. The entire wall echo device of the distributed splicing system obtains the node layout information of the splicing wall through the node information obtaining unit, and uses the echo code stream obtaining unit to obtain the echo code stream of each node; the decoding unit responds to each node The display code stream is decoded to obtain the node code stream; the display unit splices and cuts the node code stream according to the display area and node layout information to obtain the spliced and cut echo picture. The display screen of the whole-wall echo display device of the distributed splicing system is consistent with the display area of the splicing wall; the effect of splicing wall echo will not deteriorate due to the increase in the number of splicing screens of the splicing wall; it can realize the high-definition echo of the splicing wall And partial high-definition echo. It solves the technical problem that all the pictures displayed on the existing splicing wall cannot be displayed, which causes the display picture to be wrong and causes the displayed picture quality to be poor.

Description of the drawings

In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative labor.

FIG. 1 is a flow chart of the steps of the whole wall echo display method of a distributed splicing system according to an embodiment of the present invention;

2 is a schematic diagram of the splicing wall structure of the entire wall echo method of the distributed splicing system according to an embodiment of the present invention;

FIG. 3 is a flowchart of steps of generating an echo code stream in the whole wall echo method of a distributed splicing system according to an embodiment of the present invention;

FIG. 4 is a flowchart of steps for obtaining an echoed picture by the whole wall echoing method of a distributed splicing system according to an embodiment of the present invention;

Fig. 5 is a frame diagram of the whole wall echo display device of a distributed splicing system according to an embodiment of the present invention.

Detailed ways

In order to make the objectives, features, and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the following The described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

The embodiment of the present invention provides a method, device and computer equipment for the whole wall echo display of a distributed splicing system. At each splicing node of the distributed splicing processor of the distributed splicing system, while completing the splicing display, it displays the current The display screen is encoded again and converted to IP video for output. You can also use the echo server to decode and splice the echo images of each splicing node and directly output them to the display device, or it can be encoded as an IP video and output through the network to solve the existence of the existing splicing wall display screen. Cannot display all of them, causing errors in the display screen, leading to technical problems with poor display quality.

Example one:

FIG. 1 is a flow chart of the steps of a distributed splicing system whole wall echoing method according to an embodiment of the present invention, and FIG. 2 is a schematic diagram of a splicing wall structure of the distributed splicing system whole wall echoing method according to an embodiment of the present invention. In this embodiment, the splicing wall composed of a total of 18 splicing screens in 3 rows and 6 columns is taken as an example for description.

As shown in Fig. 1 and Fig. 2, an embodiment of the present invention provides a whole wall echo display method of a distributed splicing system, which includes the following steps:

S2. Obtain the echo code stream of each node on the splicing wall;

S3. Decode the echo code stream to obtain a node code stream;

S5. Output the display screen.

In the step S1 of the embodiment of the present invention, the splicing wall is composed of several splicing screens, each of the splicing screens corresponds to a node, the echo server is connected to the splicing wall, and the echo server Acquire the node corresponding to each splicing screen on the splicing wall, and the position layout of each node constitutes the node layout information.

It should be noted that in this embodiment, the splicing wall is composed of a total of 18 splicing screens in 3 rows and 6 columns, that is, 18 nodes are obtained corresponding to the 18 splicing screens, and the output of the 18 nodes is In the display screen, the screen area that each node is responsible for is different.

In the step S2 of the embodiment of the present invention, the echo server and the splicing wall can be connected by a wire harness, and the echo server and the splicing wall can also communicate via wireless (wifi, Internet, Bluetooth, etc.). Protocol) connection, the echo server obtains the echo code stream of each node.

It should be noted that, in this embodiment, the echo code streams corresponding to the 18 nodes are acquired on the echo server, that is, there are 18 echo code streams.

In the step S3 of the embodiment of the present invention, according to the echo code stream obtained in the step S2, the echo server decodes the echo code stream to obtain the echo code stream corresponding to the echo code stream. The node code stream.

It should be noted that the 18 echo code streams can be decoded one by one to obtain the 18 node code streams corresponding to the 18 nodes; it can also be calculated according to the display area, if the echo code If the stream is not in the current display area, the echo code stream may not be decoded to save system resources.

In the step S4 of the embodiment of the present invention, the echo server obtains the display area, and the display area refers to the area where the echo screen is displayed on the splicing wall. The node layout information and the display area, the echo server selects the node code stream to obtain all the node code streams corresponding to the display area, and the echo server treats all the nodes The code stream is spliced and cut to obtain the echoed picture. Wherein, the display area is to select a desired screen area on the splicing wall through the mobile terminal, and the display area refers to the screen area of the splicing wall selected during echo output, which may be the entire splicing wall. The area of the wall may also be a sub-area of the splicing wall. That is, the display area to be displayed on the splicing wall selected by the mobile terminal may be the entire area of the splicing wall, or it may be a sub-area of the splicing wall.

It should be noted that, as shown in FIG. 2, in this embodiment, the area labeled A is the area that currently needs to be echoed. It can be seen from FIG. 2 that the display area A involves 2, 3, 4, 8, There are a total of nine

nodes

9, 10, 14, 15, 16, and the node code streams of these nine nodes need to be decoded. After decoding, they are spliced according to the layout of the display area A. After splicing, they are cut into The picture that matches the display area A is used as the echo picture of the entire wall. The display area A is displayed as a partial high-definition echo display on the splicing wall, and the full-wall high-definition echo display can be considered as a situation where the display area A covers the entire splicing wall. Wherein, the display area A is arbitrarily zoomed and moved within the range of the splicing wall. The splicing and cutting of the node code stream is based on the node code stream obtained at the same time, so as to ensure the quality of the echoed picture after splicing and cutting. The node layout information may be the order of the positions of the nine nodes in the display area A in 2, 3, 4, 8, 9, 10, 14, 15, and 16, such as the order of the rows of

nodes

2, 3, 4 ,

Nodes

2, 8, and 14 form a column sort.

In the step S5 of the embodiment of the present invention, the echo server transmits the spliced and cropped echo screen to the mobile terminal or display device, on the display screen of the mobile terminal or on the display device. The display device displays the echoed picture, and the echo server may also encode the echoed picture into a channel of IP video and output it through the network.

It should be noted that both the mobile terminal and the display device may be devices that can display images such as computers, iPads, and mobile phones.

The whole wall echo display method of a distributed splicing system provided by the present invention obtains the node layout information of the splicing wall; wherein the node layout information is the position of the node where a plurality of splicing screens are connected to form an output screen; and the information of each node on the splicing wall is obtained Echo code stream; decode the echo code stream to obtain the node code stream; obtain the display area, based on the node layout information and display area, select the node code stream corresponding to the display area, and splice and cut the selected node code stream Obtain the echoed screen; output the echoed screen, the distributed splicing system whole-wall echo method, the display screen is consistent with the display area of the splicing wall; the effect of the splicing wall echo will not change due to the increase in the number of splicing screens in the splicing wall Poor; can realize high-definition echo and partial high-definition echo of splicing wall. It solves the technical problem that all the pictures displayed on the existing splicing wall cannot be displayed, which causes the display picture to be wrong and causes the displayed picture quality to be poor.

FIG. 3 is a flow chart of the steps of generating an echo code stream in the whole wall echo method of a distributed splicing system according to an embodiment of the present invention.

As shown in FIG. 3, in the embodiment of the present invention, the steps of generating the echo code stream of each node include:

S23. Grab the display screen of the node at the current system time;

S24. Encode the display picture to obtain the echo code stream.

It should be noted that each node generates an echo code stream of one of the splicing screens in the splicing wall, and the echo server splices all the splicing screens, and then the entire splicing wall can be obtained. If you splice part of the splicing screen, you will get a partial high-definition echo stream.

In the step S21 of the embodiment of the present invention, the display time of each node on the splicing wall is synchronized with the display time of the time synchronization server, that is, the display time of each node on the splicing wall is synchronized with the display time of each node on the splicing wall. The display time of each of the nodes is the same.

It should be noted that since the splicing wall is composed of multiple independent splicing screens, in order to ensure that the entire wall echo code stream of the splicing wall does not appear torn, it needs to be synchronized, and the time is synchronized. The basis of processing is to ensure that the time of the multiple splicing screen nodes on the splicing wall is uniform. The time synchronization server may be a GPS network time synchronization server, where the GPS network time synchronization server uses GPS signals as the time source. At the same time, Beidou, CDMA, B code and other time source servers can be selected, and the internationally popular NTP is embedded. /SNTP protocol, synchronize all computers, controllers and other devices in the network.

In the step S22 of the embodiment of the present invention, the time for the node to fetch the frame is calculated based on the current system time of the splicing wall. Wherein, in the process of generating the echo code stream of the display screen, the time for all the nodes to fetch frames for the first time is aligned to an integer number of seconds, and then the nodes are fetched every corresponding time. The display screen of the node is captured according to the time when the frame is fetched. The corresponding time is 1000/echo frame rate, and the echo frame rate is based on the settings required by the mobile terminal.

It should be noted that the node calculates the frame fetching time of the node according to the current system time of the splicing wall. Wherein, because the echoed picture is not displayed at a certain moment, the calculated frame of the node includes the first frame and other frames. In order to ensure the synchronization of the echoed picture, all the nodes need to fetch frames at the same time, and the frame fetching time of the first frame can be aligned to an integer number of seconds. Specifically, the alignment starts at an integer number of seconds, and the program that executes the entire wall echo method of the distributed splicing system can be suspended for a period of time, and the length of the suspension (time unit is milliseconds) is t:

t=1000-x/1000

x is the current system time of the splicing wall.

Starting from the first frame, the node is fetched every corresponding time. For example, if 30 frames per second are to be output, the frame is fetched every 33.3 milliseconds. After the first frame fetching is completed, the node is then fetched as other frames. All the nodes are aligned to an integer number of seconds according to the first frame, and then each frame is calculated according to the corresponding time of the frame rate. The effect achieved is that the frame fetching time of each node is one-to-one corresponding to ensure the display The quality of the picture.

In the step S23 of the embodiment of the present invention, at the moment when the node is performing frame fetching, all the display pictures of the nodes on the splicing wall are captured.

It should be noted that capturing the display screen of the node at the current time (that is, the frame capture time), and capturing the display screen of the node needs to be performed through a hardware platform or an operating system. For example, the Huawei HiSilicon platform has a WBC module. Through the WBC module, the picture displayed on the device screen can be written back to a channel in the memory, and then this channel can be collected and coded to obtain the echo code stream.

In the step S24 of the embodiment of the present invention, the display picture is encoded to obtain an echo code stream.

It should be noted that the captured display screen generally has a ratio of 1:1 to the current display screen by default. Since the size of the mosaic wall is often larger than the display screen, if they are all 1:1 Echoing the display picture proportionally will cause a large decoding workload for the echo server. Therefore, the display picture is scaled first, and then encoded to obtain the echo code stream. The zoom processing will not affect the quality of the echoed picture after the splicing of the displayable picture, and the echoed picture will still display a high-definition picture.

FIG. 4 is a flowchart of the steps of obtaining the echoed picture by the whole wall echoing method of the distributed splicing system according to the embodiment of the present invention.

As shown in FIG. 4, the steps of selecting the node code stream at the same frame fetching time, and splicing and cropping the selected node code stream include:

S43. The zoomed picture splices pictures of the same frame fetching time together according to the node layout information to obtain the spliced echo picture.

In the step of obtaining the echoed picture after cutting and splicing in the embodiment of the present invention, firstly, the picture display area is obtained on the splicing wall based on the display area, and based on the splicing area of the splicing wall and the picture The display area, that is, the splicing area is composed of multiple splicing screens, and each splicing display area and each splicing screen display area of the splicing area are obtained. The screen display area is composed of a plurality of spliced display areas. Secondly, perform zooming processing on each of the spliced display areas to obtain the same zoomed picture corresponding to the size of the spliced picture display area. Finally, the zoomed picture will be the same according to the node layout information. The pictures of the frame time are spliced together to obtain the spliced echo picture.

It should be noted that, as shown in FIG. 2, in the display area A, the screen display area refers to an area overlapping the display area A on the splicing wall. The splicing area refers to the splicing composition of each splicing screen. Corresponding to the picture display area, each of the spliced display areas and each of the spliced picture display areas is obtained on the spliced area. Specifically, in this embodiment, the screen display area is composed of nine seamless splicing of the spliced screen display areas, each of the spliced screen display areas has two coordinates, one is the image area coordinate , That is, the coordinates of the splicing screen display area in the node screen area of the splicing wall, and the other is the display coordinates (x1, y12, w1, h1), that is, the splicing display area is in the display area A The coordinates in (x2, y2, w2, h2). The steps for displaying the display screen in a splicing screen display area are: the first step is to set up a space for storing image frames, and the second step is to set the spliced screen with (x1, y12, w1, h1) coordinates The image frame of the display area is scaled to w2×h2 to obtain the scaled image frame; the third step is to transfer the scaled image frame to the spliced display area with coordinates (x2, y2, w2, h2).

Steps

2 and 3 are repeated to process the image frames on the display area of the nine spliced pictures to obtain the echoed picture after splicing.

Embodiment two:

As shown in FIG. 5, an embodiment of the present invention provides a whole wall echo display device of a distributed splicing system, including:

The node information acquiring unit 10 is configured to acquire node layout information of the splicing wall; wherein the node layout information is the position of the node where a plurality of splicing screens are connected to form an output screen;

The echo code stream obtaining unit 20 is used to obtain the echo code stream of each node on the splicing wall;

The decoding unit 30 is configured to decode the echo code stream to obtain a node code stream;

The display unit 40 is configured to obtain a display area, select the node code stream corresponding to the display area according to the node layout information and the display area, and splice and crop the selected node code stream to obtain a response Display screen

The control unit 50 is configured to output the display screen.

In the embodiment of the present invention, the node layout information acquired by the node information acquiring unit 10 is the composition of each splicing piece of the splicing wall.

It should be noted that the splicing wall is composed of several splicing screens, each of the splicing screens corresponds to a node, the echo server is connected to the splicing wall, and the echo server obtains each splicing wall. Each of the nodes corresponding to the splicing screen, the echo server obtains the node layout information of the splicing wall. In this embodiment, the splicing wall is composed of a total of 18 splicing screens in 3 rows and 6 columns, that is, 18 nodes corresponding to the 18 splicing screens are obtained, and the display screen is output by the 18 nodes. Each of the nodes is responsible for different picture areas.

In the embodiment of the present invention, the echo code stream acquisition unit 20 is connected to the splicing wall through the echo server, and the echo server obtains all the nodes on the splicing wall based on the node layout information. Echo the code stream.

In the embodiment of the present invention, the decoding unit 30 decodes the echo code stream through the echo server to obtain a node code stream corresponding to the echo code stream. Wherein, the echo server can decode all the 18 echo code streams one by one to obtain the 18 node code streams corresponding to the 18 nodes.

In the embodiment of the present invention, the display unit 40 is based on acquiring the display area and the node layout information on the splicing wall and the display area, and the echo server selects the node code stream to obtain and The display area corresponds to all the node code streams, and the echo server splices and cuts all the node code streams to obtain the echo picture. Wherein, the display area refers to an area where the echo display screen is displayed on the splicing wall.

nodes

9, 10, 14, 15, 16, and the node code streams of these nine nodes need to be decoded. After decoding, they are spliced according to the layout of the display area A. After splicing, they are cut into The picture that matches the display area A is used as the echo picture of the entire wall. The display area A is displayed as a partial high-definition echo display on the splicing wall, and the full-wall high-definition echo display can be considered as a situation where the display area A covers the splicing wall. Wherein, the display area A is arbitrarily zoomed and moved within the range of the splicing wall. Wherein, the display area is to select a desired screen area on the splicing wall through the mobile terminal, and the display area refers to the screen area of the splicing wall selected during echo output, which may be the entire splicing wall. The area of the wall may also be a sub-area of the splicing wall. That is, the display area to be displayed on the splicing wall selected by the mobile terminal may be the entire area of the splicing wall, or it may be a sub-area of the splicing wall.

In the embodiment of the present invention, the control unit 50 controls the echo server to deliver the spliced and cropped display screen to the mobile terminal or display device to realize the screen display, and can also control the echo server to display the screen. The echoed picture is encoded as a channel of IP video and output through the network.

The invention provides a distributed splicing system whole-wall echo display device that obtains the node layout information of the splicing wall through a node information obtaining unit, and uses the echo code stream obtaining unit to obtain the echo code stream of each node; the decoding unit is for each node The echo code stream of the node is decoded to obtain the node code stream; the display unit splices and cuts the node code stream according to the display area and node layout information to obtain the spliced and cropped echo picture. The display screen of the whole-wall echo display device of the distributed splicing system is consistent with the display area of the splicing wall; the effect of splicing wall echo will not deteriorate due to the increase in the number of splicing screens of the splicing wall; it can realize the high-definition echo of the splicing wall And partial high-definition echo. It solves the technical problem that all the pictures displayed on the existing splicing wall cannot be displayed, which causes the display picture to be wrong and causes the displayed picture quality to be poor.

In the embodiment of the present invention, the echo code stream acquisition unit 20 includes a node time synchronization subunit 21, a calculation subunit 22, a collection subunit 23, and an encoding subunit 24;

The node time synchronization subunit 21 is used to synchronize the time of each of the nodes with a time synchronization server;

The calculation subunit 22 is configured to calculate the frame fetching time of the node according to the current system time of the splicing wall;

The collection subunit 23 is configured to capture the display screen of the node at the current system time;

The encoding subunit 24 is used to encode the display picture to obtain the echo code stream.

In the embodiment of the present invention, the time synchronization in the node time synchronization subunit 21 means that the display time of each node on the splicing wall is synchronized with the display time of the time synchronization server, that is, the splicing wall The display time of each of the above nodes is the same as the display time of the time synchronization server.

It should be noted that since the splicing wall is composed of multiple independent splicing screens, in order to ensure that the entire wall echo code stream of the splicing wall does not appear torn, it needs to be synchronized, and the time is synchronized. The basis of processing is to ensure that the time of the multiple splicing screen nodes on the splicing wall is uniform.

In the embodiment of the present invention, the calculation subunit 22 calculates the time for the node to fetch frames based on the current system time of the splicing wall. Wherein, in the process of generating the echo code stream of the display screen, the time for all the nodes to fetch frames for the first time is aligned to an integer number of seconds, and then the nodes are fetched every corresponding time. The display screen of the node is captured according to the time when the frame is fetched. The corresponding time is 1000/echo frame rate, and the echo frame rate is based on the settings required by the mobile terminal.

t=1000-x/1000

x is the current system time of the splicing wall.

In the embodiment of the present invention, the collection subunit 23 captures all the displayed images of the nodes on the splicing wall at the moment when the node is performing frame capture. Wherein, the display screen of the node is captured at the current time (that is, the time when the frame is captured), and the capture of the display screen of the node needs to be performed through a hardware platform or an operating system. For example, the Huawei HiSilicon platform has a WBC module. Through the WBC module, the picture displayed on the device screen can be written back to a channel in the memory, and then this channel can be collected and encoded to obtain the echo code stream.

In the embodiment of the present invention, the encoding subunit 24 encodes the display picture captured by the collecting subunit 23. Among them, the captured display screen generally has a ratio of 1:1 to the current display screen by default. Since the size of the mosaic wall is often larger than the display screen, if all are returned at a ratio of 1:1 Displaying the display screen will cause a large decoding workload for the echo server. Therefore, the display screen is scaled first, and then encoded after the scaling process to obtain the echo code stream. The zoom processing will not affect the quality of the echoed picture after the splicing of the displayable picture, and the echoed picture will still display a high-definition picture.

In the embodiment of the present invention, the display unit 40 includes a region dividing subunit 41, a zooming subunit 42, and a splicing subunit 43;

The area dividing subunit 41 is configured to obtain a picture display area on the splicing wall based on the display area, and obtain each splicing area of the splicing area based on the splicing area of the splicing wall and the picture display area Display area and display area of each splicing screen;

The zoom subunit 42 is configured to perform zoom processing on each of the spliced display areas to obtain the same zoomed picture corresponding to the spliced picture display area size specification;

The splicing subunit 43 is configured to splice pictures of the same frame fetching time together according to the node layout information according to the zoom picture to obtain the spliced echo picture.

In the embodiment of the present invention, in the display unit 40 of the embodiment of the present invention, first, the screen display area is obtained through the area dividing subunit 41, based on the splicing area of the splicing wall and the screen display area , That is, the splicing area is composed of multiple splicing screens, and each splicing display area and each splicing screen display area of the splicing area are obtained. The screen display area is composed of a plurality of spliced display areas. Secondly, each of the spliced display areas is scaled by the zoom subunit 42 to obtain the same zoomed picture corresponding to the size of the spliced picture display area; finally, the spliced subunit 43 The zoomed picture splices pictures of the same frame fetching time together according to the node layout information to obtain the spliced echo picture.

It should be noted that, as shown in FIG. 2, in the display area A, the screen display area refers to an area overlapping the display area A on the splicing wall. The splicing area refers to the splicing composition of each splicing screen. Corresponding to the picture display area, each of the spliced display areas and each of the spliced picture display areas is obtained on the spliced area. Specifically, in this embodiment, the screen display area is composed of nine seamless splicing of the spliced screen display areas, each of the spliced screen display areas has two coordinates, one is the image area coordinate , That is, the coordinates of the splicing screen display area in the node screen area of the splicing wall, and the other is the display coordinates (x1, y12, w1, h1), that is, the splicing display area is in the display area A The coordinates in (x2, y2, w2, h2). The steps for displaying the display screen in a splicing screen display area are: the first step is to set up a space for storing image frames, and the second step is to set the spliced screen with (x1, y12, w1, h1) coordinates The image frame of the display area is scaled to w2×h2 to obtain the scaled image frame; the third step is to transfer the scaled image frame to the spliced display area of (x2, y2, w2, h2) coordinates.

Steps

Example three:

The embodiment of the present invention provides a computer device, including a processor and a memory;

The processor is configured to execute the above-mentioned distributed splicing system whole wall echoing method according to the instructions in the program code.

It should be noted that the processor is used to execute the steps in the above-mentioned embodiment of the whole wall echo display method of a distributed splicing system according to the instructions in the program code, such as steps S1 to S5 shown in FIG. 1. Or, when the processor executes the computer program, the functions of the modules/units in the foregoing device embodiments, such as the functions of the units 10 to 50 shown in FIG. 5, are realized.

Exemplarily, the computer program may be divided into one or more modules/units, and the one or more modules/units are stored in the memory and executed by the processor to complete the present invention. One or more modules/units may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program in the terminal device.

The terminal device can be a computing device such as a desktop computer, a notebook, a palmtop computer, and a cloud server. The terminal device may include, but is not limited to, a processor and a memory. Those skilled in the art can understand that it does not constitute a limitation on the terminal device. It may include more or fewer components than shown in the figure, or combine some components, or different components. For example, the terminal device may also include input and output devices, Network access equipment, bus, etc.

The so-called processor can be a central processing unit (Central Processing Unit, CPU), other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.

The memory may be an internal storage unit of the terminal device, such as the hard disk or memory of the terminal device. The memory can also be an external storage device of the terminal device, such as a plug-in hard disk equipped on the terminal device, a smart memory card (Smart Media Card, SMC), a Secure Digital (SD) card, a flash memory card (Flash Card), etc. . Further, the memory may also include both an internal storage unit of the terminal device and an external storage device. The memory is used to store computer programs and other programs and data required by the terminal device. The memory can also be used to temporarily store data that has been output or will be output.

Those skilled in the art can clearly understand that, for the convenience and conciseness of the description, the specific working process of the above-described system, device, and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

In the several embodiments provided by the present invention, it should be understood that the disclosed system, device, and method may be implemented in other ways. For example, the device embodiments described above are merely illustrative, for example, the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components may be combined or It can be integrated into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

In addition, the functional units in the various embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the technical solution of the present invention essentially or the part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium. , Including several instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disks or optical disks and other media that can store program codes. .

As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present invention, but not to limit them. Although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: The technical solutions recorded in the embodiments are modified, or some of the technical features are equivalently replaced; these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

A whole wall echo display method of a distributed splicing system is characterized in that it comprises the following steps:

S1. Obtain the node layout information of the splicing wall; wherein the node layout information is the position of the node where a plurality of splicing screens are connected to form an output screen;

S2. Obtain the echo code stream of each node on the splicing wall;

S3. Decode the echo code stream to obtain a node code stream;

S4. Obtain a display area, select the node code stream corresponding to the display area based on the node layout information and the display area, and splice and crop the selected node code stream to obtain an echo picture;

S5. Output the display screen.
The entire wall echo method of a distributed splicing system according to claim 1, wherein the step of generating the echo code stream of each node comprises:

S21. Time synchronization between each of the nodes and the time synchronization server;

S22. Calculate the frame fetching time of the node according to the current system time of the splicing wall;

S23. Grab the display screen of the node at the current system time;

S24. Encode the display picture to obtain the echo code stream.
The whole wall echo display method of the distributed splicing system according to claim 2, characterized in that, in the process of generating the echo code stream of the display screen, the time when all the nodes perform frame fetching for the first time All are aligned to an integer number of seconds, and then the node is fetched every corresponding time, and the display screen of the node is captured according to the moment of fetching the frame;

Wherein, the corresponding time is 1000/echo frame rate, and the echo frame rate is based on the setting required by the mobile terminal.
The whole wall echo display method of a distributed splicing system according to claim 2, characterized in that, at the same frame fetching time, all the nodes on the splicing wall perform the capture of the display screen.
The whole wall echo method of a distributed splicing system according to claim 2, wherein the node code stream at the same frame fetching time is selected, and the selected node code stream is spliced and cropped. The steps include:

S41. Obtain a picture display area on the splicing wall based on the display area, and obtain each splicing display area and each splicing picture display of the splicing area based on the splicing area of the splicing wall and the picture display area area;

S42. Perform zooming processing on each of the spliced display areas to obtain the same zoomed picture corresponding to the size of the spliced picture display area;

S43. The zoomed picture splices pictures of the same frame fetching time together according to the node layout information to obtain the spliced echo picture.
A whole wall echo display device of a distributed splicing system, which is characterized in that it includes:

A node information obtaining unit for obtaining node layout information of the splicing wall; wherein the node layout information is the position of a node where a plurality of splicing screens are connected to form an output screen;

Obtaining the echo code stream unit, used to obtain the echo code stream of each node on the splicing wall;

A decoding unit, configured to decode the echo code stream to obtain a node code stream;

The display unit is configured to obtain a display area, select the node code stream corresponding to the display area according to the node layout information and the display area, and splice and crop the selected node code stream to obtain an echo Picture

The control unit is used to output the display screen.
The entire wall echo display device of the distributed splicing system according to claim 6, wherein the echo code stream acquisition unit includes a node time synchronization subunit, a calculation subunit, a collection subunit, and an encoding subunit;

The node time synchronization subunit is used to synchronize the time of each of the nodes with a time synchronization server;

The calculation subunit is configured to calculate the frame fetching time of the node according to the current system time of the splicing wall;

The collection subunit is used to capture the display screen of the node at the current system time;

The encoding subunit is used to encode the display picture to obtain the echo code stream.
The whole wall echo display device of the distributed splicing system according to claim 7, wherein, in the echo code stream acquisition unit, the time for all the nodes to fetch frames for the first time is aligned to an integer number of seconds. , And then fetch the frame of the node every corresponding time, and fetch the display screen of the node according to the time when the frame is fetched;

Wherein, the corresponding time is 1000/echo frame rate, and the echo frame rate is based on the setting required by the mobile terminal.
The whole wall echo display device of the distributed splicing system according to claim 7, wherein the display unit splices and cuts the node code stream at the same frame fetching time, and the display unit includes Area division sub-unit, zoom sub-unit and splicing sub-unit;

The area dividing subunit is configured to obtain a picture display area on the splicing wall based on the display area, and obtain each splicing display of the splicing area based on the splicing area of the splicing wall and the picture display area Area and display area of each splicing screen;

The zoom subunit is configured to perform zoom processing on each of the spliced display areas to obtain the same zoomed picture corresponding to the size of the spliced picture display area;

The splicing subunit is configured to splice pictures of the same frame fetching time together according to the node layout information according to the zoomed picture to obtain the spliced echo picture.
A computer device characterized by comprising a processor and a memory;

The memory is used to store program code and transmit the program code to the processor;

The processor is configured to execute the whole wall echo display method of the distributed splicing system according to any one of claims 1 to 5 according to the instructions in the program code.