CN117812298A

CN117812298A - Display method, display device, electronic equipment and storage medium

Info

Publication number: CN117812298A
Application number: CN202311862065.2A
Authority: CN
Inventors: 徐树升; 高丛; 赵健; 孔均渭
Original assignee: Hangzhou Hikvision System Technology Co Ltd
Current assignee: Hangzhou Hikvision System Technology Co Ltd
Priority date: 2023-12-29
Filing date: 2023-12-29
Publication date: 2024-04-02

Abstract

The application discloses a display method, a display device, electronic equipment and a storage medium, relates to the technical field of image processing, and is used for solving the problems that when a 2016 type GB/T28281 protocol is used for displaying video streams, a display unit is not supported to display multiple paths of video streams, and one path of video stream is displayed across the display unit. The method comprises the following steps: receiving the distribution condition of the display windows of at least one target display unit in the television wall, which is transmitted by the television wall, and the display windows corresponding to the video streams to be displayed, wherein one video stream to be displayed corresponds to one display window; performing video processing operation on at least one video stream to be displayed to obtain a target video stream corresponding to a target display unit, wherein one target display unit corresponds to one target video stream; and sending the target video stream to a target display unit corresponding to the target video stream in the television wall, so that the target display unit of the television wall displays the target video stream.

Description

Display method, display device, electronic equipment and storage medium

Technical Field

The present disclosure relates to the field of image processing technologies, and in particular, to a display method, a display device, an electronic device, and a storage medium.

Background

In recent years, video display application has been rapidly developed, the access scale of the television wall is also continuously enlarged, a large number of different types of video acquisition devices are emerging, the access protocols of the video acquisition devices are different, when multiple paths of video streams need to be intensively browsed, the video acquisition devices and the access protocols of the television wall are not communicated with each other, and the centralized browsing is difficult.

Based on the method, related departments formulate a unified access protocol, such as GB/T28281 protocol, for networking system information transmission, exchange and control technical requirements, and the problem that video streams are difficult to retrieve in a concentrated mode due to the fact that different access protocols are provided for a television wall is effectively avoided.

However, in the 2016 type GB/T28281 protocol, for example, there is no provision for displaying multiple video streams in different display windows of one display unit of a video wall and displaying one video stream in multiple display units, that is, when video stream transmission is performed using a unified access protocol, there is no support for displaying multiple video streams in one display unit and displaying one video stream across display units.

Disclosure of Invention

The application provides a display method, a display device, electronic equipment and a storage medium, which are used for solving the problems that when a 2016 type GB/T28281 protocol is used for video stream transmission, one display unit is not supported to display multiple paths of video streams, and one path of video stream is displayed across the display unit.

In order to achieve the technical purpose, the application adopts the following technical scheme:

in a first aspect, an embodiment of the present application provides a display method, which is applied to a server, where the method includes:

receiving first display information sent by a television wall, wherein the first display information is used for indicating the distribution condition of at least one target display unit in the television wall and the distribution condition of display windows of at least one target display unit, and one target display unit comprises at least one display window;

determining a target number based on the first display information, and sending the target number to the television wall so that the television wall establishes a corresponding relation between the target number and the target display unit, wherein the target number is used for representing the number of the video processing operation of the server;

receiving second display information sent by a television wall, wherein the second display information comprises a corresponding relation between a target number and a target display unit, identification information of at least one video stream to be displayed and a display window corresponding to the video stream to be displayed, and one video stream to be displayed corresponds to one display window;

acquiring at least one video stream to be displayed based on the identification information of the at least one video stream to be displayed, and performing video processing operation on the at least one video stream to be displayed based on the distribution condition of at least one target display unit, the distribution condition of the display window of the at least one target display unit and the display window corresponding to the video stream to be displayed to obtain a target video stream corresponding to the target display unit, wherein one target display unit corresponds to one target video stream;

And sending the target video stream to a target display unit corresponding to the target video stream in the television wall, so that the target display unit of the television wall displays the target video stream.

The technical scheme provided by the application at least brings the following beneficial effects: the server receives the first display information sent by the television wall, and because the first display information comprises the distribution condition of the target display units and the distribution condition of the display windows in the target display units, the server can determine whether one path of video stream is displayed in a plurality of display units or one display unit is displayed in a plurality of video streams, and then the server determines a target number and sends the target number to the television wall, wherein the target number is used for representing the number of the server for video processing operation. The television wall establishes a corresponding relation between the target number and the target display unit, and sends the corresponding relation between the target number and the target display unit, the identification information of at least one video stream to be displayed and the display window corresponding to the video stream to be displayed to the server, so that the server can acquire the video stream to be displayed, and based on the distribution condition of at least one target display unit, the distribution condition of the display window of at least one target display unit and the display window corresponding to the video stream to be displayed, video processing operation is carried out on the video stream to be displayed, and the target video stream corresponding to the target display unit is obtained. For the television wall, the structure of the television wall is not changed, and the access protocol is not changed, when one target display unit comprises a plurality of display windows, the target video stream displayed in the target display unit of the television wall is one video stream obtained based on a plurality of video streams to be displayed, and the situation that one display unit displays a plurality of video streams is realized. Or when one target display unit comprises one display window and a plurality of target display units need to display one video stream to be displayed, the target video stream displayed in the target display unit of the television wall is one video stream in a plurality of paths of video streams obtained based on one video stream to be displayed, and the situation that one video stream is displayed across the plurality of display units is realized.

In one possible implementation, in the case where the number of target display units is one and the target display units include a plurality of display windows, the video processing operation is a stitching operation; based on the distribution condition of at least one target display unit, the distribution condition of the display window of at least one target display unit, and the display window corresponding to the video stream to be displayed, performing video processing operation on at least one video stream to be displayed to obtain a target video stream corresponding to the target display unit, including: determining that a display picture of a display window which does not correspond to the video stream to be displayed in the display window of the target display unit is a preset picture based on the display window which corresponds to the video stream to be displayed, and determining that the display picture of the display window which corresponds to the video stream to be displayed is a video picture of the video stream to be displayed; and based on the distribution condition of at least one target display unit, the distribution condition of the display window of at least one target display unit, the display picture of the display window which does not correspond to the video stream to be displayed, and the display picture of the display window which corresponds to the video stream to be displayed, performing splicing operation on the video picture of the video stream to be displayed and the preset picture to obtain the target video stream which corresponds to the target display unit.

In one possible implementation manner, when the number of the target display units is plural, the display areas corresponding to the plural target display units are spliced into rectangular areas, the number of the display windows of each target display unit is one, and the number of the video streams to be displayed is one, the video processing operation is a dividing operation; based on the distribution condition of at least one target display unit, the distribution condition of the display window of at least one target display unit, and the display window corresponding to the video stream to be displayed, performing video processing operation on at least one video stream to be displayed to obtain a target video stream corresponding to the target display unit, including: based on the distribution condition of at least one target display unit, the distribution condition of the display window of at least one target display unit and the display window corresponding to the video stream to be displayed, the video picture of the video stream to be displayed is subjected to segmentation operation, so that a plurality of target video streams corresponding to the target display units one by one are obtained.

In one possible implementation manner, when the video stream to be displayed is a video stream corresponding to a real-time picture in a display screen of the terminal, the method further includes: and receiving a display video stream sent by the terminal, wherein the display video stream is obtained by capturing a display picture in a display screen of the terminal in real time by the terminal.

In one possible implementation, the sending the target video stream to a target display unit in the tv wall corresponding to the target video stream includes: for each target video stream, encoding the target video stream by a target protocol to obtain a target code stream; and sending the target code stream to a target display unit corresponding to the target video stream in the television wall.

In a second aspect, the present application provides a display method applied to a tv wall, the method comprising:

determining at least one target display unit, a distribution of the at least one target display unit and a distribution of display windows of the at least one target display unit, wherein one target display unit comprises at least one display window;

generating first display information based on the distribution condition of at least one target display unit and the distribution condition of a display window of at least one target display unit, and sending the first display information to a server;

receiving a target number returned by the server, and establishing a corresponding relation between the target number and a target display unit, wherein the target number is used for representing the number of the video processing operation of the server;

determining identification information of at least one video stream to be displayed and a display window corresponding to the video stream to be displayed, wherein one video stream to be displayed corresponds to one display window;

Generating second display information based on the corresponding relation between the target number and the target display unit, the identification information of at least one video stream to be displayed and the display window corresponding to the video stream to be displayed, and sending the second display information to the server;

receiving target video streams corresponding to all target display units returned by a server, wherein the target video streams are obtained by the server based on identification information of at least one video stream to be displayed, and video processing operation is carried out on the at least one video stream to be displayed based on the distribution condition of the at least one target display unit, the distribution condition of a display window of the at least one target display unit and the display window corresponding to the video stream to be displayed, and one target video stream corresponds to one target display unit;

and displaying the target video stream corresponding to the target display unit in each target display unit.

In a possible implementation manner, in the case that the number of the target display units is one and the target display units include a plurality of display windows, the video processing operation is a splicing operation, a display picture of a display window, which does not correspond to the video stream to be displayed, in the display windows of the target display units is a preset picture, a display picture of a display window, which corresponds to the video stream to be displayed, is a video picture of the video stream to be displayed, and the target video stream is obtained by the server by performing the splicing operation based on a distribution condition of at least one target display unit, a distribution condition of at least one display window of the target display unit, a display picture of a display window, which does not correspond to the video stream to be displayed, and a display picture of a display window, which corresponds to the video stream to be displayed.

In one possible implementation manner, when the number of the target display units is plural, the display areas corresponding to the plural target display units are spliced into rectangular areas, the number of the display windows of each target display unit is one, and the number of the video streams to be displayed is one, the video processing operation is a splitting operation, and the target video streams are obtained by the server by performing the splitting operation on the video frames of the video streams to be displayed based on the distribution condition of at least one target display unit, the distribution condition of the display windows of at least one target display unit, and the display windows corresponding to the video streams to be displayed.

In a third aspect, the present application provides a display device, including:

the television comprises a transmission module, a display module and a display module, wherein the transmission module is used for receiving first display information sent by a television wall, the first display information is used for indicating the distribution condition of at least one target display unit in the television wall and the distribution condition of display windows of at least one target display unit, and one target display unit comprises at least one display window;

the processing module is used for determining a target number based on the first display information;

the transmission module is also used for transmitting the target number to the television wall so that the television wall establishes a corresponding relation between the target number and the target display unit, and the target number is used for representing the number of the video processing operation of the server;

The transmission module is further configured to receive second display information sent by the video wall, where the second display information includes a correspondence between a target number and a target display unit, identification information of at least one video stream to be displayed, and a display window corresponding to the video stream to be displayed, and one video stream to be displayed corresponds to one display window;

the transmission module is further used for acquiring at least one video stream to be displayed based on the identification information of the at least one video stream to be displayed;

the processing module is further used for performing video processing operation on at least one video stream to be displayed based on the distribution condition of at least one target display unit, the distribution condition of the display window of at least one target display unit and the display window corresponding to the video stream to be displayed, so as to obtain a target video stream corresponding to the target display unit, wherein one target display unit corresponds to one target video stream;

the transmission module is further used for transmitting the target video stream to a target display unit corresponding to the target video stream in the television wall, so that the target display unit of the television wall displays the target video stream.

In one possible implementation, in the case where the number of target display units is one and the target display units include a plurality of display windows, the video processing operation is a stitching operation; the processing module is specifically used for: determining that a display picture of a display window which does not correspond to the video stream to be displayed in the display window of the target display unit is a preset picture based on the display window which corresponds to the video stream to be displayed, and determining that the display picture of the display window which corresponds to the video stream to be displayed is a video picture of the video stream to be displayed; and based on the distribution condition of at least one target display unit, the distribution condition of the display window of at least one target display unit, the display picture of the display window which does not correspond to the video stream to be displayed, and the display picture of the display window which corresponds to the video stream to be displayed, performing splicing operation on the video picture of the video stream to be displayed and the preset picture to obtain the target video stream which corresponds to the target display unit.

In one possible implementation manner, when the number of the target display units is plural, the display areas corresponding to the plural target display units are spliced into rectangular areas, the number of the display windows of each target display unit is one, and the number of the video streams to be displayed is one, the video processing operation is a dividing operation; the processing module is specifically configured to perform a segmentation operation on a video frame of the video stream to be displayed based on a distribution condition of at least one target display unit, a distribution condition of a display window of at least one target display unit, and a display window corresponding to the video stream to be displayed, so as to obtain a plurality of target video streams corresponding to the plurality of target display units one by one.

In one possible implementation manner, the transmission module is further configured to receive a display video stream sent by the terminal, where the display video stream is a video stream obtained by capturing, by the terminal, a display picture in a display screen of the terminal in real time.

In a possible implementation manner, the processing module is further configured to, for each target video stream, encode the target video stream with a target protocol to obtain a target code stream; the transmission module is specifically configured to send the target code stream to a target display unit in the video wall corresponding to the target video stream.

In a fourth aspect, the present application provides a display device, including:

the processing module is used for determining at least one target display unit, the distribution condition of the at least one target display unit and the distribution condition of the display windows of the at least one target display unit, and one target display unit comprises at least one display window;

the processing module is further used for generating first display information based on the distribution condition of at least one target display unit and the distribution condition of the display window of at least one target display unit;

the transmission module is used for transmitting the first display information to the server;

the transmission module is also used for receiving the target number returned by the server;

the processing module is also used for establishing a corresponding relation between a target number and a target display unit, wherein the target number is used for representing the number of the video processing operation performed by the server;

the processing module is further used for determining identification information of at least one video stream to be displayed and a display window corresponding to the video stream to be displayed, and one video stream to be displayed corresponds to one display window;

the processing module is further used for generating second display information based on the corresponding relation between the target number and the target display unit, the identification information of at least one video stream to be displayed and the display window corresponding to the video stream to be displayed;

The transmission module is also used for transmitting the second display information to the server;

the transmission module is further used for receiving target video streams corresponding to the target display units returned by the server, the target video streams are obtained by the server based on identification information of at least one video stream to be displayed, and the at least one video stream to be displayed is obtained by performing video processing operation on the at least one video stream to be displayed based on distribution conditions of the at least one target display unit, distribution conditions of display windows of the at least one target display unit and the display windows corresponding to the video stream to be displayed, and one target video stream corresponds to one target display unit;

and the display module is used for displaying the target video stream corresponding to the target display unit in each target display unit.

In a fifth aspect, the present application provides an electronic device, comprising: one or more processors; one or more memories; wherein the one or more memories are configured to store computer program code comprising computer instructions that, when executed by the one or more processors, cause the electronic device to perform any of the display methods provided in the first aspect described above, or cause the electronic device to perform any of the display methods provided in the second aspect described above.

In a sixth aspect, the present application provides a computer-readable storage medium storing computer-executable instructions that, when executed on a computer, cause the computer to perform any one of the display methods provided in the first aspect, or perform any one of the display methods provided in the second aspect.

In a seventh aspect, the present application provides a computer program product comprising computer instructions which, when run on a computer, cause the computer to perform any of the display methods provided in the first aspect described above, or to perform any of the display methods provided in the second aspect described above.

For a detailed description of the second to seventh aspects and various implementations thereof in this application, reference may be made to the detailed description of the first aspect and various implementations thereof; moreover, the advantages of the second aspect and the various implementations thereof may be referred to as analyzing the advantages of the first aspect and the various implementations thereof, and will not be described herein.

These and other aspects of the present application will be more readily apparent from the following description.

Drawings

Fig. 1 is a timing chart of capturing video stream based on GB/T28281 protocol according to an embodiment of the present application;

fig. 2 is a schematic structural diagram of a display system to which a display method according to an embodiment of the present application is applicable;

fig. 3 is a schematic diagram of an application scenario of a display method according to an embodiment of the present application;

FIG. 4 is a schematic diagram of hardware components of a computing device according to an embodiment of the present disclosure;

Fig. 5 is a flowchart of a display method according to an embodiment of the present application;

fig. 6 is a second application scenario schematic diagram of a display method according to an embodiment of the present application;

fig. 7 is a third application scenario schematic diagram of a display method according to an embodiment of the present application;

fig. 8 is a schematic diagram of an application scenario of a display method according to an embodiment of the present application;

fig. 9 is a fifth application scenario diagram of a display method according to an embodiment of the present application;

fig. 10 is a schematic diagram of an application scenario of a display method according to an embodiment of the present application;

fig. 11 is a schematic structural diagram of a display device according to an embodiment of the present application;

fig. 12 is a schematic structural diagram of another display device according to an embodiment of the present application.

Detailed Description

The following description of the technical solutions in the embodiments of the present application will be made clearly and completely with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.

It should be noted that, in the embodiments of the present application, words such as "exemplary" or "such as" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "for example" should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion. The terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the present application, unless otherwise indicated, the meaning of "a plurality" is two or more.

For ease of understanding, the basic concepts of some terms or techniques involved in the embodiments of the present application are first briefly described and illustrated.

Television wall: the super-large screen television wall body formed by splicing a plurality of display units can be used for displaying contents such as images, pictures and texts.

A decoder: is a hardware device capable of decoding digital audio and video data streams into analog audio and video signals.

GB/T28281 protocol: the technical requirements of information transmission and exchange control of a video networking system, the basic requirements and the safety requirements of transmission, exchange and control, the technical requirements of control, transmission flow, protocol interfaces and the like of an interconnection structure of the video networking system are specified by related departments. The GB/T28181 protocol signaling layer uses the session initiation protocol (session initiation protocol, SIP) protocol. The current GB/T28281 protocols comprise 2016 type and 2022 type, the GB/T28281 protocol of the 2016 type does not provide for the situation that one video stream is displayed across a display unit, one display unit displays multiple video streams and a display picture of a desktop of a terminal is thrown on a screen in real time, and the GB/T28281 protocol of the 2022 type provides for the situation that one display unit displays multiple video streams, but does not provide for the situation that one video stream is displayed across the display unit and the display picture of the desktop of the terminal is thrown on a screen in real time.

The video stream fetching timing diagram based on the GB/T28281 protocol can be as shown in FIG. 1:

1. the controller of the television wall sends Invite information to the server to request a video stream to be displayed from the server;

2. The server receives Invite information sent by the controller of the television wall and replies 200OK information carrying SDP message bodies so as to inform the controller of the television wall that the server is ready;

3. the controller of the television wall sends Invite information carrying SDP message body to the video transmission device so as to enable the video transmission device to prepare a video stream to be displayed;

4. the video transmission device replies 200OK information carrying SDP message body, and informs the controller of the television wall that the video transmission device is ready;

5. the controller of the television wall sends ACK information carrying an SDP message body to the server so as to inform the server that the video stream to be displayed is ready to be received;

6. the controller of the television wall sends ACK information to the video transmission device to inform the video transmission device to start transmitting the video stream to be displayed, and the video transmission device transmits the real-time video stream to the server;

7. a decoder of a display unit in the television wall sends Invite information to a server of the television wall to request a video stream to be displayed from a controller of the television wall;

8. the controller of the television wall replies the 200OK information of the SDP message body, and informs the decoder controller of the display unit of the television wall that the controller is ready;

9. The controller of the television wall sends Invite information carrying SDP message body to the server so as to enable the server to prepare video stream to be displayed;

10. the server replies 200OK information carrying SDP message body, and informs the controller of the television wall that the server is ready;

11. the controller of the television wall sends ACK information carrying the SDP message body to the decoder of the display unit in the television wall so as to inform the decoder of the display unit in the television wall that the decoder is ready to receive the video stream to be displayed;

12. the controller of the television wall sends ACK information carrying an SDP message body to the server so as to instruct the server to send a video stream to be displayed, and the server sends a real-time video stream to a decoder of a display unit in the television wall;

13. after the video stream to be displayed is sent, the controller of the television wall sends BYE information to the decoder of the display unit in the television wall so as to indicate that a data transmission link indicated by Invite information between the controller of the television wall and the decoder of the display unit in the television wall is disconnected;

14. the decoder of the display unit in the television wall replies 200OK information, and the data transmission link indicated by the Invite information between the controller of the television wall and the decoder of the display unit in the television wall is disconnected;

15. The controller of the television wall sends BYE information to the server to indicate that a data transmission link indicated by Invite information between the controller of the television wall and the server is disconnected;

16. the server replies 200OK information and disconnects the data transmission link indicated by Invite information between the controller of the television wall and the server;

17. the controller of the television wall sends BYE information to the server to indicate that a data transmission link indicated by Invite information carrying SDP message bodies between the controller of the television wall and the server is disconnected;

18. the server replies 200OK information and disconnects a data transmission link carrying Invite information indication of SDP message body between the controller of the television wall and the server;

19. the controller of the television wall sends BYE information to the video transmission device to instruct the disconnection of a data transmission link indicated by Invite information carrying SDP message bodies between the controller of the television wall and the video transmission device;

20. the server replies 200OK message, disconnecting the data transmission link between the controller of the tv wall and the video transmission device carrying Invite message indication of the SDP message body.

The foregoing is a description of some concepts related to the embodiments of the present application, and is not repeated herein below.

However, the unified access protocol does not specify the situation that multiple video streams are displayed in different display windows of one display unit of the television wall and one video stream is displayed in multiple display units, that is, when the unified access protocol is used for video stream transmission, the situation that one display unit displays multiple video streams and one video stream is displayed across the display units is not supported.

In this regard, the embodiment of the present application provides a display method, where the server receives first display information sent by the tv wall, and because the first display information includes a distribution condition of a target display unit and a distribution condition of a display window in the target display unit, the server may determine whether one video stream is displayed in a plurality of display units or one display unit displays a plurality of video streams, so that the server determines a target number and sends the target number to the tv wall, where the target number is used to represent a number of the server performing video processing operations. The television wall establishes a corresponding relation between the target number and the target display unit, and sends the corresponding relation between the target number and the target display unit, the identification information of at least one video stream to be displayed and the display window corresponding to the video stream to be displayed to the server, so that the server can acquire the video stream to be displayed, and based on the distribution condition of at least one target display unit, the distribution condition of the display window of at least one target display unit and the display window corresponding to the video stream to be displayed, video processing operation is carried out on the video stream to be displayed, and the target video stream corresponding to the target display unit is obtained. For the television wall, the structure of the television wall is not changed, and the access protocol is not changed, when one target display unit comprises a plurality of display windows, the target video stream displayed in the target display unit of the television wall is one video stream obtained based on a plurality of video streams to be displayed, and the situation that one display unit displays a plurality of video streams is realized. Or when one target display unit comprises one display window and a plurality of target display units need to display one video stream to be displayed, the target video stream displayed in the target display unit of the television wall is one video stream in a plurality of paths of video streams obtained based on one video stream to be displayed, and the situation that one video stream is displayed across the plurality of display units is realized.

Referring to fig. 2, a display system to which the display method provided in the present application is applicable is shown. As shown in fig. 2, the display system 1 includes a server 10 and a tv wall 20.

Wherein a communication connection is established between the server 10 and the tv wall 20. It should be appreciated that the connection may be a wireless connection, such as a Bluetooth connection, a wireless fidelity (wireless fidelity, wi-Fi) connection, or the like; alternatively, the connection may be a wired connection, for example, an optical fiber connection, which is not limited thereto. Illustratively, the server 10 and the television wall 20 may be connected to the internet through a router, thereby enabling a communication connection between the server 10 and the television wall 20.

In some embodiments, the server 10 is configured to perform a video processing operation on a video stream to be displayed based on the first display information and the second display information sent by the tv wall 20, obtain a target video stream corresponding to a target display unit in the tv wall 20, and send the target video stream to the target display unit in the tv wall 20, so that one video stream can be displayed in the tv wall across the display units, and one display unit displays multiple video streams.

In some embodiments, the server 10 is further configured to obtain a display video stream obtained by capturing, in real time, a display picture in a display screen of the terminal, and perform video processing operation on the display video stream to obtain a target video stream, so that the display picture in a desktop of the terminal can be projected to a television wall.

In practical applications, application software for capturing a video stream of a display screen of the terminal may be installed in the terminal, so that the terminal may send the video stream of the display screen captured in real time to the server 10.

Based on the above description, the server 10 may be divided into a media splitting server, a media splicing server, and a media screen-throwing server, as shown in fig. 3, where the media splitting server is configured to implement splicing processing on multiple video streams displayed in one display unit, the media splicing server is configured to implement splitting processing on one video stream displayed across multiple display units, and the media screen-throwing server is configured to implement video stream capturing of a display screen of a mobile desktop of a terminal, and the media splitting server, the media splicing server, and the media screen-throwing server send target video streams obtained by respective processing to corresponding target display units.

Alternatively, the media splitting server, the media splicing server, and the media projection server may be three independent servers as shown in fig. 3, or may be integrated into one server.

In some embodiments, television wall 20 is configured to determine at least one target display unit, a distribution of at least one target display unit, and a distribution of a display window of at least one target display unit, and generate first display information based on the information. Wherein one target display unit comprises at least one display window.

In some embodiments, the tv wall 20 is further configured to send the first display information to the server 10, receive a target number returned by the server 10, and establish a correspondence between the target number and the target display unit based on the target number returned by the server 10, where the target number is used to characterize a number of the server 10 performing the video processing operation.

In some embodiments, the tv wall 20 is further configured to determine identification information of at least one video stream to be displayed and a display window corresponding to the video stream to be displayed, and generate second display information based on the information. Wherein one video stream to be displayed corresponds to one display window.

In some embodiments, the tv wall 20 is further configured to send the second display information to the server 10, and receive a target video stream corresponding to a target display unit returned by the server 10, where one target display unit corresponds to one target video stream.

In some embodiments, television wall 20 is configured to display a target video stream corresponding to a target display unit in the target display unit.

In some embodiments, the server 10 includes an encoder for encoding a target video stream according to a target protocol (e.g., version 2016 of GB28281 protocol or version 2022 of GB28281 protocol) to obtain a target code stream.

In some embodiments, based on the above functions, the tv wall 20 includes a controller for implementing information interaction with the server 10, and determining information such as a target display unit, a distribution situation of the target display unit, a distribution situation of a display window of the target display unit, and at least one decoder for decoding a target bitstream so that the target display unit may display the decoded target video stream.

In some embodiments, when the tv wall 20 includes a plurality of decoders, one decoder may correspond to a display unit in one tv wall 20, and the decoder is configured to decode a target bitstream to be displayed on the display unit corresponding to the decoder, so that the display unit may display the target video stream corresponding to the display unit.

In some embodiments, the server 10 may further include other functional modules that may be used to perform operations of encapsulation, format conversion, and the like on the target code stream, which are not described herein.

In some embodiments, the tv wall 20 may further include other functional modules that may be used to perform operations such as palette, trimming, etc. on video pictures in the target video stream, which will not be described herein.

In some embodiments, one or more video transmission devices may also be included in the display system 1. The video transmission device may be any electronic device capable of providing a video stream to be displayed, and the video transmission device may be respectively in communication connection with the server 10 and the tv wall 20, where the server 10 and the tv wall 20 may both obtain the video stream to be displayed and the identification information of the video stream to be displayed provided by the video transmission device. The identification information of the video stream to be displayed is used for representing the source of the video stream to be displayed. By way of example, the video transmission device may be an image capturing apparatus (such as a video camera, etc.), a terminal apparatus having a video transmission function (such as a mobile phone, a tablet computer, a notebook computer, etc.), a digital video disc (digital video disc, DVD), a set-top box, a satellite receiver, etc., and the embodiment of the present application does not limit the specific form of the video transmission device.

In some embodiments, the server 10 may be any electronic device capable of performing the functions described above, including a desktop computer, a mobile computing device, a notebook (e.g., laptop) computer, a tablet computer, a set-top box, a telephone handset such as a so-called "smart" phone, a television, a camera, a display device, a digital media player, a video game console, an in-vehicle computer, or the like. The server 10 may be a single server or a cluster of servers, and the embodiment of the present application is not limited to the specific form of the server 10.

In some embodiments, the display unit in the tv wall 20 may be a liquid crystal display, an organic light-emitting diode (OLED) display, etc., and the specific type, size, resolution, etc. of the display unit are not limited.

In some embodiments, the display system may be applied in a scene where video streams are reviewed, such as a video stream exhibiting multiple views in a video wall, etc.

In the embodiment of the present application, one or more video transmission devices and/or the server 10 may be integrated in the display system 1, the server 10 and the tv wall 20 may be integrated in the display system 1, for example, the video transmission device may be integrated in one device with the server 10, the display screen 30 may be integrated in one device with the decoding end 22, or the server 10 may be integrated in the tv wall 20; alternatively, the server 10 and the tv wall 20 may be independent of the display system 1 as shown in fig. 2, which is not limited in the embodiment of the present application.

The server 10 may be an electronic device, and the hardware structure of the electronic device includes elements included in the computing device shown in fig. 4. The hardware configuration of the server 10 will be described below using the computing device shown in fig. 4 as an example.

As shown in fig. 4, the computing device may include a processor 301, a memory 302, a communication interface 303, a bus 304. The processor 301, the memory 302 and the communication interface 303 may be connected via a bus 304.

Processor 301 is the control center of the computing device and may be a single processor or a collective term for a plurality of processing elements. For example, the processor 301 may be a general-purpose central processing unit (central processing unit, CPU), or may be another general-purpose processor. Wherein the general purpose processor may be a microprocessor or any conventional processor or the like.

As one example, processor 301 may include one or more CPUs, such as CPU 0 and CPU 1 shown in fig. 4.

Memory 302 may be, but is not limited to, read-only memory (ROM) or other type of static storage device that can store static information and instructions, random access memory (random access memory, RAM) or other type of dynamic storage device that can store information and instructions, as well as electrically erasable programmable read-only memory (EEPROM), magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer.

In a possible implementation, the memory 302 may exist separately from the processor 301, and the memory 302 may be connected to the processor 301 through the bus 304 for storing instructions or program code. The processor 301, when calling and executing instructions or program code stored in the memory 302, is capable of implementing the model deployment method provided in the embodiments of the present application.

In another possible implementation, the memory 302 may also be integrated with the processor 301.

A communication interface 303 for connecting the computing device with other devices via a communication network, which may be ethernet, a radio access network (radio access network, RAN), a wireless local area network (wireless local area networks, WLAN), etc. The communication interface 303 may include a receiving unit for receiving data and a transmitting unit for transmitting data.

Bus 304 may be an industry standard architecture (industry standard architecture, ISA) bus, an external device interconnect (peripheral component interconnect, PCI) bus, or an extended industry standard architecture (extended industry standard architecture, EISA) bus, among others. The bus may be classified as an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown in fig. 4, but not only one bus or one type of bus.

It should be noted that the structure shown in fig. 4 is not limiting of the computing device, and the computing device may include more or less components than those shown in fig. 4, or may combine some components, or a different arrangement of components.

The implementation of the examples of the present application will be described in detail below with reference to the accompanying drawings.

As shown in fig. 5, an embodiment of the present application provides a display method, which includes the following steps:

s1, the television wall determines at least one target display unit, the distribution condition of the at least one target display unit and the distribution condition of the display window of the at least one target display unit.

Wherein one target display unit comprises at least one display window.

In one example, a controller of a television wall presents a plurality of display units of the television wall, receives a user selection of a display unit, and determines the display unit selected by the user as a target display unit. Alternatively, each display unit of the tv wall has corresponding identification information (for example, a number, an id number, a row and column position, etc.), the controller of the tv wall receives the identification information of the display unit input by the user, and determines the display unit corresponding to the identification information of the display unit input by the user as the target display unit.

In yet another example, the controller of the tv wall displays a distribution of display windows of a plurality of display units, one of which can be selected by the user, and determines the distribution of display windows selected by the user as the distribution of display windows of the target display unit. Or the controller of the television wall receives the dividing operation of the user on the target display unit, and determines the distribution condition of the display window of the target display unit based on the dividing operation of the user on the target display unit. For example, as shown in fig. 6, the distribution of the display windows of the target display unit may be 1 display window, two display windows distributed up and down, two display windows distributed left and right, three display windows distributed up and down, four display windows distributed 2×2, and the like.

It should be understood that the distribution of the display windows shown in the tv wall is only to logically divide the display unit in areas, and in fact, the display unit is still only one display window, and the display windows of the display unit are not actually divided. For example, a display unit is divided into two equal display windows, which are distributed left and right, and the display unit is actually a display screen and is not obtained by splicing the two display screens.

S2, the television wall generates first display information based on the distribution condition of at least one target display unit and the distribution condition of the display window of at least one target display unit.

In particular, the television wall may generate the first display information in a particular format.

For example, in the case where the number of target display units is one, and the distribution situation of the display windows of the target display units indicates that the target display units include 4 equal display windows, the format of the first display information sent by the tv wall may be { divNum:4}.

For another example, in a case where the number of target display units is plural and the display window of the target display unit is one, the format of the first display information transmitted by the tv wall may be { JointList: "output1", "output2", wherein output1 and output2 represent two different display elements, respectively.

It should be understood that the number of the target display units is plural, and the case that the display windows of the target display units are plural may be simplified to the case that one target display unit corresponds to plural display windows, or the case that plural target display units correspond to one video stream to be displayed, so if the number of the target display units is one, the distribution situation of the display windows may be mainly focused when the first display information is sent, for example { divNum:4, the server receives such first display information, the default number of target display units is one. If the number of target display units is plural, the distribution of the plural target display units may be mainly focused when the first display information is transmitted, for example { JointList: "output1", "output2", and the server receives such first display information, it is required to acquire a path of video stream by default and display the path of video stream in two target display units.

S3, the television wall sends the first display information to the server; correspondingly, the server receives the first display information.

For example, the tv wall and the server are both connected to the internet, and the tv wall may send the first display information to the server through a network connection.

S4, the server determines the target number based on the first display information.

The target number is used for representing the number of the video processing operation performed by the server.

For example, the first display information received by the server is { JointList: "output1", "output2", and "target number continur 1" are generated, which indicates that the number of the video processing operation performed later is continur 1, and the result obtained by the video processing operation corresponds to the continur 1.

S5, the server sends the target number to the television wall; correspondingly, the television wall receives the target number.

For example, if a communication connection is established between the tv wall and the server via a wired line, the server may send the target number to the server via the wired connection.

S6, the television wall establishes a corresponding relation between the target number and the target display unit, determines identification information of at least one video stream to be displayed and a display window corresponding to the video stream to be displayed, and generates second display information based on the corresponding relation between the target number and the target display unit, the identification information of the at least one video stream to be displayed and the display window corresponding to the video stream to be displayed.

Wherein one video stream to be displayed corresponds to one display window.

For example, if the target number sent by the server is continuer 1 and the target display units are output 1 and output2, the tv wall determines that continuer 1 corresponds to output 1 and output 2.

In one example, a user inputs identification information of at least one video stream to be displayed, and the video wall determines the identification information of the at least one video stream to be displayed. Or, the user selects the identification information of at least one video stream to be displayed from the identification information of the plurality of video streams to be displayed, and the television wall further determines the identification information of the at least one video stream to be displayed.

In yet another example, the user drags the video stream to be displayed into a display window, so that the video wall determines the display window corresponding to the video stream to be displayed. Or the user corresponds the identification information of the video stream to be displayed with the number of the display window, and the television wall further determines the display window corresponding to the video stream to be displayed.

In particular, the video wall may generate the second display information in a particular format.

For example, in a case where the number of the target display units is one, and the distribution of the display windows of the target display units indicates that the target display units include 4 equal display windows, if the 4 display windows are arranged in a 2×2 manner, the display window at the upper left corner corresponds to 0, the display window at the upper right corner corresponds to 1, the display window at the lower left corner corresponds to 2, and the display window at the lower right corner corresponds to 3. If only one path of video stream to be displayed is displayed in the display window at the lower left corner, the user determines that the identification information of the video stream to be displayed is the stream taking address of the video stream to be displayed, and the format of the second display information sent by the television wall may be { id: continuous 1; pos:2; url: "rtsp://10.168.1.1:8001/eurl/aabbcc" }, wherein id represents a target number, pos represents a display window corresponding to a video stream to be displayed, and url represents a stream fetching address of the video stream to be displayed. If there are two paths of video streams to be displayed, wherein one path of display window corresponding to the video stream to be displayed is the display window in the upper right corner, the other path of display window corresponding to the video stream to be displayed is the display window in the lower left corner, and the identification information of the video stream to be displayed is the stream taking address of the video stream to be displayed, the format of the second display information sent by the television wall may be { id: continuous 1; (pos: 1; url: "rtsp://10.168.0.2: 6093/eurl/aabbcc"); (pos: 2; url: "rtsp:// 10.168.1.1:8001/eurl/aabbcc") }.

For another example, when the distribution situation of the target display units represents that 2 target display units are distributed adjacently left and right, the display window of the target display unit is one, and the video stream to be displayed is one channel, if the identification information of the video stream to be displayed is the stream taking address of the video stream to be displayed, the format of the second display information sent by the television wall may be { id: continuous 1; jointList: "output1", "output2"; url: "rtsp://10.168.1.1:8001/eurl/aabbcc" }, wherein id represents the target number, jointList represents the distribution of target display units, and url represents the streaming address of the video stream to be displayed. If the distribution situation of the target display units indicates that 4 target display units are arranged in a 2×2 mode, one target display unit includes a display window, the 4 target display units display one path of video stream to be displayed, the identification information of the video stream to be displayed is the stream taking address of the path of video stream to be displayed, and the format of the second display information sent by the television wall can be { id: continuous 1; jointList: "output11", "output12", "output21", "output22"; url: "rtsp://10.168.1.1:8001/eurl/aabbcc" }, wherein output11 represents the target display element at the upper left corner, output12 represents the target display element at the upper right corner, output21 represents the target display element at the lower left corner, and output22 represents the target display element at the lower right corner.

S7, the television wall sends the second display information to the server; correspondingly, the server receives the second display information.

S8, the server acquires at least one video stream to be displayed based on the identification information of the at least one video stream to be displayed, and performs video processing operation on the at least one video stream to be displayed based on the distribution condition of at least one target display unit, the distribution condition of the display window of the at least one target display unit and the display window corresponding to the video stream to be displayed to obtain the target video stream corresponding to the target display unit.

Wherein one target display unit corresponds to one target video stream.

The identification information of the video stream to be displayed may be, for example, the number of the video stream to be displayed, the id number of the video stream to be displayed, the stream taking address of the video stream to be displayed, the id number of the acquisition device generating the video stream to be displayed, the connection interface between the acquisition device generating the video stream to be displayed and the server, the ip address of the acquisition device generating the video stream to be displayed, etc. For example, the identification information of the video stream to be displayed is the number of the video stream to be displayed, and the streaming address corresponding to the number of the video stream is pre-stored in the server, so that the server can find the streaming address of the video stream to be displayed based on the number of the video stream to be displayed, and acquire the video stream to be displayed from the streaming address of the video stream to be displayed. For another example, if the identification information of the video stream to be displayed is the id number of the acquisition device generating the video stream to be displayed, the server determines the video stream sent to the server by the acquisition device generating the video stream to be displayed as the video stream to be displayed based on the id number of the acquisition device generating the video stream to be displayed.

In some embodiments, where the number of target display units is one and the target display units include a plurality of display windows, the video processing operation is a stitching operation; the server performs video processing operation on at least one video stream to be displayed based on the distribution condition of at least one target display unit, the distribution condition of the display window of at least one target display unit, and the display window corresponding to the video stream to be displayed, so as to obtain a target video stream corresponding to the target display unit, which can be specifically implemented as follows: the server determines that the display picture of the display window which does not correspond to the video stream to be displayed in the display window of the target display unit is a preset picture based on the display window which corresponds to the video stream to be displayed, and determines that the display picture of the display window which corresponds to the video stream to be displayed is the video picture of the video stream to be displayed; the server performs splicing operation on the video frames of the video stream to be displayed and the preset frames based on the distribution condition of at least one target display unit, the distribution condition of the display window of at least one target display unit, the display frames of the display window which does not correspond to the video stream to be displayed and the display frames of the display window which corresponds to the video stream to be displayed, so as to obtain the target video stream which corresponds to the target display unit.

As shown in fig. 7, for an example, only one path of video stream to be displayed is provided, the display windows of the target display units are arranged according to a 2×2 manner, the display window corresponding to the path of video stream to be displayed is the display window of the lower left corner of the target display unit, the display windows of the upper left corner, the upper right corner and the lower right corner of the target display unit are filled with preset pictures containing words without video signals, the server splices the video pictures of the video stream to be displayed and the preset pictures to obtain one path of target video stream, and then the server sends the target video stream to the target display unit output1.

As another example, as shown in fig. 8, there are two paths of video streams to be displayed, the display windows of the target display unit are arranged in a left-to-right 2 manner, one path of video stream to be displayed corresponds to the display window on the left side, the other path of video stream to be displayed corresponds to the display window on the upper right corner, then the display window on the lower right corner of the target display unit is filled with a preset picture containing a word without video signal, the server splices the video pictures of the two paths of video streams to be displayed and the preset picture to obtain one path of target video stream, and then the server sends the target video stream to the target display unit output1.

In this way, aiming at the situation that one display unit comprises a plurality of display windows, the server performs splicing operation on the display pictures corresponding to each display window, and the multi-channel video stream can be displayed in one display unit without changing the unified access protocol or the television wall.

In some embodiments, when the number of the target display units is plural, the display areas corresponding to the plural target display units are spliced into rectangular areas, the number of the display windows of each target display unit is one, and the number of the video streams to be displayed is one, the video processing operation is a dividing operation; the server performs video processing operation on at least one video stream to be displayed based on the distribution condition of at least one target display unit, the distribution condition of the display window of at least one target display unit, and the display window corresponding to the video stream to be displayed, so as to obtain a target video stream corresponding to the target display unit, which can be specifically implemented as follows: the server performs a segmentation operation on a video picture of the video stream to be displayed based on the distribution condition of at least one target display unit, the distribution condition of a display window of at least one target display unit and a display window corresponding to the video stream to be displayed, so as to obtain a plurality of target video streams corresponding to the target display units one by one.

As an example, as shown in fig. 9, there are two target display units arranged left and right, and the server divides the video stream to be displayed from the middle according to the size ratio of the two target display units, and sends the two divided video streams to the target display unit output1 and the target display unit output2 according to the left and right order.

As another example, as shown in fig. 10, four target display units are arranged in a 2×2 manner, and the server divides the video stream to be displayed into four video streams matching the sizes of the four target display units according to the size ratio of the four target display units, and sends the divided four video streams to the target display unit output1, the target display unit output2, the target display unit output3 and the target display unit output4 according to the distribution situation of the four video streams from top to bottom and from left to right.

In this way, for the situation that one path of video stream is displayed across the display units, the server performs the segmentation operation on the video frames of the video stream to be displayed, and the video stream can be displayed across the display units without changing the unified access protocol or the television wall.

In some embodiments, in the process of performing a splicing operation on a video stream to be displayed, the server performs scaling processing on a video picture of the video stream to be displayed based on a size of a display window represented by a distribution condition of a display window of a target display unit and a size of a video picture of the video stream to be displayed, and finally the size of the display picture of the spliced target video stream is the same as the size of the target display unit, so that the television wall is not required to perform scaling processing on the display picture of the target video stream, and the processing workload of the television wall is reduced.

In some embodiments, in the process of performing the splitting operation on the video stream to be displayed, the server performs scaling processing on the video frame of the video stream to be displayed after performing the splitting operation on the video stream to be displayed based on the size of the target display unit represented by the distribution condition of the target display unit and the size of the video frame of the video stream to be displayed, and the size of the finally obtained display frame of the target video stream is the same as the size of the target display unit, so that the television wall is not required to perform scaling processing on the display frame of the target video stream, and the processing workload of the television wall is reduced.

In some embodiments, when the video stream to be displayed is a video stream corresponding to a real-time picture in a display screen of the terminal, the server receives a display video stream sent by the terminal, where the display video stream is a video stream obtained by capturing the display picture in the display screen of the terminal in real time.

For example, application software for capturing a video stream of a display screen of the terminal may be installed in the terminal, the application software obtains the display video stream in real time, the terminal sends the display video stream to the server, and the server performs a video processing operation on the display video stream.

In this way, the terminal captures the video stream of the display screen of the terminal in real time, and the server can further process the video stream of the display screen of the terminal as other video streams to be displayed, so as to realize the situation that the display screen of the terminal is put into the target display unit of the television wall.

S9, the server sends the target video stream to a target display unit corresponding to the target video stream in the television wall; accordingly, each target display unit in the television wall receives a target video stream corresponding to the target display unit.

In some embodiments, the server sends the target video stream to a target display unit corresponding to the target video stream in the tv wall, which may be specifically implemented as: for each target video stream, the server encodes the target video stream by a target protocol to obtain a target code stream; and the server sends the target code stream to a target display unit corresponding to the target video stream in the television wall.

The target protocol may be, for example, the GB28281 protocol described above.

In this way, the target video stream is encoded by the target protocol, various types of television walls can decode the target code stream based on the target protocol, the access protocol in the video transmission process is unified, and the concentrated retrieval of multiple video streams is convenient.

And S10, the television wall displays the target video stream corresponding to the target display unit in each target display unit.

The decoder in the television wall decodes the received target code stream to obtain a target video stream, and then the target display unit can display the target video stream.

In some embodiments, if the size of the target video stream is different from the size of the target display unit, the video wall performs a scaling operation on the target video stream, so that the size of the scaled target video stream is the same as the size of the target display unit, and then the target display unit of the video wall displays the scaled target video stream.

Based on the above description, in the embodiment of the present application, the process of performing the splitting operation or the splicing operation on the video stream to be displayed by the server should be located in the process of 12-14 in fig. 1, the process of displaying the display screen in the desktop of the terminal in the display unit of the television wall should be located in the process of 1-6 in fig. 1, and if the process of displaying the display screen in the desktop of the terminal in the display unit of the television wall involves displaying the display screen across the display unit or displaying the display screen in the desktop of a plurality of terminals in one display unit, the process of displaying the display screen in the desktop of the terminal in the display unit of the television wall also involves the process of 12-14 in fig. 1.

The technical solution shown in fig. 5 brings at least the following advantages: the server receives the first display information sent by the television wall, and because the first display information comprises the distribution condition of the target display units and the distribution condition of the display windows in the target display units, the server can determine whether one path of video stream is displayed in a plurality of display units or one display unit is displayed in a plurality of video streams, and then the server determines a target number and sends the target number to the television wall, wherein the target number is used for representing the number of the server for video processing operation. The television wall establishes a corresponding relation between the target number and the target display unit, and sends the corresponding relation between the target number and the target display unit, the identification information of at least one video stream to be displayed and the display window corresponding to the video stream to be displayed to the server, so that the server can acquire the video stream to be displayed, and based on the distribution condition of at least one target display unit, the distribution condition of the display window of at least one target display unit and the display window corresponding to the video stream to be displayed, video processing operation is carried out on the video stream to be displayed, and the target video stream corresponding to the target display unit is obtained. For the television wall, the structure of the television wall is not changed, and the access protocol is not changed, when one target display unit comprises a plurality of display windows, the target video stream displayed in the target display unit of the television wall is one video stream obtained based on a plurality of video streams to be displayed, and the situation that one display unit displays a plurality of video streams is realized. Or when one target display unit comprises one display window and a plurality of target display units need to display one video stream to be displayed, the target video stream displayed in the target display unit of the television wall is one video stream in a plurality of paths of video streams obtained based on one video stream to be displayed, and the situation that one video stream is displayed across the plurality of display units is realized.

The foregoing description of the solution provided in the embodiments of the present application has been mainly presented in terms of a method. To achieve the above functions, it includes corresponding hardware structures and/or software modules that perform the respective functions. Those of skill in the art will readily appreciate that the elements and algorithm steps of the various examples described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is implemented as hardware or computer software driven hardware depends upon the particular application and design constraints imposed on the solution. The technical aim may be to use different methods to implement the described functions for each particular application, but such implementation should not be considered beyond the scope of the present application.

As shown in fig. 11, the embodiment of the present application further provides a display device, which is used for the display method shown in the above method embodiment. The display device 400 includes: a transmission module 401 and a processing module 402.

The transmission module 401 is configured to receive first display information sent by the tv wall, where the first display information is used to indicate a distribution condition of at least one target display unit in the tv wall and a distribution condition of display windows of at least one target display unit, and one target display unit includes at least one display window; a processing module 402, configured to determine a target number based on the first display information; the transmission module 401 is further configured to send a target number to the tv wall, so that the tv wall establishes a correspondence between the target number and the target display unit, where the target number is used for characterizing a number of the server for performing video processing operation; the transmission module 401 is further configured to receive second display information sent by the tv wall, where the second display information includes a correspondence between a target number and a target display unit, identification information of at least one video stream to be displayed, and a display window corresponding to the video stream to be displayed, and one video stream to be displayed corresponds to one display window; the transmission module 401 is further configured to obtain at least one video stream to be displayed based on identification information of the at least one video stream to be displayed; the processing module 402 is further configured to perform video processing operation on at least one video stream to be displayed based on a distribution situation of at least one target display unit, a distribution situation of a display window of the at least one target display unit, and a display window corresponding to the video stream to be displayed, so as to obtain a target video stream corresponding to the target display unit, where one target display unit corresponds to one target video stream; the transmission module 401 is further configured to send the target video stream to a target display unit in the tv wall corresponding to the target video stream, so that the target display unit of the tv wall displays the target video stream.

In one possible implementation, in the case where the number of target display units is one and the target display units include a plurality of display windows, the video processing operation is a stitching operation; the processing module 402 is specifically configured to: determining that a display picture of a display window which does not correspond to the video stream to be displayed in the display window of the target display unit is a preset picture based on the display window which corresponds to the video stream to be displayed, and determining that the display picture of the display window which corresponds to the video stream to be displayed is a video picture of the video stream to be displayed; and based on the distribution condition of at least one target display unit, the distribution condition of the display window of at least one target display unit, the display picture of the display window which does not correspond to the video stream to be displayed, and the display picture of the display window which corresponds to the video stream to be displayed, performing splicing operation on the video picture of the video stream to be displayed and the preset picture to obtain the target video stream which corresponds to the target display unit.

In another possible implementation manner, when the number of the target display units is multiple, the display areas corresponding to the multiple target display units are spliced into rectangular areas, the number of the display windows of each target display unit is one, and the number of the video streams to be displayed is one, the video processing operation is a splitting operation; the processing module 402 is specifically configured to perform a segmentation operation on a video frame of a video stream to be displayed based on a distribution situation of at least one target display unit, a distribution situation of a display window of at least one target display unit, and a display window corresponding to the video stream to be displayed, so as to obtain a plurality of target video streams corresponding to the plurality of target display units one by one.

In another possible implementation manner, the transmission module 401 is further configured to receive a display video stream sent by the terminal, where the display video stream is a video stream obtained by capturing, by the terminal, a display picture in a display screen of the terminal in real time.

In another possible implementation manner, the processing module 402 is further configured to, for each target video stream, encode the target video stream with a target protocol to obtain a target code stream; the transmission module 401 is specifically configured to send the target code stream to a target display unit corresponding to the target video stream in the video wall.

As shown in fig. 12, the embodiment of the present application further provides a display device, which is used for the display method shown in the above method embodiment. The display device 500 includes: a processing module 501, a transmission module 502 and a display module 503.

Wherein, the processing module 501 is configured to determine at least one target display unit, a distribution situation of the at least one target display unit, and a distribution situation of display windows of the at least one target display unit, where one target display unit includes at least one display window; the processing module 501 is further configured to generate first display information based on a distribution of at least one target display unit and a distribution of a display window of at least one target display unit; a transmission module 502, configured to send the first display information to a server; the transmission module 502 is further configured to receive a target number returned by the server; the processing module 501 is further configured to establish a correspondence between a target number and a target display unit, where the target number is used to characterize a number of the server for performing a video processing operation; the processing module 501 is further configured to determine identification information of at least one video stream to be displayed and a display window corresponding to the video stream to be displayed, where one video stream to be displayed corresponds to one display window; the processing module 501 is further configured to generate second display information based on a correspondence between the target number and the target display unit, identification information of at least one video stream to be displayed, and a display window corresponding to the video stream to be displayed; the transmission module 502 is further configured to send the second display information to the server; the transmission module 502 is further configured to receive a target video stream corresponding to each target display unit returned by the server, where the target video stream is obtained by the server based on identification information of at least one video stream to be displayed, and based on a distribution condition of at least one target display unit, a distribution condition of a display window of at least one target display unit, and a display window corresponding to the video stream to be displayed, performing video processing operation on the at least one video stream to be displayed, where one target video stream corresponds to one target display unit; and a display module 503, configured to display, in each target display unit, a target video stream corresponding to the target display unit.

In another possible implementation manner, when the number of the target display units is multiple, the display areas corresponding to the multiple target display units are spliced into rectangular areas, the number of the display windows of each target display unit is one, and the number of the video streams to be displayed is one, the video processing operation is a splitting operation, and the target video streams are obtained by the server by performing the splitting operation on the video frames of the video streams to be displayed based on the distribution condition of at least one target display unit, the distribution condition of the display windows of at least one target display unit, and the display windows corresponding to the video streams to be displayed.

It should be noted that the division of the modules in fig. 11 and fig. 12 is schematic, only one logic function is divided, and another division manner may be implemented in actual implementation. For example, two or more functions may also be integrated in one processing module. The integrated modules may be implemented in hardware or in software functional modules.

Another embodiment of the present application also provides an electronic device, including a memory and a processor; the memory is coupled to the processor; the memory is used to store computer program code, which includes computer instructions. When the processor executes the computer instructions, the electronic device is caused to execute each step executed by the server or the television wall in the method flow shown in the method embodiment.

In actual implementation, the transmission module 401 and the processing module 402, as well as the processing module 501, the transmission module 502 and the display module 503, may be implemented by a processor of the electronic device invoking computer program code in a memory. For specific implementation, reference may be made to the description of the above display method section, and details are not repeated here.

Another embodiment of the present application further provides a computer readable storage medium, where computer instructions are stored, where the computer instructions, when executed on a computer, cause the computer to perform the steps performed by a server or a tv wall in a method flow shown in the foregoing method embodiment.

In another embodiment of the present application, there is also provided a computer program product including computer instructions which, when executed on a computer, cause the computer to perform the steps performed by a server or a tv wall in the method flow shown in the method embodiment described above.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using a software program, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer-executable instructions are loaded and executed on a computer, the processes or functions in accordance with embodiments of the present application are fully or partially produced. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another, for example, a website, computer, server, or data center via a wired (e.g., coaxial cable, fiber optic, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. Computer readable storage media can be any available media that can be accessed by a computer or data storage devices including one or more servers, data centers, etc. that can be integrated with the media. Usable media may be magnetic media (e.g., floppy disks, hard disks, magnetic tape), optical media (e.g., DVD), etc.

The foregoing is merely a specific embodiment of the present application. Variations and alternatives will occur to those skilled in the art from the detailed description provided herein and are intended to be included within the scope of the present application.

Claims

1. A display method, comprising: the method is applied to a server; the method comprises the following steps:

receiving first display information sent by a television wall, wherein the first display information is used for indicating the distribution condition of at least one target display unit in the television wall and the distribution condition of display windows of the at least one target display unit, and one target display unit comprises at least one display window;

determining a target number based on the first display information, and sending the target number to the television wall so that the television wall establishes a corresponding relation between the target number and the target display unit, wherein the target number is used for representing the number of the server for video processing operation;

receiving second display information sent by the television wall, wherein the second display information comprises a corresponding relation between the target number and the target display unit, identification information of at least one video stream to be displayed and a display window corresponding to the video stream to be displayed, and one display window corresponding to the video stream to be displayed;

Acquiring at least one video stream to be displayed based on the identification information of the at least one video stream to be displayed, and performing the video processing operation on the at least one video stream to be displayed based on the distribution condition of the at least one target display unit, the distribution condition of the display window of the at least one target display unit and the display window corresponding to the video stream to be displayed to obtain a target video stream corresponding to the target display unit, wherein one target display unit corresponds to one target video stream;

and sending the target video stream to the target display unit corresponding to the target video stream in the television wall, so that the target display unit of the television wall displays the target video stream.

2. The method according to claim 1, wherein in the case where the number of the target display units is one and the target display units include a plurality of display windows, the video processing operation is a splicing operation;

the performing the video processing operation on the at least one video stream to be displayed based on the distribution condition of the at least one target display unit, the distribution condition of the display window of the at least one target display unit, and the display window corresponding to the video stream to be displayed, to obtain a target video stream corresponding to the target display unit, includes:

Determining that a display picture of a display window which does not correspond to the video stream to be displayed in the display window of the target display unit is a preset picture based on the display window which corresponds to the video stream to be displayed, and determining that the display picture of the display window which corresponds to the video stream to be displayed is a video picture of the video stream to be displayed;

and performing the splicing operation on the video picture of the video stream to be displayed and the preset picture based on the distribution condition of the at least one target display unit, the distribution condition of the display window of the at least one target display unit, the display picture of the display window which does not correspond to the video stream to be displayed and the display picture of the display window which corresponds to the video stream to be displayed, so as to obtain the target video stream which corresponds to the target display unit.

3. The method according to claim 1, wherein in a case where the number of the target display units is plural, the display areas corresponding to the respective plural target display units are spliced into rectangular areas, the number of the display windows of each of the target display units is one, and the number of the video streams to be displayed is one, the video processing operation is a dividing operation;

and carrying out the segmentation operation on the video picture of the video stream to be displayed based on the distribution condition of the at least one target display unit, the distribution condition of the display window of the at least one target display unit and the display window corresponding to the video stream to be displayed, so as to obtain a plurality of target video streams which are in one-to-one correspondence with a plurality of target display units.

4. A method according to any of claims 1-3, wherein when the video stream to be displayed is a video stream corresponding to a real-time picture in a display screen of a terminal, the method further comprises:

and receiving a display video stream sent by the terminal, wherein the display video stream is obtained by capturing a display picture in a display screen of the terminal in real time by the terminal.

5. A method according to any one of claims 1-3, wherein said transmitting said target video stream to said target display unit in said video wall corresponding to said target video stream comprises:

For each target video stream, encoding the target video stream by a target protocol to obtain a target code stream;

and sending the target code stream to the target display unit corresponding to the target video stream in the television wall.

6. A display method, characterized in that it is applied to a television wall; the method comprises the following steps:

determining at least one target display unit, a distribution situation of the at least one target display unit and a distribution situation of display windows of the at least one target display unit, wherein one target display unit comprises at least one display window;

generating first display information based on the distribution condition of the at least one target display unit and the distribution condition of the display window of the at least one target display unit, and sending the first display information to a server;

receiving a target number returned by the server, and establishing a corresponding relation between the target number and the target display unit, wherein the target number is used for representing the number of the video processing operation performed by the server;

Generating second display information based on the corresponding relation between the target number and the target display unit, identification information of at least one video stream to be displayed and a display window corresponding to the video stream to be displayed, and sending the second display information to the server;

receiving target video streams corresponding to the target display units returned by the server, wherein the target video streams are obtained by the server based on identification information of the at least one video stream to be displayed, and are obtained by performing the video processing operation on the at least one video stream to be displayed based on the distribution condition of the at least one target display unit, the distribution condition of display windows of the at least one target display unit and the display windows corresponding to the video stream to be displayed, and one target video stream corresponds to one target display unit;

7. The method according to claim 6, wherein in a case where the number of the target display units is one and the target display units include a plurality of display windows, the video processing operation is a splicing operation, a display screen of a display window that does not correspond to the video stream to be displayed among the display windows of the target display units is a preset screen, the display screen of the display window that corresponds to the video stream to be displayed is a video screen of the video stream to be displayed, and the target video stream is obtained by the server performing the splicing operation on the video screen of the video stream to be displayed and the preset screen based on a distribution situation of the at least one target display unit, a distribution situation of the display window of the at least one target display unit, a display screen of a display window that does not correspond to the video stream to be displayed, and a display screen of a display window that corresponds to the video stream to be displayed.

8. The method according to claim 6, wherein in a case where the number of the target display units is plural, the display areas corresponding to the respective plural target display units are spliced into rectangular areas, the number of the display windows of each of the target display units is one, and the number of the video streams to be displayed is one, the video processing operation is a dividing operation, and the target video streams are obtained by the server performing the dividing operation on the video frames of the video streams to be displayed based on the distribution situation of the at least one target display unit, the distribution situation of the display windows of the at least one target display unit, and the display windows corresponding to the video streams to be displayed.

9. A display device, comprising:

the television comprises a transmission module, a display module and a display module, wherein the transmission module is used for receiving first display information sent by a television wall, the first display information is used for indicating the distribution condition of at least one target display unit in the television wall and the distribution condition of display windows of the at least one target display unit, and one target display unit comprises at least one display window;

The transmission module is further configured to send the target number to the tv wall, so that the tv wall establishes a correspondence between the target number and the target display unit, where the target number is used to characterize a number of the server for performing video processing operation;

the transmission module is further configured to receive second display information sent by the video wall, where the second display information includes a correspondence between the target number and the target display unit, identification information of at least one video stream to be displayed, and a display window corresponding to the video stream to be displayed, and one display window corresponding to the video stream to be displayed;

the transmission module is further configured to obtain the at least one video stream to be displayed based on the identification information of the at least one video stream to be displayed;

the processing module is further configured to perform the video processing operation on the at least one video stream to be displayed based on a distribution situation of the at least one target display unit, a distribution situation of a display window of the at least one target display unit, and a display window corresponding to the video stream to be displayed, so as to obtain a target video stream corresponding to the target display unit, where one target display unit corresponds to one target video stream;

The transmission module is further configured to send the target video stream to the target display unit corresponding to the target video stream in the tv wall, so that the target display unit of the tv wall displays the target video stream.

10. A display device, comprising:

the processing module is further configured to generate first display information based on a distribution situation of the at least one target display unit and a distribution situation of a display window of the at least one target display unit;

the transmission module is used for transmitting the first display information to a server;

the processing module is further used for establishing a corresponding relation between the target number and the target display unit, wherein the target number is used for representing the number of the server for video processing operation;

The processing module is further used for determining identification information of at least one video stream to be displayed and a display window corresponding to the video stream to be displayed, and one display window corresponding to the video stream to be displayed;

the processing module is further configured to generate second display information based on a correspondence between the target number and the target display unit, identification information of at least one video stream to be displayed, and a display window corresponding to the video stream to be displayed;

the transmission module is further used for sending the second display information to the server;

the transmission module is further configured to receive a target video stream corresponding to each target display unit returned by the server, where the target video stream is obtained by the server based on identification information of the at least one video stream to be displayed, and based on a distribution condition of the at least one target display unit, a distribution condition of a display window of the at least one target display unit, and a display window corresponding to the video stream to be displayed, performing the video processing operation on the at least one video stream to be displayed, where one target video stream corresponds to one target display unit;

11. An electronic device, comprising:

one or more processors;

one or more memories;

wherein the one or more memories are configured to store computer program code comprising computer instructions that, when executed by the one or more processors, cause the electronic device to perform the display method of any of claims 1-5 or the display method of any of claims 6-8.

12. A computer readable storage medium storing computer executable instructions which, when run on a computer, cause the computer to perform the display method of any one of claims 1 to 5 or perform the display method of any one of claims 6 to 8.

13. A computer program product comprising computer instructions which, when run on a computer, cause the computer to perform the display method of any one of claims 1 to 5 or to perform the display method of any one of claims 6 to 8.