CN109218656B

CN109218656B - Image display method, device and system

Info

Publication number: CN109218656B
Application number: CN201710521669.9A
Authority: CN
Inventors: 吴尚杰; 宋义; 陈王贤; 周建
Original assignee: Hangzhou Hikvision Digital Technology Co Ltd
Current assignee: Hangzhou Hikvision Digital Technology Co Ltd
Priority date: 2017-06-30
Filing date: 2017-06-30
Publication date: 2021-03-26
Anticipated expiration: 2037-06-30
Also published as: CN109218656A

Abstract

The invention discloses an image display method, device and system, and belongs to the technical field of image processing. The method comprises the following steps: and receiving a close-up display instruction issued by the terminal, acquiring a close-up code stream corresponding to the close-up area from the video code stream of the panoramic image according to the position information of the close-up area in the panoramic image, and outputting the close-up code stream to a corresponding display unit. In the process of displaying the close-up image, the decoding equipment can directly process the acquired video code stream of the panoramic image without acquiring the close-up code stream from the camera, so that the occupation of excessive network resources can be avoided.

Description

Image display method, device and system

Technical Field

The present invention relates to the field of image processing technologies, and in particular, to an image display method, apparatus, and system.

Background

Referring to fig. 1, a video surveillance system commonly used at present generally includes at least one camera 01, a terminal 02, a decoding device 03, and a television wall 04, and the television wall 04 is formed by splicing a plurality of display units. Each camera 01 is used for collecting a video code stream and transmitting the collected video code stream to the decoding device 03 through a communication network; the decoding device 03 is configured to decode each video code stream and output the decoded video code stream to a corresponding display unit in the television wall 04 for display, and the television wall 04 may simultaneously display monitoring images acquired by a plurality of cameras. The terminal 02 is configured to perform overall control on the decoding device 03, for example, may issue an identifier of the camera 01 to the decoding device 03, so that the decoding device 03 establishes a connection with the camera 01 according to the identifier, and obtains a video code stream acquired by the decoding device.

In the related technology, when a user needs to enlarge and display a part of area in a certain monitored image, a close-up area can be selected in the monitored image through the terminal 02, after the terminal 02 determines the position information of the close-up area, the position information can be sent to a corresponding camera, the camera can cut the collected video code stream according to the received position information, and a close-up code stream is generated independently. After that, the terminal 02 may send the identification of the camera and the related information of the close-up code stream to the decoding device 03, and after the decoding device 03 connects the camera and acquires the close-up code stream, the close-up code stream may be decoded, and the decoded close-up image data may be output to a preset display unit in the television wall 04 for display.

However, in the method in the related art, when the image of the close-up area is displayed, the decoding device needs to acquire the close-up code stream from the camera again, which occupies more network resources.

Disclosure of Invention

The invention provides an image display method, device and system, and aims to solve the problem that a close-up area image occupies more network resources when being displayed by a method in the related art. The technical scheme is as follows:

in a first aspect, an image display method is provided, which is applied to a decoding device, and includes:

receiving close-up display instructions, wherein the close-up display instructions carry identification of the panoramic image and position information of the close-up area in the panoramic image;

according to the position information, acquiring a close-up code stream corresponding to the close-up area from a video code stream of the panoramic image;

and outputting the close-up code stream to a corresponding display unit in the television wall for display.

Optionally, before the receiving the close-up display instruction, the method further comprises:

receiving window configuration instructions for a target camera, wherein the window configuration instructions comprise position information of a panoramic window on the television wall, the number of feature windows associated with the panoramic window, and position information of each feature window on the television wall, and the target camera is a camera for collecting a video code stream of the panoramic image;

determining at least one display unit corresponding to the panoramic window according to the position information of the panoramic window on the television wall and the position information of each display unit on the television wall;

determining at least one display unit corresponding to each feature window according to the position information of each feature window on the television wall and the position information of each display unit on the television wall;

wherein the panoramic window is used for displaying the panoramic image, and each close-up window is used for displaying a close-up image of one close-up area.

Optionally, the close-up display instruction further includes an identifier of a target close-up window for displaying the close-up area, and the outputting the close-up code stream to a corresponding display unit in a television wall for displaying includes:

determining at least one target display unit corresponding to a target close-up window for displaying the close-up area according to the corresponding relation between the close-up window and the display units;

determining blocking information of the target close-up window according to a relative positional relationship between the target close-up window and each target display unit, the blocking information including: an identification of a window-block in the target close-up window corresponding to each target display unit, and location information of each window-block on the corresponding target display unit;

according to the blocking information of the target close-up window, segmenting the close-up code stream to obtain a path of segmented code stream corresponding to each target display unit;

and respectively outputting each path of the divided code stream to a corresponding target display unit for display.

Optionally, the decoding device is provided with a display chip for each display unit, and after determining the blocking information of the target close-up window, the method further comprises:

calculating an initial video memory address of each path of the segmented code stream when the segmented code stream is stored in a display chip of the corresponding target display unit according to the position information of each window block on the corresponding target display unit;

the respectively outputting each path of the divided code streams to the corresponding target display unit for displaying comprises:

and storing each path of the divided code stream in a video memory area behind the initial video memory address in the display chip of the corresponding target display unit according to the initial video memory address of each path of the divided code stream obtained by calculation.

Optionally, after calculating an initial video memory address of each divided code stream when the divided code stream is stored in a display chip of the corresponding target display unit, the method further includes:

recording a block information set of each close-up window, wherein the block information set comprises blocking information and video memory information, and the video memory information comprises an initial video memory address of a segmentation code stream corresponding to each window block;

and when detecting that the block information set of any close-up window is updated, sending an updating instruction to each display chip, wherein the updating instruction is used for instructing each display chip to acquire the updated block information set.

Optionally, before outputting each divided code stream to the corresponding target display unit for display, the method further includes:

and adjusting the resolution of each path of the divided code stream to ensure that the resolution of each path of the divided code stream is equal to the display resolution of the corresponding target display unit.

Optionally, before receiving a window configuration instruction for the target camera, the method further includes:

receiving a display instruction aiming at the target camera, wherein the display instruction comprises position information of a single-screen window for independently displaying the panoramic image on the television wall;

acquiring a video code stream of the panoramic image acquired by the target camera according to the display instruction;

outputting the video code stream of the panoramic image to at least one display unit corresponding to the single-screen window for displaying;

after the receiving window configuration instructions for a target camera, the method further comprises:

outputting the video code stream of the panoramic image to at least one display unit corresponding to the panoramic window for displaying;

wherein the corresponding at least one display unit of the single-screen window comprises at least one display unit corresponding to the panoramic window.

Optionally, at least one panoramic image is displayed in the television wall, and the method further includes:

when a moving instruction aiming at a target panoramic image is received, pausing outputting a video code stream to an original panoramic display unit corresponding to a panoramic window for displaying the target panoramic image, and pausing outputting a feature code stream to an original feature display unit corresponding to each feature window associated with the panoramic window;

determining at least one new panoramic display unit corresponding to the panoramic window and at least one new close-up display unit corresponding to each close-up window associated with the panoramic window according to the target position to which the target panoramic image needs to be moved;

outputting the video code stream of the target panoramic image to the at least one new panoramic display unit;

and outputting the close-up code stream of each close-up area to the corresponding at least one new close-up display unit.

Optionally, when a movement instruction for the target panoramic image is received, the method further includes:

clearing the video code stream of the panoramic image stored in a display chip of the original panoramic display unit;

and emptying the feature code stream stored in the display chip of the original feature display unit.

In a second aspect, an image display apparatus is provided, which is applied to a decoding device, and comprises:

the receiving module is used for receiving a close-up display instruction, wherein the close-up display instruction carries an identification of the panoramic image and position information of the close-up area in the panoramic image;

the first acquisition module is used for acquiring a close-up code stream corresponding to the close-up area from a video code stream of the panoramic image according to the position information;

and the first output module is used for outputting the close-up code stream to a corresponding display unit in the television wall for display.

Optionally, the receiving module is further configured to receive, before receiving the close-up display instruction, a window configuration instruction for a target camera, where the window configuration instruction includes location information of a panoramic window on the television wall, the number of close-up windows associated with the panoramic window, and location information of each close-up window on the television wall, and the target camera is a camera that collects a video stream of the panoramic image;

the device further comprises: a first determination module to:

Optionally, the close-up display instructions further comprise an identification of a target close-up window for displaying the close-up area, the first output module comprising:

a first determination unit, which is used for determining at least one target display unit corresponding to the target close-up window used for displaying the close-up area according to the corresponding relation between the close-up window and the display unit;

a second determining unit for determining the piece information of the target close-up window according to the relative positional relationship between the target close-up window and each target display unit, the piece information including: an identification of a window-block in the target close-up window corresponding to each target display unit, and location information of each window-block on the corresponding target display unit;

the segmentation unit is used for segmenting the close-up code stream according to the blocking information of the target close-up window to obtain a path of segmented code stream corresponding to each target display unit;

and the output unit is used for respectively outputting each path of the divided code streams to the corresponding target display unit for display.

Optionally, a display chip is configured for each display unit in the decoding apparatus, and the first output module further includes:

the computing unit is used for computing an initial video memory address of each path of the segmented code stream when the segmented code stream is stored in a display chip of the corresponding target display unit according to the position information of each window block on the corresponding target display unit after the block information of the target close-up window is determined;

the output unit is used for:

Optionally, the first output module further includes:

the recording unit is used for recording a block information set of each close-up window after calculating an initial video memory address of each path of the segmented code stream when the segmented code stream is stored in a display chip of the corresponding target display unit, wherein the block information set comprises the segmentation information and the video memory information, and the video memory information comprises the initial video memory address of the segmented code stream corresponding to each window block;

and the updating unit is used for sending an updating instruction to each display chip when the block information set of any close-up window is detected to be updated, and the updating instruction is used for instructing each display chip to acquire the updated block information set.

Optionally, the first output module further includes:

and the adjusting unit is used for adjusting the resolution of each path of the divided code stream before outputting the divided code stream to the corresponding target display unit for display, so that the resolution of each path of the divided code stream is equal to the display resolution of the corresponding target display unit.

Optionally, the receiving module is further configured to receive a display instruction for a target camera before receiving a window configuration instruction for the target camera, where the display instruction includes location information of a single-screen window on the television wall, where the single-screen window is used to separately display the panoramic image;

the device further comprises:

the second acquisition module is used for acquiring a video code stream of the panoramic image acquired by the target camera according to the display instruction;

the second output module is used for outputting the video code stream of the panoramic image to at least one display unit corresponding to the single-screen window for display;

a third output module, configured to output, after the receiving a window configuration instruction for a target camera, a video code stream of the panoramic image to at least one display unit corresponding to the panoramic window for display;

Optionally, at least one panoramic image is displayed in the television wall, and the apparatus further includes:

a pause module, configured to, when a movement instruction for a target panoramic image is received, pause outputting a video code stream to an original panoramic display unit corresponding to a panoramic window for displaying the target panoramic image, and pause outputting a close-up code stream to an original close-up display unit corresponding to each close-up window associated with the panoramic window;

a second determining module, configured to determine, according to a target position to which the target panoramic image needs to be moved, at least one new panoramic display unit corresponding to the panoramic window and at least one new close-up display unit corresponding to each close-up window associated with the panoramic window;

a fourth output module, configured to output the video stream of the target panoramic image to the at least one new panoramic display unit; and outputting the close-up code stream of each close-up area to the corresponding at least one new close-up display unit.

Optionally, the apparatus further comprises:

the clearing module is used for clearing a video code stream of the panoramic image stored in a display chip of the original panoramic display unit when a moving instruction aiming at a target panoramic image is received; and emptying the feature code stream stored in the display chip of the original feature display unit.

In a third aspect, a computer device is provided, which includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete communication with each other through the bus; a memory for storing a computer program; and a processor for executing the program stored in the memory to implement the image display method of the first aspect.

In a fourth aspect, there is provided an image display system, the system comprising: at least one camera, a terminal, a decoding device and a television wall; the decoding device comprises an image display apparatus as described in the second aspect.

The technical scheme provided by the invention has the beneficial effects that:

the invention provides an image display method, a device and a system.A decoding device can directly acquire a close-up code stream corresponding to a close-up area from a video code stream of a panoramic image according to the position information of the close-up area in the panoramic image after receiving a close-up display instruction issued by a terminal, and output the close-up code stream to a corresponding display unit. In the process of displaying the close-up image, the decoding equipment can directly process the acquired video code stream of the panoramic image without acquiring the close-up code stream from the camera, so that the occupation of excessive network resources can be avoided.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is an architecture diagram of a video surveillance system in the related art;

FIG. 2 is an architecture diagram of an image display system according to an embodiment of the present invention;

FIG. 3 is a flow chart of an image display method according to an embodiment of the present invention;

FIG. 4 is a flow chart of another image display method provided by the embodiment of the invention;

FIG. 5 is a schematic layout diagram of a panoramic window and a close-up window according to an embodiment of the present invention;

FIG. 6 is a schematic diagram of the relative positions of a panoramic window and a close-up window with display units according to an embodiment of the present invention;

FIG. 7 is a schematic diagram of the display effect of a panoramic window and a close-up window provided by the embodiment of the invention;

FIG. 8 is a flow chart of another image display method provided by the embodiments of the present invention;

FIG. 9 is a flowchart of a further image display method according to an embodiment of the present invention;

fig. 10 is a flowchart of a method for outputting a close-up code stream to a corresponding display unit in a video wall for display according to an embodiment of the present invention;

FIG. 11 is a flowchart of a further image display method according to an embodiment of the present invention;

fig. 12 is a schematic structural diagram of an image display device according to an embodiment of the present invention;

fig. 13 is a schematic structural diagram of another image display apparatus according to an embodiment of the present invention;

fig. 14 is a schematic structural diagram of a first output module according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Fig. 2 is an architecture diagram of an image display system according to an embodiment of the present invention, and referring to fig. 2, the system may include a camera 10, a terminal 20, a decoding apparatus 30, and a video wall 40, and the video wall 40 may include a plurality of display units (a display unit 1 and a display unit 2 are shown in fig. 2). As can be seen from fig. 2, the decoding device 30 may be configured with a video wall configuration module, a decoding chip 300 and a plurality of display chips, where each display chip corresponds to a display unit and is used to store a code stream to be displayed in the display unit. The video wall configuration module may receive a control instruction issued by the terminal 20, and issue an identifier of a camera to be connected to the streaming management module according to the control instruction, so that the streaming management module may establish a connection with the camera 10, obtain a video code stream acquired by the camera 10, and store the video code stream to a streaming buffer. In addition, the video wall configuration module may also issue related configuration information to the decoding chip 300 and each display chip, respectively, according to the control of the terminal. So that the decoding chip can decode the video code stream according to the configuration information and store the decoded code stream into a decoding buffer area; the display chip can acquire a code stream from the decoding buffer area and store the code stream to a designated video memory area according to the configuration information; and then output to the corresponding display unit through the output port to be displayed.

Fig. 3 is a flowchart of an image display method according to an embodiment of the present invention, which can be applied to the decoding device 30 in the image display system shown in fig. 2. As shown in fig. 3, the method may specifically include:

and step 101, receiving close-up display instructions, wherein the close-up display instructions carry the identification of the panoramic image and the position information of the close-up area in the panoramic image.

The close-up display instruction may be transmitted by the terminal, and the close-up display instruction may be triggered by the user performing a preset operation on the panoramic image through the input device. The identification of the panoramic image may refer to the identification of the camera that captured the panoramic image. In an optional implementation manner, a user may draw a graphic frame in a preset shape in a certain panoramic image displayed on a television wall or a terminal display screen through a mouse, and the terminal may obtain an identifier of the panoramic image operated by the user according to the above operation, and determine an area in the panoramic image, which is located in the graphic frame, as a close-up area. And then generating close-up display instructions according to the identification of the panoramic image and the position information of the close-up area in the panoramic image, and sending the close-up display instructions to the decoding device.

And 102, acquiring a close-up code stream corresponding to the close-up area from the video code stream of the panoramic image according to the position information.

After receiving the close-up display instruction, the decoding device may first acquire the video code stream acquired by the camera indicated by the identifier, and then clip the acquired video code stream according to the position information of the close-up area in the panoramic image, so as to obtain the close-up code stream corresponding to the close-up area.

And 103, outputting the close-up code stream to a corresponding display unit in the television wall for display.

In the embodiment of the present invention, the decoding apparatus stores the correspondence between the close-up area and the display unit in advance, or configures the correspondence between the close-up area and the display unit through the terminal, which is not limited herein. The decoding device can determine a display unit for displaying the close-up area according to the corresponding relation, and further can output the acquired close-up code stream to the corresponding display unit for displaying.

In summary, the embodiment of the present invention provides an image display method, where after receiving a close-up display instruction issued by a terminal, a decoding device may directly obtain, according to location information of a close-up area in a panoramic image, a close-up code stream corresponding to the close-up area from a video code stream of the panoramic image, and output the close-up code stream to a corresponding display unit. In the process of displaying the close-up image, the decoding equipment can directly process the acquired video code stream of the panoramic image without acquiring the close-up code stream from the camera, so that the occupation of excessive network resources can be avoided.

Fig. 4 is a flowchart of another image display method according to an embodiment of the present invention, where the image display method may be applied to the system shown in fig. 2, and referring to fig. 4, the method may specifically include:

step 201, the terminal sends a display instruction aiming at the target camera to the decoding device.

The display instruction may include an identification of the target camera and position information of a single-screen window on the television wall for displaying the panoramic image separately. The display instruction can be generated by a user according to a preset operation trigger; the identification of the target camera may be a network address of the target camera, or may also be an identification capable of uniquely identifying the camera, such as a factory serial number of the target camera; the position information may indicate the orientation of the single-screen window on the television wall and the size of the occupied area. And the shape, size and orientation of the single-screen window on the television wall can be preset in the terminal or can be selected by the user.

When the single-screen window is a polygon with a regular shape, the position information may include coordinates of each endpoint of the single-screen window in a television wall coordinate system, or may also include coordinates of a plurality of endpoints of the single-screen window in the television wall coordinate system and lengths of a plurality of sides of the single-screen window. When the single-screen window is circular, the position information may include coordinates of a center of the single-screen window in a coordinate system of the television wall and a radius of the single-screen window. For example, if the single-screen window is a rectangular window, the position information may include coordinates of two end points on any diagonal line of the rectangular window in a coordinate system of the television wall; alternatively, the position information may further include coordinates of an endpoint of an upper left corner of the rectangular window, and a length and a width of the rectangular window.

For example, assuming that a user wishes to display an image captured by a target camera a on a television wall, the user may select the target camera a in a camera list displayed on a terminal through a single-click operation; alternatively, the user may select the panoramic image a1 captured by the target camera a from among the plurality of panoramic images displayed on the terminal. Further, the user may select a display area of the single screen window in a wall pattern displayed in the terminal through an input device (e.g., a mouse). After receiving the operation, the terminal can generate a display instruction according to the identification of the target camera selected by the user and the position information of the single-screen window.

Step 202, the decoding device obtains the video code stream of the panoramic image collected by the target camera according to the display instruction.

After receiving the display instruction, the decoding device can establish communication connection with the target camera according to the identifier in the display instruction, and acquire the video code stream of the panoramic image acquired by the target camera. Specifically, when the identifier in the display instruction is the network address of the target camera, the decoding device may directly establish a communication connection with the target camera according to the network address; when the identifier in the display instruction is an identifier such as a factory serial number, the decoding device may determine the network address of the target camera according to a correspondence between a pre-stored identifier and the network address, and then establish communication connection with the network address.

Further, referring to fig. 2, the decoding device may obtain the video code stream through the stream fetching management module, and store the video code stream into the stream fetching buffer. Meanwhile, the decoding device can also create a layer for the video code stream, wherein the layer only comprises a single-screen window for displaying the panoramic image; and, the decoding apparatus may allocate a corresponding decoding chip processing resource to the single-screen window. After the decoding chip acquires the video code stream from the stream taking buffer area, the video code stream of the panoramic image can be decoded according to a preset decoding rule; or, the decoding rule may also be issued along with the video code stream, which is not limited in the embodiment of the present invention.

And 203, outputting the video code stream of the panoramic image to at least one display unit corresponding to the single-screen window by the decoding equipment for displaying.

In the embodiment of the present invention, referring to fig. 2, it can be known that a plurality of display chips may be configured in the decoding apparatus, wherein each display chip outputs a video code stream to one display unit on a television wall. For example, the display chip 1 may output the video stream to the display unit 1 through the output port 1, and the display chip 2 may output the video stream to the display unit 2 through the output port 2. After the decoding chip allocated to the single-screen window in the decoding device completes the decoding operation of the video code stream, the decoded video code stream can be output to a decoding buffer area of the decoding device. Then, the target display chip in the decoding device may obtain the video code stream from the decoding buffer, and output the video code stream to a corresponding display unit for display. The target display chip is used for driving the display unit corresponding to the single-screen window.

Specifically, the decoding device may determine at least one display unit for displaying the image in the single-screen window according to the position information of the single-screen window on the television wall and the position information of each display unit on the television wall. That is, the decoding chip may determine at least one display unit overlapping the single screen window on the television wall as the at least one display unit corresponding to the single screen window.

When the display unit on the television wall, which overlaps with the single-screen window, includes a plurality of display units, the decoding device further needs to segment the single-screen window according to the overlapping condition of the single-screen window and each display unit, so as to obtain a window block corresponding to each display unit. For example, as shown in fig. 2, since the images in the single-screen window need to be tiled for display by the display units 1 and 2, the decoding apparatus can split the single-screen window into two window blocks corresponding to the two display units. Further, the decoding device may determine, according to the position of each window block on the corresponding display unit, a video memory offset of the code stream to be displayed in each window block in the display chip. Then, a decoding chip allocated to the single-screen window in the decoding device may segment the decoded video code stream according to the position of each window block on the corresponding display unit, so as to obtain a path of code stream corresponding to each display unit. Finally, the decoding chip in the decoding device can output the segmented code stream to the corresponding display chip, and the display chip can copy the received code stream according to the video memory offset and output the copied code stream to the corresponding display unit through an output port, so that the splicing display of the panoramic image acquired by the target camera on the television wall is completed.

And step 204, the terminal sends a window configuration instruction aiming at the target camera to the decoding equipment.

In the embodiment of the invention, when a user needs to zoom in one or more areas in the panoramic image acquired by the target camera, the user can trigger the terminal to display the window configuration interface by executing the preset operation, and the user can select or input the number of the close-up windows in the window configuration interface. After the terminal determines the number of the close-up windows according to the selection or the output operation of the user, the terminal can directly determine the arrangement mode between the panoramic window and the close-up windows according to the pre-stored arrangement model; of course, the user may also adjust the arrangement pattern of the plurality of windows autonomously. Then, the terminal can generate a window configuration instruction according to the operation trigger of the user, and the window configuration instruction can include the position information of the panoramic window on the television wall, the number of the feature windows associated with the panoramic window, and the position information of each feature window on the television wall.

The panoramic window is used for displaying a panoramic image collected by the target camera, and each close-up window is used for displaying a close-up image of one close-up area on the panoramic image. The panoramic window and the position information of each close-up window can be determined by dividing the single-screen window by the terminal according to the number of the close-up windows and the arrangement mode of the close-up windows and the panoramic window. That is, the panoramic window and the close-up window associated therewith may be obtained by repartitioning the single-screen window, and thus the at least one display unit corresponding to the single-screen window may include at least one display unit corresponding to the panoramic window and at least one display unit corresponding to each close-up window.

For example, it is assumed that panoramic images captured by two cameras are currently displayed on a television wall, and the panoramic images captured by the two cameras are also synchronously displayed on a display screen of the terminal. When a user needs to enlarge and display a plurality of areas in the panoramic image A1 collected by the target camera A, the panoramic image A1 can be selected by a mouse, and a right mouse button is clicked to trigger a terminal display window configuration interface. Further, the user may enter the number of close-up windows in the window configuration interface, e.g., the user may enter the number of close-up windows: 5; or the user may also directly select one of the multiple window configuration options provided by the window configuration interface, for example, the user may select the window configuration option: 1 × 5, the window configuration option: 1 × 5 represents: the 1 panorama window configures 5 associated close-up windows. The arrangement pattern of 1 panorama window and 5 associated feature windows pre-configured in the terminal may be as shown in fig. 5.

It should be noted that, in practical application, a user may also trigger the terminal to generate the window configuration instruction through other operations, for example, the window configuration instruction may be triggered through operations such as voice, touch, or double-click, and this is not specifically limited in the embodiment of the present invention.

And step 205, the decoding device determines at least one display unit corresponding to the panoramic window according to the position information of the panoramic window on the television wall and the position information of each display unit on the television wall.

In the embodiment of the present invention, the decoding device may store the position information of each display unit on the television wall, where the position information may be issued by the terminal in advance, or may be configured in advance in the decoding device, and is not limited herein. After receiving the window configuration instruction, the decoding device may determine, according to the position information of the panoramic window on the television wall and the position information of each display unit, the display unit overlapped with the panoramic window as the display unit corresponding to the display unit.

Step 206, the decoding device determines at least one display unit corresponding to each feature window based on the location information of each feature window on the television wall and the location information of each display unit on the television wall.

Further, the decoding device may determine the display unit that overlaps with each close-up window as the display unit corresponding thereto. In the embodiment of the present invention, after determining the correspondence between each window and the display unit, the decoding device may segment the layer created previously to obtain one panoramic window and at least one close-up window associated with the panoramic window.

For example, assume that a video wall includes 4 display units: display units 1 to 4, where positions of a panoramic window for displaying a video stream collected by the target camera a and 5 close-up windows related to the panoramic window on the television wall are shown in fig. 6, and the decoding apparatus may determine, according to an overlapping condition between each window and the display unit, a correspondence between each window and the display unit as shown in table 1. Wherein, the display unit corresponding to the panorama window 0 includes: display unit 1 to display unit 4, the display unit corresponding to the close-up window 1 is display unit 2, and the display unit corresponding to the close-up window 2 includes display unit 2 and display unit 3.

TABLE 1

And step 207, outputting the video code stream of the panoramic image to at least one display unit corresponding to the panoramic window for display by the decoding device.

After the decoding device receives the window configuration instruction, because the single-screen window is divided again, the video code stream of the panoramic image can be output to at least one display unit corresponding to the panoramic window again for display. That is, the panoramic image is displayed through the panoramic window.

For example, the decoding apparatus may segment the video code stream of the panoramic image a1 according to the relative position relationship between the panoramic window 0 and the four display units to obtain four segmented code streams, and correspondingly output the four segmented code streams to the display units 1 to 4 for display.

Step 208, the terminal sends close-up display instructions to the decoding device.

The close-up display instruction carries an identification of the panoramic image, location information of the close-up area in the panoramic image, and an identification of a close-up window for displaying the close-up area. The identifier of the panoramic image may refer to an identifier of a camera used for capturing the panoramic image. In an embodiment of the present invention, the user may select a close-up area in the panoramic image through a preset area selection operation, and may select a target close-up window for displaying the close-up area among at least one close-up window according to the preset window selection operation. The terminal can further calculate the position information of the close-up area in the panoramic image after determining the close-up area, generate close-up display instructions according to the position information, the identification of the panoramic image (such as the identification of the target camera) and the identification of the target close-up window, and send the close-up display instructions to the decoding device.

When the close-up area is a regular polygon, the position information of the close-up area in the panoramic image may include the coordinates of each endpoint in the coordinate system of the panoramic image, or may also include the coordinates of a plurality of endpoints in the coordinate system of the panoramic image, and the side lengths of a plurality of sides. For example, when the close-up area is rectangular, the position information may include the coordinates of the two end points on either diagonal line in the panoramic image coordinate system, or may also include the coordinates of the end point at the upper left corner, and the length and width of the close-up area. The panoramic image coordinate system may be a two-dimensional coordinate system with the lower left corner endpoint of the panoramic image as the origin.

For example, assuming that the user needs to display a close-up image through the close-up window 2 shown in fig. 6, the user may draw a rectangular frame 00 in the panoramic image displayed in the panoramic window 0 through the mouse, and the terminal may determine, according to the received selected operation, an area in the panoramic image within the rectangular frame 00 as the close-up area; thereafter, the user may drag the rectangular frame 00 into the area where the close-up window 2 is located through the mouse, and the terminal may determine the close-up window 2 as a target close-up window for displaying the close-up area according to the received operation.

It should be noted that, when the user triggers the terminal to generate the close-up display instruction through a preset operation, the user may first double-click the close-up window 2 through the mouse, so that the terminal may first select the close-up window 2 as a target close-up window; the user then draws a graphic box 00 in the panoramic image for the selected close-up area.

And step 209, the decoding device acquires the close-up code stream corresponding to the close-up area from the video code stream of the panoramic image according to the position information.

After receiving the close-up display instruction, the decoding device may first obtain the video code stream collected by the camera indicated by the identifier from the decoding buffer area, and then clip the obtained video code stream of the panoramic image according to the position information of the close-up area in the panoramic image carried in the instruction, so as to obtain the close-up code stream corresponding to the close-up area. Then, the decoding device may store the obtained special-write code stream into a decoding buffer. For example, in fig. 2, after the decoding chip in the decoding device acquires the close-up code stream 2 corresponding to the close-up area from the video code stream of the panoramic image, the close-up code stream 2 may be stored in the decoding buffer.

It should be noted that, when the decoding device processes the video code stream of the panoramic image, if the processing capability of the decoding chip previously allocated to the single-screen window for displaying the panoramic image is insufficient, the decoding device may also allocate a decoding chip for processing the close-up code stream to each camera separately.

Step 210, the decoding device determines at least one target display unit corresponding to the target close-up window for displaying the close-up area according to the corresponding relationship between the close-up window and the display units.

The decoding device may determine, from the identification of the close-up window carried in the close-up display instruction, a target close-up window for displaying the close-up area, and may determine, from the pre-stored correspondence of close-up windows to display units, at least one target display unit corresponding to the target close-up window.

By way of example, assume that the identification of the close-up window carried in the close-up display instruction is: 2, the decoding apparatus may determine that the close-up window 2 is the target close-up window, and may determine, according to the correspondence shown in table 1, that the target display unit corresponding to the target close-up window 2 is: a display unit 2 and a display unit 3.

The decoding device determines the blocking information of the target close-up window according to the relative position relationship between the target close-up window and each target display unit, step 211.

In an embodiment of the invention, the decoding device may segment the target close-up window according to the relative positional relationship between the target close-up window and each target display unit to obtain a window block corresponding to each target display unit. That is, the decoding apparatus may divide an area of the target feature window overlapping each target display unit into one window-block according to the target feature window and the position information of each target display unit on the television wall, thereby obtaining one window-block corresponding to each target display unit. The decoding device may then assign a unique identification to each window-block and calculate the position information of each window-block on the corresponding target display unit, i.e. the blocking information of the target close-up window, the identification of the window-block and the position information of each window-block on the corresponding target display unit.

For example, the target display unit corresponding to the target close-up window of 2 is assumed to be: display unit 2 and display unit 3, it can be seen with reference to fig. 6 that the decoding device can divide the part of the target close-up window 2 that overlaps with the display unit 2 into window-blocks 21 and the part that overlaps with the display unit 3 into window-blocks 22. Further, the decoding apparatus can also calculate the positional information of window-block 21 on display unit 2 and the positional information of window-block 22 on display unit 3, respectively. For example, the decoding apparatus may calculate coordinates of the upper left end point and the lower right end point of window block 21 within the coordinate system of display unit 2 with the lower left end point of display unit 2 as the origin, and take the coordinates of the two end points as the position information of window block 21 in display unit 2; accordingly, the decoding apparatus can calculate coordinates of the upper left corner end point and the lower right corner end point of the window block 22 in the coordinate system of the display unit 3 with the lower left corner end point of the display unit 3 as the origin, and use the coordinates of the two end points as the position information of the window block 22 in the display unit 3. Finally, the decoding device can generate the blocking information for the close-up window 2 from the identification of the two window-blocks, and the position information for each window-block.

And 212, segmenting the close-up code stream by the decoding equipment according to the block information of the target close-up window to obtain a path of segmented code stream corresponding to each target display unit.

The target close-up window is used for displaying the close-up area, and the block information of the target close-up window can prompt the block of the close-up area on each display unit, so that the decoding equipment can directly segment the close-up code stream according to the block information to obtain a segment code stream corresponding to each target display unit. Then, the decoding device may store the code stream obtained by the division into a decoding buffer.

By way of example, the decoding chip in the decoding device may segment the close-up region close-up code stream 2 according to the blocking information of the target close-up window 2, to obtain a first segmented code stream corresponding to the display unit 2, and a second segmented code stream corresponding to the display unit 3.

In step 213, the decoding device outputs each divided code stream to a corresponding target display unit for display.

In the embodiment of the present invention, after obtaining the blocking information of the target window, the decoding device may further calculate, according to the position information of each window block on the corresponding target display unit, an initial video memory address of each path of the split code stream when the split code stream is stored in the display chip of the corresponding target display unit; and then according to the initial video memory address, storing each path of the divided code stream in a video memory area behind the initial video memory address in a display chip of the corresponding target display unit. Because the display area of the display chip corresponds to the display area on the display unit, the segmented code stream is stored in the display area behind the calculated initial display address, and the corresponding area of the block area corresponding to the segmented code stream on the display unit can be displayed. And when the segmentation code streams stored in the plurality of display chips are all output to the corresponding display units, splicing display of the close-up area can be realized.

For example, the decoding device may calculate, from the blocking information of the target close-up window 2, a first start video memory address when the first split code stream is stored in the display chip 2 corresponding to the display unit 2, and a second start video memory address when the second split code stream is stored in the display chip 3 corresponding to the display unit 3. Then, the display chip 2 in the decoding device may store the first split code stream into a video memory area after the first start video memory address, and the display chip 3 may store the second split code stream into a video memory area after the second start video memory address. After the two display chips output the data stored in the video memory area to the corresponding display units, the display of the image blocks corresponding to the first split code stream in the window block 21 and the display of the image blocks corresponding to the second split code stream in the window block 22 can be realized, so that the splicing display of the close-up images is realized.

After the decoding device outputs the five close-up code streams to the corresponding display units, the display effect of the panoramic image collected by the target camera and the images of the five close-up areas selected by the user on the television wall can be as shown in fig. 7. As can be seen from fig. 7, the panoramic image a1 is displayed in the panoramic window 0, and the close-up images of one close-up area in the panoramic image a1 are respectively displayed in the close-up windows 1 to 5 around the panoramic window 0, which effectively improves the flexibility of image display.

It should be noted that, in the embodiment of the present invention, in order to ensure that the close-up area is normally displayed on the close-up window, the decoding device further needs to adjust the resolution of each of the divided code streams according to the resolution of each of the target display units, so that the resolution of each of the divided code streams is equal to the display resolution of the corresponding target display unit. After the adjustment of the resolution is finished, the decoding device stores the segmentation code stream into the corresponding display chip. The resolution of each display unit on the television wall may be a preset default resolution or a resolution set by a user through a terminal. After the user adjusts the default resolution of the display unit through the terminal, the terminal can issue the adjusted resolution to the corresponding display chip in the decoding device, so that the display chip can process the code stream to be output according to the resolution of the display unit.

It should be further noted that, after calculating the start video memory address of each split code stream stored in the display chip of the corresponding target display unit, the decoding device may further record a block information set of each close-up window, where the block information set may include the split information and the video memory information, and the video memory information includes the start video memory address of the split code stream corresponding to each window block. After the decoding equipment obtains the block information set of each close-up window, the block information set can be respectively issued to a decoding chip and a display chip, so that the decoding chip can acquire the close-up code stream of the close-up window from a decoding buffer area according to the block information set and then cut the code stream; after the display chip acquires the cut code stream from the decoding buffer area, the cut code stream can be stored into the corresponding video memory area according to the block information set. That is, the above steps 212 and 213 may be performed sequentially after the decoding apparatus generates the set of block information of the target feature window.

In addition, since the image displayed by the close-up window may need to be displayed by a plurality of display units in a splicing manner, in order to ensure synchronous display of the display units, the decoding device can store the block information set of each close-up window into the multicast buffer, and each display chip in the decoding device can simultaneously access the data stored in the multicast buffer. When the decoding device detects that the block information set of any close-up window block is updated, an update instruction (for example, an update terminal) can be sent to each display chip, wherein the update instruction is used for instructing each display chip to acquire the updated block information set, acquiring the segmentation code stream according to the updated block information set, and outputting the segmentation code stream after processing, so that the display consistency of the close-up image in each close-up window is ensured.

Further, according to the image display method provided by the embodiment of the present invention, the user may further adjust, by the terminal, a display area of any panoramic image on the television wall among the at least one panoramic image displayed on the television wall. Referring to fig. 8, after the step 213, the method may further include:

and 214, when a moving instruction aiming at the target panoramic image is received, pausing outputting the video code stream to the original panoramic display unit corresponding to the panoramic window for displaying the target panoramic image, and pausing outputting the close-up code stream to the original close-up display unit corresponding to each close-up window associated with the panoramic window.

In the embodiment of the invention, when a user needs to move a certain panoramic image, the panoramic image can be selected through the input device of the terminal and dragged to the specified position. The terminal may determine the image selected by the user as a target panoramic image according to the received operation, and issue a moving instruction for the target panoramic image to the decoding device, where the moving instruction may include an identifier of the target panoramic image and a target position to which the target panoramic image is to be moved.

In order to avoid confusion of image display and ensure that the panoramic image and the close-up image therein are displayed in the same area in an associated manner, the decoding device can determine the panoramic window and the associated close-up window of the panoramic image and process the panoramic window and the associated close-up window as a whole after receiving the moving instruction. That is, each layer (for cameras not equipped with feature-up windows, the layer may comprise only one panoramic window; for cameras equipped with feature-up windows, the layer may comprise one panoramic window and its associated feature-up window) is a basic unit of operation for the decoding device. Specifically, the decoding device may pause outputting the video code stream to an original panoramic display unit corresponding to a panoramic window for displaying the target panoramic image, and pause outputting the feature code stream to an original feature display unit corresponding to each feature window associated with the panoramic window.

And 215, emptying the video code stream of the panoramic image stored in the display chip of the original panoramic display unit, and emptying the feature code stream stored in the display chip of the original feature display unit.

Further, in order to clear the display of the panoramic image and the associated close-up image on the original display unit, the decoding device may clear the video code stream of the panoramic image stored in the display chip of the original panoramic display unit, and clear the close-up code stream stored in the display chip of the original close-up display unit.

And step 216, determining at least one new panoramic display unit corresponding to the panoramic window and at least one new close-up display unit corresponding to each close-up window associated with the panoramic window according to the target position to which the target panoramic image needs to be moved.

The decoding device may re-determine, from the target position of the target panoramic image, at least one new panoramic display unit corresponding to the panoramic window and at least one new close-up display unit corresponding to each close-up window associated with the panoramic window. The step 205 and the step 206 may be referred to in the specific process of determining the display unit corresponding to each window, which is not described again in this embodiment of the present invention.

And step 217, outputting the video code stream of the target panoramic image to the at least one new panoramic display unit, and outputting the close-up code stream of each close-up area to the corresponding at least one new close-up display unit.

Finally, the decoding device can recalculate the block information set of each close-up window according to the newly determined display unit corresponding to each window, and combine and issue the block information to the decoding chip and the display chip respectively, the decoding chip can re-segment the close-up code stream according to the block information in the block information set, and each display chip can re-adjust and store the resolution of each path of segmented code stream according to the display information in the block information set, thereby realizing the migration display of the panoramic image and the close-up image.

For a specific implementation process of step 217, reference may be made to steps 210 to 213, which is not described again in this embodiment of the present invention.

It should be noted that, the image display method provided in the embodiment of the present invention may adjust the size of the display area occupied by the panoramic image and the close-up image thereof, in addition to the display area of the panoramic image. For example, the user may select a layer to which a certain panoramic image belongs by a mouse, and then drag the mouse to enlarge or reduce the layer. After receiving the above operation, the decoding device may recalculate the correspondence between each window and the display unit according to the adjusted layer size, and update the block information set according to the correspondence. The decoding chip can re-segment the close-up code stream according to the block information in the block information set, and each display chip can re-adjust and store the resolution of each segmented code stream according to the video memory information in the block information set, so that the adjustment of the size of the display area of the panoramic image and the close-up image is realized.

Fig. 9 is a flowchart of another image display method provided in an embodiment of the present invention, which may be applied to the decoding device 30 shown in fig. 2, and referring to fig. 9, the method may include:

step 301, receiving a window configuration instruction for a target camera.

The window configuration instructions are transmitted by the terminal, which may include information of the position of the panoramic window on the television wall, the number of close-up windows associated with the panoramic window, and information of the position of each close-up window on the television wall. The specific process of generating the window configuration instruction by the terminal may refer to step 204, which is not described herein again.

Step 302, determining at least one display unit corresponding to the panoramic window according to the position information of the panoramic window on the television wall and the position information of each display unit on the television wall.

The specific implementation process of step 302 may refer to step 205, which is not described herein again.

Step 303, determining at least one display unit corresponding to each feature window according to the position information of each feature window on the television wall and the position information of each display unit on the television wall.

Wherein the panoramic window is used for displaying the panoramic image, and each close-up window is used for displaying a close-up image of one close-up area. The specific implementation process of step 303 may refer to step 206, which is not described herein again.

And step 304, receiving close-up display instructions, wherein the close-up display instructions carry the identification of the panoramic image and the position information of the close-up area in the panoramic image.

And 305, acquiring a close-up code stream corresponding to the close-up area from the video code stream of the panoramic image according to the position information.

And step 306, outputting the close-up code stream to a corresponding display unit in the television wall for displaying.

The specific implementation process of the above steps 304 to 306 may refer to corresponding steps in the embodiment shown in fig. 3, or may refer to corresponding steps in the embodiment shown in fig. 4, which is not described herein again.

Optionally, in step 304, the close-up display instruction received by the decoding device may further include an identifier of a target close-up window for displaying the close-up area, and referring to fig. 10, step 306 may specifically include:

step 3061, determining at least one target display unit corresponding to the target close-up window for displaying the close-up area according to the corresponding relation between the close-up window and the display unit.

Step 3062, determining blocking information of the target close-up window according to the relative position relationship between the target close-up window and each target display unit.

The blocking information includes: an identification of a window-block in the target close-up window corresponding to each target display unit, and location information of each window-block on the corresponding target display unit.

Step 3063, segmenting the close-up code stream according to the block information of the target close-up window to obtain a path of segmented code stream corresponding to each target display unit.

Step 3064, outputting each divided code stream to the corresponding target display unit for displaying.

In the foregoing steps 3061 to 3034, the specific implementation process of each step may refer to the corresponding step in steps 210 to 213 in the embodiment shown in fig. 4, and details are not repeated here.

In an alternative implementation manner, the decoding apparatus is configured with a display chip for each display unit, and after determining the block information of the target close-up window in the step 3062, the decoding apparatus may further perform the following operations:

step 3065, according to the position information of each window block on the corresponding target display unit, calculating the initial video memory address of each path of the divided code stream when the divided code stream is stored in the display chip of the corresponding target display unit.

Correspondingly, the step 3064 may specifically include: and storing each path of the divided code stream in a video memory area behind the initial video memory address in the display chip of the corresponding target display unit according to the initial video memory address of each path of the divided code stream obtained by calculation.

Because the display area of the display chip corresponds to the display area on the display unit, the segmented code stream is stored in the display area behind the calculated initial display address, and the corresponding area of the block area corresponding to the segmented code stream on the display unit can be displayed.

In an alternative implementation, after step 3065, the decoding apparatus may further perform the following operations:

step 3066, recording a block information set of each close-up window, wherein the block information set comprises the blocking information and the video memory information, and the video memory information comprises the initial video memory address of the segmentation code stream corresponding to each window block.

The decoding device may store the set of block information for each close-up window in a multicast buffer, the set of block information stored in the multicast buffer being accessible to both the decoding chip and the display chip.

Step 3067, when detecting that the block information set of any close-up window is updated, sending an update instruction to each display chip, wherein the update instruction is used for instructing each display chip to acquire the updated block information set.

After each display chip acquires the updated block information set, the segmentation code stream can be acquired again according to the updated block information set, and the segmentation code stream is output after being processed, so that the display consistency of the close-up image in each close-up window is ensured.

In an alternative implementation manner, in the embodiment shown in fig. 10, before performing the method shown in step 3064, the decoding apparatus may further perform the following operations:

step 3068, the resolution of each path of the divided code stream is adjusted, so that the resolution of each path of the divided code stream is equal to the display resolution of the corresponding target display unit. To ensure good display effect.

It should be noted that, for the specific implementation process of the step 3065 to the step 3068, reference may be made to the relevant description in the embodiment shown in fig. 4, and details are not repeated here.

In an alternative implementation manner, referring to fig. 11, before performing the method shown in step 301, the decoding apparatus may further perform the following operations:

and 307, receiving a display instruction aiming at the target camera, wherein the display instruction comprises position information of a single-screen window for independently displaying the panoramic image on the television wall.

And 308, acquiring a video code stream of the panoramic image acquired by the target camera according to the display instruction.

Step 309, outputting the video code stream of the panoramic image to at least one display unit corresponding to the single-screen window for displaying.

The specific implementation process of each step in step 307 to step 309 may refer to the corresponding step in step 201 to step 203 in the embodiment shown in fig. 4, and is not described herein again.

Accordingly, after step 301, the method may further comprise:

and 310, outputting the video code stream of the panoramic image to at least one display unit corresponding to the panoramic window for displaying.

And the corresponding at least one display unit of the single-screen window comprises at least one display unit corresponding to the panoramic window. The specific implementation process of step 310 may refer to step 207 in the embodiment shown in fig. 4, and is not described here again.

Optionally, in the embodiment shown in any one of fig. 3 and 9 to 11, when at least one panoramic image is displayed on the television wall, the decoding device may further perform the methods shown in steps 214 to 217 in the embodiment shown in fig. 8, so as to adjust the display area of any panoramic image and its associated close-up image on the television wall. In addition, the decoding apparatus may not perform the method shown in step 215 in the embodiment shown in fig. 8, which is not specifically limited in this embodiment of the present invention.

It should be noted that, the order of the steps of the image display method provided in each embodiment of the present invention may be appropriately adjusted, and the steps may also be increased or decreased according to the situation. Any method that can be easily conceived by those skilled in the art within the technical scope of the present disclosure is covered by the protection scope of the present disclosure, and thus, the detailed description thereof is omitted.

Fig. 12 is a schematic structural diagram of an image display apparatus according to an embodiment of the present invention, where the image display apparatus may be configured in the decoding device 30 shown in fig. 2, and referring to fig. 12, the apparatus may include:

and the receiving module 401 is configured to receive a close-up display instruction, where the close-up display instruction carries an identifier of the panoramic image and location information of the close-up area in the panoramic image.

A first obtaining module 402, configured to obtain, according to the location information, a close-up code stream corresponding to the close-up area from a video code stream of the panoramic image.

And a first output module 403, configured to output the close-up code stream to a corresponding display unit in a video wall for display.

Optionally, the receiving module 401 may be further configured to receive, before receiving the close-up display instruction, a window configuration instruction for a target camera, where the window configuration instruction includes location information of a panoramic window on the television wall, the number of close-up windows associated with the panoramic window, and location information of each close-up window on the television wall, and the target camera is a camera that captures a video stream of the panoramic image.

Fig. 13 is a schematic structural diagram of another image display device according to an embodiment of the present invention, and referring to fig. 13, the device may further include: a first determining module 404, the first determining module 404 configured to:

and determining at least one display unit corresponding to the panoramic window according to the position information of each close-up window on the television wall and the position information of each display unit on the television wall.

The close-up display instruction further includes an identifier of a target close-up window for displaying the close-up area, fig. 14 is a schematic structural diagram of a first output module 403 provided by an embodiment of the present invention, and referring to fig. 14, the first output module 403 may specifically include:

a first determining unit 4031, configured to determine, according to the correspondence relationship between the close-up window and the display units, at least one target display unit corresponding to the target close-up window for displaying the close-up area.

A second determining unit 4032 for determining the piece information of the target close-up window based on the relative positional relationship between the target close-up window and each target display unit, the piece information including: an identification of a window-block in the target close-up window corresponding to each target display unit, and location information of each window-block on the corresponding target display unit.

And the segmenting unit 4033 is configured to segment the close-up code stream according to the blocking information of the target close-up window to obtain a segment of segmented code stream corresponding to each target display unit.

And the output unit 4034 is configured to output each divided code stream to a corresponding target display unit for display.

Optionally, the decoding apparatus is configured with a display chip for each display unit, and referring to fig. 14, the first output module 403 may further include:

a calculating unit 4035, configured to calculate, after determining the blocking information of the target close-up window, a starting video memory address when each split code stream is stored in the display chip of the corresponding target display unit according to the position information of each window block on the corresponding target display unit.

The output unit 4034 may be specifically configured to: and storing each path of the divided code stream in a video memory area behind the initial video memory address in the display chip of the corresponding target display unit according to the initial video memory address of each path of the divided code stream obtained by calculation.

A recording unit 4036, configured to record a block information set of each close-up window after calculating a start video memory address of each split code stream when stored in a display chip of the corresponding target display unit, where the block information set includes the block information and video memory information, and the video memory information includes the start video memory address of the split code stream corresponding to each window block.

An updating unit 4037, configured to, when it is detected that the block information set of any close-up window is updated, send an update instruction to each display chip, where the update instruction is used to instruct each display chip to acquire the updated block information set.

Optionally, referring to fig. 14, the first output module 403 may further include:

an adjusting unit 4038, configured to adjust a resolution of each of the divided code streams before outputting the divided code streams to the corresponding target display units respectively for display, so that the resolution of each of the divided code streams is equal to a display resolution of the corresponding target display unit.

Optionally, the receiving module 401 may be further configured to receive a display instruction for the target camera before receiving a window configuration instruction for the target camera, where the display instruction includes location information of a single-screen window on the television wall, where the single-screen window is used to separately display the panoramic image.

Further, referring to fig. 13, the image display device may further include:

and a second obtaining module 405, configured to obtain, according to the display instruction, a video code stream of the panoramic image collected by the target camera.

And a second output module 406, configured to output the video stream of the panoramic image to at least one display unit corresponding to the single-screen window for display.

A third output module 407, configured to output, after the window configuration instruction for the target camera is received, the video code stream of the panoramic image to at least one display unit corresponding to the panoramic window for display. And the corresponding at least one display unit of the single-screen window comprises at least one display unit corresponding to the panoramic window.

Optionally, at least one panoramic image is displayed in the television wall, and referring to fig. 13, the image display apparatus may further include:

and a pausing module 408, configured to, when receiving a moving instruction for the target panoramic image, pause outputting the video code stream to the original panoramic display unit corresponding to the panoramic window for displaying the target panoramic image, and pause outputting the close-up code stream to the original close-up display unit corresponding to each close-up window associated with the panoramic window.

A second determining module 409, configured to determine, according to the target position to which the target panoramic image needs to be moved, at least one new panoramic display unit corresponding to the panoramic window, and at least one new close-up display unit corresponding to each close-up window associated with the panoramic window.

A fourth output module 410, configured to output the video code stream of the target panoramic image to the at least one new panoramic display unit, and output the close-up code stream of each close-up area to the corresponding at least one new close-up display unit.

An emptying module 411, configured to empty a video code stream of the panoramic image stored in a display chip of the original panoramic display unit when a movement instruction for the target panoramic image is received; and emptying the feature code stream stored in the display chip of the original feature display unit.

In summary, the embodiment of the present invention provides an image display apparatus, where after receiving a close-up display instruction issued by a terminal, a decoding device may directly obtain, according to location information of a close-up area in a panoramic image, a close-up code stream corresponding to the close-up area from a video code stream of the panoramic image, and output the close-up code stream to a corresponding display unit. In the process of displaying the close-up image, the decoding equipment can directly process the acquired video code stream of the panoramic image without acquiring the close-up code stream from the camera, so that the occupation of excessive network resources can be avoided.

It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses, modules and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

The embodiment of the invention provides computer equipment which can comprise a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the bus; a memory for storing a computer program; and a processor, configured to execute the program stored in the memory to implement the image display method according to any one of the embodiments shown in fig. 3, 4, and 8 to 11.

An embodiment of the present invention provides a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the image display method provided in any one of the embodiments shown in fig. 3, 4, and 8 to 11.

Referring to fig. 2, an embodiment of the present invention further provides an image display system, which may include: at least one camera 10, a terminal 20, a decoding device 30 and a video wall 40.

The decoding apparatus 30 may include an image display device as shown in fig. 12 or 13, which may include the first output module shown in fig. 14.

The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

Claims

1. An image display method applied to a decoding apparatus, the method comprising:

receiving close-up display instructions carrying an identification of a panoramic image, position information of a close-up area in the panoramic image and an identification of a target close-up window for displaying the close-up area;

according to the blocking information of the target close-up window, segmenting the close-up code stream to obtain a path of segmented code stream corresponding to each target display unit; respectively outputting each path of the divided code stream to a corresponding target display unit for display;

a panoramic window for displaying the panoramic image and a close-up window associated with the panoramic window for displaying a close-up image of the close-up area are displayed in a television wall.

2. The method of claim 1, wherein prior to said receiving a close-up display instruction, the method further comprises:

receiving window configuration instructions for a target camera, wherein the window configuration instructions comprise position information of the panoramic window on the television wall, the number of the close-up windows and position information of each close-up window on the television wall, and the target camera is a camera for collecting a video code stream of the panoramic image;

determining at least one display unit corresponding to each feature window based on the location information of each feature window on the television wall and the location information of each display unit on the television wall.

3. The method according to claim 1, characterized in that a display chip is provided in the decoding device for each display unit, the method further comprising, after determining the blocking information of the target close-up window:

4. The method of claim 3, wherein after calculating a starting video memory address of each divided code stream stored in the display chip of the corresponding target display unit, the method further comprises:

5. The method of claim 1, wherein before outputting each divided code stream to a corresponding target display unit for display, the method further comprises:

6. The method of any of claims 2 to 5, wherein prior to said receiving a window configuration instruction for a target camera, the method further comprises:

7. The method of any of claims 1 to 5, wherein at least one panoramic image is displayed in the video wall, the method further comprising:

8. The method of claim 7, wherein when receiving a movement instruction for a target panoramic image, the method further comprises:

9. An image display apparatus, applied to a decoding device, the apparatus comprising:

a receiving module, configured to receive a close-up display instruction, where the close-up display instruction carries an identifier of a panoramic image, location information of a close-up area in the panoramic image, and an identifier of a target close-up window for displaying the close-up area;

the first output module is used for outputting the close-up code stream to a corresponding display unit in a television wall for display;

a panoramic window and a close-up window associated with the panoramic window are displayed in the television wall, the panoramic window is used for displaying the panoramic image, and the close-up window is used for displaying a close-up image of the close-up area;

the first output module includes:

10. The apparatus of claim 9,

the receiving module is further used for receiving a window configuration instruction aiming at a target camera before receiving a close-up display instruction, wherein the window configuration instruction comprises the position information of the panoramic window on the television wall, the number of the close-up windows and the position information of each close-up window on the television wall, and the target camera is a camera for collecting a video code stream of the panoramic image;

the device further comprises: a first determination module to:

11. The apparatus of claim 9, wherein the decoding device is configured with one display chip for each display unit, and the first output module further comprises:

the output unit is used for:

12. The apparatus of claim 11, wherein the first output module further comprises:

13. The apparatus of claim 9, wherein the first output module further comprises:

14. The apparatus according to any one of claims 10 to 13,

the receiving module is further configured to receive a display instruction for a target camera before receiving a window configuration instruction for the target camera, where the display instruction includes location information of a single-screen window on the television wall, where the single-screen window is used to separately display the panoramic image;

the device further comprises:

15. The apparatus of any of claims 9 to 13, wherein at least one panoramic image is displayed in the video wall, the apparatus further comprising:

16. The apparatus of claim 15, further comprising:

17. The computer equipment is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing the communication between the processor and the memory through the bus; a memory for storing a computer program; a processor for executing the program stored in the memory to implement the image display method according to any one of claims 1 to 8.

18. An image display system, characterized in that the system comprises: at least one camera, a terminal, a decoding device and a television wall;

the decoding apparatus comprising the image display device according to any one of claims 9 to 16.